AI RESEARCH
LLLMs: A Data-Driven Survey of Evolving Research on Limitations of Large Language Models
arXiv CS.AI
•
ArXi:2505.19240v3 Announce Type: replace-cross Large language model (LLM) research has grown rapidly, along with increasing concern about their limitations. In this survey, we conduct a data-driven, semi-automated review of research on limitations of LLMs (LLLMs) from 2022 to early 2025 using a bottom-up approach. From a corpus of 250,000 ACL and arXi papers, we identify 14,648 relevant papers using keyword filtering, LLM-based classification, validated against expert labels, and topic clustering (via two approaches, HDBSCAN+BERTopic and LlooM.