AI RESEARCH

Beyond the Black Box: A Survey on the Theory and Mechanism of Large Language Models

arXiv CS.CL

ArXi:2601.02907v2 Announce Type: replace The rapid emergence of Large Language Models (LLMs) has precipitated a profound paradigm shift in Artificial Intelligence, delivering monumental engineering successes that increasingly impact modern society. However, a critical paradox persists within the current field: despite the empirical efficacy, our theoretical understanding of LLMs remains disproportionately nascent, forcing these systems to be treated largely as ``black boxes