AI RESEARCH
Evaluating the Formal Reasoning Capabilities of Large Language Models through Chomsky Hierarchy
arXiv CS.AI
•
ArXi:2604.02709v1 Announce Type: cross The formal reasoning capabilities of LLMs are crucial for advancing automated software engineering. However, existing benchmarks for LLMs lack systematic evaluation based on computation and complexity, leaving a critical gap in understanding their formal reasoning capabilities. Therefore, it is still unknown whether SOTA LLMs can grasp the structured, hierarchical complexity of formal languages as defined by Computation Theory. To address this, we