AI RESEARCH
ChessArena: A Chess Testbed for Evaluating Strategic Reasoning Capabilities of Large Language Models
arXiv CS.LG
•
ArXi:2509.24239v4 Announce Type: replace Recent large language models (LLMs) have shown strong reasoning capabilities. However, a critical question remains: do these models possess genuine strategic reasoning, or do they primarily excel at pattern recognition? To address this, we present ChessArena, a chess-based testbed for evaluating LLMs. Chess demands strategic reasoning, precise rule adherence, and the ability to track complex game states. ChessArena is a competitive framework where LLMs play against each other under four play modes.