AI RESEARCH
Test-Time Reasoners Are Strategic Multiple-Choice Test-Takers
arXiv CS.CL
•
ArXi:2510.07761v2 Announce Type: replace Large language models (LLMs) now give reasoning before answering, excelling in tasks like multiple-choice question answering (MCQA). Yet, a concern is that LLMs do not solve MCQs as intended, as work finds LLMs sans reasoning succeed in MCQA without using the question, i.e., choices-only. Such partial-input success is often linked to trivial shortcuts, but reasoning traces could reveal if choices-only strategies are truly shallow.