AI RESEARCH

BAS: A Decision-Theoretic Approach to Evaluating Large Language Model Confidence

arXiv CS.CL

ArXi:2604.03216v1 Announce Type: new Large language models (LLMs) often produce confident but incorrect answers in settings where abstention would be safer. Standard evaluation protocols, however, require a response and do not account for how confidence should guide decisions under different risk preferences. To address this gap, we