AI RESEARCH
Before the First Token: Scale-Dependent Emergence of Hallucination Signals in Autoregressive Language Models
arXiv CS.LG
•
ArXi:2604.13068v1 Announce Type: cross When do large language models decide to hallucinate? Despite serious consequences in healthcare, law, and finance, few formal answers exist. Recent work shows autoregressive models maintain internal representations distinguishing factual from fictional outputs, but when these representations peak as a function of model scale remains poorly understood.