AI RESEARCH

Scalable Token-Level Hallucination Detection in Large Language Models

arXiv CS.AI

ArXi:2605.12384v1 Announce Type: cross Large language models (LLMs) have nstrated remarkable capabilities, but they still frequently produce hallucinations. These hallucinations are difficult to detect in reasoning-intensive tasks, where the content appears coherent but contains errors like logical flaws and unreliable intermediate results. While step-level analysis is commonly used to detect internal hallucinations, it suffers from limited granularity and poor scalability due to its reliance on step segmentation. To address these limitations, we propose TokenHD, a holistic pipeline for.