AI RESEARCH
From Hallucination to Structure Snowballing: The Alignment Tax of Constrained Decoding in LLM Reflection
arXiv CS.CL
•
ArXi:2604.06066v1 Announce Type: new Intrinsic self-correction in Large Language Models (LLMs) frequently fails in open-ended reasoning tasks due to ``hallucination snowballing,'' a phenomenon in which models recursively justify early errors during free-text reflection. While structured feedback can mitigate this issue, existing approaches often rely on externally trained critics or symbolic tools, reducing agent autonomy. This study investigates whether enforcing structured reflection purely through Outlines-based constrained decoding can disrupt error propagation without additional.