AI RESEARCH
Why Fine-Tuning Encourages Hallucinations and How to Fix It
arXiv CS.AI
•
ArXi:2604.15574v1 Announce Type: cross Large language models are prone to hallucinating factually incorrect statements. A key source of these errors is exposure to new factual information through supervised fine-tuning (SFT), which can increase hallucinations w.r.t. knowledge acquired during pre-