AI RESEARCH

Learning Can Converge Stably to the Wrong Belief under Latent Reliability

arXiv CS.LG

ArXi:2603.21491v1 Announce Type: new Learning systems are typically optimized by minimizing loss or maximizing reward, assuming that improvements in these signals reflect progress toward the true objective. However, when feedback reliability is unobservable, this assumption can fail, and learning algorithms may converge stably to incorrect solutions. This failure arises because single-step feedback does not reveal whether an experience is informative or persistently biased.