AI RESEARCH

Correct Is Not Enough: Training Reasoning Planners with Executor-Grounded Rewards

arXiv CS.AI

ArXi:2605.03862v2 Announce Type: new Reinforcement learning with verifiable rewards has become a common way to improve explicit reasoning in large language models, but final-answer correctness alone does not reveal whether the reasoning trace is faithful, reliable, or useful to the model that consumes it. This outcome-only signal can reinforce traces that are right for the wrong reasons, overstate reasoning gains by rewarding shortcuts, and propagate flawed intermediate states in multi-step systems. To this end, we propose TraceLift, a planner-executor.