AI RESEARCH
Unsupervised Process Reward Models
arXiv CS.LG
•
ArXi:2605.10158v1 Announce Type: new Process Reward Models (PRMs) are a powerful mechanism for steering large language model reasoning by providing fine-grained, step-level supervision. However, this effectiveness comes at a significant cost: PRMs require expert annotations for every reasoning step, making them costly and difficult to scale. Here, we propose a method for