Length Value Model: Scalable Value Pretraining for Token-Level Length Modeling

ArXi:2604.27039v1 Announce Type: new Token serves as the fundamental unit of computation in modern autoregressive models, and generation length directly influences both inference cost and reasoning performance. Despite its importance, existing approaches lack fine-grained length modeling, operating primarily at the coarse-grained sequence level. We