AI RESEARCH

Top-b: Entropic Regulation of Relative Probability Bands in Autoregressive Language Processes

arXiv CS.CL

ArXi:2603.14567v1 Announce Type: new Probabilistic language generators are theoretically modeled as discrete stochastic processes, yet standard decoding strategies (Top-k, Top-p) impose static truncation rules that fail to accommodate the dynamic information density of natural language. This misalignment often forces a suboptimal trade-off: static bounds are either too restrictive for high-entropy creative generation or too permissive for low-entropy logical reasoning. In this work, we formalize the generation process as a trajectory through a relative probability manifold. We.