AI RESEARCH

Loopholing Discrete Diffusion: Deterministic Bypass of the Sampling Wall

arXiv CS.LG

ArXi:2510.19304v3 Announce Type: replace Discrete diffusion models offer a promising alternative to autoregressive generation through parallel decoding, but they suffer from a sampling wall: once categorical sampling occurs, rich distributional information collapses into one-hot vectors and cannot be propagated across steps, forcing subsequent steps to operate with limited information. To mitigate this problem, we