AI RESEARCH
Loopholing Discrete Diffusion: Deterministic Bypass of the Sampling Wall
arXiv CS.LG
•
ArXi:2510.19304v3 Announce Type: replace Discrete diffusion models offer a promising alternative to autoregressive generation through parallel decoding, but they suffer from a sampling wall: once categorical sampling occurs, rich distributional information collapses into one-hot vectors and cannot be propagated across steps, forcing subsequent steps to operate with limited information. To mitigate this problem, we