AI RESEARCH
DOS: Dependency-Oriented Sampler for Masked Diffusion Language Models
arXiv CS.CL
•
ArXi:2603.15340v1 Announce Type: new Masked diffusion language models (MDLMs) have recently emerged as a new paradigm in language modeling, offering flexible generation dynamics and enabling efficient parallel decoding. However, existing decoding strategies for pre-trained MDLMs predominantly rely on token-level uncertainty criteria, while largely overlooking sequence-level information and inter-token dependencies. To address this limitation, we propose Dependency-Oriented Sampler (DOS), a