AI RESEARCH

Focus on the Core: Empowering Diffusion Large Language Models by Self-Contrast

arXiv CS.CL

ArXi:2605.01373v1 Announce Type: new The iterative denoising paradigm of Diffusion Large Language Models (DLMs) endows them with a distinct advantage in global context modeling. However, current decoding strategies fail to leverage this capability, typically exhibiting a local preference that overlooks the heterogeneous information density within the context, ultimately degrading generation quality.