AI RESEARCH
Unlocking Prompt Infilling Capability for Diffusion Language Models
arXiv CS.AI
•
ArXi:2604.03677v1 Announce Type: cross Masked diffusion language models (dLMs) generate text through bidirectional denoising, yet this capability remains locked for infilling prompts. This limitation is an artifact of the current supervised finetuning (SFT) convention of applying response-only masking. To unlock this capability, we extend full-sequence masking during SFT, where both prompts and responses are masked jointly. Once unlocked, the model infills masked portions of a prompt template conditioned on few-shot examples.