AI RESEARCH

Copy-as-Decode: Grammar-Constrained Parallel Prefill for LLM Editing

arXiv CS.CL

ArXi:2604.18170v1 Announce Type: new LLMs edit text and code by autoregressively regenerating the full output, even when most tokens appear verbatim in the input. We study Copy-as-Decode, a decoding-layer mechanism that recasts edit generation as structured decoding over a two-primitive grammar: references an input line range,. emits new content.