AI RESEARCH
Double: Breaking the Acceleration Limit via Double Retrieval Speculative Parallelism
arXiv CS.CL
•
ArXi:2601.05524v2 Announce Type: replace Parallel Speculative Decoding (PSD) accelerates traditional Speculative Decoding (SD) by overlapping draft generation with verification. However, it remains hampered by two fundamental challenges: (1) a theoretical speedup ceiling dictated by the speed ratio between the draft and target models, and (2) high computational waste and pipeline stall due to mid-sequence token rejections of early errors. To address these limitations, we