AI RESEARCH
Understanding Sensitivity of Differential Attention through the Lens of Adversarial Robustness
arXiv CS.LG
•
ArXi:2510.00517v2 Announce Type: replace Differential Attention (DA) has been proposed as a refinement to standard attention, suppressing redundant or noisy context through a subtractive structure and thereby reducing contextual hallucination. While this design sharpens task-relevant focus, we show that it also