AI RESEARCH
Screening Is Enough
arXiv CS.AI
•
ArXi:2604.01178v1 Announce Type: cross A core limitation of standard softmax attention is that it does not define a notion of absolute query--key relevance: attention weights are obtained by redistributing a fixed unit mass across all keys according to their relative scores. As a result, relevance is defined only relative to competing keys, and irrelevant keys cannot be explicitly rejected. We