AI RESEARCH
When Does Embedding Magnitude Matter? A Cross-Task Functional-Symmetry Framework
arXiv CS.LG
•
ArXi:2602.09229v3 Announce Type: replace Cosine similarity normalizes both sides; dot product normalizes neither. We propose a 2x2 framework that independently controls query-side and document-side normalization, exposing two intermediate variants (QNorm, DNorm) that have not been previously studied. On retrieval with four encoders, evaluated in-domain on MS MARCO and out-of-domain on BEIR, BRIGHT, and multi-hop QA, the unilateral variants outperform both cosine and dot product, with relative gains of up to +72% out-of-domain and +24% on downstream RAG.