AI RESEARCH
Gating Enables Curvature: A Geometric Expressivity Gap in Attention
arXiv CS.LG
•
ArXi:2604.14702v1 Announce Type: new Multiplicative gating is widely used in neural architectures and has recently been applied to attention layers to improve performance and