AI RESEARCH
Softpick: No Attention Sink, No Massive Activations with Rectified Softmax
arXiv CS.LG
•
ArXi:2504.20966v4 Announce Type: replace