AI RESEARCH
Sign-Based Optimizers Are Effective Under Heavy-Tailed Noise
arXiv CS.LG
•
ArXi:2602.07425v2 Announce Type: replace While adaptive gradient methods are the workhorse of modern machine learning, sign-based optimization algorithms such as Lion and Muon have recently nstrated superior empirical performance over AdamW in