AI RESEARCH
MuonEq: Balancing Before Orthogonalization with Lightweight Equilibration
arXiv CS.LG
•
ArXi:2603.28254v1 Announce Type: new Orthogonalized-update optimizers such as Muon improve