AI RESEARCH
Pro-KLShampoo: Projected KL-Shampoo with Whitening Recovered by Orthogonalization
arXiv CS.LG
•
ArXi:2605.06316v1 Announce Type: new Optimizers that exploit the matrix structure of gradients are central to modern LLM pre-