AI RESEARCH

Constrained Stochastic Spectral Preconditioning Converges for Nonconvex Objectives

arXiv CS.LG

ArXi:2605.11850v1 Announce Type: cross In this work, we develop proximal preconditioned gradient methods with a focus on spectral gradient methods providing a proximal extension to the Muon and Scion optimizers. We