AI RESEARCH

The Role of Symmetry in Optimizing Overparameterized Networks

arXiv CS.LG

ArXi:2604.25150v1 Announce Type: new Overparameterization is central to the success of deep learning, yet the mechanisms by which it improves optimization remain incompletely understood. We analyze weight-space symmetries in neural networks and show that overparameterization