AI RESEARCH

Deep Neural Regression Collapse

arXiv CS.LG

ArXi:2603.23805v1 Announce Type: new Neural Collapse is a phenomenon that helps identify sparse and low rank structures in deep classifiers. Recent work has extended the definition of neural collapse to regression problems, albeit only measuring the phenomenon at the last layer. In this paper, we establish that Neural Regression Collapse (NRC) also occurs below the last layer across different types of models.