AI RESEARCH
Diagonal Linear Networks and the Lasso Regularization Path
arXiv CS.LG
•
ArXi:2509.18766v3 Announce Type: replace Diagonal linear networks are neural networks with linear activation and diagonal weight matrices. Their theoretical interest is that their implicit regularization can be rigorously analyzed: from a small initialization, the