AI RESEARCH

OUI as a Structural Observable: Towards an Activation-Centric View of Neural Network Training

arXiv CS.LG

ArXi:2605.11570v1 Announce Type: new Activation functions are what make deep networks expressive: without them, the model collapses to a linear map. Yet we still evaluate