AI RESEARCH

Beyond the Birkhoff Polytope: Spectral-Sphere-Constrained Hyper-Connections

arXiv CS.AI

ArXi:2603.20896v1 Announce Type: cross Hyper-Connections (HC) generalize residual connections into multiple streams, employing residual matrices for cross-stream feature mixing to enrich model expressivity. However, unconstrained mixing disrupts the identity mapping property intrinsic to the residual connection, causing unstable