AI RESEARCH

ArcGate: Adaptive Arctangent Gated Activation

arXiv CS.LG

ArXi:2605.14518v1 Announce Type: cross Activation functions are central to deep networks, influencing non-linearity, feature learning, convergence, and robustness. This paper proposes the Adaptive Arctangent Gated Activation (ArcGate) function, a flexible formulation that generates a broad spectrum of activation shapes via a three-stage non-linear transformation.