AI RESEARCH
PolyGLU: State-Conditional Activation Routing in Transformer Feed-Forward Networks
arXiv CS.AI
•
ArXi:2603.13347v1 Announce Type: cross Biological neural systems employ diverse neurotransmitters -- glutamate, GABA, dopamine, acetylcholine -- to implement distinct signal-processing modalities within shared neural circuits. In contrast, modern transformers apply a single fixed activation function across all feed-forward neurons. We