Stochastic Attention: Connectome-Inspired Randomized Routing for Expressive Linear-Time Attention

ArXi:2604.00754v1 Announce Type: cross The whole-brain connectome of a fruit fly comprises over 130K neurons connected with a probability of merely 0.02%, yet achieves an average shortest path of only 4.4 hops. Despite being highly structured at the circuit level, the network's long-range connections are broadly distributed across brain regions, functioning as stochastic shortcuts that enable efficient global communication.