AI RESEARCH
Where to Bind Matters: Hebbian Fast Weights in Vision Transformers for Few-Shot Character Recognition
arXiv CS.LG
•
ArXi:2605.02920v1 Announce Type: cross Standard transformer architectures and lack mechanisms for rapid adaptation within an episode. In contrast, biological neural systems address this through fast synaptic updates that form transient associative memories during inference, a property known as Hebbian plasticity. In this paper, we conduct an empirical study of Hebbian Fast-Weight (HFW) modules integrated into multiple transformer backbones, including ViT-Small, DeiT-Small, and Swin-Tiny.