AI RESEARCH
[R] First open-source implementation of Hebbian fast-weight write-back for the BDH architecture
r/MachineLearning
•
The BDH (Dragon Hatchling) paper (arXi:2509.26507) describes a Hebbian synaptic plasticity mechanism where model weights update during inference. The released code computes the co-activation product and discards it, the write-back was never implemented publicly. I implemented it. The model rewrites its own decoder weights during inference using sparse activation codes as addresses. Same token always produces the same code regardless of position.