Accidentally discovered you can teach frozen MoE models new knowledge by just steering their expert routing — no training needed

r/LocalLLaMA
Generative AI Open Source AI

Was probing Gemma 4's MoE routing patterns out of curiosity and noticed something weird experts route differently when the model "knows" something vs. when it doesn't. So I recorded that difference and replayed it. Called it Adaptive Cognitive Intelligence (ACI). Result: A 154KB file makes Gemma 4 go from "Starfield is NOT available on PS5" (181 words, confidently wrong) → "Starfield released on PS5 in April 2026 with DualSense haptics" (31 words, correct). No weight modification. No LoRA. No RAG. Just routing.