AI RESEARCH
The Illusion of Specialization: Unveiling the Domain-Invariant "Standing Committee" in Mixture-of-Experts Models
arXiv CS.LG
•
ArXi:2601.03425v2 Announce Type: replace Mixture of Experts models are widely assumed to achieve domain specialization through sparse routing. In this work, we question this assumption by