AI RESEARCH
Geometric Metrics for MoE Specialization: From Fisher Information to Early Failure Detection
arXiv CS.AI
•
ArXi:2604.14500v1 Announce Type: new Expert specialization is fundamental to Mixture-of-Experts (MoE) model success, yet existing metrics (cosine similarity, routing entropy) lack theoretical grounding and yield inconsistent