AI RESEARCH
Symbiotic-MoE: Unlocking the Synergy between Generation and Understanding
arXiv CS.CL
•
ArXi:2604.07753v1 Announce Type: cross Empowering Large Multimodal Models (LMMs) with image generation often leads to catastrophic forgetting in understanding tasks due to severe gradient conflicts. While existing paradigms like Mixture-of-Transformers (MoT) mitigate this conflict through structural isolation, they fundamentally sever cross-modal synergy and suffer from capacity fragmentation. In this work, we present Symbiotic-MoE, a unified pre-