Token-Level LLM Collaboration via FusionRoute

ArXi:2601.05106v3 Announce Type: replace Large language models (LLMs) exhibit strengths across diverse domains. However, achieving strong performance across these domains with a single general-purpose model typically requires scaling to sizes that are prohibitively expensive to train and deploy. On the other hand, while smaller domain-specialized models are much efficient, they struggle to generalize beyond their