AI RESEARCH
A Step Toward Federated Pretraining of Multimodal Large Language Models
arXiv CS.AI
•
ArXi:2603.26786v1 Announce Type: cross The rapid evolution of Multimodal Large Language Models (MLLMs) is bottlenecked by the saturation of high-quality public data, while vast amounts of diverse multimodal data remain inaccessible in privacy-sensitive silos. Federated Learning (FL) offers a promising solution to unlock these distributed resources, but existing research focuses predominantly on fine-tuning, leaving the foundational pre-