AI RESEARCH

SkyReels-V4: Multi-modal Video-Audio Generation, Inpainting and Editing model

arXiv CS.CV

ArXi:2602.21818v3 Announce Type: replace SkyReels V4 is a unified multi modal video foundation model for joint video audio generation, inpainting, and editing. The model adopts a dual stream Multimodal Diffusion Transformer (MMDiT) architecture, where one branch synthesizes video and the other generates temporally aligned audio, while sharing a powerful text encoder based on the Multimodal Large Language Models (MLLM). SkyReels V4 accepts rich multi modal instructions, including text, images, video clips, masks, and audio references.