AI RESEARCH
MAViD: A Multimodal Framework for Audio-Visual Dialogue Understanding and Generation
arXiv CS.CV
•
ArXi:2512.03034v2 Announce Type: replace We propose MAViD, a novel Multimodal framework for Audio-Visual Dialogue understanding and generation. Existing approaches primarily focus on non-interactive systems and are limited to producing constrained and unnatural human speech. The primary challenge of this task lies in effectively integrating understanding and generation capabilities, as well as achieving seamless multimodal audio-video fusion. To solve these problems, we propose a Conductor-Creator architecture that divides the dialogue system into two primary components.