AI RESEARCH
Speech-Guided Multimodal Learning for Vocal Tract Segmentation in Real-Time MRI
arXiv CS.CV
•
ArXi:2605.18466v1 Announce Type: new Segmenting vocal tract articulators in real-time MRI (rtMRI) is a challenging dynamic image segmentation problem characterized by low contrast, rapid motion, and limited spatial resolution. However, while rtMRI acquisitions may provide synchronized acoustic signals, existing methods discard this information, and the few multimodal approaches that incorporate audio cannot be deployed when audio is unavailable. We propose a three-stage framework that leverages acoustic and phonological supervision during