AI RESEARCH
2nd of the 5th PVUW MeViS-Audio Track: ASR-SaSaSa2VA
arXiv CS.CV
•
ArXi:2604.23935v1 Announce Type: new Audio-based video object segmentation aims to locate and segment objects in videos conditioned on audio cues, requiring precise understanding of both appearance and motion. Recent audio-driven video segmentation methods extend MLLMs by fusing audio and visual features for end-to-end localization. Despite their promise, these approaches are computationally intensive, struggle with aligning temporal audio cues to dynamic video content, and depend on large paired audio-video datasets.