AI RESEARCH
Do Audio-Visual Large Language Models Really See and Hear?
arXiv CS.AI
•
ArXi:2604.02605v1 Announce Type: new Audio-Visual Large Language Models (AVLLMs) are emerging as unified interfaces to multimodal perception. We present the first mechanistic interpretability study of AVLLMs, analyzing how audio and visual features evolve and fuse through different layers of an AVLLM to produce the final text outputs. We find that although AVLLMs encode rich audio semantics at intermediate layers, these capabilities largely fail to surface in the final text generation when audio conflicts with vision.