AI RESEARCH

Investigating self-supervised representations for audio-visual deepfake detection

arXiv CS.LG

ArXi:2511.17181v2 Announce Type: replace-cross Self-supervised representations excel at many vision and speech tasks, but their potential for audio-visual deepfake detection remains underexplored. Unlike prior work that uses these features in isolation or buried within complex architectures, we systematically evaluate them across modalities (audio, video, multimodal) and domains (lip movements, generic visual content). We assess three key dimensions: detection effectiveness, interpretability of encoded information, and cross-modal complementarity.