AI RESEARCH
POTSA: A Cross-Lingual Speech Alignment Framework for Speech-to-Text Translation
arXiv CS.CL
•
ArXi:2511.09232v2 Announce Type: replace Speech Large Language Models have achieved breakthroughs in multilingual speech-to-text translation. However, existing approaches often overlook semantic commonalities across source languages, leading to biased translation performance. In this work, we propose POTSA (Parallel Optimal Transport for Speech Alignment), a new framework based on cross-lingual parallel speech pairs and Optimal Transport, designed to bridge high- and low-resource translation gaps. First, we