AI RESEARCH

How Does Alignment Enhance LLMs' Multilingual Capabilities? A Language Neurons Perspective

arXiv CS.AI

ArXi:2505.21505v3 Announce Type: replace-cross Multilingual Alignment is an effective and representative paradigm to enhance LLMs' multilingual capabilities, which transfers the capabilities from the high-resource languages to the low-resource languages. Meanwhile, some research on language-specific neurons provides a new perspective to analyze and understand LLMs' mechanisms. However, we find that there are many neurons that are shared by multiple but not all languages and cannot be correctly classified.