AI RESEARCH
Are Non-English Papers Reviewed Fairly? Language-of-Study Bias in NLP Peer Reviews
arXiv CS.CL
•
ArXi:2604.07119v1 Announce Type: new Peer review plays a central role in the NLP publication process, but is susceptible to various biases. Here, we study language-of-study (LoS) bias: the tendency for reviewers to evaluate a paper differently based on the language(s) it studies, rather than its scientific merit. Despite being explicitly flagged in reviewing guidelines, such biases are poorly understood. Prior work treats such comments as part of broader categories of weak or unconstructive reviews without defining them as a distinct form of bias.