AI RESEARCH
The Hrunting of AI: Where and How to Improve English Dialectal Fairness
arXiv CS.CL
•
ArXi:2603.15187v1 Announce Type: new It is known that large language models (LLMs) underperform in English dialects, and that improving them is difficult due to data scarcity. In this work we investigate how quality and availability impact the feasibility of improving LLMs in this context. For this, we evaluate three rarely-studied English dialects (Yorkshire, Geordie, and Cornish), plus African-American Vernacular English, and West Frisian as control. We find that human-human agreement when determining LLM generation quality directly impacts LLM-as-a-judge performance.