AI RESEARCH
Understanding Annotator Safety Policy with Interpretability
arXiv CS.LG
•
ArXi:2605.05329v1 Announce Type: cross Safety policies define what constitutes safe and unsafe AI outputs, guiding data annotation and model development. However, annotation disagreement is pervasive and can stem from multiple sources such as operational failures (annotators misunderstand or misexecute the task), policy ambiguity (policy wording leaves room for interpretation), or value pluralism (different annotators hold different perspectives on safety). Distinguishing these sources matters.