Emergent Semantic Role Understanding in Language Models

ArXi:2605.09187v1 Announce Type: new Understanding how linguistic structure emerges in language models is central to interpreting what these systems learn from data and how much supervision they truly require. In particular, semantic role understanding ("who did what to whom") is a core component of meaning representation, yet it remains unclear whether it arises from pre-