AI RESEARCH

On the Expressive Power of Contextual Relations in Transformers

arXiv CS.LG

ArXi:2603.25860v1 Announce Type: cross Transformer architectures have achieved remarkable empirical success in modeling contextual relationships in natural language, yet a precise mathematical characterization of their expressive power remains incomplete. In this work, we