AI RESEARCH
Scale Determines Whether Language Models Organize Representation Geometry for Prediction
arXiv CS.LG
•
ArXi:2605.17084v1 Announce Type: new In language models, what a representation encodes is determined by the geometry of its representation space: distances, not activations, carry meaning. Existing tools characterize the shape of this geometry but do not ask what that shape is organized for. We