AI RESEARCH
Attention in Space: Functional Roles of VLM Heads for Spatial Reasoning
arXiv CS.AI
•
ArXi:2603.20662v1 Announce Type: new Despite remarkable advances in large Vision-Language Models (VLMs), spatial reasoning remains a persistent challenge. In this work, we investigate how attention heads within VLMs contribute to spatial reasoning by analyzing their functional roles through a mechanistic interpretability lens. We