AI RESEARCH

Spatial Reasoning is Not a Free Lunch: A Controlled Study on LLaVA

arXiv CS.CV

ArXi:2603.12545v1 Announce Type: new Vision-language models (VLMs) have advanced rapidly, yet they still struggle with basic spatial reasoning. Despite strong performance on general benchmarks, modern VLMs remain brittle at understanding 2D spatial relationships such as relative position, layout, and counting. We argue that this failure is not merely a data problem, but is closely tied to dominant design choices in current VLM pipelines: reliance on CLIP-style image encoders and the flattening of images into 1D token sequences with 1D positional encoding.