AI RESEARCH

PokeGym: A Visually-Driven Long-Horizon Benchmark for Vision-Language Models

arXiv CS.CV

ArXi:2604.08340v1 Announce Type: new While Vision-Language Models (VLMs) have achieved remarkable progress in static visual understanding, their deployment in complex 3D embodied environments remains severely limited. Existing benchmarks suffer from four critical deficiencies: (1) passive perception tasks circumvent interactive dynamics; (2) simplified 2D environments fail to assess depth perception; (3) privileged state leakage bypasses genuine visual processing; and (4) human evaluation is prohibitively expensive and unscalable. We.