AI RESEARCH
GIM: Evaluating models via tasks that integrate multiple cognitive domains
arXiv CS.LG
•
ArXi:2605.18663v1 Announce Type: cross As LLM benchmarks saturate, the evaluation community has pursued two strategies to increase difficulty: escalating knowledge demands (GPQA, HLE) or removing knowledge entirely in favor of abstract reasoning (ARC-AGI). The first conflates memorization with capability; the second divorces reasoning from the practical contexts in which it matters. We take a different approach.