AI RESEARCH

DEER: A Benchmark for Evaluating Deep Research Agents on Expert Report Generation

arXiv CS.CL

ArXi:2512.17776v4 Announce Type: replace Recent advances in large language models have enabled deep research systems that generate expert-level reports through multi-step reasoning and evidence-based synthesis. However, evaluating such reports remains challenging: report quality is multifaceted, making it difficult to determine what to assess and by what criteria; LLM-based judges may miss errors that require domain expertise to identify; and because deep research relies on retrieved evidence, report-wide claim verification is also necessary.