AI RESEARCH
ARFBench: Benchmarking Time Series Question Answering Ability for Software Incident Response
arXiv CS.LG
•
ArXi:2604.21199v1 Announce Type: new Time series question-answering (TSQA), in which we ask natural language questions to infer and reason about properties of time series, is a promising yet underexplored capability of foundation models. In this work, we present ARFBench, a TSQA benchmark that evaluates the understanding of multimodal foundation models (FMs) on time series anomalies prevalent in software incident data. ARFBench consists of 750 questions across 142 time series and 5.38M data points from 63 production incidents sourced exclusively from internal telemetry at Datadog.