AI RESEARCH

Fast Best-in-Class Regret for Contextual Bandits

arXiv CS.LG

ArXi:2510.15483v2 Announce Type: replace-cross We study the problem of stochastic contextual bandits in the agnostic setting, where the goal is to compete with the best policy in a given class without assuming realizability or imposing model restrictions on losses or rewards. In this work, we establish the first fast rate for regret relative to the best-in-class policy. Our proposed algorithm updates the policy at every round by minimizing a pessimistic objective, defined as a clipped inverse-propensity estimate of the policy value plus a variance penalty.