AI RESEARCH

ACSAC: Adaptive Chunk Size Actor-Critic with Causal Transformer Q-Network

arXiv CS.LG

ArXi:2605.11009v1 Announce Type: new Long-horizon, sparse-reward tasks pose a fundamental challenge for reinforcement learning, since single-step TD learning suffers from bootstrapping error accumulation across successive Bellman updates. Actor-critic methods with action chunking address this by operating over temporally extended actions, which reduce the effective horizon, enable fast value backups, and temporally consistent exploration. However, existing methods rely on a fixed chunk size and therefore cannot adaptively balance reactivity against temporal consistency.