AI RESEARCH
Towards Efficient and Expressive Offline RL via Flow-Anchored Noise-conditioned Q-Learning
arXiv CS.LG
•
ArXi:2605.01663v1 Announce Type: new We propose Flow-Anchored Noise-conditioned Q-Learning (FAN), a highly efficient and high-performing offline reinforcement learning (RL) algorithm. Recent work has shown that expressive flow policies and distributional critics improve offline RL performance, but at a high computational cost. Specifically, flow policies require iterative sampling to produce a single action, and distributional critics require computation over multiple samples (e.g., quantiles) to estimate value. To address these inefficiencies while maintaining high performance, we.