AI RESEARCH
A Switching System Theory of Q-Learning with Linear Function Approximation
arXiv CS.LG
•
ArXi:2605.11021v1 Announce Type: new This paper develops a switching-system interpretation of Q-learning with linear function approximation (LFA) based on the joint spectral radius (JSR). We derive an exact linear switched model for the mean dynamics and relate convergence to stability of the corresponding switched system. The same construction is then used for stochastic linear Q-learning with independent and identically distributed (i.i.d.) observations and with Markovian observations.