AI RESEARCH
The Power of Second Order Methods for Sequence Preconditioning
arXiv CS.LG
•
ArXi:2605.08390v1 Announce Type: new Sequence prediction methods for dynamical systems with long memory, i.e. marginally stable systems, typically achieve regret that grows polynomially with the hidden dimension of the underlying generative model. Universal Sequence Preconditioning (USP) is a method that compresses any sequence which comes from a linear dynamical system into a "preconditioned" sequence which requires exponentially shorter memory for accurate prediction.