AI RESEARCH

Tiny Autoregressive Recursive Models

arXiv CS.LG

ArXi:2603.08082v1 Announce Type: new Tiny Recursive Models (TRMs) have recently nstrated remarkable performance on ARC-AGI, showing that very small models can compete against large foundation models through a two-step refinement mechanism that updates an internal reasoning state $z$ and the predicted output $y$. Naturally, such refinement is of interest for any predictor; it is therefore natural to wonder whether the TRM mechanism could be effectively re-adopted in autoregressive models.