RNNs Cannot Think What Transformers Think Cheaply. ICLR 2026 Proved the Gap Is Exponential.
Towards AI
•
AI Research
For a decade, we asked if RNNs can represent what Transformers represent. We proved they can. We forgot to ask how expensively. That…