Can LLMs Be Computers? (20 minute read)

Transformers can execute programs efficiently inside their own inference loop. This opens a path towards AI systems that integrate learned representations with compiled algorithms inside a single computational substrate. Solving humanity's toughest problems will require systems that can both reason flexibly and compute reliably. Future AI systems will have software as part of the model.