The Inference Shift
Stratechery
•
Generative AI
Agentic inference is going to be different than the inference we use today, and it will change compute infrastructure because speed won't matter when humans aren't involved.