How Do Modern LLMs Cheat the Scaling Laws? (In a Good Way).

Towards AI
Generative AI AI Hardware

If you’ve been following LLMs closely, you’ve probably noticed a pattern: parameter counts explode, GPU bills explode, but inference still…