Why NVIDIA Paid $20B for Groq — and What It Means for AI Inference

Towards AI
AI Hardware

The Groq 3 LPX rack - 256 LPU chips, 128 GB SRAM, 640 TB/s internal bandwidth.