Meta announces four new MTIA chips, focussed on inference

r/LocalLLaMA
Generative AI

Meta shared details on four generations of their custom MTIA chips (300-500), all developed in roughly two years. Meta's building their own silicon and iterating fast, a new chip roughly every 6 months, using modular chiplets where they can swap out pieces without redesigning everything. Notable: Inference-first design. MTIA 450 and 500 are optimized for GenAI inference, not