These AI Workstations Look Like PCs, but Pack a Stronger Punch

The rise of generative AI has spurred demand for AI workstations that can run or train models on local hardware. Yet modern PCs have proven inadequate for this task. A typical laptop only has enough memory to load a large language model (LLM) with 8 to 13B parameters - many times smaller, and much less intelligent, than frontier models that are presumed to have over a trillion parameters. Even the most capable workstation PCs struggle to serve LLMs with than 70B parameters. Tenstorrent’s QuietBox 2 is an attempt to fill that gap.