XAI Shows How Hard It Is to Use a Lot of GPUs at Once

The Information
AI Safety AI Hardware

AI developers have been desperately scrambling to get ahold of Nvidia server chips lately, as we wrote last week. When developers do get the graphics processing units, they’re under a lot of pressure to wring as much performance as possible from that expensive hardware. That’s easier said than done