Behind millions of dollars of funding in AI sit enterprises with just a 5% average utilisation rate. Inference cost plus cost of ownership also rose to 41% from 34%

Well, Over the last few years after the Chat GPT rolled out, companies rushed to buy massive GPU fleets because AI demand exploded and compute was scarce but i think now it depends on than just utilization like utilization, scheduling, inference efficiency, routing, governance, energy access, and operational management. The irony hits perfect, the technology designed to have the most efficient impact on human lives has this huge inefficiency of infrastructure problem Where majority budget goes out in figuring out allocation of hardware.