Understanding the Most Viral Chart in Artificial Intelligence | Odd Lots

Bloomberg Tech
Generative AI AI Research

METR, which stands for Model Evaluation and Threat Researc, is focused on understanding the degree to which AI models can engage in autonomous, complex tasks. METR see this is as a particularly important benchmark, given the risk that AI could one day be engaged in recursive self improvement, taking humans out of the loop. But how do you really gauge a model's ability to do complex problems.