The AI industry’s massive bet on transformer models may not be enough for true AGI
Fast Company Tech
•
Machine Learning
Generative AI
NLP
AI Research
AI Business
Welcome to AI Decoded, Fast Company ’s weekly newsletter that breaks down the most important news in the world of AI. You can to receive this newsletter every week via email here. Are the biggest AI labs betting on the wrong horse? Big AI companies are betting nearly all of their R&D and capital expenditure on the idea that pre-trained transformer models can deliver AI with human-level general intelligence. This approach relies heavily on backpropagation, the standard algorithm used to train deep neural networks.