Mixed Precision Training: The Art of Teaching AI to Think in Multiple Languages at Once
Towards AI
•
AI Hardware
AI Research
In 2019, a research team at NVIDIA discovered they could train a model twice as fast by simply changing how numbers were d in memory.