Why Local Minima Aren’t the Problem We Thought They Were

Towards AI
Machine Learning AI Research

Visualizing the hidden low-loss paths that connect different neural network solutions.