AI RESEARCH

Grokking or Glitching? How Low-Precision Drives Slingshot Loss Spikes

arXiv CS.LG

ArXi:2605.06152v1 Announce Type: new Deep neural networks exhibit periodic loss spikes during unregularized long-term