TinyR1-32B-Preview: Boosting Accuracy with Branch-Merge Distillation

ArXi:2503.04872v3 Announce Type: replace-cross The challenge of reducing the size of Large Language Models (LLMs) while maintaining their performance has gained significant attention. However, existing methods, such as model distillation and transfer learning, often fail to achieve high accuracy. To address this limitation, we