AI RESEARCH

Curriculum Learning-Guided Progressive Distillation in Large Language Models

arXiv CS.AI

ArXi:2605.11260v1 Announce Type: cross Knowledge distillation is a key technique for transferring the capabilities of large language models (LLMs) into smaller, efficient student models. Existing distillation approaches often overlook two critical factors: the learning order of