AI RESEARCH
Distilled Circuits: A Mechanistic Study of Internal Restructuring in Knowledge Distillation
arXiv CS.LG
•
ArXi:2505.10822v2 Announce Type: replace Knowledge distillation compresses a larger neural model (teacher) into smaller, faster student models by