AI RESEARCH

Rethinking Dataset Distillation: Hard Truths about Soft Labels

arXiv CS.LG

ArXi:2604.18811v1 Announce Type: new Despite the perceived success of large-scale dataset distillation (DD) methods, recent evidence finds that simple random image baselines perform on-par with state-of-theart DD methods like SRe2L due to the use of soft labels during downstream model