AI RESEARCH
Optimizer-Model Consistency: Full Finetuning with the Same Optimizer as Pretraining Forgets Less
arXiv CS.LG
•
ArXi:2605.06654v1 Announce Type: new Optimizers play an important role in both pre