AI RESEARCH
Fine-Tuning Without Forgetting via Loss-Adaptive Learning Rates
arXiv CS.LG
•
ArXi:2605.20005v1 Announce Type: new Fine-tuning large language models on new data improves task performance but degrades capabilities learned during pre