AI RESEARCH

CRAFT: Forgetting-Aware Intervention-Based Adaptation for Continual Learning

arXiv CS.LG

ArXi:2605.05732v1 Announce Type: new Large language models (LLMs) can acquire new capabilities through fine-tuning, but continual adaptation often leads to catastrophic forgetting. We propose CRAFT, a continual learning framework that avoids updating model weights by instead learning low-rank interventions on hidden representations.