AI RESEARCH
Not All Directions Matter: Toward Structured and Task-Aware Low-Rank Adaptation
arXiv CS.CV
•
ArXi:2603.14228v1 Announce Type: new Low-Rank Adaptation (LoRA) has become a cornerstone of parameter-efficient fine-tuning (PEFT). Yet, its efficacy is hampered by two fundamental limitations: semantic drift, by treating all update directions with equal importance, and structural incoherence, from adapting layers independently, resulting in suboptimal, uncoordinated updates.