AI RESEARCH
Understanding LoRA as Knowledge Memory: An Empirical Analysis
arXiv CS.LG
•
ArXi:2603.01097v2 Announce Type: replace Continuous knowledge updating for pre-trained large language models (LLMs) is increasingly necessary yet remains challenging. Although inference-time methods like In-Context Learning (ICL) and Retrieval-Augmented Generation (RAG) are popular, they face constraints in context budgets, costs, and retrieval fragmentation. Departing from these context-dependent paradigms, this work investigates a parametric approach using Low-Rank Adaptation (LoRA) as a modular knowledge memory.