TLoRA: Task-aware Low Rank Adaptation of Large Language Models

ArXi:2604.18124v1 Announce Type: new Low-Rank Adaptation (LoRA) has become a widely adopted parameter-efficient fine-tuning method for large language models, with its effectiveness largely influenced by the allocation of ranks and scaling factors, as well as initialization. Existing LoRA variants typically address only one of these factors, often at the cost of increased