FedRot-LoRA: Mitigating Rotational Misalignment in Federated LoRA

ArXi:2602.23638v2 Announce Type: replace-cross Federated LoRA provides a communication-efficient mechanism for fine-tuning large language models on decentralized data. In practice, however, a discrepancy between the factor-wise averaging used to preserve low rank and the mathematically correct aggregation of local updates can cause significant aggregation error and unstable