AI RESEARCH

Graph Representation Learning Augmented Model Manipulation on Federated Fine-Tuning of LLMs

arXiv CS.LG

ArXi:2605.07961v1 Announce Type: new Federated fine-tuning (FFT) has emerged as a privacy-preserving paradigm for collaboratively adapting large language models (LLMs). Built upon federated learning, FFT enables distributed agents to jointly refine a shared pretrained LLM by aggregating local LLM updates without sharing local raw data. However, FFT-based LLMs remain vulnerable to model manipulation threats, in which adversarial participants upload manipulated LLM updates that corrupt the aggregation process and degrade the performance of the global