AI RESEARCH

A Patch-based Cross-view Regularized Framework for Backdoor Defense in Multimodal Large Language Models

arXiv CS.LG

ArXi:2604.04488v1 Announce Type: cross Multimodal large language models have become an important infrastructure for unified processing of visual and linguistic tasks. However, such models are highly susceptible to backdoor implantation during supervised fine-tuning and will steadily output the attacker's predefined harmful responses once a specific trigger pattern is activated. The core challenge of backdoor defense lies in suppressing attack success under low poisoning ratios while preserving the model's normal generation ability. These two objectives are inherently conflicting.