AI & ML
Cross-Modal Backdoor Attack on Connector-based Multimodal Large Language Models
arXiv cs.CR0 views
arXiv:2605.07490v2 Announce Type: replace Abstract: Assembling multimodal large language models (MLLMs) from pretrained components has become a widely adopted practice in the open-source ecosystem, yet the supply-chain risks of lightweight connectors remain largely unexplored. We propose a cross-modal backdoor attack that exploits this gap. By poisoning only the connector with a single seed sample and a small set of augmented variants from one modality, the adversary establishes a compact malicious region in the shared latent space associated with a target output. A centroid extracted from this region then serves as a latent anchor for cross-modal activation: adversarial inputs from any other modality can be optimized offline to reach this anchor, triggering the target response without access to the deployed model. Evaluations on PandaGPT and NExT-GPT show same-modality attack success rates (ASR) up to 99.9%, with most cross-modal settings exceeding 95.0% ASR under bounded perturbations. Experiments on ChatBridge further demonstrate the attack's effectiveness across different connector architectures. The attack produces 0.0% backdoor leakage on clean inputs and maintains weight-cosine similarity above 0.97 relative to benign connectors. Existing defenses fail to neutralize the threat without substantial utility degradation, revealing that a single poisoned connector can establish a reusable backdoor pathway across modalities.
Source:https://arxiv.org/abs/2605.07490PreviousSST-Guard: Detecting and Characterizing Server-Side Google Analytics in the WildNextBehavioral Integrity Verification for AI Agent Skills
Related posts
VESTA: Visual Exploration with Statistical Tool Agents
0arXiv stat.CO
An interpretable semiparametric Bayesian machine learning model for high-dimensional circulating epigenetic signatures of multiple myeloma
0arXiv stat.CO
Quantum Nondecimated Wavelet Transform: Theory, Circuits, and Applications
0arXiv stat.CO
dapper: Data Augmentation for Private Posterior Estimation in R
0arXiv stat.CO
HAVAPlot: A Web-Based Scientific Visualization and Post-Processing Platform
0arXiv stat.CO
ISC Stormcast For Friday, November 20th, 2026 https://isc.sans.edu/podcastdetail/10188, (Fri, Nov 20th)
0SANS ISC