Backend
Leveraging Soft Prompts for Privacy Attacks in Federated Prompt Tuning
arXiv cs.CR0 views
arXiv:2601.06641v4 Announce Type: replace-cross Abstract: Membership inference attacks (MIAs) pose a serious privacy threat in federated learning (FL). While MIAs have been extensively studied in standard FL, the recent shift toward federated fine-tuning introduces new and largely unexplored attack surfaces. In this work, we show that federated prompt-tuning, which adapts pre-trained foundation models using lightweight input prefixes, exposes a novel and effective vector for membership inference. We propose PromptMIA, a membership inference attack tailored to federated prompt-tuning, in which a malicious server introduces adversarially crafted prompts and exploits their updates during collaborative training to determine whether a target data point belongs to a client's private dataset. We formalize this threat via a security game and demonstrate that PromptMIA achieves consistently high attack advantage across diverse benchmark datasets, substantially outperforming current SOTA federated MIAs. We also provide a theoretical lower bound on the attack advantage that explains the observed empirical behavior. Finally, we show that existing MIA defenses are often ineffective against PromptMIA, highlighting the need for defense mechanisms specifically tailored to prompt-tuning in federated settings.
Source:https://arxiv.org/abs/2601.06641PreviousUpSafe$^\circ$C: Upcycling for Controllable Safety in Large Language ModelsNextTROPT: An Open Framework for Unifying and Advancing Discrete Text Optimization
Related posts
Quantum estimates for classical polynomial optimization
0arXiv cs.NA
A Tensor-Network Chebyshev--Galerkin Method for Boundary-Value Problems in Computational Mechanics
0arXiv cs.NA
Linear adaptive variable time step schemes for the anisotropic phase field dendritic crystal growth model
0arXiv cs.NA
Magnetic Bloch eigenvalue problems in nonuniform periodic magnetic fields: a Fourier-finite difference approach
0arXiv cs.NA
Phantoms and Disclosures: A Statistical Framework for Auditing Privacy in Synthetic Data
0arXiv stat.ML
When the Agent Learns Too: Learning to Incentivize with Unobserved Rewards
0arXiv stat.ML