AI & ML
Timing is Everything: Inferring Temporal Membership in Continually Updated Models
arXiv cs.CR0 views
arXiv:2611.05781v1 Announce Type: new Abstract: Continual model updating has become a common practice in the deployment of machine learning systems. However, the dynamic training behaviors give rise to new risks not sufficiently addressed by existing studies. In this paper, we present the first systematic study of temporal privacy risk in continually updated deep learning models. We formalize the notion of temporal membership in continually updated models. We then define the temporal membership inference attack, which seeks to infer whether and when individual samples were involved in model training, at both timestamp-level and interval-level granularities. To this end, we propose TMIA, a novel black-box attack that leverages bidirectional LSTMs to infer temporal membership from model outputs observed across successive updates. Through extensive experiments on three language models and three image classification models, we show that TMIA is highly effective and significantly outperforms existing baselines. Finally, we evaluate three potential defenses, revealing the trade-off between privacy protection and model utility.
Source:https://arxiv.org/abs/2611.05781PreviousPrivate Vulnerability Testing for User OversharingNextWhen File Ingestion Misleads Language Models: Measuring and Mitigating Divergences in Office Documents
Related posts
Factorized MLLM Embeddings for Composed Image Retrieval
0arXiv cs.IR
Trustworthy RAG: An Evaluation Agent for Detecting Misinformation and Knowledge Poisoning in Generative AI Systems
0arXiv cs.IR
Safety, or Just Capability? A Validity Audit of Agent-Safety Benchmarks
0arXiv cs.IR
When Is Complex Chunking Worth It? A Multi-Objective Evaluation of Chunking Methods at Scale
0arXiv cs.IR
IMFuse: Instance-Aware Multi-Layer Fusion for LLM-Enhanced Sequential Recommendation
0arXiv cs.IR
When Reviews Are Scarce: Structure-Aware Review Imputation for Recommendation in Realistic Sparse Review Settings
0arXiv cs.IR