AI & ML
How Much Can Tool Calls Reveal About You? Privacy Leakage from Tool-Call Traces
arXiv cs.CR0 views
arXiv:2610.41885v1 Announce Type: new Abstract: Large language model (LLM)-based agents interact with external tools through protocols such as the Model Context Protocol (MCP), producing tool-call traces that may expose behavioral signals about users. In this work, we systematically study the risk of user-profile inference from MCP tool-call traces, where observers infer user attributes from protocol-valid tool interactions without access to user conversations. We introduce PrivacyTrace, a benchmark containing 1,000 synthetic user profiles and 4,000 agent trajectories across four domains, generated with real MCP tools from 25 servers. Experiments with four mainstream LLM attackers show that tool-call traces enable a 26.25% attack success rate for profile inference, compared with 17.97% from prior-based guessing. Further analysis reveals that tool arguments and returned results provide the main trace-grounded evidence, while linking traces across sessions further amplifies profiling risk. These findings demonstrate that MCP tool-call traces can act as effective behavioral side channels for user profiling, motivating the development of privacy-aware mechanisms for agent-tool interactions. Code and data are available at https://github.com/AI45Lab/PrivacyTrace.
Source:https://arxiv.org/abs/2610.41885PreviousWhat Standard Evaluations Hide About Detectors of Hijacked LLM Agents: Rare Attacks, Unseen Tools and Benchmark TransferNextSecPO: Principled Adversarial Training for Prompt Injection Security
Related posts

Apple TV reportedly getting Justin Timberlake docuseries, announces new Toni Collette show
09to5Mac
DevRev delivers autonomous self-service with GPT-6.1 Sol
0OpenAI Blog
A thousand fewer paths to root
0OpenAI Blog
Ted Cruz aims to stack FCC with Republicans before Democrats take Senate control
0Ars Technica

17 better ways Elon Musk could have wasted $446 million
0The Verge
Snapchat surpasses 30M paid subscribers
0TechCrunch