AI & ML
How Much Can Tool Calls Reveal About You? Privacy Leakage from Tool-Call Traces
arXiv cs.CR0 views
arXiv:2610.41885v1 Announce Type: new Abstract: Large language model (LLM)-based agents interact with external tools through protocols such as the Model Context Protocol (MCP), producing tool-call traces that may expose behavioral signals about users. In this work, we systematically study the risk of user-profile inference from MCP tool-call traces, where observers infer user attributes from protocol-valid tool interactions without access to user conversations. We introduce PrivacyTrace, a benchmark containing 1,000 synthetic user profiles and 4,000 agent trajectories across four domains, generated with real MCP tools from 25 servers. Experiments with four mainstream LLM attackers show that tool-call traces enable a 26.25% attack success rate for profile inference, compared with 17.97% from prior-based guessing. Further analysis reveals that tool arguments and returned results provide the main trace-grounded evidence, while linking traces across sessions further amplifies profiling risk. These findings demonstrate that MCP tool-call traces can act as effective behavioral side channels for user profiling, motivating the development of privacy-aware mechanisms for agent-tool interactions. Code and data are available at https://github.com/AI45Lab/PrivacyTrace.
Source:https://arxiv.org/abs/2610.41885PreviousWhat Standard Evaluations Hide About Detectors of Hijacked LLM Agents: Rare Attacks, Unseen Tools and Benchmark TransferNextSecPO: Principled Adversarial Training for Prompt Injection Security
Related posts
From disclosure to durable protection: lessons from CVE-2026-113341
0dev.to
Do AI crawlers read llms.txt? What three days of server logs show
0dev.to

About $50 per breach: inside the AI-agent campaigns that probed 1,200+ websites
0dev.to News

Robb Report Best of the Best 2030
0dev.to Design

Robb Report Best of the Best 2016
0dev.to Design
What "free" actually means in AI companion apps (November 2026)
0dev.to Discuss