AI & ML
GapLeak: When Privacy-Preserving LLM-based Web Agents Become a Privacy Risk
arXiv cs.CR0 views
arXiv:2611.22223v1 Announce Type: new Abstract: Large Language Model (LLM)-based web agents rely on data minimization and least privilege to protect user privacy. We show that these principles are necessary but insufficient: they constrain authorized sources, but not higher-sensitivity sources that remain reachable. A website can request a field unavailable from authorized sources, creating an information gap. To complete the task, a goal-driven agent may escalate to reachable but unauthorized sources and disclose accumulated sensitive information. We formalize this vulnerability as GapLeak, where an adversary exploits a legitimate web form without prompt injection or other malicious instructions. We evaluate GapLeak on three web-agent frameworks and six LLMs from Anthropic, Google, and OpenAI across recruitment, e-commerce, travel, and healthcare. GapLeak induces an average unauthorized disclosure of approximately 37%. The information gap is the primary driver: eliminating it reduces disclosure by more than 50%. Existing instruction-level defenses based on least privilege partially mitigate the vulnerability but often reduce task success. We propose submission-time verification, which filters unauthorized content before form submission, eliminating over 96% of unauthorized disclosures while preserving task success.
Source:https://arxiv.org/abs/2611.22223PreviousIs 4-Bit Quantization More Than Noise to a Chat Model's Safety Behaviour? Attributing Behavioural Shifts with Matched PerturbationsNextFrom Token Changes to Task Failures: Bit Flips in a Shared KV-Cache Block
Related posts
Nvidia Earnings; Office Convergence; OS Wars, AI Edition
0Stratechery
France Is Blaming Iran for the Fridge Cyberattack
0Schneier on Security
Apple iPhone Duo Gets a New Facial Unlock Option With iOS 27.3 Update
0FOSS Bytes
CMM. The cursed language that never really took off.
0dev.to Watercooler

I built a GitHub Action that scores pull requests and never auto-closes them
0dev.to GitHub
I built a Windows app to track Instagram follower and profile changes over time
0dev.to GitHub