AI & ML
Evolution Under Fire: Evolving Agent Safety Harnesses with Adaptive Injection Stressors
arXiv cs.CR0 views
arXiv:2611.22583v1 Announce Type: new Abstract: Tool-using language-model agents must act on information from untrusted emails, webpages, and documents. This creates a central security challenge: malicious instructions and legitimate task directives can arrive through the same interaction channel. Existing defenses are largely hand-designed and static, making further improvements dependent on repeated manual redesign. We introduce Evolution Under Fire, a staged framework that couples safety-harness evolution with adaptive stressor evolution. Utility-constrained, Pareto-scheduled tree search evolves complete executable safety harnesses from execution evidence while keeping the task model, benchmark, tools, and evaluator fixed. Adaptive stressor evolution then discovers utility-preserving attacks that guide a subsequent stage of harness evolution. On AgentDyn with GPT-4o-mini, an evolved harness reduces attack success from 50.4% to 3.0%, improves clean and attacked utility over the initial harness, and offers a stronger security-utility trade-off than reproduced defenses. On Agent-SafetyBench with Qwen2.5-7B-Instruct, harness evolution reduces attack success from 82.6% to 62.0% while retaining helpfulness and runtime validity. Evolved harnesses also transfer without further evolution to Qwen3.5-35B-A3B, reducing attack success from 32.1% to 0.9% while improving attacked-task utility.
Source:https://arxiv.org/abs/2611.22583PreviousHow Well Is My Artwork Protected? Predicting and Tailoring Protection against Style Mimicry by PersonalizationNextAdaptive LLM-Driven Honeypots vs. LLM-Driven Attackers: Does Narrative Coherence Improve Deception?
Related posts
Daily Dose of DevOps — Log pipeline: across multiple cloud platforms
0dev.to
Why browser agents waste tokens, and how to stop it
0dev.to
State of HTML 2026: built-in elements win, form controls still hurt
0dev.to
Making a portfolio of open public-sector projects that keeps itself honest
0dev.to
Keeping AI answers findable when you use ChatGPT, Claude and Gemini
0dev.to
What is the Model Context Protocol (MCP)? Tools, resources, transports and auth, explained by someone who built a server
0dev.to