AI & ML
Agent Security is a Systems Problem
arXiv cs.CR0 views
arXiv:2605.18991v3 Announce Type: replace Abstract: We take the position that agent security must be approached as a systems problem: the AI model powering the agent must be treated as an untrusted component, and security invariants must be enforced at the system level. Through this lens, efforts to increase model robustness (the dominant viewpoint in the community) are insufficient on their own. Instead, we must complement existing efforts with techniques from the systems security domain. Based on our experience as cybersecurity researchers in operating systems, networks, formal methods, and adversarial machine learning, we articulate a set of core principles, grounded in decades of systems security research, that provide a foundation for designing agentic systems with predictable guarantees. As evidence, we analyze eleven representative real-world attacks on agents and discuss how systems principles, if realized, could have prevented these attacks. We also identify the research challenges that stand in the way of implementing these principles in agents.
Source:https://arxiv.org/abs/2605.18991PreviousGraphIP-Bench: How Hard Is It to Steal a Graph Neural Network, and Can We Stop It?NextGrammar-Constrained Decoding Can Jailbreak LLMs into Generating Malicious Code
Related posts
Test DOCX Breaks as a Many-to-One Conversion
0dev.to JavaScript
A Bayesian Optimized Biquad Filter-Burg Model for Real-Time EEG Phase Estimation
0arXiv eess.SP
Thought-deciphering via hierarchical EEG-to-text alignment
0arXiv eess.SP
Neuromorphic Decoding and Dynamical Image Reconstruction from Populations of Spiking Retinal Ganglion Cells
0arXiv eess.SP
Benchmarking Sensor-Fault Robustness in Forecasting
0arXiv eess.SP
Consistent Geometric Deep Learning via Hilbert Bundles and Cellular Sheaves
0arXiv eess.SP