AI & ML
MemForm: Benchmarking Memory Formation Poisoning in LLM Agents
arXiv cs.CR0 views
arXiv:2610.14431v2 Announce Type: replace Abstract: Long-term memory enables LLM agents to learn from past interactions but exposes memory formation to adversarial influence. Existing studies primarily organize memory poisoning by attack channels, corruption patterns, or lifecycle stages, leaving formation interfaces insufficiently characterized. We formulate Memory Formation Poisoning as adversarial manipulation of the interfaces through which persistent agent memory is produced and committed, and introduce MemForm, a controlled diagnostic benchmark covering five interfaces: Content, Evidence, Scope, Selection, and Path Poisoning. We introduce Selection and Path Poisoning as controlled intervention categories that isolate retention and consolidation order effects, respectively. Each category pairs clean and poisoned conditions with interface-specific controls. Evaluations across six LLMs and two response formats reveal broad susceptibility at all five interfaces under the evaluated memory protocols and implementations. Crucially, authentic experiences with successful outcomes do not guarantee reliable behavior after memory formation: changes to contextual support, retention, or consolidation order can induce undesirable downstream behavior. In particular, consolidation order can alter behavior even with identical retained experiences, depending on the memory formation procedure. Additional analyses show that interface applicability depends on memory architecture and that Path Poisoning susceptibility depends on the updater. The evaluated defenses provide incomplete mitigation that varies by interface. These findings motivate protecting both what is committed to persistent memory and how memory is formed from experiences. Code and data are available at https://github.com/opanhw/memform-code.
Source:https://arxiv.org/abs/2610.14431PreviousUK AI Weekly: Claude Code’s privacy patch shows AI agents need privacy by defaultNextWhen appearance and motion disagree: evaluating class-motion consistency against disguised uncrewed surface vessels
Related posts
I bought the knock-off Pixel Watch and Fitbit Air bands, and it’s crazy how good they are [Gallery]
09to5Google

Amazon will let you text Alexa your shopping list
0The Verge

TikTok’s For You page needs to change, says the EU
0The Verge

Stranger Things is getting a live-action spinoff called Other Worlds
0The Verge
The Cost of Self-Hosting Open-Source LLMs: GPUs, Staffing, and Operations
0dev.to
The central challenge of working with AI
0dev.to