AI & ML
Decision Models as Retrieval Gates Against Injection and Pollution
arXiv cs.IR0 views
arXiv:2611.08325v1 Announce Type: cross Abstract: Retrieved web text can carry instructions aimed at the language model, or synthetic pages written to mislead. We test whether released open-weight decision models, which answer typed questions about a text without generating tokens, can screen retrieved passages against both threats. On a benchmark of 1,000 questions over forum-style web pages with hidden injected instructions, a Kev-4B gate reads each passage's HTML. Attack success, measured automatically, falls from 27.9% with no defence to 13.6% with the published mitigations (sanitisation, normalisation and citation prompting) and to 5.7% with the gate added. The gate takes 76 ms per passage and wrongly flags 4 of 186 benign pages with instructions for human readers. Responsiveness on clean queries stays within a point (85.6% to 86.2%). On a 200-query pollution testbed where two thirds of the candidate pages are fake, filtering the pool before the top ten are chosen keeps fake pages out of the answer (0.5% exposure) and holds accuracy at 83%, against 28% with no filter. Filtering only the top ten leaves the generator too few pages to answer. Large LLMs used as judges rank attacks better (AUROC 0.99 against 0.94) but cost ten times more. Gates catch more attacks when they read the page's HTML than when they read its plain text. Every model is open-weight.
Source:https://arxiv.org/abs/2611.08325PreviousArcadeDB in Python: An In-Process Multi-Model DatabaseNextFloodSQL-Bench: A Retrieval-Augmented Benchmark for Geospatially-Grounded Text-to-SQL
Related posts
Federated AI Still Has a Central Coordinator Problem
0HackerNoon

The iPhone Duo has more than 100,000 optimized apps, Apple says
0The Verge
Product JSON-LD for WooCommerce: the fields AI shopping answers can actually use
0dev.to
It's a weird time to buy a laptop, but the new MacBook Pro doesn't skimp on quality
0Ars Technica
Could potential AI clones of GTA VI force a quicker official port?
0Ars Technica

AI is the new dating dealbreaker
0The Verge