AI & ML
RefinementGuard: Counterexample-Directed Semantic Qualification for Hidden Agent-Tool Execution
arXiv cs.SE0 views
arXiv:2611.23611v1 Announce Type: cross Abstract: Tool runtimes can lower an agent-selected operation into a hidden parallel graph, reducing latency and context while risking semantic mistranslation. We introduce RefinementGuard: translation validation for hidden, effectful agent-tool lowerings, coupled to artifact-bound, fail-closed runtime admission. Qualification compares a candidate graph with an independent reference on isolated state using explicit parent-operation obligations. We evaluate two repository-level contracts, bug localization and patch validation, on controlled repositories. Among 100 activated, non-equivalent development/qualification faults adjudicated by one human, parent-semantic validation rejects 49/100 (operator-cluster bootstrap 95% CI [33.7%, 64.8%]). The objective is selective admission, not maximum mutation rejection: exact equality rejects 100/100 faults but also all 60 valid variants, whereas obligation-based validation accepts 60/60; its 51 residual misses identify concrete specification gaps. On a frozen disjoint input split, the held-out B2-B3 result is localization-only because 21 patch mutants fail structurally; B3 rejects 38/56 localization defects. In a controlled asynchronous-delay regime, the localization serial/guarded median-latency ratio is 4.50x, and hidden execution exposes 74.3% less parent-visible context than visible execution. Patch validation shows no demonstrated speedup; zero-delay runs expose overhead. End-to-end qualification thus detects lower-layer misses while preserving localization's parallelism.
Source:https://arxiv.org/abs/2611.23611PreviousMetaphIR: Corpus-Scale Applicability Analysis for LLVM Peephole OptimizationsNextEvaluating Governed LLM-Driven ML Experimentation: Lifecycle, Provenance, and Failure Metrics
Related posts
I checked 183 vibe-coded apps. 92% are almost blank to AI crawlers.
0dev.to
What a Rule Engine, a Model and a Graph Can Each Know About a Mule Chain
0dev.to

I made the model end every post with a question. The replies stayed the same
0dev.to
How powerful is modern "low-end" hardware?
0dev.to
The Test Guarding My List of Deliberate Bugs Made Every Bug Look Caught for a Month
0dev.to

The wait begins for GTA VI on PC
0The Verge