AI & ML
Can LLMs Debug Robots by Editing Their Weights?
arXiv cs.RO0 views
arXiv:2611.09376v1 Announce Type: new Abstract: A language model can repair a robot policy's lexical instruction grounding by editing just 65 token-embedding rows. We bring weight-space programming to robot foundation policies: GPT-6 Astra reads weights and uses a CPU workspace and budgeted simulator feedback, without gradient updates or new demonstrations. Three independent sessions on $\pi_{0.5}$ all improve success on 765 held-out paraphrases; the best raises success from 86.3\% to 92.0\% (48 repairs, four regressions; exact paired $p=1.31\times10^{-10}$). Among the 335 instructions containing edited tokens, success rises from 74.3\% to 87.5\%; the other 430 episodes have zero outcome changes. Matched random-direction edits do not help. Full replacement using the editor's own lexicon explains much of the gain but produces more regressions; its direct difference from the editor is not significant at 0.05. Across 13 further robot sessions, the editor declines 12 candidates; the sole retained edit does not show a significant held-out gain. Separately, benchmark metadata lowers FastWAM success from 70.0\% to 48.6\%, while the evaluated VLA's aggregate rate is unchanged. The evidence supports precise lexical repair, not general acquisition of missing robot capabilities.
Source:https://arxiv.org/abs/2611.09376PreviousHorizon-Coupled Obstacle Guidance for Relative-Action Diffusion PoliciesNextMechanical Interaction Sensing for Robotic Kiwifruit Handling with an Optoelectronic Soft Suction Cup
Related posts
Startup Founder Interview: How Novera Is Turning Enterprise Infrastructure Into an Autonomous System
0HackerNoon
Startup Founder Interview: The Startup Using AI and Data to Improve Adoption and Foster Care
0HackerNoon

TurnWise Outperforms Streaming Video RL Baselines Across Three Benchmarks
0HackerNoon
TokenPulse: Building the Leadership Team Behind Cost-Efficient AI Inference
0HackerNoon
From Raw Sensor Signals to Regulatory-Grade Data: How Air Quality Monitoring Networks Are Engineered
0HackerNoon

Researchers Decrypt Hidden Chain-of-Thought From OpenAI, Anthropic and Google APIs
0HackerNoon