Open Source
STAR: Steering Action Representations during Inference
arXiv cs.RO0 views
arXiv:2610.41009v1 Announce Type: new Abstract: Vision-language-action models (VLAs) map language instructions and visual observations to robot actions, showing strong capabilities across robotic manipulation tasks. However, in our probing experiment, we find that action representations near the action output do not fully preserve task-relevant visual grounding. Motivated by this late-layer grounding gap, we introduce STAR, for STeering Action Representations, a training-free inference method for pre-trained VLAs. STAR applies an exponential moving average over late-layer residual updates, allowing later action representations to inherit object-aware update directions from earlier layers without model updates or architectural changes. It further uses recent proprioceptive states to adapt the mixing strength, using conservative mixing when execution dynamics change rapidly. Experiments on robot manipulation benchmarks show that STAR improves late-layer object awareness and increases average task success rates by 4.0 percentage points. Our code is available at https://github.com/PKU-VaLuE-Lab/STAR.
Source:https://arxiv.org/abs/2610.41009PreviousConfidence-Modulated Safety Filtering for End-to-End PoliciesNextContact Imitation Interface: Transferring Dexterous Skills by Showing How Contact Unfolds
Related posts

Buckle: Let AI agent work on remote machine without giving SSH access
0dev.to OpenSource

Conductor vs Claude Squad vs Hermes IDE: 3 Worktree Managers for Parallel Agents
0dev.to Git
Clannect UI & Navigation Update: A Smoother Way to Explore
0dev.to WebDev

Apple Arcade Adds Crossy Road Rush and NBA 2K27
0MacRumors
Dbt-lineage – see what a dbt change breaks, without a warehouse
0Hacker News New
Show HN: Bisimia – A TLA+ environment that runs in the browser
0Hacker News Show