Open Source
STAR: Steering Action Representations during Inference
arXiv cs.RO0 views
arXiv:2610.41009v1 Announce Type: new Abstract: Vision-language-action models (VLAs) map language instructions and visual observations to robot actions, showing strong capabilities across robotic manipulation tasks. However, in our probing experiment, we find that action representations near the action output do not fully preserve task-relevant visual grounding. Motivated by this late-layer grounding gap, we introduce STAR, for STeering Action Representations, a training-free inference method for pre-trained VLAs. STAR applies an exponential moving average over late-layer residual updates, allowing later action representations to inherit object-aware update directions from earlier layers without model updates or architectural changes. It further uses recent proprioceptive states to adapt the mixing strength, using conservative mixing when execution dynamics change rapidly. Experiments on robot manipulation benchmarks show that STAR improves late-layer object awareness and increases average task success rates by 4.0 percentage points. Our code is available at https://github.com/PKU-VaLuE-Lab/STAR.
Source:https://arxiv.org/abs/2610.41009PreviousConfidence-Modulated Safety Filtering for End-to-End PoliciesNextContact Imitation Interface: Transferring Dexterous Skills by Showing How Contact Unfolds
Related posts

The detailed conditions I knew on the day I measured were gone when I looked at the graph later
0dev.to Productivity
What If Your Life Had Multiple Possible Versions? Building an Auditable Counterfactual Self Architecture
0dev.to AI
Canonical updates Ubuntu for permanent time changes in 3 regions of Canada
0dev.to Linux
Sotot: A small daemon&readonly dashboard for the things that need your attention
0Hacker News New
MoofTCP – A modern replacement for MacTCP on 68k Macs
0Hacker News New
Skill to teach your agents how to use Jujutsu VCS
0Hacker News New