Open Source
STAR: Steering Action Representations during Inference
arXiv cs.RO0 views
arXiv:2610.41009v1 Announce Type: new Abstract: Vision-language-action models (VLAs) map language instructions and visual observations to robot actions, showing strong capabilities across robotic manipulation tasks. However, in our probing experiment, we find that action representations near the action output do not fully preserve task-relevant visual grounding. Motivated by this late-layer grounding gap, we introduce STAR, for STeering Action Representations, a training-free inference method for pre-trained VLAs. STAR applies an exponential moving average over late-layer residual updates, allowing later action representations to inherit object-aware update directions from earlier layers without model updates or architectural changes. It further uses recent proprioceptive states to adapt the mixing strength, using conservative mixing when execution dynamics change rapidly. Experiments on robot manipulation benchmarks show that STAR improves late-layer object awareness and increases average task success rates by 4.0 percentage points. Our code is available at https://github.com/PKU-VaLuE-Lab/STAR.
Source:https://arxiv.org/abs/2610.41009PreviousConfidence-Modulated Safety Filtering for End-to-End PoliciesNextContact Imitation Interface: Transferring Dexterous Skills by Showing How Contact Unfolds
Related posts
UK AI Weekly: When AI Gets Too Good at Forgetting
0dev.to AI
A lighter and less costly SDD workflow comapared to openspec
0Hacker News New
OrcaSlicer v2.5.0 Official Release Latest
0Hacker News New
37 public leaderboard strategies, one screen: the arithmetic holds, the concentration does not
0dev.to

ElevenLabs Free Plan vs a Local Open-Source Model: Same Chinese Script, Side by Side
0dev.to OpenSource
AI real estate video editing: preserve the route through the home
0dev.to AI