AI & ML
MARS: Dynamic Routing of Reinforcement-Learned Atomic Skills for Multi-Stage Robotic Manipulation
arXiv cs.RO0 views
arXiv:2611.19324v1 Announce Type: new Abstract: Vision-Language-Action (VLA) models have demonstrated strong capabilities in multi-task robotic manipulation. However, they still face limitations in control precision and execution stability during critical manipulation stages, such as object grasping, alignment and insertion. To combine general-purpose manipulation capabilities with task-specific fine-grained control, while enabling effective coordination between generalist and specialized policies throughout multi-stage manipulation tasks, this paper proposes MARS (Modular Atomic-skill Routing System), a dynamic routing framework for reinforcement learning-based atomic skills. MARS integrates a frozen generalist VLA policy with multiple independently trained atomic skill policies. Using a shared RL Token state representation and the reference action of VLA, specialized control policies are optimized through reinforcement learning for different cr`itical manipulation stages. For high-level policy selection, we develop a dynamic router that integrates temporal context and skill semantics. The router employs Mamba-based recurrent encoding and a historical feature window to capture state evolution during manipulation. Skill descriptions of candidate policies are encoded into semantic queries, and attention mechanisms are used to establish correspondences between skill semantics and temporal state features. Experimental results show that MARS achieves an average Macro-F1 score of 90.47% across four LIBERO task suites under fixed-trajectory evaluation, outperforming an MLP-based router by 7.08 percentage points. In the simulated Tube Transport task, the full-task success rate increases from 20.04% to 85.67%. These results demonstrate that stage-specific reinforcement learning and temporal state-aware dynamic policy routing can improve multi-policy coordination and overall task execution performance in multi-stage robotic manipulation.
Source:https://arxiv.org/abs/2611.19324PreviousResidual Reinforcement Learning for Visual Servo Control with Zero-Shot Sim-to-Real TransferNextLong-Horizon Causal Inertial Odometry in Multistory Buildings
Related posts

iPhone 18 and iPhone Air 2 Display Production to Begin Soon Ahead of Expected March Launch
0MacRumors

iPhone Air 2 Reportedly Sticks With Same Display
0MacRumors
Hours later, Airbyte is still unavailable
0Hacker News New
Show HN: Qpilot – an AI agent that runs plain-text manual test cases in Chrome
0Hacker News Show
Show HN: Arbituro
0Hacker News Show
Show HN: Neopane. Run Neovim once, show its windows in your multiplexer's panes
0Hacker News Show