AI & ML
Cross-Embodiment Motion Planning by Coupling Body-Agnostic World Model with Differentiable Ego-Dynamics
arXiv cs.RO0 views
arXiv:2610.41330v1 Announce Type: new Abstract: Motion planning in clutter is embodiment-specific: the feasible free space and reachable commands depend on each robot's geometry and dynamics. Existing cross-embodiment policies output normalized commands that disregard these differences, or compensate through per-robot training and distillation. World models can in principle pool cross-embodiment data, yet command-conditioned models bind their latent dynamics to a single action space, while pose-conditioned models omit the mapping from commands to body-specific motion. On flat ground, however, embodiment affects the planner's observations only through the camera ego-motion. This letter proposes Hourglass, an hourglass-shaped architecture that factorizes cross-embodiment motion planning at this interface: a body-agnostic world model and each robot's differentiable ego-dynamics, which map commands to that ego-motion, are coupled only through it. The world model is trained on data pooled across embodiments and camera mounts; each robot's ego-dynamics is a reduced-order template with identified physical parameters. A generalist parameter-conditioned policy is learned once at this junction: each imagined step rolls out the template and then the world model, and imagination training through each robot's template makes the policy body-aware. On seven simulated robots of five locomotion types, the generalist policy outperforms imitation-learning and diffusion-policy baselines on the same world model by 3.8--10.6 percentage points in success rate and matches per-robot specialists without dedicated training, while approaching its parameter-conditioned MPPI teacher within 1.4--2.8 points without an online map. After three minutes of teleoperated driving for identification, the synthetic-data-trained model transfers zero-shot to a real skid-steer robot unseen in training, navigating unseen indoor scenes.
Source:https://arxiv.org/abs/2610.41330PreviousLearning from Physical Experience:Context-Space Adaptation for Robotic ManipulationNextHIPC: Humanoid Iterative Planning and Control via Goal-Conditioned Motion Closure
Related posts
AI spend flatlined at +1.5% as Anthropic's $2T IPO shrinks
0dev.to Discuss

osFoundry का Maestro क्या करता है, एक AI चैट जो अपना हर कदम दिखाती है
0dev.to Productivity
![[Part 3] Your first steps in Computer Vision on AWS: deploying models for an ASL recognition app](https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fujtow25j4x4xr644q5s9.png)
[Part 3] Your first steps in Computer Vision on AWS: deploying models for an ASL recognition app
0dev.to Machine Learning
Perplexity Teammates Turns AI Into Coworkers That Don't Clock Out
0dev.to Machine Learning
Weight-Space Programming: When LLMs Learn to Read and Rewrite Neural Network Weights
0dev.to Machine Learning
Salesforce's Koa Decisions: One Step, One Answer, No Paragraph
0dev.to Machine Learning