AI & ML
DexSeed: Expanding Human Hand-Object Interactions into Robot Demonstrations for Dexterous Policy Learning
arXiv cs.RO0 views
arXiv:2611.14092v1 Announce Type: new Abstract: We study how to generate diverse, physically executable robot demonstrations for dexterous vision-language-action (VLA) learning. Existing demonstration-generation methods typically rely on costly teleoperated examples. Meanwhile, human hand--object datasets provide a reusable source, but existing transfer methods mainly reproduce given interactions. Turning these interactions into VLA training data further requires coverage of different objects and manipulation locations, together with executable arm and finger actions, and visual observations. To achieve this, we present DexSeed, a framework for low-cost generation of dexterous robot data from human hand--object interactions. Our key idea is to expand human sequences while preserving their grasps and realizing the resulting motions under arm-tracking dynamics in physics simulation. Specifically, we organize source sequences by grasp mode with shared language descriptions. InteractionMesh-based retargeting and arm trajectory augmentation adapt these sequences to the robot hand, different object geometries, and pick-and-place locations while preserving local hand--object relationships. An RL finger-control policy produces executable rollouts, while the arm tracks precomputed trajectories. Rendered observations and recorded actions from successful rollouts are paired with grasp descriptions to fine-tune a VLA. Experiments show improved contact fidelity in retargeting and more reliable whole-arm execution than the evaluated baselines. Simulation evaluation and real-world deployment further demonstrate that a VLA fine-tuned solely on the generated demonstrations can execute language-specified grasps. Project page: https://robbyant-research.github.io/DexSeed/.
Source:https://arxiv.org/abs/2611.14092PreviousA human-in-the-loop Control Paradigm for Construction Robotics: From VR-Guided Teleoperation to Semi-Autonomous Dual-Arm OperationNextModel-Free Runtime Measurement of Task-Relevant Information
Related posts
Singapore Airlines elevates travel & work with OpenAI technology
0OpenAI Blog
How to Plan a Five-Slide Social Carousel with One Consistent Character
0dev.to

Kimi K2.5 to K3.1 Pro: 8 API Models, One Enterprise Task, and What Actually Got Done
0dev.to
Visa tested 22 shopping agents. 43% failed - and half of those bought anyway. Here's what actually stops it.
0dev.to
Building WUUUH: Skills Drift Faster Than Confidence — Keeping a Hand In During a Career Gap, What Worked, What Broke
0dev.to
FDR-Controlled Variable Selection for Generalized Linear Models and Cox Regression with Virtual Dummies
0arXiv eess.SP