General
Single-Controller Teleoperation and Multimodal Dataset Generation for a Mobile Manipulator
arXiv cs.RO0 views
arXiv:2611.24499v1 Announce Type: new Abstract: Robot learning systems require synchronized, high-quality demonstrations that combine visual, proprioceptive, and action data. However, collecting such datasets with mobile manipulators is often slowed down by fragmented teleoperation interfaces and manual post-processing workflows. This paper presents an integrated framework for teleoperated multimodal data collection on a Clearpath Dingo-O mobile base equipped with a Kinova Gen3 Lite manipulator and an Intel RealSense RGB-D camera. The framework combines single-controller operation of the base, arm, and recording process with an automated ROS-based pipeline for data capture, image-quality filtering, temporal synchronization, visualization, and export to machine-learning-ready Zarr datasets. We validate the system on a pick-and-place mobile-manipulation task in which the robot transports a bottle between two surfaces. The results show that the unified controller supports complete task execution and recording without external commands, while the data pipeline produces synchronized datasets for short demonstrations and identifies corrupted visual frames. The proposed framework provides a practical basis for producing structured demonstrations for robot-learning research.
Source:https://arxiv.org/abs/2611.24499PreviousWhen to Refine: Selective Search for Frozen Visual World ModelsNextOmniFish: A Bioinspired, Modular, Reconfigurable Soft Robotic Fish Enabling Multi-Modal Swimming
Related posts
Humanity
0Hacker News New
Datacentres to create 70% more carbon emissions by 2030, IEA report warns
0Hacker News New
GTA 6 Cheats, Mods and Companion Tool
0Hacker News New
Worlds largest beaver dam in Northern Alberta
0Hacker News New
Powered by Netlify badge on new Free plan projects
0Hacker News New
Draft Emoji List for 2027/2028 Unveiled
0Hacker News New