AI & ML
Old Experience, New Lessons: Relabeling Autonomous Robot Rollouts in Interactive Imitation Learning
arXiv cs.RO0 views
arXiv:2611.24273v1 Announce Type: new Abstract: Interactive imitation learning enables robots to learn from human interventions during deployment. These interactions naturally produce sparse human corrections and abundant autonomous robot experience without human action labels. Yet existing methods either leave this experience unused for action supervision or imitate historical robot actions, which can reinforce suboptimal behavior. To address this limitation, we propose Set-valued Relabeling of Autonomous experience (SeRA), a framework that learns from autonomous robot experience through set-valued supervision of policy relabels. Later policy checkpoints relabel this experience, and agreement across checkpoints filters the relabels. Since agreement does not guarantee correctness, SeRA constructs desired action sets around accepted relabels. Following Set-Supervised Diffusion Policy (SDP), it trains an action-chunking diffusion policy to increase the probability of actions within these sets. A step-masked denoising loss combines accepted relabels with available human corrections in partially supervised chunks. Experiments across five simulated manipulation tasks in online and offline settings show that SeRA improves policy performance over SDP and outperforms baselines that imitate historical robot actions or exact relabels. On a real-robot tomato-picking task, SeRA achieves 80% success, compared with 40% for SDP, using the same human feedback and training budget. These results demonstrate that relabeled autonomous robot experience can complement human corrections to improve policy performance.
Source:https://arxiv.org/abs/2611.24273PreviousTowards Vacuum-Assisted Robotic Needle Interventions: From Fluid Aspiration to Tissue BiopsyNextQDD-MM: A Simple and Compact Open-Source Muscle Module with Quasi-Direct-Drive Motor for Tendon-driven Robots
Related posts
CaMBRAIN: Real-time, Continuous EEG Inference with Causal State Space Models
0arXiv cs.HC
How Far Does Online RL Generalize in Mobile GUI Agents? A Controlled Study with AndroidWorld-Generalization
0arXiv cs.HC
From Consensus-Based Optimization to Evolution Strategies: Proof of Global Convergence
0arXiv cs.NA
Unconditionally $L^2$-stable explicit--implicit--null filtered Runge--Kutta methods for general nonlinear degenerate parabolic equations
0arXiv cs.NA
CS-PIKAN: Curvilinear Separable Physics-Informed Kolmogorov-Arnold Networks with Autograd-Based Metric Evaluation and Certified Error Bounds for PDEs on Complex Domains
0arXiv cs.NA
Fourier--Galerkin Methods for Subwavelength Resonances in two-dimensional Acoustic Metamaterials
0arXiv cs.NA