AI & ML
QTOP: Scaling Humanoid Motion Tracking with Quantile Critics
arXiv cs.RO0 views
arXiv:2611.20791v1 Announce Type: new Abstract: Learning human motion tracking policies through reinforcement learning (RL) has emerged as a core capability that underpins a majority of recent progress in humanoid whole-body control. However, achieving generalization to unseen motions at high fidelity requires jointly scaling training to thousands of GPU and dataset hours. This work hypothesizes that motion tracking is inherently compute-bound because training on a diverse set of motions introduces learning interference, similar to multi-task RL. To tackle this, we propose Quantile Tracking Optimization (QTOP), which improves sample efficiency by introducing a distributional advantage estimate conditioned on state and reference pairs. QTOP outperforms on and off-policy RL baselines both in simulation and real-world tracking scenarios on multiple datasets by up to 10\%. Furthermore, we establish a scaling law for QTOP and find that, aside from scaling predictably, dataset size has minimal impact on performance for moderately sized GPU hour regimes.
Source:https://arxiv.org/abs/2611.20791PreviousNon-Imaging Optical Tactile Sensors for Robotics: Transduction Principles, System Integration, and Robotic ApplicationsNextDriving the Style: Velocity-Conditioned Whole-Body Control from Motion Demonstrations
Related posts
TacBridge: Learning Unified Tactile Representations through Cross-Sensor Correspondence
0arXiv cs.RO
Transferable Neural CBFs via Generalized Closure
0arXiv cs.RO
Non-Imaging Optical Tactile Sensors for Robotics: Transduction Principles, System Integration, and Robotic Applications
0arXiv cs.RO
Robotic Reward Models in the Foundation-Model Era
0arXiv cs.RO
Selective Sensor Acquisition for Multimodal Place Recognition
0arXiv cs.RO
AVD: A Multi-Sensor Teleoperated Wheelchair Platform with Safety-Aware Control
0arXiv cs.RO