AI & ML
DiffWBC: Unlocking Steerable General Humanoid Motion Tracking via One-Step Diffusion Whole-Body Control
arXiv cs.RO0 views
arXiv:2610.41354v1 Announce Type: new Abstract: General humanoid motion trackers typically rely on deterministic policies that cannot adapt online without brittle reference editing or costly retraining. We present DiffWBC, shifting whole-body control to a generative paradigm via a one-step diffusion model. By modeling distributions over future trajectories, DiffWBC unifies general tracking, test-time steering, and simulation-free failure discovery within a single controller: (1) Generative general tracking: DiffWBC requires a single forward pass per 50 Hz control step and can be distilled from an RL teacher or trained from scratch via model-based RL, achieving the lowest local tracking error among six general trackers on held-out benchmarks (20.1 mm on BONES) and deploying on a physical Unitree G1. (2) Zero-shot test-time steering: differentiable cost gradients and body-group masks modulate the frozen controller online, substantially outperforming kinematic reference editing (0.84 clean pass at 1.25 m ceiling vs. 0.10) and zero-shot generalizing across hurdles, spatial reaching, actuator faults, and tray balancing. (3) Simulation-free failure discovery: plan dispersion across generation noise effectively identifies physical tracking failures (91% precision in top 2%) without physics simulations; targeted fine-tuning on flagged clips resolves 50% of failure cases. Videos and interactive demonstrations are available at https://diffwbc.github.io/#selfassess.
Source:https://arxiv.org/abs/2610.41354PreviousCalibSwitch: Observation-Driven Camera-LiDAR Extrinsic Recovery and Selective Maintenance for Multimodal PerceptionNextMolmoSpaces-CommonSense: Evaluating Commonsense in Robotic Manipulation Policies
Related posts
Beyond the Cloud: The Rise of Edge Intelligence
0dev.to News
NVIDIA open models: Shopify reports 90% lower serving costs in Sidekick
0dev.to News
Is Watching Porn Illegal in the UK From November 6, 2026?
0dev.to News
Best AI Presentation Makers in 2026: From Text and PDF to Finished Slides
0dev.to Design
Who is building solutions with documents?
0dev.to Discuss
When the Political Shift Hits the Cluster: What the 2026 Midterms Mean for AI Infra and Code
0dev.to Discuss