AI & ML
Movens-Zero: Scaling Humanoid Motion Foundation Models with Large-Scale Human Videos
arXiv cs.RO0 views
arXiv:2610.41877v1 Announce Type: new Abstract: Scaling humanoid motion foundation models is constrained by the scarcity of diverse, robot-executable data and by the difficulty of jointly learning from heterogeneous multimodal inputs while supporting real-time closed-loop control. We present Movens-5M, constructed from raw Internet videos through clip generation, quality filtering, semantic annotation, motion recovery, and physical refinement with humanoid retargeting and execution verification. It contains 15 million human-motion sequences and 5 million physically executable humanoid-motion sequences spanning over 10,000 hours, aligned with text, RGB video, speech, and music. Building on this data, we introduce Movens-Zero, a scalable understanding-generation-execution architecture that supports joint learning across modalities and real-time closed-loop execution. Task-mixed flow-matching training jointly optimizes a single action expert across seven generation tasks, enabling direct motion generation from text, speech, music, and video. Multimodal Real-Time Chunking connects overlapping chunks under continuously updated instructions and robot states for continuous closed-loop execution. We further introduce Movens-Intent, a four-track benchmark with 8,192 expert-verified condition-motion pairs across text, speech, music, and video. Experiments show consistent gains across all four modalities when scaling execution-verified data from 1% to 100% and action-expert capacity from 64M to 911M parameters, while demonstrating that data quality and cross-modal supervision improve generation and execution.
Source:https://arxiv.org/abs/2610.41877PreviousMETA-Robot: Self-Cognition and Capability Scaling in Agentic RobotsNextOnline Learning of Heterogeneous Locomotion Dynamics under Reinforcement Learning Policies for Precise Loco-Manipulation
Related posts

In Hộp Thiếc: Kiểu Dáng, Công Nghệ Và Chi Phí Sản Xuất
0dev.to Design
How to compare AI image prices without fooling yourself
0dev.to Design
How long does hiding the Shorts shelf last on YouTube for iPhone? (2026)
0dev.to Productivity
What changes if you use Instagram in Safari instead of the app on iPhone? (2026)
0dev.to Productivity
Qual é o melhor app grátis para esconder Reels e Shorts no iPhone sem perder as DMs? (2026)
0dev.to Productivity
装完先别急着调命令:两条 ls 先看装对了没有
0dev.to Productivity