Open Source
EgoSwarm: Learning Decentralized Robot Swarm Intelligence from Human Swarm Demonstrations
arXiv cs.RO0 views
arXiv:2611.20100v1 Announce Type: new Abstract: Advancing from individual embodied intelligence to swarm embodied intelligence is a key step toward scalable, general-purpose embodied intelligence. Complex tasks often require multiple agents to divide responsibilities, coordinate handovers, and manipulate shared objects collaboratively. However, existing robot learning methods rely primarily on individual demonstrations, which provide limited supervision for modeling dependencies among agent actions, while collecting multi-robot demonstrations at scale remains difficult. Human egocentric demonstrations offer a scalable alternative, yet distributed observations from multiple participants cannot directly supervise decentralized policies. We introduce EgoSwarm, the first robot learning framework for learning decentralized multi-robot collaboration from human swarm demonstrations. EgoSwarm collects more than 50 hours of collaborative experience using a robot-free multi-person egocentric system. We introduce the Swarm Interaction Packet (SIP) and Swarm Interaction Token (SIT) to recover cross-agent interaction relations from distributed observations and transform this experience into local supervision consistent with deployment-time information constraints. We further propose SwarmVLA, which transfers knowledge of swarm behavior to decentralized policies conditioned on local observations, local history, and limited neighbor messages. SwarmVLA achieves a mean success rate of 72.2% across three categories of multi-robot collaborative tasks. Project page:https://xitong-c.github.io/EgoSwarm_Page/.
Source:https://arxiv.org/abs/2611.20100PreviousPrompt Re-Specification and Target-Mask Availability in Mask-Conditioned Visual Reinforcement Learning for Moving-Platform LandingNextSAFER: Navigating the Exploration-Exploitation Dilemma in World-Model-Based Planning for Autonomous Driving
Related posts
From exposed secrets to managed credentials: Reducing credential risk across the application lifecycle
0HashiCorp Blog
AgentLens: Revealing The Lucky Pass Problem in SWE-Agent Evaluation
0arXiv cs.SE
Approximation of the L\'evy-driven stochastic heat equation on the sphere
0arXiv cs.NA
EasyNav: A Modular Architecture for Real-Time Navigation Across Heterogeneous Robot Environments
0arXiv cs.RO
DynLimit: A Simulation Benchmark for Dynamics-Critical Planning and Control
0arXiv cs.RO
Sim-to-Real Room-Mediated Object-Goal Navigation with ROS 2 and Nav2
0arXiv cs.RO