AI & ML
Behavior Graphs: Unsupervised Graph Structures for Interpreting Robot Deployment Data
arXiv cs.RO0 views
arXiv:2611.00405v2 Announce Type: replace Abstract: Data flywheels promise continuous improvement via insights from deployment data. Understanding how the deployed model succeeds and fails can steer subsequent data collection towards patching failures and reinforcing successes. However, robot deployments create large volumes of high-dimensional rollout data, which is challenging to understand and confidently ground data collection decisions in. To make deployment data easier to analyze and act on, we propose behavior graphs, which compress policy rollouts into a single interpretable, directed graph. We construct the graphs by learning to identify similar behavior modes across rollouts, connecting the behaviors temporally, and finally linking them to outcomes. In a user study on three real-world tasks, where participants analyzed rollouts to choose a data collection strategy, 16 of 18 preferred behavior graphs to rollout videos, reaching comparable conclusions with 40.3% lower perceived temporal demand and 37.6% lower effort. Beyond interpretability for deployment data, behavior graphs are capable progress predictors: across 43 datasets, they improve the rank correlation between predicted progress and true temporal order by 22.9% and reduce mean absolute error by 53.5% relative to the strongest baseline. As the number of deployed robots grows, behavior graphs lend structure to high-dimensional policy rollouts and make deployment data easier to interpret and reason about.
Source:https://arxiv.org/abs/2611.00405PreviousRoboFQE: Rollout-Free Evaluation of Visual Robot Policies from Offline TrajectoriesNextDexHOT: Learning Hand-Object Configuration Transfer for Dexterous Manipulation
Related posts
A Straight Line Is Not a Camera Pose: Auditing Short-Clip Pose Benchmarks
0arXiv cs.RO
Mechanisms of Misgeneralization in Physical Sequence Modeling
0arXiv cs.RO
RoboFQE: Rollout-Free Evaluation of Visual Robot Policies from Offline Trajectories
0arXiv cs.RO
Improving Imitation Learning Efficiency for Manipulation through Geometric Prior Pretraining
0arXiv cs.RO
MATE: Asynchronous Multi-Rate Diffusion Policy Composition
0arXiv cs.RO
EvoPlan: Evolutionary Neuro-Symbolic Robot Planning with Spatio-Temporal Guarantees
0arXiv cs.RO