AI & ML
PROOF: Perceptive Robustness via Out-of-Distribution Fallback for Legged Locomotion
arXiv cs.RO0 views
arXiv:2611.18305v1 Announce Type: new Abstract: Vision-based perceptive locomotion has enabled legged robots to achieve agile and terrain-aware locomotion across complex environments. However, the reliability of such systems heavily depends on visual observations, which are inherently susceptible to occlusion, reflective surfaces, and illumination variations, often resulting in catastrophic locomotion failures under degraded perception conditions. In this paper, we present PROOF (Perceptive Robustness via Out-of-Distribution Fallback for Legged Locomotion), a perceptive locomotion framework that enables robust locomotion under severe visual disturbances. Our method adopts a two-stage teacher-student learning paradigm that explicitly models perception reliability: the teacher learns both perception-driven and proprioceptive fallback behaviors, while the student predicts exteroceptive features with uncertainty and suppresses them under out-of-distribution inputs. We evaluate our method on a Unitree Go2 quadruped equipped with a RealSense D435 depth camera in real-world settings. Under normal visual conditions, our method enables the robot to successfully perform high-dynamic parkour maneuvers, including traversing large gaps, elevated platforms, and narrow beam terrains. Under severe visual degradation, such as heavy occlusion and strong illumination changes, the robot continues to maintain stable and robust locomotion performance.
Source:https://arxiv.org/abs/2611.18305PreviousObjectives as Policies: Vision-Language Model Cost Programs for Contact-Rich ManipulationNextEnvisioning Agentic Robotics: A New Era of Robotic Systems
Related posts
Stopping models closed under pgf composition, and the stability of randomly stopped model extensions
0arXiv stat.TH
Testing the equality of the copulas of two multivariate populations with Bernstein polynomials
0arXiv stat.TH
Quantifying Dependence Effects on $k$-out-of-$n$ Reliability Relative to the Independent Benchmark
0arXiv stat.TH
Causal and conditional tail coefficients: asymptotics, inference and graph recovery
0arXiv stat.TH
Characterizing M-estimators using canonical divergences from information geometry
0arXiv stat.TH
Statistical guarantees for signature kernel ridge regression
0arXiv stat.TH