AI & ML
Stochastic Self-Distillation for Flow-Based Vision-Language-Action Models
arXiv cs.RO0 views
arXiv:2611.20460v1 Announce Type: new Abstract: Flow-based vision-language-action (VLA) models achieve strong performance in robotics through imitation learning, yet fine-tuning them with on-policy reinforcement learning (RL) is limited. In group-based RL methods like Group Relative Policy Optimization (GRPO), every rollout step requires multi-step ODE integration, and the sampler's limited stochasticity leads to rollout groups with low variance. We propose VLA-SSD, which addresses both high inference latency and limited stochasticity. In particular, our method self-distills a pretrained flow-matching action head into a stochastic one-step policy by conditioning a single-jump generator on a Brownian path. We derive a conditional action density via our stochastic one-step policy, enabling efficient post-training via likelihood-ratio RL algorithms. We show that distilling VLA-SSD from the $\pi_0$ VLA reduces the action head's forward-pass time by a factor of 7.7, at the cost of a 5.5% relative decrease in the success rate on the LIBERO benchmark. However, by leveraging the increased sample diversity of VLA-SSD during group generation, post-training a $\pi_{0.5}$ VLA using GRPO yields a 20.6% relative improvement.
Source:https://arxiv.org/abs/2611.20460PreviousXMimic and XSoma: Learning Humanoid Motion Tracking and Locomotion in Under a MinuteNextReRead: Wrong Predictions, Useful Representations - Correcting Frozen Robot Policies by Re-reading Their Own Representations
Related posts

NVIDIA's CEO Shake-Up Exposes a Costly Prediction Market Deadline
0HackerNoon
Lumi-4B AI Model: Everything You Need to Know
0HackerNoon
The End of the Mouse: How AI Could Change the Way We Use Computers
0HackerNoon
How to Structure AI Adoption Teams and Measure Software Delivery Improvements
0HackerNoon
A Seven-Slide Framework for Funding AI Transformation Without New Headcount
0HackerNoon
System One Models and the Future of AI Decision-Making
0HackerNoon