AI & ML
VICTR: Value-Informed In-Context Learning for Vision-Language-Action Models
arXiv cs.RO0 views
arXiv:2611.08698v1 Announce Type: new Abstract: Recent advances in robot foundation models have highlighted the potential of in-context learning (ICL) for adapting robot behavior from demonstrations without further fine-tuning. Previous work has used retrieval-based post-training to equip pretrained vision-language-action (VLA) models with the capability for ICL by teaching them to condition action predictions on retrieved visually-relevant demonstration chunks. However, the effectiveness of retrieval hinges on selecting context relevant to the current execution stage, which visual similarity alone may not capture. We introduce VICTR, a framework enabling in-context learning in VLAs via progress-informed context retrieval built around an In-Context Value Function Estimator (IC-VFE). IC-VFE conditions on a reference demonstration video, a language instruction and the current observation to estimate task-relative progress. By conditioning progress estimation on a reference demonstration, IC-VFE can align the current state with a demonstrated execution even for tasks unseen during training. VICTR uses the estimated progress to select demonstration chunks at corresponding stages of execution and supplies them to a $\pi_{0.5}$ policy post-trained for in-context action generation. On unseen out-of-domain real-world manipulation tasks, VICTR raises the success rate from 6.2% for a fine-tuned $\pi_{0.5}$ baseline to 23.8% and more than doubles the task progress rate, from 28.9% to 55.5%. Project page with code, data and videos: https://ai4ce.github.io/VICTR/
Source:https://arxiv.org/abs/2611.08698PreviousNational and State-Level Approaches to Automated Vehicle Certification: A Comparative Framework for State Operational GovernanceNextIt Takes Two to Tangram: Multi-Agent Object Centric Reinforcement Learning for Assembly
Related posts
New Linux Patches Bring-Up The Samsung Galaxy XR Headset, Qualcomm Halliday SoC
0Phoronix

Some United Airlines flights now let you sign into Spotify on your flight — and its' totally free
0TechRadar

Straight Talk just dropped an unlimited data plan to $20/mo ahead of Black Friday — a brand new record
0TechRadar

Who Gives A Crap: Data breach at ethical toilet paper company exposes customer information across UK, US and Australia
0TechRadar

Since tokenmaxxing is the wrong metric for AI ROI, what is the right one?
0TechRadar

Narwal V50 Cube review: a self-emptying stick vacuum with brilliant smart features
0TechRadar