AI & ML
ActPrune: Action-Grounded Visual Token Pruning for Efficient Vision-Language-Action Models
arXiv cs.RO0 views
arXiv:2611.08827v1 Announce Type: new Abstract: Vision-language-action (VLA) models perform versatile manipulation tasks from language instructions, but their inference cost limits how fast a robot can respond in closed-loop control. Visual token pruning reduces this cost; however, prior methods estimate token redundancy from encoded visual embeddings or attention, only after the visual encoder has processed the entire observation. We propose \ours, a training-free token pruning method that moves the pruning decision ahead of the vision encoder by grounding it in a geometric prior derived from the robot's own action. The action chunk predicted at the previous control step is already available before the current observation is encoded, and it specifies the end-effector and camera motion between consecutive observations. The same action affects the two standard camera views asymmetrically: in the fixed third-person view, \ours retains patches along the projected end-effector trajectory together with semantic anchors, while in the wrist view, it prunes patches that remain unchanged after compensating for the action-induced camera motion. Extensive experiments on two simulation environments (LIBERO and VLABench) and four real-robot tasks demonstrate that \ours achieves up to 1.61 $\times$ speedup and 59.5\% FLOPs reduction with negligible degradation in success rates.
Source:https://arxiv.org/abs/2611.08827PreviousIt Takes Two to Tangram: Multi-Agent Object Centric Reinforcement Learning for AssemblyNextSTRIDE: Learning Humanoid Locomotion in Minutes with Acceleration-Based Rewards
Related posts

Apple staff accused of signing up customers to subscriptions without consent; company responds
09to5Mac

Teens and parents can expect Instagram notifications about AI age estimation
09to5Mac
W-2 vs 1099 Calculator: A Worked Offer Comparison for 2026
0dev.to

I tested ChatGPT's PDF Content Credentials: what survives a re-save, a print and an edit
0dev.to
I Built ResearchLens AI to Make Data Exploration and ML Benchmarking Easier
0dev.to
Fold Epic Paper Airplanes
0Hacker News