AI & ML
CoRA-VTLA: Contact-Guided Attention and Queryable Response Memory for Tactile Post-Training
arXiv cs.RO0 views
arXiv:2611.23963v1 Announce Type: new Abstract: In precision manipulation, small errors in alignment or force can cause jamming or deformation, making contact feedback essential for adapting pretrained vision-language-action (VLA) models to these tasks. A single tactile observation leaves the response to recent actions ambiguous. Direct tactile fusion during post-training can also disperse the action expert's visual attention and reduce the share it allocates to contact regions. To address these challenges, CoRA-VTLA augments pretrained VLAs with lightweight tactile modules. A queryable action-response memory retrieves recent contact responses so that the action expert can combine them with immediate tactile feedback. Contact-guided gaze supervision concentrates the visual attention of the tactile semantic token on image regions corresponding to fingertip contact. CoRA-VTLA achieves 73.33% mean success across three MuJoCo tasks, compared with 50% for direct tactile fusion with the same sensor inputs. It also achieves 67% success on an optical-tactile task from the public UniVTAC benchmark and 66.7% mean success across three real-robot tasks. These results show that tactile post-training helps pretrained VLAs adjust to changing contact.
Source:https://arxiv.org/abs/2611.23963Previous3DTouch: A Tactile-aware VLA Model with 3D Geometric Relations for Dexterous ManipulationNextLaST1.0: A Unified Latent World-Action Model with Control-Centric SpatioTemporal Reasoning
Related posts
The draft is not the send
0dev.to Discuss

My First GitHub Issue & My First Forem (DEV.to) Issue 🚀
0dev.to Discuss
Multimodel AI for Business: How to Build a Reliable Video Content Workflow
0dev.to Productivity
Your Thanksgiving flight home is on the busiest travel day of the year
0dev.to Productivity
Audit Week: When Your AI Assistant Knows Your Website Better Than You
0dev.to Productivity

Telegram เตรียม Dictator: AI Agent บน Mac ที่รายงานว่ารันบน Hermes Agent
0dev.to Machine Learning