Open Source
WiTac: Wrist-Informed Tactile Representations for Contact-Rich Manipulation
arXiv cs.RO0 views
arXiv:2611.21057v2 Announce Type: new Abstract: Similar tactile contacts can call for different corrections depending on the configuration of the hand, object and target. Rather than supplying touch and wrist vision separately, fusing them before policy injection better grounds tactile features in visual context, yielding more accurate contact representations. We introduce Wrist-Informed Tactile Representations (WiTac), a pretrained encoder that learns such representations before action generation. Pretrained on nearly 300 hours of SharpaDex data, WiTac deeply fuses tactile signals with hand motion and wrist views into a comprehensive contact representation. Conditioning downstream VLA policies (GR00T N1.7 and $\pi_{0.5}$) on WiTac substantially improves task success over vision-only base policies across four contact-rich manipulation tasks (+28.8% and +15.0% on average), and further outperforms a wrist-free tactile encoder by 18.8% and 7.5%, respectively. Offline analyses further show that incorporating wrist vision yields more accurate contact descriptors, stronger joint task-contact discrimination, greater feature stability under tactile noise, and clearer action-direction readout from similar contacts. Project page: https://wrist-informed-tactile-representations.github.io/.
Source:https://arxiv.org/abs/2611.21057PreviousFlowRow: Learning Navigation Behaviors in Agricultural Environments with Long-Horizon Goal-Conditioned Flow Matching PoliciesNextMulti-CONDOR: Learning Multistable Motion Primitives from Demonstration
Related posts
Successive Convexification in Learned World Models for Safe Offline Planning
0arXiv cs.RO
GOOSELoc: A Multimodal Benchmark for Ground-to-Aerial Localization in Unstructured Off-Road Terrain
0arXiv cs.RO
Linglong Agent Service: A Runtime for Centralized Agent Reasoning and Distributed Execution
0arXiv cs.RO

Backup imutável de RDS com cofre logicamente isolado: o que PCI DSS e ISO 27001 pedem e como provar
0dev.to AWS
Show HN: NetDiag self-hosted network inventory and diagnostics
0Hacker News Show
Show HN: Map showing if GTA 6 is out in your country
0Hacker News Show