AI & ML
ACiT: Proprioceptive-Prior Action Chunking with Inverted Transformers
arXiv cs.RO0 views
arXiv:2611.20719v1 Announce Type: new Abstract: Visuomotor policies condition action prediction on visual and proprioceptive observations. While historical proprioceptive sequences carry rich dynamic priors, current methods treat them as equal to high-dimensional vision, causing the proprioceptive signal to be overwhelmed. To identify what is lost in equal-conditioning fusion, we analyze proprioceptive data and find that strong inter-joint coupling is the key action-determining structure. This finding aligns with the neural sensorimotor loop, in which proprioception first forms a body-centered prior and vision is later calibrated via parietal remapping. Inspired by this, we propose ACiT, Proprioceptive-Prior Action Chunking with Inverted Transformers, which reinforces historical joint-coupling as the primary condition with vision as a later calibration. This design is instantiated through three modules: Inverted State Encoding builds a proprioceptive prior via per-joint tokens and inter-joint self-attention. State-Visual Grounding lets joint tokens query visual evidence, making vision goal- and calibration-only. Inverted Action Chunking decodes per-joint trajectories independently. ACiT improves success rates on most LIBERO, RoboTwin 2.0, and real-world tasks, with the largest gains on those that require dynamics and coordination. The same conditioning design transferred to the VLA backbone pi_0-ACiT yields significant gains with better execution efficiency.
Source:https://arxiv.org/abs/2611.20719PreviousTaF-Foundation: Wrench-Grounded Cross-Sensor Tactile RepresentationsNextAVD: A Multi-Sensor Teleoperated Wheelchair Platform with Safety-Aware Control
Related posts
CMM. The cursed language that never really took off.
0dev.to Watercooler

I built a GitHub Action that scores pull requests and never auto-closes them
0dev.to GitHub
I built a Windows app to track Instagram follower and profile changes over time
0dev.to GitHub

Designing a Splash-Zone Ambient Lamp: What IP44 Actually Means in Practice
0dev.to Design
A Canva alternative for Instagram posts, stories and carousels with your brand applied in one click
0dev.to Design
What Might the Next Generation of AI Look Like?
0dev.to Discuss