Open Source
Computer-Use Agents Are Embodied Generalists
arXiv cs.RO0 views
arXiv:2611.09847v1 Announce Type: cross Abstract: In many areas of AI, general-purpose models have increasingly replaced handcrafted methods and specialized architectures. We argue that embodied AI is poised for a similar shift. Our key claim is that embodied tasks can be formulated as interaction with digital software. Specifically, we build software that renders an agent's view of a physical environment on a screen and provides controls for acting in it. A computer-use agent (CUA) can then perform embodied tasks through the same screenshots and keyboard and mouse actions that it uses to operate ordinary software. Using a single CUA design and changing only the software, our entries win first-, second-, third-, and sixth-place prizes across four ECCV workshop competitions, without any competition-specific agent tuning. These results suggest that the skills CUAs learn on software, such as visual grounding, precise clicking, and exploration, already carry over to embodied tasks, giving CUAs a far broader scope in embodied AI than previously realized. We therefore advocate that computer-use agents can be embodied generalists. Further, we advocate that, by following the training strategy that made computer-use agents general, embodied AI can converge on a single general model as well, ushering in a new era of general embodied AI. Website: https://pranjal2041.github.io/cua-embodied
Source:https://arxiv.org/abs/2611.09847PreviousAugmentron: Scalable Multi-View Visual Augmentation for Robot LearningNextAdaptive Collision Sensitivity for Efficient and Safe Human-Robot Collaboration
Related posts
Prime Agent: an open source coding and research agent for long-running work
0dev.to Rust
Simple Extensions of Single-Objective Acquisition Functions and Hedge Strategies for Multi-Objective Bayesian Optimization
0arXiv stat.ML
Fine-Tuned Language Models Exhibit Improved Information Conveyance
0arXiv stat.ML
Grasp-TAGS: Task-Aware Grasp Selection via Critic Distillation for Prehensile Loco-Manipulation
0arXiv cs.RO
DKWBC: Decoupling Motion Tracking and Balancing for Humanoid Whole-Body Control
0arXiv cs.RO
The new version 2026.11 of the Slax operating system has been released
0dev.to Linux