AI & ML
Learning from Physical Experience:Context-Space Adaptation for Robotic Manipulation
arXiv cs.RO0 views
arXiv:2610.41320v1 Announce Type: new Abstract: Recent multimodal foundation models exhibit strong perception, reasoning, and in-context learning capabilities, but translating these capabilities into physical action remains challenging. Through real-world experiments across diverse manipulation tasks, we find that ChatGPT-6-Astra, a state-of-the-art general-purpose reasoner, can serve as a physically actionable, context-responsive manipulation policy, demonstrating effective fine manipulation and spatial reasoning. Building on these findings, we introduce LEXP, a harness for learning from physical experience through context-space adaptation. LEXP combines task-level planning with an experience module that interprets execution evidence, extracts and retains lessons with applicability conditions, and reuses relevant lessons to generate contextual feedback for subsequent actions. Model weights and the action interface remain fixed throughout. Across 12 real-world manipulation tasks, LEXP achieves $23/36$ successful trials (63.9\%), compared with $19/36$ (52.8\%) with memory alone and $2/36$ (5.6\%) for vanilla Astra. On three tasks, bread transfer, sort trash and toiletries, and retrieve drawer, removing planning reduces success from $7/9$ to $4/9$, while removing retained experience reduces it to $3/9$. Execution traces illustrate feedback-guided corrections and cross-episode reuse of an inspection strategy. Execution analyses illustrate how task structure and experience-derived feedback guide task progression, action correction, and experience reuse. These results support context-space adaptation as a practical mechanism for turning physical interaction into reusable guidance for robotic manipulation.
Source:https://arxiv.org/abs/2610.41320PreviousTRACE: Target-State Risk-Aligned Conditional Execution for Embodied TrackingNextCross-Embodiment Motion Planning by Coupling Body-Agnostic World Model with Differentiable Ego-Dynamics
Related posts
Why Senior Engineers Are Mostly Professional Code Deleters
0dev.to

AWS Puts the Region Inside the AS Path on Direct Connect
0dev.to AWS
How Much Does an OTT Platform Really Cost? Start With Two Budgets
0dev.to WebDev

Real Estate API MCP: One Dubai Property Search Costs an AI Agent 17,000 Tokens
0dev.to Python
Inter-AI Morality: How AI Systems Treat One Another [pdf]
0Hacker News New
Solar plane soars to 47,600 ft, on target to fly 100 hours
0Hacker News New