Open Source
MolmoSpaces-CommonSense: Evaluating Commonsense in Robotic Manipulation Policies
arXiv cs.RO0 views
arXiv:2610.41377v1 Announce Type: new Abstract: Real-world robotic manipulation requires reasoning about cluttered scenes, partially observable or hidden objects, and semantically appropriate actions, in addition to low-level execution within those scenes. However, existing simulation benchmarks primarily test the latter and remain dominated by comparatively clean environments with limited clutter and narrowly scoped task structure, leaving many forms of commonsense reasoning untested. We address this by introducing a taxonomy of reasoning processes for robotic manipulation grounded in developmental cognitive science. We operationalize this taxonomy through a new benchmark of robot tasks, MolmoSpaces-CommonSense, that requires reasoning about occlusion, containment, support relations, semantically correct grasp points, spatial affordances, and hidden objects. These evaluations require policies not only to recognize relevant scene structure but also to execute correct actions in them. We evaluate several zero-shot generalist manipulation policies. Across model types and architectures, we observe consistent failures in commonsense reasoning: success rates in cluttered scenes drop by over 50% as distractors increase, policies act on incorrect objects in cluttered settings 30% of the time, and affordance-sensitive grasping remains unreliable even with highly specific language prompts, with correct object part selection happening only about 50% of the time. Further, VLM-based success estimation struggles to reliably evaluate rollouts in these settings, suggesting that the challenge extends beyond control to the broader perception-reasoning-action stack. Our results suggest that existing benchmarks may substantially overestimate zero-shot real-world readiness. Code and policy leaderboard link at https://github.com/allenai/molmospaces.
Source:https://arxiv.org/abs/2610.41377PreviousDiffWBC: Unlocking Steerable General Humanoid Motion Tracking via One-Step Diffusion Whole-Body ControlNextBioAgent: Self-Directed Skill Acquisition and Capability Growth for Long-Horizon Laboratory Protocols
Related posts
Show HN: Thinker – Trim context and cache knowledge to extend agent usage limits
0Hacker News Show
Show HN: Ls-service – minimal, namespaced, and typed localStorage wrapper
0Hacker News Show
Show HN: HackerGit – Every GitHub repo shared on HN
0Hacker News Show

Inside GitHub’s new Git storage architecture
0GitHub Engineering

# 55 Comments, Four Pull Requests, One Maintainer: Building Issue Desk with Switch
0dev.to OpenSource
You Don't Need to Pay for an AI Coding Tool in 2026 — Here's What's Actually Free
0dev.to Programming