Open Source
DobotTrack: Target-Grounded Vision-Language-Action Learning for Embodied Person Tracking
arXiv cs.RO0 views
arXiv:2611.09041v1 Announce Type: new Abstract: Language-guided embodied person tracking requires a mobile agent to identify a target from a referring description and consistently follow the target under egocentric observations. We present DobotTrack, a target-grounded vision-language-action (VLA) framework that integrates auxiliary grounding supervision with efficient temporal modeling. We systematically investigate five auxiliary tasks---person segmentation, bounding-box grounding, visual-spatial classification (VSC), future DINO feature prediction, and future-frame prediction---and adopt complementary mask and bounding-box supervision to enhance target delineation and localization. We introduce Q-identity, a target-conditioned historical visual compression module that leverages target-grounding predictions to selectively preserve identity-discriminative appearance features and spatial cues in compact historical tokens. On EVT-Bench, our 0.8B-parameter model achieves an average success rate of 77.9%, exceeding OmTrackVLA by 16.9 percentage points across the three tasks. We further construct a real-world person-tracking dataset collected using a quadruped robot, comprising 126 episodes and 596,323 mask-annotated frames. The target masks enable automatic derivation of bounding boxes and visual-spatial labels encoding horizontal position and apparent image scale, providing additional grounding supervision without separate manual annotation of these labels. Together, our framework and annotation pipeline support learning target-grounded tracking policies from simulated and real-world data. Code is available at https://github.com/Dobot-Team/dobot_track.
Source:https://arxiv.org/abs/2611.09041PreviousToolDex: An Ego-Exo Human Demonstration Dataset for Creative Physical Tool UseNextWhen to Trust the BIM: Identifiability-Aware LiDAR-Inertial--BIM Fusion under As-Built Deviations
Related posts

Why I Built AICRE: Making Linux Development Environments More Visible for AI Coding Workflows
0dev.to Linux
Show HN: antennasim – Visualize Electromagnetism
0Hacker News Show
Show HN: Raw RAG leaks 0%, but agent memory leaks 67%
0Hacker News Show
Zebkit – Chromium's engine as a library you link, not a runtime you live in
0Hacker News
Keep the Agent's Packets Out of the Host Kernel
0Hacker News New
Accuracy potential of visual localization exploiting high-end street-level imagery
0arXiv cs.RO