Open Source
EventHOI: Event-Driven Resource-Efficient Hand-Object Interaction Logging on Smartglasses
arXiv cs.HC0 views
arXiv:2611.09089v1 Announce Type: cross Abstract: Hand-object interactions (HOIs) can be captured by smartglasses to learn how people manipulate objects in daily life. Automatic logging of these interactions from an egocentric perspective provides time-stamped evidence of daily actions for applications like memory assistance. However, continuous RGB capture and wireless transmission exceed the energy and bandwidth budgets of smartglasses. We present EventHOI, an event-driven sensing and compression system that couples selective RGB capture with HOI-aware encoding to enable egocentric logging over Bluetooth Low Energy (BLE) while preserving downstream HOI logging performance. Our key insight is to use low-power event sensing both to determine when RGB capture is needed and to identify where visual detail must be preserved. A lightweight IMU-based egomotion cancellation pipeline suppresses egomotion-induced events so that residual HOI motion can guide RGB triggering and spatial compression. We build a smartglasses prototype and conduct an end-to-end evaluation of EventHOI on a 50-hour egocentric benchmark with 97 subjects and a 20-hour real-world dataset we collect from 10 participants, together covering a broad range of daily-life scenarios and environments. Compared to RGB-only baselines, EventHOI reduces always-on backend power consumption by 5.8-10.4x and uplink bandwidth by 2.9x, with minimal HOI recognition accuracy loss. The resulting RGB uplink of less than 130 kbps fits within commodity BLE bandwidth budgets, making stable BLE video streaming feasible for egocentric HOI logging. Demo video and project website: https://eventhoi.github.io
Source:https://arxiv.org/abs/2611.09089Previous"A Space Where I Can Be Myself": Exploring Safe Visibility for Graduate Student Mothers in Mom CafesNextRAG-Enhanced LLMs for Interactive Explainability in Clinical Decision Support Systems
Related posts
Prime Agent: an open source coding and research agent for long-running work
0dev.to Rust
Simple Extensions of Single-Objective Acquisition Functions and Hedge Strategies for Multi-Objective Bayesian Optimization
0arXiv stat.ML
Fine-Tuned Language Models Exhibit Improved Information Conveyance
0arXiv stat.ML
Computer-Use Agents Are Embodied Generalists
0arXiv cs.RO
Grasp-TAGS: Task-Aware Grasp Selection via Critic Distillation for Prehensile Loco-Manipulation
0arXiv cs.RO
DKWBC: Decoupling Motion Tracking and Balancing for Humanoid Whole-Body Control
0arXiv cs.RO