Open Source
EventHOI: Event-Driven Resource-Efficient Hand-Object Interaction Logging on Smartglasses
arXiv cs.HC0 views
arXiv:2611.09089v1 Announce Type: cross Abstract: Hand-object interactions (HOIs) can be captured by smartglasses to learn how people manipulate objects in daily life. Automatic logging of these interactions from an egocentric perspective provides time-stamped evidence of daily actions for applications like memory assistance. However, continuous RGB capture and wireless transmission exceed the energy and bandwidth budgets of smartglasses. We present EventHOI, an event-driven sensing and compression system that couples selective RGB capture with HOI-aware encoding to enable egocentric logging over Bluetooth Low Energy (BLE) while preserving downstream HOI logging performance. Our key insight is to use low-power event sensing both to determine when RGB capture is needed and to identify where visual detail must be preserved. A lightweight IMU-based egomotion cancellation pipeline suppresses egomotion-induced events so that residual HOI motion can guide RGB triggering and spatial compression. We build a smartglasses prototype and conduct an end-to-end evaluation of EventHOI on a 50-hour egocentric benchmark with 97 subjects and a 20-hour real-world dataset we collect from 10 participants, together covering a broad range of daily-life scenarios and environments. Compared to RGB-only baselines, EventHOI reduces always-on backend power consumption by 5.8-10.4x and uplink bandwidth by 2.9x, with minimal HOI recognition accuracy loss. The resulting RGB uplink of less than 130 kbps fits within commodity BLE bandwidth budgets, making stable BLE video streaming feasible for egocentric HOI logging. Demo video and project website: https://eventhoi.github.io
Source:https://arxiv.org/abs/2611.09089Previous"A Space Where I Can Be Myself": Exploring Safe Visibility for Graduate Student Mothers in Mom CafesNextRAG-Enhanced LLMs for Interactive Explainability in Clinical Decision Support Systems
Related posts
5G-NetBotSim: A Synchronized Co-Simulation Framework for Connected Robots over ROS and srsRAN-based 5G Network
0arXiv cs.NI
Quantum-Enhanced Classical Communications for DPMZM-based NG-PON2 Systems
0arXiv eess.SP
Classification Aggregation with Multiple Memberships
0arXiv cs.MA
Generalized Intention Modeling in Multi-Agent Reinforcement Learning
0arXiv cs.MA
Truncated Signature Information for Mixed Fractional Brownian Paths
0arXiv stat.TH
Phase transition for conditional covariance matrices estimated by importance sampling, and implications for cross-entropy schemes in high dimension
0arXiv stat.TH