AI & ML
Emo-H2A: Driving a Facial Robot Directly from LLM Hidden States at Token Rate
arXiv cs.RO0 views
arXiv:2611.23932v1 Announce Type: new Abstract: Diverse, semantically synchronized, and low-latency facial expressions are essential for human-robot interaction. While large language models (LLMs) have endowed anthropomorphic robots with fluent speech, facial expression still struggles to follow the conversation. Motivated by this gap, we present Emo-H2A (hidden-to-actuation), a paradigm that drives a facial robot directly from LLM hidden states during autoregressive decoding. Without a separate emotion label, expression stays continuous and context-sensitive, and the face moves with the unfolding reply. We instantiate this paradigm as EmoManifold, a training-free method that extracts a valence-arousal-dominance (VAD) coordinate from each hidden state, projects it, and drives the face at token granularity. The readout is checked on six language models, and the same projection drives our 29-degree-of-freedom (DoF) facial robot. When driven by this projection, the face shifts its expression in the matching direction on 87.5% of within-reply valence transitions, whereas holding a single label for the whole reply leaves directional tracking near the 50% chance level, and first moves in 0.96s rather than waiting 10-26s for the reply to finish and a turn-level label to return.
Source:https://arxiv.org/abs/2611.23932PreviousHow to Make AI Part of Every Employee's Day Without Breaking Trust or ComplianceNextFacet-SLAM: Real-Time Triangle Splatting SLAM
Related posts
Re-Testing LLM-Based C-to-Rust Translations Against Their Original C
0arXiv cs.SE
Reliability is a user-specific property of large language models
0arXiv cs.SE
Safe Personal RSI: Evaluating and Repairing Personal-Agent Updates
0arXiv cs.SE
Option-GRPO: Hierarchical RL Against AI Slop in Code Generation for Unseen SDKs
0arXiv cs.SE
Systematic Mapping Protocol. Generative AI-Augmented Requirements Engineering: A Systematic Mapping Study of Practices, Specifications, and Reuse in Software Development
0arXiv cs.SE
RootSink: Reproducible C/C++ Crashes with Tested Repair Sites
0arXiv cs.SE