AI & ML
Multi-Phonation Graph Learning with Self-Supervised Speech Embeddings for ALS Detection and Progression Prediction
arXiv cs.SD0 views
arXiv:2607.25284v2 Announce Type: replace-cross Abstract: Amyotrophic lateral sclerosis (ALS) progressively impairs speech motor control, making acoustic analysis a promising biomarker for severity and progression estimation. We propose a subject-level graph framework that aggregates multiple phonation recordings into a unique k-nearest-neighbor graph built from pretrained SSL embeddings of 2s segments. We compare four SSL front-ends (wav2vec 2.0, HuBERT, data2vec-audio, and UniSpeech-SAT) and five graph neural networks (GCN, residual GCN, GAT, GraphSAGE, and GIN) on the SAND dataset tasks (339 participants: 205 ALS, 134 control): 5-class dysarthria severity and 4-class ALSFRS-R progression prediction. On the official validation set, the best configuration (HuBERT+GIN) achieves macro-F$_1$ of 0.73 for Task 1 and 0.69 for Task 2, outperforming SAND validation baselines (0.61 and 0.58). These results highlight the potential of combining GNNs with pretrained cross-lingual speech representations for low-resource ALS detection and progression monitoring.
Source:https://arxiv.org/abs/2607.25284PreviousMinimizing Modality Gap from the Input Side: Your Speech LLM Can Be a Prosody-Aware Text LLMNextTamilEOT: A Dataset and Model for Semantic End-of-Turn Detection in Tamil Telephone Speech
Related posts
Show HN ::Duo Vibe–Couples App: Connect with yours and enjoy there
0Hacker News New
The Race to Build a "Find My" for AI Chips
0Hacker News New
Show HN: ISBN Books in Claude
0Hacker News New
OpenAI orginated from YC non-profit research? How to build impactful Institutes?
0Hacker News New
xAI's Jet Engine-Powered Data Center Has Experts Raising the Alarm
0Hacker News New
Aaronson-Ambainis Conjecture proved (By AI, of course)
0Hacker News New