AI & ML
Beyond Intelligibility: Fine-Grained Perceptual Assessment of Dysarthric Speech with Auditory Large Language Models
arXiv cs.SD0 views
arXiv:2611.23768v1 Announce Type: cross Abstract: Accurate assessment of dysarthric speech is vital for clinical diagnosis and rehabilitation, yet existing automated methods rely heavily on isolated, single-task models or generic speech quality metrics that fail to disentangle heterogeneous neuromotor deficits. This work presents the first systematic investigation into adapting auditory large language models (ALLMs) for multi-dimensional dysarthric speech assessment under a unified, prompt-conditioned framework. Four representative ALLMs are benchmarked across five clinical perceptual dimensions from the Speech Accessibility Project (SAP): naturalness, monopitch, intelligibility, imprecise consonants, and inappropriate silences. To bridge generic perceptual quality and clinical evaluation, a two-stage training paradigm is explored, leveraging out-of-domain pre-training followed by in-domain clinical adaptation. Experimental results demonstrate that leading ALLMs reliably capture fine-grained pathological variations, exhibiting distinct and complementary strengths across prosodic and articulatory attributes. These findings establish ALLMs as a scalable foundation for clinical speech evaluation and provide practical insights into model selection and multi-task transfer potential.
Source:https://arxiv.org/abs/2611.23768PreviousLabel-Free Role-Aware Segmentation of Classroom Recordings: Recovering the Teacher from Transferable StructureNext21Codec: Decoder-side Speaker Control for Text-to-Speech
Related posts
Teaching VLMs What to Say, Not How to Reason: Rethinking Counterfactual Reasoning in Autonomous Driving
0arXiv cs.RO
SearchDiffusion: Information-Guided Diffusion Planning for Object Search
0arXiv cs.RO
Proprioceptive Simultaneous Base and Terrain Elevation Estimation for Legged Robot Locomotion
0arXiv cs.RO
Remote Teleoperation of Endovascular Robots: A Network Emulation Framework for Systematic Performance Evaluation
0arXiv cs.RO
QDD-MM: A Simple and Compact Open-Source Muscle Module with Quasi-Direct-Drive Motor for Tendon-driven Robots
0arXiv cs.RO
Old Experience, New Lessons: Relabeling Autonomous Robot Rollouts in Interactive Imitation Learning
0arXiv cs.RO