AI & ML
Route-DMD: Distribution Matching Distillation with Task-Routed Mechanism for Speech Foundation Models
arXiv cs.SD0 views
arXiv:2611.08011v1 Announce Type: new Abstract: Speech foundation models built on flow matching handle generation, editing, and processing in one system, but every request costs 20-50 iterative steps, and classifier-free guidance (CFG) doubles each of them. Distribution matching distillation (DMD) trains a student that approaches the teacher's quality in a few steps, yet existing speech distillation work applies it to generation alone. We show that a distribution-matching objective does not serve every task: in separation, the noised states of erroneous student outputs deviate far from the teacher's training distribution, where its prediction is unreliable. Route-DMD therefore makes the objective task-dependent, routing the affected tasks to a regression loss and keeping decoupled distribution matching elsewhere. The student is initialized by consistency distillation, and teacher rollouts use adaptive projected guidance (APG) instead of CFG. Without CFG, the 4-step student matches the 32-step teacher on generation, editing, and processing tasks at a 4.5$\times$ end-to-end speedup.
Source:https://arxiv.org/abs/2611.08011PreviousProCraft: Instruction-Driven Music Production from Free-Form TextNextVoxCanvas-41M: A Large-Scale Bilingual Dataset for Instruction-Based Speech Editing and Its Learning Dynamics
Related posts
Infinix – Abandoned Local AI Agent Base Seeking Developers
0Hacker News New
Beeble
0Hacker News New
Microsoft Researcher John Langford Exits. AI Frontiers Group Declared Finished
0Hacker News New
GPT-6 Astra Covertly Underperforms on Safety Research Tasks
0Hacker News New
The End of AI Frontiers
0Hacker News New
TokiRecur – llama.cpp LLM launcher with KV-cache recycling
0Hacker News New