AI & ML
Route-DMD: Distribution Matching Distillation with Task-Routed Mechanism for Speech Foundation Models
arXiv cs.SD0 views
arXiv:2611.08011v1 Announce Type: new Abstract: Speech foundation models built on flow matching handle generation, editing, and processing in one system, but every request costs 20-50 iterative steps, and classifier-free guidance (CFG) doubles each of them. Distribution matching distillation (DMD) trains a student that approaches the teacher's quality in a few steps, yet existing speech distillation work applies it to generation alone. We show that a distribution-matching objective does not serve every task: in separation, the noised states of erroneous student outputs deviate far from the teacher's training distribution, where its prediction is unreliable. Route-DMD therefore makes the objective task-dependent, routing the affected tasks to a regression loss and keeping decoupled distribution matching elsewhere. The student is initialized by consistency distillation, and teacher rollouts use adaptive projected guidance (APG) instead of CFG. Without CFG, the 4-step student matches the 32-step teacher on generation, editing, and processing tasks at a 4.5$\times$ end-to-end speedup.
Source:https://arxiv.org/abs/2611.08011PreviousProCraft: Instruction-Driven Music Production from Free-Form TextNextVoxCanvas-41M: A Large-Scale Bilingual Dataset for Instruction-Based Speech Editing and Its Learning Dynamics
Related posts
A 13-Year-Old Asked AI About Suicide on Her School Laptop. It Didn’t Get Flagged for Weeks
0Wired

I stopped babysitting Claude Code: spec in, pull request out
0dev.to
Mastering CPMAI Certification: Your Training Guide
0dev.to
HPE7-A11 Exam: A Design-Artifact Guide to Campus Access Architecture
0dev.to

Railway's Breach Cost $740,000 in Fraudulent AI Charges — and Up to 100,000 Workspaces May Have Leaked Secrets
0dev.to
Nod Reports 98% Agent Task Completion and 93.2% Long-Term Memory Recall in Tests
0dev.to