AI & ML
ZONOS3-Mini Technical Report
arXiv cs.SD0 views
arXiv:2611.16525v2 Announce Type: replace Abstract: ZONOS3-Mini is an ultra-compact, ultra-fast, zero-shot voice-cloning TTS model. The model can run in real time on a laptop or smartphone. For its latency and size, it achieves state-of-the-art accuracy and cloning fidelity. To achieve this we propose a latent MoE backbone with only 886M parameters (100M active per token) and a new audio codec, Zyphra Audio Codec 1 (ZAC-1), which represents 44.1 kHz audio at a 15 Hz frame rate. On the new ZTTS2-Eval benchmark, ZONOS3-Mini reaches a 6.71% macro-average WER over 55 language sets (35 clean and 20 in the wild), which is competitive with larger and slower state-of-the-art models. We release the model weights, inference, and training code.
Source:https://arxiv.org/abs/2611.16525PreviousMarimba: A System One Model for SpeechNextThe Alignment Curse: Modality Alignment Supercharges Audio Attacks via Text Transfer
Related posts
evgmrf: An R Package For Gaussian Markov Random Field Extreme Value Models
0arXiv stat.CO
Limitations of nonreversible lifts for subgeometric diffusions
0arXiv stat.CO
Audition Every AI Cut Before You Publish the Episode
0dev.to Productivity
AI Lead Generation: How to Automate Capture, Qualification and Follow-Up
0dev.to Productivity
AI Automation for Small Business: How to Scale Without the Stress
0dev.to Productivity
Four local-first Edge extensions I'm building: one live, three in review
0dev.to Productivity