AI & ML
High-Fidelity Binarized Neural Vocoder
arXiv cs.SD0 views
arXiv:2611.22593v1 Announce Type: new Abstract: Neural vocoders have achieved remarkable progress in high-fidelity waveform generation in recent years, but most existing methods still rely on full-precision operators, leading to non-negligible storage and computational costs during inference. Binary neural networks (BNNs) provide an alternative direction by quantizing weights and activations to 1 bit. However, directly applying binarization to neural vocoders is rather challenging as it inherently incurs severe information loss. To this end, we propose BiVoC, a BNN-oriented time-frequency neural vocoder for high-fidelity waveform generation. Building on our previous full-precision RNDVoC framework, BiVoC adapts the inverse-problem formulation, range-null decomposition, and fineto-coarse non-uniform subband modeling to the 1-bit setting. Specifically, we develop a simple binarized convolutional unit to provide stable time-frequency feature modeling under binary representations. Furthermore, we analyze the quality-complexity sensitivity of different modules and propose a mixed-precision design to retain quality-sensitive components in full precision while binarizing computation-dominant parts. Extensive experiments are conducted on LibriTTS and multiple out-of-distribution benchmarks. Both objective and subjective results demonstrate that BiVoC substantially outperforms BNN variants obtained by directly binarizing existing vocoders, while achieving competitive performance against several mainstream full-precision vocoder baselines under much lower theoretical computational cost. These results demonstrate the promising potential of BNNs in the audio generation field. Codes and pre-trained weights are available at https://github.com/Andong-Li-speech/BiVoC.
Source:https://arxiv.org/abs/2611.22593PreviousEvaluating the Evaluation of Music Generation Models with Generative PsychometricsNextBeyond Mimicry: Constrained Exploration with GRPO for Joint Multi-Talker ASR and Diarization under Unknown Speaker Counts
Related posts
Microsoft’s new Licensed Weights lets businesses customize AI models with their own data
0ZDNet

“Collaboration over competition”: Hugging Face hands model inference traffic to OpenRouter
0The New Stack
Robots learn human movement patterns to find paths through dense crowds
0Phys.org Tech
Researchers find eight ways AI could lead to our downfall
0Phys.org Tech
Q&A: Why transportation is critical to rebuilding countries after war and terrorism
0Phys.org Tech
Wine Merges Remote OpenGL Swapchain Image Presentation, CEF Now Works With Wayland
0Phoronix