AI & ML
High-Fidelity Binarized Neural Vocoder
arXiv cs.SD0 views
arXiv:2611.22593v1 Announce Type: new Abstract: Neural vocoders have achieved remarkable progress in high-fidelity waveform generation in recent years, but most existing methods still rely on full-precision operators, leading to non-negligible storage and computational costs during inference. Binary neural networks (BNNs) provide an alternative direction by quantizing weights and activations to 1 bit. However, directly applying binarization to neural vocoders is rather challenging as it inherently incurs severe information loss. To this end, we propose BiVoC, a BNN-oriented time-frequency neural vocoder for high-fidelity waveform generation. Building on our previous full-precision RNDVoC framework, BiVoC adapts the inverse-problem formulation, range-null decomposition, and fineto-coarse non-uniform subband modeling to the 1-bit setting. Specifically, we develop a simple binarized convolutional unit to provide stable time-frequency feature modeling under binary representations. Furthermore, we analyze the quality-complexity sensitivity of different modules and propose a mixed-precision design to retain quality-sensitive components in full precision while binarizing computation-dominant parts. Extensive experiments are conducted on LibriTTS and multiple out-of-distribution benchmarks. Both objective and subjective results demonstrate that BiVoC substantially outperforms BNN variants obtained by directly binarizing existing vocoders, while achieving competitive performance against several mainstream full-precision vocoder baselines under much lower theoretical computational cost. These results demonstrate the promising potential of BNNs in the audio generation field. Codes and pre-trained weights are available at https://github.com/Andong-Li-speech/BiVoC.
Source:https://arxiv.org/abs/2611.22593PreviousEvaluating the Evaluation of Music Generation Models with Generative PsychometricsNextBeyond Mimicry: Constrained Exploration with GRPO for Joint Multi-Talker ASR and Diarization under Unknown Speaker Counts
Related posts
Code review, automated tests and observed behaviour
0dev.to WebDev
What is an agent harness?
0dev.to Python
What 164,000 open Greenhouse jobs look like (and how to search all 4,000 boards at once)
0dev.to Python
Auth healing pattern for autonomous agents: a 60-line approach
0dev.to Python

Microsoft Ends Unmanaged Developer Environments in Power Platform
0dev.to DevOps

Anthropic's 26% Is a Measurement Story Before It Is a Warning
0dev.to DevOps