AI & ML
MFlowAudio: Efficient Text-to-Audio Synthesis via Mamba-based Stateful Flow Matching
arXiv cs.SD0 views
arXiv:2610.41852v1 Announce Type: new Abstract: Recent advancements in audio generation have been largely driven by Transformer-based diffusion models. However, these models suffer from quadratic complexity of self-attention, severely bottlenecking the long-form audio synthesis. To overcome this limitation, we propose MFlowAudio, a novel latent audio generation framework that synergizes the continuous-time dynamics of Flow Matching with a custom-designed TCMamba backbone. TCMamba uses an innovative dual-scan mechanism: a TimeMamba module to capture long-range causal dependencies with linear complexity, and a ChannelMamba module to model cross-channel correlations such as harmonic structures. Exploiting this structural foundation, we formulate the Stateful Flow Matching (SFM) paradigm. This framework inherently enables chunk-wise training and streaming generation, maintaining an $\mathcal{O}(1)$ caching complexity without incurring extra computational overhead. To enable fine-grained controllable synthesis, we devise a novel guidance mechanism that neutralizes vector field collisions precipitated by on-the-fly semantic transitions of prompts. Comprehensive empirical evaluations confirm that MFlowAudio yields generative fidelity on par with state-of-the-art baselines while establishing significant computational efficiency, achieving above $14.5$% acceleration in generation and facilitating perceptually seamless streaming synthesis with a constant latency of $1.8$ seconds. Demo: https://huggingface.co/spaces/mflowaudio/MFlowAudio
Source:https://arxiv.org/abs/2610.41852PreviousSelf-Localization of Distributed Microphone Arrays Using One Source and Acoustic ReflectionsNextSelf-Supervised Object-Centric Representation for Multi-Task Audio Analysis
Related posts
Hypergraph Generation via Structured Stochastic Diffusion
0arXiv stat.CO
Sparse Probabilistic Richardson Extrapolation
0arXiv stat.CO
Dynamic Bayesian Predictive Stacking via Markovian Spatiotemporal Propagation
0arXiv stat.CO
Coherent forecast combination for linearly constrained multiple time series
0arXiv stat.CO
New optimisations for exact, scalable 2D Gaussian process inference, with applications to astronomical time-series
0arXiv stat.CO
A tractable transition function for the Wright-Fisher diffusion with selection via gamma duality
0arXiv stat.CO