AI & ML
MFlowAudio: Efficient Text-to-Audio Synthesis via Mamba-based Stateful Flow Matching
arXiv cs.SD0 views
arXiv:2610.41852v1 Announce Type: new Abstract: Recent advancements in audio generation have been largely driven by Transformer-based diffusion models. However, these models suffer from quadratic complexity of self-attention, severely bottlenecking the long-form audio synthesis. To overcome this limitation, we propose MFlowAudio, a novel latent audio generation framework that synergizes the continuous-time dynamics of Flow Matching with a custom-designed TCMamba backbone. TCMamba uses an innovative dual-scan mechanism: a TimeMamba module to capture long-range causal dependencies with linear complexity, and a ChannelMamba module to model cross-channel correlations such as harmonic structures. Exploiting this structural foundation, we formulate the Stateful Flow Matching (SFM) paradigm. This framework inherently enables chunk-wise training and streaming generation, maintaining an $\mathcal{O}(1)$ caching complexity without incurring extra computational overhead. To enable fine-grained controllable synthesis, we devise a novel guidance mechanism that neutralizes vector field collisions precipitated by on-the-fly semantic transitions of prompts. Comprehensive empirical evaluations confirm that MFlowAudio yields generative fidelity on par with state-of-the-art baselines while establishing significant computational efficiency, achieving above $14.5$% acceleration in generation and facilitating perceptually seamless streaming synthesis with a constant latency of $1.8$ seconds. Demo: https://huggingface.co/spaces/mflowaudio/MFlowAudio
Source:https://arxiv.org/abs/2610.41852PreviousSelf-Localization of Distributed Microphone Arrays Using One Source and Acoustic ReflectionsNextSelf-Supervised Object-Centric Representation for Multi-Task Audio Analysis
Related posts
Arizona Layoffs November 2026: WARN Numbers Explained
0dev.to Career
New Freelancer With 3 Months of History? Here's How to Prove Income Anyway
0dev.to Career
WARN Act and Non-Disclosure Agreements — What a Layoff Does to Your NDA
0dev.to Career
Draft by Agent, Approve by Human: A Publishing API and MCP Server for Symfony 8.1
0dev.to PHP
A Cheat Sheet of One-Line Email Requests That Actually Work
0dev.to Beginners
One Modelflare sign-in, 70+ models: the exact switching path inside AnyModelBot
0dev.to OpenSource