AI & ML
Variational decomposition autoencoding improves disentanglement of latent representations
arXiv eess.AS0 views
arXiv:2601.06844v2 Announce Type: replace-cross Abstract: Understanding the structure of complex, nonstationary, high-dimensional time-evolving signals is a central challenge in scientific data analysis. In many domains, such as speech and biomedical signal processing, the ability to learn disentangled and interpretable representations is critical for uncovering latent generative mechanisms. Traditional approaches to unsupervised representation learning, including variational autoencoders (VAEs), often struggle to capture the temporal and spectral diversity inherent in such data. Here we introduce variational decomposition autoencoding (VDA), a framework that incorporates a strong structural bias toward signal decomposition into variational representation learning. VDA is instantiated through variational decomposition autoencoders (DecVAEs), i.e., encoder-only neural networks that perform latent autoencoding at the level of distributions to learn multiple latent subspaces aligned with time-frequency characteristics. We evaluate DecVAEs on simulated data and three publicly available scientific datasets, spanning speech recognition, dysarthric speech evaluation, and emotional speech classification. DecVAEs improve on VAE-based methods in disentanglement quality and robustness, and their latent subspaces become factor-specific when the generative factors have distinct spectral signatures. These findings position decomposition-aware architectures as potential tools for extracting structured representations from speech, and potentially from other dynamic signals with factors exhibiting distinct spectral signatures, with applications in clinical diagnostics, human-computer interaction, and adaptive neurotechnologies.
Source:https://arxiv.org/abs/2601.06844PreviousDM-ASR: Diarization-aware Multi-speaker ASR with Unified Offline and Online Decoding with Large Language ModelsNextExploring the potential and limitations of Model Merging for Multi-Domain Adaptation in ASR
Related posts
Your RAG chatbot confidently answers questions about docs that don't exist in production. How to fix.
0dev.to

Chatbots might be coming to Apple’s HomeView
0The Verge
단백질 속으로의 여정: 아르키메데스 나사와 NexoPeek
0dev.to
Why Flattened PDF Tables Break RAG (and How to Preserve Cell Semantics in Markdown)
0dev.to

'Dubious Ownership': The 2022 Git CVE Behind the Error Your Agent's Container Hits
0dev.to Git
Git for Beginners: Stop Losing Your Code and Start Versioning Like a Pro
0dev.to Git