AI & ML
Exploring the potential and limitations of Model Merging for Multi-Domain Adaptation in ASR
arXiv eess.AS0 views
arXiv:2603.05354v2 Announce Type: replace-cross Abstract: Model merging is a scalable alternative to multi-task training that combines the capabilities of multiple specialised models into a single model. This is particularly attractive for large speech foundation models, which are typically adapted through domain-specific fine-tuning, resulting in multiple customised checkpoints, for which repeating full fine-tuning when new data becomes available is computationally prohibitive. In this work, we study model merging for multi-domain ASR and benchmark 11 merging algorithms for 10 European Portuguese domains, evaluating in-domain accuracy, robustness under distribution shift, as well as English and multilingual performance. We further propose BoostedTSV-M, a new merging algorithm based on TSV-M that mitigates rank collapse via singular-value boosting and improves numerical stability. Overall, our approach outperforms full fine-tuning on European Portuguese while preserving out-of-distribution generalisation in a single model.
Source:https://arxiv.org/abs/2603.05354PreviousVariational decomposition autoencoding improves disentanglement of latent representationsNextIngeniería de Software TPV Local para Alimentación y Supermercados: Conexión a Balanzas Homologadas y Tickets con Trazabilidad (Vol. 34)
Related posts
단백질 속으로의 여정: 아르키메데스 나사와 NexoPeek
0dev.to
Why Flattened PDF Tables Break RAG (and How to Preserve Cell Semantics in Markdown)
0dev.to

'Dubious Ownership': The 2022 Git CVE Behind the Error Your Agent's Container Hits
0dev.to Git
Git for Beginners: Stop Losing Your Code and Start Versioning Like a Pro
0dev.to Git
The Azure CLI Extension That Doesn't Exist — And Is Probably in Your SAP Runbook
0dev.to Database
AI signals this week (2026-11-02 to 2026-11-08): what actually moved
0dev.to AI