AI & ML
GRIDEX: Region-Grounded Forensic Explanations for Vocoder-Based Synthetic Speech
arXiv cs.SD0 views
arXiv:2606.18738v2 Announce Type: replace Abstract: The advancement of speech generation technologies has made artificial speech increasingly realistic. Although modern classifiers achieve high accuracy in deepfake detection, they do not indicate where spoof cues appear in the spectrogram and what they imply acoustically, limiting their usefulness in forensic settings. Manual analysis of full spectrograms is resource-intensive, so evidence should narrow attention to the most diagnostic regions. Moreover, existing explainability methods have limited capabilities in connecting contextual attributes to localized evidence, making explanations harder to verify. To overcome this limitation, we propose GRIDEX, a pipeline that, given a detector-flagged spectrogram, generates forensic explanations of its anomalies. The pipeline (i) selects top-$K$ anomalous regions in the spectrogram and (ii) produces an explanation for each anomaly. The explanations follow a schema of categorical acoustic fields, including temporal, spectral, and phonetic information, as well as interpretation text. To our knowledge, this is the first framework to generate structured forensic explanations using region-grounded evidence in a controlled vocoder-based setting. GRIDEX is trained with a staged learning recipe that combines supervised fine-tuning (SFT) with Group Relative Policy Optimization (GRPO). Experiments on our dataset show improved artifact localization and explanation grounding quality over strong vision-language model (VLM) baselines.
Source:https://arxiv.org/abs/2606.18738PreviousUnified Synthesis of Compositional Speech and Sound from Free-Form Text PromptsNextA Factorial Ablation of a Speech-to-SFT Pipeline: Differential Effects on Data Quality and Downstream Transfer
Related posts
I wanted one screen that said whether a kids' app was worth installing
0dev.to

Before I Could Build GPT, I Had to Teach a Machine to Learn
0dev.to
Cogent and OpenAI build cyber defense factories for enterprises
0OpenAI Blog
ChatGPT Plus for veterans and servicemembers
0OpenAI Blog
Hitting 200 Strokes: What the Signature Maker Does at Its Stroke Limit
0dev.to
A Lightweight, Open-Source Network Digital Twin Blueprint for IoT-Edge Environments
0arXiv cs.NI