~ similar to 2607.01594· 19 results
This paper proposes an SSL-AutoEncoder (SSL-AE) approach for reducing feature dimensions in self-supervised learning models while maintaining dysarthric ASR performance.
A lightweight framework for automated pronunciation assessment using native speech resources and unsupervised or lightly calibrated methods.
This paper systematically evaluates acoustic-to-articulatory inversion under domain shifts on FROST-EMA, a Finnish-Russian bilingual EMA corpus, and establishes benchmarks for articulatory targets, ac…
The study investigates the limitations of Phonetic Foundation Models (PFMs) for Speech-to-IPA transcription using Grapheme-to-Phoneme (G2P) labels and proposes a new approach based on continuous Artic…
Ye Lu, Yihan Yan, Zhaoyang Zhang, Zhitao Ou +3 more
This paper introduces Audio BERT (AuB) and SpInv, methods for recovering embeddings from speech tokens and performing speaker inversion attacks using only three seconds of frontend output.
Yifan Liao, Zongmin Zhang, Zhen Sun, Yuhui Sun +2 more
The paper introduces a novel Clean-Referenced Feature-Vocoder Attack, a black-box adversarial attack that perturbs high-level SSL feature representations instead of raw audio waveforms, achieving supe…
Yuxuan Wu, Yifan Xu, Junkun Wang, Jiayong Jiang +2 more
This paper introduces Re-Sonance, a real-time speech-driven AAC system for professional speaking scenarios using LLM-enhanced Whisper ASR, Qwen LLM, and CosyVoice TTS.
This paper proposes a graph framework using pretrained SSL embeddings for speech analysis in Amyotrophic Lateral Sclerosis (ALS) patients, achieving better results than validation baselines on the SAN…
Xiaoyu Yang, Xuenan Xu, Wenyi Yu, Siyin Wang +9 more
The paper proposes SALMONN-2, an ALLM built on a unified SSL encoder, and presents a multi-layer feature fusion adapter to better exploit hierarchical SSL encoder representations. It also explores mul…
This paper investigates the use of various acoustic features for recognizing dysarthric speech using a Factorized Time Delay Neural Network (F-TDNN) model, achieving a relative improvement of 4.65% in…
The paper proposes methods for generating global prosodic embeddings using auto-encoder models of pitch and energy, demonstrating competitive or superior performance under challenging conditions.
The paper introduces GRIDS, a framework using Local Intrinsic Dimensionality (LID) to detect anomalies in self-supervised speech model representations, showing that LID elevation correlates with ASR d…
SooHwan Eom, Hee Suk Yoon, Eunseop Yoon, Mark Hasegawa-Johnson +1 more
The paper proposes RTFree-F5, a method to make flow-matching TTS models like F5-TTS independent of reference transcripts, improving performance and naturalness for dysarthric speakers.