~ similar to 2606.21453· 12 results
Haechan Kim, Seungjun Chung, Inkyu Park, Jihoo Lee +1 more
The paper introduces three new Korean speech benchmarks (KVoiceBench, KOpenAudioBench, and KMMAU) to evaluate SpeechLMs, demonstrating that English-centric evaluation fails to capture performance gaps…
Sicheng Yang, Shulan Ruan, Shiwei Wu, Yu Liu +3 more
PolySpeech-100 introduces a massive, multi-lingual benchmark covering 110 linguistic variants to rigorously test Speech-LLMs, demonstrating that open-source models struggle with low-resource languages…
Yuxiang Zhao, Yichi Zhang, Yanjie An, Yanqiao Zhu +9 more
X-Translator is a low-cost modular system for real-time speech-to-speech translation, using streaming ASR, machine translation, and prompt-conditioned TTS, with session-level control.
David Ayllon, Alice Baird, Jeffrey Brooks, Franc Camps-Febrer +10 more
The paper introduces the Real World Voice EQ Bench, a multidimensional benchmark for evaluating voice AI across text-to-speech, speech-to-speech, speech understanding, and automatic speech recognition…
The paper proposes DOA, a training-free attention policy that leverages self-attention in decoder-only SpeechLLMs to achieve high-quality, low-latency simultaneous long-form translation without requir…
This paper proposes a reinforcement learning approach for adapting audio-language models to code-switched speech using group relative policy optimization and verifiable rewards.
Rongshen He, Xinyu Liang, Dekun Chen, Jiaqi Li +2 more
This paper introduces a training recipe for sentence-level and long-form streaming speech-to-speech translation using only 2k hours of paired cross-lingual data and auxiliary supervision.
Zhenyu Liu, Yunxin Li, Xuanyu Zhang, Qixun Teng +9 more
This paper identifies the root cause of performance degradation in full-duplex Spoken Language Models (SLMs) due to modality interference and proposes Lychee-FD, a framework that decouples conflicting…
Ruchao Fan, Yiming Wang, Rui Zhao, Liliang Ren +9 more
This paper proposes Joint Speech-Text Interleaved Pretraining (JSTIP) for speech recognition, which constructs interleaved speech-text sequences and achieves consistent entity accuracy improvement.
This paper evaluates the use of large audio language models for speaker verification systems against conventional pipelines and finds that task-specific adaptation improves performance.
Jing Peng, Junhao Du, Chenghao Wang, Hanqi Li +20 more
The paper introduces SURE, a unified framework designed to standardize and improve the comparability and reproducibility of evaluations for advanced speech understanding models.