20 results for “large audio-language models”
CS papers onlyHybrid search: Keyword + semantic, ranked by combined score.ⓘ
Want pure semantic search? Try claim verification →
Shengbo Cai, Zhisheng Zhang, Zichao Nie, Jing Peng +2 more
This paper introduces UniAE-MoE, a unified audio encoder that achieves state-of-the-art performance in audio understanding tasks.
Tzu-Quan Lin, Chih-Kai Yang, Yi-Cheng Lin, Hao Tang +1 more
This paper investigates how audio and text representations are integrated in large audio-language models.
Introduces a benchmark to analyze the causes of temporal reasoning failures in Large Audio Language Models (LALMs).
The authors identify confusion patterns in a large audio-language model and use them to curate diagnostic data for fine-tuning, achieving higher accuracy than the baseline.
This paper introduces a recipe for building a small audio-language model (ALM) with fewer than 200M parameters that achieves state-of-the-art results on three benchmarks.
Chen Yang, Chufan Yu, Hanfu Chen, Jie Zhu +21 more
MOSS-Audio is a unified audio-language model designed for comprehensive understanding of speech, environmental sounds, and music, achieving strong performance across various audio-grounded tasks.
Huadai Liu, Kaicheng Luo, Wen Wang, Qian Chen +3 more
This paper presents AudioCALM, a universal audio generation framework that unifies speech, sound, and music generation.
This paper investigates the performance of Generative Spoken Language Modeling (GSLM) on speech synthesis and continuation using discrete speech representations with varying bitrates.
Xiaoyu Yang, Xuenan Xu, Wenyi Yu, Siyin Wang +9 more
The paper proposes SALMONN-2, an ALLM built on a unified SSL encoder, and presents a multi-layer feature fusion adapter to better exploit hierarchical SSL encoder representations. It also explores mul…
Sicheng Yang, Shulan Ruan, Shiwei Wu, Yu Liu +3 more
PolySpeech-100 introduces a massive, multi-lingual benchmark covering 110 linguistic variants to rigorously test Speech-LLMs, demonstrating that open-source models struggle with low-resource languages…
Zhisheng Zhang, Xiang Li, Yixuan Zhou, Jing Peng +2 more
LoSATok proposes a low-dimensional semantic-acoustic tokenizer that efficiently compresses high-dimensional audio features into a compact latent space, significantly improving the performance and effi…
Yujie Tu, Yifan Yang, Tianrui Wang, Yanqiao Zhu +32 more
The paper introduces GigaSpeechBench, a comprehensive multilingual and multidimensional ASR & AST benchmark with 680 hours of human-annotated speech, featuring 12 low-resource languages, 6 Chinese dia…
Changhao Pan, Yifei Fan, Fan Zhuo, Yifu Chen +12 more
This paper provides a comprehensive review of audio editing in the era of foundation models, including a unified taxonomy of existing editing tasks and major foundation-model paradigms.
Junyu Wang, Tianrui Wang, Meng Ge, Longbiao Wang +2 more
This paper proposes AD-Mamba, a multi-stage knowledge distillation framework that improves the performance of state space models in audio classification tasks.
Haechan Kim, Seungjun Chung, Inkyu Park, Jihoo Lee +1 more
The paper introduces three new Korean speech benchmarks (KVoiceBench, KOpenAudioBench, and KMMAU) to evaluate SpeechLMs, demonstrating that English-centric evaluation fails to capture performance gaps…