20 results for “Multimodal Large Language Models”
CS papers onlyHybrid search: Keyword + semantic, ranked by combined score.ⓘ
Want pure semantic search? Try claim verification →
This survey provides a comprehensive taxonomy and vulnerability-centric analysis of adversarial attacks targeting Multimodal Large Language Models (MLLMs), offering an explanatory framework for enhanc…
Changhao Xiang, Shangyu Xing, Zhen Wu, Jianbing Zhang +1 more
This paper introduces MultiModal Code-Switching (MMCS), a new pretraining paradigm for multimodal large language models that provides explicit object-level supervision and improves visual grounding an…
This paper proposes a multimodal graph-based approach for constructing knowledge graphs from visually rich documents to improve multimodal question answering.
The paper introduces MLLM-Microscope, a system that analyzes the internal structure of multimodal large language models (MLLMs), finding that modality fusion significantly impacts the linearity and di…
Megan Wei, Deepali Aneja, Jiaqi Su, Yunyun Wang +2 more
This paper introduces MMEE, a multilingual and multi-emotion corpus for emphasis detection, and evaluates two state-of-the-art models under various settings.
This paper analyzes speech-text interleaved language models and reveals that they go through an implicit transcription phase in which spoken words become decodable as text in intermediate layers.
Yiming Zhang, Zhonghan Zhao, Wenwei Zhang, Haiteng Zhao +12 more
This paper presents the benefits of visual pretraining for foundation model intelligence, outperforming text-only pretraining on multiple backbones and benchmarks.
Tomoya Mizumoto, Yusuke Fujita, Hao Shi, Lianbo Liu +2 more
This paper investigates the dialectal robustness of large language models and speech language models using Japanese dialects.
Bingshen Mu, Mingchen Shao, Zhennan Lin, Liumeng Xue +6 more
The paper summarizes the Interspeech2026 Multilingual Conversational Speech Language Model Challenge and presents the results and insights from the challenge.
Yuxiang Guo, Zhonghao Hu, Yuren Mao, Yuhang Liu +4 more
This paper presents Stellar, a scalable multimodal document retrieval framework that reduces memory overhead and query latency without compromising retrieval effectiveness.
This paper proposes a Romanized transcription-based text-to-speech encoder for multilingual TTS systems that can handle 495 languages.
The paper proposes Large Language Gibbs, a scheme for structured probabilistic inference using conditional distributions of large language models as transition operators.
Sicheng Yang, Shulan Ruan, Shiwei Wu, Yu Liu +3 more
PolySpeech-100 introduces a massive, multi-lingual benchmark covering 110 linguistic variants to rigorously test Speech-LLMs, demonstrating that open-source models struggle with low-resource languages…
The paper introduces Dialogs, a new Russian conversational speech corpus with high-quality recordings, segmented utterances, and expressive prosody labels.
MEUSLI introduces an open-source multilingual projector family linking a Whisper encoder with LLMs, enabling end-to-end ASR in 28 European languages and supporting multilingual speech translation and…
Tzu-Quan Lin, Chih-Kai Yang, Yi-Cheng Lin, Hao Tang +1 more
This paper investigates how audio and text representations are integrated in large audio-language models.
The paper presents a new text-to-image generation model, Halcyon, that can be trained from scratch without internet-scale language pretraining.