Hugo Van hamme
3 indexed papers
Publications per year
Top categories
Frequent co-authors
Research Timeline
Integrating LLMs with speech encoders to improve speech recognition
This paper investigates whether combining multiple pre-trained speech encoders can improve speech-aware large language models for automatic speech recognition.
The paper proposes a training method to improve speech recognition by using video metadata and LLM-generated explanations to perform contextual reasoning.