20 results for “lip synchronization”
CS papers onlyHybrid search: Keyword + semantic, ranked by combined score.ⓘ
Want pure semantic search? Try claim verification →
Paul Hyunbin Cho, Jinhyuk Jang, SeokYoung Lee, Joungbin Lee +6 more
This paper presents Lip Forcing, an autoregressive diffusion method for real-time video-to-video lip synchronization.
Yuxuan Wu, Yifan Xu, Junkun Wang, Jiayong Jiang +2 more
This paper introduces Re-Sonance, a real-time speech-driven AAC system for professional speaking scenarios using LLM-enhanced Whisper ASR, Qwen LLM, and CosyVoice TTS.
This paper introduces own-voice cancellation (OVC) to remove a target speaker from a noisy multi-speaker mixture with low latency.
This paper introduces WavLM for vocal effort classification and improves performance through data augmentation and Gaussian-neighbor soft labels, achieving a new state-of-the-art on AVID.
A text-to-speech model is trained to simulate the Lombard effect, improving clarity in noisy conditions.
The authors propose an end-to-end neural architecture for phoneme alignment that outperforms the current state of the art.
The authors present a system design case study for a scalable, low-cost, and offline evaluation pipeline for synthetic speech quality.
This study evaluates a mathematical model of syllable production using EMA data and validates its representational validity.
SooHwan Eom, Hee Suk Yoon, Eunseop Yoon, Mark Hasegawa-Johnson +1 more
The paper proposes RTFree-F5, a method to make flow-matching TTS models like F5-TTS independent of reference transcripts, improving performance and naturalness for dysarthric speakers.
Bowen Zheng, Andrew H. Yang, Jiaqi Ruan, Jia He +4 more
The authors present StreamMUSE, an inference system for language models that performs synchronous generation with external signals in real-time.
This paper explores the effect of conversational timing properties on automatic speech recognition (ASR) systems by controlling and optimizing pause and overlap timing distributions.