ArXivCSExplorer
☆☆Bookmarks🏆RSSHow to UseFAQ
Built with and by Teycir Ben Soltane•
How to Use•FAQ•GitHub•arXiv.org•
Share:

20 results for “lip synchronization”

CS papers only

Hybrid search: Keyword + semantic, ranked by combined score.ⓘ

Want pure semantic search? Try claim verification →

cs.CVEmpiricalRecentJun 9, 2026

Lip Forcing: Few-Step Autoregressive Diffusion for Real-time Lip Synchronization

Paul Hyunbin Cho, Jinhyuk Jang, SeokYoung Lee, Joungbin Lee +6 more

This paper presents Lip Forcing, an autoregressive diffusion method for real-time video-to-video lip synchronization.

View →
cs.SDcs.AIEmpiricalRecentJul 20, 2026

Re-Sonance: A Dysarthric Asynchronous Real-Time Speech Conversion System Based on a Three-Stage Cascaded ASR-LLM-TTS Architecture

Yuxuan Wu, Yifan Xu, Junkun Wang, Jiayong Jiang +2 more

This paper introduces Re-Sonance, a real-time speech-driven AAC system for professional speaking scenarios using LLM-enhanced Whisper ASR, Qwen LLM, and CosyVoice TTS.

View →
eess.ASEmpiricalRecentJun 22, 2026

Don't Listen to Me: A Lightweight, Low-Latency Model for Own-Voice Cancellation in Far-Field Speech Enhancement

Mads Østergaard, Alexander Neergaard Zahid, Karl Ulbæk, Andreas Hansen Bagge +2 more

This paper introduces own-voice cancellation (OVC) to remove a target speaker from a noisy multi-speaker mixture with low latency.

View →
cs.SDcs.LGEmpiricalRecentJun 25, 2026

Advancing Speaker-Based Vocal Effort Classification with WavLM and Data Augmentation in Naturalistic Non-Calibrated Speech Recordings

Zahra Omidi, John H. L. Hansen

This paper introduces WavLM for vocal effort classification and improves performance through data augmentation and Gaussian-neighbor soft labels, achieving a new state-of-the-art on AVID.

View →
cs.SDcs.CLEmpiricalRecentJun 22, 2026

Synthesizing the Lombard Effect: Multi-Level Control of Speech Clarity and Vocal Effort in TTS

Seymanur Akti, Alexander Waibel

A text-to-speech model is trained to simulate the Lombard effect, improving clarity in noisy conditions.

View →
eess.AScs.CLcs.SDEmpiricalRecentJun 24, 2026

Fully Differentiable Neural Forced Alignment via Soft Dynamic Programming

Rotem Rousso, Eyal Cohen, Joseph Keshet

The authors propose an end-to-end neural architecture for phoneme alignment that outperforms the current state of the art.

View →
cs.SDeess.ASEmpiricalRecentOct 30, 2026

Scalable Audio-LLM System for Speech MOS Evaluation: A Diagnostic Case Study and Adaptation Roadmap

Dimitrios Kokkinis, Panagiotis Kakoulidis, Nikolaos Ellinas, Chrysovalanti Lymperi +9 more

The authors present a system design case study for a scalable, low-cost, and offline evaluation pipeline for synthetic speech quality.

View →
eess.ASEmpiricalRecentSep 25, 2026

Assessing a Mathematical Model of Syllable Production via CTW Alignment with EMA Data

Frédéric Berthommier

This study evaluates a mathematical model of syllable production using EMA data and validates its representational validity.

View →
eess.ASEmpiricalRecentJun 18, 2026

Transcript-Free Flow-Matching Text-to-Speech via Speech Feature Conditioning

SooHwan Eom, Hee Suk Yoon, Eunseop Yoon, Mark Hasegawa-Johnson +1 more

The paper proposes RTFree-F5, a method to make flow-matching TTS models like F5-TTS independent of reference transcripts, improving performance and naturalness for dysarthric speakers.

View →
cs.SDcs.OSEmpiricalRecentJun 10, 2026

Real-Time Language Model Jamming: A Case Study for Live Music Accompaniment Generation

Bowen Zheng, Andrew H. Yang, Jiaqi Ruan, Jia He +4 more

The authors present StreamMUSE, an inference system for language models that performs synchronous generation with external signals in real-time.

View →
eess.AScs.AIcs.SDEmpiricalRecentJul 9, 2026

On the Role of Conversational Timing in Synthetic Training Data for ASR

Máté Gedeon, Péter Mihajlik

This paper explores the effect of conversational timing properties on automatic speech recognition (ASR) systems by controlling and optimizing pause and overlap timing distributions.

View →