20 results for “Video diffusion transformer”
CS papers onlyHybrid search: Keyword + semantic, ranked by combined score.ⓘ
Want pure semantic search? Try claim verification →
This paper introduces MFlow, an adaptive parameterization for pixel-space diffusion models that learns to interpolate between two prediction methods, and ConvRefiner, a lightweight module to improve h…
Yuyang Zhao, Yicheng Pan, Qiyuan He, Jincheng Yu +5 more
SANA-Streaming introduces a novel, efficient framework that enables real-time, high-resolution streaming video-to-video editing by combining a hybrid diffusion transformer with specialized training an…
Ruotong Liao, Guowen Huang, Qing Cheng, Guangyao Zhai +5 more
TunerDiT introduces a training-free progressive steering method to enhance multi-event video generation using Diffusion Transformers, achieving state-of-the-art performance by explicitly managing even…
Bin Ma, Min Yu, Vijay Kodamalla, Jialin Liu +1 more
The authors present Difflet, a serving engine that accelerates diffusion model denoiser steps by fusing attention and reusing earlier outputs.
Xinyin Ma, Julius Berner, Chao Liu, Arash Vahdat +2 more
This paper introduces Flex-Forcing, a framework for video generation that enables a model to operate under both bidirectional and autoregressive generation regimes, achieving better video quality and…
Sangbeom Lim, Seoung Wug Oh, Heeji Yoon, Seungryong Kim +1 more
The paper presents a new framework for video matting that improves consistency across chunk boundaries in long videos.
Haoxuan Wu, Lai Man Po, Mengyang Liu, Kun Li +2 more
The paper introduces PRISM, a method for decoding preference signals from noisy latents using a lightweight Query-based Aggregation head and a frozen video diffusion backbone, achieving state-of-the-a…
This paper proposes KroQuant, a post-training quantization method for diffusion transformers using learned Kronecker-structured invertible transforms, which reduces parameters, improves speed, and mai…
Cheng-De Fan, Chun-Wei Tuan Mu, Chen-Wei Chang, Chin-Yang Lin +3 more
This paper proposes LongE2V, a method for high-quality video recovery from sparse event streams using pre-trained video diffusion priors.
Liting Gao, Yonggang Zhu, Yaru Chen, Dongyu Wang +4 more
This paper proposes a hybrid two-stage diffusion transformer architecture for instruction-guided audio editing, balancing performance and efficiency.
The paper proposes VRPO, a reinforcement learning-based optimization strategy that replaces static alignment losses in diffusion models, significantly improving both convergence and image fidelity.
VideoMLA introduces a novel Multi-Head Latent Attention (MLA) mechanism that replaces per-head KV caches with a shared low-rank content latent, significantly reducing memory and improving throughput f…
This paper introduces Video Diffusion Avatars, a method for creating photo-realistic, multi-view consistent avatars from a single image.
Paul Hyunbin Cho, Jinhyuk Jang, SeokYoung Lee, Joungbin Lee +6 more
This paper presents Lip Forcing, an autoregressive diffusion method for real-time video-to-video lip synchronization.
Chao Feng, Zhiyang Xu, Bowei Chen, Yuanjun Xiong +6 more
This paper improves text-to-image generation performance by using the clean data parameterization in RAEs.
Jinyang Du, Shenghao Jin, Ziqian Xu, Ruihao Gong +4 more
The paper proposes a compression pipeline combining few-step distillation and low-bit quantization to significantly reduce the deployment cost and parameter footprint of large dual-expert video diffus…
Jingyun Liang, Min Wei, Shikai Li, Yizeng Han +4 more
The paper proposes a novel render-free framework that conditions video diffusion models directly on compressed 3D human mesh tokens, enabling robust 3D-aware human motion control without relying on re…
Woojung Han, Seil Kang, Youngjun Jun, Min-Hung Chen +2 more
The paper proposes PhaseLock, a training-free framework that preserves physical consistency in image-to-video diffusion models by extracting a motion prior from few-step inference.