ZONOS2 Technical Report
The authors present ZONOS2 8B, a TTS model with improved naturalness, prosody, and voice cloning fidelity, achieved through scaling, data expansion, and simplification.
The authors achieved state-of-the-art naturalness, prosody, and voice cloning fidelity through a combination of scaling, data expansion, and simplification.
Before reading this…
Applications
- →Speech synthesis
- →Accessibility
- →Multimedia
To understand this paper, make sure you know these concepts first:
- Understanding of text-to-speech systemsfind papers →
- Familiarity with deep learning conceptsfind papers →
Abstract
More Like ThisWe present ZONOS2 8B, our latest TTS model, which achieves state-of-the-art naturalness, prosody, and voice cloning fidelity. We improve upon Zonos-v0.1 across scale, data, and training recipe. We scale the model from 1.6B to 8B total parameters (900M active) with a novel mixture-of-experts (MoE) backbone, improving inference latency and throughput. We expand our training corpus from 200K to over 6M hours using a new data processing pipeline, and we simplify our post-training and conditioning recipes to improve naturalness and voice cloning fidelity. We evaluate ZONOS2 8B on quality, speaker similarity, WER, and ZTTS1-Eval, our novel TTS benchmark, where it performs competitively with state-of-the-art systems while maintaining good streaming latency. We release our model weights and example inference code under an Apache 2.0 license on GitHub and Hugging Face.