Papers
arxiv:2406.18009

E2 TTS: Embarrassingly Easy Fully Non-Autoregressive Zero-Shot TTS

Published on Jun 26
ยท Submitted by naoyuki82 on Jul 2
Authors:
,
,
,
,
,
,
,
Xu Tan ,
,
,

Abstract

This paper introduces Embarrassingly Easy Text-to-Speech (E2 TTS), a fully non-autoregressive zero-shot text-to-speech system that offers human-level naturalness and state-of-the-art speaker similarity and intelligibility. In the E2 TTS framework, the text input is converted into a character sequence with filler tokens. The flow-matching-based mel spectrogram generator is then trained based on the audio infilling task. Unlike many previous works, it does not require additional components (e.g., duration model, grapheme-to-phoneme) or complex techniques (e.g., monotonic alignment search). Despite its simplicity, E2 TTS achieves state-of-the-art zero-shot TTS capabilities that are comparable to or surpass previous works, including Voicebox and NaturalSpeech 3. The simplicity of E2 TTS also allows for flexibility in the input representation. We propose several variants of E2 TTS to improve usability during inference. See https://aka.ms/e2tts/ for demo samples.

Community

Paper author Paper submitter

See https://aka.ms/e2tts for demo samples.

awesome!

Are there any plans to release this for open research?

Sign up or log in to comment

Models citing this paper 2

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2406.18009 in a dataset README.md to link it from this page.

Spaces citing this paper 52

Collections including this paper 8