Previous works on neural text-to-speech (TTS) have been tackled on limited speed in training and inference time, robustness for difficult synthesis conditions, expressiveness, and controllability. Although several approaches resolve some limitations, none of them has resolved all weaknesses at once. In this paper, we propose STYLER, an expressive and controllable text-to-speech model with robust speech synthesisand high speed. Excluding autoregressive decoding and introducing a novel audio-text aligning method called Mel Calibrator leads speech synthesis more robust on long, unseen data. Disentangled style factor modeling under supervision enlarges the controllability of synthesizing speech with fruitful expressivity. Moreover, our novel noise modeling pipeline using domain adversarial training and Residual Decoding enables noise-robust style transfer, decomposing the noise without any additional label. Our extensive and various experiments demonstrate STYLER's effectiveness in the aspects of speed , robustness, expressiveness, and controllability by comparison with existing neural TTS models and ablation studies . Synthesis samples of our model and experiment results are provided via our demo page  .
Previous works on neural text-to-speech (TTS) have been addressed on limited speed in training and inference time, robustness for difficult synthesis conditions, expressiveness, and controllability. Although several approaches resolve some limitations, there has been no attempt to solve all weaknesses at once. In this paper, we propose STYLER, an expressive and controllable TTS framework with high-speed and robust synthesis. Our novel audio-text aligning method called Mel Calibrator and excluding autoregressive decoding enable rapid training and inference and robust synthesis on unseen data. Also, disentangled style factor modeling under supervision enlarges the controllability in synthesizing process leading to expressive TTS. On top of it, a novel noise modeling pipeline using domain adversarial training and Residual Decoding empowers noise-robust style transfer, decomposing the noise without any additional label. Various experiments demonstrate that STYLER is more effective in speed and robustness than expressive TTS with autoregressive decoding and more expressive and controllable than reading style non-autoregressive TTS . Synthesis samples and experiment results are provided via our demo page , and code is available publicly .
R
tackled
addressed
R
none of them has resolved
there has been no attempt to solve
R
text-to-speech model with robust speech synthesisand high speed. Excluding autoregressive decoding and introducing a
TTS framework with high-speed and robust synthesis. Our
R
leads speech synthesis more robust on long,
and excluding autoregressive decoding enable rapid training and inference and robust synthesis on
R
Disentangled
Also, disentangled
R
of synthesizing speech with fruitful expressivity. Moreover, our
in synthesizing process leading to expressive TTS. On top of it, a
R
enables
empowers
R
Our extensive and various experiments demonstrate STYLER's effectiveness in the aspects of speed , robustness, expressiveness, and controllability by comparison with existing neural TTS models and ablation studies
Various experiments demonstrate that STYLER is more effective in speed and robustness than expressive TTS with autoregressive decoding and more expressive and controllable than reading style non-autoregressive TTS
D
of our model
A
, and code is available publicly