Before revision: We present a novel system for singing synthesis , based on attention. Starting from a musical score with notes and lyrics, we build a phoneme-level multi stream note embedding. The embedding contains the information encoded in the score regarding pitch, duration and the phonemes to be pronounced on each note. This note representation is used to condition an attention-based sequence-to-sequence architecture, in order to generate mel-spectrograms.
After revision: We present UTACO, a singing synthesis model based on an attention-based sequence-to-sequence architecture, in order to generate mel-spectrograms.