metadata
language:
- en
tags:
- music
- t5
- byt5
license: isc
metrics:
- accuracy
ByT5 Song Lyrics
This is a Seq2Seq model trained on a karaoke dataset to predict syllables with pitch and timing from song lyrics.
As of writing, the model has only been trained on 1/2 of the full dataset. Expect the quality to improve later.
The Huggingface demo seems to produce outputs with a small sequence length. So what you see on the right will only make a prediction for the first two syllables.