Emotions

#3
by Dxee - opened

Could you maybe consider adding emotions, such as angry, it'd make it better because I've tried to put things for the model to scream and sound angry, but it just sounds blank, if it isn't possible it's alright.

A screaming setting as well if you could.

Dxee changed discussion status to closed

Thank you for your suggestion! I do have a emotion controllable model but it is not ready to deploy, because the emotions need to be sampled from existing character voices, which takes some time to manually pick qualitative examples for each emotion. Before it is ready, you may use symbol input as a temporary solution.

Plachta changed discussion status to open

Alright then. Thanks for responding!

Hi Plachta, would you consider supporting MB-iSTFT-VITS? - How's the emotion segment coming?

Hi Plachta, would you consider supporting MB-iSTFT-VITS? - How's the emotion segment coming?

I kind of tested emotion control function but it seemed to be too naïve. It cannot tell different emotion types but only the general emotion intensity (talk loudly or peacefully). I'm not professional researcher in TTS so I'm sorry that I cannot work on this for further improvement.😥

Hi Plachta, would you consider supporting MB-iSTFT-VITS? - How's the emotion segment coming?

I kind of tested emotion control function but it seemed to be too naïve. It cannot tell different emotion types but only the general emotion intensity (talk loudly or peacefully). I'm not professional researcher in TTS so I'm sorry that I cannot work on this for further improvement.😥

Maybe a branch on the repo page with a disclaimer would prompt the community to help out? https://github.com/innnky/emotional-vits -Looks like a step in the right direction - I'm sure you're just missing a tiny tweak here or there 😉

Thanks for responding quickly! Great work so far

Hi Plachta, would you consider supporting MB-iSTFT-VITS? - How's the emotion segment coming?

I kind of tested emotion control function but it seemed to be too naïve. It cannot tell different emotion types but only the general emotion intensity (talk loudly or peacefully). I'm not professional researcher in TTS so I'm sorry that I cannot work on this for further improvement.😥

Maybe a branch on the repo page with a disclaimer would prompt the community to help out? https://github.com/innnky/emotional-vits -Looks like a step in the right direction - I'm sure you're just missing a tiny tweak here or there 😉

Thanks for responding quickly! Great work so far

I was using the exactly same method as the repo you mentioned. I have to say it is not as amazing as expected, but a great try.

Sign up or log in to comment