Patent ID: 11922924
Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A method for generating speech through multilingual neural text-to-speech (TTS) synthesis, comprising:
receiving a text input in at least a first language and a target speaker ID;
providing, through a speaker encoder, speaker latent space information of a target speaker in the form of a speaker embedding vector associated with the target speaker ID;
providing, through a language encoder, language latent space information of a second language in the form of a language embedding vector associated with a target language ID;
generating, through an acoustic feature predictor, at least one acoustic feature based on the text input, the speaker latent space information and the language latent space information of the second language; and
generating, through a neural vocoder, a speech waveform corresponding to the text input based on the at least one acoustic feature and the speaker latent space information.