Patent ID: 11922923
Assignee: VONAGE BUSINESS INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 1:
2. A method for emotion-enhanced natural speech audio generation using dilated convolutional neural networks, comprising:
training a first dilated convolutional artificial neural network to recognize emotion in text-based content by processing a plurality of text-based training data through the first dilated convolutional artificial neural network;
receiving a first set of output data from the first dilated convolutional artificial network, the first set of output data comprising probability-based associations of text with emotions;
training a second dilated convolutional artificial neural network to recognize emotion in audio-based content by providing a plurality of audio-based training-data through the second dilated convolutional artificial neural network, the audio-based training data corresponding to the text-based training data;
receiving a second set of output data from the second dilated convolutional artificial network, the second set of output data comprising probability-based associations of modulations of sounds with emotions;
constructing an emotion injection model by associating text from the first set of output data with sounds from the second set of output data based on the emotions associated with each;
receiving text content;
processing the text content through the first dilated convolutional artificial neural network to recognize emotional states in the text content; and
converting the text content to audio content using a text-to-speech engine, and modulating the audio content with the modulations of sounds associated with the text from the emotion injection model.