Patent ID: 11915683
Assignee: AMAZON TECHNOLOGIES, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A method comprising:
processing first recorded speech representing at least a first utterance of a first speaker to determine first target spectrogram data representing at least the first utterance;
determining first voice characteristic data of the first recorded speech, the first voice characteristic data including first fundamental frequency data and first speaker embedding data corresponding to the first speaker;
generating, using a text-to-speech (TTS) component and first data representing a first transcript of the first recorded speech, first predicted spectrogram data of first synthesized speech representing the at least first utterance, the first predicted spectrogram data having voice characteristics different from the first recorded speech;
processing the first predicted spectrogram data and the first voice characteristic data using a first neural network to generate first voice-modified spectrogram data, the first voice-modified spectrogram data having modified voice characteristics relative to the first predicted spectrogram data;
calculating first loss data based at least in part on a difference between the first target spectrogram data and the first voice-modified spectrogram data; and
performing first training using the first neural network and the first loss data to determine a second neural network configured to process second predicted spectrogram data to generate second voice-modified spectrogram data having voice characteristics similar to the first voice characteristic data.