Patent ID: 11929060
Assignee: GOOGLE LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A computer-implemented method when executed by data processing hardware causes the data processing hardware to perform operations comprising:
receiving a set of training utterance pairs, each training utterance pair comprising:
a respective non-synthetic speech representation of a corresponding utterance; and
a respective synthetic speech representation of the same corresponding utterance as the respective non-synthetic speech representation, the synthetic speech representation generated from a respective ground-truth transcription of the corresponding utterance;

at each of a plurality of output steps for each training utterance pair in the set of training utterance pairs:
generating, for output by a speech recognition model, a first probability distribution over possible non-synthetic speech recognition hypotheses for the corresponding non-synthetic speech representation of the corresponding utterance;
generating, for output by the speech recognition model, a second probability distribution over possible synthetic speech recognition hypotheses for the corresponding synthetic speech representation generated from the respective ground-truth transcription of the corresponding utterance; and
determining a consistent loss term for the corresponding training utterance pair based on the first probability distribution over possible non-synthetic speech recognition hypotheses and the second probability distribution over possible synthetic speech recognition hypotheses; and

updating parameters of the speech recognition model based on the consistent loss term determined at each of the plurality of output steps for each training utterance pair in the set of training utterance pairs.