Patent ID: 11961515
Assignee: GOOGLE LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 11:
12. The contrastive Siamese network of claim 1, wherein the trained speech recognition model comprises a Transformer-Transducer (T-T) model, the T-T model comprising:
the audio encoder configured to:
receive, as input, a sequence of acoustic frames extracted from audio data characterizing a spoken utterance; and
generate, at each of a plurality of time steps, a higher order feature representation for a corresponding acoustic frame in the sequence of acoustic frames;

a label encoder configured to:
receive, as input, a sequence of non-blank symbols output by a final softmax layer; and
generate, at each of the plurality of time steps, a dense representation; and

a joint network configured to:
receive, as input, the higher order feature representation generated by the audio encoder at each of the plurality of time steps and the dense representation generated by the label encoder at each of the plurality of time steps; and
generate, at each of the plurality of time steps, a probability distribution over possible speech recognition hypothesis at the corresponding time step,

wherein the audio encoder comprises a neural network having a stack of strided convolutional layers and transformer layers.