Patent ID: 11922963
Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 17:
18. A computing system comprising:
one or more processors; and
one or more storage devices storing computer-readable instructions that are executable by the one or more processors to configure the computing system to at least:
obtain a speech enhancement model trained on a first training dataset to generate noise-suppressed speech outputs;
obtain an automatic speech recognition model trained on a second training dataset to generate transcription labels for spoken language utterances;
obtain a third training dataset comprising (i) a first data subset comprising a set of spoken language utterances and ground truth transcription labels corresponding to the set of spoken language utterances and (ii) a second data subset comprising noisy audio data and clean reference audio data corresponding to the noisy audio data;
apply the set of spoken language utterances included in the third training dataset to the speech enhancement model to obtain a first noise-suppressed speech output;
apply the first noise-suppressed speech output from the speech enhancement model to the automatic speech recognition model to generate a noise-suppressed transcription output for the set of spoken language utterances;
apply the noisy audio data included in the third training dataset to the speech enhancement model to obtain a second noise-suppressed speech output; and
update one or more speech enhancement model parameters to optimize the speech enhancement model to generate optimized noise-suppressed speech outputs based on alternating between (i) a first comparison of the noise-suppressed transcription output and the ground truth transcription labels to facilitate a first improvement in generating noise-suppressed transcription outputs and (ii) a second comparison of the second noise-suppressed speech output and the clean reference audio data to facilitate a second improvement in generating noise-suppressed speech outputs.