Patent ID: 11875809
Assignee: BAIDU USA LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 13:
14. The system of claim 9 wherein the non-transitory computer-readable medium or media further comprises one or more sets of instructions which, when executed by at least one of the one or more processors causes steps to be performed comprising:
given one or more additional sets of one or more clean-noisy audio pairs:
for each clean audio from the one or more additional sets of one or more clean-noisy audio pairs:
generating one or more continuous latent representations for the clean audio using the first encoder; and
for each continuous latent representation of the one or more continuous latent representations for the clean audio, generating a corresponding discrete clean audio representation using the quantizer;

for each noisy audio from the one or more additional sets of one or more clean-noisy audio pairs:
generating one or more continuous latent representations for the noisy audio using the second encoder; and
for each continuous latent representation of the one or more continuous latent representations for the noisy audio, generating a corresponding discrete noisy audio representation using the quantizer;

for each clean-noisy audio pair from the one or more additional sets of one or more clean-noisy audio pairs, inputting the discrete clean audio representation or representations, the clean audio, and a speaker embedding that represents the speaker of the clean-noisy audio pair into the decoder to generate an audio sequence prediction;
computing a loss for the denoising system, in which the loss comprises a latent representation matching loss term that, for a time step in which the discrete clean audio representation and the discrete noisy audio representation for a clean-noisy audio pair have different values, is determined using a distance measure between the continuous latent representation of the clean audio and the continuous latent representation of the noisy audio for that time step; and
updating the denoising system using the loss; and

responsive to a stop condition being reached, outputting a trained denoising system comprising a trained second encoder, a trained quantizer, and a trained decoder.