Patent ID: 11875809
Assignee: BAIDU USA LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 15:
16. A computer-implemented method comprising:
generating one or more continuous latent representations for a clean audio using a first encoder;
for each continuous latent representation of the one or more continuous latent representations for the clean audio, generating a corresponding discrete clean audio representation using a quantizer;
generating one or more continuous latent representations for a noisy audio, which is a noisy version of the clean audio, using a second encoder;
for each continuous latent representation of the one or more continuous latent representations for the noisy audio, generating a corresponding discrete noisy audio representation using the quantizer;
generating an audio sequence prediction by inputting the discrete clean audio representation or representations, the clean audio, and a speaker embedding that represents the speaker of the clean audio into a decoder;
computing a loss for a denoising system, in which the loss comprises a latent representation matching loss term that, for a time step in which the discrete clean audio representation and the discrete noisy audio representation of a clean-noisy audio pair differ, is determined using a distance measure between the continuous latent representation of the clean audio and the continuous latent representation of the noisy audio for that time step; and
updating the denoising system using the loss.