Patent ID: 11869482
Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 17:
18. An apparatus for a neural vocoder, the apparatus comprising:
one or more processors; and
a memory storing computer-executable instructions that, when executed, cause the one or more processors to:
receive fundamental frequency information, glottal features and vocal tract features associated with an input, wherein the glottal features include a phase feature, a shape feature, and an energy feature, the phase feature being represented by phase vectors, the shape feature being represented by shape vectors, and the energy feature being represented by energy vectors;
generate a glottal waveform based on the fundamental frequency information and the glottal features through a first neural network model, wherein when generating the glottal waveform, the computer-executable instructions further cause the one or more processor to:
form a phase matrix from the phase vectors;
construct a phase-based weighting matrix by converting the phase matrix nonlinearly through a first part of the first neural network model;
generate a characteristic waveform feature based on the fundamental frequency information, the shape vectors and the energy vectors through a second part of the first neural network model; and
obtain the glottal waveform based on the phase-based weighting matrix and the characteristic waveform feature; and

generate a speech waveform based on the glottal waveform and the vocal tract features through a second neural network model.