Patent ID: 11935556
Assignee: SNAP INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 16:
17. A non-transitory computer-readable storage medium including instructions that, when processed by a computer, configure the computer to perform operations comprising:
transforming the input vocal data to an input image, the input image representing frequencies and intensities of the input vocals, wherein the input image has plurality of pixels with a pixel height and a pixel width, and wherein a horizontal axis is a time, a vertical axis is a frequency, and an amplitude is represented by an intensity of a pixel of the plurality of pixels;
processing the input image using a first convolutional neural network (CNN) to generate a first output image;
processing the first output image, using a second CNN, to generate a second output image;
determining a loss between the input image and the second output image;
training the first CNN based on the determined loss;
processing, using a third CNN, the second output image to generate a first logistical output storing first feature values determined in processing the second output image by the third CNN;
processing, using the third CNN, the input image to generate a second logistical output;
storing second feature values determined in processing the input image by the third CNN;
determining a feature loss based on differences between the second feature values and the first feature values;
training the first CNN further based on the feature loss; and
transforming the output image to output vocal data representing output vocals, the output vocals having a second characteristic.