Patent ID: 11922723
Assignee: LIONROCKET INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 5:
6. A mouth shape synthesis method using the mouth shape synthesis device using an artificial neural network according to claim 1, the method comprising:
an original video encoding step in which an original video encoder encodes original video data, which is a target of mouth shape synthesis, as a video including a synthesis target face, and outputs an original video embedding vector;
an audio encoding step in which an audio encoder encodes audio data that is a basis for the mouth shape synthesis and outputs an audio embedding vector; and
a synthesized video decoding step in which a synthesized video decoder uses the original video embedding vector and the audio embedding vector as input data, and outputs synthesized video data in which a mouth shape corresponding to the audio data is synthesized on the synthesized target face.