Patent ID: 11887403
Assignee: NANJING SILICON INTELLIGENCE TECHNOLOGY CO., LTD.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 2:
3. The method according to claim 2, wherein before training a preset mouth shape correction model, the method further comprises:
selecting two sets of mouth shape videos recorded by a real actor, which are respectively the first original video and the second original video;
inputting the first original video and preset audio to a preset model for driving a mouth shape by audio, to generate a first video;
inputting the second original video and the preset audio to the preset model for driving a mouth shape by audio, to generate a second video, the first video and the second video being videos when a digital human performs corresponding actions based on the preset audio;
deleting video segments with incorrect pronunciation of the digital human in the first video and the second video, to obtain a first filtered video and a second filtered video; and
obtaining the first face image and the second face image by using the first filtered video and the second filtered video.