Patent ID: 6014625
Filing Date: 2000-01-11
Classification: G06T

Abstract:
A method for producing a lip movement parameter by using voice signals and image signals in a 3 dimension model-based coding system, wherein the lip movement parameter is a distance between a actual lip image and a transformed 2 dimension lip model, the actual lip image being an image of a lip of a person displayed which varies continuously, the method comprising the steps of:(a) providing a characteristic 3 dimension lip model for the person by using a basic facial image of the person and a location of the basic lip of the person and a general 3 dimension lip model, wherein the basic facial image is an expressionless and mute front facial image of the person;(b) recognizing syllables from the voice signals of the person, and providing a first selection signal at a moment when an amount of an energy of the syllable along a time axis and a frequency axis becomes greater than a predetermined threshold, and providing a second selection signal at a moment when the amount of the energy of the syllable begins to fall below the predetermined threshold;(c) extracting the actual lip image of the person from the image signals;(d) presenting a 2 dimension lip model transformed based on a rotation angle and the syllable; and(e) transmitting lip movement parameters, the voice signals and the rotation angle to a decoder.