This new technique is designed to work in a group setting, where there are many candidate faces. The algorithm locates candidate faces, localizes the lips within the faces, and determines if the lips are moving. Face determination compares the colors in the images to a standard training set of skin tones. Any color that is within a set distance from the training set is considered a skin tone. The face is then determined using region growing.
Lip localization is based on invariants of the face.
Motion Analysis techniques are applied to the lip region to determine if the lips are moving from frame to frame independent of any head motion. A comparison is then done to determine if this speaker has been seen previously, allowing for searching for a unique face.