Patent ID: 11734889

Abstract:
The present invention proposes method of gaze estimation with 3D face reconstructing, which precisely reconstructs a 3D face to accurately calculate the gaze direction of the face. The present invention decomposes the gaze direction calculation task into two sub-tasks of gaze-aligned 3D face reconstruction, and gaze contact realized by rotation. First, a 3D morphable model is used to reconstruct a basic 3D face with a 2D reference face image as input. Then, shape adjustment is performed on the basic 3D face to obtain a shape-aligned 3D reconstructed face. Finally, a gaze-aligned 3D face is obtained by replacing the textures of the shape-aligned 3D face eye area. For the subtask of gaze contact, the present invention proposes a novel method for realizing gaze contact by rotating a 3D face, which does not depend on too many assumptions and can be widely used in the field of virtual reality.