Patent ID: 6345111
Filing Date: 2002-02-05
Classification: G06F,G06K,H04N

Abstract:
Multi-modal interface apparatus, comprising:an image input unit configured to continually input an image of a user's entire face during the user's operation on a display; a face image processing unit configured to extract a feature from the user's face image, the first time that the user's operation of predetermined object on the display is detected a recognition decision unit configured to store the feature of the user's face image as a dictionary pattern and the user's operation selecting the predetermined object as an event, the dictionary pattern representing the user's gaze for the predetermined object, and to recognize the user's face image newly inputted through said image input unit by referring to the dictionary pattern; and an object control unit configured to execute the event for the predetermined object on the display, when the user's face image newly inputted is recognized as the dictionary pattern, wherein said recognition decision unit deletes the dictionary pattern corresponding to the predetermined object, when said object control unit detects movement or deletion of the predetermined object on the display.