Abstract:
A user can define a gesture-based input mode with respective input value to establish an authentication protocol to unlock a computer or govern other computer behavior. As an alternative or in addition, the user can define a second input mode based on face recognition plus IR sensing satisfying a threshold to ensure a live person is being imaged for authentication, and/or face recognition plus a particular facial expression such as a smile and wink.

Description:
FIELD OF THE INVENTION 
       [0001]    The present invention relates generally to gesture- and expression-based authentication, sensed either in the visible and/or IR spectrum. 
       BACKGROUND 
       [0002]    User input sequences such as passwords are used to unlock computing device behaviors and controls. Examples include unlocking the computing device for operation. Typically, only one input mode is used, e.g., only a text entry or only a biometric input is used to unlock a computer. 
         [0003]    As understood herein, face recognition may also be used as a password-type mechanism, but as also understood herein, the use of face recognition can result in an unwanted auto-login in the presence of others among whom the authorized user may not want automatic authorization to occur. Also, a photo of the user may be used by unauthorized people to gain access in the absence of the user. 
       SUMMARY OF THE INVENTION 
       [0004]    Accordingly, a computer includes a processor and a computer readable storage medium accessible to the processor and bearing instructions embodying logic comprising permitting a user to select at least first input mode with associated first input parameter. The first input parameter is face recognition in combination with, infrared (IR) sensing, face recognition in combination with a user-defined facial, expression, image of a physical gesture established by the user, or a combination thereof. A behavior of the computer is executed only when at least one subsequent input of the first input parameter is received as authentication. 
         [0005]    In some examples, the first input parameter is face recognition in combination with infrared (IR) sensing, and the behavior of the computer is executed only responsive to receiving an image matching the face combination and sensing an IR signal at least equal in magnitude to a threshold magnitude. In other examples, the first input parameter is face recognition in combination with a user-defined facial expression, and the behavior of the computer is executed only responsive to receiving an image matching the face combination and also matching the facial expression. In still other examples, the first input parameter is image of a physical gesture established by the user, and the behavior of the computer is executed only responsive to receiving an image matching the image of a physical gesture. 
         [0006]    If desired, the instructions can further include permitting the user to select a second input mode with associated second input parameter, with the first input mode being different from the second input mode. The behavior of the computer is executed only when at least one subsequent input of the first input parameter and second input parameter are received in the first and second input modes in an order specified by the user. A user may be allowed to select the behavior. 
         [0007]    In another aspect, a method includes presenting, on a computer display, a sequence of user interfaces to permit a user to define at least a first input mode with a respective first input value to establish an authentication protocol, to enable a computer behavior. The method executes the computer behavior only when the input value is received. The first input value is face recognition, in combination with infrared (IR) sensing, face recognition in combination with a user-defined facial expression, a physical gesture established by the user, or a combination thereof. 
         [0008]    In another aspect, a competing device has a processor, a display coupled to the processor, and first and second input devices coupled to the processor that are of different genre from each other. The processor receives a first input mode value from the first input device and a second input mode value from the second input device. The processor then determines whether the first and second values match user-defined values, and only if a match is found, executes a computer behavior. At least one input mode value is established by an image of a gesture, and/or face recognition plus IR sensing satisfying a threshold to ensure a live person is being imaged for authentication, and/or face recognition plus a particular facial expression. 
         [0009]    The details of the present invention, both as to its structure and operation, can best be understood in reference to the accompanying drawings, in which like reference numerals refer to like parts, and in which: 
     
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
         [0010]      FIG. 1  is a schematic perspective view of a computing device which can employ present princples; 
           [0011]      FIG. 2  is a flow chart of example overall logic; 
           [0012]      FIG. 3  shoves a sequence of screen shots illustrating example user interfaces that may be presented on the computing device to allow a user to define a multi-modal input sequence; and 
           [0013]      FIG. 4  is an example screen shot of a user interface allowing the user to define which computer behavior is governed by the multi-modal input sequence. 
       
    
    
     DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 
       [0014]    Referring initially to  FIG. 1 , a device  10  that in the embodiment shown includes a portable lightweight housing  12  has a display  14  such as a touch screen display and a key input device  16  such as a keypad. In some embodiments an infrared (IR) sensor  18  may also be provided on the housing  12 . 
         [0015]    The device  10  may be implemented in one example embodiment by a smart phone. In other embodiments, the device  10  may be TV, tablet computer, laptop computer, or home automation computer for operating a door, sensing a person&#39;s presence to establish setting tor lighting and music, etc. Yet again, the device  10  may be an access door for medical hospital applications or for defense industry security access. Indeed, the device  10  may be established by a banking computer such as but not limited to an ATM, transaction kiosk, mobile phone refill station, etc. 
         [0016]    The key input device  16  and IR sensor  18  typically provide input signals to one or more processors  20  (only one processor shown) in the housing  12 . The processor  20  controls the display  14  to present a demanded image and, when the display  14  is a touch screen display, the processor  20  receives input from the display  14 . 
         [0017]    The processor  20  can access one or more tangible computer readable storage media  22  to read and write data thereto and to execute logic stored thereon. The medium  22  shown in  FIG. 1  may be implemented by disk storage, solid state storage, etc. 
         [0018]      FIG. 1  shows various additional sources of input signals to the processor  20  that may be supported on the housing  12 . For example, a microphone  24  may provide voice input to the processor  20 , while a camera  26  may provide still and/or moving image input to the processor  20 . 
         [0019]    When the device  10  is implemented as a smart phone a wireless telephony transceiver  28  may be supported on the housing  12  for enabling voice and/or data calls to be made using the device  10 , The telephony transceiver  28  may be, without limitation, a global, system for mobile communication (GSM) transceiver or code division, multiple access (CDMA) transceiver or orthogonal frequency division multiplexing (OFDM) transceiver or satellite phone transceiver or variants thereof. 
         [0020]    if desired, a wireless network transceiver  30  may also be provided on the housing  12  to permit network communication using the device  10 . The transceiver  30  may be, without limitation, a Bluetooth transceiver, Wi-Fi transceiver, or other appropriate transceiver. 
         [0021]      FIG. 2  shows example logic that may be implemented by the processor  20 . A set-up screen may be presented on the display  14  at block  36  to enable a user to select to define what specific input modes and values associated therewith are to be used for purposes discussed below. The user&#39;s selection to define the modes and values are received at block  38 . At block  40 , the processor  20  causes the display  14  to present a user interface, an example of which is discussed below, on the display  14  to allow the user to define a multi-mode with corresponding multi-value protocol for enabling a user-selected computer behavior. This behavior is unlocked at block  42  subsequently, and only when the user-defined protocol is input as specified by the user, i.e., only when input modal values match the user-defined values, such that only if a match is found, the computer behavior is unlocked. 
         [0022]      FIG. 3  gives an example set of user interface screens that may be presented on the display  14  in the logic of block  40  of  FIG. 2 . The screen  44  instructs the user to select a first mode. In the example shown, the first mode may be selected from a list that includes voice recognition, potentially with a corresponding cadence, keypad entry, gesture entry, and image entry, potentially with IR and/or expression augmentation discussed further below. 
         [0023]    Assuming the user selects voice recognition, the screen  46  may be presented, in which the user is instructed to speak into the microphone  24  the desired value or parameter of the voice mode component, e.g., a word or word string. The parameters may include specific words and/or cadence, timing, and/or more advanced voice recognition parameters such as voice prints, voice-to-text recognition, etc.) 
         [0024]    The processor  20  can execute voice recognition software to convert the signal from the microphone to data values that are stored on the medium  22 . The values are associated with “voice mode”, i.e., with a requirement that the values be received subsequently from the microphone  24 . 
         [0025]    Because multiple modes may be defined a screen  48  may next be presented on the display  14 , instructing the user io select a second mode. Note that the mode selected as the first mode (in this example, voice input) need not appear on the screen  48 , but only the remaining available modes. Assuming the user selects “keypad” the screen  50  may appear, instructing the user to input the desired key sequence as corresponding values for the keypad mode. The values are stored on the medium  22  and correlated to the keypad  16 . 
         [0026]    If desired, the user may be given the opportunity to select more than two modes. Or, the user may have selected “gesture” or “face” initially. In any case, a further screen  52  is presented for selection of a third mode. If the user selects “gesture” at  44 ,  48 , or  52 , the UI  54  is presented to instruct the user to make a gesture, for example, a hand wave, hand signal, or other gesture/motion. The image of the gesture is captured by the camera  26  and sent to the processor  20 , which stores it on the medium  22 . 
         [0027]    A screen  56  can be presented responsive to a user selecting: face recognition” from  44 ,  48 , or  52 , instructing the user to take a picture of the desired image, e.g., the user&#39;s face, which is stored in memory and associated with the camera  26 . The image can include still images (pattern, optical character recognition, etc.), video image recognition (which may include movement detection, color pattern analysis, etc.) The user is also given the option of turning IR detection on or off using a toggle selection in the embodiment shown. Moreover, the user may be given the option of electing to have not just recognition of the user&#39;s face as an authentication mode, but also recognition of a particular expression on the user&#39;s face. 
         [0028]    If IR detection is turned on, this means that subsequent authentication is indicated only by both a face recognition match and a sensed IR level by the IR sensor  18  that meets a threshold which is empirically established to indicate the presence of a live human within a few feet of the camera. This is to avoid the above-noted problem with holding a photograph of the user in front, of the camera when the user is otherwise absent. 
         [0029]    Additionally, when “expression” is selected, the expression on the user&#39;s face within, e.g., the next few seconds as imaged by the camera must match the expression in a subsequent image of the user intended to be used for authentication. For example, the user can smile and close one eye as an expression-based face recognition password, and subsequent images of the user&#39;s face that are intended for authentication will cause successful authentication only if the subsequent images show the user smiling and closing one eye (or repeating whatever expression was originally established). Other examples of expressions include eyes looking left or right or up or down, a frown, closed eyes, a grimace, a tongue sticking out, etc. 
         [0030]    Once the mode sequence and values have been defined by the user,  FIG. 4  shows that a screen  58  may be presented to enable the user to define the purpose for which subsequent input of the defined mode sequence and values is to be used. For example, the user may elect to require input of the defined protocol to logon to the computer, or to connect to a network. Other computer behaviors that can be invoked only upon input of the user-defined multi-modal protocol include a transition from a device state with the low power consumption, hibernation mode with security device lock engaged to another state with active use of the application software or the network service access functions. 
         [0031]    As an example of Input sequences that can be used to unlock user-defined computer behaviors, a simple voice (audio) signal from the microphone  24  may first be required and if the input signal matches the user-defined, value from block  40  in  FIG. 2 , the second mode is triggered. If the second mode is image detection, the camera  26  is then activated and input from the camera is tested against the user-defined image value stored at block  40  in  FIG. 2 . This may be done by activating an embedded camera. The user-defined behavior that is associated with the muki-modal protocol is enabled only when the input mode values match the user-defined values that were established at block  40 . 
         [0032]    While the particular GESTURE- AND EXPRESSION-BASED AUTHENTICATION is herein shown and described in detail, it is to be understood tha the subject matter which is encompassed by the present invention is limited only by the claims.