Abstract:
The present invention provides systems and methods of an apparatus that comprises a layer of fingerprint imagers, an addressing circuit, a fingerprint controller, an electronic storage devices, a layer of touch panel and a display panel. The touch panel behind the layer of fingerprint imagers can sense touch position when touched. The specific fingerprint imagers can be activated according to the touch panel coordinates when touched by a user. After fingerprint is captured, the system evaluates quality of the captured fingerprint and admits fingerprint for recognition when its quality is above a threshold value. User of a computing system can be accepted or rejected based on the comparison between the captured fingerprint and an authorized fingerprint list.

Description:
BACKGROUND OF THE INVENTION 
     Field of the Invention 
       [0001]    This invention relates to integrating fingerprint imagers with touch panels for supporting both access control and human computer interactions. 
     
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
         [0002]    The invention may be better understood, and further advantages and uses thereof more readily apparent, when considered in view of the following detailed description of exemplary embodiments and examples, taken with the accompanying diagrams, in which: 
           [0003]      FIG. 1  is a block diagram showing, in one exemplary embodiment of the present invention, the components involved for implementing a touch-fingerprint apparatus; 
           [0004]      FIG. 2  is a flowchart showing, in one exemplary embodiment of the present invention, the process involved for user verification with the touch-fingerprint apparatus; 
           [0005]      FIG. 3  is a flowchart showing, in one exemplary embodiment of the present invention, the process involved for continued user verification with the touch-fingerprint apparatus after a computing system is in accessible state; 
           [0006]      FIG. 4  is a block diagram showing, in one exemplary embodiment of the present invention, placement of fingerprint imager and dynamic human interaction artifact; and 
           [0007]      FIG. 5  is a block diagram showing, in one exemplary embodiment of the present invention, placement of fingerprint imager and static human interaction artifact. 
       
    
    
       [0008]    While the patent invention shall now be described with reference to the embodiments shown in the drawings, it should be understood that the intention is not to limit the invention only to the particular embodiments shown but rather to cover alterations, modifications and equivalent arrangements possible within the scope of appended claims. Throughout this discussion that follows, it should be understood that the terms are used in the functional sense and not exclusively with reference to specific embodiment, implementation, programming interface. 
       DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
       [0009]    Discussion in this section is intended to provide a brief description of some exemplary embodiments of the present invention. 
         [0010]      FIG. 1  is a block diagram showing, in one exemplary embodiment of the present invention, the components involved for implementing a touch-fingerprint apparatus. 
         [0011]    A touch-fingerprint apparatus can comprise multiple fingerprint imagers ( 110 ) that are overlayed on top of a touch panel ( 100 ). A fingerprint imager is an electronic device used to capture a digital image of the fingerprint pattern. The captured image can be digitally processed to create a biometric template (a collection of extracted features) which is stored and used for matching. Fingerprint imagers include but not limited to optical fingerprint imagers, ultrasonic fingerprint imagers, thermal fingerprint imagers, capacitance fingerprint imagers, passive capacitance fingerprint imagers, and active capacitance fingerprint imagers. An touch panel can detect the presence and location of a touch (e.g., capacitive touch panel, resistive touch panel, acoustic wave touch panel, infrared touch panel, projective capacitive touch panel). A computing system (e.g., laptop, desktop, tablet, notebook, PDA, mobile phone, game console, Kiosk) can comprise at least one such touch-fingerprint apparatus and use the touch-fingerprint apparatus for access control and/or user authentication. Furthermore, in additional embodiment, a computing system can comprise one or multiple transceivers (e.g. wired transceivers, wireless transceivers). 
         [0012]    Furthermore, in an embodiment, a fingerprint imager can be TFT (thin-film transistors) based fingerprint imager. Each TFT fingerprint imager contains a matrix of fingerprint sensing cells, basic sensing unit of a fingerprint imager. A sensing cell can comprises a upper electrode of the capacitor, a metal plate as lower electrode. The TFT fingerprint imagers ( 110 ) can be transparent by using transparent materials and transparent TFT fabrication process. 
         [0013]    In an additional embodiment, the touch panel can be integrated with an electronic display panel (e.g., OLED displays, liquid crystal display devices such as TFT-LCD, electronic paper display). Or in alternative embodiment, an electronic display panel can be placed beneath the touch panel. 
         [0014]    The TFT fingerprint imagers ( 110 ) are controlled by a controller ( 120 ). The controller ( 120 ) can select and activate a fingerprint imager according to pre-determined conditions. In one embodiment, when finger tip is inside the region covered by a fingerprint imager, its location can be recorded. Then the controller can select and activate one or multiple fingerprint imagers to capture one or multiple fingerprints according to their locations. 
         [0015]    The fingerprint imagers and fingerprint sensing cells can have their unique column addresses and line addresses. The controller ( 120 ) can translate a touch panel location (position in touch panel X-axis and Y-axis) into a pair of fingerprint imager line address and column address. The line address decoder( 140 ) can decode a line address and send the decoding output to a shift register (e.g., parallel-in parallel-out shift register). The shift register ( 160 ) can enable one row of fingerprint sensing cells at a time. In one embodiment, the fingerprint sensing cells in the enabled row can be addressed during a clock cycle and disabled after results of the sensing cells are converted into digital values and fed into the storage devices (physical storage used to temporarily hold data such as latches, flip-flops, or buffers) that are situated at the end of each column ( 130 ). Sensed results stored in the storage devices are selected and transmitted to the controller ( 120 ). In one embodiment, the controller can compute a pair of column addresses( 180 ) as beginning and end column addresses. Results stored in the storage devices ( 130 ) within the selected columns via selector ( 170 ) are transferred to the controller. 
         [0016]      FIG. 2  is a flowchart showing, in one exemplary embodiment of the present invention, the process involved for user verification with the described touch-fingerprint apparatus in  FIG. 1 . 
         [0017]    In accordance with the present invention, in one embodiment, a computing system can use a sequence of steps to authenticate a user with the touch-fingerprint apparatus. Furthermore, in additional embodiment, a computing system (e.g., laptop, desktop, tablet, notebook, PDA, mobile phone, game console, Kiosk) can be locked. The computing system can be unlocked using the steps in  FIG. 2 . 
         [0018]    In an embodiment, when a computing system is locked, an unlock button (e.g., dynamic or static button) can be shown over one or multiple fingerprint imagers ( 300 ). A user can touch the unlock button to unlock the computing system. When the unlock button is touched ( 310 ), the controller can activate one or multiple fingerprint imagers and capture one or multiple fingerprint images ( 320 ). The captured fingerprint can be matched against fingerprints of a list of authorized users ( 330 ). If the fingerprint is accepted as one of the authorized users&#39;, the computing system is unlocked and it is in accessible state ( 350 ). When the computing system is in accessible state, a state that the system is unlocked, permissions granted to the user are to access certain part, or all functions of the system, including login to user accounts, using Internet, modifying settings, file access. Or when a computer system is in accessible state, it can be controlled or respond to interactive user inputs. 
         [0019]      FIG. 3  is a flowchart showing, in one exemplary embodiment of the present invention, the process involved for continued user verification with the described touch-fingerprint apparatus in  FIG. 1  after a computing system is in accessible state. 
         [0020]    In accordance with the present invention, in one embodiment, after a computer system is unlocked or is in accessible state, the computing system that comprises the touch-fingerprint apparatus can keep verifying the user using fingerprint when the user interacts with the computing system. In one embodiment, user verification can be performed when the user touches the touch-fingerprint apparatus and fingerprint can be captured. 
         [0021]    An embodiment can choose when and how often fingerprint based user verification is performed. For example, in one embodiment, user verification can be tried for every touch when fingerprint can be captured. In another embodiment, user verification is performed periodically or randomly in time. In additional embodiment, one or multiple conditions can be defined as triggers for fingerprint based user verification. When the conditions are met, user verification can be performed. For instance, in one embodiment, a condition can be defined as, when certain region of the touch panel is touched by the user, user verification will be started. The computing system may use the region for displaying one or multiple human interaction artifacts (e.g., icon, button, menu). When the region is touched, fingerprint can be captured by the touch-fingerprint apparatus and be verified using fingerprint recognition. 
         [0022]    In an embodiment, when a user touches the touch panel ( 200 ), a touch event can be generated and touch location (e.g., touch panel coordinate) is recorded. When the controller ( 120 ) gets the touch event and its touch panel coordinate, it can calculate the corresponding fingerprint imager coordinate according to each fingerprint imager&#39;s location mapped to the touch panel space ( 210 ). If the calculated fingerprint imager coordinate is within the data capture range of one or multiple fingerprint imagers, the controller can enable these specific fingerprint imagers and capture the fingerprint by selecting the rows and columns surrounding the touch point ( 230 ). 
         [0023]    In an embodiment, for captured fingerprint, before it is admitted for fingerprint recognition, its quality can be evaluated ( 240 ). Variety of reasons may lead to poor fingerprint quality (e.g. move too fast, press too soft, incomplete data). Low quality fingerprint data can be discarded before admitted. Fingerprint recognition can be applied to the admitted fingerprint ( 260 ). If the admitted fingerprint does not match, the computing system can take pre-determined actions as response ( 280 ). These comprise putting the system in in-accessible state (e.g., A state that the system is locked). In an embodiment, when the system is in in-accessible state, permission to access certain, part, or all functions of the system is denied. Those functions include but not limited to, access to user account, Internet browsing, modifying setting, file access, launching software. Furthermore, when in in-accessible state, the response includes but not limited to, halting interactions with the user, refusing user&#39;s input, freeze the computing system, and/or logging out the user automatically. 
         [0024]      FIG. 4  is a block diagram showing, in one exemplary embodiment of the present invention, placement of dynamic user interaction artifact over fingerprint imager for user authentication. 
         [0025]    In accordance with the present invention, in one embodiment, the electronic display ( 410 ) is behind a layer of fingerprint imagers ( 110 ). The display includes but not limited LCD display, OLED display, electronic paper display, etc. Furthermore, in additional embodiment, the display can be integrated with touch panel using add-on touch panel, in-screen touch panel, or in-cell touch enabled display. 
         [0026]    In one embodiment, one or multiple human interaction artifacts ( 410 ) can be shown on the display ( 410 ) and overlap with the area covered by one or multiple fingerprint imagers ( 110 ). A dynamic human interaction artifact shown on a display is a graphical human interaction component that can respond to user actions, including button, icon, menu or similar human interaction component. 
         [0027]    In an embodiment, a human interaction artifact can be commonly used GUI (Graphic User Interface) component (e.g., button, icon, menu). A human interaction artifact can be a static or dynamic component. In an embodiment, when a human interaction artifact is pressed or selected, certain functional response can be triggered. For example, in an embodiment, a human interaction artifact can include, home button, return button, cancel button, phone calling button, confirm button, menu button, search button, launch button, fire button, browser or any Internet related button. 
         [0028]    Moreover, a human interaction artifact can be an icon used by a user to access any functional part of a computing system, including but not limited to software, configuration, setting, or files. 
         [0029]    For example, in an embodiment shown, in  FIG. 4 , when a user presses the button trying to pickup a phone call, the user can be authenticated by using the touch-fingerprint apparatus. 
         [0030]      FIG. 5  is a block diagram showing, in one exemplary embodiment of the present invention, placement of static human interaction artifact over fingerprint imager for user authentication. 
         [0031]    In accordance with the present invention, in one embodiment, a layer of static human interaction artifact ( 440 ) is in front of a layer of fingerprint imagers ( 110 ). In an embodiment, a static human interaction artifact comprises a static button, or a static icon, etc. 
         [0032]    It should be understood that there exists implementations of other variations and modifications of the invention and its various aspects, as may be readily apparent to those of ordinary skill in the art, and that the invention is not limited by the specific embodiments described herein.