Abstract:
A method of 3D biometrics identification includes the steps of acquiring 3D image(s) of fingerprint; performing image normalization and feature extraction steps involving, noise elimination, ridge extraction, ridge modification and ridge validation; extracting 3D fingerprint minutiae and performing the reliability evaluation of the extracted 3D fingerprint minutiae; automatically extracting of 3D fingerprint template comprising at least five features; and automatically registering two 3D fingerprint templates, say P and Q, by computing relative 3D minutiae representation from a 3D minutiae in P (sample) considered as the origin and aligning every 3D minutiae in Q to compute best possible matching score, wherein every 3D minutiae in template P is further considered as the origin for the alignment of 3D minutiae in template Q, and the best possible matching score obtained from such considerations (candidate alignments) is considered as the final matching score between two 3D fingerprint templates.

Description:
CROSS-REFERENCE TO RELATED APPLICATION 
       [0001]    This application is a continuation application of U.S. application having Ser. No. 13/935,584 filed on 5 Jul. 2013, which claims benefit under 35 U.S.C. §119(e) of U.S. Provisional Application having Ser. No. 61/680,716 filed 8 Aug. 2012, which is hereby incorporated by reference herein in its entirety. 
     
    
     FIELD OF INVENTION 
       [0002]    This invention relates to a method of 3D biometrics identification, in particular the present invention is used to identify fingerprint. 
       BACKGROUND OF INVENTION 
       [0003]    Biometrics based human identification is one of the most critical and challenging task to meet growing demand for stringent security. Among different biometric features, fingerprint-based biometric is the most proven technique and has the largest market shares. Although fingerprint recognition has been studied for many years and much progress has been made, even the performance of state-of-the-art fingerprint matchers is still much lower than the expectations of people and theory estimation. The reason is that the traditional fingerprint acquisition is conducted by pressing or rolling of fingers against the hard surface (glass, silicon, polymer) or paper which often results in partial or degraded images due to improper finger placement, skin deformation, slippages, smearing or due to sensor noise. Therefore contactless finger imaging systems that can provide three dimensional (3D) representation of fingerprints have recently emerged to provide ideal solutions to above intrinsic problems. Such 3D approaches can provide more accurate personal identification due to the large amount of information contained in the 3D surface models as compared to the traditional two dimensional (2D) fingerprint images. The main obstacle of these emerging 3D fingerprint technologies to replace the conventional 2D fingerprint system lies in their bulk and high cost, which mainly results from the usage of structured lighting system or multiple cameras. 
         [0004]    Besides, both of these technologies have not been able to exploit other surface parameters, like surface normal vectors, refraction parameters, and scattering parameters etc., which can also contribute to the precision of the reconstruction result. Therefore advanced capability to develop more and low-cost solution for the 3D fingerprint identification will significantly enhance the applicability of fingerprint recognition technologies in wide range of civilian and commercial applications. 
       SUMMARY OF INVENTION 
       [0005]    In the light of the foregoing background, it is an object of the present invention to provide an alternative design of contactless 3D biometric feature identification system and the method thereof. 
         [0006]    Accordingly, the present invention, in one aspect, is a method of identifying biometric feature comprising the steps of capturing a plurality of images with different illuminations of an object that has such biometric features; reconstructing a 3D surface model of the object based on the captured images and extracting a plurality of features from the plurality of images and the 3D surface model. The aforesaid plurality of features comprises 3D coordinates and orientations of the biometric features 
         [0007]    In one embodiment of the present invention, the plurality of features further comprises surface curvature and local surface orientations of the object and 2D coordinated and orientation of the biometric features. 
         [0008]    In another embodiment, the step of extracting the plurality of features further comprises the steps of extracting 2D coordinates and orientations of the features from each of the captured images; evaluating the reliability of the features accordingly; and extracting 3D coordinates and orientations of the features based on the reliability. 
         [0009]    In a further embodiment, the step of establishing identity further comprises the steps of computing a plurality of parameters based on the plurality of features and corresponding predefined reference features of a second object; generating matching scores based on the plurality of parameters; and establishing identity of the biometric feature based on the matching score. In one embodiment, a combined matching score which is a weighted sum of said matching scores. In another embodiment, the combined matching score is a dynamic combination of said matching scores. 
         [0010]    According to another aspect of the present invention, a biometric feature identification system is disclosed. The system comprises a lighting module configured produce a plurality of illuminations on the object having the biometric features; a fix-viewpoint image capturing means configured to capture images of an object having the biometric features; a microprocessor coupled to the image capturing means and the lighting module; and a computer-readable storage medium coupled to the microprocessor. The computer-readable storage medium is encoded with computer-readable instructions for causing the microprocessor to execute the following steps: synchronizing the image capturing means and the lighting module; capturing a plurality of images of the object with each image having different illuminations; reconstructing a 3D surface model of the object based on the plurality of images; extracting a plurality of features from the plurality of images and the 3D surface model; and establishing identity of the object accordingly. 
         [0011]    In one embodiment, the plurality of features comprises 2D and 3D coordinates and orientation of the biometric features; as well as surface curvature and local surface orientations of the object. 
         [0012]    In one embodiment of the present invention, the lighting module comprises a plurality of light sources positioned around the image capturing means which can be switched on and off independently by the microprocessor thereby producing different illuminations on the object. 
         [0013]    In another embodiment of the present invention, the lighting module comprises a modulated light source wherein the output intensity is controllable by the microprocessor thereby producing different illuminations on the object. 
         [0014]    According to another aspect of the present invention, a computer-implemented method of identifying a 3D fingerprint in a specially developed device comprising the steps of (i) acquiring 3D image(s) of fingerprint with the specially developed device; (ii) performing image normalization and feature extraction steps involving, noise elimination, ridge extraction, ridge modification and ridge validation; (iii) extracting 3D fingerprint minutiae in a 3D space and performing the reliability evaluation of the extracted 3D fingerprint minutiae; (iv) automatically extracting of 3D fingerprint template comprising at least five features, including location of minutiae in a 3D space using its x, y, z location, and its orientation in a 3D space comprising θ (azimuth angle) and φ (elevation angle); (v) automatically registering two 3D fingerprint templates, say P and Q, by computing relative 3D minutiae representation from a 3D minutiae in P (sample) considered as the origin and aligning every 3D minutiae in Q to compute best possible matching score, wherein every 3D minutiae in template P is further considered as the origin for the alignment of 3D minutiae in template Q, and the best possible matching score obtained from such considerations (candidate alignments) is considered as the final matching score between two 3D fingerprint templates, wherein the matching score is generated between two 3D minutiae templates with multiple features by counting the fraction of matched minutiae in two 3D templates (P and Q) and the two 3D minutiae are considered as matched if difference between their feature(s) is smaller than a threshold(s) or tolerance limit(s), whereby the matching score between two unique 3D fingerprint template computed between the presented fingerprint and those stored in a registration database is used to establish the identity of the fingerprint. 
         [0015]    In one embodiment, the matching scores from the 3D fingerprint minutiae are combined with the matching scores from the 3D fingerprint curvature, 3D unit normal vector matching scores, and 2D fingerprint matching scores, which are also simultaneously generated from the 3D fingerprint images to form the combined matching scores. 
         [0016]    There are many advantages to the present invention. Firstly, this invention can be used in a variety of biometric identification applications, including fingerprint identification. The present invention utilizes a single camera with fixed viewpoint that simultaneously acquires and processes multiple 2D fingerprint images under different illuminations, thus reducing system cost substantially. Such photometric stereo inspired approach provides a low-cost alternative to the currently available 3D fingerprint recognition systems which either use structured lighting or multiple cameras. 
         [0017]    Another advantage of the present invention is that the accuracy of fingerprint recognition is higher than conventional fingerprint systems in both verification and recognition applications. This improvement is due to the 3D feature extraction algorithm as proposed in the present invention which is able to recover additional fingerprint features and adaptively match them. 
     
    
     
       BRIEF DESCRIPTION OF FIGURES 
         [0018]      FIG. 1  is a schematic diagram of biometric feature identification system according to one of the embodiment of the present invention. 
           [0019]      FIG. 2  is the front view of the image capturing means and the lighting module according to one of the embodiments of the present invention. 
           [0020]      FIG. 3  shows the concept flow chart of the method of identifying biometric feature according to one of the embodiments of the present invention. 
           [0021]      FIG. 4  shows the relative localization of a 3D minutia (m) with a reference minutia (m r ). 
           [0022]      FIG. 5  shows a plurality of images captured by the biometric feature identification system according to one embodiment of the present invention. 
           [0023]      FIG. 6  shows four different series of 2D fingerprint images and the reconstructed 3D surface model, in particular (a) images as obtained by the image capturing mean according to one embodiment of the present invention; (b) images after normalization; (c) enhanced normalized images; (d) 3D curvature images of corresponding fingers and (e) reconstructed 3D surface model of the finger. 
           [0024]      FIG. 7  shows the receiver operating characteristic (ROC) curves using 2D fingerprint images with different illuminations. 
           [0025]      FIGS. 8   a  and  8   b  shows the ROC curve for the system performance using reconstructed 3D surface model and the system performance using combinations of 3D and 2D fingerprint images as acquired according to one embodiment of the present invention respectively. 
           [0026]      FIG. 9   a  shows the validation performance of the biometric features identification system according to the same embodiment of the present invention using 240 known clients and 20 unknowns.  FIG. 9   b  shows the false positive identification rate (FPIR) vs. false negative identification rate (FNIR) characteristics from the same experiment as in  FIG. 9   a.    
           [0027]      FIGS. 10   a  and  10   b  shows the cumulative match characteristics (CMC) for the average recognition performance on using reconstructed 3D surface model and respective performance using combination of 3D model and 2D fingerprint images according to the same embodiment of the present invention. 
           [0028]      FIG. 11   a  and  11   b  shows ROC curve for the system performance using different surface code matching scores and respective performance using combination of different surface code and local surface orientation according to the same embodiment of the present invention. 
       
    
    
     DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
       [0029]    As used herein and in the claims, “comprising” means including the following elements but not excluding others. 
         [0030]    Referring now to  FIG. 1 , the first aspect of the present invention is a biometric feature identification system  20  comprising a lighting module  22 , an image capturing means  24  and a microcomputer  26 . The microcomputer  26  at least comprises a microprocessor (not shown) and a computer-readable storage medium or memory (not shown) connected to the microprocessor. The lighting module  22  and image capturing means  24  are further coupled to the microprocessor. 
         [0031]    The lighting module  22  is configured to produce a plurality of illuminations on an object having the biometric features and the image capturing means  24  is configured to capture a plurality of images of the object  18  having the biometric features of interest. During operation, the object  18  has no physical contact with the biometric feature identification system  20 . In one embodiment, the object  18  is placed in front of, without any physical contact with, the image capturing means  24  as shown in  FIG. 1 . As shown in this figure, the object  18  is a finger and the biometric features are the fingerprint. 
         [0032]    Referring now to  FIG. 2 , in one embodiment of the present invention, the lighting module  22  comprises of a plurality of light-emitting diodes  28   a - 28   g  (LEDs). The LEDs  28   a - 28   g  are positioned around the image capturing means  24  and are distributed evenly around the center of the image capturing means  24 . The LEDs  28   a - 28   g  are configured to be switched on or off independently by the microprocessor thereby the object can be illuminated from different illuminating angles. The microprocessor is further configured to synchronize the lighting module  22  and image capturing means  24  such that a plurality images can be captured with each of the images having different illuminations on the same object. In another embodiment, the illumination sources that emit different colored light can be employed to simultaneously estimate the shading corresponding to each color source by separating the color/spectral image components of acquired/multispectral image(s). In another embodiment, the plurality of LEDs can be replaced by a single modulated light source and different illuminations are produced on the object by alternating the output intensity of the modulated light source. 
         [0033]    According to another aspect of the present invention, now referring to  FIG. 3 , a method of identifying biometric feature is provided. After capturing a plurality of images of the object in step  30 , a 3D surface model of the object is reconstructed in step  32 . Afterwards a plurality of features is extracted from the images and 3D surface model in step  34  which in turns are used in establishing the identity of the biometric features (step  36 ). 
         [0034]    The reconstruction step  32  is based on the shape from shading technique. Given a captured image E(x, y), the shape from shading technique can be used to recover the surface model z(x, y) using the following equation (1): 
         [0000]        E ( x,y )=ρ l   0   R ( p ( x,y ), q ( x,y ))   (1)
 
         [0000]    where ρ is the albedo and I 0  is the incident radiance. The surface reflectance R relates the observed image pixel intensities in E(x, y) to the surface orientations/gradients for a given source direction and the surface reflectance in the direction of the image capturing means. The surface gradients p(x, y) and q(x, y) can be defined as following equation (2): 
         [0000]        p ( x,y )=∂ƒ( x,y )/∂ x, q ( x,y )=∂ƒ( x,y )/∂ y    (2)
 
         [0035]    The 3D surface model can be reconstructed by recovering the surface height information z=ƒ(x, y). In one embodiment, the surface of the object is assumed to be a Lambertian surface which is illuminated by a plurality of, say m, light sources, i.e., L=[l 1 ,l 2 , . . . l m ] T . Each of these light sources is fixed with known direction l=[l x ,l y ,l z ] T  and radiance ∥l∥. Let n=[n x ,n y ,n z ] T  be the unit surface normal vectors at some point of interest on the surface model. The observed image pixel intensities y, from the m images, corresponding to the respective illumination sources can be written as following equation (3): 
         [0000]      y=L.x   (3)
 
         [0000]    where L=[y 1 ,y 2 , . . . y m ] T  and x=ρ[n x ,n y ,n z ] T . In one embodiment, the light source directions are not co-planer so that the matrix L is non-singular. Equation (3) illustrates linear relationship between the 3D surface model, observed pixel intensities from the captured images and the unit surface normal vectors x. The unknown vector x can be estimated from the least squared error technique using the following equation (4): 
         [0000]        x= ( L   T   L ) −1   L   T   y≡ρn    (4)
 
         [0036]    Since n is of unit length, the length of recovered vector x is the absolute reflectance (albedo) ρ and the surface normal is represented by the direction of unit vector n. The recovered surface normals are then integrated to recover the 3D object surface z(x, y). 
         [0037]    In one embodiment, the method of identifying biometric feature further comprises a step of preprocessing the 3D surface model z(x, y). The 3D surface model is first smoothed using a median filer, followed by a 3D variant of Laplacian smoothing which can effectively denoises point clouds. For a vertex z t  within the image z=ƒ(x, y), with its neighbors z j , the updated vertexes  z   t  are computed by the following equation (5): 
         [0000]    
       
         
           
             
               
                 
                   
                     
                       z 
                       _ 
                     
                     ι 
                   
                   = 
                   
                     
                       
                         ( 
                         
                           1 
                           - 
                           ε 
                         
                         ) 
                       
                        
                       
                         z 
                         i 
                       
                     
                     + 
                     
                       
                         ε 
                         
                           
                             ∑ 
                             j 
                           
                            
                           
                             w 
                             ij 
                           
                         
                       
                        
                       
                         
                           ∑ 
                           j 
                         
                          
                         
                           
                             w 
                             ij 
                           
                            
                           
                             z 
                             j 
                           
                         
                       
                     
                   
                 
               
               
                 
                   ( 
                   5 
                   ) 
                 
               
             
           
         
       
     
         [0000]    where w ij  is a finite support weighting function and is chosen as the inverse of distance between vertex z t  and its neighbors z j , i.e. w tj =∥z j −z i ∥ −1 . The reconstructed surface model is smoothed after 40 iterations with ∈=0.5 and the neighbors j are chosen within ±2 pixel in the x and y directions from vertex z t . The normal vectors of the cloud point data for the smoothed surface is then computed by the gradient of z=ƒ(x, y). The normalized vector is an upward normal with (−g x , −g y , 1), where g x  and g y  are the gradient along x and y directions. The normalized surface normal is then used for estimating the principle curvature. 
         [0038]    After reconstructing the 3D surface model in step  32 , a plurality of features is extracted from the 3D surface model and the plurality of images in step  34 . In one embodiment, the features comprise 3D coordinates and orientations of the biometric features. In another embodiment of the present invention, the features further comprise surface curvature and local surface orientation of the object. In order to prevent object movement between each captured image from affecting the accuracy and reliability of the extracted features, in one embodiment, the 3D coordinates and orientations are extracted base on the result of a reliability test applied on the plurality of images. 
         [0039]    To illustrate the feature extraction algorithm of the present invention, a specific realization on applying these extraction algorithms to identifying the fingerprint is disclosed herein. In the context of fingerprint identification, the aforesaid object is a finger and the biometric feature is the fingerprint itself. In one embodiment, the step of extraction  34  starts with extracting 2D coordinates and orientations of the features (2D minutiae). 2D minutiae details (x, y, θ, q) consisting of position of the minutiae (x, y), angle θ representing the orientation of the minutiae and the quality q of the minutiae. 
         [0040]    In one embodiment, the reliabilities of the extracted 2D minutiae are then evaluated. The rationale behind the reliability test is that if a particular minutiae is detected in more than one image among the plurality of images acquired, that particular minutiae is considered to be reliable. One particular implementation of the reliability test is disclosed as follows: 
         [0041]    Let the list of minutiae extracted from the plurality of fingerprint image under the first illumination angle be L={m 1 , m 2  . . . m n } where m=[x, y, θ, q]. Then the counted list CL={cm 1 , cm 2 , . . . cm n } is initialized, where cm=[x, y, θ, q, c], and c is the number of occurrences and is set to 1. For each minutiae m i  from the fingerprint image under the second to seventh illumination angle, the CL is updated as follows: 
         [0042]    Let {TL} be a subset of CL such that such that ∥x cm     k   −x i ,y cm     k   −y i ∥ 2 ≦k 1  and min(|θ cm     k   −θ i |,360−|θ cm     k   −θ i |)≦k 2 , where cm k ∈CL, then cm t  is updated such that c t ≧c i  for all cm i ∈{TL}. The value of x, y, θ, q of updated cm t  will be the average value of existing cluster members and the new member, and c will be increased by one. If {TL}=Ø, then CL=CL ∪ [x i ,y i ,θ i ,q i ,1]. In one embodiment of the present invention, the constant k 1  is set to 4 since the minutiae location in differently illuminated fingerprint images would not shift too far away and square root of 4, i.e. 2, which is slightly smaller the half width of the ridge (measured as 5 pixels in experiments). In another embodiment, constant k 2  is set to 25 for the acceptable angle difference which can keep the cluster to have similar direction/orientation. After updating CL, the subset of CL is picked as DL with c≧2. If two clusters groups are too close, they are merged to one single group to reduce the chance that a single minutia is extracted as two minutiae. The final list of minutia, which is the merged list DL, is considered to have high reliability. 
         [0043]    In one embodiment, the highly reliable 2D minutiae are extended to 3D coordinates and orientations (3D minutiae) by adding two additional features z and φ onto (x, y, θ, q). The value z is the height of the vertex on the reconstructed 3D surface model at position (x, y) while θ and φ represent the minutiae orientation in spherical coordinates with unit length 1. The angle φ is computed by tracing the reconstructed 3D surface model at minutiae locations along the direction of θ, which is available from 2D minutiae details (x, y, θ, q). In case of bifurcation type of minutiae, the local ridge surface is masked while local valley surface is masked for the end type of minutiae since the direction θ is here pointing in outward direction. The angle φ is then computed by estimating the principle axes of the masked ridge surface. Therefore, the minutiae representation can be extended in 3D space with the representation (x, y, z, θ, φ, q). 
         [0044]    In one embodiment, surface curvature and surface directions are also extracted as members of the plurality of features. The surface curvature typically measures local bending of fingerprint surface at each of the surface points while the surface directions indicate the directions of minimum and maximum surface bending. The surface curvature is estimated using local surface fitting (cubic order approximation). Let a given surface point be s with its normal N and its u neighboring points be t, with their normal vectors K i  where i=1, 2 . . . u. In the coordinate system with s as the origin (0, 0, 0) and its normal N as the z-axis, the position of neighbors t i  is (x i , y i , z i ) and the values of K i  is (a i , b i , c i ). Using the adjacent-normal cubic order algorithm, a surface that can fit the vertex and its neighboring points is located such that: 
         [0000]    
       
         
           
             
               
                 
                   z 
                   = 
                     
                    
                   
                     
                       f 
                        
                       
                         ( 
                         
                           x 
                           , 
                           y 
                         
                         ) 
                       
                     
                     = 
                     
                       
                         
                           a 
                           2 
                         
                          
                         
                           x 
                           2 
                         
                       
                       + 
                       bxy 
                       + 
                       
                         
                           c 
                           2 
                         
                          
                         
                           y 
                           2 
                         
                       
                       + 
                       
                         dx 
                         3 
                       
                       + 
                       
                         
                           ex 
                           2 
                         
                          
                         y 
                       
                       + 
                       
                         fxy 
                         2 
                       
                       + 
                       
                         gy 
                         3 
                       
                     
                   
                 
               
               
                 
                   ( 
                   6 
                   ) 
                 
               
             
           
         
       
     
         [0045]    The normal vector of the surface point s in the approximated surface is written as 
         [0000]    
       
         
           
             
               
                 
                   
                     
                       
                         
                           N 
                            
                           
                             ( 
                             
                               x 
                               , 
                               y 
                             
                             ) 
                           
                         
                         = 
                           
                          
                         
                           ( 
                           
                             
                               
                                 f 
                                 x 
                               
                                
                               
                                 ( 
                                 
                                   x 
                                   , 
                                   y 
                                 
                                 ) 
                               
                             
                             , 
                             
                               
                                 f 
                                 y 
                               
                                
                               
                                 ( 
                                 
                                   x 
                                   , 
                                   y 
                                 
                                 ) 
                               
                             
                             , 
                             
                               - 
                               1 
                             
                           
                           ) 
                         
                       
                     
                   
                   
                     
                       
                         = 
                           
                          
                         
                           ( 
                           
                             
                               ax 
                               + 
                               by 
                               + 
                               
                                 3 
                                  
                                 
                                     
                                 
                                  
                                 
                                   dx 
                                   2 
                                 
                               
                               + 
                               exy 
                               + 
                               
                                 fy 
                                 2 
                               
                             
                             , 
                           
                         
                       
                     
                   
                   
                     
                       
                           
                          
                         
                           
                             bx 
                             + 
                             cy 
                             + 
                             
                               ex 
                                
                               
                                   
                               
                                
                               2 
                             
                             + 
                             
                               2 
                                
                               
                                   
                               
                                
                               fxy 
                             
                             + 
                             
                               3 
                                
                               
                                   
                               
                                
                               
                                 gy 
                                 2 
                               
                             
                           
                           , 
                           
                             - 
                             1 
                           
                         
                         ) 
                       
                     
                   
                 
               
               
                 
                   ( 
                   7 
                   ) 
                 
               
             
           
         
       
     
         [0046]    The cubic-order surface fitting, for both the neighboring surface points and their normal, generate following three equations for each of the surface points. 
         [0000]    
       
         
           
             
               
                 
                   
                     
                       ( 
                       
                         
                           
                             
                               0.5 
                                
                               
                                   
                               
                                
                               
                                 x 
                                 i 
                                 2 
                               
                             
                           
                           
                             
                               
                                 x 
                                 i 
                               
                                
                               
                                 y 
                                 i 
                               
                             
                           
                           
                             
                               0.5 
                                
                               
                                   
                               
                                
                               
                                 y 
                                 i 
                                 2 
                               
                             
                           
                           
                             
                               x 
                               i 
                               3 
                             
                           
                           
                             
                               
                                 x 
                                 i 
                                 2 
                               
                                
                               
                                 y 
                                 i 
                               
                             
                           
                           
                             
                               
                                 x 
                                 i 
                               
                                
                               
                                 y 
                                 i 
                                 2 
                               
                             
                           
                           
                             
                               y 
                               i 
                               3 
                             
                           
                         
                         
                           
                             
                               x 
                               i 
                             
                           
                           
                             
                               y 
                               i 
                             
                           
                           
                             0 
                           
                           
                             
                               3 
                                
                               
                                   
                               
                                
                               
                                 x 
                                 i 
                                 2 
                               
                             
                           
                           
                             
                               2 
                                
                               
                                   
                               
                                
                               
                                 x 
                                 i 
                               
                                
                               
                                 y 
                                 i 
                               
                             
                           
                           
                             
                               y 
                               i 
                               2 
                             
                           
                           
                             0 
                           
                         
                         
                           
                             0 
                           
                           
                             
                               x 
                               i 
                             
                           
                           
                             
                               y 
                               i 
                             
                           
                           
                             0 
                           
                           
                             
                               x 
                               i 
                               2 
                             
                           
                           
                             
                               2 
                                
                               
                                   
                               
                                
                               
                                 x 
                                 i 
                               
                                
                               
                                 y 
                                 i 
                               
                             
                           
                           
                             
                               3 
                                
                               
                                   
                               
                                
                               
                                 y 
                                 i 
                                 2 
                               
                             
                           
                         
                       
                       ) 
                     
                      
                     Ω 
                   
                   = 
                   
                     ( 
                     
                       
                         
                           
                             z 
                             i 
                           
                         
                       
                       
                         
                           
                             
                               - 
                               
                                 a 
                                 i 
                               
                             
                             / 
                             
                               c 
                               i 
                             
                           
                         
                       
                       
                         
                           
                             
                               - 
                               
                                 b 
                                 i 
                               
                             
                             / 
                             
                               c 
                               i 
                             
                           
                         
                       
                     
                     ) 
                   
                 
               
               
                 
                   ( 
                   8 
                   ) 
                 
               
             
           
         
       
     
         [0000]    where Ω=[a b c d e f g] T  is the coefficient vector of cubic surface. Equation (7) represents an over determined equation system and can be written in the following form: 
         [0000]      KΩ=R   (9)
 
         [0000]    where K is 3u×7 matrix (from left hand side of equation 7) and R is 3u×1 vector. Least-square fitting is applied to find the best solution for equation (7) and construct Weingarten curvature matrix W for the fitted surface using only three coefficients. 
         [0000]    
       
         
           
             
               
                 
                   W 
                   = 
                   
                     ( 
                     
                       
                         
                           a 
                         
                         
                           b 
                         
                       
                       
                         
                           b 
                         
                         
                           c 
                         
                       
                     
                     ) 
                   
                 
               
               
                 
                   ( 
                   10 
                   ) 
                 
               
             
           
         
       
     
         [0047]    The eigenvalues of Weingarten matrix are the maximum and minimum principle curvature of the surface (k max  and k min ), and their eigenvectors are the principal direction vectors and (t max  and t min ) which can be directly computed. Shape index of a surface at vertex s is adopted to quantify the local shape of the fingerprint surface. The curvature information described using C i (s) is independent of scale and can be computed using following equation (11): 
         [0000]    
       
         
           
             
               
                 
                   
                     
                       C 
                       i 
                     
                      
                     
                       ( 
                       s 
                       ) 
                     
                   
                   = 
                   
                     
                       1 
                       2 
                     
                     - 
                     
                       
                         ( 
                         
                           1 
                           n 
                         
                         ) 
                       
                        
                       
                         
                           tan 
                           
                             - 
                             1 
                           
                         
                          
                         
                           ( 
                           
                             
                               
                                 t 
                                 max 
                               
                               + 
                               
                                 t 
                                 min 
                               
                             
                             
                               
                                 t 
                                 max 
                               
                               - 
                               
                                 t 
                                 min 
                               
                             
                           
                           ) 
                         
                       
                     
                   
                 
               
               
                 
                   ( 
                   11 
                   ) 
                 
               
             
           
         
       
     
         [0048]    The C i (s) maps all shapes in the interval [0,1]. In one embodiment, the shape of the surface is considered to be valley and ridge if C i (s) is close to 0.25 and 0.75 respectively. This binomial representation is referred as Surface Code. In another embodiment, the zone of surface is split into five zones: cup, rut, saddle, ridge and cap as shown in table 1. 
         [0000]    
       
         
               
             
               
               
               
               
               
               
             
               
               
               
               
               
               
               
               
               
               
               
               
               
               
               
               
             
           
               
                 TABLE 1 
               
             
             
               
                   
               
               
                 Zones of Finger Surface code 
               
             
          
           
               
                 Shape 
                   
                   
                   
                   
                   
               
               
                 index 
                 0-0.0625 
                 0.0625-0.4375 
                 0.4375-0.5625 
                 0.5625-0.9375 
                 0.9375-1 
               
               
                   
               
             
          
           
               
                 Angle (π/6) 
                 / 
                 0 
                 1 
                 2 
                 3 
                 4 
                 5 
                 / 
                 0 
                 1 
                 2 
                 3 
                 4 
                 5 
                 / 
               
               
                 Code 
                 0 
                 1 
                 2 
                 3 
                 4 
                 5 
                 6 
                 7 
                 8 
                 9 
                 10 
                 11 
                 12 
                 13 
                 14 
               
               
                   
               
             
          
         
       
     
         [0049]    Direction of the dominant principle curvature (max(|k Max |,|k Min |) is portioned into six directions. Rut and ridge zones are further divided since cup, saddle and cap&#39;s |k Max | and |k Min | are close; therefore, t max  and t min  are not as accurate as that in rut and ridge zones. The resulting feature representation, referred to as Finger Surface Code has 15 different values and therefore 4-bits can store resulting binary code for each pixel. 
         [0050]    In one embodiment, local surface orientation is also extracted from the reconstructed 3D surface model. The local surface orientation is extracted by exploiting the unit normal vector location at the 3D fingerprint surface points. The unit normal vector at 3D fingerprint surface point can be estimated using lowest eigenvalues which are available while determining principle axes of the masked ridge surface for the minutiae direction angle φ. Since the direction of principle axis is the normal vector over the masked ridge surface, it has least noise as compared to the case when the normal vector is measured on the exact minutiae location. 
         [0051]    After extracting all or part of the features as mentioned above, the identity of the biometric features is established based on the extracted features. In one embodiment, step  36  of establishing the identity further comprises the steps of computing a plurality of parameters based on the extracted features and corresponding predefined reference values of a second object; generating a matching score based on the parameters; and establishing identity of the object based on the matching score. In one embodiment, reference values of the second object corresponds to the biometric features obtained using the same feature extraction process on that object and stored in a database. 
         [0052]    In one embodiment, the matching score is computed merely based on the 2D minutiae, and is referred as 2D matching score. The extracted minutiae pairs from the query image (Q) and pre-obtained template image (P) are matched to generate a 2D fingerprint matching scores between two 2D fingerprint images. All minutiae are converted to spherical coordinate as [r, A s , A θ , T] which center at the reference minutia and align the angle with θ ref . 
         [0000]    
       
         
           
             
               
                 
                   r 
                   = 
                   
                     
                       
                         
                           ( 
                           
                             x 
                             - 
                             
                               x 
                               r 
                             
                           
                           ) 
                         
                         2 
                       
                       + 
                       
                         
                           ( 
                           
                             y 
                             - 
                             
                               y 
                               r 
                             
                           
                           ) 
                         
                         2 
                       
                     
                   
                 
               
               
                 
                   ( 
                   12 
                   ) 
                 
               
             
             
               
                 
                   
                     A 
                     s 
                   
                   = 
                   
                     
                       atan 
                        
                       
                           
                       
                        
                       2 
                        
                       
                         ( 
                         
                           
                             y 
                             - 
                             
                               y 
                               r 
                             
                           
                           
                             x 
                             - 
                             
                               x 
                               r 
                             
                           
                         
                         ) 
                       
                     
                     - 
                     
                       θ 
                       r 
                     
                   
                 
               
               
                 
                   ( 
                   13 
                   ) 
                 
               
             
             
               
                 
                   
                     A 
                     θ 
                   
                   = 
                   
                     ( 
                     
                       θ 
                       - 
                       
                         θ 
                         r 
                       
                     
                     ) 
                   
                 
               
               
                 
                   ( 
                   14 
                   ) 
                 
               
             
           
         
       
     
         [0000]    where r is the distance of respective minutiae with the reference minutia, A s  is the angular separation of the minutia and A θ  is the orientation of the minutia. If the difference between [r i , A si , A θi , T i ] in P and [r j , A sj , A θj , T j ] in Q is smaller than a predetermined threshold, then T i =T j , and the minutia i in P and minutia j in Q are considered as matched pair. The overall 2D matching score S 2D  is generated using the equation (15): 
         [0000]    
       
         
           
             
               
                 
                   
                     S 
                     
                       2 
                        
                       
                           
                       
                        
                       D 
                     
                   
                   = 
                   
                     
                       m 
                       2 
                     
                     
                       
                         M 
                         p 
                       
                        
                       
                         M 
                         Q 
                       
                     
                   
                 
               
               
                 
                   ( 
                   15 
                   ) 
                 
               
             
           
         
       
     
         [0000]    where m is the total number of matched minutiae pairs and M P , M Q  is the number of minutiae in query and template image respectively. The maximum score from all of the possible reference minutia pair is selected as the final 2D matching score between fingerprint image P and Q. 
         [0053]    In another embodiment, the matching score is computed merely based on the 3D minutiae, and is referred as 3D matching score. Similar to the 2D minutiae matching score, a minutiae pair from the query image (Q) and pre-obtained template image (P) is first selected and all minutiae are converted to spherical coordinate. The minutiae pair are then aligned with the x-axes and z-axes. This alignment ensures that the aligned minutiae (in both P and Q) location can serve as the universal origin or reference minutiae to measure other minutiae in respective templates. An aligned minutia represented as m r =[x r , y r , z r , θ r , φ r ] in template P, the relative representation of other 3D minutiae in template P can be denoted as m=[r, A s , A θ , A g , A φ ]. Referring to  FIG. 4 , r is the radial distance with reference minutiae, A θ , is the azimuth angle and A φ  is the elevation angle that localize the minutiae m in 3D plane, while A s  and A g  are the azimuth and the elevation angle that localize the radial vector r (with respect to reference minutiae m r) in  3D space. Let R z (θ) and R y (φ) be the rotation matrix along z and y direction in Cartesian coordinate, and sph(x, y, z) be the Cartesian to Spherical coordinate transformation with unit length 1: 
         [0000]    
       
         
           
             
               
                 
                   
                     
                       
                         R 
                         z 
                       
                        
                       
                         ( 
                         θ 
                         ) 
                       
                     
                     = 
                     
                       [ 
                       
                         
                           
                             
                               cos 
                                
                               
                                   
                               
                                
                               θ 
                             
                           
                           
                             
                               
                                 - 
                                 sin 
                               
                                
                               
                                   
                               
                                
                               θ 
                             
                           
                           
                             0 
                           
                         
                         
                           
                             
                               sin 
                                
                               
                                   
                               
                                
                               θ 
                             
                           
                           
                             
                               cos 
                                
                               
                                   
                               
                                
                               θ 
                             
                           
                           
                             0 
                           
                         
                         
                           
                             0 
                           
                           
                             0 
                           
                           
                             1 
                           
                         
                       
                       ] 
                     
                   
                   , 
                   
                     
                       
                         R 
                         y 
                       
                        
                       
                         ( 
                         φ 
                         ) 
                       
                     
                     = 
                     
                       [ 
                       
                         
                           
                             
                               cos 
                                
                               
                                   
                               
                                
                               φ 
                             
                           
                           
                             0 
                           
                           
                             
                               
                                 - 
                                 sin 
                               
                                
                               
                                   
                               
                                
                               φ 
                             
                           
                         
                         
                           
                             0 
                           
                           
                             1 
                           
                           
                             0 
                           
                         
                         
                           
                             
                               sin 
                                
                               
                                   
                               
                                
                               φ 
                             
                           
                           
                             0 
                           
                           
                             
                               cos 
                                
                               
                                   
                               
                                
                               φ 
                             
                           
                         
                       
                       ] 
                     
                   
                 
               
               
                 
                   ( 
                   16 
                   ) 
                 
               
             
             
               
                 
                   
                     sph 
                      
                     
                       ( 
                       
                         [ 
                         xyz 
                         ] 
                       
                       ) 
                     
                   
                   = 
                   
                     [ 
                     
                       
                         
                           
                             atan 
                              
                             
                                 
                             
                              
                             2 
                              
                             
                               ( 
                               
                                 y 
                                 , 
                                 x 
                               
                               ) 
                             
                           
                         
                         
                           
                             
                               sin 
                               
                                 - 
                                 1 
                               
                             
                              
                             z 
                           
                         
                       
                     
                     ] 
                   
                 
               
               
                 
                   ( 
                   17 
                   ) 
                 
               
             
           
         
       
     
         [0000]    where atan2 is the four-quadrant inverse tangent function. The parameters for the relative representation (feature vector) of minutiae m are computed as follows: 
         [0000]    
       
         
           
             
               
                 
                   r 
                   = 
                   
                     
                       
                         
                           ( 
                           
                             x 
                             - 
                             
                               x 
                               r 
                             
                           
                           ) 
                         
                         2 
                       
                       + 
                       
                         
                           ( 
                           
                             y 
                             - 
                             
                               y 
                               r 
                             
                           
                           ) 
                         
                         2 
                       
                       + 
                       
                         
                           ( 
                           
                             z 
                             - 
                             
                               z 
                               r 
                             
                           
                           ) 
                         
                         2 
                       
                     
                   
                 
               
               
                 
                   ( 
                   18 
                   ) 
                 
               
             
             
               
                 
                   
                     [ 
                     
                       
                         x 
                         ′ 
                       
                        
                       
                         y 
                         ′ 
                       
                        
                       
                         z 
                         ′ 
                       
                     
                     ] 
                   
                   = 
                   
                     
                       
                         R 
                         y 
                       
                        
                       
                         ( 
                         
                           - 
                           
                             φ 
                             r 
                           
                         
                         ) 
                       
                     
                      
                     
                       
                         R 
                         z 
                       
                        
                       
                         ( 
                         
                           - 
                           
                             φ 
                             r 
                           
                         
                         ) 
                       
                     
                      
                     
                       
                         
                           1 
                           r 
                         
                          
                         
                           [ 
                           
                             
                               
                                 
                                   x 
                                   - 
                                   
                                     x 
                                     r 
                                   
                                 
                               
                               
                                 
                                   y 
                                   - 
                                   
                                     y 
                                     r 
                                   
                                 
                               
                               
                                 
                                   z 
                                   - 
                                   
                                     z 
                                     r 
                                   
                                 
                               
                             
                           
                           ] 
                         
                       
                       T 
                     
                   
                 
               
               
                 
                   ( 
                   19 
                   ) 
                 
               
             
             
               
                 
                   
                     [ 
                     
                       
                         A 
                         s 
                       
                        
                       
                         A 
                         g 
                       
                     
                     ] 
                   
                   = 
                   
                     sph 
                      
                     
                       ( 
                       
                         [ 
                         
                           
                             x 
                             ′ 
                           
                            
                           
                             y 
                             ′ 
                           
                            
                           
                             z 
                             ′ 
                           
                         
                         ] 
                       
                       ) 
                     
                   
                 
               
               
                 
                   ( 
                   20 
                   ) 
                 
               
             
             
               
                 
                   
                     [ 
                     
                       
                         A 
                         θ 
                       
                        
                       
                         A 
                         φ 
                       
                     
                     ] 
                   
                   = 
                   
                     sph 
                      
                     
                       ( 
                       
                         
                           ( 
                           
                             
                               
                                 R 
                                 y 
                               
                                
                               
                                 ( 
                                 
                                   - 
                                   
                                     φ 
                                     r 
                                   
                                 
                                 ) 
                               
                             
                              
                             
                               
                                 R 
                                 z 
                               
                                
                               
                                 ( 
                                 
                                   - 
                                   
                                     φ 
                                     r 
                                   
                                 
                                 ) 
                               
                             
                              
                             
                               
                                 ( 
                                 
                                   
                                     sph 
                                     
                                       - 
                                       1 
                                     
                                   
                                    
                                   
                                     ( 
                                     
                                       [ 
                                       
                                         θ 
                                          
                                         
                                             
                                         
                                          
                                         φ 
                                       
                                       ] 
                                     
                                     ) 
                                   
                                 
                                 ) 
                               
                               T 
                             
                           
                           ) 
                         
                         T 
                       
                       ) 
                     
                   
                 
               
               
                 
                   ( 
                   21 
                   ) 
                 
               
             
           
         
       
     
         [0054]    Two 3D minutiae in the two fingerprint template P and Q are considered as matched pair if the difference between their feature vectors 
         [0000]    
       
         
           
             
               ( 
               
                 
                   r 
                   
                     P 
                     i 
                   
                 
                 , 
                 
                   A 
                   
                     s 
                     
                       P 
                       i 
                     
                   
                 
                 , 
                 
                   A 
                   
                     θ 
                     
                       P 
                       i 
                     
                   
                 
                 , 
                 
                   A 
                   
                     g 
                     
                       P 
                       i 
                     
                   
                 
                 , 
                 
                   A 
                   
                     φ 
                     
                       P 
                       i 
                     
                   
                 
               
               ) 
             
              
             
                 
             
              
             and 
              
             
                 
             
              
             
               ( 
               
                 
                   r 
                   
                     Q 
                     i 
                   
                 
                 , 
                 
                   A 
                   
                     s 
                     
                       Q 
                       i 
                     
                   
                 
                 , 
                 
                   A 
                   
                     θ 
                     
                       Q 
                       i 
                     
                   
                 
                 , 
                 
                   A 
                   
                     g 
                     
                       Q 
                       i 
                     
                   
                 
                 , 
                 
                   A 
                   
                     φ 
                     
                       Q 
                       i 
                     
                   
                 
               
               ) 
             
           
         
       
     
         [0000]    is smaller than a given threshold. The differences of each elements in the feature vector are computed as follows: 
         [0000]    
       
         
           
             
               
                 
                   
                     Δ 
                      
                     
                         
                     
                      
                     r 
                   
                   = 
                   
                      
                     
                       
                         r 
                         
                           P 
                           i 
                         
                       
                       - 
                       
                         r 
                         
                           Q 
                           i 
                         
                       
                     
                      
                   
                 
               
               
                 
                   ( 
                   22 
                   ) 
                 
               
             
             
               
                 
                   
                     Δ 
                      
                     
                         
                     
                      
                     
                       A 
                       s 
                     
                   
                   = 
                   
                     min 
                      
                     
                       ( 
                       
                         
                            
                           
                             
                               A 
                               
                                 s 
                                 
                                   P 
                                   i 
                                 
                               
                             
                             - 
                             
                               A 
                               
                                 s 
                                 
                                   Q 
                                   i 
                                 
                               
                             
                           
                            
                         
                         , 
                         
                           
                             360 
                              
                             ° 
                           
                           - 
                           
                              
                             
                               
                                 A 
                                 
                                   s 
                                   
                                     P 
                                     i 
                                   
                                 
                               
                               - 
                               
                                 A 
                                 
                                   s 
                                   
                                     Q 
                                     i 
                                   
                                 
                               
                             
                              
                           
                         
                       
                       ) 
                     
                   
                 
               
               
                 
                   ( 
                   23 
                   ) 
                 
               
             
             
               
                 
                   
                     Δ 
                      
                     
                         
                     
                      
                     
                       A 
                       θ 
                     
                   
                   = 
                   
                     min 
                      
                     
                       ( 
                       
                         
                            
                           
                             
                               A 
                               
                                 θ 
                                 
                                   P 
                                   i 
                                 
                               
                             
                             - 
                             
                               A 
                               
                                 θ 
                                 
                                   Q 
                                   i 
                                 
                               
                             
                           
                            
                         
                         , 
                         
                           
                             360 
                              
                             ° 
                           
                           - 
                           
                              
                             
                               
                                 A 
                                 
                                   θ 
                                   
                                     P 
                                     i 
                                   
                                 
                               
                               - 
                               
                                 A 
                                 
                                   θ 
                                   
                                     Q 
                                     i 
                                   
                                 
                               
                             
                              
                           
                         
                       
                       ) 
                     
                   
                 
               
               
                 
                   ( 
                   24 
                   ) 
                 
               
             
             
               
                 
                   
                     Δ 
                      
                     
                         
                     
                      
                     
                       A 
                       g 
                     
                   
                   = 
                   
                      
                     
                       
                         A 
                         
                           g 
                           
                             P 
                             i 
                           
                         
                       
                       - 
                       
                         A 
                         
                           g 
                           
                             Q 
                             i 
                           
                         
                       
                     
                      
                   
                 
               
               
                 
                   ( 
                   25 
                   ) 
                 
               
             
             
               
                 
                   
                     Δ 
                      
                     
                         
                     
                      
                     
                       A 
                       φ 
                     
                   
                   = 
                   
                      
                     
                       
                         A 
                         
                           φ 
                           
                             P 
                             i 
                           
                         
                       
                       - 
                       
                         A 
                         
                           φ 
                           
                             Q 
                             i 
                           
                         
                       
                     
                      
                   
                 
               
               
                 
                   ( 
                   26 
                   ) 
                 
               
             
           
         
       
     
         [0055]    In one embodiment of the present invention, the pair of minutia is considered as a match pair if all the difference vectors (22)-(26) are smaller than their corresponding predefined thresholds. 
         [0056]    In another embodiment of the present invention, a unified 3D matching distance between two 3D minutiae is generated and rejects falsely matched minutiae using comparison with a predefined threshold. The function to combine the difference vector in equations (22)-(26) for generating unified matching distance can be written as follows equation (27): 
         [0000]    
       
         
           
             
               
                 
                   
                     funRSG 
                      
                     
                       ( 
                       
                         Δ 
                          
                         
                             
                         
                          
                         v 
                       
                       ) 
                     
                   
                   = 
                   
                     
                       
                         ( 
                         
                           
                             Δ 
                              
                             
                                 
                             
                              
                             r 
                           
                           65 
                         
                         ) 
                       
                       0.8 
                     
                     + 
                     
                       
                         ( 
                         
                           
                             Δ 
                              
                             
                                 
                             
                              
                             
                               A 
                               s 
                             
                           
                           30 
                         
                         ) 
                       
                       0.8 
                     
                     + 
                     
                       
                         ( 
                         
                           
                             Δ 
                              
                             
                                 
                             
                              
                             
                               A 
                               g 
                             
                           
                           15 
                         
                         ) 
                       
                       0.8 
                     
                     + 
                     
                       
                         ( 
                         
                           
                             Δ 
                              
                             
                                 
                             
                              
                             
                               A 
                               θ 
                             
                           
                           18 
                         
                         ) 
                       
                       0.8 
                     
                     + 
                     
                       
                         ( 
                         
                           
                             Δ 
                              
                             
                                 
                             
                              
                             
                               A 
                               φ 
                             
                           
                           42 
                         
                         ) 
                       
                       0.8 
                     
                     + 
                     
                       
                         ( 
                         
                           
                             1 
                             - 
                             
                               cos 
                                
                               
                                   
                               
                                
                               N 
                             
                           
                           0.075 
                         
                         ) 
                       
                       0.8 
                     
                   
                 
               
               
                 
                   ( 
                   27 
                   ) 
                 
               
             
           
         
       
     
         [0057]    where Δν are the vector of difference of values as computed in (22)-(26). In one embodiment, the pair of minutia is considered as a matched pair if funRSG(Δν) is smaller than 1.825. 
         [0058]    In another embodiment, the equation (27) can be generalized and improved to take into the consideration of the non-linearity of the difference vector in equations (22)-(26) by adding the function of distance from reference minutiae to obtained equation (28): 
         [0000]    
       
         
           
             
               
                 
                   
                     funRSG 
                      
                     
                       ( 
                       
                         Δ 
                          
                         
                             
                         
                          
                         v 
                       
                       ) 
                     
                   
                   = 
                   
                     
                       
                         ( 
                         
                           
                             Δ 
                              
                             
                                 
                             
                              
                             r 
                           
                           
                             f 
                              
                             
                               ( 
                               r 
                               ) 
                             
                           
                         
                         ) 
                       
                       a 
                     
                     + 
                     
                       
                         ( 
                         
                           
                             Δ 
                              
                             
                                 
                             
                              
                             
                               A 
                               s 
                             
                           
                           A 
                         
                         ) 
                       
                       b 
                     
                     + 
                     
                       
                         ( 
                         
                           
                             Δ 
                              
                             
                                 
                             
                              
                             
                               A 
                               g 
                             
                           
                           B 
                         
                         ) 
                       
                       c 
                     
                     + 
                     
                       
                         ( 
                         
                           
                             Δ 
                              
                             
                                 
                             
                              
                             
                               A 
                               θ 
                             
                           
                           C 
                         
                         ) 
                       
                       d 
                     
                     + 
                     
                       
                         ( 
                         
                           
                             Δ 
                              
                             
                                 
                             
                              
                             
                               A 
                               φ 
                             
                           
                           
                             f 
                              
                             
                               ( 
                               r 
                               ) 
                             
                           
                         
                         ) 
                       
                       0.8 
                     
                     + 
                     
                       
                         ( 
                         
                           
                             1 
                             - 
                             
                               cos 
                                
                               
                                   
                               
                                
                               N 
                             
                           
                           D 
                         
                         ) 
                       
                       f 
                     
                   
                 
               
               
                 
                   ( 
                   28 
                   ) 
                 
               
             
           
         
       
     
         [0000]    which has an independent set of power term {a, b, . . . ,f} and f(r) is the function of distance. The pair of minutia is considered as a matched pair if funRSG(Δν) is smaller than a predefined threshold. 
         [0059]    The overall 3D matching score S 3D  between two 3D minutiae template P and Q is computed as follows: 
         [0000]    
       
         
           
             
               
                 
                   
                     S 
                     
                       3 
                        
                       
                           
                       
                        
                       D 
                     
                   
                   = 
                   
                     
                       m 
                       2 
                     
                     
                       
                         M 
                         p 
                       
                        
                       
                         M 
                         q 
                       
                     
                   
                 
               
               
                 
                   ( 
                   29 
                   ) 
                 
               
             
           
         
       
     
         [0000]    where m is here refers to the total number of 3D matched minutiae pairs and M P , M Q  is the number of 3D minutiae in query and template image respectively. 
         [0060]    In yet another embodiment, the matching score is computed merely based on the Finger Surface Codes. The Finger Surface Codes matching score S Finger Surface Code  between a query Finger Surface Codes  U  from the query image and a reference Finger Surface Codes V from pre-obtained template image is computed using their normalized hamming distance as shown in equation (30): 
         [0000]    
       
         
           
             
               
                 
                   
                     S 
                     
                       Finger 
                        
                       
                           
                       
                        
                       Surface 
                        
                       
                           
                       
                        
                       Code 
                     
                   
                   = 
                   
                     
                       1 
                       
                         4 
                         × 
                         U 
                         × 
                         V 
                       
                     
                      
                     
                       
                         ∑ 
                         
                           p 
                           = 
                           1 
                         
                         U 
                       
                        
                       
                         
                           ∑ 
                           
                             q 
                             = 
                             1 
                           
                           V 
                         
                          
                         
                           ⊗ 
                           
                             ( 
                             
                               
                                 J 
                                  
                                 
                                   ( 
                                   
                                     p 
                                     , 
                                     q 
                                   
                                   ) 
                                 
                               
                               , 
                               
                                 K 
                                  
                                 
                                   ( 
                                   
                                     p 
                                     , 
                                     q 
                                   
                                   ) 
                                 
                               
                             
                             ) 
                           
                         
                       
                     
                   
                 
               
               
                 
                   ( 
                   30 
                   ) 
                 
               
             
           
         
       
     
         [0000]    where {circle around (x)} denotes the Hamming distance between the two four bit Finger Surface Codes. 
         [0061]    In another embodiment, the matching score is computed merely based on the local surface orientation (i.e. unit normal vector). The surface-orientation matching score S orientation  between two unit normal vectors, say n p  and n q  from the minutiae of the query image (Q) and pre-obtained template image (P), is generated using their dot product, i.e., S orientation =cos α=n p √n q . If S orientation  is bigger than a pre-defined threshold, the  430  normal vectors of the two 3D fingerprints are considered to be matched. 
         [0062]    In one embodiment, a combined matching score is computed and is used for minutiae matching. In a further embodiment, the combined matching score is a weighted sum of S 2D , S 3D , S Finger Surface Codes  and S orientation . In another embodiment, the combined matching score is a dynamic combination of S 2D , S 3D , S orientation  and S Finger Surface Codes . 
         [0063]    In order to demonstrate the flexibility of the present invention, an experiment with real data is conducted. A 3D fingerprint database with  240  distinct fingers using the biometric feature system as proposed is first obtained. The light module comprises seven different LEDs which are able to generate seven different illuminations on the same finger and seven images (impressions) are acquired for each of the fingers as shown in  FIG. 5 . 
         [0064]      FIG. 6  illustrates image samples from four different fingers (014_r3_g5, 015_I3_g4, 003_I4_g5 and 021_I2_g3) and the intermediate results during preprocessing and 3D reconstruction.  FIG. 6   a  shows one of the images captured by the image capturing means for each finger.  FIGS. 6   b  and  6   c  illustrate the images after normalization and enhancement respectively.  FIGS. 6   d  and  6   e  shows the surface curvature images and the reconstructed 3D surface model. 
         [0065]    As mentioned, multiple 2D images acquired for the 3D fingerprint reconstruction can themselves be utilized for generating 2D matching scores based on the 2D minutiae. However the imaging procedure employed in the present invention requires that each of these images be acquired under different illumination. Therefore the 2D minutiae extracted from the respective images can be different and optimal matching scores are generated by matching all the available images from two fingers in template P and Q.  FIG. 7  illustrates experimental results from the usage of all 2D fingerprint images when (i) the best possible matching scores among matching all seven images from each fingers are used and when (ii) only best performing one image was used. It should be noted that the 2D matching score generated using all respective 2D fingerprint images outperforms that utilizing only the best performing image. 
         [0066]    The performances of different fingerprint matching scores as proposed in the present invention are also studied.  FIG. 8   a  illustrates matching results using 3D minutiae representation, 3D fingerprint curvature representation and also using 2D fingerprint images acquired for the 3D fingerprint reconstruction. It can be ascertained from this figure that 3D minutiae representation achieves superior results as compared to those using 3D fingerprint surface representation.  FIG. 8   b  illustrates experimental results from the combination of 2D matching score (using the images acquired during 3D fingerprint reconstruction), 3D matching score, and 3D surface-orientation matching score. It can be ascertained from this figure that the combination of 3D minutiae matching scores with the available 2D minutiae matching scores achieves superior performance This performance improvement is significant and suggests that 3D fingerprint information generated according to the present invention can be effectively used to improve performance for the contactless 2D fingerprint matching. 
         [0067]    In order to ascertain the capability of the present invention to identify the unknown clients, 20 new finger images are acquired and are employed as unknown clients. These unknown clients were then identified from the proposed method to ascertain the performance.  FIG. 9   a  shows the plot of number of unknown clients identified as unknown verses known clients rejected as unknown. These experimental results suggest superior performance from 3D minutiae representation and illustrate performance improvement with the combination of conventional 2D minutiae features. The performance from the proposed identification method for the FPIR and FNIR was also observed and is illustrated in  FIG. 9   b.  The performance improvement using the combination of 3D minutiae representation, extracted from the reconstructed 3D fingerprint images, and 2D minutiae representation is observed to be quite consistent in FPIR vs. FNIR plots. 
         [0068]    The present invention is also configured to perform recognition tasks of biometric features.  FIGS. 10   a  and  10   b  illustrate the CMC from the recognition experiments for the comparison and combination of 2D/3D fingerprint features. These results also suggest superior performance using 3D minutiae representation, over 3D curvature representation, and also illustrate improvement in average (rank-one) recognition accuracy using the combination of available minutiae features from the 2D fingerprint images acquired during the 3D fingerprint reconstruction. The superiority of finger surface code, over the surface code, can be ascertained from the experimental results in  FIG. 11   a.  Robust 3D fingerprint matching using the unit normal vector field matching and the significant performance improvement from the adaptive combination with finger surface code based 3D curvature matching can be ascertained from experimental results in  FIG. 11   b.    
         [0069]    The overall quantitative performance comparison between conventional identification and different embodiments of the present invention is shown in the following table 2: 
         [0000]    
       
         
               
             
               
               
               
               
               
               
             
               
               
               
               
               
               
             
           
               
                 TABLE 2 
               
             
             
               
                   
               
               
                 Individual and combined match performance from 2D and 3D Fingerprint Images 
               
             
          
           
               
                   
                   
                   
                   
                 2D Minutiae + 
                 2D Minutiae + 
               
               
                 Experiments 
                 2D Minutiae 
                 3D Curvature 
                 3D Minutia 
                 3D Curvature 
                 3D Minutiae 
               
               
                   
               
             
          
           
               
                 Equal Error Rate 
                 2.12% 
                 12.19% 
                 2.73% 
                 1.73% 
                 1.02% 
               
               
                 from 240 clients 
               
               
                 Equal Error Rate 
                 5.44% 
                 32.26% 
                 9.28% 
                 4.36% 
                 3.33% 
               
               
                 from 240 clients 
               
               
                 and 20 unknowns 
               
               
                 Rank-1 accuracy 
                 94.56% 
                 68.21% 
                 90.72% 
                 95.64% 
                 96.67% 
               
               
                 from 240 clients 
               
               
                 and 20 unknowns 
               
               
                   
               
             
          
         
       
     
         [0070]    It should be ascertained from table 1 that the combination of 3D minutiae matching scores with 2D minutiae matching scores achieves the best performance. It suggests that the present invention provides a more accuracy fingerprint identification means comparing to the conventional fingerprint systems. 
         [0071]    The exemplary embodiments of the present invention are thus fully described. Although the description referred to particular embodiments, it will be clear to one skilled in the art that the present invention may be practiced with variation of these specific details. Hence this invention should not be construed as limited to the embodiments set forth herein. 
         [0072]    For instance, fingerprint identification is illustrated as a specific realization of the method as proposed in the present invention. However, it should be clear that the present invention can be applied to identification of any biometric features, for instance palm print, footprint, ear biometric and lip print. 
         [0073]    Seven LEDs are used as the lighting module in the embodiment described above. It should be clear that any number of light sources may be used according to the user&#39;s preference. In another embodiment, any number of light sources with different color illuminations can be used, by separating the spectral component for respective light source in the acquired multispectral image, to simultaneously determine shading from each of the colored light source. Moreover, any types of light sources may also be used, such as light bulbs and fluorescent lamps, as long as they are able to illuminate the object with biometric feature from different illumination angles.