Source: http://patents.com/us-10019616.html
Timestamp: 2018-11-20 00:16:33
Document Index: 146480985

Matched Legal Cases: ['application No. 14887606', 'application No. 2016', 'application No. 2016', 'application No. 14887446', 'application No. 14886867', 'application No. 2014']

US Patent # 1,001,9616. Biometrics authentication device and biometrics authentication method - Patents.com
United States Patent 10,019,616
A biometrics authentication device is configured so as to include: a filter that extracts a plurality of directional features from an input image; a per-direction directional feature normalization processing unit that normalizes the plurality of directional features extracted by the filter; a non-directional feature generating unit that generates a non-directional feature on the basis of the plurality of directional features output from the per-direction directional feature normalization processing unit; a matching processing unit that determines a degree of similarity between the non-directional feature and a registered non-directional feature stored in a storing unit; and a determining unit that determines identity by using the degree of similarity.
Suzuki; Tomoharu (Inagi, JP)
Family ID: 54194187
15/265,189
US 20170004348 A1 Jan 5, 2017
PCT/JP2014/058384 Mar 25, 2014
Current CPC Class: G06K 9/00006 (20130101); G06K 9/00067 (20130101); G06K 9/00087 (20130101); G06F 21/32 (20130101); G06K 9/0008 (20130101); H04L 9/3231 (20130101); G06K 9/00114 (20130101); G06K 2009/00932 (20130101)
Field of Search: ;340/5.83 ;382/15,118,124
6282304 August 2001 Novikov
6876757 April 2005 Yau
7359555 April 2008 Porikli
7496214 February 2009 Zhang
7636455 December 2009 Keaton
7903880 March 2011 Wyatt
8077932 December 2011 Togashi
8285010 October 2012 Rowe
8358870 January 2013 Abiko
8712114 April 2014 Thaniyath
8953854 February 2015 Kumar
9280805 March 2016 Esaki
9317761 April 2016 Kong
2004/0042645 March 2004 Wang
2004/0057606 March 2004 David et al.
2005/0084155 April 2005 Yumoto et al.
2005/0281438 December 2005 Zhang et al.
2006/0020203 January 2006 Tamura
2006/0126916 June 2006 Kokumai
2006/0147096 July 2006 Lee
2007/0036400 February 2007 Watanabe
2007/0217660 September 2007 Komura et al.
2009/0245593 October 2009 Suzuki et al.
2009/0245648 October 2009 Hara
2009/0268951 October 2009 Zhang et al.
2011/0200237 August 2011 Nakamura
2012/0108973 May 2012 Osumi
2012/0194662 August 2012 Zhang et al.
2012/0201431 August 2012 Komura et al.
2013/0004028 January 2013 Jones
2013/0136327 May 2013 Kamei
2013/0251213 September 2013 Nada et al.
2014/0133711 May 2014 Abe
2014/0294251 October 2014 Jo et al.
2015/0071538 March 2015 Marchisio
2015/0261299 September 2015 Wajs
2017/0193637 July 2017 Suzuki
2000-358025 Dec 2000 JP
2006-500662 Jan 2006 JP
2006-301881 Nov 2006 JP
2007-249339 Sep 2007 JP
2009-237621 Oct 2009 JP
2009-301104 Dec 2009 JP
2012-73684 Apr 2012 JP
WO 2011/052085 May 2011 WO
WO 2012/020718 Feb 2012 WO
WO 2013/136553 Sep 2013 WO
Office action issued in U.S. Appl. No. 15/236,990, dated Aug. 10, 2017. cited by applicant .
ESSR issued in corresponding EP patent application No. 14887606.3, dated Jan. 20, 2017. cited by applicant .
Office action issued in corresponding Japanese patent application No. 2016-509684, dated Dec. 20, 2016 (with full machine translation). cited by applicant .
Office action issued in corresponding Japanese patent application No. 2016-509683, dated Dec. 20, 2016 (with full machine translation). cited by applicant .
ESSR issued in corresponding EP patent application No. 14887446.4, dated Feb. 9, 2017. cited by applicant .
Chaudhuri S. et al.; Detection of Blood Vessels in Retinal Images Using Two-Dimensional Matched Filters, IEEE Service Center, vol. 8, No. 3, Sep. 1, 1989. cited by applicant .
A1 Bovik "Handbook of Image and Video Processing (First Edition)"; May 31, 2001. cited by applicant .
Hany F. Arid et al., "Optimally Rotation-Equivariant Directional Derivative Kernels?", Sep. 10, 1997. cited by applicant .
Keiji Yamada et al., "Consideration on Stability of Gabor Feature Extraction and Character Recognition Application", vol. 92, No. 433; Jan. 21, 1993 (with partial English translation). cited by applicant .
Kijja Srimuang et al. "Detection of a Person Face and Head Pose Estimation using the Gabor wavelet.", vol. 2004, No. 119; (with partial English translation). cited by applicant .
Kazuhiro Hotta et al., "Object Detection Method Based on Maximun Cliques", vol. 2002, No. 114, p. 49-56; Nov. 29, 2002 (with partial English translation). cited by applicant .
Hiroshi Yoshimura et al, "Efficacy Evaluation of Directional Edge Component Projection Method for Caption Recognition", vol. 99, No. 649, p. 17-22; Feb. 22, 2000 (with partial English translation). cited by applicant .
Jialiang Peng et al., "Finger-vein Verification Using Gabor Filter and SIFT Feature Matching" p. 45-48; Jul. 18, 2012. cited by applicant .
Yang Wenming et al.; "Comparative competitive coding for personal identification by using finger vein and finger dorsal texture fusion" Information Sciences, vol. 268, p. 20-32; Oct. 21, 2013. cited by applicant .
Int'l. Search Report issued in Int'l. App. No. PCT/JP2014/058383, dated May 13, 2014. cited by applicant .
Int'l. Search Report issued in Int'l. App. No. PCT/JP2014/058385, dated May 13, 2014. cited by applicant .
Int'l. Search Report issued in Int'l. App. No. PCT/JP2015/059213, dated Jun. 16, 2015. cited by applicant .
Written Opinion (PCT/ISA/237) dated Jun. 16, 2015 (with partial translation). cited by applicant .
U.S. Appl. No. 15/236,990, filed Aug. 15, 2016. cited by applicant .
U.S. Appl. No. 15/266,012, filed Sep. 15, 2016. cited by applicant .
U.S. Appl. No. 15/266,067, filed Sep. 15, 2016. cited by applicant .
Int'l. Search Report issued in Int'l. App. No. PCT/JP2014/058384, dated May 13, 2014. cited by applicant .
A. Ross et al.; "A hybrid fingerprint matcher"; Pattern Recognition, vol. 36, No. 7, pp. 1661-1673; 2003. cited by applicant .
Extended EP Search Report issued in European patent application No. 14886867.2, dated Apr. 20, 2017. cited by applicant .
Office Action issued in corresponding Japanese patent application No. 2014-062775, dated May 2, 2017 (full machine translation). cited by applicant .
Wei Li et al., "Principal Line-Based Alignment Refinement for Palm Print Recognition.", vol. 42, No. 6, pp. 1491-1499; Nov. 1, 2012. cited by applicant .
Zhen-Hua Guo et al., "Palmprint recognition using Gabor magnitude code", pp. 796-801; Jul. 11, 2010. cited by applicant .
Kumar A. et al., "Personal authentication using multiple palm print representation", vol. 38, No. 10, pp. 1695-1704; Oct. 1, 2005. cited by applicant .
Office action issued in U.S. Appl. No. 15/266,012, dated Oct. 19, 2017. cited by applicant .
Office action issued in corresponding U.S. Appl. No. 15/266,067, dated Feb. 27, 2018. cited by applicant .
Office action issued in corresponding EP App. No. 14 887 606.3, dated Mar. 15, 2018. cited by applicant.
This application is continuation application of International Application PCT/JP2014/058384 filed on Mar. 25, 2014 and designated the U.S., the entire contents of which are incorporated herein by reference.
1. A biometrics authentication device comprising: a filter that extracts a plurality of directional features from an input image; a per-direction directional feature normalization processing unit that normalizes, by a computer, the plurality of directional features so as to make a luminance value that corresponds to a palm print smaller than a luminance value that corresponds to a vein; a non-directional feature generating unit that generates, by the computer, a non-directional feature on the basis of the plurality of directional features output from the per-direction directional feature normalization processing unit; a matching processing unit that determines, by the computer, a degree of similarity between the non-directional feature and a registered non-directional feature stored in a storing unit; and a determining unit that determines, by the computer, identity by using the degree of similarity.
2. A biometrics authentication method comprising: extracting, by a computer, a plurality of directional features from an input image; normalizing, by the computer, the extracted plurality of directional features so as to make a luminance value that corresponds to a palm print smaller than a luminance value that corresponds to a vein; generating, by the computer, a non-directional feature on the basis of the normalized plurality of directional features; determining, by the computer, a degree of similarity between the non-directional feature and a registered non-directional feature stored in a storing unit; and determining, by the computer, identity by using the degree of similarity.
3. A non-transitory computer-readable recording medium which records a program for causing a computer to execute a process comprising: extracting a plurality of directional features from an input image; normalizing the extracted plurality of directional features so as to make a luminance value that corresponds to a palm print smaller than a luminance value that corresponds to a vein; generating a non-directional feature on the basis of the normalized plurality of directional features; determining a degree of similarity between the non-directional feature and a registered non-directional feature stored in a storing unit; and determining identity by using the degree of similarity.
An embodiment of the present disclosure relates to a technology for biometrics authentication.
In an existing biometrics authentication device, when biological information extracted from a photographed image and registered biological information match each other, identity is determined. The biological information includes features denoting a palm print, a vein, and the like, and when biometrics authentication is performed by using the feature denoting the vein, the feature denoting the palm print needs to be separated from the photographed image such that as far as possible only the feature denoting the vein is included in the biological information. As an example of a method for separating the feature denoting the palm print, a method for optically separating the feature denoting the palm print by using a polarizing filter is known. As another example of the method, a method using plural-wavelength photographing is known.
Related Art Document: A. Ross, A. K. Jain, and J. Reisman, "A Hybrid fingerprint matcher", Pattern Recognition, vol. 36, no. 7, pp. 1661-1673, 2003.
A biometrics authentication device according to an embodiment of the present disclosure includes: a filter that extracts a plurality of directional features from an input image; a per-direction directional feature normalization processing unit that normalizes the plurality of directional features extracted by the filter; a non-directional feature generating unit that generates a non-directional feature on the basis of the plurality of directional features output from the per-direction directional feature normalization processing unit; a matching processing unit that determines a degree of similarity between the non-directional feature and a registered non-directional feature stored in a storing unit; and a determining unit that determines identity by using the degree of similarity.
Further, a biometrics authentication method according to an embodiment of the present disclosure includes: extracting, by a computer, a plurality of directional features from an input image; normalizing, by the computer, the extracted plurality of directional features; generating, by the computer, a non-directional feature on the basis of the normalized plurality of directional features; determining, by the computer, a degree of similarity between the non-directional feature and a registered non-directional feature stored in a storing unit; and determining, by the computer, identity by using the degree of similarity.
Furthermore, a non-transitory computer-readable recording medium according to an embodiment of the present disclosure which records a program causes a computer to execute a process including: extracting a plurality of directional features from an input image; normalizing the extracted plurality of directional features; generating a non-directional feature on the basis of the normalized plurality of directional features; determining a degree of similarity between the non-directional feature and a registered non-directional feature stored in a storing unit; and determining identity by using the degree of similarity.
FIG. 1 illustrates an example of a biometrics authentication device according to an embodiment of the present disclosure.
FIG. 2 is a flowchart illustrating a biometrics authentication method according to an embodiment of the present disclosure.
FIG. 3 illustrates an example of a feature extracting unit according to an embodiment of the present disclosure.
FIG. 4 illustrates an example of a matching processing unit according to an embodiment of the present disclosure.
FIG. 5 illustrates an example of hardware of a biometrics authentication device.
A biometrics authentication device 1 illustrated in FIG. 1 includes an image obtaining unit 2, a region specifying unit 3, a feature extracting unit 4, a matching processing unit 5, a score determining unit 6 (a determining unit), and a storing unit 7.
First, the image obtaining unit 2 obtains an image of a hand of a subject (S1). As an example, the image obtaining unit 2 is an imaging device, and the image obtaining unit 2 obtains a captured image of a hand of a subject by using a single-plate image sensor and respective RGB color filters of a Bayer array.
Then, the region specifying unit 3 specifies an ROI (Region Of Interest) that corresponds to a palm of the subject in the image obtained by the image obtaining unit 2 (S2).
The feature extracting unit 4 then extracts a non-directional feature from an image f of the ROI specified by the region specifying unit 3 (S3). In a case in which filtering S is performed on an image f, the term "non-directional" is defined such that it obtains a result that is almost the same as a result of performing only the filtering S even when image rotation conversion T.sub..theta. or inverse conversion T.sub..theta..sup.-1 of T.sub..theta. at various angles .theta. is inserted before the filtering S. Stated another way, the term "non-directional" is defined using symbols to be S(f)=T.sub..theta..sup.-1(S(T.sub..theta.(f))) at an arbitrary angle .theta..
The matching processing unit 5 determines a degree of similarity between the non-directional feature extracted by the feature extracting unit 4 and a registered non-directional feature that has been registered in advance and that has been stored in the storing unit 7 (S4).
The score determining unit 6 determines the identity of the subject according to the degree of similarity determined by the matching processing unit 5 (S5).
FIG. 3 illustrates an example of the feature extracting unit 4 according to the embodiment of the present disclosure.
The feature extracting unit 4 illustrated in FIG. 3 includes a filter 41, a per-direction directional feature normalization processing unit 42, a point-wise maximum selecting unit 43, a binarizing unit 44, and a skeletonizing unit 45.
The filter 41 performs Gabor filtering on an input image f of the ROI in eight respective directions .theta. (0.degree., 22.5.degree., 45.degree., 67.5.degree., 90.degree., 112.5.degree., 135.degree., and 157.5.degree.) so as to obtain respective filter responses (luminance values) as directional features g.sub..theta. (a directional feature g.sub..theta..degree., a directional feature g.sub.22.5.degree., a directional feature g.sub.45.degree., a directional feature g.sub.67.5.degree., a directional feature g.sub.90.degree., a directional feature g.sub.112.5.degree., a directional feature g.sub.135.degree., and a directional feature g.sub.157.5.degree.). The number of directions .theta. set in the filtering is not limited to eight, and may be any number that is greater than or equal to two. The filtering is not limited to Gabor filtering, and may be any type of filtering that has a high filter response to a linear dark portion in respective directions .theta. in the image f.
The per-direction directional feature normalization processing unit 42 normalizes the respective directional features go extracted from the filter 41.
The point-wise maximum selecting unit 43 generates a non-directional feature g on the basis of the respective directional features go output from the per-direction directional feature normalization processing unit 42. As an example, the point-wise maximum selecting unit 43 outputs a maximum directional feature max.sub..theta.{g.sub..theta.(i,j)} as a non-directional feature g(i,j) from among the respective directional features g.sub..theta.(i,j) output from the per-direction directional feature normalization processing unit 42, as expressed by Expression 1. The i represents a position in a horizontal-axis direction of two-dimensional coordinates, and the j represents a position in a vertical-axis direction of the two-dimensional coordinates, when positions of respective pixels within the ROI are made to correspond to positions on the two-dimensional coordinates. g(i,j):=max.sub..theta.{g.sub..theta.(i,j)},(i,j) ROI Expression 1
The binarizing unit 44 outputs 1 as a non-directional plane feature b(i,j) when the non-directional feature g(i,j) output from the point-wise maximum selecting unit 43 has a positive value, and the binarizing unit 44 outputs 0 as the non-directional plane feature b(i,j) when the non-directional feature g(i,j) has a value that is not a positive value, as expressed by Expression 2. The obtained non-directional plane feature b is stored in the storing unit 7.
.function..times..times..function.>.times..times. ##EQU00001##
In the description above, the binarizing unit 44 has performed binarization by performing simple thresholding using a constant of 0, but the binarizing unit 44 may perform binarization using a more advanced Adaptive-thresholding scheme.
The skeletonizing unit 45 performs skeletonizing on the non-directional plane feature b so as to obtain a non-directional line feature LF, as expressed by Expression 3. The skel represents skeletonizing. The obtained non-directional line feature LF is stored in the storing unit 7. The line feature is a linear image. LF:=skel(b) Expression 3
The matching processing unit 5 illustrated in FIG. determines a degree of similarity score between the non-directional line feature LF that has been output from the skeletonizing unit 45 and that has been stored in the storing unit 7 and a registered non-directional line feature TLF that has been registered in advance and that has been stored in the storing unit 7, as expressed by Expression 4.
The score determining unit 6 illustrated in FIG. 1 determines the identity of the subject when the degree of similarity score is greater than or equal to a threshold.
A luminance value that corresponds to a palm print is likely to be greater than a luminance value that corresponds to a vein. Accordingly, when the respective directional features g.sub..theta. extracted from the filter 41 are normalized, the luminance value that corresponds to the palm print is smaller than the luminance value that corresponds to the vein in the respective directional features g.sub..theta.. As a result, a non-directional line feature LF generated by using the respective normalized directional features g.sub..theta. is a non-directional line feature on which an influence of the palm print has been suppressed. This allows the identity of a subject to be determined in a state in which an influence of the palm print has been suppressed, and consequently authentication accuracy can be improved. Stated another way, the biometrics authentication device 1 according to the embodiment of the present disclosure can prevent the FAR from increasing even when a method for physically separating a feature denoting the palm print from an image fails to be applied. Further, even when melanin is abnormally deposited, in particular, in a palm of a subject, and the palm print is included in a large portion of a directional feature g.sub..theta., the identity of the subject can be determined in a state in which an influence of the palm print on the non-directional line feature LF has been suppressed, and consequently the FAR can be reduced.
Further, when the respective directional features g.sub..theta. extracted from the filter 41 are normalized, the luminance value that corresponds to the vein is greater than the luminance value that corresponds to the palm print in the respective directional features g.sub..theta.. Accordingly, a non-directional line feature LF generated by using the respective normalized directional features g.sub..theta. is a non-directional line feature in which the vein has been emphasized. Consequently, the identity of the subject can be determined in a state in which a vein that has a higher level of diversity than the palm print has been emphasized, and therefore the FAR can be reduced.
FIG. 5 illustrates an example of hardware that configures the biometrics authentication device 1 according to the embodiment of the present disclosure.
As illustrated in FIG. 5, hardware that configures the biometrics authentication device 1 includes a control unit 1201, a storing unit 1202, a recording medium reading device 1203, an input/output interface 1204, and a communication interface 1205, and these components are mutually connected via a bus 1206. The hardware that configures the biometrics authentication device 1 may be implemented by using a cloud or the like.
As an example, a Central Processing Unit (CPU), a multicore CPU, or a programmable device (a Field Programmable Gate Array (FPGA), a Programmable Logic Device (PLD) or the like) can be considered to be used as the control unit 1201. The control unit 1201 corresponds to the region specifying unit 3, the feature extracting unit 4, the matching processing unit 5, and the score determining unit 6 illustrated in FIG. 1.
The storing unit 1202 corresponds to the storing unit 7 illustrated in FIG. 1, and examples of the storing unit 1202 include a memory such as a Read Only Memory (ROM) or a Random Access Memory (RAM), and a hard disk. The storing unit 1202 may be used as a work area at the time of execution. In addition, another storing unit may be provided outside the biometrics authentication device 1.
The recording medium reading device 1203 is controlled by the control unit 1201 so as to read data recorded in a recording medium 1207 or to write data to the recording medium 1207. The recording medium 1207 that is removable is a non-transitory computer-readable recording medium, and examples of the recording medium 1207 include a magnetic recording device, an optical disk, a magneto-optical recording medium, and a semiconductor memory. Examples of the magnetic recording device include a hard disk drive (HDD). Examples of the optical disk include a Digital Versatile Disc (DVD), a DVD-RAM, a Compact Disc Read Only Memory (CD-ROM), and a CD-R (Recordable)/RW (ReWritable). Examples of the magneto-optical recording medium include a Magneto-Optical disk (MO). Note that the storing unit 1202 is also included in the non-transitory recording medium.
The input/output interface 1204 is connected to an input/output unit 1208, and the input/output interface 1204 transmits information input by a user via the input/output unit 1208 to the control unit 1201 via the bus 1206. The input/output interface 1204 also transmits information transmitted from the control unit 1201 to the input/output unit 1208 via the bus 1206.
The input/output unit 1208 corresponds to the image obtaining unit 2 illustrated in FIG. 1, and examples of the input/output unit 1208 include an imaging device. Examples of the input/output unit 1208 also include a keyboard, a pointing device (for example, a mouse), a touch panel, a Cathode Ray Tube (CRT) display, and a printer.
The communication interface 1205 is an interface for performing Local Area Network (LAN) connection or Internet connection. The communication interface 1205 may be used as an interface for performing LAN connection, Internet connection, or wireless connection with another computer, as needed.
By using a computer having the hardware above, various processing functions performed by the biometrics authentication device 1 are implemented. In this case, a computer executes a program describing the content of the various processing functions performed by the biometrics authentication device 1 such that the above various processing functions (for example, the region specifying unit 3, the feature extracting unit 4, the matching processing unit 5, and the score determining unit 6) are implemented on the computer. The program describing the content of the various processing functions can be stored in the storing unit 1202 or the recording medium 1207.
In a case in which a program is distributed, the recording medium 1207 recording the program, such as a DVD or a CD-ROM, is sold separately, for example. The program can be recorded in a storage of a server computer, and the program can be transferred from the server computer to another computer via a network.
The computer that executes a program stores, for example, the program recorded in the recording medium 1207 or the program transferred from the server computer in the storing unit 1202. The computer reads the program from the storing unit 1202, and performs processing according to the program. The computer may directly read a program from the recording medium 1207, and may perform processing according to the program. Further, every time a program is transferred from the server computer, the computer may perform processing according to the received program.
In the embodiment of the present disclosure, an image processing device that performs authentication using a vein of a palm has been described as an example, but the embodiment is not limited to this, and any other feature detection region of a living body may be used.
As an example, the other feature detection region of the living body is not limited to a vein, and may be a vascular image of a living body, a pattern of a living body, a fingerprint or a palm print of a living body, the sole of the foot, a finger or toe, the back of the hand or the instep of the foot, the wrist, the arm, or the like.
When a vein is used for authentication, the other feature detection region of a living body may be any region in which the vein can be observed.
The existence of an other feature detection region of a living body in which biological information can be specified is advantageous to authentication. As an example, when a palm, a face or the like is used, a region can be specified from an obtained image. In addition, various modifications to the embodiment above can be made without departing from the gist of the embodiment. Further, multiple variations or modifications to the embodiment above can be made by those skilled in the art, and the embodiment is not limited to the exact configuration and applications described above.
According to the embodiment of the present disclosure, even when a method for physically separating a feature denoting a palm print from an image fails to be applied, an FAR can be prevented from increasing.
Previous Patent US 10,019,615 | Next Patent US 10,019,617