Patent Description:
In recent years, biometric authentication technology has been used in various situations such as entry and exit management, settlement, and banking transactions. The biometric authentication technology utilizes a technique of collating biometric information acquired from a part of the user's body or user's behavior with registered biometric information.

<CIT> discloses a system in which, when the reading quality during the authentication process is less than a predetermined level of quality, image processing to improve the quality of a read image that is not performed during the registration process is performed to improve the image quality, thus making the biometric authentication successful. Software to improve the image quality is added by upgrading the version of the authentication software to successively add image improvement software to the authentication software irrespective of the registration process.

An example of a system using a biometric authentication technology is described in <CIT>. When the user inputs a correct password, the IC card described in Patent Document <NUM> displays a correct fingerprint input order. Further, when the user inputs an incorrect password, the IC card displays an erroneous fingerprint input order. In a case where the fingerprint input by the user and the input order are correct, a control apparatus inserted with the IC card operates a key opening and closing apparatus.

Meanwhile, it takes a certain period of time to acquire and collate biometric data used in the biometric authentication technology. In particular, it tends to take a lot of time to acquire high-resolution biometric data and collate biometric data under high security. Then, the time is increased during which the user terminal executing the authentication process may receive erroneous operation from the user, thus increasing the possibility of the authentication process not being performed normally due to an unintended operation caused by erroneous operation.

However, in the above-described systems, there is a problem that it is impossible to prevent erroneous operation by the user, occurring during the authentication process in the biometric data processing apparatus which is the user terminal. We have appreciated that it would be desirable to provide a biometric data processing apparatus that solves the problem of not being able to prevent erroneous operation by the user occurring during the authentication process in the biometric data processing apparatus.

In <CIT>, in Jing, "Anti-Spoofing System for RFID Access Control combining with Face Recognition", IEEE ICMLC, <NUM>, XP31759655 and in Frischholz, "Avoiding replay-attacks in a face recognition system using head-pose estimation", IEEE AFMG, <NUM>, XP010664370, interactive techniques with biometric quality control have been proposed. However the users knows in advance which kind of biometric will be asked which still gives an advantage to impersonators.

The invention is defined by the independent claims to which reference is now made. Advantageous features are set forth by the dependent claims.

It should be noted that any combination of the above constituent elements and converted forms expressing the present invention among a method, an apparatus, a system, a recording medium, a computer program, and the like are also effective as aspects of the present invention.

Further, the various constituent elements of the present invention do not necessarily have to exist individually and independently, a plurality of constituent elements may be formed as a single member, one component may be formed by a plurality of members, a certain constituent element is a part of another constituent element, and a part of a certain constituent element may overlap with a part of another constituent element, within the scope defined by the independent claims.

Further, although a plurality of procedures are described in order in the method and the computer program of the present invention, the order of description does not limit the order of executing a plurality of procedures. Therefore, when implementing the method and the computer program of the present invention, the order of the plurality of procedures can be changed within a range that does not interfere with the contents, as long as it follows the order set forth in the independent claims.

Furthermore, the plurality of procedures of the method and the computer program of the present invention are not limited to being executed individually at different timings. Therefore, another procedure may occur during the execution of a certain procedure, some or all of the execution timing of a certain procedure overlaps with the execution timing of another procedure, or the like, within the scope defined by the independent claims.

According to the present invention, it is possible to provide a biometric data processing system that prevents an erroneous operation of a user occurring during an authentication process in the biometric data processing system and better protects against impersonation attempts.

The foregoing and other objects, features and advantages will become more apparent from the following description of preferred example embodiments and the accompanying drawings.

Hereinafter, example embodiments of the present invention will be described in detail with reference to the drawings. However, constituent elements described in the following example embodiments are examples, and the scope of the invention is defined by the independent claims.

In the example embodiments of the present specification, it is assumed that a user sends money to a specific party through Internet banking which is a banking service through the Internet. Using a user terminal, the user accesses a system implementing Internet banking and receives a remittance service from the bank. Hereinafter, the system implementing Internet banking is called a bank system. In order to prevent unauthorized remittance, the banking system needs to authenticate that the user trying to receive the banking service is the same person as the previously registered person. In the example embodiments of the present specification, it is assumed that the user is authenticated using biometric data. A user terminal operated by the user is hereinafter referred to as a biometric data processing apparatus.

The biometric data is data representing a biometric feature or a behavioral feature of a human being, and may be fingerprint image data, vein image data, face image data, iris image data, voice data, or the like.

In addition, in the example embodiments of the present specification, a server which is one of apparatuses implementing a bank system will also be described. The server stores customer's bank data, deposit balance, or the like. The server provides a banking service based on information transmitted from the biometric data processing apparatus.

Note that, the usage scene of the present invention is not limited to the banking service. For example, the present invention may be used in the scene of user authentication in mail order, entry and exit management, credit card settlement or the like.

The configuration example of a first example embodiment will be described. <FIG> is a diagram showing a configuration example of the first example embodiment. A biometric data processing apparatus <NUM> includes a control unit <NUM>, a determination unit <NUM>, an authentication unit <NUM>, a display unit <NUM>, a reception unit <NUM>, a transmission unit <NUM>, a storage unit <NUM>, an imaging unit <NUM>, a detection unit <NUM>, an acquisition unit <NUM>, and an input unit <NUM>.

The control unit <NUM> causes the display unit <NUM> to display a message requesting a user to perform a predetermined action. The predetermined action may be any action as long as it is a movement of the user that can be detected by the detection unit <NUM>. For example, if the detection unit <NUM> is a touch panel, the predetermined action may be a user's action of touching the touch panel, a user's action of tracing the touch panel in the form of a specific character, or the like. For example, if the detection unit <NUM> is a microphone, it may be a user's action of emitting sound. The control unit <NUM> may cause the display unit <NUM> to display illustrations, photographs, or the like showing a predetermined action to the user. The control unit <NUM> may acquire image data such as messages, and illustrations, from the storage unit <NUM>.

Further, in response to the input process performed by the user through the input unit <NUM>, the control unit <NUM> causes the display unit <NUM> to display a message requesting an input of biometric data having a predetermined feature. The predetermined feature may be any feature as long as it is a feature possessed by the biometric data. The predetermined feature may be, for example, a feature of an eye when the user looks in a specific direction, a feature of a voice when the user speaks a specific word, a feature of a fingerprint of a specific finger among ten fingers, and the like. Further, it is preferable that the predetermined feature is such that the user can input the biometric data having the feature with his own intention. For example, the user can input the feature of the eyes when looking in a specific direction by moving his eyes with his own intention. In addition, the user can input the feature of the voice when speaking a specific word by speaking the word with his own intention.

The control unit <NUM> may cause the display unit <NUM> to display illustrations or photographs showing how to input biometric data having a predetermined feature to the user. The control unit <NUM> may acquire image data such as messages and illustrations from the storage unit <NUM>.

Further, in a case where the biometric data of the user is determined to have the predetermined quality, the control unit <NUM> causes the display unit <NUM> to display a progress status of the whole authentication process. The whole authentication process means an entire process from acquisition of biometric data to completion of authentication of a user. The whole authentication process includes a process of acquiring biometric data of a user and a process of collating biometric data. The process of collating biometric data is a process of collating the biometric data of a user with the previously registered biometric data.

The display unit <NUM> displays a message requesting a user to perform a predetermined action. The display unit <NUM> may display illustrations, photographs, or the like showing a predetermined action to the user. Further, the display unit <NUM> displays a message requesting an input of biometric data having a predetermined feature. The display unit <NUM> may display illustrations or photographs showing how to input biometric data having a predetermined feature to the user.

The determination unit <NUM> determines whether or not biometric data of the user has a predetermined quality. The predetermined quality as referred to herein means a quality suitable for collation of biometric data with other biometric data. Further, the predetermined quality may vary depending on the type of biometric data. For example, in a case where the biometric data is image data, the quality may be whether or not the luminance or color of the image data and the shape of a living body is detected, or the like. The detection of the shape of a living body may be achieved by pattern recognition or the like. Further, in a case where the biometric data is voice data, the quality may be sound volume, S/N ratio, or the like. The predetermined quality may be a range in which the above-described luminance, color, volume, and S/N ratio are preferable for collation.

For example, it is assumed that the predetermined quality is represented by the average value of the luminance of the entire image data. In a case where the average value of the luminance of the entire face image data as biometric data is higher than the predetermined quality, the image data is in a state of being too bright. Image data is in a state of being too bright in a case where light emitted by the subject itself or light hitting the subject is strong. The image data in the state of being too bright may have a part of the face not photographed or photographed but missing a part. Thus, there is a possibility that feature value data based on the part of the face cannot be appropriately extracted from the image data whose luminance is higher than the predetermined value. The determination unit <NUM> can determine that the biometric data is not of a predetermined quality with respect to such an image, and can prevent such an image from being used for the collating process.

Further, the determination unit <NUM> may collate the feature extracted from the biometric data with the predetermined feature. More specifically, the determination unit <NUM> first extracts feature value data from biometric data. Extraction of the feature value data may be achieved by a method such as Scale-Invariant Feature Transform (SIFT) or Histograms of Oriented Gradients (HOG). Then, the determination unit <NUM> acquires feature value data indicating a predetermined feature, and collates the feature value data with feature value data indicating the predetermined feature. The acquisition unit <NUM> may acquire feature value data indicating a predetermined feature from the storage unit <NUM>. The determination unit <NUM> may determine whether or not the score calculated by collating the feature value data extracted from the biometric data with the feature value data indicating a predetermined feature is equal to or more than a predetermined threshold value.

The detection unit <NUM> detects a predetermined action of the user. For example, in a case where the detection unit <NUM> is a capacitance touch panel and a predetermined action is touching the touch panel, the detection unit <NUM> may detect the user's touch on the touch panel as a change in the amount of charge.

Further, the predetermined action may be a gesture, and the detection unit <NUM> may be a processor. For example, in a case where the action is a gesture of "raising the left hand", the detection unit <NUM> first detects the left hand of the user from the image data generated by the imaging unit <NUM>. Detection of the left hand of the user may be achieved by pattern matching. The detection unit <NUM> may track the movement of the detected left hand, and detect the upward movement of the left hand, that is, the user's action of "raising the left hand".

In a case where a collation score (referred to as a first score) of the biometric data of the user and the previously-registered biometric data is equal to or more than a predetermined threshold value and the detection unit <NUM> continuously detects the predetermined action and a collation score (referred to as a second score) of a feature extracted from the biometric data and a predetermined feature is equal to or more than a predetermined threshold value, the authentication unit <NUM> determines that the authentication of the user is successful. Hereinafter, the authentication unit <NUM> will be specifically described.

The authentication unit <NUM> acquires data indicating whether or not the first score calculated by collating the biometric data of the user and the previously registered biometric data is equal to or more than a predetermined threshold value. The authentication unit <NUM> may acquire data indicating whether or not the second score calculated by collating the biometric data of the user and the previously registered biometric data is equal to or more than a predetermined threshold value, from the collation unit <NUM> in the server <NUM>.

Further, the authentication unit <NUM> determines whether the detection unit <NUM> continuously detects the predetermined action from when the detection unit <NUM> first detects a predetermined action after the message is displayed until the authentication process in the biometric data processing apparatus <NUM> is ended. For example, after the display unit <NUM> displays a message requesting the user to perform a predetermined action, the authentication unit <NUM> acquires information indicating that a predetermined action of the user is detected, from the detection unit <NUM>. In a case where the user continuously performs a predetermined action, the detection unit <NUM> continuously detects the predetermined action of the user.

Here, it is assumed that a predetermined action is touching the touch panel. For example, in a case where the detection unit <NUM> is a capacitance touch panel, the detection unit <NUM> detects a predetermined action of the user by a change in the amount of charge. By acquiring the amount of charge detected by the detection unit <NUM>, the authentication unit <NUM> can determine whether or not the user is performing a predetermined action and is continuing the action. For example, the authentication unit <NUM> determines whether or not the amount of charge after change is continuously detected from when the amount of charge detected by the detection unit <NUM> first changes, after the display unit <NUM> displays a message requesting a predetermined action until the authentication process in the biometric data processing apparatus <NUM> is ended. In such a case, the authentication unit <NUM> determines that the detection unit <NUM> continuously detects the predetermined action.

On the other hand, when the user stops touching the touch panel after touching the touch panel, the amount of charge detected by the detection unit <NUM> returns to the value before the change. Therefore, in a case where the detected amount of charge becomes the value before the change before completion of the authentication process in the biometric data processing apparatus <NUM>, the authentication unit <NUM> determines that the detection unit <NUM> did not continuously detect the predetermined action.

Here, the authentication process in the biometric data processing apparatus <NUM> refers to the process performed by the biometric data processing apparatus <NUM> out of the whole authentication process. For example, in a case where the biometric data processing apparatus <NUM> performs a process of acquiring biometric data of a user and the server <NUM> performs a process of collating biometric data, the authentication process in the biometric data processing apparatus <NUM> is a process of acquiring the biometric data of the user.

The authentication unit <NUM> acquires data indicating whether or not the first score calculated by collating the feature extracted from the biometric data and the predetermined feature is equal to or more than a predetermined threshold value. The authentication unit <NUM> may acquire from the determination unit <NUM>, data indicating whether or not the first score calculated by collating the feature extracted from the biometric data and the predetermined feature is equal to or more than a predetermined threshold value.

The authentication unit <NUM> acquires, for example, data indicating a collation score (a first score) of the biometric data being equal to or more than a predetermined threshold value, and data indicating a collation score (a second score) of a feature extracted from the biometric data and a predetermined feature being equal to or more than a predetermined threshold value and the detection unit <NUM> has been determined to have continuously detected the predetermined action, the authentication unit <NUM> determines that the authentication of the user is successful.

Note that, the authentication unit <NUM> may determine whether or not predetermined information has been continuously acquired from when predetermined information is acquired from the detection unit <NUM> after the message is displayed until the authentication process in the biometric data processing apparatus <NUM> is ended. For example, in a case where the detection unit <NUM> is a capacitance touch panel, the authentication unit <NUM> may determine whether or not the information indicating the amount of charge when a person touches the detection unit <NUM> has been continuously acquired from the detection unit <NUM>.

The acquisition unit <NUM> acquires information on a service to be received by the user from the input unit <NUM>. The service may be any service as long as it is a service, a waiting, a civil service or the like that a user receives. For example, the service may be a banking service mediating financial transactions, a mail order service mediating product trading through the Internet, a settlement service using a credit card, or the like. For example, in a case where the service to be received by the user is a remittance service in the banking service, the information on the service to be received by the user may be the user identification (ID), the user's account number, the branch name of the user's account, the user's password, the user's name, and the like. In addition, the information on the service to be received by the user may be the account number of the remittee, the branch name of the account of the remittee, the name of the payee, the remittance amount, and the like.

The input unit <NUM> receives information on the service to be received by the user based on an input process by the user. The input process by the user means a process in which the user operates the input unit <NUM> and inputs information.

The imaging unit <NUM> converts a light image into an electric signal to generate image data. The image data generated by the imaging unit <NUM> may be face image data, fingerprint image data, vein image data, iris image data, and the like of the user.

The storage unit <NUM> stores messages displayed on the display unit <NUM> and various data. The storage unit <NUM> may store illustrations, photographs, and the like showing the predetermined action to the user as image data. In addition, the storage unit <NUM> may store illustrations, photographs, and the like showing how to input biometric data having a predetermined feature to the user as image data. Further, the storage unit <NUM> may store feature value data indicating a predetermined feature. The storage unit <NUM> may store feature value data indicating a predetermined feature in association with a message requesting an input of biometric data having a predetermined feature.

The reception unit <NUM> receives data transmitted from the server <NUM> and other apparatuses. The transmission unit <NUM> transmits data to the server <NUM> and other apparatuses.

The server <NUM> includes a collation unit <NUM>, a storage unit <NUM>, a reception unit <NUM>, a transmission unit <NUM>, and a control unit <NUM>. The server <NUM> may be connected to the biometric data processing apparatus <NUM> through the Internet. The server <NUM> may be directly connected to the biometric data processing apparatus <NUM> wirelessly or through a wired line.

The collation unit <NUM> collates biometric data of the user with biometric data previously stored in the storage unit <NUM>. Then, the second score calculated by collation is compared with a predetermined threshold value. In a case where the second score calculated by the collation is equal to or more than the predetermined threshold value, the collation unit <NUM> transmits the data indicating to that effect to the biometric data processing apparatus <NUM> through the transmission unit <NUM>. Even in a case where the second score calculated by the collation is less than the predetermined threshold value, the collation unit <NUM> may transmit the data indicating to that effect to the biometric data processing apparatus <NUM> through the transmission unit <NUM>.

The storage unit <NUM> stores the biometric data of the customers (users) of the bank. The storage unit <NUM> may store personal information such as the user's name, address, date of birth, sex, and My Number (personal number). Further, the storage unit <NUM> may store information required for users to receive banking services, such as the user's account number, deposit balance, remittance upper limit amount, and password.

In a case where the authentication of the user is successful, the control unit <NUM> provides the user with the service. For example, the control unit <NUM> executes a remittance process of money from the user's account to the account specified by the user.

The reception unit <NUM> receives data transmitted from the biometric data processing apparatus <NUM> and other apparatuses. The transmission unit <NUM> transmits data to the biometric data processing apparatus <NUM> and other apparatuses.

Next, the operations of the biometric data processing apparatus <NUM> and the server <NUM> will be described using specific examples. In the present example embodiment, the biometric data processing apparatus <NUM> is described as being a smartphone. Further, in the present example embodiment, it is described that the display unit <NUM> is a display of a smartphone, and the input unit <NUM> and the detection unit <NUM> are a touch panel which is a part of the display. <FIG> is a sequence diagram showing an example of operations of the biometric data processing apparatus <NUM> and the server <NUM>.

For example, the user first activates a predetermined application previously downloaded in the biometric data processing apparatus <NUM>. Then, the user inputs information on the service to be received by the user to the biometric data processing apparatus <NUM> through the input unit <NUM>. Specifically, the user inputs information for the bank system to identify an individual through the touch panel as information on the service. Information for identifying an individual may be, for example, a user ID, a user's name, a password, an email address, or the like. In the present example embodiment, the user inputs the user ID. Subsequently, the user inputs the service he wishes to receive. For example, the user inputs a "remittance" service on the touch panel. Then, the user inputs information on the remittee to the biometric data processing apparatus <NUM>.

The acquisition unit <NUM> acquires information on a service to be received by the user from the input unit <NUM> (S1). For example, the acquisition unit <NUM> acquires information indicating the position on the touch panel touched by the user's finger from the input unit <NUM>, and converts the information input by the user into computer-compatible character data or the like. In the above example, the acquisition unit <NUM> acquires from the input unit <NUM> the user ID input by the user, the "remittance" service, and the information on a remittee.

The control unit <NUM> may cause the display unit <NUM> to display information on the service to be received by the user, which is acquired by the acquisition unit <NUM>. Thus, the user viewing the display unit <NUM> can determine whether his input is correct.

An example of an input process by a user is illustrated in <FIG>. In <FIG>, the display unit <NUM> displays information on a remittance destination input by the user. The imaging unit <NUM> is a camera built in the smartphone and is provided at a position allowing to image the face of the user viewing the display of the smartphone.

<FIG> shows that the user has inputted the information of the bank name "Nichiden Bank", the branch name "Mita branch", the type "savings account", the account number "<NUM>", and the recipient "Hanako Nichiden" to the biometric data processing apparatus <NUM>. The user may input such information by touching the touch panel which is the input unit <NUM> with a finger. Further, the display unit <NUM> displays a message "Please confirm the remittee. Upon confirmation please touch the "next" button. ", prompting the user to check the information that the user has inputted. The user viewing the display unit <NUM> confirms that the information the user has inputted is correct and touches a portion on the display unit <NUM> where "next" is displayed.

The control unit <NUM> causes the display unit <NUM> to display a message requesting a user to perform a predetermined action (S2). A display example of a message by the display unit <NUM> is illustrated in <FIG>. In <FIG>, a message "Please touch "execute authentication" button below and do not release your finger until authentication process in this apparatus is completed. " is displayed on the display unit <NUM>. That is, the predetermined action required of the user is an action to touch the "execute authentication" button. The user viewing the display unit <NUM> touches a portion on the display unit <NUM> on which "execute authentication" is displayed and keeps the finger in place.

The detection unit <NUM> detects a predetermined action of the user. In the above example, the detection unit <NUM>, which is a touch panel, detects that the user is touching a portion of the display unit <NUM> on which "execute authentication" is displayed.

In a case where the detection unit <NUM> detects a predetermined action by the user, the control unit <NUM> causes the display unit <NUM> to display a message requesting an input of biometric data having a predetermined feature (S3). An example of a display by the display unit <NUM> is illustrated in <FIG>. In <FIG>, a message "Please look to the right without moving the position of your face. " is displayed on the display unit <NUM>. That is, the display unit <NUM> displays a message requesting an input of biometric data having a feature when the face is directed to the front and the eyes are looking to the right. Further, the display unit <NUM> displays a message "Please keep your finger in place. " requesting the user to continue the action of touching the "execute authentication" button. Further, the display unit <NUM> displays an illustration of a person looking to the right, which is an illustration showing how to input biometric data having a predetermined feature.

In a case where the detection unit <NUM> does not detect a predetermined action of the user within a predetermined time, the acquisition unit <NUM> may acquire information on the service to be received again by the user from the input unit <NUM>. At this time, the control unit <NUM> may cause the display unit <NUM> to display a message requesting re-inputting of the remittee. Alternatively, in a case where the detection unit <NUM> does not detect a predetermined action of the user within a predetermined time, the authentication unit <NUM> may determine that the authentication of the user has failed. At this time, the control unit <NUM> may cause the display unit <NUM> to display a message indicating that authentication has failed.

The user viewing the display on the display unit <NUM> shown in <FIG> looks at the right without moving the position of the face. The imaging unit <NUM> captures the face of the user looking to the right and generates face image data of the user. The imaging unit <NUM> may continuously generate face image data of the user, after the display unit <NUM> displays a message requesting an input of biometric data having a predetermined feature. Alternatively, the imaging unit <NUM> may generate face image data of the user, for example, when it is detected that the user has touched a physical button or a buttons displayed by the display unit <NUM>.

The determination unit <NUM> determines whether or not the biometric data of the user has a predetermined quality (S4). For example, the determination unit <NUM> determines whether or not the average value of the luminance of the entire face image data generated by the imaging unit <NUM> is within a predetermined range.

In a case where the determination unit <NUM> determines that the biometric data of the user has a predetermined quality, the control unit <NUM> causes the display unit <NUM> to display a progress status of the whole authentication process (S5). In the present example embodiment, it is assumed that the whole authentication process includes the processes of S1 to S9 shown in <FIG>.

An example of a display by the display unit <NUM> is illustrated in <FIG>. The display unit <NUM> shown in <FIG> displays messages "Authenticating. " and "Please do not release your finger. " In addition, the display unit <NUM> displays the progress status of the whole authentication process by displaying a rectangle. In the rectangle, a proportion occupied by a dark colored part and a proportion occupied by a light colored part are respectively displayed on the display unit <NUM> as a completed process and an incomplete process. The proportions occupied by respective processes in the rectangle displayed may be equal to each other. That is, every time a process is completed, the proportion occupied by the dark colored part in the rectangle may increase by one-ninth.

In S5, the process of S1 to S5 has already been completed, but the process of S6 to S9 is not completed. Thus, the proportion occupied by the dark colored part in the rectangle displayed by the display unit <NUM> is <NUM>/<NUM>.

In a case where the determination unit <NUM> determines that the biometric data of the user is not of a predetermined quality, the imaging unit <NUM> may recapture the face of the user and generate face image data. At this time, the control unit <NUM> may cause the display unit <NUM> to display a message requesting recapturing of the face. Further, the control unit <NUM> may cause the display unit <NUM> to display a message requesting improvement of the imaging environment so as to improve the quality of the face image data.

<FIG> shows an example of a display by the display unit <NUM> in a case where the average value of the luminance of the entire face image data is determined to be higher than the predetermined range, that is, when the luminance of the face image data is too high. The display unit <NUM> shown in <FIG> displays the message "The image is too bright. Please move to a less-lit area and touch the "Retry" button. " The user who reads the message moves to a place with less illumination or direct sunlight, for example, and touches the "retry" button portion on the display unit <NUM>. Thus, it is expected that the luminance of the regenerated face image data by the imaging unit <NUM> is lower than the luminance of the face image data generated earlier.

Alternatively, in a case where the biometric data of the user is determined not to have the predetermined quality, the authentication unit <NUM> may determine that the authentication of the user has failed. At this time, the control unit <NUM> may cause the display unit <NUM> to display a message indicating that authentication has failed.

Returning to the sequence diagram of <FIG>, the determination unit <NUM> collates the feature extracted from the biometric data with a predetermined feature (S6). Then, the determination unit <NUM> determines whether or not the first score calculated by the collation is equal to or more than the predetermined threshold value. For example, the determination unit <NUM> may acquire feature value data corresponding to the predetermined feature displayed by the display unit <NUM> from the storage unit <NUM>. That is, the determination unit <NUM> may acquire the feature value data corresponding to a message "Please look to the right without moving the position of the face. " from the storage unit <NUM>.

Further, the determination unit <NUM> may extract feature value data from the face image data generated by the imaging unit <NUM>. Extraction of the feature value data may be realized by a method such as Scale-Invariant Feature Transform (SIFT) or Histograms of Oriented Gradients (HOG). Then, the determination unit <NUM> may collate the feature value data acquired from the storage unit <NUM> with the feature value data extracted from the facial image data to calculate a second score. Further, the determination unit <NUM> may determine whether or not the first score calculated by the collation of both pieces of the feature value data is equal to or more than the predetermined threshold value.

Here, an example of data stored in the storage unit <NUM> is shown in <FIG>. As illustrated in <FIG>, the storage unit <NUM> may store feature value data in association with a message requesting an input of biometric data having a predetermined feature. In <FIG>, A message "Please look to the right without moving the position of the face. " is associated with feature value data "feature value data A" of an image of a person's eyes when looking to the right. A message "Please look to the left without moving the position of the face. " is associated with feature value data "feature value data B" of an image of a person's eyes when looking to the left. A message "Please look up without moving the position of the face. " is associated with feature value data "feature value data C" of an image of a person's eyes when looking up. A message "Please look down without moving the position of the face. " is associated with feature value data "feature value data D" of an image of a person's eyes when looking down.

The feature value data stored in the storage unit <NUM> may be generated by performing a statistical process on the feature value data extracted from a large number of image data obtained by capturing the person's eyes. That is, the feature value data stored in the storage unit <NUM> may be an object generated by learning feature value data indicating a predetermined feature.

In a case where the first score calculated by collating the feature value data acquired from the storage unit <NUM> with the feature value data extracted from the face image data is equal to or more than the predetermined threshold value, the authentication unit <NUM> determines whether or not the detection unit <NUM> continuously detects the predetermined action (S7). More specifically, the authentication unit <NUM> determines whether the detection unit <NUM> continuously detects the predetermined action from when the detection unit <NUM> first detects a predetermined action after the message requesting a predetermined action is displayed until the authentication process in the biometric data processing apparatus <NUM> is ended.

Here, the authentication process in the biometric data processing apparatus <NUM> according to the present example embodiment is the process of S1 to S6 shown in <FIG>, as described above. The end of the authentication process in the biometric data processing apparatus <NUM> is indicated by the determination unit <NUM> calculating the collation result in S6 and completing the determination as to whether or not the first score is equal to or more than the predetermined threshold value. The predetermined action in the present example embodiment is the user touching the detection unit <NUM>. Therefore, the authentication unit <NUM> determines whether the detection unit <NUM> has continuously detected contact of the user from when the detection unit <NUM> first detects the contact of the user after the message requesting a predetermined action is displayed until the determination in S6 in the determination unit <NUM> is ended.

More specifically, the authentication unit <NUM> sequentially acquires the amount of charge detected by the detection unit <NUM> which is a touch panel. Then, the authentication unit <NUM> determines whether or not the amount of charge after the change is continuously detected, from when the amount of charge detected by the detection unit <NUM> first changes after the display at S2 until the determination at S6 in the determination unit <NUM> is completed. In such a case, the authentication unit <NUM> determines that the detection unit <NUM> continuously detects the predetermined action. On the other hand, in a case where the value of the detected amount of charge becomes the value before the change from when the amount of charge first changes until the determination at S5 by the determination unit <NUM> is completed, the authentication unit <NUM> determines that the detection unit <NUM> did not continuously detect the predetermined action.

Next, in a case where the first score calculated by the collation of the feature value data is determined equal to or more than the predetermined threshold value, the determination unit <NUM> causes the transmission unit <NUM> to transmit the biometric data of the user. The determination unit <NUM> may cause the transmission unit <NUM> to transmit the feature value data extracted from the face image data generated by the imaging unit <NUM> as biometric data of the user. Further, the determination unit <NUM> may acquire information on the service to be received by the user from the acquisition unit <NUM>, and causes the transmission unit <NUM> to transmit the acquired information together with the biometric data. In the present example embodiment, the determination unit <NUM> causes the transmission unit <NUM> to transmit the user ID input by the user, together with the biometric data of the user which is the feature value data.

The reception unit <NUM> in the server <NUM> receives the feature value data and the user ID. The collation unit <NUM> acquires the feature value data and the user ID from the reception unit <NUM>. Then, the collation unit <NUM> acquires the face image data associated with the same user ID as the acquired user ID among the face image data stored in the storage unit <NUM>.

Here, an example of data stored in the storage unit <NUM> is shown in <FIG>. As shown in <FIG>, the storage unit <NUM> stores the user ID and the face image data of the user at the time of registration in association with each other. The face image data may be stored in the storage unit <NUM> when the user is registered in the bank system as a customer of the bank. The face image data stored in the storage unit <NUM> may be feature value data extracted from data generated by an imaging unit such as the imaging unit <NUM>. Hereinafter, the face image data of the user stored in the storage unit <NUM> is referred to as previously registered biometric data or face image data.

The collation unit <NUM> collates the feature value data acquired from the reception unit <NUM> with the previously registered face image data acquired from the storage unit <NUM> to calculate a second score (S8). For example, if the acquired user ID is "1A2B3C", the collation unit <NUM> searches the storage unit <NUM> for the user ID " 1A2B3C". Then, the collation unit <NUM> acquires the face image data "face image data a" associated with the user ID matching the user ID "1A2B3C". The collation unit <NUM> collates the "face image data a" acquired from the storage unit <NUM> with the feature value data acquired from the reception unit <NUM>.

Then, the collation unit <NUM> determines whether or not the second score calculated by the collation is equal to or more than the predetermined threshold value. The collation unit <NUM> transmits the determination result to the biometric data processing apparatus <NUM> through the transmission unit <NUM>. The determination result is data indicating whether or not the second score calculated by the collation is equal to or more than the predetermined threshold value. The collation unit <NUM> may cause the transmission unit <NUM> to transmit the calculated second score together with the determination result. In the example embodiment, the transmission unit <NUM> transmits data indicating that the second score calculated by the collation is equal to or more than the predetermined threshold value, to the biometric data processing apparatus <NUM>.

The authentication unit <NUM> determines whether or not the authentication of the user is successful, based on the data received from the server <NUM> (S9). In the example embodiment, the reception unit <NUM> in the biometric data processing apparatus <NUM> receives data indicating that the second score calculated by the collation is equal to or more than the predetermined threshold value. The authentication unit <NUM> determines that the authentication of the user is successful. On the other hand, in a case of acquiring data indicating that the second score calculated by the collation is less than the predetermined threshold value, the authentication unit <NUM> determines that the authentication of the user has failed.

The control unit <NUM> may cause the display unit <NUM> to display success or failure of the authentication of the user. For example, in a case where the authentication unit <NUM> determines that the authentication of the user is successful, the control unit <NUM> may cause the display unit <NUM> to display a message "Authentication successful". On the other hand, for example, in a case where the authentication unit <NUM> determines that the authentication of the user has failed, the control unit <NUM> may cause the display unit <NUM> to display a message "Authentication failed.

In the authentication process using biometric data, there may be persons impersonating another person to try and succeed in authentication by using biometric data of the other person acquired in advance. In the biometric data processing apparatus <NUM> of the present example embodiment, the display unit <NUM> displays a message requesting an input of biometric data having a predetermined feature. Further, in a case where a first score calculated by collating a feature extracted from the biometric data with the predetermined feature is equal to or more than a predetermined threshold value, the authentication unit <NUM> determines that the authentication of the user is successful.

Thus, even if a person impersonating a user to try and receive a service acquires biometric data of the user in advance, the authentication of this person would fail. This is because a person to be authenticated does not know what type of biometric data having what type of feature needs to be inputted, until a message is displayed on the display unit <NUM>. Therefore, the biometric data processing apparatus <NUM> of the present example embodiment can prevent impersonation of another person.

The control unit <NUM> may cause the display unit <NUM> to display a message prompting to end the predetermined action, after the authentication process in the biometric data processing apparatus <NUM> is ended. The storage unit <NUM> may store the message in advance. As described above, the authentication process in the biometric data processing apparatus <NUM> according to the present example embodiment is the process of S1 to S6 shown in <FIG>. The end of the authentication process in the biometric data processing apparatus <NUM> is indicated by the determination unit <NUM> calculating the collation result in S6 and completing the determination as to whether or not the first score is equal to or more than the predetermined threshold value. Therefore, after the determination unit <NUM> completes the determination on the feature extracted from the biometric data, the control unit <NUM> may cause the display unit <NUM> to display a message prompting to release the finger from the touch panel. Thus, the user can know how long the predetermined action needs to be continued. Thus, the convenience of the user using the biometric data processing apparatus <NUM> is improved.

Further, after the control unit <NUM> causes the display unit <NUM> to display a message requesting an input of biometric data having a predetermined feature, the control unit <NUM> may cause the display unit <NUM> to display a message requesting a predetermined action. Further, after the determination unit <NUM> determines whether or not the biometric data has a predetermined quality, the control unit <NUM> may cause the display unit <NUM> to display a message requesting a predetermined action. Thus, the time for the user to perform the predetermined action is shortened, and the burden on the user is reduced.

Before the determination unit <NUM> determines that the biometric data of the user has a predetermined quality, the control unit <NUM> may cause the display unit <NUM> to display a progress status of the whole authentication process. For example, after the acquisition unit <NUM> acquires information on the service to be received by the user, before displaying a message requesting a predetermined action, the control unit <NUM> may cause the display unit <NUM> to display the progress of the whole authentication process. Thus, the user can know the progress of the whole authentication process at an earlier stage, so that the user's stress is reduced.

Further, after determining that the biometric data of the user has a predetermined quality, the determination unit <NUM> may cause the transmission unit <NUM> to transmit the biometric data. That is, the determination unit <NUM> may cause the transmission unit <NUM> to transmit the biometric data before making a determination on the feature extracted from the biometric data. In this case, the collation unit <NUM> in the server <NUM> may perform a biometric data collation process in parallel with the authentication process in the biometric data processing apparatus <NUM>. This shortens the time required for the whole authentication process.

The determination unit <NUM> may be a constituent element of the server <NUM>. In this case, the determination unit <NUM> may make a determination on the biometric data transmitted from the biometric data processing apparatus <NUM>, and may transmit the determination result to the biometric data processing apparatus <NUM>. A part of the process performed by the determination unit <NUM> may be performed by the collation unit <NUM> in the server <NUM>. For example, the determination unit <NUM> may determine whether the biometric data of the user has a predetermined quality or not, and the collation unit <NUM> may perform collation between the feature extracted from the biometric data and the predetermined feature. Thus, the number of authentication processes performed by the biometric data processing apparatus during the whole authentication process is reduced, and it is possible to shorten the time for the user to perform a predetermined action.

The collation unit <NUM> may be a constituent element of the biometric data processing apparatus <NUM>. In this case, the collation unit <NUM> may acquire the previously registered biometric data from the storage unit <NUM> in the server <NUM> and perform collation. The storage unit <NUM> may be a constituent element of the biometric data processing apparatus <NUM>. In this case, the storage unit <NUM> may store biometric data for one person. Thus, the number of data transmission and reception between the biometric data processing apparatus <NUM> and the server <NUM> is reduced, and the time required for the whole authentication process can be shortened.

In the case where the collation unit <NUM> is a constituent element of the biometric data processing apparatus <NUM>, the biometric data processing apparatus <NUM> and the server <NUM> may perform operations conforming to the Fast IDentity Online (FIDO) (registered trademark) specification. For example, in a case where the second score resulting from the collation between the face image data acquired from the imaging unit <NUM> and the previously-registered face image data is equal to or more than the predetermined threshold value, the collation unit <NUM> in the biometric data processing apparatus <NUM> may encrypt authentication information by using a secret key. The collation unit <NUM> may cause the transmission unit <NUM> to transmit the encrypted authentication information. The control unit <NUM> in the server <NUM> may decrypt the authentication information transmitted from the biometric data processing apparatus <NUM> by using the public key. In a case where the decoding is successful, the control unit <NUM> may transmit the data indicating to that effect to the biometric data processing apparatus <NUM> through the transmission unit <NUM>. In a case of acquiring data indicating that decoding has succeeded, the authentication unit <NUM> in the biometric data processing apparatus <NUM> may determine that the authentication of the user is successful.

In a case where the decoding has failed, the control unit <NUM> may transmit the data indicating to that effect to the biometric data processing apparatus <NUM> through the transmission unit <NUM>. In a case of acquiring data indicating that decoding has failed, the authentication unit <NUM> in the biometric data processing apparatus <NUM> may determine that the authentication of the user has failed.

In a case where the biometric data processing apparatus <NUM> and the server <NUM> perform operations conforming to the FIDO specification, the authentication process in the biometric data processing apparatus <NUM> may include a process of receiving the data indicating whether the decoding is successful or not from the server <NUM>. In this case, the authentication unit <NUM> may determine whether the detection unit <NUM> continuously detects the predetermined action from when the detection unit <NUM> first detects a predetermined action after the message is displayed until receiving the data indicating whether the decoding is successful or not from the server <NUM>.

Further, the collation unit <NUM> may be implemented by a plurality of apparatuses. For example, the collation unit <NUM> may be implemented by the constituent elements in the biometric data processing apparatus <NUM> and the constituent elements in the server <NUM>. That is, the constituent elements in the biometric data processing apparatus <NUM> and the constituent elements in the server <NUM> may cooperate to collate the biometric data of the user with the previously registered biometric data. In this case, the feature value data of previously registered biometric data may be secretly distributed and stored in the biometric data processing apparatus <NUM> and the server <NUM>. Then, the biometric data processing apparatus <NUM> and the server <NUM> executes the collation between the biometric data of the user and the previously registered biometric data, and the collation score (the first score) may be calculated based on the calculation results of both apparatuses.

In a case where the biometric data is determined to have the predetermined quality, the imaging unit <NUM> may regenerate biometric data. For example, in a case where the determination unit <NUM> determines that the biometric data has a predetermined quality, the imaging unit <NUM> may recapture the face of the user and generate face image data. At this time, the imaging unit <NUM> may generate biometrics data having a larger amount of data than the biometrics data used to determine the quality. For example, the imaging unit <NUM> may generate image data with higher resolution than the image data used to determine the quality. The imaging unit <NUM> may generate image data or the like having a larger number of colors than the image data used to determine the quality.

Further, the determination unit <NUM> may perform image processing such as noise removal and contrast enhancement on the regenerated image data and improve the quality of the image data. Then, the determination unit <NUM> may collate the feature value data extracted from the regenerated face image data with the predetermined feature value data. The collation unit <NUM> may collate the regenerated face image data with the previously registered face image data.

Further, the control unit <NUM> may cause the display unit <NUM> to display the biometric data generated by the imaging unit <NUM>. Further, in a case where the biometric data is determined to have the predetermined quality, the control unit <NUM> causes the display unit <NUM> to display to that effect. For example, in a case where the biometric data is determined to have the predetermined quality, the control unit <NUM> may display a frame of a color different from the background at the edge of the biometric data displayed by the display unit <NUM>. Thus, the user can know that the quality of the captured face image is good. By attempting to maintain the current imaging environment, the user has a high possibility of generating high-quality image data when the imaging unit <NUM> regenerates the image data. In addition, it takes a lot of time to generate biometric data with a large amount of data, and the image process of the biometric data takes a certain amount of time. That is, it takes a longer time to generate image data with better quality. Thus, by generating biometric data with better quality after the biometric data is determined to have the predetermined quality, it is possible to shorten the time required for the whole authentication process.

The acquisition unit <NUM> may acquire a part of information on the service to be received by the user, after the authentication unit <NUM> determines that the authentication of the user is successful. For example, the acquisition unit <NUM> may acquire the user ID in S1 and acquire information on the remittee after the authentication unit <NUM> determines that the authentication of the user is successful. Thus, for a person who is attempting to impersonate others, it can be determined that authentication has failed at an earlier stage before inputting a remittee.

Next, the configuration example of a second example embodiment will be described. In the second example embodiment, it is assumed that the authentication process described in the first example embodiment is performed a plurality of times until a certain service is provided. That is, in the second example embodiment, it is assumed that the input of information on the service to be received by the user and the authentication process of the user are repeated. In a case where the service to be received by the user is "remittance", as the information on services received by the user, for example, a remittee and a remittance amount may be inputted. The biometric data processing apparatus <NUM> and the server <NUM> of the second example embodiment perform the first authentication process after the user inputs the remittee, and perform the second authentication process after the user inputs the remittance amount.

A configuration example of the second example embodiment is illustrated in <FIG>. The biometric data processing apparatus <NUM> shown in <FIG> is different from the biometric data processing apparatus <NUM> of the first example embodiment in having a control unit <NUM> and an authentication unit <NUM>. Since the rest of the configuration is the same as in the first example embodiment, the description will not be repeated.

In a case where the authentication process is performed a plurality of times, the control unit <NUM> makes the predetermined feature different from the previous feature depending on the authentication process. For example, the control unit <NUM> may cause the display unit <NUM> to display a message requesting input of biometric data having a first feature at the time of the first authentication process. Then, the control unit <NUM> may cause the display unit <NUM> to display a message requesting input of biometric data having a second feature different from the first feature at the time of the second authentication process.

More specifically, for example, the control unit <NUM> acquires information indicating the service to be received by the user from the acquisition unit <NUM>. The information indicating the service to be received by the user may be information inputted by the user to the input unit <NUM>. Then, the control unit <NUM> acquires an input request message corresponding to the information indicating the service to be received by the user from the storage unit <NUM>. The inputted request message is a message for requesting the user to input information on the service. The inputted request message may be, for example, a message such as "Please input remittee. ", and "Please input remittance amount.

At this time, the control unit <NUM> acquires an input request message from the storage unit <NUM> depending on the number of times of the authentication process currently being executed. Then, the control unit <NUM> causes the display unit <NUM> to display the acquired input request message.

The storage unit <NUM> stores a plurality of input request messages in association with information indicating the service to be received by the user. In addition, the storage unit <NUM> stores a plurality of messages requesting input of a predetermined feature in association with information indicating the service to be received by the user. The input request message and the message requesting input of a predetermined feature stored in the storage unit <NUM> vary depending on the number of times of authentication.

For example, the storage unit <NUM> stores a message for the first authentication process "Please look to the right without moving the position of the face. " and a message for the second authentication process "Please look to the left without moving the position of the face. " in association with "remittance" which is a service to be received by the user. That is, the control unit <NUM> acquires from the storage unit <NUM> a message requesting input of different features depending on the authentication process. A feature value data may be associated with a message requesting input of a predetermined feature stored in the storage unit <NUM> similarly to the first example embodiment. In the case where the authentication of the user is determined successful in all authentication processes, the authentication unit <NUM> executes the process enabling the provision of the service to the user. For example, the authentication unit <NUM> determines whether or not the authentication of the user is successful in both of the first authentication process and the second authentication process. In a case where the authentication of the user is determined successful in both of the first authentication process and the second authentication process, the authentication unit <NUM> can provide the service to the user.

The process enabling the provision of the service to the user is a process that triggers a process of providing a service to a user. For example, the process enabling the provision of a service to a user may be the authentication unit <NUM> transmitting data indicating that the service can be provided to the server <NUM> through the transmission unit <NUM>. Alternatively, the authentication unit <NUM> may transmit to the server <NUM> data indicating that the authentication of the user is determined to be successful in all authentication processes. The authentication unit <NUM> may further cause the transmission unit <NUM> to transmit information on the service to be received by the user.

The control unit <NUM> that has received these pieces of data from the authentication unit <NUM> provides the user with a service. For example, the control unit <NUM> may execute remittance from the user's savings account to the savings account of the remittee based on the information on the service to be received by the user.

The operation of the second example embodiment will be described using a specific example. <FIG> is a sequence diagram showing an example of operations of the biometric data processing apparatus <NUM> and the server <NUM>. The sequence diagram shown in <FIG> shows the operations performed following the sequence diagram shown in <FIG>. Since the operations of S1 to S9 are the same as those in the first example embodiment, a description thereof will not be repeated. Since S10 to S18 are also similar to the operations of S1 to S9, the description will not be repeated.

Prior to S1, for example, the user inputs "remittance" as the service the user wants to receive to the input unit <NUM>. The screen allowing the user to input the service may be displayed after the user activates the predetermined application. Then, the control unit <NUM> acquires information indicating the service to be received by the user from the input unit <NUM>.

The control unit <NUM> acquires a message for the first authentication process from the storage unit <NUM> among the input request messages corresponding to the service "remittance" to be received by the user. For example, the storage unit <NUM> stores, as the message for the first authentication process, "Please input remittee. " in association with "remittance" which is a service to be received by the user. For example, the storage unit <NUM> stores, as the message for the second authentication process, "Please input remittance amount. " in association with "remittance" which is a service to be received by the user. Then, in the first authentication process, the control unit <NUM> acquires a message "Please input remittee. " from the storage unit <NUM> and causes the display unit <NUM> to display the message.

A user viewing the display on the display unit <NUM> inputs information on the remitee through the input unit <NUM>. An example of the input process by the user is as shown in <FIG> similarly to the first example embodiment. The acquiring unit <NUM> acquires information on the remittee from the input unit <NUM> as information on the service to be received by the user (S1). The control unit <NUM> may cause the display unit <NUM> to display information on the service to be received by the user, which is acquired by the acquisition unit <NUM>. Thus, the user viewing the display unit <NUM> can determine whether his input is correct.

Since the operation of S2 is the same as that in the first example embodiment, a description thereof will not be repeated. Prior to the operation in S3, the control unit <NUM> acquires from the storage unit <NUM> a message requesting input of a predetermined feature. At this time, the control unit <NUM> acquires, from the storage unit <NUM>, a message corresponding to the service "remittance" received by the user and requesting input of a predetermined feature for the first authentication process.

For example, the storage unit <NUM> stores the message "Please look to the right without moving the position of the face. " requesting the input of a predetermined feature for the first authentication process in association with "remittance" which is a service to be received by the user. Further, the storage unit <NUM> stores the message "Please look to the left without moving the position of the face. " requesting the input of a predetermined feature for the second authentication process in association with "remittance" which is a service to be received by the user. Then, in the second authentication process, the control unit <NUM> acquires the message "Please look to the right without moving the position of the face. " from the storage unit <NUM>, and causes the display unit <NUM> to display the message (S3).

Since the operations of S4 to S9 are the same as those in the first example embodiment, a description thereof will not be repeated. When the authentication unit <NUM> completes the operation of S9, the control unit <NUM> acquires a message for the second authentication process from the storage unit <NUM> among the input request messages corresponding to the service "remittance" received by the user. For example, as described above, the storage unit <NUM> stores, as the message for the second authentication process, "Please input remittance amount. " in association with "remittance" which is a service to be received by the user. Then, the control unit <NUM> acquires a message "Please input remittance amount. " from the storage unit <NUM> and causes the display unit <NUM> to display the message.

A user viewing the display on the display unit <NUM> inputs information on the remittance amount through the input unit <NUM>. An example of an input process by the user is illustrated in <FIG>. In <FIG>, the display unit <NUM> displays information on the remittance amount which is inputted by the user. <FIG> shows that the user has inputted the information of "<NUM>,<NUM> yen" to the biometric data processing apparatus <NUM>. The user may input such information by touching the touch panel which is the input unit <NUM> with a finger. Further, the display unit <NUM> displays a message "Please confirm remittance amount. Upon confirmation please touch "next" button" prompting the user to check the information inputted by the user. The user viewing the display unit <NUM> confirms that the information inputted by the user inputs is correct and touches a portion of the display unit <NUM> where "next" is displayed.

Since the operation of S11 is the same as S2 in the first example embodiment, a description thereof will not be repeated. In a case where the detection unit <NUM> detects a predetermined action by the user, the control unit <NUM> acquires a message requesting an input of a predetermined feature from the storage unit <NUM>. At this time, the control unit <NUM> acquires, from the storage unit <NUM>, a message requesting input of biometric data having a feature different from that in the first authentication process, and causes the display unit <NUM> to display the message.

More specifically, the control unit <NUM> acquires, from the storage unit <NUM>, a message corresponding to the service "remittance" received by the user and requesting input of a predetermined feature for the second authentication process. For example, as described above, the storage unit <NUM> stores, as the message for the second authentication process, "Please look to the left without moving the position of the face. " in association with "remittance" which is a service to be received by the user. Then, the control unit <NUM> acquires "Please look to the left without moving the position of the face. " from the storage unit <NUM>, and causes the display unit <NUM> to display the message (S12).

Since the operations of S13 to S17 are the same as those in the first example embodiment, a description thereof will not be repeated. As in the first example embodiment, the authentication unit <NUM> determines whether or not the authentication of the user is successful, based on the data received from the server <NUM> (S18). For example, the reception unit <NUM> in the biometric data processing apparatus <NUM> receives data indicating that the second score calculated by the collation is equal to or more than the predetermined threshold value. Since data indicating that the second score calculated by the collation is equal to or more than the predetermined threshold value is acquired, the authentication unit <NUM> determines that the authentication of the user is successful.

Further, the authentication unit <NUM> determines whether or not the authentication of the user has been determined to be successful in all authentication processes. In the present example embodiment, it is assumed that the authentication unit <NUM> determines that the authentication of the user is successful in all authentication processes in a case where the authentication of the user is determined successful both in S9 and S18. On the other hand, it is assumed that the authentication unit <NUM> determines that the authentication of the user is unsuccessful in all authentication processes in a case where the authentication of the user is determined to have failed in S9 or S18.

The authentication unit <NUM> executes a process of enabling provision of a service to the user, in a case where the authentication of the user is determined successful in all authentication processes (S19). For example, the authentication unit <NUM> transmits data indicating that the service can be provided to the server <NUM> through the transmission unit <NUM>. Further, the authentication unit <NUM> causes the transmitting unit <NUM> to transmit the information on the service to be received by the user, which is acquired by the acquisition unit <NUM>.

The control unit <NUM> that has received these pieces of data from the authentication unit <NUM> provides the user with a service. For example, the control unit <NUM> may execute remittance of money from the user's savings account to the savings account of the remittee based on the information on the service to be received by the user. For example, the control unit <NUM> acquires data indicating that the service can be provided, data on the remittee such as the bank name "Nichiden Bank", the branch name "Mita branch", the type "savings account", the account number "<NUM>", and the recipient "Hanako Nichiden", and data on the remittance amount of "<NUM>,<NUM> yen". Further, the control unit <NUM> acquires the user ID, for example. Then, the control unit <NUM> executes a process of remitting <NUM>,<NUM> to the account of the remittee from the user's account identified from the user ID. Further, the control unit <NUM> may transmit to the biometric data processing apparatus <NUM> data indicating that the remittance process has been completed.

The control unit <NUM> in the biometric data processing apparatus <NUM> may cause the display unit <NUM> to display a message indicating that the remittance process has been completed. For example, the control unit <NUM> may cause the display unit <NUM> to display a message "Remittance process completed".

In a case where the authentication unit <NUM> determines that not all authentication processes of the authentication of the user has been determined successful, the authentication unit <NUM> may transmit data indicating that the service cannot be provided to the server <NUM> through the transmission unit <NUM>. In this case, the control unit <NUM> may not provide a service to the user.

Further, the control unit <NUM> may cause the display unit <NUM> to display a message indicating that the service cannot be provided. For example, the control unit <NUM> may cause the display unit <NUM> to display a message "Because authentication has failed, remittance process cannot be executed. Sorry to trouble you, please try again from the beginning.

Since the biometric data processing apparatus <NUM> of the present example embodiment makes the predetermined feature different from the previous feature according to the authentication process, the effect of preventing impersonation of another person is further enhanced. This is because it is difficult for an impersonator to prepare biometric data of another person having various features in advance.

In a case where the authentication of the user has been determined to have failed in any one of the authentication processes performed more than once, the biometric data processing apparatus <NUM> may not perform the next authentication process. For example, in a case where the authentication of the user has been determined to have failed in the first authentication process in the present example embodiment, the biometric data processing apparatus <NUM> may not perform the operations after S10 in the second authentication process. Thus, the biometric data processing apparatus <NUM> may end the process at an early stage without repeating the authentication process for a person attempting to impersonate another person.

A third example embodiment will be described. <FIG> illustrates a configuration example of a biometric data processing apparatus <NUM> in the third example embodiment. The biometric data processing apparatus <NUM> includes a control unit <NUM>, a determination unit <NUM>, and an authentication unit <NUM>.

The control unit <NUM> causes the display unit to display a message requesting the user to perform a predetermined action. The display unit may be a constituent element in the biometric data processing apparatus <NUM> or may be implemented by another apparatus connected to the biometric data processing apparatus <NUM>. Further, in a case where the biometric data of the user is determined to have the predetermined quality, the control unit <NUM> causes the display unit to display a progress status of the whole authentication process.

The determination unit <NUM> determines whether or not biometric data of the user has a predetermined quality.

The authentication unit <NUM> determines that the authentication of the user is successful, in a case where a first score calculated by collating the biometric data of the user with previously-registered biometric data is equal to or more than a predetermined threshold value and the detection unit continuously detects the predetermined action from when a detection unit first detects a predetermined action after the message is displayed until an authentication process in the biometric data processing apparatus is ended.

The authentication unit <NUM> or the determination unit <NUM> may determine whether or not the first score calculated by collating the biometric data of the user and biometric data which previously registered is equal to or more than a predetermined threshold value. Alternatively, other apparatuses connected to the biometric data processing apparatus <NUM> may determine whether or not the second score calculated by collating the biometric data of the user and the previously registered biometric data is equal to or more than a predetermined threshold value.

The authentication unit <NUM> or the determination unit <NUM> may determine whether or not the detection unit continuously detects the predetermined action from when the detection unit first detects the predetermined action after the message is displayed until the authentication process in the biometric data processing apparatus is ended. Alternatively, another apparatus connected to the biometric data processing apparatus <NUM> may determine whether or not the detection unit continuously detects the predetermined action from when the detection unit first detects the predetermined action after the message is displayed until the authentication process in the biometric data processing apparatus is ended.

The detection unit may be a constituent element in the biometric data processing apparatus <NUM> or may be implemented by another apparatus connected to the biometric data processing apparatus <NUM>.

The biometric data processing apparatus <NUM> of the second example embodiment determines that the authentication of the user is successful, in a case where the detection unit continuously detects the predetermined action from when the detection unit first detects a predetermined action after the message is displayed until an authentication process in the biometric data processing apparatus is ended. Thus, the biometric data processing apparatus <NUM> prevents an erroneous operation of a user occurring during the authentication process in the biometric data processing apparatus <NUM>. Further, the biometric data processing apparatus <NUM> causes the display unit to display the progress status of the whole authentication process in the biometric data processing apparatus. Thus, since the user can know the time required for the remaining authentication process, the biometric data processing apparatus <NUM> can prevent an increase in stress of the user.

A fourth example embodiment will be described. <FIG> illustrates a configuration example of a biometric data processing apparatus <NUM> in the fourth example embodiment. The biometric data processing apparatus <NUM> includes a control unit <NUM>, and an authentication unit <NUM>.

The control unit <NUM> causes the display unit to display a message requesting the user to perform a predetermined action. The display unit may be a constituent element in the biometric data processing apparatus <NUM> or may be implemented by another apparatus connected to the biometric data processing apparatus <NUM>.

The authentication unit <NUM> determines that the authentication of the user is successful, in a case where a first score calculated by collating the biometric data of the user with previously-registered biometric data is equal to or more than a predetermined threshold value and the detection unit continuously detects the predetermined action from when the detection unit first detects the predetermined action after the message is displayed until an authentication process in the biometric data processing apparatus is ended.

The authentication unit <NUM> may determine whether or not the first score calculated by collating the biometric data of the user and biometric data which previously registered is equal to or more than a predetermined threshold value. Alternatively, another apparatus (for example, the server <NUM>) connected to the biometric data processing apparatus <NUM> may determine whether or not the second score calculated by collating the biometric data of the user with the previously registered biometric data is equal to or more than a predetermined threshold value.

The authentication unit <NUM> may determine whether or not the detection unit continuously detects the predetermined action from when the detection unit first detects the predetermined action after the message is displayed until the authentication process in the biometric data processing apparatus is ended. Alternatively, another apparatus (for example, the server <NUM>) connected to the biometric data processing apparatus <NUM> may determine whether or not the detection unit continuously detects the predetermined action from when the detection unit first detects the predetermined action after the message is displayed until the authentication process in the biometric data processing apparatus is ended.

The biometric data processing apparatus <NUM> of the fourth example embodiment determines that the authentication of the user is successful, in a case where the detection unit continuously detects the predetermined action from when the detection unit first detects a predetermined action after the message is displayed until an authentication process in the biometric data processing apparatus <NUM> is ended. Thus, the biometric data processing apparatus <NUM> prevents an erroneous operation of a user occurring during the authentication process in the biometric data processing apparatus <NUM>.

A fifth example embodiment will be described. <FIG> illustrates a configuration example of a biometric data processing apparatus <NUM> in the fifth example embodiment. The biometric data processing apparatus <NUM> includes a control unit <NUM> and an authentication unit <NUM>.

The control unit <NUM> displays, on a display unit, a message requesting a user to input biometric data having a predetermined feature. The display unit may be a constituent element in the biometric data processing apparatus <NUM> or may be implemented by another apparatus connected to the biometric data processing apparatus <NUM>.

The authentication unit <NUM> determines that the authentication of the user is successful, in a case where the first score calculated by collating the biometric data of the user with the previously-registered biometric data is equal to or more than a predetermined threshold value and the first score calculated by collating a feature extracted from the biometric data with the predetermined feature is equal to or more than a predetermined threshold value.

The authentication unit <NUM> may determine whether or not the first score calculated by collating the biometric data of the user and the previously registered biometric data is equal to or more than a predetermined threshold value. Alternatively, another apparatus (for example, the server <NUM>) connected to the biometric data processing apparatus <NUM> may determine whether or not the second score calculated by collating the biometric data of the user with the previously registered biometric data is equal to or more than a predetermined threshold value.

In the authentication process using biometric data, there may be persons impersonating another person to attempt to succeed in authentication by using biometric data of the other person acquired in advance. In the biometric data processing apparatus <NUM> of the fifth example embodiment, the control unit <NUM> causes the display unit to display a message requesting an input of biometric data having a predetermined feature. Further, in a case where a first score calculated by collating a feature extracted from the biometric data with the predetermined feature is equal to or more than a predetermined threshold value, the authentication unit <NUM> determines that the authentication of the user is successful.

Thus, even if a person attempting to wrongfully receive a service by impersonating a user has acquired biometric data of the user in advance, the authentication of this person would fail. This is because the person to be authenticated does not know what type of biometric data having what type of feature needs to be inputted, until a message is displayed on the display unit. Therefore, the biometric data processing apparatus <NUM> of the fifth example embodiment can prevent impersonation of others.

Next, an example of a hardware configuration will be described. <FIG> is a diagram showing a hardware configuration example of the server <NUM> described in the above example embodiment. The server <NUM> in <FIG> may be any general computer. For example, the server <NUM> may be a server, a notebook PC, a desktop PC, a workstation, a blade server, or the like. Further, the server <NUM> may be communicatively connected to another server, a computer, or the like.

In <FIG>, the server <NUM> includes a processor <NUM>, a memory <NUM>, a storage <NUM>, a north bridge <NUM> connected to the memory <NUM>, and an expansion slot <NUM>. The server <NUM> further includes a communication interface <NUM> and a south bridge <NUM> connected to the storage <NUM>. These components are connected to each other by a bus and fixed to the mother board.

The processor <NUM> reads and executes the instructions stored in the memory <NUM>, the storage <NUM>, and the like. The processor <NUM> may execute instructions to display video on a display apparatus (not shown). The processor <NUM> reads the programs stored in the memory <NUM> and the storage <NUM> and executes the instructions. The processor <NUM> may be a circuit such as a central processing unit (CPU) and application specific integrated circuits (ASICs).

Further, the processor <NUM> may implement the functions of the collation unit <NUM> and the control unit <NUM> of the server <NUM>.

The memory <NUM> is a computer readable storage medium that stores information. The memory <NUM> may be a volatile storage medium such as a random access memory (RAM) or a nonvolatile storage medium such as a read only memory (ROM). Further, the memory <NUM> may be an optical disk, a magnetic disk, or the like. The storage <NUM> may be a large-capacity computer readable storage medium. The storage <NUM> may be, for example, a floppy (registered trademark) disk, a hard disk drive, an optical disk, a flash memory, or the like. Instructions included in a computer program stored in a computer readable storage medium are executed to achieve the above-described example embodiments. The memory <NUM> may implement the storage unit <NUM> of the server <NUM>.

The north bridge <NUM> connects parts that are brains of the computer, such as a CPU and a memory, and controls the timing and speed to transfer data. The north bridge <NUM> bridges data among apparatuses that operate primarily at high speed. On the other hand, the south bridge <NUM> bridges data among apparatuses that operate primarily at low speed. For example, the north bridge <NUM> may be connected to the memory <NUM>, a display apparatus (not shown), and the expansion slot <NUM> that can accept expansion cards (not shown). Further, the south bridge <NUM> may be connected to the storage <NUM> and the communication interface <NUM>.

The communication interface <NUM> may include various communication ports such as universal serial bus (USB), Bluetooth (registered trademark), Ethernet (registered trademark), and Wireless Ethernet. In addition, these communication ports may be connected to one or more input and output apparatuses, for example, communication apparatuses such as a keyboard, a pointing device, a scanner, a wireless local area network (LAN) adapter, and a router. That is, the server <NUM> may be connected to the biometric data processing apparatus through the communication interface <NUM>. Further, the communication interface <NUM> may include a wireless LAN adapter. The communication interface <NUM> may implement functions of the reception unit <NUM> and the transmission unit <NUM> of the server <NUM>.

<FIG> is a diagram showing an example of a hardware configuration of the mobile terminal <NUM> that implements the biometric data processing apparatuses <NUM>, <NUM>, <NUM>, <NUM>, and <NUM> described in the above example embodiments. The mobile terminal <NUM> shown in <FIG> will be described. The mobile terminal <NUM> may be a mobile terminal such as a mobile phone, a smart phone, and a personal digital assistant (PDA).

The mobile terminal <NUM> may include a display <NUM>, a transceiver <NUM>, an audio codec <NUM>, a control interface <NUM>, a display interface <NUM>, and an imaging apparatus <NUM>. Further, the mobile terminal <NUM> may further include a communication interface <NUM>, a processor <NUM>, a global positioning system (GPS) receiving module <NUM>, an expansion memory <NUM>, a memory <NUM>, and an external interface <NUM>.

The display <NUM> may be, for example, a Thin-Film Transistor Liquid Crystal Display (TFT LCD), an Organic Light Emitting Diode (OLED) display, or other displays. Further, the display may be connected to the control interface <NUM> and the display interface <NUM>. The display <NUM> may have a touch panel. The processor <NUM> may exchange information with the user of the mobile terminal <NUM> through the control interface <NUM> and the display interface <NUM>. The display <NUM> may implement functions of the display unit <NUM>, the detection unit <NUM>, and the input unit <NUM> of the biometric data processing apparatuses <NUM>, <NUM> and the like.

The display interface <NUM> may be configured by a circuit. The display interface <NUM> controls the display to display video and other information to the user. The control interface <NUM> receives a command from the user. Then, the control interface <NUM> may convert the received command to send it to the processor <NUM>.

Further, the mobile terminal <NUM> may have an external interface <NUM> enabling communication between an external apparatus (for example, the server <NUM>) and the processor <NUM>. The external interface <NUM> may provide wired communication or wireless communication to the mobile terminal <NUM>.

The expansion memory <NUM> is connected to the mobile terminal <NUM> through an extension interface <NUM>. Further, the expansion memory <NUM> may include a Single In Line Memory Module (SIMM) card interface, for example. Further, the expansion memory <NUM> may give an additional storage area to the mobile terminal <NUM>, and may store the application and other information. Further, the expansion memory <NUM> may store information on security. The expansion memory <NUM> may function as a security management device of the mobile terminal <NUM>. For example, an instruction for realizing safe use of the mobile terminal <NUM> is programmed in the expansion memory <NUM>.

The mobile terminal <NUM> performs wireless communication through the communication interface <NUM>. That is, the mobile terminal <NUM> may communicate with the server <NUM> through the communication interface <NUM>. The communication interface <NUM> may implement the functions of the reception unit <NUM> and the transmission unit <NUM> of the biometric data processing apparatuses <NUM> and <NUM>.

The communication interface <NUM> may include a digital signal processing circuit. The communication interface <NUM> may realize communication under modes and protocols such as Global System for Mobile Communication (GMS), Short Message Service (SMS), and Enhanced Messaging Service (EMS). Alternatively, the communication interface <NUM> may realize communication under modes and protocols such as Multimedia Messaging Service (MMS), Code Division Multiple Access (CDMA), and Time Division Multiple Access (TDMA).

Further, the communication interface <NUM> may realize communication under modes and protocols such as Personal Digital Cellular (PDC), Wideband Code Division Multiple Access (WCDMA (registered trademark)), CDMA <NUM>, General Packet Radio Service (GPRS). The above-described communication is generated, for example, through the transceiver <NUM>. Further, narrow band communication, for example, communication using Bluetooth (registered trademark), Wi-Fi (registered trademark), or the like may also be generated through the transceiver <NUM>.

The GPS reception module <NUM> may provide data used by an application operating on the mobile terminal <NUM>. The data may be, for example, position or data related to navigation.

Further, the mobile terminal <NUM> may perform sound communication through the audio codec <NUM>. The audio codec <NUM> acquires sound information from the user and converts it into a form that can be used as digital information. Further, the audio codec <NUM> generates sound that the user can hear. The information handled by the audio codec <NUM> may be a sound call, a recorded sound (such as a voice message and a music file), a sound generated by an application on the mobile terminal <NUM>, or the like.

Since the processor <NUM> and the memory <NUM> are the same as those of the server <NUM>, the description thereof will not be repeated. The processor <NUM> may implement the functions of the control unit <NUM>, the determination unit <NUM>, the authentication unit <NUM>, and the acquisition unit <NUM> of the biometric data processing apparatuses <NUM>, <NUM> and the like. That is, by reading the program stored in the memory <NUM>, the processor <NUM> may implement functions of the control unit <NUM>, the determination unit <NUM>, the authentication unit <NUM>, and the acquisition unit <NUM> of the biometric data processing apparatuses <NUM>, <NUM>, and the like. The memory <NUM> may implement the function of the storage unit <NUM>.

The imaging apparatus <NUM> may be a camera having, for example, a charge coupled device (CCD) sensor, a complementary meta oxide semiconductor (CMOS) sensor, an image processor, and the like. The imaging apparatus <NUM> converts the received light into image data to generate image data.

The above-described example embodiments are only examples that embody the present invention, and various modifications can be made within the scope of invention defined by the independent claims.

Claim 1:
A biometric data processing system comprising a biometric data processing apparatus (<NUM>) and a server apparatus (<NUM>);
the biometric data processing apparatus (<NUM>) comprising a control unit (<NUM>), a determination unit (<NUM>), an authentication unit (<NUM>), a display unit (<NUM>), a detection unit (<NUM>), and an input unit (<NUM>);
the server apparatus (<NUM>) comprising a collation unit (<NUM>) and a storage unit (<NUM>) storing biometric data of the users of the system;
wherein the system is configured to execute the following operations:
the control unit (<NUM>) causes the display unit (<NUM>) to display a message requesting a user to perform a predetermined action;
if the detection unit (<NUM>) detects the predetermined action by the user, then the control unit (<NUM>) causes the display unit (<NUM>) to further display a message requesting an input of a type of biometric data having a type of feature, whereby the person to be authenticated does not know what type of biometric data having what type of feature needs to be inputted, until this message is displayed on the display unit (<NUM>);
the determination unit (<NUM>) collates the feature extracted from the biometric data with a predetermined feature to calculate a first score, and determines whether the first score is equal to or more than a predetermined threshold value;
if the first score is equal to or more than the predetermined threshold value, then the authentication unit (<NUM>) determines whether or not the detection unit (<NUM>) continuously detects the predetermined action, and the determination unit (<NUM>) causes a transmission of the feature extracted from the biometric data to the server (<NUM>);
the collation unit (<NUM>) collates the feature extracted from the biometric data with the previously registered biometric data of the user, which previously registered data is stored in the storage unit (<NUM>), to calculate a second score, determines whether or not the second score is equal to or more than a predetermined threshold value, and causes a transmission of the determination result to the biometric data processing apparatus (<NUM>); and
if the second score is equal to or more than the predetermined threshold value and the detection unit (<NUM>) continuously detects the predetermined action and the first score is equal to or more than the predetermined threshold value, then the authentication unit (<NUM>) determines that the authentication of the user is successful.