Patent Description:
Recently, public certificates including a face photograph such as a driver's license and a passport are gradually changed from paper media to digital data. With the digitization of the public certificate, it is necessary to confirm that the digitized public certificate is real, i.e., not a counterfeit. Patent Document <NUM> discloses a technique for recognizing characters, symbols, or the like by OCR process from the image data of a driver's license, and performing authenticity determination of the certificate based on whether or not the recognized characters and symbols conform to a predetermined rule. <CIT> relates to personal identification. <CIT> relates to a confidential information storing. <CIT> refers to a check validity device to verify the validity of the medium.

In the technique of Patent Document <NUM>, the authenticity determination of the certificate is performed based on the characters and symbols extracted from the image data of the certificate, but the check related to the face image displayed on the certificate is not described. Therefore, it is not possible to prevent a malicious person from falsifying the face image of the certificate or registering a certificate of another person.

One object of the some non-limiting embodiments is to provide an information processing device capable of determining authenticity of a certificate even when the information included in the certificate matches.

According to an example aspect of the present disclosure, there is provided an information processing device comprising:.

According to another example aspect of the present disclosure, there is provided an information processing method comprising:.

According to still another example aspect of the present disclosure, there is provided a recording medium recording a program, the program causing a computer to execute processing of:.

According to the present disclosure, even when the information included in the certificate matches, it is possible to determine the authenticity of the certificate.

Preferred example embodiments will be described with reference to the accompanying drawings. In the following example embodiments, it is assumed that a user photographs a public certificate of a paper medium such as a driver's license or a passport by using his or her smartphone or a tablet terminal (hereinafter, referred to as "terminal device") and registers the photographed image in a public certificate application installed in the terminal device or the like.

When registering a certificate electronically with a terminal device, a malicious person may attempt to register another person's certificate with his own terminal device as it is, or to register another person's certificate with his own terminal device by only changing the face image. In this case, it is not possible to prevent registration by a malicious person unless a check on the face image included in the certificate is performed.

Therefore, in this example embodiment, a local government or an organization issuing a certificate (hereinafter, referred to as "certificate issuer". ) embeds information for checking in the certificate. Specifically, the certificate issuer generates a hash value based on the character information (personal information such as the address, the name, and the date of birth) and the face image shown on the surface of certificate, and embeds the hash value in the certificate at the time of issuing the certificate. The following methods can be used to embed a hash value in a certificate.

This ensures that each certificate always maintains the hash value generated from the correct personal information and face image of the owner of the certificate. When embedding the hash value in a certificate, the hash value may be encrypted in some way.

When the certificate is digitized and registered with the terminal device as digital data, the user photographs the certificate using the terminal device. The terminal device extracts the character information and the face image from the photographed image and generates a hash value. Also, the terminal device obtains the hash value embedded in advance in the certificate. Then, the terminal device checks the hash value generated from the photographed image of the certificate with the hash value embedded in the certificate. If the two hash values coincide, the terminal device determines that there is no falsification of the information and registers the certificate with the terminal device as digital data. Thus, if any part of the character information and the face image of the certificate is falsified, the two hash values do not match. Therefore, the terminal device detects the falsification, and the registration can be stopped.

<FIG> is a block diagram showing a hardware configuration of the terminal device according to the first example embodiment. The terminal device <NUM> is a terminal device of a user and includes a processor <NUM>, a memory <NUM>, a camera <NUM>, a light <NUM>, a recording medium <NUM>, a database (DB) <NUM>, a display unit <NUM>, and an input unit <NUM>.

The processor <NUM> is a computer such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit) and controls the entire terminal device <NUM> by executing a program prepared in advance. In particular, the processor <NUM> performs certificate digitization processing to be described later.

The memory <NUM> may be a ROM (Read Only Memory) and a RAM (Random Access Memory). The memory <NUM> stores various programs executed by the processor <NUM>. The memory <NUM> is also used as a working memory during various processing performed by the processor <NUM>.

The camera <NUM> is provided in the terminal device, and generates a photographed image of the certificate to be digitized. The light <NUM> is a flashlight or the like provided in the terminal device, and is used to illuminate the certificate at the time of photographing, as necessary.

The recording medium <NUM> is a non-volatile and non-transitory recording medium such as a disk-like recording medium and a semiconductor memory and is configured to be detachable from the terminal device <NUM>. The recording medium <NUM> records various programs to be executed by the processor <NUM>.

The DB <NUM> stores the photographed image of the certificate generated by the camera <NUM>. Further, the digital data of the certificate determined to be authentic by the terminal device <NUM> is stored in the DB <NUM>. The display unit <NUM> is a liquid crystal panel or the like provided in the terminal device, and displays the image of the certificate photographed by the camera <NUM> and an operation screen for registering the certificate with the terminal device. The input unit <NUM> is a button provided in the terminal device or a touch panel integrated with the display unit <NUM>. Necessary instructions and inputs are made by the user to the input unit <NUM> at the time of executing the certificate digitization processing.

<FIG> is a block diagram showing a functional configuration of the terminal device <NUM> according to the first example embodiment. The terminal device <NUM> functionally includes a certificate photographing unit <NUM>, an information reading unit <NUM>, a hash comparison unit <NUM>, and a registration unit <NUM>.

The certificate photographing unit <NUM> controls the camera <NUM> and the light <NUM> on the basis of an instruction of a user to photograph a certificate. The certificate photographing unit <NUM> outputs the photographed image of the certificate (hereinafter, referred to as "certificate image") to the information reading unit <NUM>.

The information reading unit <NUM> reads the character information and the face image from the certificate image. At this time, the information reading unit <NUM> performs correction of the certificate image, as necessary. That is, the information reading unit <NUM> geometrically corrects the distortion in the certificate image caused by the influence of the photographing angle of the certificate or the like.

Also, the information reading unit <NUM> reads out the hash value (hereinafter also referred to as the "first hash value") pre-embedded in the certificate. <FIG> show examples of embedding a hash value in a certificate. <FIG> shows an example in which the first hash value is printed as a QR code <NUM> on a certificate <NUM> that is a driver's license. In this case, the information reading unit <NUM> extracts the QR code from the certificate image and decodes the QR code to obtain the first hash value.

<FIG> shows an example in which the first hash value is embedded in the certificate <NUM> as a visible electronic watermark <NUM>. In this case, the information reading unit <NUM> acquires the first hash value from the certificate image using the reading method corresponding to the embedding method of the electronic watermark <NUM>. Note that the electronic watermark <NUM> may be invisibly embedded. Further, when the certificate <NUM> is a medium having a storage unit such as an IC card, the first hash value can be stored in the storage unit. In this case, the information reading unit <NUM> accesses the storage unit of the certificate to acquire the first hash value. Then, the information reading unit <NUM> outputs the acquired first hash value to the hash comparison unit <NUM>.

The hash comparison unit <NUM> calculates the hash value (hereinafter, referred to as the "second hash value") using the character information and the face image acquired from the information reading unit <NUM>. It should be noted that, although the method of generating hash values is not limited to a particular one, a hash method for similar retrieval of multimedia data such as Locality-sensitive Hashing can be used, for example. Then, the hash comparison unit <NUM> compares the first hash value obtained from the information reading unit <NUM> with the second hash value obtained by the calculation. The hash comparison unit <NUM> outputs a comparison result indicating whether or not the first hash value and the second hash value coincide with each other to the registration unit <NUM>.

The registration unit <NUM> registers the certificate image according to the comparison result inputted from the hash comparison unit <NUM>. Specifically, when the comparison result indicates that the first hash value and the second hash value coincide with each other, the registration unit <NUM> determines that there is no falsification of the certificate and registers the certificate image generated by the certificate photographing unit <NUM> with the DB <NUM> as the digital data. On the other hand, when the comparison result indicates that the first hash value and the second hash value do not coincide with each other, the registration unit <NUM> displays a message indicating that the certificate cannot be registered, and terminates the processing.

When the registration unit <NUM> registers the certificate image photographed by the certificate photographing unit <NUM> with the DB <NUM>, if there is distortion or the like due to the influence of the photographing angle in the certificate image as described above, it is preferable to register the image after performing the geometric correction to remove the distortion. If the information reading unit <NUM> has already performed the geometric correction, the registration unit <NUM> may register the certificate image after the correction.

Instead of registering the certificate image itself with the DB <NUM>, the registration unit <NUM> may register the character information and the face image extracted from the certificate image by the information reading unit <NUM> with the DB <NUM>. For example, when the certificate is a driver's license, the registration unit <NUM> may register information specific to the user, such as a name, an address, an expiration date, a driver's license number, and a face image, extracted from the certificate image with the DB <NUM>. In this case, when displaying the information of the registered certificate on the display unit <NUM>, the terminal device <NUM> may read those registered information from the DB <NUM> and insert them to the corresponding portions in a template of the driver's license to generate and display an image of a pseudo driver's license.

<FIG> is a flowchart of certificate digitization processing by the terminal device <NUM> of the first example embodiment. This processing is realized by the processor <NUM> shown in <FIG>, which executes a program prepared in advance and operates as each element shown in <FIG>.

First, the certificate photographing unit <NUM> photographs a certificate by controlling the camera <NUM> and the light <NUM> based on the photographing instruction of the user, and generates a certificate image (step S11). Next, the information reading unit <NUM> acquires the character information and the face image from the certificate image (step S12). Also, the information reading unit <NUM> acquires the first hash value embedded in the certificate (step S13). Incidentally, the order of steps S12 and S13 may be reversed, or steps S12 and S13 may be performed in parallel.

Next, the hash comparison unit <NUM> calculates the second hash value from the character information and the face image acquired in step S12 and compares the second hash value with the first hash value acquired in step S13 (step S14). When the first hash value and the second hash value do not coincide with each other (step S15: No), the registration unit <NUM> determines that there is falsification of the certificate and terminates the processing. On the other hand, when the first hash value and the second hash value coincide with each other (step S15: Yes), the registration unit <NUM> determines that there is no falsification of the certificate and registers the certificate image with the DB <NUM> as digital data (step S16). Then, the processing ends.

As described above, according to the terminal device <NUM> of the first example embodiment, when the character information or the face image of the certificate is falsified, it is possible to prevent the registration of the certificate.

Next, modified examples of the first example embodiment will be described. The following modified examples can be applied in an appropriate combination.

As described above, the hash comparison unit <NUM> generates a second hash value from the character information and the face image extracted from the certificate image. At that time, the hash comparison unit <NUM> may generate a single hash value from the data string including both the character information and the face image, or may generate a hash value separately from each of the character information and the face image and combine those hash values to form a second hash value.

In the above-described example embodiment, the hash comparison unit <NUM> generates a hash value from the face image itself. However, the hash comparison unit <NUM> may generate the hash value using information related to the individuality of the face. As the information related to the individuality of the face, it is possible to use the feature quantity extracted from the face image when the face image is used for the face authentication, or the position information of the feature points such as the eye, the nose, and the mouth in the face image, for example.

The above-described first example embodiment can prevent registration of a certificate when falsification is made to character information or a face image of a certificate, but it cannot prevent a malicious person from obtaining a certificate of another person and registering it directly with his or her terminal device. Therefore, in the second example embodiment, the identity of the owner of the certificate and the person who performs the registration operation is checked to prevent the malicious person from registering the certificate of another person with his or her terminal device.

The hardware configuration of the terminal device according to the second example embodiment is the same as the first example embodiment shown in <FIG>, and therefore its description will be omitted.

<FIG> is a block diagram showing a functional configuration of the terminal device <NUM> according to the second example embodiment. The terminal device <NUM> includes a certificate photographing unit <NUM>, an information reading unit <NUM>, a hash comparison unit <NUM>, a registration unit <NUM>, a face image photographing unit <NUM>, and a face authentication unit <NUM>. Since the certificate photographing unit <NUM>, the information reading unit <NUM>, the hash comparison unit <NUM>, and the registration unit <NUM> are basically the same as the certificate photographing unit <NUM>, the information reading unit <NUM>, the hash comparison unit <NUM>, and the registration unit <NUM> of the first example embodiment, description thereof will be omitted.

The face image photographing unit <NUM> controls the camera <NUM> and the light <NUM> on the basis of an instruction of a user to photograph a face image of a person (hereinafter, referred to as an "operator") who performs a registration operation of the certificate. The face image photographing unit <NUM> outputs the photographed face image of the operator (hereinafter, referred to as "photographed face image") to the face authentication unit <NUM>.

The information reading unit <NUM> extracts the character information and the face image from the certificate image in the same manner as the first example embodiment and outputs the face image to the face authentication unit <NUM>. The face authentication unit <NUM> collates the photographed face image inputted from the face image photographing unit <NUM> with the face image of the certificate inputted from the information reading unit <NUM> (hereinafter, referred to as "certificate face image") to perform face authentication. Then, the face authentication unit <NUM> outputs the face authentication result to the registration unit <NUM>.

The registration unit <NUM> registers the certificate image according to the comparison result inputted from the hash comparison unit <NUM> and the face authentication result inputted from the face authentication unit <NUM>. Specifically, when the comparison result indicates that the first hash value coincides with the second hash value, and the face authentication result indicates that the photographed face image and the certificate face image show the same person, the registration unit <NUM> stores the certificate image generated by the certificate photographing unit <NUM> in the DB <NUM> as the digital data. On the other hand, when the comparison result indicates that the hash values do not coincident with each other or the face authentication result indicates that the images do not show the same person, the registration unit <NUM> displays a message indicating that the certificate cannot be registered, and terminates the processing.

<FIG> is a flowchart of certificate digitization processing by the terminal device <NUM> of the second example embodiment. This processing is realized by the processor <NUM> shown in <FIG>, which executes a program prepared in advance and operates as each element shown in <FIG>.

First, the certificate photographing unit <NUM> controls the camera <NUM> and the light <NUM> based on the photographing instruction of the user to photographs a certificate, and generates a certificate image (step S21). the face image photographing unit <NUM> controls the camera <NUM> and the light <NUM> based on the photographing instruction of the user to photograph the face of the operator and generates the face image (step S22). The order of steps S21 and S22 may be reversed. Since the processing of steps S23 to S25 is the same as steps S12 to S14 of the certificate digitization processing of the first example embodiment shown in <FIG>, description thereof will not be repeated.

Next, the hash comparison unit <NUM> calculates a second hash value from the character information and the face image acquired in step S23 and compares the second hash value with the first hash value acquired in step S24 (step S26). When the first hash value and the second hash value do not coincide with each other (step S26: No), the registration unit <NUM> determines that there is falsification of the certificate and terminates the processing. On the other hand, when the first hash value and the second hash value coincide with each other (step S26: Yes), the face authentication unit <NUM> collates the photographed face image obtained in step S22 with the certificate face image obtained from the certificate image (step S27).

When the photographed face image and the certificate face image does not show the same person (step S28: No), the registration unit <NUM> determines that the operator is not the owner of the certificate, and terminates the processing. On the other hand, when the photographed face image and the certificate face image show the same person (step S28: Yes), the registration unit <NUM> determines that there is no falsification of the certificate image and that the operator is the owner of the certificate, and registers the certificate image with the DB <NUM> as digital data (step S29). Then, the processing ends. The determination process of steps S26 and S28 may be reversed in order, or may be performed in parallel.

As described above, the terminal device <NUM> of the second example embodiment registers the certificate when there is no falsification in the character information and face image of the certificate and the person performing the registration operation is the owner of the certificate. Thus, it is possible to prevent that a person registers the certificate of another person with his or her own terminal device.

Next, modified examples of the second example embodiment will be described. The modified examples <NUM> and <NUM> described in the first example embodiment can be similarly applied to the second example embodiment. Further, the following modified examples may be applied to the second example embodiment.

In the second example embodiment, the certificate photographing unit <NUM> photographs a certificate, and the face image photographing unit <NUM> photographs the face image of the operator. At that time, it is preferable to perform the photographing of the certificate and the face image at the same time. Usually, a terminal device such as a smartphone or a tablet has two cameras, i.e., an out-camera and an in-camera. The out-camera is provided on the back side of the terminal device, and photographs a subject displayed on the liquid crystal display of the terminal device. The in-camera is provided on the front side of the terminal device and photographs the side of the user who is viewing the liquid crystal display of the terminal device. Therefore, when the terminal device <NUM> has an out-camera and an in-camera, the certificate is photographed by the out-camera and a person's face image is photographed by the in-camera at the same time. Thus, it is possible to photograph the face image of the person who is performing the registration operation of the certificate simultaneously with photographing the certificate, and it is possible to reliably confirm the identity between the owner and the operator of the certificate. In addition, the face image of the operator may be photographed in such a manner that the operator does not notice that his or her face image is being taken.

Next, a third example embodiment will be described. In the third example embodiment, the terminal device according to the present disclosure is applied to the registration of a driver's license. <FIG> shows a configuration of a terminal device <NUM> according to the third example embodiment. The terminal device <NUM> basically has the same hardware configuration as the first example embodiment shown in <FIG>.

The terminal device <NUM> includes a certificate photographing unit <NUM>, a face image photographing unit <NUM>, a registration unit <NUM>, a storage unit <NUM>, a display control unit <NUM>, and a display unit <NUM>. The certificate photographing unit <NUM> photographs a driver's license which is a certificate by a camera or the like. The certificate photographing unit <NUM> outputs the certificate image generated by the photographing to the registration unit <NUM>. The face image photographing unit <NUM> photographs the face image of the operator performing the registration operation of the certificate by a camera or the like, and outputs the face image to the registration unit <NUM>.

The registration unit <NUM> performs the same determination as in the second example embodiment using the certificate image generated by the certificate photographing unit <NUM> and the face image generated by the face image photographing unit <NUM>. That is, the registration unit <NUM> registers the certificate image with the storage unit <NUM> when it determines that there is no falsification of the certificate based on the certificate image and that the operator is the same person as the owner of the certificate based on the face image.

After the certificate image is registered with the storage unit <NUM>, the display control unit <NUM> displays the certificate image registered with the storage unit <NUM> on the display unit <NUM> in accordance with the user's operation. Incidentally, the display unit <NUM> is constituted by a touch panel or the like, and may also function as an input unit.

Next, a method of registering the certificate image will be specifically described. First, the operator photographs a certificate image. <FIG> shows a manner of photographing a certificate image. As shown, the operator operates the camera of the terminal device <NUM>, and the certificate photographing unit <NUM> photographs a certificate <NUM> which is a driver's license. In one example in this case, when the operator activates the registration application and taps the photographing button, the camera of the terminal device <NUM> photographs the certificate. In another example, when the operator activates the registration application, the registration application may display the count down "<NUM>, <NUM>, <NUM>" at an appropriate timing and automatically photographs the certificate <NUM> by the camera. In yet another example, when the operator activates the registration application, the registration application automatically starts the camera of the terminal device <NUM>, and detects that the certificate <NUM> is in the captured image of the camera and automatically photographs the certificate <NUM>, like a QR code (registered trademark) reader generally used in a smart phone.

Next, the operator photographs a face image. <FIG> shows a manner of photographing a face image. As shown in <FIG>, when photographing a face image, the terminal device <NUM> displays a cursor <NUM> on the display unit <NUM>. The cursor <NUM> moves in accordance with the direction of the operator's face being imaged by the camera. Specifically, the cursor <NUM> moves using the end point <NUM> as a starting point, and the direction of the cursor <NUM> is changed in accordance with the direction of the operator's face in the camera, as indicated by an arrow <NUM>. Further, in the display unit <NUM>, the target point 74a is displayed.

The operator changes the direction of his or her face so that the tip (the end point opposite to the end point <NUM>) of the cursor <NUM> coincides with the target point 74a. When the tip of the cursor <NUM> coincides with the target point 74a, a circular gage <NUM> is displayed around the target point 74a as shown in <FIG>. The gauge <NUM> indicates the duration of the state in which the tip of cursor <NUM> coincides with the target point 74a (hereinafter referred to as the "cursor coincident state"). The operator maintains the direction of his or her face in the cursor coincident state as shown in <FIG>. When the operator maintains the cursor coincident state, the pointer <NUM> of the gauge <NUM> moves around the target point 74a. When the duration of the cursor coincidence state reaches a predetermined time (for example, several seconds), the pointer <NUM> moves around the target point 74a and returns to the <NUM> o'clock position. When the duration of the cursor coincident state reaches the predetermined time, the terminal device <NUM> turns off the target point 74a, and displays the next target point 74b as shown in <FIG>.

When the next target point 74b is displayed, the operator adjusts the direction of his or her face so that the tip of the cursor <NUM> coincides with the target point 74b in the same manner and maintains the cursor coincident state for a predetermined period of time. The terminal device <NUM> repeats this process a predetermined number of times. The reason for performing such process is to confirm that the operator is actually photographing his or her face image using the terminal device. That is, when the operator attempts to register a certificate by displaying another person's face image or the like on the terminal device <NUM>, it is not possible to place the tip of the cursor <NUM> on the target point <NUM>, and hence the registration operation is stopped.

The face image photographing unit <NUM> photographs the face image of the operator while the operator places the tip of the cursor <NUM> on the target point <NUM> a predetermined number of times. For example, the face image photographing unit <NUM> photographs the face image of the operator while the operator maintains the direction of the face in a state that the tip of the cursor <NUM> coincides with the target point <NUM>.

Thus, when the certificate image and the face image are obtained, the registration unit <NUM> registers the certificate image with the storage unit <NUM> when it determines that there is no falsification in the certificate by using the certificate image and that the operator is the same person as the owner of the certificate by using the face image.

Next, the display method of the registered certificate image will be described. <FIG> shows an example of an authentication method for displaying certificate image. When the terminal device <NUM> is set to a certificate display mode, the display authentication screen shown in <FIG> is displayed. The user selects the method of display authentication by the buttons 81a and 81b. When the user selects the passcode button 81a, the terminal device <NUM> displays the passcode entry screen shown in <FIG>. The user performs display authentication by inputting the passcode registered in advance. On the other hand, when the user selects the button 81b of the face authentication, the terminal device <NUM> displays the face authentication screen shown in <FIG>. The user performs display authentication by displaying his or her face with a camera.

When the display authentication is successful in any method, the terminal device <NUM> displays the display information selection screen shown in <FIG>. The display information selection screen includes a button 82a designating all information as the display information, a button 82b designating an age, a button 82c designating a name and an address, and a button 82d designating a digital code.

When the user selects the button 82b in the display information selection screen, the user's face image and age are displayed as shown in <FIG>. When the user selects the button 82c in the display information selection screen, a face image of the user and the address and name of the user are displayed as shown in <FIG>. When the user selects the button 82d in the display information selection screen, the user's face image and a digital code are displayed as shown in <FIG>. Note that the digital code is generated by encoding the name, the address, the driver's license number, and other personal information included in the certificate. Personal information can be acquired by reading the displayed digital code with the corresponding code reader.

On the other hand, when the user selects the button 82a in the display information selection screen, the entire certificate image is displayed as shown in <FIG>. Here, the face image is displayed with some movement in the displayed certificate image. For example, the face image is displayed as a moving image in which the direction of the face changes slightly in the left-right direction or the up-down direction. Thus, it can be proven that the displayed image is not the image generated by simply photographing the image of the certificate and displaying it on the terminal device <NUM>. That is, the movement of the face image proves that the certificate image has been formally registered using the registration application of the terminal device <NUM>.

Further, if the user touches a part of the screen of the terminal device <NUM> as shown in <FIG> when the entire certificate image is being displayed, the region of the certificate is colored with a predetermined color, as shown by the reference numeral <NUM>. Further, a pointer <NUM> of a predetermined shape is displayed at a position touched by a user with a finger on the display screen of the terminal device <NUM>. As the user moves the position of the finger on the display screen, the pointer <NUM> moves in accordance with the movement of the user's finger. In this way, coloring and displaying the pointer <NUM> at the touched position when the user touches the display are methods for indicating that the terminal device <NUM> is not simply displaying the photographed image of the certificate, but displaying the certificate image formally registered using the registration application.

<FIG> is a block diagram illustrating a functional configuration of the information processing device <NUM> according to the fourth example embodiment. The information processing device <NUM> registers the certificate as electronic data. The information processing device <NUM> includes a certificate photographing means <NUM>, an acquisition means <NUM>, a reading means <NUM>, a comparison means <NUM>, a registration means <NUM>, and a storage unit <NUM>. The certificate photographing means <NUM> photographs a certificate and generates a certificate image. The acquisition means <NUM> acquires a first hash value from the certificate. The reading means <NUM> reads character information and a face image from the certificate image. The comparison means <NUM> calculates a second hash value using the character information and the face image and compares the second hash value with the first hash value. The registration means <NUM> stores information related to the certificate in the storage unit <NUM> when the first hash value and the second hash value coincide with each other.

<FIG> is a flowchart of registration processing according to the fourth example embodiment. The certificate photographing means <NUM> photographs a certificate and generates a certificate image (step S31). The acquisition means <NUM> acquires a first hash value from the certificate (step S32). The reading means <NUM> reads character information and a face image from the certificate image (step S33). The comparison means <NUM> calculates a second hash value using the character information and the face image and compares the second hash value with the first hash value (step S34). The registration means <NUM> stores information related to the certificate in the storage unit <NUM> when the first hash value and the second hash value coincide with each other (step S35). Then, the processing ends.

According to the fourth example embodiment, the information processing device <NUM> calculates the second hash value from the character information and the face image extracted from the certificate image and compares the second hash value with the first hash value previously held in the certificate. When the two hash values coincide with each other, the information processing device <NUM> registers the information of the certificate in the storage unit <NUM> on the assumption that there is no falsification of the certificate. Therefore, it is possible to register the information of the certificate as electronic data only when there is no falsification in the contents of the certificate.

Claim 1:
An information processing device comprising:
a certificate acquisition means for acquiring a certificate and generating a certificate image;
an acquisition means for acquiring a first hash value from the certificate;
a reading means for reading information on the surface of the certificate from the certificate image;
a comparison means for calculating a second hash value using the information and comparing the second hash value with the first hash value;
a registration means for storing information related to the certificate based on a result of comparing the second hash value with the first hash value,
a means for acquiring a face image of a user by a camera;
a means for comparing the acquired face image with a face image read from the certificate image;
a means for displaying the acquired face image and a target point on a display; and
a means for displaying, on the display, a cursor that moves in accordance with a direction of the user's face in the acquired face image,
wherein the registration means stores the information related to the certificate when the first hash value and the second hash value coincide with each other and the acquired face image and the face image read from the certificate image coincide with each other, and
wherein the acquiring means acquires the face image by the camera when the position of the cursor and the position of the target point on the display coincide with each other.