Patent Description:
Official documents are often used to check and test the identity of people. This is typically done manually. For example, a representative of a car rental company may check a customer's driving license before authorising the rental of a car to the customer. Such checking implicitly requires manual verification of the presented documents to check their authenticity. This manual verification is typically based on any number of known standard checks which the assessor may or may not choose to perform.

One problem that is encountered is that people may use forged or counterfeit documents to present false details. In the case of manual verification, the authenticity of a document is assessed using an assessor's experience and many factors are taken into account. Often, an assessor will suspect a presented document is not authentic, but will not be able to identify on what factor they base their assessment. An assessor's ability to assess documents will also be limited by their experience with particular types of documents. Therefore, it is likely that an assessor will struggle to accurately assess rarely used documents or documents of a new type with which they have limited experience.

Manual verification is therefore a highly skilled and labour intensive process that may lead to uncertainty and processing bottlenecks. For this reason, various systems have been developed to assist and automate aspects of this assessment. One such system uses a barcode scanner to scan a barcode on a document and check that the barcode relates to a valid number, or a number that is associated with the details presented on the document.

However, such systems have drawbacks. For example, an up to date database of the associated information must be maintained to avoid false alerts being raised with genuine documents. To correctly assess the authenticity of presented documents, the systems will also need to cope with all previous versions and multiple different types of genuine documents. For example, driving licenses from one country can have a different format and structure to driving licenses from another country, and it is impossible for a human assessor to have detailed knowledge of the various types and format of authentic documents which are permitted. As another specific example, the formatting of a barcode on recently issued driving licenses might be different to older driving licenses and an automated authenticity assessment system using barcodes needs to have details of both versions of the driving license to perform assessment correctly. Moreover, not all documents use the same anti-forgery or anti-counterfeiting measures and it is unfeasible to have a system that can deal with all of the possible measures that may be presented.

One particular anti-counterfeiting measure that is found on many types of official documents uses facial images. The present invention uses computational analysis on facial images present in the documents to overcome the above-mentioned problems.

<CIT> describes a method for issuing a credential that includes scanning in documents (e.g. breeder or ID documents) used to verify the applicant of the credential and creating data records including the image of the documents.

The present invention is defined by the independent claims, with further optional features being defined by the dependent claims.

There is provided a computer-implemented method according to claim <NUM>.

Optionally, acquiring image data pertaining to the document may comprise acquiring at least one image of at least a part of the document. The at least one image may be acquired using one or more of: a visible-light camera, which may be integrated in a user electronic device, an ultraviolet camera, and an infrared camera. Additionally or alternatively, the at least one image may be acquired by transferring from a memory. The memory may be integrated in a user electronic device, or may be in or accessible by a web server. The at least one image may consist of a single image, or comprise multiple images. Optionally, the at least one image may be stored in a memory once acquired.

Optionally, acquiring image data pertaining to the document may further comprise manipulating the at least one image to obtain image data pertaining to the document. Manipulating the at least one image to obtain image data may comprise applying one or more image transforms to the at least one image, such as rotation, resizing, contrast adjustment, brightness adjustment, colour adjustment, gamma correction. Alternatively or additionally, manipulating the at least one image to obtain image data pertaining to the document may comprise cropping the at least one image.

The image data pertaining to the document may consist of a single document image, which may comprise multiple facial representations. Thus, manipulating the at least one image to obtain data pertaining to the document may optionally comprise forming a single document image from the at least one image. Alternatively, the image data pertaining to the document may comprise multiple document images, wherein at least two of the multiple document images may comprise a facial representation.

Preferably, performing facial detection on the image data comprises using at least one face detection algorithm. Optionally, a first face detection algorithm may be used to detect a first facial representation and a second face detection algorithm may be used to detect a second facial representation. The least one face detection algorithm is preferably trained via a machine learning algorithm.

The one or more facial representations each comprise an image of a face, and may each have one or more computer-readable characteristics. For example, a facial representation may be formed of pixels, which may be of varying shades, greyscale, or colour, or may be formed of alphanumeric characters. Additionally or alternatively, a facial representation may be visible under visible light, or under only ultraviolet or infrared light. A facial representation may also be a hologram.

Selecting a first facial representation and a second facial representation may be performed automatically based on one or more detected computer-readable characteristics of the detected facial representations. For example, the first facial representation may be formed of pixels, and the second representation may be formed of alphanumeric characters. Alternatively, selecting a first facial representation and a second facial representation may be performed automatically by random selection. Optionally, if three or more representations are detected, the method may comprise selecting a third facial representation and a fourth facial representation and performing the determining step using the third facial representation and the fourth facial representation.

Optionally, determining whether the image of a face of the first facial representation corresponds to the image of a face of the second facial representation may comprise determining whether the image of a face of the first facial representation matches the image of a face of the second facial representation.

Preferably, determining whether the image of a face of the first facial representation corresponds to the image of a face of the second facial representation comprises the steps of: extracting at least one feature from each of the first facial representation and the second facial representation; combining the extracted features to produce a pair-feature representation; and determining whether the image of a face of the first facial representation corresponds to the image of a face of the second facial representation using the pair-feature representation.

Optionally, determining whether the image of a face of the first facial representation corresponds to the image of a face of the second facial representation may further comprise determining at least one feature for extraction from each of the first facial representation and the second facial representation. The determining may be performed via computer vision algorithm such as a KAZE algorithm, or a Local Binary Patterns (LBP) algorithm. Additionally or alternatively, the determining may be performed via a Deep Neural Network (DNN), which may be trained by deep machine learning. In some instances, the at least one feature may consist of multiple features, where at least one feature of the multiple features is determined by a computer vision algorithm and at least one feature of the multiple features is determined by a DNN.

Preferably, determining whether the image of a face of the first facial representation corresponds to the image of a face of the second facial representation is performed using a machine learning algorithm. The machine learning algorithm may be trained using pair-feature representations.

Optionally, combining the extracted features may comprise combining at least one feature extracted from the first facial representation with at least one corresponding feature extracted from the second facial representation. Optionally, combining the extracted features may comprise combining all features extracted from the first facial representation with all features extracted from the second facial representation. In any case, combining the extracted features may comprise one or more of: concatenating the extracted features of the first facial representation with the extracted features of the second facial representation; adding the extracted features of the first facial representation to the extracted features of the second facial representation; and subtracting the extracted features of the second facial representation from the extracted features of the first facial representation, or subtracting the extracted features of the first facial representation from the extracted features of the second facial representation.

Optionally, prior to the determining, at least one transform may be applied to at least one of the first facial representation and second facial representation such that the first facial representation and the second facial representation are in the same representation space, which may be an embedded space. A first transform may be applied to the first facial representation to transform the first facial representation into the representation space of the second facial representation. Alternatively, a second transform may be applied to the second facial representation to transform the second facial representation into the representation space of the first facial representation. Alternatively, a first transform may be applied to the first facial representation and a second transform is applied to the second facial representation to transform both the first facial representation and the second facial representation into a representation space different from the representation space of the first facial representation and the representation space of the second facial representation. The at least one transform may be trained via a machine learning algorithm.

Optionally, if the images of faces correspond, a flag may be set in memory which identifies the document as being authentic. Likewise, if the images of faces do not correspond, a flag may be set in memory which identifies the document as not being authentic. Optionally, if less than two facial representations are detected, a flag may be set in memory which identifies the document as being invalid. An indicator of any of the flags set in memory may be transmitted to a user electronic device, and the user may be optionally be alerted of the indicator received by user electronic device. When the indicator relates to the document being invalid, the indicator may prompt the user to acquire image data from a second document. The above-described method may then be repeated for the second document.

There is also provided a computer-readable medium comprising executable instructions for performing the above-described method, which is not claimed.

There is also provided a computer comprising a processor configured to execute executable code stored in memory, wherein the executable code comprises instructions for performing the method according to claim <NUM>.

The present disclosure is made by way of example and with reference to the accompanying drawings in which:.

<FIG> shows a system <NUM> in which, according to one embodiment, the disclosed method is implemented. The system comprises user electronic devices <NUM>, <NUM>, including mobile electronic device <NUM>, fixed location electronic device <NUM>, and server <NUM>. The user electronic devices are in communication with at least one communication network <NUM> (which may, but not necessarily, include wireless network <NUM>). Data may be communicated between the user electronic devices. The at least one communication network <NUM> may include the internet, an internet of things (IoT) network, a cellular network, or the like. The wireless network <NUM> may, for example, be a <NUM> LTE network or WiFi communication network, or any other conventionally known wireless communication network. The described network architecture is only exemplary and modifications to it, including removing or adding of network components, are possible.

<FIG> shows selected aspects of the network system <NUM> shown in <FIG>. Specifically, it shows a mobile electronic device <NUM> in communication, over the wireless network <NUM>, with a server <NUM>. The server <NUM> is an electronic device that can be accessed across the network <NUM> by user electronic devices <NUM>, <NUM> to perform computational tasks. The mobile electronic device <NUM> comprises a communication subsystem <NUM> to enable communication across the wireless network <NUM>. The mobile electronic device <NUM> further comprises at least one application <NUM> that can be executed on a processor <NUM> and a camera <NUM> that can be used to acquire image data. The image data and applications <NUM> are stored in memory <NUM> on the mobile electronic device <NUM>.

<FIG> also shows a server <NUM> which is connected to the wireless network <NUM> by a wireless network interface <NUM> and a network interface <NUM>. The server <NUM> further comprises applications <NUM> that can be executed on a processor <NUM>. The server further comprises memory <NUM> on which the applications <NUM> and any data that is received from the wireless network <NUM>, and any electronic device connected thereto, can be stored. The server <NUM> may be distributed and comprise multiple servers, several processors and/or several memory storage locations. Such a distributed server <NUM> may operate by distributing computational tasks and data across its constitute parts and may communicate with other servers to perform computational operations.

<FIG> and <FIG> provide further details of the mobile electronic device <NUM> through which a user may work the method disclosed herein. The mobile electronic device <NUM> comprises a display <NUM>, the camera <NUM>, and an electromagnetic (EM) radiation source <NUM> for illuminating the area to be imaged with the camera <NUM>. The mobile electronic device <NUM> is an example of a user electronic device by which a camera <NUM> may be used to capture image data of an official document <NUM>. This image data may be communicated over the wireless network <NUM> to the server <NUM> and stored in the server memory <NUM>. Other components of the mobile electronic device <NUM> include an input device <NUM>, such as a touch screen or a keyboard, a microphone <NUM>, and an orientation system <NUM>, such as a gyroscope or GPS positioning system.

The memory <NUM> of the mobile electronic device <NUM> includes an operating system <NUM> which stores the computer-readable code for operating the mobile electronic device <NUM>. As mentioned, the memory <NUM> also includes applications <NUM>, such as identity authentication application <NUM>, which are downloadable to memory <NUM> from server <NUM> via the at least one communication network <NUM>, or are pre-stored on the memory <NUM>. Other data <NUM> may also be present in memory <NUM> such as current and historical metadata of the mobile electronic device <NUM>.

The fixed location device <NUM> may have similar components to the mobile electronic device <NUM>. The components may be integrated into the fixed location device <NUM>, or may be in communication with the fixed location device via a port in the fixed location device <NUM>. For example, camera <NUM> may be connected to the fixed location device <NUM> via a USB port or similar in the fixed location device <NUM>.

In the server <NUM>, application software of the stored applications <NUM> executes on the processor <NUM> to acquire image data pertaining to the official document <NUM>. The result of this extraction may be communicated back across the wireless network <NUM> to the mobile electronic device <NUM> and displayed on the display <NUM> to a user.

It will be understood that the system <NUM> described above is merely an exemplary system <NUM> for implementing the disclosed method defined herein.

An official document <NUM> may take one of many forms such as a driving license, a passport, a utility or other bill, a birth certificate, a benefits book, a state identity card, or a residency permit. The term "official document" is therefore intended to cover any document that contains structured information that may be used to verify a person's identity or an aspect relating a person, for example their address. The different forms of official document <NUM> may be referred to herein as being a particular "type" of official document <NUM>, which may be further restricted by the territory of issue. For example, an official document type might be 'UK passport', a 'Finnish driving licence', etc..

Referring to <FIG>, there is an official document <NUM>, which comprises at least one feature such as a facial photograph <NUM>, a secondary facial image <NUM>, or one or more lines of text <NUM>. The at least one feature may be positioned in set locations within the official document <NUM>. The at least one feature may also have set size and format. For example, in an exemplary official document <NUM>, there may be positioned at <NUM> in from the left edge and <NUM> down from the top edge a facial photograph in a particular size and format. For example, the facial photograph may be <NUM> high and <NUM> wide, and depict a face formed of colour pixels (representing the natural colours of the face) at <NUM> dots per inch. To reduce the likelihood of counterfeiting, the structure and format of the official document <NUM>, and its constituent features, may be restricted or difficult to obtain and therefore reproduce. It will be appreciated that particular types of official document <NUM> have particular structures and formats.

One particular feature in an official document <NUM> that is useful for the disclosed method is a facial representation. The term "facial representation" as used herein is intended to mean any image of a face contained in the official document <NUM>, for example facial photograph <NUM> and secondary facial image <NUM>. Such facial representations are not restricted to images of faces obtained directly by photography, but also includes images of faces having one or more characteristics which deviate from those obtained directly by photography. For example, the facial representation may be an image of a face which is formed of alphanumeric characters, such as that shown in <FIG>.

Facial representations in an official document <NUM> have one or more characteristics which are specific to that type of official document <NUM>. For example, a facial representation may be formed of pixels, or formed of alphanumeric and/or non-alphanumeric characters. In other types of official document <NUM>, a facial representation may be visible in visible light, for example a hologram. Alternatively, a facial representation may only be visible under ultraviolet or infrared light. Other characteristics which are present in certain types of official document <NUM> are also suitable for use with the described method. These one or more characteristics may be computer-readable.

As mentioned, in some types of official document <NUM>, a facial representation is formed of pixels. This is the most common computer-readable characteristic of a facial representation in an official document. The pixels may have a range of shades, which may be either greyscale shades or colour shades, forming a greyscale facial representation or a colour facial representation respectively. Alternatively, the pixels may be selected from two shades or colours to form a binary facial representation. Where the facial representation is formed of pixels, the camera <NUM> of the user electronic device <NUM>, <NUM> may be used to capture image data of an official document <NUM> which contains the facial representation formed of pixels. This image data may then be read by processor <NUM> or processor <NUM>. The facial photograph <NUM> shown in <FIG> is an example of a binary facial representation formed of pixels.

In some types of official document <NUM>, a facial representation is formed of alphanumeric and/or non-alphanumeric characters. Alphanumeric characters may include both upper- and lowercase letters, A to Z, as well as the <NUM> Arabic numerals, <NUM> to <NUM>. For official documents <NUM> written in certain languages, alphanumeric characters may also include letter variations such as é and ç. Non-alphanumeric characters may include punctuation characters (for example, !, @, #, (, ), ?, /) as well as symbol characters (for example, ~, £, +, <, >). Optionally, the alphanumeric and/or non-alphanumeric characters may indicate an aspect relating a person such as a personal identifier. For instance, in an exemplary official document <NUM>, the secondary facial image <NUM> is constructed from the letters and numbers that make up the surname and date of birth of the person. This aspect may be used to authenticate the official document <NUM>, or to improve authentication of the official document <NUM>. The second facial image <NUM> shown in <FIG> is an example of a facial representation formed of alphanumeric and/or non-alphanumeric characters.

Where the facial representation is formed of alphanumeric or non-alphanumeric characters, the camera <NUM> of the user electronic device <NUM>, <NUM> may be used to capture image data of an official document <NUM> which contains the facial representation formed of alphanumeric and/or non-alphanumeric. This image data may then be read by processor <NUM> or processor <NUM>. Optionally, the processor <NUM> may decipher from the alphanumeric and/or non-alphanumeric characters of the image data an aspect relating to the person.

It is appreciated that alphanumeric characters and non-alphanumeric characters are in fact formed of pixels. Thus, the alphanumeric and/or non-alphanumeric characters may have a range of shades, which may be either greyscale shades or colour shades. Alternatively, the alphanumeric and/or non-alphanumeric characters may be selected from two shades or colours. However, where it is mentioned herein that the facial representation is formed of pixels, it is intended to exclude the possibility that the facial representation is formed of alphanumeric or non-alphanumeric characters so as to distinguish these two types of facial representation.

In some types of official document <NUM>, a facial representation is a hologram. Holograms are sometimes used in an official document <NUM> as an additional security feature. Where the facial representation is a hologram, the camera <NUM> of the user electronic device <NUM>, <NUM> may be used to capture image data of an official document <NUM> which contains the hologram. Preferably, the image data comprises multiple images or a video of the official document <NUM>. This image data may then be read by processor <NUM> or processor <NUM>. Reconstruction of a two-dimensional image from the hologram may then be performed by processor <NUM> or processor <NUM> using any suitable image reconstruction algorithm known in the art.

A facial representation in an official document <NUM> captured according to the invention does not necessarily have to be normally visible under visible light to a human. In some types of official document <NUM>, a facial representation may only be visible under ultraviolet light or under infrared light. Such facial representations are sometimes used in an official document <NUM> as an additional security feature. For instance, in an exemplary official document <NUM>, the secondary facial image <NUM> may be printed in ink which is only viewable under ultraviolet light.

Where the facial representation is only visible under ultraviolet light or infrared light, the camera <NUM> of the user electronic device <NUM>, <NUM> generally cannot be used to capture image data of an official document <NUM>. Instead, the image data may be captured by an infrared camera <NUM> (not shown) or an ultraviolet camera <NUM> (not shown) which is in communication with the server <NUM> or the user electronic device <NUM>, <NUM>. This image data may then be read by processor <NUM> or processor <NUM>.

The facial representation characteristics described above are merely exemplary based on those commonly seen in different types of official document <NUM>. The facial representation may have other characteristics such as being formed of a thermochromatic ink, an ink that is reactive to particular solvents, an optically variable ink, a magnetic ink, a biometric ink, etc. Suitable detection methods for such inks which can communicate with the server <NUM> or one of the electronic devices <NUM>, <NUM> are known in the art.

The disclosed method is directed towards testing the authenticity of an official document <NUM>. An aspect of this method is determining whether the image of a face in each of two of the facial representations contained in the document correspond to one another, regardless of any difference in characteristics of the two facial representations. For example, referring to the exemplary facial representations in <FIG>, the method determines whether the image of a face in facial photograph <NUM> corresponds to the image of a face in the secondary facial image <NUM>. Assuming that the facial photograph <NUM> and secondary facial image <NUM> are part of an official document <NUM>, as shown in <FIG>, the method then determines the authenticity of the document based on whether the images of faces were deemed to correspond.

Although in some instances the method described above may be performed by a human, such a determination is difficult for a human to make accurately as differences in the characteristics of the facial representations may obscure any differences in the images of the faces. In fact, it is often difficult for a human to decipher minor differences appearing in the images of faces of two facial representations because of differences already present in the two facial representations as a result of their different characteristics. The disclosed method overcomes this problem by implementing the method on a computer (for example, user electronic device <NUM>, <NUM>, or server <NUM>) and using computer processing and computer-vision to exceed the limitations of human vision and visual analysis.

Referring to <FIG>, an overview of the disclosed method is provided below. The method is preferably performed by processor <NUM>, although the method may alternatively be performed by processor <NUM>, or be performed by processor <NUM> in conjunction with processor <NUM>.

The method comprises the basic steps of:.

As noted from the step above, the method is not restricted to an official document <NUM>, but may also be used for any document where at least two facial representations are present. For instance, the method may be used with two images of faces to determine if a copyright has been infringed.

The steps above are now described below in detail. The additional steps shown in <FIG> which are not mentioned above are optional and are also described below in detail.

With reference to step <NUM> of <FIG>, the first step of the method is to acquire image data pertaining to the document.

Acquiring image data pertaining to the document preferably comprises acquiring at least one image of at least a part of the document. The at least one image may be of at least a page of the document, or a substantial portion of the page. For example, the at least one image may comprise at least <NUM>% of the page.

The at least one image may comprise multiple images. The multiple images may be, for example, a first image comprising a first page of an official document <NUM> and a second image comprising a second page of an official document <NUM>. For instance, referring to the official document <NUM> in <FIG>, the first image may be of the lower page with the facial photograph <NUM>, and the second image may be of upper page with the secondary facial image <NUM>. Alternatively, the at least one image may consist of a single image. For instance, referring again to the official document <NUM> in <FIG>, the single image may be of both the upper and lower pages.

The at least one image may be acquired via a camera <NUM> of a user electronic device <NUM>, <NUM>. For example, image data may be acquired via an identification authentication application <NUM> (or webpage) accessed via user electronic device <NUM>, <NUM>. When the application <NUM> is first accessed it loads and executes the applications on to the user electronic device <NUM>, <NUM>. The identification authentication application <NUM> may then prompt the user, via display <NUM> or speaker <NUM>, to use the camera <NUM> to take a photograph of an official document <NUM>, possibly using a separate camera application. Additionally or alternatively, the at least one image may be acquired by transferring from memory <NUM> of the user electronic device <NUM>, <NUM>. In such case, the identification authentication application <NUM> may allow the user to upload an image stored in memory <NUM> on the user electronic device <NUM>, <NUM>.

For facial representations with certain characteristics, such as those only visible in ultraviolet or infrared light, obtaining an image via a camera <NUM> of the user electronic device <NUM>, <NUM> may not be possible. Instead, the at least one image may be acquired via a separate infrared camera <NUM> (not shown) or an ultraviolet camera <NUM> (not shown) which is in communication with the server <NUM> or the user electronic device <NUM>, <NUM>. Where the infrared camera <NUM> or the ultraviolet camera <NUM> is in communication with the user electronic device <NUM>, <NUM>, the identification authentication application <NUM> may prompt the user, via display <NUM> or speaker <NUM>, to use the infrared camera <NUM> or the ultraviolet camera <NUM> to take a photograph of an official document, possibly using a separate camera application. Alternatively, where the infrared camera or the ultraviolet camera are in communication with the server <NUM>, the application <NUM> may prompt acquisition of the at least one image via the infrared camera <NUM> or the ultraviolet camera <NUM>.

Once the at least one image has been acquired, the at least one image may be stored in memory <NUM>, or server memory <NUM>. The memory <NUM> and/or server memory <NUM> may include permanent data storage, such as an optical hard drive, a solid state hard drive, a removable optical disk, etc. Alternatively or additionally, the memory <NUM> and/or server memory <NUM> may include nonpermanent data storage, such as a cache or random access memory (RAM).

In some examples, the server memory <NUM> may have previously acquired and stored the at least one image. The at least one image may then be acquired via server memory <NUM> integrated in or accessible by a server <NUM>, which is connected at least one communication network <NUM>, rather than via identification authentication application <NUM>.

Acquiring image data pertaining to the document may also involve acquiring metadata from the at least one image. The acquired metadata may include one or more of: when the image was captured, the size of the image, the author name, the focal length, the exposure time, the type of user electronic device <NUM>, <NUM> and camera <NUM> used to capture the image, the GPS coordinates or the location the image was captured at, etc. This metadata may be used to assist in authenticating the official document <NUM>.

Acquiring image data pertaining to the document may also involve creating metadata for the at least one image. The created metadata may include one or more of: personal details contained in the official document <NUM> such as name, date of birth, address, telephone number, nationality; and an indication of the type of official document <NUM> (e.g. passport). To achieve this, the at least one image may be passed through a data extraction pipeline that is capable of classifying the type of official document <NUM> in the image and extracting data from the classified document. One such data extraction pipeline is described in European patent application no.

Once the at least one image has been acquired, the at least one image may be manipulated before facial detection is performed. Thus, acquiring image data pertaining to the document may further comprise manipulating the at least one image to obtain image data pertaining to the document.

The purpose of this manipulation is to manipulate the image data into a suitable form for facial detection. For example, the at least one image may be adapted such that image data pertaining to a particular type of official document <NUM> is put in a particular form which is made consistent for that type of document. Advantageously, by increasing the consistency of the input of the facial detection step, an improvement in the accuracy and consistency of the output of the facial detection step is achieved.

Manipulating the at least one image to obtain image data pertaining to the document may comprise applying one or more image transforms to the at least one image. The one or more image transforms may include: rotation, resizing, contrast adjustment, brightness adjustment, colour adjustment, gamma correction, etc., although any other image transformation and editing techniques may also be used. The one or more image transforms may be implemented in the disclosed method by any suitable image transform algorithm known to the skilled person.

In some cases, a different image transform may be applied to each image. For example, each image may be rotated until the top and bottom edges of the document appearing in the image are aligned with the horizontal axis of the image frame. In this case, the size of the rotation is likely to differ for each image, particularly if the images are captured by camera <NUM> of user electronic device <NUM>, <NUM>.

In some cases, the same image transform may be applied to each image. For example, the image transform may compensate for a particular characteristic of camera <NUM>. The characteristic of the camera <NUM> to be compensated may be detected from the at least one image, or may be identified by the metadata of the at least one image. For instance, if the metadata of a number of images indicates a shorter than expected exposure time, the brightness may be adjusted in the same way for all of the images originating from camera <NUM> to compensate for the camera's characteristics.

Once the at least one image has been acquired, it may also be desirable to remove any image data which is not part of the document. For example, if the image data contains data representing a background behind the document, then this background data may be removed. This step is particularly useful if any facial representations appear in the background (for example, facial representations in a document behind the document being imaged, or the face of a user holding up the document), as removing these will improve the accuracy of the facial detection step. Accordingly, manipulating the at least one image to obtain image data pertaining to the document may comprise cropping the at least one image.

For images where both cropping and transformation are required, these processes may be performed in any order.

Once the at least one image has been acquired, the image data pertaining to the document may comprise multiple document images. In other words, each of the at least one images may form a single document image. In this case, at least two of the multiple document images should include a facial representation, otherwise face detection and matching cannot be performed. For example, referring to the official document <NUM> in <FIG>, a first image of the lower page with the facial photograph <NUM> may be the first document image, and a second image of the upper page with the secondary facial image <NUM> may be a second document image. Without both facial photograph <NUM> and secondary facial image <NUM>, face detection and matching cannot be performed.

Alternatively, the image data pertaining to the document may consist of a single document image.

This means that when the at least one image comprises multiple images, the multiple images must be formed into a single document image. In other words, the step of manipulating the at least one image to obtain data pertaining to the document may comprise forming a single document image from the at least one image. One exemplary method for forming a single document image is to position the multiple images adjacent to each other in a single image frame representing a document image. In other words, the multiple images are concatenated into a single document image. For example, referring to the official document <NUM> in <FIG>, a first image of the lower page with the facial photograph <NUM>, and a second image of the upper page with the secondary facial image <NUM> may be positioned in the way shown in <FIG> to form a single document image. Preferably, the single document images have at least two facial representations, otherwise face detection and matching cannot be performed.

With reference to step <NUM> of <FIG>, the second step of the method is to perform facial detection on the image data to detect one or more facial representations existing within the document. The aim of this step is to detect in the official document <NUM> all facial representations existing within that document, such as facial photograph <NUM> and secondary facial image <NUM>.

Performing facial detection on the image data may be performed using at least one face detection algorithm on the image data. A face detection algorithm, as the name suggests, is an algorithm which detects human faces within image data. One suitable face detection algorithm for use with the disclosed method is discussed in <NPL>. This particular face detection algorithm detects, in a cascading manner, a series of features in the image data that each represent part of a face. For example, the algorithm may first detect vertical bright bands in the image data that might represent a nose, then detect horizontal dark bands that might represent eyes, and then detect other general patterns associated with faces. Since the face detection algorithm discussed in Viola and Jones is based on conventional machine learning and computer vision techniques, only a small amount of training image data is required. Another suitable face algorithm for use with the disclosed method that is described in <NPL>, is based on histogram of oriented gradients (HOG) features and support vector machines (SVM). Similar to Viola and Jones, the face detection algorithm in King requires only a small set of training image data.

When a large set of training image data is available, a deep learning method may be utilised for face detection. An exemplary face detection algorithm used for implementing a deep learning method is described in <NPL>.

In many types of official document <NUM>, there is variation in the size and hence resolution of each of the facial representations contained in that official document <NUM>. Typically, the resolution of the facial photograph <NUM> is found to be higher than that of the secondary facial image <NUM>. This difference may result in poor performance for a face detector algorithm which is used to detect both of the facial photograph <NUM> and the second facial image <NUM>. In order to overcome this problem, the present method may employ two different face detection algorithms, one for each of the facial photograph <NUM> and the second facial image <NUM>.

Thus, the step of performing facial detection on the image data may include using a first face detection algorithm and a second face detection algorithm on the image data. In such case, the first face detection algorithm may be configured to detect a higher resolution facial representation than the second face detection algorithm. In this way, the first face detection algorithm may be configured to detect a first facial representation, such as facial photograph <NUM>, whereas the second face detection algorithm may be configured to detect a second facial representation, such as second facial image <NUM>.

The first and second facial detection algorithms may be different types of face detection algorithm. For example, the first face detection algorithm may use the conventional machine algorithm and computer vision techniques discussed in Viola and Jones, whilst the second face detection algorithm may use the deep learning method discussed in King. The type of face detection algorithm may be chosen based on the availability of training image data. If a large amount of training data is available, face detection is preferably performed via the deep learning method.

To optimise the at least one face detection algorithm, training may be performed via a machine learning algorithm for a particular facial representation of a particular official document type, for example for facial photograph <NUM> of official document <NUM>. In this way, the at least one face detection algorithm can be trained to find a specific facial representation contained in a document. As discussed above, this training may use a small or large amount of image data from sample official documents and/or computer-generated official document image data.

Of course, if more than two facial representations with different resolutions are contained within the document, then more than two face detection algorithms may be used on the image data. Generally speaking, the number of face detection algorithms may be the same as the number of facial representations typically found in a particular type of official document <NUM>.

Once one or more facial representations have been detected within the document, the one or more facial representations may be stored in memory <NUM> and/or server memory <NUM>.

With reference to step <NUM> of <FIG>, the third step is to determine whether two or more facial representations have been detected. This may be achieved by, for example, summing the number of facial representations stored in memory <NUM> and/or server memory <NUM>, or storing in memory <NUM> and/or server memory <NUM> a total of the number of facial representations detected.

If it is identified that two or more facial representations have been detected, then the method proceeds to step <NUM>. However, with reference to optional step <NUM> of <FIG>, if less than two facial representations have been detected, a flag may be set in memory <NUM> and/or server memory <NUM> which identifies the document as being invalid. A "valid" document is defined as a document which comprises at least two facial representations.

Once a flag has been set in memory <NUM> and/or server memory <NUM>, an indicator may be transmitted to the user electronic device <NUM>, <NUM>, prompting the user to acquire image data from a second document, as per step <NUM> of <FIG>. For example, the identification authentication application <NUM> may display an error message and prompt the user, via display <NUM> or speaker <NUM>, to provide a different document. Steps <NUM> to <NUM> may be repeated until a valid document is provided by the user.

With reference to step <NUM> of <FIG>, once a valid document is provided, the next step is to select a first facial representation and a second facial representation from the two or more facial representations that have been detected.

Preferably, selecting a first facial representation and a second facial representation is performed automatically based on one or more computer-readable characteristics of the detected facial representations. The computer-readable characteristics are those described above. The first facial representation may be selected to have certain computer-readable characteristics, whereas the second facial representation may be selected to have other computer-readable characteristics. For example, the first facial representation may be a facial representation formed of pixels, such as facial photograph <NUM>, and the second facial representation may be a facial representation formed of alphanumeric and/or non-alphanumeric characters, such as secondary facial image <NUM>.

Additionally or alternatively, selecting a first facial representation and a second facial representation may be performed automatically based on the type of official document <NUM>. In particular, the format of the particular type of official document <NUM> and its facial representations may be taken into consideration for selecting the first and second facial representations. For example, in exemplary official document <NUM> of <FIG>, the facial photograph <NUM> may always be selected as the first facial representation, and the secondary facial image <NUM> may always be selected as the second facial representation. Thus, in addition to, or as an alternative to, using the characteristics of the facial representation, the first and second facial representations may be selected based on size, format, and/or position of the facial representation within the official document <NUM>.

Alternatively, selecting a first facial representation and a second facial representation may be performed automatically by random selection. Any suitable randomised selection algorithm may be used to implement this selection.

With reference to <FIG>, once the first and second facial representations are selected, the method may proceed to step <NUM> to determine if the image of a face in the first and second facial representations correspond. Optionally, if three or more facial representations have been detected, then a third facial representation and a fourth facial representation may be selected, and step <NUM> may additionally determine if the image of a face in the third and fourth facial representations correspond. This may be repeated for a fifth and sixth facial representation, etc., until all of the pairs of facial representations in the official document <NUM> have been tested.

The selection of the third, fourth, fifth, sixth, etc. facial representation may be performed in a similar way to the section of the first and second facial representation, as described above.

With reference to step <NUM> of <FIG>, the next step is to determine whether the image of a face of the first facial representation corresponds to the image of a face of the second facial representation. The aim of this step is to ascertain whether the images of faces contained in the official document <NUM> are based on identical photographs of an identical person. Put another way, the step aims to ascertain whether the facial representations are derived from the same original photograph of a person.

By "correspond" it is meant that the image of a face of the first and second facial representations have a high degree of similarity, and thus a high likelihood of being the same image of a face.

In such case, the likelihood of being the same image of a face may be greater than a first threshold T1, where the first threshold may be one of: <NUM>%, <NUM>%, <NUM>%, <NUM>%, or <NUM>%.

Optionally, the step of determining whether the image of a face of the first facial representation corresponds to the image of a face of the second facial representation may include determining whether the image of a face of the first facial representation matches the image of a face of the second facial representation. By "matches" it is meant that the image of a face of the first and second facial representations are required to have a higher degree of similarity than that required for correspondence, and thus a higher likelihood of being the same image of a face than for those deemed to correspond. In such case, the likelihood of being the same image of a face may be greater than a second threshold T2, where the second threshold may be one of: <NUM>%, <NUM>%, <NUM>%, or <NUM>%.

The required level of similarity will generally be defined by the exact application of the disclosed method. The specified threshold values given above are therefore merely exemplary.

The step of determining whether the image of a face of the first facial representation corresponds or matches to the image of a face of the second facial representation may be achieved by directly comparing the intensities of pixels that facial representations contain. However, the utilisation of pixel intensities could result in an inaccurate determination of whether the official document <NUM> is authentic. This is because pixel intensities are usually affected by different factors such as occlusion, illumination conditions, etc. particularly when the pixel intensities are derived from image data captured by a camera <NUM> of a user electronic device <NUM>, <NUM>. In order to overcome these problems, the disclosed method extracts features from each facial representation in order to perform the determination of correspondence or matching.

In particular, referring to <FIG>, the step of determining whether the image of a face of the first facial representation corresponds to the image of a face of the second facial representation may comprise at least the steps of:.

Each feature that is extracted from the first facial representation preferably corresponds to each feature that is extracted from the second facial representation. For instance, if the feature extracted from the first facial representation is the jawline, then the jawline will also be extracted from the second facial representation. Similarly, if the feature extracted from the first facial representation is the iris, then the iris will also be extracted from the second facial representation.

The extracted features may take many forms, such as a vector form or a bitmap form (also referred to as a raster form). The extracted features may be in a particular form for a particular extracted feature, depending on which form is most suitable for that type of feature. For example, if the extracted feature is the jawline, which can be represented as a single continuous line, then the extracted feature may take a vector form. In another example, if the extracted feature is the iris, which can be represented as a colour image, then the extracted feature may take a bitmap form.

Extracting the at least one feature from each of the first facial representation and the second facial representation may be performed by extracting holistic features from a preselected facial region. Suitable features for extraction may include, for example, one or more of: the forehead, which is bordered laterally by the temples and inferiorly by eyebrows and ears; the eyes, sitting in the orbit and protected by eyelids, and eyelashes; the nose, in particular its shape, the nostrils, and nasal septum; the cheeks covering the maxilla and mandibular (or jaw), the extremity of which is the chin; and the mouth, with the upper lip divided by the philtrum, and the teeth. These features are merely exemplary, and other features may be selected. Alternatively, other features may be determined by an automated means using facial landmarks. In particular, as is further discussed below, once facial landmark localisation is performed on the first and second facial representations, and the at least one feature may be extracted using image patches around the facial landmarks.

Once at least one feature has been extracted from each of the first facial representation and the second facial representation, the extracted features may be combined to produce a pair-feature representation. The pair-feature representation is named as such because it simultaneously represents the features present in the first facial representation and the second facial representation.

In some instances, the step of combining the extracted features may include combining at least one feature extracted from the first facial representation with at least one corresponding feature extracted from the second facial representation to form a pair-feature representation. In such a case, the pair-feature representation is associated with a single corresponding feature from each of the first facial representation and the second facial representation. Preferably, where more than one feature is extracted from each of the first facial representation and the second facial representation, each of the features extracted from the first facial representation are combined with each of the corresponding features extracted from the second facial representation to form multiple pair-feature representations. In such a case, each of the multiple pair-feature representations is associated with a single corresponding feature of each of the first facial representation and the second facial representation.

In other instances, the step of combining the extracted features may include combining all features extracted from the first facial representation with all features extracted from the second facial representation. In such instances, there will exist only a single pair-feature representation for the first facial representation and the second facial representation.

Several exemplary methods are described herein for combining the extracted features. However, the disclosed method should not be considered limited by these methods. Any other methods known to the skilled person for combining the extracted features may also be used with the disclosed method.

In some exemplary methods, the step of combining the extracted features may comprise concatenating the extracted features of the first facial representation with the extracted features of the second facial representation. Concatenation of the extracted features causes the features to be placed adjacent to one another in a single representation space in order to form a pair-feature representation. For instance, in the jawline example mentioned above, the pair-feature representation would consist of a first vector representing the jawline from the first facial representation and a second vector representing the jawline from the second facial representation.

In some exemplary methods, the step of combining the extracted features may comprise adding the extracted features of the first facial representation to the extracted features of the second facial representation. In other exemplary methods, the step of combining the extracted features may comprise subtracting the extracted features of the second facial representation from the extracted features of the first facial representation, or subtracting the extracted features of the first facial representation from the extracted features of the second facial representation. Addition or subtraction of the extracted features causes the features to be amalgamated together in a single representation space in order to form a pair-feature representation. For instance, in the iris example mentioned above, the pair-feature representation may consist of a single bitmap image created by subtracting each of the pixels of the bitmap image of the iris from the second facial representation from each of the pixels of the bitmap image of the iris from the first facial representation.

For concatenation, addition or subtraction of extracted features, the extracted features may be required to have the same width, height and data type. In other words, the extracted features may be required to be in the same representation space. Methods for transforming the facial representations to achieve this are further discussed below.

Once the extracted features have been combined into a single pair-feature representation, or multiple pair-feature representations, it should be determined whether the image of a face of the first facial representation corresponds to the image of a face of the second facial representation using the pair-feature representation.

The method used to determine whether the images of faces correspond may depend on the form of the pair-feature representation. For instance, in the jawline example mentioned above, where the pair-feature representation consists of a first vector representing the jawline from the first facial representation and a second vector representing the jawline from the second facial representation, the determination may be made based on how closely the vectors match, i.e. the distance between the vectors. In the iris example mentioned above, where there pair-feature representation consists of a single bitmap image, the determination may be made based on the extent of null values or near null values in the bitmap image. Note that these methods are merely exemplary, and other methods for determining whether the images of faces correspond are also considered within the scope of the disclosed method.

The methods for determining whether the images of faces correspond are performed by processor <NUM> or processor <NUM> to speed up the processing time and avoid bottlenecking, rather than by manual checks performed by a human. However, since there are many different forms of pair-feature representation, conventionally the identity authentication application <NUM> or stored applications <NUM> would be required to be manually programmed with a multitude of methods for determining whether the images of faces correspond, with each of the multitude of methods relating to a particular form of pair-feature representation. Moreover, since the number of different types of official document <NUM> is vast, and there are consequently many different forms of facial representation (i.e. facial representations with different characteristics), a significant number of different methods would conventionally need to be manually programmed for determining whether the images of faces correspond. Such extensive manual programming is extremely time consuming.

In order to avoid the need for extensive manual programming, and to allow for the method to adapt to new forms of pair-feature representation easily, determining whether the image of a face of the first facial representation matches the image of a face of the second facial representation is performed using a machine learning algorithm. The machine learning algorithm determines whether a pair-feature representation is indicative of corresponding images of faces in the first facial representation and the second facial representation. Put another way, the machine learning algorithm is trained to classify pair-feature representations into those which are formed of images of faces which correspond, and those which are formed of images of faces which do not correspond.

The machine learning algorithm, such as a support vector machine (SVM), may be trained to classify the pair-feature representations using sample pair-feature representations. Typically a small number of around <NUM> or <NUM> sample pair-feature representations of a particular form are required by the machine learning algorithm to classify pair-feature representations into those which are formed of images of faces which correspond, and those which are formed of images of faces which do not correspond, with an acceptable degree of accuracy. The sample pair-feature representations used for training may be determined using sample official documents and/or computer-generated official document image data.

As mentioned above, the one or more features for extraction may be selected or determined by more complex means. In such a case, referring back to <FIG>, the step of determining whether the image of a face of the first facial representation corresponds to the image of a face of the second facial representation may further comprise, prior to the extracting:
determining at least one feature for extraction from each of the first facial representation and the second facial representation (step <NUM>).

As mentioned above, facial landmark localisation may be performed on the first and second facial representations to determine at least one feature for extraction from each of the first and second facial representations. Various methods may be used for facial landmark localisation, such as conventional machine learning methods, as described in <NPL>, and deep machine learning methods, as described in <NPL>, and <NPL>.

Additionally or alternatively, determining at least one feature for extraction from each of the first facial representation and the second facial representation may be performed via a computer vision algorithm. Suitable computer vision algorithms include KAZE algorithms, Local Binary Patterns (LBP) algorithms, Scale Invariant Feature Transform (SIFT) algorithms, and speeded up robust features (SURF) algorithms, and the like. One suitable KAZE algorithm for use with the disclosed method is described in <NPL>. One suitable LBP algorithm for use with the disclosed method is described in <NPL>. One suitable SIFT algorithm for use with the disclosed method is described in <NPL>. One suitable SURF algorithm for use with the disclosed method is described in <NPL>.

Additionally or alternatively, determining at least one feature for extraction from each of the first facial representation and the second facial representation may be performed via a Deep Neural Network (DNN). One suitable DNN for use with the disclosed method is described in <NPL>. Another suitable DNN for use with the disclosed method is described in <NPL>. The DNN may be trained by deep learning. Deep learning is a class of machine learning algorithm which characteristically uses a cascade of multiple layers of nonlinear processing units for extracting features, where each successive layer uses the output from the previous layer as input.

In some instances, the at least one feature may consist of multiple features. For example, the at least one feature may consist of two features, the jawline and the iris. The multiple features may include at least one feature determined by a computer vision algorithm and at least one feature determined by a DNN. Thus, in the example, the jawline may be determined by a computer vision algorithm such as a KAZE algorithm, and the iris by a DNN.

As a consequence of the above-mentioned steps for determining whether the images of faces correspond contained in the document correspond, in particular step <NUM>, the disclosed method can easily be applied to new official document <NUM> types, with limited manual input. For instance, the only manual input required for a new document type (where it is assumed that there is limited training data) is that the feature extraction method should preferably be made via a computer vision algorithm rather than via a DNN.

As mentioned above, in some types of official document <NUM>, the facial representations may have different characteristics. As a consequence of these different characteristics, face matching the image of a face of the first facial representation and the image of a face of the second facial representation to ascertain whether the images of faces are derived from the same original photograph of a person, without additional processing steps, may result in poor matching accuracy. For example, referring to <FIG>, if facial photograph <NUM> is directly compared to secondary facial image <NUM>, then it may be found that the images of faces do not correspond, even though the facial representations are derived from the same original photograph of a person. To address this, the disclosed method provides a means for moving the facial representations into the same representation space, causing the face matching is performed on images of faces in the same representation space. Moving the facial representations into the same representation space is performed by applying at least one transform to at least one of the first facial representation and the second facial representation.

Thus, referring back to <FIG>, the step of determining whether the image of a face of the first facial representation corresponds to the image of a face of the second facial representation may further comprise, prior to the extracting or determining:
applying at least one transform to at least one of the first facial representation and second facial representation such that the first facial representation and the second facial representation are in the same representation space.

In some cases, a first extracting or determining method may be performed prior to applying the at least one transform, and a second extracting or determining method, different from the first, performed after the at least one transform has been applied. For example, a facial landmark localisation method may be performed prior to applying the at least one transform, and a computer vision algorithm and/or a DNN performed after the at least one transform has been applied.

In some cases, a first transform may be applied to the first facial representation to transform the first facial representation into the representation space of the second facial representation. Alternatively, a second transform, different from the first, may applied to the second facial representation to transform the second facial representation into the representation space of the first facial representation. Alternatively, a third transform, different from the first or second transform, may be applied to the first facial representation and a fourth transform, different from the first, second, or third transform, may be applied to the second facial representation to transform both the first facial representation and the second facial representation into a representation space different from the representation space of the first facial representation and the representation space of the second facial representation.

Where the first facial representation is selected to be a particular facial representation of a particular type of official document <NUM>, and the second facial representation is selected to be another facial representation of that particular type of official document <NUM>, the transform between the representation spaces of the first and second facial representation will be consistent documents of that type. For example, the transform between facial photograph <NUM> and secondary facial image <NUM> of official document <NUM> in <FIG> will be the same as the transform for another document of the same type. Thus, the at least one transform may be trained via a machine learning algorithm such as a DNN. A DNN that is suitable for use with the disclosed method is the Generative Adversarial Network described in <NPL>. This training may use a large amount of image data from sample official documents and/or computer-generated official document image data of a particular type of official document <NUM>. For example, a database containing M pairs of images, where M greater than <NUM>, where each pair contains two facial representations of the same face may be used to train the DNN.

Alternatively, the at least one transform may be estimated by determining the common space between the first facial representation and the second facial representation using components analysis techniques such the Linear Discriminant Analysis (LDA).

As mentioned above, the disclosed method can easily be applied to new document types for authenticating those documents. For new official document <NUM> types where the second facial representation of an official document <NUM> is displayed in a different representation space, then the at least one transform should be retained. Optionally, the face detection algorithm that is employed to detect the second facial representation may also be retrained.

The method discussed above for determining whether images of faces contained in a document correspond to each other is useful for testing the authenticity of an official document <NUM>. In particular, the determination of whether the official document <NUM> is authentic may be based on whether the image of a face in the first facial representation corresponds to the image of a face in the second facial representation.

Generally speaking, when the image of a face in the first facial representation corresponds to the image of a face in the second facial representation, the document is deemed to be an authentic official document <NUM>. However, there are a few exceptional circumstances where the document may not be deemed to be an authentic official document <NUM>, even if the first and second facial representations correspond. For example, if more than two facial representations were present in the document, and the images of faces in the first and second facial representations correspond, but the images of faces in the third and fourth representations do not correspond, then the document may not be deemed to be an authentic official document <NUM>. Thus, for most types of official document <NUM>, if at least one of the pairs of facial representations do not correspond then the document may not be deemed to be authentic. Likewise, if all of the pairs of facial representations correspond then the document may be deemed to be authentic. However, this is not necessarily true for all types of official document <NUM>, for example types of official document <NUM> where images of more than one person's face are purposefully present in the official document <NUM> (e.g. a document with facial images of a parent and a child). In that case, a suitable number of pairs of facial representations should have corresponding images of faces. Using metadata which indicates the type of official document <NUM> may be useful in determining which facial representations should have corresponding images of faces.

A flag may be set in memory <NUM> and/or server memory <NUM> which identifies whether the document is deemed authentic or not based on whether the images of faces correspond. With reference to <FIG>, step <NUM>, if the images of faces correspond, a flag may be set in memory <NUM> and/or server memory <NUM> which identifies the document as being authentic. Similarly, with reference to <FIG>, step <NUM>, if the images of faces (of at least one pair) do not correspond, a flag may be set in memory <NUM> and/or server memory <NUM> which identifies the document as being not authentic.

It is noted that deeming or not deeming a document to be authentic is different from establishing whether the document is in fact authentic or counterfeit. Optionally, where a document is deemed to be not authentic, manual checks may be performed on the document to establish whether the document is in fact authentic or counterfeit. Accordingly, an indicator of the flag and other relevant data, such as document images or images or faces present in the document, may be transmitted to the an operator of the server <NUM> and/or a third party for manual checking. In some instances, only a sample of the documents not deemed to be authentic may be sent to the third party for manual checking. The operator of the server <NUM> and/or third party preferably has expertise in the particular type of official document <NUM> deemed to be not authentic.

If the flag is stored in the server memory <NUM>, an indicator of the flag may be transmitted to a user electronic device <NUM>, <NUM>. The indicator may take the form of an electronic message transmitted to the user electronic device <NUM>, <NUM>, and may be readable by the identification authentication application <NUM>. For example, the identification authentication application <NUM> may, in the case of a document that is deemed to be authentic, receive an indicator that validation of the document has been successful. Alternatively, the identification authentication application <NUM> may, in the case of a document that is deemed to be not authentic, receive an indicator that validation of the document has not been successful.

Once the indicator has been received by the user electronic device <NUM>, <NUM>, the user may be alerted of the indicator. For example, the identification authentication application <NUM> may cause display <NUM> of user electronic device to read "VALIDATION SUCCESSFUL" or "VALIDATION UNSUCCESSFUL", or to show a symbol to denote whether validation of the official document <NUM> has been successful, such as a tick or a cross. In another case, the identification authentication application <NUM> may cause speaker <NUM> to play a sound to denote whether validation of the official document <NUM> has been successful.

Claim 1:
A computer-implemented method for testing the authenticity of a document based on whether images of faces contained in a document correspond to each other, the method comprising:
acquiring image data pertaining to the document;
performing facial detection on the image data to detect one or more facial representations existing within the document,
wherein performing facial detection on the image data comprises using a first face detection algorithm and a second face detection algorithm on the image data;
if two or more facial representations are detected, selecting a first facial representation and a second facial representation, wherein the first face detection algorithm is configured to detect the first facial representation and the second face detection algorithm is configured to detect the second facial representation;
determining whether an image of a face of the first facial representation corresponds to an image of a face of the second facial representation, wherein determining whether the image of the face of the first facial representation corresponds to the image of the face of the second facial representation comprises determining that a likelihood of the image of the face of the first facial representation and the image of the face of the second facial representation being images of a same face exceeds a threshold; and
determining whether the document is authentic based on whether the image of a face of the first facial representation corresponds to the image of a face of the second facial representation.