Patent Description:
Electronic devices such as smart phones, laptops, remote controls, tablets, smart cards, etc., may use fingerprint recognition e.g. to allow a user to access the device, to authorize transactions carried out using the electronic device, or to authorize the user for accessing a service via the electronic device.

Hence, the electronic device, being for example a smart phone, is equipped with a fingerprint sensor on which the user places her finger in order for the sensor to capture an image of the fingerprint and compare the recorded fingerprint with a pre-stored, authenticated fingerprint template. If the recorded fingerprint matches the pre-stored template, the user is authenticated and the smart phone will perform an appropriate action, such as transitioning from locked mode to unlocked mode, in which the user is allowed access to the smart phone.

For a fingerprint sensor - being based on e.g. a capacitive, optical or an ultra sonic detection signal from the finger - requirements on the materials present between the user's finger and the fingerprint sensing elements (known as pixels) of the sensor are high in terms of precision in thickness and material properties such as for instance dielectric homogeneity for capacitive sensors. In case of a capacitive sensor, when the user touches a fingerprint sensing area (covered by e.g. glass or ceramic) of the smart phone, a capacitor is formed between a surface of the fingerprint sensing area and the fingerprint sensor arranged inside the smart phone. By measuring the capacitance between the surface touched by the user and the sensor at each pixel, the fingerprint of the user may be derived from an image captured by the fingerprint sensor of the user's finger.

fingerprint of the user may be derived from an image captured by the fingerprint sensor of the user's finger.

However, due to a number of reasons, impairment data in the form of quasi-stationary noise may be present in the image captured by the fingerprint sensor which renders the deriving of a fingerprint from a captured image more difficult.

For capacitive sensors, this type of noise is referred to as capacitive noise and may occur for instance due to impairments such as variations in the material stack-up height between the surface of the fingerprint sensing area and the fingerprint sensor, a damaged surface of the fingerprint sensing area in the form of for instance scratches, or due to impairments such as sensor warpage or imperfections in material properties, such as impurities in the material adhesive between the stack-up and the sensing area. and give rise to a recurring noise pattern in captured images. In order to eliminate capacitive noise, sub-µm precision and extremely pure materials may be required. In a practical scenario, such precision in materials is difficult to achieve.

<CIT> discloses a fingerprint sensor that effects capacitive measurement, a sequence of fingerprint images is recorded while a finger is placed on to the sensor. By comparing the best image with previous images of the sequence, the real constituent parts of the present image are determined and the remaining constituent parts are eliminated from the best image. Thus, residual prints and disturbance components brought about by contamination of the bearing area can be eliminated from the fingerprint image.

An object of the present invention is to solve, or at least mitigate, this problem in the art and thus to provide an improved method of at least partly suppressing impairment data present in images captured by the fingerprint sensor.

This object is attained in a first aspect of the invention by a method of a fingerprint sensing system of supressing impairment data present in an image captured by a fingerprint sensor of the fingerprint sensing system according to claim <NUM>.

This object is attained in a second aspect of the invention by a method of a fingerprint sensing system comprising a fingerprint sensor and a processing unit. The fingerprint sensing system is configured to supress impairment data present in an image captured by the fingerprint sensor of the fingerprint sensing system. The fingerprint sensor is configured to capture at least one image of an object contacting the fingerprint sensor, the image comprising impairment data caused by impairments that the fingerprint sensor is subjected to. The processing unit is configured to store the captured image comprising the impairment data, capture at least one further image of a fingerprint of a finger contacting the fingerprint sensor, and process the further captured image of a fingerprint with the stored captured image comprising the impairment data in order to at least partly suppress the impairment data in said further captured image of a fingerprint.

As previously discussed, impairment data in the form of quasi-stationary noise may be present in the image captured by the fingerprint sensor which renders the deriving of a fingerprint from a captured image more difficult. The invention advantageously suppresses such impairment data present in captured images by having a fingerprint sensor capturing an image of an object contacting the sensor. The object is a real finger of a user.

It is noted that several images are captured, and that these images are combined to produce a single image representing the impairment data. Subsequently, when user of an electronic device in which the fingerprint system is arranged wishes to perform an authentication process with the electronic device - being e.g. a smart phone - for instance by pressing her thumb to a home button of the smart phone under which the fingerprint sensor is arranged for unlocking the smart phone, the fingerprint sensor captures a further image of the fingerprint of the user.

The previously stored image comprising the impairment data is fetched from a memory, and the processing unit processes the captured image of the fingerprint with the stored captured image comprising the impairment data in order to suppress or even cancel out the impairment data from the further captured image.

Advantageously, the impairment data present in the further captured image images is suppressed, while the fingerprint is intact.

In an embodiment, not covered by the invention, a rubber stamp is used for creating and storing the single image comprising the impairment data. This may be performed during manufacturing and testing of the fingerprint sensor.

However, in the embodiment where the user's finger is utilized to create the single image comprising the impairment data, a number of advantages are attained.

Firstly, by applying a registration process utilizing the finger of the user, there is no need to perform the "offline" manufacturing test using the rubber stamp; the capturing of the images comprising the impairment data can be performed any time by the user, either upon configuration of the electronic device in which the sensor is arranged, or later.

For instance, it can be envisaged that one or a couple of images are captured each time the user touches a surface of a sensing area of the sensor, for example when the user wishes to unlock the electronic device, being e.g. a smart phone, and when the processing unit of the fingerprint system determines that a sufficient number of images have been captured, the single image is created and stored. Advantageously, the user will not have to engage in a tedious registration process for creating the image comprising the impairment data.

Secondly, the "online" finger registration process advantageously facilitates updating of the stored image. Since the electronic device is subjected to wear - for instance in the form of scratches and cracks in a cover glass covering the sensor - the impairments that the sensor is subjected to may change over time.

This can be overcome by capturing a large set of new images for creating and storing the single image comprising the new impairment data.

New images are repeatedly captured during normal user operation of the electronic device, which new images are combined with the stored single image, wherein the stored image changes over time to reflect changing impairments that the sensor is subjected to.

Hence, a great advantage of capturing images of the user's finger during normal operation of the electronic device implementing the fingerprint sensing system is that estimation of the impairment data can be gradually improved over time (if any refinements are possible). Furthermore, an added benefit of such an approach is that impairments changing over time (i.e. that the user breaks the cover glass of her smart phone) can be compensated for. Further, in an embodiment, it may be envisaged that a confidence metric associated with the image pixels is computed and utilized for the stored single image. If the stored image is not considered reliable enough in certain areas, i.e. the confidence metric is low for certain areas; those areas are not used when suppressing the impairment data of a further captured image. The confidence metric may be computed on a pixel-by-pixel-level or for a cluster of pixels. It can also be envisaged that an overall confidence metric is computed for the complete stored image.

In still an embodiment, the fingerprint sensing system extracts a fingerprint from the further captured image of a fingerprint in which the impairment data has been suppressed, compares a fingerprint of the captured image of the finger with one or more authorised pre-stored fingerprint templates, and authenticates a user if the extracted fingerprint of the captured image is considered to match one or more of the authorised pre-stored fingerprint templates.

In a further aspect, an electronic device is provided comprising the fingerprint sensing system described herein. The electronic device may be embodied e.g. in the form of a smart phone, laptop, remote control, tablet, smart card, smartwatch, etc., or any other type of present or future similarly configured device utilizing fingerprint sensing.

Further provided is a computer program comprising computer-executable instructions for causing the fingerprint sensing system to perform the described method when the computer-executable instructions are executed on a processing unit included in the fingerprint sensing system.

Yet further provided is a computer program product comprising a computer readable medium, the computer readable medium having the above mentioned computer program embodied thereon.

Further embodiments of the invention will be described in the detailed description.

The invention will now be described more fully hereinafter with reference to the accompanying drawings, in which certain embodiments of the invention are shown. This invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided by way of example so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art.

<FIG> shows an electronic device in the form of a smart phone <NUM> in which the present invention may be implemented. The smart phone <NUM> is equipped with a fingerprint sensor <NUM> and a display unit <NUM> with a touch screen interface <NUM>. The fingerprint sensor <NUM> may, for example, be used for unlocking the mobile phone <NUM> and/or for authorizing transactions carried out using the mobile phone <NUM>, etc. The fingerprint sensor <NUM> may alternatively be placed on the backside of the mobile phone <NUM>. It is noted that the fingerprint sensor <NUM> could be integrated in the display unit/touch screen or form part of a smart phone home button.

It is understood that the fingerprint sensor <NUM> according to embodiments of the invention may be implemented in other types of electronic devices, such as laptops, remote controls, tablets, smart cards, smartwatches, etc., or any other type of present or future similarly configured device utilizing fingerprint sensing.

<FIG> illustrates a somewhat enlarged view of the fingerprint sensor <NUM> onto which a user places her finger <NUM>. In the case of employing a capacitive sensing technology, the fingerprint sensor <NUM> is configured to comprise a plurality of sensing elements. A single sensing element (also denoted as a pixel) is in <FIG> indicated by reference numeral <NUM>.

It is noted that the present invention is equally applicable to other fingerprint sensing technologies, such as e.g. optical or ultrasonic sensing.

<FIG> shows the fingerprint sensor <NUM> being part of a fingerprint sensing system <NUM>. The fingerprint sensing system <NUM> comprises the fingerprint sensor <NUM> and a processing unit <NUM>, such as a microprocessor, for controlling the fingerprint sensor <NUM> and for analysing captured fingerprints. The fingerprint sensing system <NUM> further comprises a memory <NUM>. The fingerprint sensing system <NUM> in turn, typically, forms part of the electronic device <NUM> as exemplified in <FIG>. A local memory <NUM> such as a one-time programmable (OTP) memory, flash memory, or random access memory (RAM) may be embedded in the sensor die.

Now upon an object contacting the fingerprint sensor <NUM>, the sensor <NUM> will capture an image of the object in order to have the processing unit <NUM> determine whether the object is a fingerprint of an authorised user or not by comparing the captured fingerprint to one or more authorised fingerprint templates pre-stored in the memory <NUM>.

The fingerprint sensor <NUM> may be implemented using any kind of current or future fingerprint sensing principle, including for example capacitive, optical, ultrasonic or thermal sensing technology. Currently, capacitive sensing is most commonly used, in particular in applications where size and power consumption are important. Capacitive fingerprint sensors provide an indicative measure of the capacitance between (see <FIG>) several sensing elements <NUM> and a finger <NUM> placed on the surface of the fingerprint sensor <NUM>. Acquisition of a fingerprint image is typically performed using a fingerprint sensor <NUM> comprising a plurality of sensing elements <NUM> arranged in a two-dimensional manner.

In a general authorization process, the user places her finger <NUM> on the sensor <NUM> for the sensor to capture an image of the fingerprint of the user. The processing unit <NUM> evaluates the captured fingerprint and compares it to one or more authenticated fingerprint templates stored in the memory <NUM>. If the recorded fingerprint matches the pre-stored template, the user is authenticated and the processing unit <NUM> will typically instruct the smart phone <NUM> to perform an appropriate action, such as transitioning from locked mode to unlocked mode, in which the user is allowed access to the smart phone <NUM>.

With reference again to <FIG>, the steps of the method performed by the fingerprint sensing system <NUM> are in practice performed by the processing unit <NUM> embodied in the form of one or more microprocessors arranged to execute a computer program <NUM> downloaded to the storage medium <NUM> associated with the microprocessor, such as a Random Access Memory (RAM), a Flash memory or a hard disk drive. The processing unit <NUM> is arranged to cause the fingerprint sensing system <NUM> to carry out the method according to embodiments when the appropriate computer program <NUM> comprising computer-executable instructions is downloaded to the storage medium <NUM> and executed by the processing unit <NUM>. The storage medium <NUM> may also be a computer program product comprising the computer program <NUM>. Alternatively, the computer program <NUM> may be transferred to the storage medium <NUM> by means of a suitable computer program product, such as a Digital Versatile Disc (DVD) or a memory stick. As a further alternative, the computer program <NUM> may be downloaded to the storage medium <NUM> over a network. The processing unit <NUM> may alternatively be embodied in the form of a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field-programmable gate array (FPGA), a complex programmable logic device (CPLD), etc. It should further be understood that all or some parts of the functionality provided by means of the processing unit <NUM> may be at least partly integrated with the fingerprint sensor <NUM>.

<FIG> illustrates the principle for capacitive fingerprint sensing, as previously has been discussed. Upon a user contacting a surface no of a fingerprint sensing area (typically by touching the home button) of the smart phone with her finger <NUM>, a capacitor C is formed between the surface <NUM> of the fingerprint sensing area and the fingerprint sensor <NUM> arranged inside the smart phone. The material <NUM> between the surface <NUM> and the fingerprint sensor <NUM> maybe composed of e.g. glass or ceramic.

By measuring the capacitance between the surface no touched by the user and the sensor <NUM>, the fingerprint of the user maybe derived from an image captured by the fingerprint sensor <NUM> of the user's finger <NUM>.

Due to various impairments, such as variations in the stack-up height of the material <NUM> between the surface <NUM> of the fingerprint sensing area and the fingerprint sensor <NUM>, a damaged surface <NUM>, sensor warpage, general imperfections in the properties of the material <NUM> quasi-stationary noise will be present in the images captured by the fingerprint sensor <NUM> which renders the deriving of a fingerprint from the captured images more difficult. Similar noise is also present in case of using optical or ultrasonic fingerprint sensing technologies.

It is desirable to cancel out such noise - or impairment data - from captured images.

With reference again to <FIG>, in a scenario not covered by the invention, during manufacturing and testing of the fingerprint sensor <NUM>, an object commonly referred to as a (flat) rubber stamp may be applied to the surface <NUM> of the fingerprint sensing area of the smart phone instead of a real finger. This rubber stamp typically entirely covers the area <NUM>, and correspondingly all pixels of the fingerprint sensor <NUM>. Such a rubber stamp is typically electrically conductive and connected to ground, in order to present an appropriately high capacitance to the sensor <NUM>. Preferably the total capacitance generated by the rubber stamp should be the same as for a typical human finger.

With reference to <FIG>, that illustrates an embodiment not covered by the invention, for a "perfect" sensor <NUM>, surface <NUM> and material <NUM>, an image captured by the sensor <NUM> of such a rubber stamp would be a uniformly black/grey, without any impairment data in the form of artefacts or noise present in the image, whereas in practice where the sensor <NUM>, surface <NUM> and material <NUM> are subjected to impairments, impairment data forming some type of pattern is oftentimes present in the captured image.

However, in practice, with reference to <FIG>, different individuals of fingerprint sensors are subjected to different impairments, which as a result will give different appearances of the captured rubber stamp image. <FIG> illustrates a further example of impairment data <NUM> present in the captured image in the form of more evident impairment data arranged in a circular or elliptic pattern. This is a pattern which may be the result of an air pocket created in the glass/ceramic material <NUM> between the surface no of the fingerprint sensing area and the fingerprint sensor <NUM>, or by impurities in the glue between the sensor and the cover glass.

No matter the exact appearance of the impairment data present in a captured image, any impairment data will render the extraction of a fingerprint from a captured image more difficult.

<FIG> illustrates a flowchart of a method according to an embodiment of the present invention which solves this problem by suppressing impairment data present in a captured image. Reference is further made to the fingerprint sensing system <NUM> of <FIG>.

In a first step S101, the fingerprint sensor <NUM> captures an image of an object contacting the sensor <NUM>, It is noted that several images are captured, and that these images are combined to produce a single image representing the the combined result of repeated finger touches.

This image may be captured during a manufacturing test of the fingerprint system <NUM> mounted in an intended electronic device <NUM>, such as a smart phone.

In this exemplifying embodiment, the captured image is assumed to have the appearance shown in <FIG>, i.e. comprising elliptically-shaped impairment data <NUM>.

Thereafter, in step S102, the captured image(s) comprising the impairment data is stored in the fingerprint system <NUM>, for example in the OTP memory <NUM> embedded in the sensor die, or in a host memory of the electronic device <NUM>. It is envisaged that the captured image(s) are downsampled or compressed before being stored.

Subsequently, when user of the electronic device <NUM> in which the fingerprint system <NUM> is arranged wishes to perform an authentication process with the electronic device being e.g. a smart phone, for instance by pressing her thumb to a home button of the smart phone under which the fingerprint sensor <NUM> is arranged for unlocking the smart phone <NUM>, the fingerprint sensor <NUM> captures an image of the fingerprint of the user in step S103. The previously stored image comprising the impairment data is thus fetched from the OTP memory <NUM> by the processing unit <NUM>.

Further, in step S104, the processing unit <NUM> processes the captured image of the fingerprint with the stored captured image comprising the impairment data in order to suppress or even cancel out the impairment data from said further captured image.

In an embodiment, the captured fingerprint image is processed using the stored captured image comprising the impairment data <NUM> in step S104, wherein the impairment data <NUM> of the previously stored image cancels out the corresponding impairment data which is present in the captured fingerprint image, while the part of the image pertaining to the actual stamp leaves the fingerprint unaffected.

The processing can be performed in many ways; for instance, (a) the stored captured image comprising the impairment data <NUM> is subtracted from the captured fingerprint image, (b) a linear (or non-linear) combination of the captured fingerprint image and the stored image comprising the impairment data is performed, (c) linear (or non-linear) data fitting of the fingerprint data based on the impairment data, or (d) data modelling of the fingerprint based on the captured image and the stored imaged comprising the impairment data.

Hence, this embodiment advantageously cancels out the impairment data present in the captured image, which greatly helps improve subsequent fingerprint feature extraction from the captured image for matching the captured fingerprint to a pre-stored fingerprint template.

<FIG> illustrates a flowchart of another method according to an embodiment of the present invention which solves the above given problem by suppressing or even cancelling out impairment data present in a captured image. Reference is further made to the fingerprint sensing system <NUM> of <FIG>.

In the invention, the object used is not a rubber stamp, but an actual finger of the user of the electronic device <NUM>, being e.g. a smart phone. In a first step S101, the fingerprint sensor <NUM> captures a plurality of images of the user's finger contacting the sensor <NUM>, four of which are illustrated in <FIG>.

As can be seen in <FIG>, with respect to the actual fingerprint of the user, no image is likely to be identical to the other, as the user does not press her finger against the surface of the sensing area in the same manner for every captured image. Thus, in the four images illustrated in <FIG>, the user's fingerprint is differently positioned, while the impairment data <NUM> which is caused by the electronic device <NUM>, or the sensor <NUM> itself, remains constantly positioned in the captured images. Again with reference to <FIG>, after the plurality of images of the user's fingerprint has been captured in step S101, a single image is created in step S101a from the plurality of images. In practice, tens of images may be captured, or even up to hundreds.

According to the invention, single image is created by combining the plurality of images, i.e. the single image is created by averaging the plurality of captured fingerprint images.

<FIG> illustrates how the single image would look like when the plurality of captured fingerprint images are averaged to create the single image. As was discussed hereinabove - for the plurality of captured images - the part of each captured image representing the fingerprint will differ from one image to another. The averaging process would thus have a filtering effect on the plurality of images and create an image similar to the rubber stamp image, i.e. an image which is uniformly grey, with the exception of the impairment data <NUM> which remains constantly positioned throughout the plurality of images. This is important; if the part of the images pertaining to the actual fingerprint of the user is not "blurred out" when creating the single image, there is a risk that impairment data will not be suppressed correctly and that there could even be further impairment data introduced in a subsequently captured fingerprint image.

The created image is then stored in step S103 for subsequent use.

Now, as previously has been discussed, when user of the electronic device <NUM> in which the fingerprint system <NUM> is arranged wishes to perform an authentication process with the electronic device <NUM>, the fingerprint sensor <NUM> captures a further image of the fingerprint of the user in step S103.

The previously stored image comprising the impairment data, which was created from the plurality of captured fingerprint images being combined, is fetched from the OTP memory <NUM> or from the host memory by the processing unit <NUM>.

Then, in step S104, the processing unit <NUM> processes the further captured image of the fingerprint with the stored created image comprising the impairment data that will be present in all captured images using this particular electronic device <NUM>, in order to supress the impairment data in said further captured image.

In this exemplifying embodiment, the processing by the processing unit <NUM> in step S104 comprises subtracting the captured image comprising the impairment data <NUM> from the further captured fingerprint image.

Again - since the part of the image pertaining to the actual fingerprint is not a part of the single image representing the impairment data - the impairment data <NUM> of the previously created and stored fingerprint image cancels out the corresponding impairment data which is present in the captured fingerprint image, while the actual fingerprint in the captured image remains unaffected.

After the stored image of <FIG> comprising the impairment data <NUM> has been subtracted from the captured image for instance having the appearance illustrated in <FIG>, a clean fingerprint image is obtained - as illustrated in <FIG> - where the impairment data <NUM> advantageously has been completely cancelled out.

This embodiment of utilizing a user's finger for an "online" registration of images in which impairment data is present caused by impairments that the sensor <NUM> is subjected to has a number of advantages over the previously described "offline" approach using a rubber stamp (or any other test device having an appropriate test pattern being applied to the sensing area of the fingerprint sensor).

Firstly, by using the online finger registration process of <FIG>, there is no need to perform the offline manufacturing test using the rubber stamp as described with reference to <FIG>; the capturing of the images comprising the impairment data can be performed any time by the user, either upon configuration of the electronic device <NUM> in which the sensor <NUM> is arranged, or later.

For instance, it can be envisaged that one or a couple of images are captured each time the user touches the surface <NUM> of the sensing area of the sensor <NUM>, for example when the user wishes to unlock the electronic device <NUM>, being e.g. a smart phone, and when the processing unit <NUM> determines that a sufficient number of images have been captured, the single image is created and stored. Advantageously, the user will not have to engage in a tedious registration process for creating the image comprising the impairment data.

In this context, it maybe envisaged that the electronic device <NUM> visually and/or audibly instructs the user how to press her finger against the surface <NUM> of the sensing area of the fingerprint sensor <NUM>.

Secondly, the online finger registration process advantageously facilitates updating of the stored image. Since the electronic device is subjected to wear - for instance in the form of scratches and cracks in a cover glass covering the sensor <NUM> - the impairments that the sensor <NUM> is subjected to changes over time.

This can be overcome by capturing a large set of new images for creating and storing the single image comprising the new impairment data. New images are repeatedly captured during normal user operation of the electronic device <NUM>, which new images are combined with - i.e. averaged with - the stored single image, wherein the stored image changes over time to reflect changing impairments that the sensor is subjected to.

<FIG> illustrates a flowchart of the method according to this embodiment. Hence, the process of <FIG> is performed, and a clean captured image is obtained in step S104.

Now, as the impairments that the fingerprint sensor <NUM> is subjected to changes, new images of the user's fingerprint are repeatedly captured in step S105, preferably during normal user operation of the electronic device <NUM>. These new images - or selected information from these images - are then, as indicated with step S106a combined with the stored single image, and the updated single image created by the combining is stored again in step S106b. Thereafter, the updated single image is used in step S104 for suppressing impairment data in a captured image.

Hence, a great advantage of capturing images of the user's finger during normal operation of the electronic device implementing the fingerprint sensing system is that estimation of the impairment data can be gradually improved over time (if any refinements are possible). Furthermore, an added benefit of such an approach is that impairments changing over time (i.e. that the user damages the glass covering the fingerprint sensor) can be compensated for.

Further, in this and previously described embodiments, it may be envisaged that a confidence metric associated with the image pixels is computed in step Sioib and utilized for the stored single image. If the stored image is not considered reliable enough in certain areas as indicated by the confidence metric stored in step S101c, i.e. the confidence metric is low for certain areas; those areas are not used when suppressing the impairment data of a captured image in step S104. The confidence metric may be computed on a pixel-by-pixel-level or for a cluster of pixels. It can also be envisaged that an overall confidence metric is computed for the complete stored image.

If a plurality of new images are captured as indicated by the step S105, these new images - or selected information from these images - are then as indicated with step S106c used to update the stored confidence metric, and the updated confidence metric is stored again in step S106d for subsequent use in the suppression of impairment data of step S104.

Further, in an embodiment, it is envisaged that a small amount of fluid is applied onto the surface of the sensing area <NUM> of the sensor and/or to the user's finger before an image is captured, in order to further improve the stored image which is used for suppressing impairment data. With the fluid, distinctions between ridges and valleys of the fingerprint is blurred out, while the impairment data remains, which is an advantage for the image which is created and used to suppress impairment data present in a subsequently captured image.

Further, it is envisaged that a user performs a swipe and/or a rotational movement with her finger upon an image being captured; the moving part of the image may thus be identified as the finger while the stationary part of the image is identified as impairment data.

<FIG> illustrates a flowchart where a user is authenticated after the impairment data has been suppressed according to an embodiment of the invention. For a description of the process up until step S104, where the impairment data is cancelled out from the image captured in step S103, reference is made to <FIG>.

Thus, after a clean image has been achieved in step <NUM>, the processing unit <NUM> extracts a fingerprint from the enhanced captured image in step S107 and compares it to one or more previously enrolled fingerprint templates stored in the memory <NUM>. If the extracted fingerprint matches the pre-stored template in step S108, the user is authenticated and the processing unit <NUM> will typically instruct the electronic device <NUM>, being e.g. a smart phone, to perform an appropriate action, such as transitioning from locked mode to unlocked mode, in which the user is allowed access to the smart phone <NUM>.

In an embodiment, the image utilized to suppress impairment data is stored in step S102 in the memory <NUM> of the fingerprint sensing system <NUM>, which memory is external from the actual sensor <NUM> (in contrast to the OTP <NUM> which is on-chip with the sensor <NUM>). Advantageously, besides providing for a greater storage capacity, using the external memory <NUM> avoids storing the created image in the host device. Further advantageous is that in situations where there is a need to replace the fingerprint sensor <NUM> with a new sensor, the stored image comprising the impairment data need not be derived again by performing further tests, since the already created image can be acquired from the external memory upon connection of the new sensor to the memory. However, it is also possible that a new image must be captured and stored for the new sensor.

As has been discussed hereinabove, in case the impairment data is of an additive type, the processing unit <NUM> subtracts a scaled version of the stored image comprising the impairment data from the captured image, wherein the impairment data present in the captured image is suppressed or even cancelled out.

In another embodiment, in case the impairment data is of a multiplicative type, the processing unit <NUM> divides the impairment data present in the captured image with the impairment data of the single stored image, wherein the impairment data present in the captured image is suppressed or even cancelled out.

It can further be envisaged that the impairment data is both additive and multiplicative.

Claim 1:
A method of a fingerprint sensing system (<NUM>) of suppressing impairment data (<NUM>) present in an image captured by a fingerprint sensor (<NUM>) of the fingerprint sensing system (<NUM>), comprising:
capturing (S101) a plurality of images of a fingerprint of a finger contacting the fingerprint sensor (<NUM>), the images comprising impairment data (<NUM>) caused by impairments that the fingerprint sensor (<NUM>) is subjected to;
creating (S101a), by averaging the plurality of captured images of the fingerprint, an image comprising the impairment data (<NUM>) ;
storing (S102) the created image comprising the impairment data;
repeatedly (S105) capturing new images of the fingerprint of the finger during normal user operation of an electronic device (<NUM>) in which the fingerprint sensing system (<NUM>) is arranged, the images comprising impairment data (<NUM>); the method being characterized in comprising:
creating (S106a), by averaging the captured new images and the previously stored image comprising the impairment data, an updated image comprising the impairment data;
storing (S106b) the updated image comprising the impairment data;
capturing (S103) at least one further image of the fingerprint of the finger contacting the fingerprint sensor (<NUM>); and
processing (S104) the further captured image of the fingerprint with the stored updated captured image comprising the impairment data in order to at least partly suppress the impairment data in said further captured image of the fingerprint.