Patent Description:
A method for authentication a user using a fingerprint is used to enhance security of an electronic device. In order to authenticate the user using the fingerprint, the electronic device may include a fingerprint sensor to obtain a fingerprint image.

In order to provide enhanced usability, there are growing needs for including a fingerprint sensor disposed as an in-display type in an electronic device. Therefore, a method for performing authentication using the fingerprint sensor disposed as an in-display type may be required. <CIT>, <CIT>, <CIT> and <CIT> all disclose devices for fingerprint sensing/imaging.

Embodiments of the disclosure are not limited to the technical problems mentioned above, and other unmentioned technical problems can be clearly understood by those skilled in the art from descriptions below.

An electronic device according to various example embodiments may include a display, a touch sensor operatively coupled with the display, and a fingerprint sensor disposed below the display and operatively coupled with the touch sensor. The fingerprint sensor may be configured to: obtain at least one image for calibrating a fingerprint image, receive a signal indicating detection of a touch input from the touch sensor while obtaining the at least one image, and cease to obtain the at least one image based on the reception of the signal.

An electronic device according to various example embodiments may include a display, a fingerprint sensor disposed below the display, a touch sensor operatively coupled with the display and the fingerprint sensor, and at least one processor. The fingerprint sensor may be configured to receive from the at least one processor a signal requesting the fingerprint sensor to obtain the at least one fingerprint image to register a fingerprint or to recognize the fingerprint, identify whether the signal indicating detection of a touch input is received from the touch sensor, in response to receiving the signal requesting to obtain the at least one fingerprint image, obtain the at least one fingerprint image in response to receiving the signal indicating the detection of the touch input from the touch sensor, and transmit, to the at least one processor, information on the at least one fingerprint image for the registration or recognition of the fingerprint, in response to the obtaining.

An electronic device according to various example embodiments may include a display, a fingerprint sensor disposed below the display, a touch sensor operatively coupled with the fingerprint sensor and the display, and at least one processor. The fingerprint sensor is configured to receive a signal requesting the fingerprint sensor to obtain a fingerprint image from the at least one processor while the fingerprint sensor is in an inactive state, switch a state of the fingerprint sensor to a standby state for identifying whether a signal indicating detection of a touch input is received from the touch sensor in response to receiving the signal requesting to obtain the at least one fingerprint image, switch the standby state to an active state in response to receiving the signal indicating the detection of the touch input from the touch sensor while in the standby state, obtain the fingerprint image in response to the switching, and transmit information on the fingerprint image to the at least one processor in response to the obtaining.

A method for operating an electronic device according to various example embodiments may include obtaining at least one image for calibrating a fingerprint image by a fingerprint sensor of the electronic device, the fingerprint sensor being disposed below a display of the electronic device, receiving a signal indicating detection of a touch input from the touch sensor of the electronic device while the fingerprint sensor obtains the at least one image, and ceasing to obtain the at least one image by the fingerprint sensor, based on the reception of the signal.

A method for operating an electronic device according to various example embodiments may include receiving from the at least one processor of the electronic device by a fingerprint sensor of the electronic device disposed below a display of the electronic device, a signal requesting to obtain the at least one fingerprint image to register a fingerprint or to recognize the fingerprint, identifying whether the signal indicating detection of a touch input is received from the touch sensor of the electronic device, in response to receiving the signal requesting to obtain the at least one fingerprint image by the fingerprint sensor, obtaining, the at least one fingerprint image in response to receiving the signal indicating the detection of the touch input by the fingerprint sensor from the touch sensor of the electronic device, and transmitting information on the at least one fingerprint image for the registration or recognition of the fingerprint to the at least one processor by the fingerprint sensor in response to the obtaining.

A method for operating an electronic device according to various example embodiments may include receiving, from the at least one processor of the electronic device by a fingerprint sensor a signal requesting to obtain a fingerprint image, while the fingerprint sensor of the electronic device, disposed below a display of the electronic device, is in an inactive state, switching a state of the fingerprint sensor to a standby state for identifying whether a signal indicating detection of a touch input is received from the touch sensor of the electronic device in response to receiving the signal requesting the fingerprint sensor to obtain the at least one fingerprint image by the fingerprint sensor, switching the standby state to an active state by the fingerprint sensor in response to receiving the signal indicating the detection of the touch input from the touch sensor while the fingerprint sensor is in the standby state, obtaining the fingerprint image by the fingerprint sensor in response to the switching, and transmitting information on the fingerprint image to the at least one processor by the fingerprint sensor in response to the obtaining.

The electronic devices may include, for example, and without limitation, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, a home appliance, or the like.

It should be appreciated that various example embodiments of the present disclosure and the terms used therein are not intended to limit the technological features set forth herein to particular embodiments and include various changes, equivalents, or replacements for a corresponding embodiment. It is to be understood that if an element (e.g., a first element) is referred to, with or without the term "operatively" or "communicatively", as "coupled with," "coupled to," "connected with," or "connected to" another element (e.g., a second element), the element may be coupled with the other element directly (e.g., wiredly), wirelessly, or via a third element.

Wherein, the "non-transitory" storage medium may refer to a tangible device, and may not include a signal (e.g., an electromagnetic wave), but this term does not differentiate between where data is semi-permanently stored in the storage medium and where the data is temporarily stored in the storage medium.

<FIG> is a block diagram illustrating an example electronic device according to various embodiments. The functional structures of the electronic device may be included in the electronic device <NUM> of <FIG>.

Referring to <FIG>, an electronic device <NUM> may include a processor (e.g., including processing circuitry) <NUM>, a memory <NUM>, a display unit (e.g., including a display) <NUM>, a fingerprint sensor <NUM>, and a touch sensor <NUM>.

In various embodiments, the processor <NUM> may include various processing circuitry including, for example, the processor <NUM> of <FIG>. The memory <NUM> may include the memory <NUM> of <FIG>. The display unit <NUM> may include the display unit <NUM> of <FIG>. The fingerprint sensor <NUM> may be included in the sensor module <NUM> of <FIG>, and may include the fingerprint sensor embedded in the display unit <NUM>. The touch sensor <NUM> may include at least one of a touch circuit included in the display unit <NUM> of <FIG> and a sensor circuit included in the display unit <NUM>.

In various embodiments, the processor <NUM> and the memory <NUM> may be disposed inside a housing of the electronic device <NUM>. In various embodiments, the housing may be used to mount other components (e.g., the display unit <NUM>, the fingerprint sensor <NUM>, and the touch sensor <NUM>) in the electronic device <NUM>.

In various embodiments, the display unit <NUM> may be disposed inside the housing. In various embodiments, the display unit <NUM> may be exposed or viewable through at least part of a first face of the housing of the electronic device <NUM>.

In various embodiments, the touch sensor <NUM> may be disposed inside the housing. In various embodiments, the touch sensor <NUM> may be operatively coupled with the display unit <NUM>.

In various embodiments, at least part of the fingerprint sensor <NUM> may be disposed below the display unit <NUM>. In various embodiments, the fingerprint sensor <NUM> may be disposed within a display region of the display unit <NUM>, when viewed from above the display unit <NUM> exposed or viewable through the first face. For example, at least one of a transmitter of the fingerprint sensor <NUM> and a receiver of the fingerprint sensor <NUM> may be disposed within an interval between patterns of light emitting elements in the display unit <NUM> or within an interval between patterns of the touch sensor <NUM>.

For example, referring to <FIG>, the fingerprint sensor <NUM> may be disposed below the display unit <NUM> exposed or viewable through at least part of the housing <NUM> of the electronic device <NUM>. In various embodiments, although not shown in <FIG>, the transparent touch sensor <NUM> may be operatively coupled with the display unit <NUM>.

In various embodiments, the fingerprint sensor <NUM> may be operatively coupled with the touch sensor <NUM>. In various embodiments, the fingerprint sensor <NUM> may be physically connected with the touch sensor <NUM>. For example, the fingerprint sensor <NUM> may be connected with the touch sensor <NUM> through an interface capable of transmitting and receiving data.

In various embodiments, the fingerprint sensor <NUM> may recognize a fingerprint based on various methods. For example, the fingerprint sensor <NUM> may be implemented with an ultrasonic fingerprint sensor which transmits an ultrasonic wave to recognize a fingerprint based on a reflected wave for the transmitted ultrasonic wave. For another example, the fingerprint sensor <NUM> may also be implemented with an optical fingerprint sensor which transmits light to recognize a fingerprint based on reflected light for the transmitted light. For another example, the fingerprint sensor <NUM> may also be implemented with a capacitive fingerprint sensor which recognizes a fingerprint based on a capacitance change. However, the disclosure is not limited thereto.

In various embodiments, the fingerprint sensor <NUM> may interwork with the touch sensor <NUM> to obtain at least one fingerprint image for a user's finger contacted on the display unit <NUM> or obtain at least one image for calibrating the at least one fingerprint image.

For example, the fingerprint sensor <NUM> may receive from the processor <NUM> a signal requesting the fingerprint sensor <NUM> to obtain at least one fingerprint image in order to register a fingerprint. In various embodiments, the processor <NUM> may receive a user input to register a fingerprint for authentication, through a user interface displayed on the display unit <NUM>. In response to receiving the user input, the processor <NUM> may transmit to the fingerprint sensor <NUM> a signal requesting the fingerprint sensor <NUM> to obtain the at least one fingerprint image.

In various embodiments, in response to receiving the signal from the processor <NUM>, the fingerprint sensor <NUM> may identify whether a signal indicating detection of the touch input contacted on the display unit <NUM> is received from the touch sensor <NUM>. For example, the fingerprint sensor <NUM> may identify whether the signal for notifying that the touch input is detected is received from the touch sensor <NUM> through the interface between the touch sensor <NUM> and the fingerprint sensor <NUM>. For the identification, in response to receiving the signal from the processor <NUM>, the fingerprint sensor <NUM> may change or switch a state of the fingerprint sensor <NUM> to a standby state for receiving the signal indicating the detection of the touch input from the touch sensor <NUM>. In various embodiments, the fingerprint sensor <NUM> may maintain the standby state until the touch input is received or may maintain the standby state until a designated time elapses from a timing of the switching. However, the disclosure is not limited thereto.

In various embodiments, the fingerprint sensor <NUM> may receive the signal indicating the detection of the touch input from the touch sensor <NUM>. In response to receiving the signal from the touch sensor <NUM>, the fingerprint sensor <NUM> may recognize that a user's finger is contacted on the display unit <NUM>.

In various embodiments, in response to receiving the signal indicating the detection of the touch input from the touch sensor <NUM>, the fingerprint sensor <NUM> may obtain at least one fingerprint image. In various embodiments, the at least one fingerprint image may be used to register a fingerprint for user authentication. In various embodiments, the at least one fingerprint image may be obtained while the user's finger is contacted on the display unit <NUM>. In various embodiments, since the obtaining of the at least one fingerprint image is performed while the user's finger is contacted on the display unit <NUM>, the at least one fingerprint image may have enhanced quality.

In various embodiments, the fingerprint sensor <NUM> may transmit information on the at least one fingerprint image to the processor <NUM>, in order to register the fingerprint for user authentication. In various embodiments, the processor <NUM> may receive the information on the at least one fingerprint image from the fingerprint sensor <NUM>.

In various embodiments, the memory <NUM> may store the application <NUM> executed in a secure execution environment of the processor <NUM>. In various embodiments, the secure execution environment may be distinct from a general execution environment configured in the processor <NUM>. In various embodiments, the secure execution environment may have a higher security than the general execution environment. It should be noted that the general execution environment may have a lower security than the secure execution environment and does not necessarily refer to an environment without a security setting. In various embodiments, the application <NUM> may be used to remove at least part of operations of the electronic device for registering a fingerprint and operations of the electronic device for calibrating an obtained fingerprint image to recognize the fingerprint. In various embodiments, the processor <NUM> may request the application <NUM> executed in the secure execution environment to obtain at least one fingerprint image for the fingerprint registration, by accessing the memory <NUM> in response to receiving a user input for requesting to register the fingerprint. For example, based on the user input, the processor <NUM> may allocate at least one first core among multiple cores configuring the processor <NUM> to a core for the secure execution environment, and may use at least one second core for the general execution environment among the multiple cores to request the application executed by the at least one first core to obtain the at least one fingerprint image for the fingerprint registration. In various embodiments, in response to the request, the application <NUM> may request the fingerprint sensor <NUM> to identify whether the signal indicating the detection of the touch input is received from the touch sensor <NUM>. In response to the request of the application <NUM>, the fingerprint sensor <NUM> may identify whether the signal indicating the detection of the touch input is received from the touch sensor <NUM>, and may obtain the at least one fingerprint image in response to receiving the signal from the touch sensor <NUM>. The fingerprint sensor <NUM> may provide information on the at least one fingerprint image to the application <NUM>. For example, the fingerprint sensor <NUM> may provide the information on the at least one fingerprint image to the application <NUM> through the at least one first core of the processor <NUM>. The application <NUM> may register the at least one fingerprint image into a security region of the memory <NUM>, in order to use the at least one fingerprint image as a reference fingerprint image for fingerprint recognition. In various embodiments, in response to receiving information on the fingerprint image, the application <NUM> may notify the processor <NUM> that the obtaining of the fingerprint image is successfully complete. The processor <NUM> may request the application <NUM> executed in the secure execution environment to identify whether the touch input is released, based on the notification from the application <NUM>. For example, the processor <NUM> may request the application <NUM> executed by the at least one first core to identify whether the touch input is released, using the at least one second core. In various embodiments, the request may be provided to the application <NUM> from the processor <NUM> to finish operations for registering the fingerprint. The application <NUM> may request the fingerprint sensor <NUM> to identify whether the touch input is released, in response to the request from the processor <NUM>. The fingerprint sensor <NUM> may identify whether a signal indicating the release of the touch input is received from the touch sensor <NUM>, in response to the request from the application <NUM>. In various embodiments, the fingerprint sensor <NUM> may notify the application <NUM> that the signal indicating the release of the touch input is received from the touch sensor <NUM>, in response to receiving the signal indicating the release of the touch input or the release of a contact of the touch input from the touch sensor <NUM>. For example, the fingerprint sensor <NUM> may notify the application <NUM> that the signal indicating the release of the touch input is received from the touch sensor <NUM> through the at least one first core. The application <NUM> may notify the processor <NUM> that operations for the registration of the fingerprint are complete, based on the notification from the fingerprint sensor <NUM>.

As described above, the electronic device <NUM> according to various embodiments may obtain a fingerprint image for registering a fingerprint using the fingerprint sensor <NUM> under the condition that the touch sensor <NUM> detects that a user's finger is contacted on the display unit <NUM>, thereby obtaining the fingerprint image having enhanced quality.

For another example, the fingerprint sensor <NUM> may obtain at least one image for calibrating the fingerprint image obtained through the fingerprint sensor <NUM>, based on interworking with the touch sensor <NUM>. In various embodiments, the fingerprint sensor <NUM> may obtain the at least one image for the calibration, based on detecting that a designated event occurs. In various embodiments, the at least one image for the calibration may imply an image requested to be obtained in a state where the user's finger is not included as an object. In various embodiments, the at least one image for the calibration may imply an image obtained to tune the fingerprint sensor <NUM> for the calibration of the fingerprint image.

In various embodiments, the designated event may imply that a temperature measured by the electronic device <NUM> corresponds to a temperature associated with a value having a lower reliability than a reference reliability among a plurality of values registered to the memory <NUM> for the calibration. For example, assume that the memory <NUM> stores a value 'a' associated with about <NUM> degrees Celsius, a value 'b' associated with about <NUM> degrees Celsius, and a value 'c' associated with about <NUM> degrees Celsius for the calibration, and the value 'b' has a lower reliability than the value 'a' and the value 'c'. The fingerprint sensor <NUM> may determine that the at least one image for the calibration is obtained to improve reliability of the value 'b', based on identifying that a current temperature measured by the electronic device <NUM> corresponds to <NUM> degrees Celsius, and may obtain the at least one image, based on the determination. However, the disclosure is not limited thereto.

In various embodiments, the designated event may imply that a designated time elapses from a timing at which a directly previous calibration is performed. For example, based on identifying that it has passed three days (a designated time) after the directly previous calibration is performed, the fingerprint sensor <NUM> may obtain the at least one image to improve reliability of at least part of the plurality of values. However, the disclosure is not limited thereto.

In various embodiments, based on detecting the occurrence of the event, the fingerprint sensor <NUM> may notify the processor <NUM> that the at least one image is obtained for the calibration. The processor <NUM> may access the memory <NUM> in response to receiving the notification from the fingerprint sensor <NUM>, and thus may request the application <NUM> executed by the at least one first core allocated for the secure execution environment to obtain the at least one image for the calibration, using the at least one second core for the general execution environment. In response to the request from the processor <NUM>, the application <NUM> may request the processor <NUM> to wait for an operation in the general execution environment for a designated time. In response to the request from the processor <NUM>, the application <NUM> may request the processor <NUM> to identify whether a touch input is received while the fingerprint sensor <NUM> obtains the at least one image. The request from the application <NUM> may be provided to the fingerprint sensor <NUM> through the processor <NUM> (or the at least one second core of the processor <NUM>). In response to the request from the application <NUM>, the fingerprint sensor <NUM> may obtain the at least one image, and may provide information on the obtained at least one image to the application <NUM> for the calibration. For example, the fingerprint sensor <NUM> may provide the information on the at least one image to the application <NUM> through the at least one first core of the processor <NUM>. The application <NUM> may improve reliability of at least part of the plurality of values, at least based on the information on the at least one image. Based on identifying the improvement of the reliability of at least part of the plurality of values, the application <NUM> may notify the processor <NUM> (or the at least one second core of the processor <NUM>) that the calibration is successfully complete. Based on the notification from the application <NUM>, the processor <NUM> may resume the ceased operation in the general execution environment.

According to an embodiment, the fingerprint sensor <NUM> may receive a signal indicating that the touch input is detected from the touch sensor <NUM>, while obtaining the at least one image. In response to receiving the signal from the touch sensor <NUM>, in order to cease the calibration, the fingerprint sensor <NUM> may cease to obtain the at least one image. In response to receiving the signal from the touch sensor <NUM>, in order to cease the calibration, the fingerprint sensor <NUM> may transmit the signal indicating the detection of the touch input while obtaining the at least one image. In response to receiving the signal from the fingerprint sensor <NUM>, the processor <NUM> may use the at least one second core to request, through the at least one first core, the application <NUM> to cease the calibration. The application <NUM> may cease the calibration, in response to the request from the processor <NUM>.

The fingerprint sensor <NUM> may cease to obtain the at least one image, based on identifying that a value identified based on the at least one image is out of a reference range. For example, if a foreign material is located on the fingerprint sensor <NUM>, the value identified based on the at least one image may be out of the reference range. Since the at least one image may cause an incorrect calibration or an unnecessary calibration, the fingerprint sensor <NUM> may cease to obtain the at least one image, based on the identification. Based on the identification, in order to cease the calibration, the fingerprint sensor <NUM> according to various embodiments may transmit a signal for notifying the processor <NUM> (e.g., the at least one second core) that the foreign material is detected. In response to receiving the signal from the fingerprint sensor <NUM>, the processor <NUM> may request the application <NUM> to cease the calibration. For example, in response to receiving the signal from the fingerprint sensor <NUM>, the processor <NUM> may use the at least one second core to request, through the at least one first core, the application <NUM> to cease the calibration. In various embodiments, the application <NUM> may cease the calibration, in response to the request from the processor <NUM>.

As described above, the electronic device <NUM> according to various embodiments may identify whether a touch input is received based on signaling between the touch sensor <NUM> and the fingerprint sensor <NUM> while obtaining at least one image for calibrating a fingerprint image using the fingerprint sensor <NUM>. In response to detecting the touch input while obtaining the at least one image using the fingerprint sensor <NUM>, the electronic device <NUM> according to various embodiments may cease the calibration to prevent and/or reduce an unnecessary calibration and/or an incorrect calibration from being performed. In response to detecting the touch input while obtaining the at least one image using the fingerprint sensor <NUM>, the electronic device <NUM> according to various embodiments may cease the calibration to prevent and/or reduce power from being consumed for the unnecessary or incorrect calibration.

For another example, the fingerprint sensor <NUM> may obtain a fingerprint image for recognition, based on interworking with the touch sensor <NUM>. In various embodiments, after registering the fingerprint image as a reference fingerprint image, the fingerprint sensor <NUM> may obtain a fingerprint image to be recognized for user authentication. In various embodiments, the fingerprint sensor <NUM> may receive from the processor <NUM> a signal requesting to obtain the fingerprint image. In various embodiments, the signal may be transmitted from the processor <NUM> to the fingerprint sensor <NUM>, based on that the processor <NUM> detects a designated event. In various embodiments, the designated event may include detecting an execution of an application which requires fingerprint recognition. In various embodiments, the designated event may include detecting a user's gesture for unlocking the electronic device <NUM>. However, the disclosure is not limited thereto.

In various embodiments, in response to receiving the signal from the processor <NUM>, the fingerprint sensor <NUM> may switch a state of the fingerprint sensor <NUM> to a standby state for identifying whether a signal indicating detection of a touch input is received from the touch sensor <NUM>. In various embodiments, the standby state may be released after being maintained for a designated time. In various embodiments, the standby state may also be maintained until the signal indicating the detection of the touch input is received. The fingerprint sensor <NUM> may receive the signal indicating the detection of the touch input from the touch sensor <NUM>, while in the standby state. The fingerprint sensor <NUM> may obtain the fingerprint image, in response to receiving the signal from the touch sensor <NUM>. Since the receiving of the signal from the touch sensor <NUM> may indicate that a user's finger is contacted on the display unit <NUM>, the fingerprint sensor <NUM> may obtain the fingerprint image, in response to receiving the signal from the touch sensor <NUM>. For example, in response to receiving the signal from the touch sensor <NUM>, the fingerprint sensor <NUM> may switch the standby state to an active state for obtaining the fingerprint image, and may obtain the fingerprint image in response to the switching. In various embodiments, the fingerprint sensor <NUM> may transmit information on the fingerprint image to the processor <NUM>. For example, the fingerprint sensor <NUM> may provide the information on the fingerprint image to the application <NUM> executed in the secure execution environment. The application <NUM> may compare the fingerprint image received from the fingerprint sensor <NUM> with a reference fingerprint image registered to the electronic device <NUM>, and may identify whether to authenticate a user who provides the fingerprint image, based on the comparison result.

The fingerprint sensor <NUM> may switch the active state to the standby state, in response to transmitting the information on the fingerprint image. For example, the standby state may imply a state for identifying whether a signal indicating the release of the touch input is received from the touch sensor <NUM>. While in the standby state for identifying whether the signal indicating the release of the touch input is received from the touch sensor <NUM>, the fingerprint sensor <NUM> may transmit the signal indicating the release of the touch input to the processor <NUM>, in response to receiving a signal for notifying the release of the touch input from the touch sensor <NUM>. The processor <NUM> may notify the application <NUM> of the release of the touch input. The application <NUM> may end the operation for fingerprint recognition, based on the notification from the processor <NUM>. Meanwhile, after the fingerprint sensor <NUM> transmits to the processor <NUM> the signal for notifying the release of the touch input, the state of the fingerprint sensor <NUM> may be switched to an inactive state. In various embodiments, the inactive state may imply a state where a function of the fingerprint sensor <NUM> is partially (or entirely) deactivated to decrease power consumption.

As described above, the electronic device <NUM> according to various embodiments may obtain a fingerprint image for recognition, based on interworking between the touch sensor <NUM> and the fingerprint sensor <NUM>, thereby obtaining the fingerprint image having enhanced quality. The electronic device <NUM> according to various embodiments may use the operation of obtaining the fingerprint image to prevent and/or reduce an occurrence of a situation in which a fingerprint of an authenticated user from being incorrectly recognized.

An electronic device (e.g., the electronic device <NUM>) according to various example embodiments described above may include a display (e.g., the display unit <NUM>), a touch sensor (e.g., the fingerprint sensor <NUM>) operatively coupled with the display, and a fingerprint sensor (e.g., the touch sensor <NUM>) disposed below the display and operatively coupled with the touch sensor. The fingerprint sensor may be configured to obtain at least one image for calibrating a fingerprint image, receive a signal indicating detection of a touch input from the touch sensor while obtaining the at least one image, and cease to obtain the at least one image, based on the reception of the signal.

In various example embodiments, the electronic device may further include at least one processor (e.g., the processor <NUM>). The fingerprint sensor may be configured to cease to obtain the at least one image by transmitting a different signal indicating reception of the signal to the at least one processor, in response to the reception of the signal. In various example embodiments, the electronic device may further include a memory (e.g., the memory <NUM>) configured to store an application (e.g., the application <NUM>) executed in a secure execution environment of the at least one processor. The at least one processor may be configured to request the application executed in the secure execution environment to cease the calibration by accessing the memory, in response to receiving the different signal.

In various example embodiments, the fingerprint sensor may be further configured to cease to obtain the at least one image, based on identifying that a value identified based on the at least one image is out of a reference range.

In various example embodiments, the fingerprint sensor may be further configured to include a memory (e.g., the memory <NUM>) configured to store a plurality of values used for the calibration of the fingerprint image and associated with a plurality of temperatures, identify that a measure temperature corresponds to a temperature associated with a value having a lower reliability than a reference reliability among the plurality of temperatures, and obtain the at least one image, based on the identification. In various example embodiments, the electronic device may further include at least one processor, and a memory configured to store an application executed in a secure execution environment of the at least one processor. The fingerprint sensor may be configured to transmit to the at least one processor a signal indicating that the calibration is required, in response to the identification. The at least one processor may be configured to request the application to initiate the calibration by accessing the memory, in response to receiving the signal indicating that the calibration is required, and request the fingerprint sensor to monitor whether the signal indicating the detection of the touch input is received from the touch sensor, in response to obtaining the response for the request from the application. The fingerprint sensor may be further configured to monitor whether the signal indicating the detection of the touch input is received from the touch sensor while the at least one image is obtained, in response to the request from the at least one processor.

In various example embodiments, the fingerprint sensor may be configured to identify that a designated time elapses from a timing at which a directly previous calibration is performed, and obtain the at least one image, based on the identification.

An electronic device according to various example embodiments described above may include a display, a fingerprint sensor disposed below the display, a touch sensor operatively coupled with the display and the fingerprint sensor, and at least one processor. The fingerprint sensor may be configured to receive from the at least one processor a signal requesting the fingerprint sensor to obtain the at least one fingerprint image to register a fingerprint or to recognize the fingerprint, identify whether the signal indicating detection of a touch input is received from the touch sensor, in response to receiving the signal requesting to obtain the at least one fingerprint image, obtain the at least one fingerprint image, in response to receiving the signal indicating the detection of the touch input from the touch sensor, and transmit information on the at least one fingerprint image for the registration or recognition of the fingerprint to the at least one processor, in response to the obtaining. In various example embodiments, the fingerprint sensor may be configured to receive a signal indicating that the touch input is released from the touch sensor, after transmitting the information on the at least one fingerprint image, and transmit the signal indicating that the touch input is released to the at least one processor, in response to receiving the signal indicating that the touch input is released. In various example embodiments, the fingerprint sensor may be configured to switch a state of the fingerprint sensor to a standby state for identifying whether the signal indicating the detection of the touch input is received from the touch sensor, in response to receiving the signal requesting to obtain the at least one fingerprint image, switch the standby state to an active state for obtaining the at least one fingerprint image, in response to receiving the signal indicating the detection of the touch input from the touch sensor, obtain the at least one fingerprint image, in response to the switching, and switch the active state to the standby state for identifying whether the signal indicating that the touch input is released is received, after obtaining the at least one fingerprint image.

In various example embodiments, the electronic device may further include a memory configured to store an application executed in a secure execution environment of the at least one processor. The at least one processor may be configured to request the application executed in the secure execution environment by accessing the memory to obtain the at least one fingerprint image in order to register the fingerprint image, in response to receiving a user input for requesting to register the fingerprint, and transmit to the fingerprint sensor the signal requesting to obtain the at least one fingerprint image, using the application which receives the request. In various example embodiments, the application may be configured to notify the at least one processor of a signal indicating that the fingerprint image is successfully obtained, based on receiving information on the at least one fingerprint image. In various example embodiments, the fingerprint sensor may be configured to receive a signal indicating that the touch input is released from the touch sensor, after transmitting the information on the at least one fingerprint image, and transmit the signal indicating that the touch input is released to the at least one processor, in response to receiving the signal indicating that the touch input is released. The at least one processor may be further configured to receive a signal indicating that the touch input is released from the fingerprint sensor using the application, and identify that the registering of the fingerprint is successfully complete using the application, based on receiving the signal indicating that the touch input is released from the fingerprint sensor.

In various example embodiments, the fingerprint sensor may be further configured to receive a signal indicating that the touch input is released from the touch sensor, after transmitting the information on the at least one fingerprint image, transmit the signal indicating that the touch input is released to the at least one processor, in response to receiving the signal indicating that the touch input is released, and switch a state of the fingerprint sensor to an inactive state, based on the transmission.

An electronic device according to various example embodiments described above may include a display, a fingerprint sensor disposed below the display, a touch sensor operatively coupled with the fingerprint sensor and the display, and at least one processor. The fingerprint sensor may be configured to receive a signal requesting the fingerprint sensor to obtain a fingerprint image from the at least one processor while in an inactive state, switch a state of the fingerprint sensor to a standby state for identifying whether a signal indicating detection of a touch input is received from the touch sensor, in response to receiving the signal requesting to obtain the at least one fingerprint image, switch the standby state to an active state, in response to receiving the signal indicating the detection of the touch input from the touch sensor while in the standby state, obtain the fingerprint image, in response to the switching, and transmit information on the fingerprint image to the at least one processor, in response to the obtaining. In various example embodiments, the electronic device may further include a memory configured to store an application executed in a secure execution environment of the at least one processor. The at least one processor may be configured to receive information on the fingerprint image using the application, compare the fingerprint image with a reference fingerprint image registered in the electronic device using the application, and identify whether to authenticate a user who provides the fingerprint image, based on the comparison result.

In various example embodiments, the fingerprint sensor may be further configured to switch the active state to a standby state for identifying whether a signal indicating that the touch input is released from the touch sensor, based on transmitting the information on the fingerprint image. In various example embodiments, the fingerprint sensor may be further configured to receive the signal indicating that the touch input is released from the touch sensor, while in the standby state for identifying whether the signal indicating the release of the touch input is received from the touch sensor, and based on receiving the signal indicating that the touch input is released from the touch sensor, switch the standby state for identifying whether the signal is received from the touch sensor to the inactive state. In various example embodiments, the fingerprint sensor may be configured to transmit to the at least one processor the signal indicating that the touch input is released, in response to receiving the signal indicating that the touch input is released from the touch sensor, and after transmitting the signal indicating that the touch input is released, switch the standby state for identifying whether the signal is received from the touch sensor to the inactive state.

In various example embodiments, the fingerprint sensor may be physically connected with the touch sensor.

<FIG> is a flowchart illustrating an example operation of an electronic device according to various embodiments. This operation may be performed by the fingerprint sensor of <FIG> or the fingerprint sensor <NUM> of <FIG>.

Referring to <FIG>, in operation <NUM>, the fingerprint sensor <NUM> may receive from the processor <NUM> a signal requesting the fingerprint sensor <NUM> to obtain at least one fingerprint image. For example, the fingerprint sensor <NUM> may receive from the processor <NUM> the signal requesting the fingerprint sensor <NUM> to obtain the at least one fingerprint image in order to register the fingerprint. For example, the signal may be transmitted from the processor <NUM> to the fingerprint sensor <NUM>, in response to detecting a user input for registering the fingerprint in the processor <NUM>. For another example, the fingerprint sensor <NUM> may receive from the processor <NUM> the signal requesting the fingerprint sensor <NUM> to obtain at least one fingerprint image, in order to recognize the fingerprint. For example, the signal may be transmitted from the processor <NUM> to the fingerprint sensor <NUM>, based on an event caused while an application (e.g., a payment application) is executed to request for user authentication through a fingerprint in the processor <NUM>.

In operation <NUM>, in response to receiving the signal from the processor <NUM>, the fingerprint sensor <NUM> may identify whether a signal indicating the detection of the touch input is received from the touch sensor <NUM>. For example, the fingerprint sensor <NUM> may be in a standby state until the signal indicating the detection of the touch input is received from the touch sensor <NUM>. The fingerprint sensor <NUM> may wait until the signal indicating the detection of the touch input is received from the touch sensor <NUM>, in order to obtain a fingerprint image in a state where a finger is in proximity to the display unit <NUM>.

In operation <NUM>, the fingerprint sensor <NUM> may obtain the at least one image, in response to receiving the signal indicating the detection of the touch input from the touch sensor <NUM> ("Yes" in operation <NUM>). In various embodiments, since the fingerprint sensor <NUM> may obtain at least one fingerprint image in response to receiving the signal indicating the detection of the touch input from the touch sensor <NUM>, the at least one image may be obtained in a state where the user's finger is contacted on the display unit <NUM>.

In operation <NUM>, the fingerprint sensor <NUM> may transmit information on the at least one fingerprint image to the processor <NUM>, in response to obtaining the at least one image. For example, the fingerprint sensor <NUM> may provide the information on the at least one fingerprint image to the processor <NUM>, in order to register the fingerprint. For another example, the fingerprint sensor <NUM> may provide the information on the at least one fingerprint image to the processor <NUM>, in order to recognize the fingerprint.

As described above, the electronic device <NUM> according to various embodiments may obtain a fingerprint image for registering a fingerprint (or a fingerprint image for recognizing a fingerprint) using the fingerprint sensor <NUM>, while the user's finger is contacted on the display unit <NUM>.

<FIG> is a signal flow diagram illustrating example operations for registering a fingerprint by components in an electronic device according to various embodiments. These operations may be performed by at least one of the processor <NUM> of <FIG> or <FIG>, the fingerprint sensor <NUM> of <FIG> or <FIG>, and the touch sensor <NUM> of <FIG> or <FIG>.

In <FIG>, operations illustrated and described as being performed by the application <NUM> may imply operations executed by the at least one first core for the secure execution environment among multiple cores of the processor <NUM>. In addition, in <FIG>, an information exchange of the processor <NUM> and the application <NUM> may imply an information exchange between the at least one second core for the general execution environment and the at least one first core for the secure execution environment. However, the disclosure is not limited thereto.

Referring to <FIG>, in operation <NUM>, the processor <NUM> may request the application <NUM> to obtain at least one fingerprint image to register a fingerprint. For example, for the application <NUM> to be executed in the secure execution environment, the processor <NUM> may allocate at least one first core as a core for the secure execution environment among multiple cores of the processor <NUM>, and may use at least one second core for the general execution environment to request, through the at least one first core, the application <NUM> to obtain the at least one fingerprint image in order to register the fingerprint. In other words, by accessing the memory <NUM>, the processor <NUM> may request the application <NUM> executed in the secure execution environment to obtain the at least one fingerprint image in order to register the fingerprint.

In operation <NUM>, the application <NUM> may request the fingerprint sensor <NUM> to obtain the at least one fingerprint image. In various embodiments, the application <NUM> may command the fingerprint sensor <NUM> to wait until the touch input is received through the request to the fingerprint sensor <NUM>, in order to obtain the at least one fingerprint image. The fingerprint sensor <NUM> may receive the request from the application <NUM>. Based on the request, the fingerprint sensor <NUM> may be in a standby state for identifying whether the signal indicating the detection of the touch input is received from the touch sensor <NUM>. In various embodiments, the standby state may be maintained for a designated time, or may be maintained until the signal is received from the touch sensor <NUM>.

In operation <NUM>, in response to detecting the touch input on the display unit <NUM>, the touch sensor <NUM> may transmit the signal indicating the detection of the touch input to the fingerprint sensor <NUM>. In various embodiments, the signal may be transmitted from the touch sensor <NUM> to the fingerprint sensor <NUM> through an interface between the touch sensor <NUM> and the fingerprint sensor <NUM>. The fingerprint sensor <NUM> may receive the signal from the touch sensor <NUM> while in the standby state.

In operation <NUM>, in response to receiving the signal indicating detection of the touch input, the fingerprint sensor <NUM> may obtain the at least one fingerprint image. For example, the fingerprint sensor <NUM> may obtain the at least one fingerprint image in order to register the fingerprint. In various embodiments, the at least one fingerprint image may be obtained while a user's finger is contacted on the display unit <NUM>.

In operation <NUM>, in response to the obtaining, the fingerprint sensor <NUM> may transmit information on the at least one fingerprint image to the application <NUM>. For example, in response to the obtaining, the fingerprint sensor <NUM> may transmit information on the at least one fingerprint image to the application <NUM> through the at least one first core. The application <NUM> may receive the information on the at least one fingerprint image.

In operation <NUM>, the application <NUM> may recognize that the at least one fingerprint image relates to a fingerprint, and in response to the recognition, may report (e.g., notify) to the processor <NUM> (e.g., the at least one second core of the processor <NUM>) that information on the fingerprint image is received. For example, the application <NUM> may report to a general execution environment, which is distinct from the secure execution environment, that the information on the fingerprint image is received.

In operation <NUM>, the processor <NUM> may request the application <NUM> to identify whether the touch input is released. For example, the processor <NUM> may request the application <NUM> to identify whether the touch input is released, through the at least one first core using the at least one second core. In various embodiments, in order to identify whether procedures for registering the fingerprint are complete, the processor <NUM> may request the application <NUM> to identify whether the touch input is released. In various embodiments, the application <NUM> may receive the request from the processor <NUM>.

In operation <NUM>, in response to the request from the processor <NUM>, the application <NUM> may request the fingerprint sensor <NUM> to identify whether the touch input is released. The fingerprint sensor <NUM> may receive the request from the application <NUM> through the at least one first core. Based on receiving the request from the application <NUM>, the fingerprint sensor <NUM> may be in a standby state for identifying whether the touch input is released. For example, the fingerprint sensor <NUM> may be in the standby state until the signal indicating the release of the touch input is received from the touch sensor <NUM>.

In operation <NUM>, the touch sensor <NUM> may transmit to the fingerprint sensor <NUM> the signal indicating the release of the touch input, while the fingerprint sensor <NUM> is in the standby state. For example, in response to identifying that a user's finger is separated from the display unit <NUM>, the touch sensor <NUM> may transmit to the fingerprint sensor <NUM> the signal indicating the release of the touch input. The fingerprint sensor <NUM> may receive from the touch sensor <NUM> the signal indicating the release of the touch input.

In operation <NUM>, the fingerprint sensor <NUM> may notify the application <NUM> that the touch input is released. For example, the fingerprint sensor <NUM> may notify the application <NUM> of the release of the touch input through the at least one first core. For example, the fingerprint sensor <NUM> may notify the application <NUM> of the release of the touch input, in order to complete operations for registering the fingerprint. The application <NUM> may receive the notification from the fingerprint sensor <NUM>.

In operation <NUM>, the application <NUM> may notify the processor <NUM> that the touch input is released, in order to notify the general execution environment that operations for registering the fingerprint are successfully complete. For example, the application <NUM> may notify the at least one second core for the general execution environment that the touch input is released, through the at least one first core. The processor <NUM> may receive the notification from the application <NUM>. In response to the reception, the processor <NUM> may identify that the operations for registering the fingerprint are complete, and may switch a screen displayed on the display unit <NUM> to register the fingerprint to another screen, based on the identification. However, the disclosure is not limited thereto.

As described above, the electronic device <NUM> according to various embodiments may obtain the fingerprint image for registering the fingerprint using the fingerprint sensor <NUM> disposed below the display unit <NUM>, under the condition that the touch input is obtained using the touch sensor <NUM>. Through the obtaining of the fingerprint image, the electronic device <NUM> according to various embodiments may enhance the operations for recognizing the fingerprint.

<FIG> is a flowchart illustrating an example operation of the electronic device <NUM> according to various embodiments. This operation may be performed by the fingerprint sensor of <FIG> or the fingerprint sensor <NUM> of <FIG>.

Referring to <FIG>, in operation <NUM>, the fingerprint sensor <NUM> may obtain at least one image for calibrating a fingerprint image. For example, the fingerprint sensor <NUM> may obtain at least one image for calibrating the fingerprint image, in response to detecting that a designated event occurs in the electronic device <NUM>. In various embodiments, the designated event may include detecting in the electronic device <NUM> that it is directly before performing fingerprint recognition (e.g., an application requiring fingerprint recognition is executed in the electronic device <NUM>, entering a menu for setting a fingerprint is detected in the electronic device <NUM>). An example of the designated event detected by the fingerprint sensor <NUM> will be described below with reference to <FIG> and <FIG>.

In various embodiments, the at least one image may imply an image required to be obtained in a state of not including an external object such as a user's finger, a foreign material, or the like. In various embodiments, the at least one image may imply an image for configuring at least one value for tuning of the fingerprint sensor <NUM>. In various embodiments, the at least one value may be registered or stored in the memory <NUM> as respectively associated with at least one temperature.

In operation <NUM>, while obtaining the at least one image, the fingerprint sensor <NUM> may identify whether a signal indicating detection of a touch input is received from the touch sensor <NUM>. The detecting of the touch input may imply that the external object is included in the at least one image. Therefore, the fingerprint sensor <NUM> may identify whether the signal indicating the detection of the touch input is received from the touch sensor <NUM>, while obtaining the at least one image. The fingerprint sensor <NUM> may maintain the identification, while obtaining the at least one image.

In operation <NUM>, while obtaining the at least one fingerprint image, in response to receiving the signal indicating the detection of the touch input, the fingerprint sensor <NUM> may cease to obtain the at least one image. The detection of the touch input implies that the external object (e.g., a finger contacted on the display unit <NUM>) is included in the at least one image. Therefore, in response to receiving the signal from the touch sensor <NUM>, the fingerprint sensor <NUM> may cease to obtain the at least one image to cease the calibration.

In operation <NUM>, in response to not receiving the touch input while obtaining the at least one image, the fingerprint sensor <NUM> may transmit information on the at least one image to the processor <NUM>. For example, in response to not receiving the signal indicating the detection of the touch input while obtaining the at least one image, the fingerprint sensor <NUM> may transmit information on the at least one image to the application <NUM> through the at least one first core.

As described above, based on receiving the touch input while performing the calibration for tuning of the fingerprint sensor <NUM>, the electronic device <NUM> according to various embodiments may cease the calibration, thereby preventing and/or reducing the calibration from being performed unnecessarily or incorrectly. The electronic device <NUM> according to various embodiments may cease the calibration to prevent and/or reduce the calibration from being performed unnecessarily or incorrectly, thereby preventing and/or reducing power from being unnecessarily consumed in the electronic device <NUM>.

<FIG> is a signal flow diagram illustrating example operations for calibrating a fingerprint image by components in an electronic device in a state where no touch input is received according to various embodiments. These operations may be performed by at least one of the processor <NUM> of <FIG> or <FIG>, the fingerprint sensor <NUM> of <FIG> or <FIG>, or the touch sensor <NUM> of <FIG> or <FIG>.

In <FIG>, operations illustrated and described as being performed by the application <NUM> may imply operations executed by the at least one first core for the secure execution environment among multiple cores of the processor <NUM>. In addition, in <FIG>, operations illustrated and described as being performed by the application <NUM> may imply operations executed by the at least one first core for the secure execution environment among the multiple cores of the processor <NUM>.

Referring to <FIG>, in operation <NUM>, the fingerprint sensor <NUM> may transmit to the processor <NUM> a signal indicating that a calibration of a fingerprint image is required. For example, the fingerprint sensor <NUM> may transmit to the at least one second core of the processor <NUM> the signal indicating that the calibration of the fingerprint image is required. The processor <NUM> may receive the signal from the fingerprint sensor <NUM>.

In operation <NUM>, the processor <NUM> may provide the application <NUM> executed in the secure execution environment with the signal indicating that the calibration is required, by accessing the memory <NUM>. In various embodiments, the processor <NUM> may provide the application with the signal indicating that the calibration is required, through the at least one first core, using the at least one second core. The application <NUM> may receive the signal indicating that the calibration is required. In various embodiments, the application <NUM> may identify that the calibration is initiated, based on the signal.

In operation <NUM>, the application <NUM> may request the processor <NUM> to wait, based on receiving the signal. For example, for the calibration, the application <NUM> may request the processor <NUM> to cease the driving in a general execution environment for a designated time. In various embodiments, based on receiving the signal, the application <NUM> may request to wait for at least one operation executed by the at least one second core using the at least one first core. The processor <NUM> may receive the request from the application <NUM>.

In operation <NUM>, in response to receiving the request, the processor <NUM> may request the fingerprint sensor <NUM> to identify whether a touch input is detected. For example, based on receiving the request, the processor <NUM> may request the fingerprint sensor <NUM> to identify whether the touch input is detected, before switching a state of the processor <NUM> to a standby state. The fingerprint sensor <NUM> may receive the request from the processor <NUM>.

In operation <NUM>, in response to receiving the request, the fingerprint sensor <NUM> may obtain at least one image for the calibration. In the example of <FIG>, the fingerprint sensor <NUM> may obtain the at least one image required for the calibration, in a state where the signal indicating the detection of the touch input is not received from the touch sensor <NUM>.

In operation <NUM>, the fingerprint sensor <NUM> may transmit information on the at least one image to the application <NUM>. For example, the fingerprint sensor <NUM> may provide the information on the at least one image to the at least one first core, thereby transmitting the information on the at least one image to the application <NUM>. The application <NUM> may receive the information on the at least one image from the fingerprint sensor <NUM>.

In operation <NUM>, the application <NUM> may notify the fingerprint sensor <NUM> that the information on the at least one image is successfully received. In various embodiments, in order to indicate that an additional image is unnecessary for the calibration, the application <NUM> may notify the fingerprint sensor <NUM> through the at least one first core that the information on the at least one image is successfully received.

In operation <NUM>, the application <NUM> may perform the tuning of the fingerprint sensor <NUM>, at least based on the information on the at least one image.

In operation <NUM>, after performing the tuning, the application <NUM> may notify the processor <NUM> that the calibration is complete. For example, the application <NUM> may notify the at least one second core that the calibration is complete through the at least one first core, thereby notifying the general execution environment that the calibration is complete. In order to complete the calibration, the application <NUM> may perform the notification to the processor <NUM>.

<FIG> is a signal flow diagram illustrating example operations for calibrating a fingerprint image by components in an electronic device in a state where a touch input is received according to various embodiments. These operations may be performed by at least one of the processor <NUM> of <FIG> or <FIG>, the fingerprint sensor <NUM> of <FIG> or <FIG>, or the touch sensor <NUM> of <FIG> or <FIG>.

In <FIG>, operations illustrated and described as being performed by the application <NUM> may imply operations executed by the at least one first core for the secure execution environment among multiple cores of the processor <NUM>. In addition, in <FIG>, an information exchange of the processor <NUM> and the application <NUM> may imply an information exchange between the at least one second core for the general execution environment and the at least one first core for the secure execution environment.

Referring to <FIG>, in operation <NUM>, the fingerprint sensor <NUM> may transmit to the processor <NUM> a signal indicating that a calibration of a fingerprint image is required. For example, the fingerprint sensor <NUM> may transmit to the at least one first core the signal indicating that the calibration of the fingerprint image is required. The processor <NUM> may receive the signal from the fingerprint sensor <NUM>.

In operation <NUM>, the processor <NUM> may provide the application <NUM> executed in the secure execution environment with the signal indicating that the calibration is required, by accessing the memory <NUM>. The operation <NUM> may correspond to the operation <NUM> of <FIG>.

In operation <NUM>, the application <NUM> may request the processor <NUM> to wait, based on receiving the signal. The operation <NUM> may correspond to the operation <NUM> of <FIG>.

In operation <NUM>, in response to receiving the request, the processor <NUM> may request the fingerprint sensor <NUM> to identify whether a touch input is detected. The operation <NUM> may correspond to the operation <NUM> of <FIG>.

In operation <NUM>, in response to receiving the request, the fingerprint sensor <NUM> may obtain at least one image for the calibration.

In operation <NUM>, while obtaining the at least one fingerprint image, the fingerprint sensor <NUM> may receive the signal indicating the detection of the touch input from the touch sensor <NUM>. For example, based on detecting that a fingerprint is contacted on the display unit <NUM>, the touch sensor <NUM> may transmit a signal indicating the detection of the touch input from the touch sensor <NUM> while the fingerprint sensor <NUM> obtains the at least one fingerprint image.

In operation <NUM>, in response to receiving the signal from the touch sensor <NUM>, the fingerprint sensor <NUM> may cease to obtain the at least one image. Since the at least one image is required not to include an external object for the calibration, the fingerprint sensor <NUM> may cease to obtain the at least one image, in response to receiving the signal from the touch sensor <NUM>, in order to prevent and/or reduce an unnecessary or incorrect calibration.

In operation <NUM>, based on that the obtaining of the at least one image is ceased, the fingerprint sensor <NUM> may notify the processor <NUM> that the touch input is detected. For example, in order to cease the calibration, the fingerprint sensor <NUM> may notify the processor <NUM> that the touch input is detected. The processor <NUM> may receive the notification from the fingerprint sensor <NUM>. For example, the processor <NUM> may receive the notification from the fingerprint sensor <NUM> through the at least one second core.

In operation <NUM>, in response to receiving the notification, the processor <NUM> may notify the application <NUM> that the calibration is to be ceased. For example, the processor <NUM> may use the at least one second core to notify the application <NUM> that the calibration is to be ceased through the at least one first core. For example, in response to receiving the notification, the processor <NUM> may notify the application <NUM> that the calibration is to be ceased, in order to prevent and/or reduce the application <NUM> from performing an unnecessary or incorrect calibration.

As described above, based on detecting that an external object is contacted on the display unit <NUM>, the electronic device <NUM> according to various embodiments may cease to obtain the at least one image for calibrating the fingerprint image using the fingerprint sensor <NUM>, thereby improving resource efficiency.

<FIG> is a flowchart illustrating an example operation of a fingerprint sensor of an electronic device which ceases to obtain an image according to various embodiments. This operation may be performed by the fingerprint sensor of <FIG> or the fingerprint sensor <NUM> of <FIG>.

Referring to <FIG>, in operation <NUM>, the fingerprint sensor <NUM> may obtain at least one image for calibrating a fingerprint image. The operation <NUM> may correspond to the operation <NUM> of <FIG>.

In operation <NUM>, the fingerprint sensor <NUM> may identify whether a signal indicating the detection of the touch input is received from the touch sensor <NUM> while obtaining the at least one image. The operation <NUM> may correspond to the operation <NUM> of <FIG>.

In operation <NUM>, the fingerprint sensor <NUM> may identify whether a value identified based on an image obtained in a state where the signal indicating the detection of the touch input is not received from the touch sensor <NUM> is out of a reference range. For example, in order to identify whether a foreign material is included in the at least one image, the fingerprint sensor <NUM> may identify whether the value identified based on the image obtained in the state where the signal indicating the detection of the touch input is not received from the touch sensor <NUM> is out of the reference range. If the value is within the reference range, the fingerprint sensor <NUM> may perform operation <NUM>. If the value is out of the reference range, the fingerprint sensor <NUM> may perform operation <NUM>.

In operation <NUM>, the fingerprint sensor <NUM> may cease to obtain the at least one image, based on identifying that the value identified based on the image obtained in the state where the signal indicating the detection of the touch input is received from the touch sensor <NUM> or the signal is not received from the touch sensor <NUM> is out of the reference range.

In operation <NUM>, based on identifying that the value is within the reference range, the fingerprint sensor <NUM> may transmit information on the at least one image to the processor <NUM>. For example, in response to identifying that the signal indicating the detection of the touch input is not received while obtaining the at least one image and that the value identified based on the obtained image is within the reference range, the fingerprint sensor <NUM> may transmit the information on the at least one image to the application <NUM> through the at least one first core of the processor <NUM>.

As described above, the electronic device <NUM> according to various embodiments may check whether an image obtained in parallel with receiving of the information on the touch input from the touch sensor <NUM> is an image suitable for calibration, thereby preventing and/or reducing the calibration from being performed unnecessarily or incorrectly.

<FIG> is a flowchart illustrating an example operation of a fingerprint sensor of an electronic device which performs triggering to obtain at least one image for calibrating a fingerprint image according to various embodiments. This operation may be performed by the fingerprint sensor of <FIG> or the fingerprint sensor <NUM> of <FIG>.

Operations <NUM> and <NUM> of <FIG> may be associated with the operation <NUM> of <FIG>.

Referring to <FIG>, in operation <NUM>, the fingerprint sensor <NUM> may identify whether a temperature (or a current temperature) measured by the electronic device <NUM> corresponds to a temperature associated with a value having a lower reliability than a reference reliability. For example, the memory <NUM> may store a plurality of values used to tune the fingerprint sensor <NUM>. In various embodiments, the plurality of values may be stored as respectively associated with a plurality of temperatures. The fingerprint sensor <NUM> may identify whether the temperature measured by the electronic device <NUM> corresponds to a value having a lower reliability than the reference reliability or other values. Upon identifying that the temperature measured by the electronic device <NUM> does not correspond to the temperature associated with the value having the lower reliability than the reference reliability, the fingerprint sensor <NUM> may periodically perform operation <NUM>. Otherwise, upon identifying that the temperature measured by the electronic device <NUM> corresponds to the temperature associated with the value having the lower reliability than the reference reliability, the fingerprint sensor <NUM> may perform operation <NUM>.

In operation <NUM>, based on identifying that the temperature measured by the electronic device <NUM> corresponds to the temperature associated with the value having the lower reliability than the reference reliability, the fingerprint sensor <NUM> may obtain the at least one image for calibrating the fingerprint image.

As described above, the fingerprint sensor <NUM> of the electronic device <NUM> according to various embodiments may calibrate a value having a low reliability among values used to tune the fingerprint sensor <NUM>, thereby improving a fingerprint recognition rate.

Referring to <FIG>, in operation <NUM>, the fingerprint sensor <NUM> may identify whether a designated time elapses from a timing at which a directly previous calibration is performed. For example, in order to improve reliability of the calibration or to match an operation of the fingerprint sensor <NUM> to a recent environment related to the electronic device <NUM>, the fingerprint sensor <NUM> may identify whether a designated time elapses from a timing at which the directly previous calibration is performed. The fingerprint sensor <NUM> may periodically perform the operation <NUM>, based on identifying that the designated time does not elapse from the timing at which the directly previous calibration is performed. The fingerprint sensor <NUM> may perform operation <NUM>, based on identifying that the designated time elapses from the timing at which the directly previous calibration is performed.

In operation <NUM>, the fingerprint sensor <NUM> may obtain the at least one image for calibrating the fingerprint image, based on identifying that the designated time elapses from a timing at which the directly previous calibration is performed.

As described above, the fingerprint sensor <NUM> of the electronic device <NUM> according to various embodiments may periodically update a state of values used for tuning of the fingerprint sensor <NUM>, thereby improving a fingerprint recognition rate.

<FIG> is a flowchart illustrating an example operation of an electronic device according to various embodiments.

This operation may be performed by the fingerprint sensor of <FIG> or the fingerprint sensor <NUM> of <FIG>.

Referring to <FIG>, in operation <NUM>, the fingerprint sensor <NUM> may receive from the processor <NUM> a signal requesting the fingerprint sensor <NUM> to obtain a fingerprint image. For example, in response to detecting that an application requiring fingerprint recognition is executed or a user grips the electronic device <NUM> in a locking state, the processor <NUM> may transmit to the fingerprint sensor <NUM> the signal requesting to obtain the fingerprint image.

In operation <NUM>, in response to receiving the signal from the processor <NUM>, the fingerprint sensor <NUM> may switch the state of the fingerprint sensor <NUM> to the standby state. The fingerprint sensor <NUM> may be in an inactive state before receiving the signal, in order to reduce power consumed by an operation of the fingerprint sensor <NUM>. While in the inactive state, in response to receiving the signal from the processor <NUM>, the fingerprint sensor <NUM> may switch the state of the fingerprint sensor <NUM> to the standby state to identify whether the touch input is detected.

In operation <NUM>, the fingerprint senor <NUM> may identify whether the signal indicating the detection of the touch input is received from the touch sensor, while in the standby state. If the signal is not received from the touch sensor <NUM>, the fingerprint sensor <NUM> may maintain the identification. If the signal is received from the touch sensor <NUM>, the fingerprint sensor <NUM> may perform operation <NUM>.

In operation <NUM>, in response to receiving the signal from the touch sensor <NUM>, the fingerprint sensor <NUM> may switch the state of the fingerprint sensor <NUM> to an active state for obtaining the fingerprint image.

In operation <NUM>, the fingerprint sensor <NUM> may obtain the fingerprint image, in response to the switching to the active state.

In operation <NUM>, the fingerprint sensor <NUM> may transmit information on the fingerprint image to the processor <NUM>, in order to recognize the obtained fingerprint image or to use the obtained fingerprint image for authentication. The information on the fingerprint image may be provided to the application <NUM> executed in the secure execution environment.

As described above, the electronic device <NUM> according to various embodiments may obtain the fingerprint image using the fingerprint sensor <NUM> under the condition that a finger is contacted on the display unit <NUM>. Through the obtaining of the fingerprint image, the electronic device <NUM> according to various embodiments may enhance the operations for recognizing the fingerprint.

<FIG> is a signal flow diagram illustrating example operations of components of an electronic device for authentication which uses a fingerprint according to various embodiments. These operations may be performed by at least one of the processor <NUM> of <FIG> or <FIG>, the fingerprint sensor <NUM> of <FIG> or <FIG>, and the touch sensor <NUM> of <FIG> or <FIG>.

Referring to <FIG>, in operation <NUM>, in response to detecting a touch input, the touch sensor <NUM> may transmit to the fingerprint sensor <NUM> a signal indicating the detection of the touch input. The fingerprint sensor <NUM> may receive the signal from the touch sensor <NUM>.

In operation <NUM>, in response to receiving the signal from the touch sensor <NUM>, the fingerprint sensor <NUM> may obtain a fingerprint image. The fingerprint sensor <NUM> may obtain the fingerprint image to authenticate a user.

In operation <NUM>, in response to obtaining the fingerprint image, the fingerprint sensor <NUM> may provide information on the fingerprint image to the application <NUM> executed in the secure execution environment of the processor <NUM>. For example, in response to obtaining the fingerprint image, the fingerprint sensor <NUM> may provide the information on the fingerprint image to the application <NUM> through the at least one first core. The application <NUM> may receive the information on the fingerprint image.

In operation <NUM>, the application <NUM> may compare the fingerprint image with a reference image stored in a secure region.

In operation <NUM>, based on the comparison result, the application <NUM> may identify whether to authenticate a user.

In operation <NUM>, the application <NUM> may provide information on the identification result to the processor <NUM>. For example, the application <NUM> may provide the information on the identification result to the general execution environment of the processor <NUM>. For example, the application <NUM> may provide the information on the identification result to the at least one second core through the at least one first core. In various embodiments, based on the identification result, the processor <NUM> may display a feedback for authentication on the display unit <NUM> through the at least one second core. For example, based on the identification result, the processor <NUM> may change a screen being displayed to indicate an authentication success, or may change a screen being displayed to indicate an authentication failure.

In operation <NUM>, after transmitting the information on the fingerprint image, the fingerprint sensor <NUM> may switch an active state for obtaining the fingerprint image to a standby state for identifying whether the touch input is released.

In operation <NUM>, the touch sensor <NUM> may transmit to the fingerprint sensor <NUM> a signal indicating that the touch input is released. The fingerprint sensor <NUM> may receive the signal from the touch sensor <NUM>.

In operation <NUM>, in response to receiving the signal from the touch sensor <NUM>, the fingerprint sensor <NUM> may switch the standby state to the inactive state. For example, the fingerprint sensor <NUM> may switch the standby state to the inactive state, in order to reduce power consumed by an operation of the fingerprint sensor <NUM>.

Methods based on the embodiments disclosed in the claims and/or specification of the disclosure can be implemented in hardware, software, or a combination of both.

When implemented in software, computer readable recording medium for storing one or more programs (e.g., software modules) can be provided. The one or more programs stored in the computer readable recording medium are configured for execution performed by one or more processors in the electronic device. The one or more programs include instructions for allowing the electronic device to execute the methods based on the embodiments disclosed in the claims and/or specification of the disclosure.

The program (e.g., the software module or software) can be stored in a random access memory, a non-volatile memory including a flash memory, a Read Only Memory (ROM), an Electrically Erasable Programmable Read Only Memory (EEPROM), a magnetic disc storage device, a Compact Disc-ROM (CD-ROM), Digital Versatile Discs (DVDs) or other forms of optical storage devices, and a magnetic cassette. The program can be stored in a memory configured in combination of all or some of these storage media. In addition, the configured memory may be plural in number.

Further, the program can be stored in an attachable storage device capable of accessing the electronic device through a communication network such as the Internet, an Intranet, a Local Area Network (LAN), a Wide LAN (WLAN), or a Storage Area Network (SAN) or a communication network configured by combining the networks. The storage device can have an access to a device for performing an embodiment of the disclosure via an external port. In addition, an additional storage device on a communication network can have an access to the device for performing the embodiment of the disclosure.

In the aforementioned specific embodiments of the disclosure, a component included in the disclosure is expressed in a singular or plural form according to the specific example embodiment proposed herein. However, the singular or plural expression is selected properly for a situation proposed for the convenience of explanation, and thus the disclosure is not limited to a single or a plurality of components. Therefore, a component expressed in a plural form can also be expressed in a singular form, or vice versa.

An electronic device and a method thereof according to various embodiments may use interworking between a touch sensor of the electronic device and a fingerprint sensor of the electronic device to obtain information associated with a fingerprint, thereby enhancing a recognition rate of the fingerprint.

Advantages acquired in the disclosure are not limited to the aforementioned advantages. Other advantages not mentioned herein can be clearly understood by those skilled in the art to which the disclosure pertains from the following descriptions.

Claim 1:
An electronic device (<NUM>) comprising:
a display (<NUM>);
a memory (<NUM>);
a touch sensor (<NUM>) operatively coupled with the display (<NUM>); and
an ultrasonic fingerprint sensor (<NUM>), disposed below the display (<NUM>) and operatively coupled with the touch sensor (<NUM>), configured to:
obtain at least one image for calibrating a fingerprint image, wherein said image is required to be obtained in a state of not including an external object such as a user's finger, a foreign material, or the like; and
in response to receiving a signal indicating detection of a touch input from the touch sensor (<NUM>) while obtaining the at least one image, cease to obtain the at least one image,
wherein the memory (<NUM>) is configured to store a plurality of values used for calibration of the fingerprint image and respectively associated with a plurality of temperatures measured by a temperature sensor; and
wherein the ultrasonic fingerprint sensor (<NUM>) is further configured to:
identify that a measured temperature corresponds to a temperature associated with a value having a lower reliability than a reference reliability among the plurality of values stored in the memory (<NUM>); and
obtain the at least one image to tune the fingerprint sensor (<NUM>) and improve the reliability of the value based on information on the at least one image.