Patent Description:
While the importance of security increases with the increase in the digital devices, various authentication methods such as biometric authentication are used for the security of user information. The biometric authentication is an authentication method that extracts biometric information, which is specified to a person, such as fingerprints, an iris, a sweat gland structure, a face, blood vessels, or the like to use the extracted biometric information.

The biometric authentication is being used for various purposes in electronic apparatuses. For example, the biometric authentication is applied to various fields such as unlocking of a home screen for the use of an electronic apparatus and user authentication upon making an electronic commerce payment. <CIT> discloses an infrared lamp control for use with iris recognition authentication. <CIT> discloses a method for recognizing an iris based on user intention and an electronic device for the same. <CIT> discloses a mobile terminal and a method for controlling the same.

In recent years, since the importance of information security has increased and the fields of use have been diversified, the complex authentication method that performs authentication by using not only biometric information corresponding to one object but also pieces of biometric information is being applied increasingly.

The electronic apparatus may recognize an object associated with biometric authentication to obtain biometric information. For the purpose of performing biometric authentication, recognition of the object, which is the target of authentication, may be performed before the authentication. Unlike the conventional authentication method using a password, the biometric authentication may be influenced by an external environment (e.g., user movement, or the like) while capturing an object, and thus the research for recognizing the appropriate object is actively underway.

In accordance with the present invention, there is provided an electronic apparatus and method as defined in the accompanying claims.

Before undertaking the DETAILED DESCRIPTION below, it may be advantageous to set forth definitions of certain words and phrases used throughout this patent document: the terms "include" and "comprise", as well as derivatives thereof, mean inclusion without limitation; the term "or" is inclusive, meaning and/or; the phrases "associated with" and "associated therewith", as well as derivatives thereof, may mean to include, be included within, interconnect with, contain, be contained within, connect to or with, couple to or with, be communicable with, cooperate with, interleave, juxtapose, be proximate to, be bound to or with, have, have a property of, or the like; and the term "controller" means any device, system or part thereof that controls at least one operation, such a device may be implemented in hardware, firmware or software, or some combination of at least two of the same.

According to various embodiments of the present disclosure, an electronic apparatus may improve user convenience by providing the feedback associated with the state of a specified object.

According to various embodiments of the present disclosure, an electronic apparatus may efficiently perform biometric authentication by adaptively using a plurality of authentication methods.

Besides, a variety of effects directly or indirectly understood through this disclosure may be provided.

Hereinafter, various embodiments of the present disclosure will be described with reference to accompanying drawings. <FIG> illustrates an operating environment of an electronic apparatus, according to an embodiment.

According to an embodiment, an electronic apparatus <NUM> performs biometric authentication. The electronic apparatus <NUM> obtains a request associated with biometric authentication, obtains an image including at least one external object in response to the request, recognizes or obtains an external object associated with the biometric authentication among at least one external object, and perform the biometric authentication by using biometric information corresponding to the external object. The external object associated with the biometric authentication is the object predetermined depending on the authentication method. Hereinafter, for convenience of description, the external object associated with the biometric authentication is referred to as a specified object.

The at least one external object may include, for example, various external objects surrounding the user of the electronic apparatus <NUM> (or a body part of the user) or the user. According to an embodiment, the specified object may be set in advance. For example, the specified object may be an iris and/or a face depending on user settings. While the authentication method of the electronic apparatus is set to iris authentication, the specified object may be an iris.

The authentication method may be an adaptive authentication method. For example, the adaptive authentication method may be an authentication method that makes it possible to selectively apply the authentication mode depending on the state of the electronic apparatus <NUM> or the external object.

According to an embodiment, the electronic apparatus <NUM> includes a plurality of cameras <NUM> and <NUM> to obtain an external object.

According to an embodiment, the plurality of cameras <NUM> and <NUM> obtain images corresponding to field of views different each other. The first camera <NUM> has a first field of view (hereinafter referred to as "FOV") (or angle of view) and the second camera <NUM> has a second FOV. The first FOV includes the second FOV. The first FOV includes a range wider than the second FOV.

According to an embodiment, the plurality of cameras <NUM> and <NUM> are disposed on one surface <NUM> of the electronic apparatus. A display <NUM> may be disposed on the one surface <NUM>.

<FIG> illustrates a block diagram a configuration of an electronic apparatus, according to an embodiment.

According to an embodiment, the electronic apparatus <NUM> (e.g., the electronic apparatus <NUM> of <FIG>) includes a processor <NUM>, the first camera <NUM>, and the second camera <NUM>. In addition, the configuration of the electronic apparatus <NUM> may be variously changed or modified according to various embodiments of the present disclosure. For example, the electronic apparatus <NUM> may further include a component such as a memory (e.g., the memory <NUM> of <FIG>), a display (e.g., the display device <NUM> of <FIG>), or a communication device (e.g., the communication module <NUM> of <FIG>).

According to an embodiment, the processor <NUM> performs an operation according to various embodiments of the present disclosure or controls the operation of another component. The processor <NUM> commands an operation of another component or receives a command from another component. For example, the processor <NUM> obtains at least one image through the first camera <NUM> or the second camera <NUM> and processes the obtained image. The processor <NUM> obtains the specified object from the obtained image. The processor <NUM> performs user authentication using the specified object. The user authentication includes biometric authentication. For example, the biometric authentication includes iris authentication or face authentication. According to an embodiment, the processor <NUM> allows the first camera <NUM> or the second camera <NUM> to capture an external object, to display the obtained image on a display, and/or to store information in a memory or to read out the stored information.

The processor <NUM> may include at least one of an image processing processor, an application processor, or a camera driving device. The operation of the electronic apparatus according to the embodiments disclosed below may be performed by at least one processor.

According to an embodiment, the first camera <NUM> captures an external object of the electronic apparatus <NUM>. The processor <NUM> allows the first camera <NUM> to capture the external object. The processor <NUM> obtains a first image corresponding to a first FOV through the first camera <NUM> and including at least one external object. The first camera <NUM> is disposed on the front surface or the rear surface of the electronic apparatus <NUM>. The first camera <NUM> is exposed through the front housing or the rear housing of the electronic apparatus <NUM>.

According to an embodiment, the second camera <NUM> captures an external object of the electronic apparatus <NUM>. The processor <NUM> allows the second camera <NUM> to capture the external object. The processor <NUM> obtains a second image corresponding to a second FOV through the second camera <NUM> and including at least one external object. The second camera <NUM> is disposed on the front surface or the rear surface of the electronic apparatus <NUM>. The second camera <NUM> is exposed through the front housing or the rear housing of the electronic apparatus <NUM>.

The first camera <NUM> may be a device configured to obtain an image using visible light. The first camera <NUM> includes an image sensor such as a complementary metal oxide semiconductor (CMOS) or charge-couple device sensor (CCD). In the following description, the first image may mean an image obtained through the first camera <NUM>. The first image is a raw image and may include information about the intensity of light sensed by the imaging medium. The first image may be a full resolution image sensed by the first camera <NUM>.

The second camera <NUM> may be a device configured to obtain an image using an infrared ray (IR). The second camera <NUM> may include at least one of an IR image sensor or a band pass filter. The IR image sensor may sense the image being captured and may convert the image into an electrical signal. The second camera <NUM> may obtain an image corresponding to the biometric authentication based on the IR image sensor. In the following description, the second image may mean an image obtained through the second camera <NUM>. The image is a raw image and may have information about the intensity of light sensed by the imaging medium. The image may be a full resolution image sensed by the IR image sensor. In various embodiments, the second camera <NUM> may be referred to as an "IR camera", and the image captured by the second camera <NUM> may be referred to as an "IR image".

The electronic apparatus <NUM> may include a memory (not illustrated). The memory may store various pieces of information described in the present disclosure. For example, the memory may store settings associated with the authentication of the electronic apparatus <NUM>. For example, the electronic apparatus <NUM> may be configured to perform iris authentication and/or face authentication in response to a request associated with the authentication.

The memory may store images obtained through the first camera <NUM> and/or the second camera <NUM>. The image may be stored in the form of an image file or a video file. The memory may store information associated with the authentication. For example, the memory may digitalize and/or encrypt the biometric information biometric information associated with a user of the electronic apparatus <NUM> to store the encrypted biometric information in advance. The stored biometric information may be referred to as "biometric data" for performing user authentication. The memory may store biometric feature information authenticated for biometric recognition. The biometric data or biometric feature information may be stored in the secure area of the memory. The memory may be the memory included in a secure element. For example, the secure element may include a secure digital (SD) card.

The memory may store instructions that direct the various operations described herein. The processor <NUM> may execute the instructions.

The display (not illustrated) of the electronic apparatus <NUM> may display various pieces of information (e.g., multimedia data or text data) to a user. The display may display a screen according to the control of the processor <NUM>. The display may be a touchscreen display for obtaining a user input. According to an embodiment, the processor <NUM> may display a screen including a preview image on the display, or a screen including a graphic image.

<FIG> illustrates a view for conceptually describing an operation in which an electronic apparatus recognizes a specified object by using two or more cameras.

Referring to <FIG>, an electronic apparatus (e.g., the electronic apparatus <NUM> of <FIG>) may primarily identify specified objects <NUM>, <NUM>, and <NUM> within a first image <NUM> obtained through a first camera (e.g., the first camera <NUM> of <FIG>) and may secondarily identify specified objects <NUM>, <NUM>, and <NUM> within a second image <NUM>. At least one first external object in the first FOV of the first camera may be included in the first image <NUM>, and at least one second external object in the second FOV of the second camera may be included in the second image <NUM>. It is understood that the first image <NUM> corresponds to the first FOV. It is understood that the second image <NUM> corresponds to the second FOV.

According to an embodiment, the electronic apparatus <NUM> obtains the at least one first image <NUM> through the first camera and obtains the at least one second image <NUM> through the second camera.

When the electronic apparatus recognizes the specified objects <NUM>, <NUM>, and <NUM> in the first image <NUM>, the electronic apparatus may identify whether the specified objects <NUM>, <NUM>, and <NUM> are present in the second image <NUM>.

For example, when the electronic apparatus succeeds in recognizing the specified object <NUM> from the first image <NUM>, the electronic apparatus may identify whether the specified object <NUM> is present in the second image <NUM> or may try to recognize the specified object <NUM>. Referring to <FIG>, since the specified object <NUM> is not positioned in the second image <NUM>, the electronic apparatus may fail to recognize the specified object <NUM>.

For example, when the electronic apparatus succeeds in recognizing the specified object <NUM> from the first image <NUM>, the electronic apparatus may identify whether the specified object <NUM> is present in the second image <NUM> or may try to recognize the specified object <NUM>. Referring to <FIG>, since the specified object <NUM> is included in the second image <NUM>, the electronic apparatus may successfully recognize the specified object <NUM>.

The electronic apparatus may identify whether the specified objects <NUM>, <NUM>, and <NUM> obtained using the first image <NUM> and the second image <NUM> are appropriate. When the specified objects <NUM>, <NUM>, and <NUM> satisfy the conditions for biometric authentication, the electronic apparatus may determine that the specified objects <NUM>, <NUM>, and <NUM> are appropriate. For example, the electronic apparatus may identify whether the specified objects <NUM>, <NUM>, and <NUM> are appropriate, based on the distance between the specified objects <NUM>, <NUM>, and <NUM> and the electronic apparatus and/or the locations of the specified objects <NUM>, <NUM>, and <NUM>. For example, when the distance from the electronic apparatus to each of the specified objects <NUM>, <NUM>, and <NUM> is too far or too close, the electronic apparatus may determine that the specified objects <NUM>, <NUM>, and <NUM> are not appropriate. For example, when the distance to each of the specified objects <NUM>, <NUM>, and <NUM> is greater than the specified first distance or is less than the specified second distance, the electronic apparatus may determine that the specified objects <NUM>, <NUM>, and <NUM> are not appropriate. Referring to <FIG>, the electronic apparatus may determine that the specified object <NUM> is not appropriate.

<FIG> illustrates a flowchart of an operation in which an electronic apparatus recognizes a specified object by using two or more cameras, according to an example that provides context to the present invention.

Referring to <FIG>, an electronic apparatus (e.g., the electronic apparatus <NUM> of <FIG>) may perform first recognition using the first image <NUM> and may perform second recognition using the second image <NUM>. The electronic apparatus may provide a feedback to a user based on at least the result of performing the second recognition. The operation of the electronic apparatus described below may be performed by a processor (e.g., the processor <NUM> of <FIG>) of the electronic apparatus. The following operations may be stored in the memory of the electronic apparatus in the form of instructions.

In operation <NUM>, the electronic apparatus may perform first recognition, using the first image obtained through the first camera. The electronic apparatus may obtain a first image corresponding to the first FOV through the first camera. The first image may include at least one first external object. The electronic apparatus may perform the first recognition operation using the first image. The electronic apparatus may identify whether the first image includes the specified object.

In operation <NUM>, the electronic apparatus may perform second recognition, using the second image obtained through the second camera. The electronic apparatus may obtain the second image corresponding to the second FOV through the second camera. The second image may include at least one second external object. The electronic apparatus may perform the second recognition operation using the second image. The electronic apparatus may try to recognize the specified object in the second image.

In operation <NUM>, the electronic apparatus may provide a feedback based on at least content from performing the second recognition. According to an embodiment, the electronic apparatus may provide a feedback based on the first recognition content and the second recognition content.

<FIG> illustrates an operational flowchart of an electronic apparatus providing a first feedback, according to an example that provides context to the present invention.

Referring to <FIG>, an electronic apparatus may recognize the specified object in a first image; when the electronic apparatus fails to recognize the specified object in the second image, the electronic apparatus may provide a user with the first feedback. The first feedback may include notification information that allows an electronic apparatus to obtain at least one second image including the specified object. The notification information may include information associated with a location. The notification information may be associated with an external object. For example, the notification information may be associated with the external object obtained in the first image.

The operation of the electronic apparatus described below may be performed by a processor (e.g., the processor <NUM> of <FIG>) of the electronic apparatus (e.g., the electronic apparatus <NUM> of <FIG>). The following operations may be stored in the memory of the electronic apparatus in the form of instructions.

In operation <NUM>, the electronic apparatus may obtain the first image using the first camera. The first image may include at least one first external object. The at least one first external object may be positioned in the first FOV of the first camera. The specified object may be included in at least part of at least one first external object.

In operation <NUM>, the electronic apparatus may obtain the second image by using the second camera. The second image may include at least one second external object. The second external object may be positioned in the second FOV of the second camera. According to the example provided in <FIG>, the at least one second external object may not include the specified object.

In operation <NUM>, the electronic apparatus may perform recognition on the specified object in the first image. When the electronic apparatus continuously obtains at least one first image, the electronic apparatus may identify the specified object while obtaining the first image. Since it is assumed that the specified object is included in the first image in operation <NUM>, the electronic apparatus may recognize or detect the specified object in the first image.

In operation <NUM>, the electronic apparatus may perform recognition on the specified object in the second image. When the electronic apparatus continuously obtains at least one second image, the electronic apparatus may identify the specified object while obtaining the second image. Since it is assumed that the specified object is not included in the second image in operation <NUM>, the electronic apparatus may fail to recognize (or detect) the specified object in the second image. In terms of electronic apparatus, it may be understood that the specified object is not included in the second image when the specified object is in the FOV of the second camera but the electronic apparatus does not recognize the specified object in the second image. The specified object in operation <NUM> may be different from the specified object in operation <NUM>. For example, in operation <NUM>, the specified object may be a part of the specified object according to operation <NUM>.

In operation <NUM>, the electronic apparatus may determine the first feedback and may provide the first feedback. The electronic apparatus may determine the first feedback based on the distance to the specified object and/or location of the specified object, in response to an operation of identifying the specified object in the second image. The electronic apparatus may provide the determined first feedback. The electronic apparatus may provide the first feedback to a user through various methods. For example, the electronic apparatus may display the first feedback via a display, or may provide the first feedback to the user via voice and/or vibration. The first feedback may include notification information that allows the electronic apparatus to obtain at least one second image including the specified object. Even though the specified object is not included in the second image, the notification information may be provided to the user by identifying the specified object through the first camera.

The notification information may include notification information associated with a location. For example, the electronic apparatus may identify that the external object is not located at the specified location (e.g., within the second FOV range) and may provide the first feedback including notification information associated with the location.

<FIG> illustrates a view for conceptually describing a method of providing a first feedback, according to an example that provides context to the present invention.

Referring to <FIG>, an electronic apparatus (e.g., the electronic apparatus <NUM> of <FIG>) may provide the first feedback to obtain at least one second image including the external object. The first feedback may include notification information associated with a distance and/or a location. The notification information associated with the distance and/or location may be information for notifying a user that the external object is located within the specified distance range from the electronic apparatus.

The electronic apparatus may obtain the distance from an external object or a specified object to the electronic apparatus. When the specified object is an iris (or eye), the electronic apparatus may obtain the distance from the external object or specified object to the electronic apparatus based on the eye distance or the detected face size.

When the second recognition is not successfully performed even though the specified object is within the first FOV range and second FOV range, the electronic apparatus may provide the first feedback to the user. To this end, the electronic apparatus may provide the user with a first feedback including notification information associated with the distance and/or location based on at least second recognition content. The first feedback may be provided to the user based on the first recognition content and the second recognition content. For example, when the specified object is not appropriate even though the specified object is recognized depending on the second recognition result, the electronic apparatus may provide the first feedback. When the specified object is not appropriate, for example, when the electronic apparatus does not satisfy the condition associated with the distance, the electronic apparatus may determine that the specified object is not appropriate. For example, when the distance between the specified object and the electronic apparatus is out of the specified distance range, the electronic apparatus may determine that the specified object is not appropriate.

<FIG> illustrates an operational flowchart of an electronic apparatus providing a first feedback not forming part of the claimed invention and is included for background only.

Referring to <FIG>, when an electronic apparatus (e.g., the electronic apparatus <NUM> of <FIG>) recognizes a specified object in a second image, the electronic apparatus may provide a user with a first feedback including notification information associated with a distance and/or location, if necessary. For example, when the electronic apparatus recognizes the specified object from the second image but the specified object is not appropriate, the electronic apparatus may provide the first feedback to the user. In this case, the first feedback may include notification information associated with the distance. The operation of the electronic apparatus described below may be performed by a processor (e.g., the processor <NUM> of <FIG>) of the electronic apparatus. The following operations may be stored in the memory of the electronic apparatus in the form of instructions.

In operation <NUM>, the electronic apparatus may obtain the first image using the first camera. The first image may include at least one first external object. The at least one first external object may be positioned in the first FOV of the first camera. According to the embodiment of <FIG>, a specified object may be included in at least part of at least one first external object or may not be included in at least part of at least one first external object.

In operation <NUM>, the electronic apparatus may obtain the second image including the specified object by using the second camera. The second image may include at least one second external object. The second external object may be positioned in the second FOV of the second camera.

In operation <NUM>, the electronic apparatus may perform recognition on the specified object in the first image. When the electronic apparatus continuously obtains at least one first image, the electronic apparatus may identify the specified object while obtaining the first image. In operation <NUM>, when the specified object is included in the first image, the electronic apparatus may recognize (or detect) the specified object in the first image; when the specified object is not included in the first image, the electronic apparatus may fail to recognize (or detect) the specified object in the first image.

In operation <NUM>, the electronic apparatus may perform recognition on the specified object in the second image. When the electronic apparatus continuously obtains at least one second image, the electronic apparatus may identify the specified object while obtaining the second image. Since it is assumed that the specified object is included in the second image in operation <NUM>, the electronic apparatus may recognize (or detect) the specified object in the second image. According to various embodiments, the specified object in operation <NUM> may be different from the specified object in operation <NUM>. For example, in operation <NUM>, the specified object may be a part of the specified object according to operation <NUM>.

In operation <NUM>, the electronic apparatus may provide the first feedback or perform biometric authentication, based on the state of the specified object. The electronic apparatus may determine the state of the specified object, in response to an operation of identifying the specified object in the second image. For example, the electronic apparatus may determine the distance between the specified object and the electronic apparatus.

The electronic apparatus may perform the measurement associated with the specified object. The electronic apparatus may identify whether the measurement result satisfies the specified distance range. The electronic apparatus may identify whether the measurement result is too far away (or longer than or equal to a specified first distance) from the specified object or is too close or equal (or closer than a specified second distance) to the specified object.

The first feedback may include notification information associated with the distance and/or location of the external object.

When the measurement result is farther or nearer than the specified distance range, the electronic apparatus may provide the first feedback.

When the measurement result is within the specified distance range, the electronic apparatus may perform biometric authentication. When the measurement result is between a specified first distance value and a specified second distance value, the electronic apparatus may determine that the specified object is appropriate.

When the measurement result is outside the specified location range, the electronic apparatus may provide the first feedback. When the measurement result indicates that the electronic apparatus is within the specified location range, the electronic apparatus may perform biometric authentication.

<FIG> illustrates a flowchart of an operation in which an electronic apparatus provides various feedbacks, according to an embodiment.

Referring to <FIG>, an electronic apparatus provides various feedbacks based on the first recognition result and the second recognition result. The operations of the electronic apparatus described below are performed by a processor (e.g., the processor <NUM> of <FIG>) of the electronic apparatus (e.g., the electronic apparatus <NUM> of <FIG>). The following operations may be stored in the memory of the electronic apparatus in the form of instructions.

In operation <NUM>, the electronic apparatus obtains a request associated with biometric authentication. The request associated with the biometric authentication corresponds to the user's selection, a request associated with authentication from the external device, or an operation associated with authentication of the electronic apparatus or is generated in response to the corresponding operation.

In operation <NUM>, the electronic apparatus obtains a first image and a second image. The first image is an image, which is obtained by the electronic apparatus using the first camera. The second image is an image, which is obtained by the electronic apparatus using the second camera.

In operation <NUM>, the electronic apparatus tries to recognize a specified object in the first image. The electronic apparatus identifies (or searches for) whether the specified object is present in the first image and tries to recognize the specified object in the second image in operation <NUM> and operation <NUM>.

The electronic apparatus may recognize the specified object from the first image in operation <NUM>; when the electronic apparatus does not recognize the specified object from the second image in operation <NUM>, the electronic apparatus performs operation <NUM>; when the electronic apparatus recognizes the specified object from the second image in operation <NUM> and operation <NUM>, the electronic apparatus performs operation <NUM>. In operation <NUM> and operation <NUM>, when the electronic apparatus fails to recognize the specified object from the first image but recognizes the specified object from the second image, the electronic apparatus performs operation <NUM>.

According to an embodiment, the specified object to be recognized within the first image is different from the specified object to be recognized within the second image. For example, the electronic apparatus tries to recognize the first specified object within the first image and tries to recognize the second specified object within the second image. The second specified object includes at least part of the first specified object. The electronic apparatus tries to recognize a face including an eyeball within the first image and may tries to recognize the eyeball within the second image.

In operation <NUM>, the electronic apparatus provides a first feedback. The electronic apparatus provides the first feedback including notification information that makes it possible to obtain at least one second image including the specified object, in response to recognition failure of the specified object from the second image. The first feedback may be displayed via the display of the electronic apparatus.

According to an embodiment, the electronic apparatus determines the first feedback based on the at least second image to provide the first feedback. For example, electronic apparatus identifies whether the specified object satisfies the specified condition, using the first image and the second image. When the specified object does not satisfy the specified condition, the electronic apparatus provides information associated with the distance and/or location based on the distance and/or location of the specified object.

When the specified object associated with the first image is different, the electronic apparatus provides information associated with the distance and/or location based on the distance from at least one specified object and/or the location of at least one specified object among the first specified object or the second specified object.

According to an embodiment, the first feedback includes information associated with the distance and/or the location. The electronic apparatus provides a first feedback that allows the specified object to be located within the second image, such as movement upward/movement downward/movement to the left/movement to the right.

In operation <NUM>, the electronic apparatus identifies whether the specified object satisfies a specified condition. The specified condition is associated with the distance between the specified object and the electronic apparatus. The specified condition includes whether the distance between the specified object and the electronic apparatus satisfies a specified distance range. For example, when the specified object satisfies the specified condition, the electronic apparatus performs the operation <NUM>; when the specified object does not satisfy the specified condition, the electronic apparatus performs operation <NUM>.

When the specified object is different in operation <NUM> and operation <NUM>, in operation <NUM>, the electronic apparatus may determine whether a specified object (or a specified object to be recognized within a second image) satisfies a specified condition.

In operation <NUM>, the electronic apparatus provides a first feedback. In this case, the electronic apparatus provides the first feedback including notification information associated with the distance and/or location, in response to the result of identifying the specified condition.

In operation <NUM>, the electronic apparatus performs biometric authentication using biometric information corresponding to at least part of the specified object. For example, when the specified object is an eye or a face, the electronic apparatus performs biometric authentication using biometric information corresponding to an iris. The electronic apparatus obtains biometric information from the specified object; and the electronic apparatus performs biometric authentication by comparing the biometric information with biometric data.

In operation <NUM>, the electronic apparatus may provide a second feedback. The second feedback may include the biometric authentication result. For example, when the biometric information does not coincide with the biometric data, the electronic apparatus may provide the second feedback indicating an authentication failure; when the biometric information coincides with the biometric data, the electronic apparatus may provide the second feedback indicating an authentication success. The authentication success may be indirectly recognized by the user, as an operation of disabling security. For example, when authentication is successful, the electronic apparatus may unlock the home screen lock or may unlock the application lock.

In operation <NUM>, the electronic apparatus may provide a third feedback. When it is indicated that the specified object cannot be recognized or when the specified object is not located within the FOV range of each of the first and second cameras of the electronic apparatus, the third feedback may include the notification information that allows the specified object to be located within the FOV range.

After performing operation <NUM>, operation <NUM>, or operation <NUM>, the electronic apparatus may perform operation <NUM>. In operation <NUM>, the electronic apparatus may determine whether the predetermined time has expired. The predetermined time may be the time set for authentication. When the time has not expired, the electronic apparatus may perform operation <NUM> and then may obtain the next image. When the time has expired, the electronic apparatus may terminate biometric authentication.

<FIG> illustrates a feedback displayed by the electronic apparatus through a display, according to an example that provides context to the present invention.

(<NUM>) and (<NUM>) of <FIG> illustrates that an electronic apparatus (e.g., the electronic apparatus <NUM> of <FIG>) displays a feedback through a display (e.g., the display <NUM> of <FIG>), and (<FIG>) of <FIG> illustrates a screen including the feedback.

Referring to (<NUM>) and (<NUM>) of <FIG>, the feedback provided by the electronic apparatus may be provided in an image or text format. The information included in the feedback may be stored in advance in the memory of the electronic apparatus. <FIG> illustrates the first feedback including notification information associated with an external object.

Referring to (<NUM>) of <FIG>, the electronic apparatus may display a screen <NUM>, which includes a first feedback <NUM> of image form and/or a first feedback <NUM> of text form, on a display. In <FIG>, the screen <NUM> is a home screen, but the electronic apparatus may provide the feedback in an application execution screen. The screen <NUM> may display an item <NUM> for performing various functions in addition to the feedback described in the present disclosure. The item <NUM> may be an item associated with an application capable of being executed without authentication.

<FIG> illustrates a screen including various feedbacks provided by an electronic apparatus, according to an example that provides context to the present invention.

A first screen <NUM> is illustrated as including a second feedback <NUM>; a second screen <NUM> is illustrated as including a first feedback <NUM>; and a third screen <NUM> is illustrated as including a third feedback <NUM>. The first feedback <NUM> is illustrated as including notification information associated with the position of an external object.

However, in <FIG>, each of the first to third screens <NUM> to <NUM> is an application execution screen, but the first to third feedbacks <NUM>, <NUM>, and <NUM> may be displayed on various screens. For example, the first to third feedbacks <NUM> to <NUM> may be displayed on a home screen.

The first to third feedbacks <NUM>, <NUM>, and <NUM> may be displayed in a pop-up form on the first to third screens <NUM> to <NUM>. The first to third feedbacks <NUM>, <NUM>, and <NUM> may be included in a separate screen displayed on the first to third screens <NUM> to <NUM>, respectively.

An electronic apparatus (e.g., the electronic apparatus <NUM> of <FIG>) may obtain different specified objects from an image obtained by using a first camera (e.g., the first camera <NUM> of <FIG>) and a second camera (e.g., the second camera <NUM> of <FIG>) and may perform two or more pieces of biometric authentication by using the specified objects. Various authentication modes for performing two or more pieces of biometric authentication may be defined in the electronic apparatus. The electronic apparatus may adaptively select the authentication mode depending on the extent to which security is required.

<FIG> illustrates a flowchart of an operation in which an electronic apparatus adaptively selects an authentication mode, the operation not forming part of the claimed invention and is included for illustration purposes only.

Referring to <FIG>, an electronic apparatus may obtain a security level (or a running operation), may obtain an authentication mode based on the security level (or a running operation), and may perform biometric authentication by using the obtained authentication mode The operation of the electronic apparatus described below may be performed by a processor (e.g., the processor <NUM> of <FIG>) of the electronic apparatus (e.g., the electronic apparatus <NUM> of <FIG>). The following operations may be stored in the memory of the electronic apparatus in the form of instructions.

In operation <NUM>, the electronic apparatus may obtain a request associated with biometric authentication. Operation <NUM> may refer to the description of operation <NUM> in <FIG>.

In operation <NUM>, the electronic apparatus may obtain the security level. The security level may be associated with the running operation or the running application in the electronic apparatus. The security level according to the operation being executed may be specified. The information associated with the security level may be stored in the electronic apparatus in advance. For example, the relationship between the security level and the application may be stored in the electronic apparatus. When the electronic apparatus is executing an application associated with a payment, the security level may be the first security level; and when the electronic apparatus is executing the home screen, the security level may be the second security level. The second security level may be lower than the first security level.

In operation <NUM>, the electronic apparatus may obtain the authentication mode based on the security level. The electronic apparatus may obtain the first authentication mode for the first security level and may obtain the second authentication mode for the second security level. Alternatively, when the operation being executed is the first operation, the electronic apparatus may determine the first authentication mode; when the operation being executed is the second operation, the electronic apparatus may determine the second authentication mode. For example, when the electronic apparatus is executing a home screen, the electronic apparatus may determine the first authentication mode; when the electronic apparatus is executing an application associated with a payment, the electronic apparatus may determine the second authentication mode.

In operation <NUM>, the electronic apparatus may perform an authentication method according to an authentication mode. The authentication method may be different depending on the authentication mode. For example, the authentication method of the low security is applied to the first security level requiring relatively low security; a strict authentication method is applied to the second security level requiring relatively high security.

<FIG> conceptually illustrates an authentication method executed by an electronic apparatus, the authentication method not forming part of the claimed invention and is included for illustration purposes only.

Referring to <FIG>, an electronic apparatus may perform two or more pieces of authentication having external objects associated with different biometric authentication methods. The operation of the electronic apparatus described below may be performed by a processor (e.g., the processor <NUM> of <FIG>) of the electronic apparatus (e.g., the electronic apparatus <NUM> of <FIG>). The following operations may be stored in the memory of the electronic apparatus in the form of instructions.

In operation <NUM>, the electronic apparatus may perform primary authentication based on the external object associated with the first biometric authentication method. For example, the first biometric authentication method may be iris authentication.

In operation <NUM>, the electronic apparatus may perform secondary authentication based on the external object associated with the second biometric authentication method. For example, the second biometric authentication method may be face authentication. The operation <NUM> may be performed based on the first authentication result. For example, operation <NUM> may be performed when the primary authentication fails.

In operation <NUM>, the electronic apparatus may perform complex authentication (or tertiary authentication). The electronic apparatus may perform complex authentication based on both the first specified object and the second specified object.

<FIG> illustrates a flowchart of an authentication operation of an electronic apparatus, the authentication operation not forming part of the claimed invention and is included for illustration purposes only.

The primary authentication or the secondary authentication of <FIG> may include an operation of performing object recognition and performing object authentication by using the recognized object. The operation of the electronic apparatus described below may be performed by a processor (e.g., the processor <NUM> of <FIG>) of the electronic apparatus (e.g., the electronic apparatus <NUM> of <FIG>). The following operations may be stored in the memory of the electronic apparatus in the form of instructions.

In operation <NUM>, the electronic apparatus may obtain an image. The image may include a first image obtained using a first camera and/or a second image obtained using a second camera.

In operation <NUM>, the electronic apparatus may perform object recognition. The electronic apparatus may search for a specified object within the obtained image. The specified object may be an iris in the case of iris authentication and a face in the case of face authentication.

In operation <NUM>, the electronic apparatus may perform object authentication. When the specified object is recognized, the electronic apparatus may obtain biometric information corresponding to the specified object and may perform biometric authentication by using the biometric information.

In the following description, first object recognition and first object authentication may correspond to an authentication method (e.g., face authentication) requiring a relatively low security, and second object recognition and second object authentication may correspond to an authentication method (e.g., iris authentication) requiring a relatively high security. The target of the first object recognition and the first object authentication may be the first specified object, and the target of the second object recognition and the second object authentication may be the second specified object.

The electronic apparatus may set an authentication mode depending on the security level and may execute at least one of the first to third pieces of authentication depending on the corresponding authentication mode. Hereinafter, the operation of an electronic apparatus for each authentication mode will be described.

The objects of the primary authentication and the secondary authentication may be different depending on the authentication mode. For example, in the first authentication mode requiring relatively low security, the primary authentication may secure the convenience of a user but may use a face authentication method of low security, and the secondary authentication may use the an iris authentication method of high security. In the second authentication mode requiring relatively high security, the primary authentication may use an iris authentication method, and the secondary authentication may use the face authentication method.

<FIG> illustrates an operation of an electronic apparatus in a first authentication mode not forming part of the claimed invention and is included for illustration purposes only.

Referring to <FIG>, an electronic apparatus may perform primary to tertiary pieces of authentication depending on the first authentication mode. The first authentication mode may be an authentication mode applied when relatively low security is required. The first authentication mode may be an authentication mode applied while a home screen is executed. In the first authentication mode, when the electronic apparatus fails in the primary authentication after performing the primary authentication using a first image obtained by using a first camera (e.g., the first camera <NUM> of <FIG>), the electronic apparatus may perform the secondary authentication by using a second image obtained by using a second camera (e.g., the second camera <NUM> of <FIG>). The first specified object that is a target of the primary authentication may be a face. The second specified object that is a target of the secondary authentication may be an iris. When the secondary authentication fails, the electronic apparatus may perform complex authentication, using the first specified object and the second specified object.

In operation <NUM>, the electronic apparatus may obtain an image including a first image and a second image. Each of the first image and the second image may include at least one external object. The first image may be an image obtained by using a first camera, and the second image may be an image obtained by using a second camera.

In operation <NUM>, the electronic apparatus may perform first object recognition, using the first image. The electronic apparatus may search for the first specified object in operation <NUM>. When the first object recognition fails, the electronic apparatus may activate secondary authentication. When the first object recognition is rejected, the electronic apparatus may determine that the first object recognition fails. When the first object recognition is successful, the electronic apparatus may perform operation <NUM>.

In operation <NUM>, the electronic apparatus may perform first object authentication and may identify whether the first object authentication is successful. When the first object authentication fails, the electronic apparatus may activate secondary authentication. When the first object authentication is successful, the electronic apparatus may perform operation <NUM>.

When the primary authentication fails, the electronic apparatus may activate the secondary authentication. The case where the primary authentication fails may include the case where first object recognition fails or the case where first object authentication fails.

In operation <NUM>, the electronic apparatus may perform second object recognition. The electronic apparatus may identify whether the second image includes the second specified object. When the second object recognition fails, the electronic apparatus may perform operation <NUM>. For example, the electronic apparatus may obtain the following image. When the second object recognition is successful, the electronic apparatus may perform operation <NUM>.

In operation <NUM>, the electronic apparatus may determine whether the second object authentication is successful. The electronic apparatus may perform the second object authentication in response to the second object recognition. The electronic apparatus may identify whether the second specified object coincides with the previously stored biometric data. When the second object authentication is successful, the electronic apparatus may perform operation <NUM>; when the second object authentication fails, the electronic apparatus may perform operation <NUM>.

In operation <NUM>, the electronic apparatus may perform complex authentication. The electronic apparatus may perform authentication, using the first specified object and the second specified object.

In operation <NUM>, the electronic apparatus may identify whether the complex authentication is successful. When the complex authentication fails, the electronic apparatus may perform operation <NUM>; when complex authentication is successful, the electronic apparatus may perform operation <NUM>.

In operation <NUM>, the electronic apparatus may perform liveness detection and authentication. The electronic apparatus may perform authentication based on the result of liveness detection.

<FIG> illustrates a flowchart of an operation of an electronic apparatus in a second authentication mode not forming a part of the claimed invention and is included for illustration purposes only.

Referring to <FIG>, an electronic apparatus may perform primary to tertiary pieces of authentication depending on the second authentication mode. The second authentication mode may be an authentication mode applied when relatively high security is required. In the second authentication mode, when the electronic apparatus fails in the primary authentication after performing the primary authentication using a second image obtained by using a second camera (e.g., the second camera <NUM> of <FIG>), the electronic apparatus may perform the secondary authentication by using a first image obtained by using a first camera (e.g., the first camera <NUM> of <FIG>). The first specified object that is a target of the primary authentication may be an iris. The second specified object that is a target of the secondary authentication may be a face. When the secondary authentication fails, the electronic apparatus may perform complex authentication, using the first specified object and the second specified object.

In operation <NUM>, the electronic apparatus may obtain an image. The electronic apparatus may obtain a first image and a second image from the image.

In operation <NUM>, the electronic apparatus may perform second object recognition. Operation <NUM> may be the same as or similar to operation <NUM> of <FIG>.

In operation <NUM>, the electronic apparatus may determine whether the second object authentication is successful. Operation <NUM> may be the same as or similar to operation <NUM> of <FIG>. When the second object authentication is successful, the electronic apparatus may perform operation <NUM>. When the second object authentication fails, the electronic apparatus may activate secondary authentication.

In operation <NUM>, the electronic apparatus may perform first object recognition. Operation <NUM> may be the same as or similar to operation <NUM> of <FIG>. When the electronic apparatus does not recognize the first specified object in the first object recognition operation, the electronic apparatus may obtain operation <NUM> and then may obtain the next image. When the electronic apparatus succeeds in recognizing the first specified object, the electronic apparatus may perform operation <NUM>.

In operation <NUM>, the electronic apparatus may determine whether the complex authentication is successful. When the complex authentication is successful, the electronic apparatus may perform operation <NUM>. When the complex authentication fails, the electronic apparatus may obtain the next image in operation <NUM> and then, may retry authentication.

In operation <NUM>, the electronic apparatus may perform liveness detection and authentication.

<FIG> illustrates a flowchart of an operation of an electronic apparatus in a first authentication mode not forming a part of the claimed invention and is included for illustration purposes only.

Referring to <FIG>, an electronic apparatus may determine the authentication criteria when performing complex authentication. When different authentication criteria are applied depending on a first authentication mode and a second authentication mode upon performing the complex authentication, authentication may be flexibility performed on the first authentication mode requiring a lower security level and the second authentication mode requiring a higher security level.

The operation of the electronic apparatus described below may be performed by a processor of the electronic apparatus. The following operations may be stored in the memory of the electronic apparatus in the form of instructions.

In operation <NUM>, the electronic apparatus may obtain an image and may preferentially perform primary authentication using a first image. In operation <NUM> and operation <NUM>, the electronic apparatus may perform the primary authentication; when the primary authentication fails, the electronic apparatus may perform operation <NUM> and operation <NUM>. Operation <NUM> may be the same as or similar to operation <NUM> of <FIG>; operation <NUM> may be the same as or similar to operation <NUM> of <FIG>; operation <NUM> may be the same as or similar to operation <NUM> of <FIG>; operation <NUM> may be the same as or similar to operation <NUM> of <FIG>. For convenience of description, the detailed description will be omitted.

In operation <NUM>, when the first object recognition fails, the electronic apparatus may identify the state (or the state of a specified object) of the electronic apparatus. When the state of the electronic apparatus is the specified state, the electronic apparatus may obtain the next image; when the state of the electronic apparatus is not the specified state, the electronic apparatus may activate the secondary authentication and may perform operation <NUM>. In <FIG>, for better understanding, the case of determining whether the state of the electronic apparatus is a low illumination (LI) state is illustrated. In the LI state, the electronic apparatus may activate the secondary authentication and may perform operation <NUM>. When not being in the LI state, the electronic apparatus may perform operation <NUM> and may obtain the next image. In the LI state, since it is difficult for the electronic apparatus to perform face recognition, the electronic apparatus may perform secondary authentication as auxiliary authentication.

When the first object authentication is successful in operation <NUM>, the electronic apparatus may perform operation <NUM>; when the first object authentication fails, the electronic apparatus may perform operation <NUM>.

In operation <NUM>, the electronic apparatus may identify whether the first image includes the second specified object. The electronic apparatus may identify whether the first image includes the object associated with the secondary authentication. When the first image does not include the second specified object, the electronic apparatus may perform operation <NUM>; when the first image includes the second specified object, the electronic apparatus may activate secondary authentication and may perform operation <NUM>. In this case, when the external object is likely to be someone other than a user, the electronic apparatus may prevent the secondary authentication from being performed unnecessarily.

In operation <NUM>, the electronic apparatus may transmit a message to the user. The message may be a message indicating that authentication fails.

In operation <NUM>, the electronic apparatus may determine the authentication criteria. The authentication criteria may be authentication criteria associated with complex authentication. The authentication criteria may be associated with a false accept rate (FAR). The electronic apparatus may determine the FAR associated with the first object recognition (e.g., face recognition) as authentication criteria in the first authentication mode; the electronic apparatus may determine the FAR associated with second object recognition (e.g., iris recognition) as the authentication criteria in the second authentication mode.

In operation <NUM>, when the second object authentication fails, the electronic apparatus may perform complex authentication in operation <NUM>; the electronic apparatus may apply the authentication criteria determined in operation <NUM>. The electronic apparatus may perform complex authentication, using the first specified object and the second specified object. In the first authentication mode, the electronic apparatus may apply the FAR associated with the first object recognition depending on the operation <NUM> while performing complex authentication.

In operation <NUM>, the electronic apparatus may determine whether the complex authentication is successful; when the complex authentication is successful, the electronic apparatus may perform liveness detection and authentication in operation <NUM>. When complex authentication fails in operation <NUM>, the electronic apparatus may perform operation <NUM> and then may obtain the next image.

According to the example disclosed in <FIG>, the electronic apparatus may perform face authentication in primary authentication, may determine whether to perform secondary authentication depending on an external environment when applying a relatively low security mode for performing iris authentication in secondary authentication, and may perform user authentication using secondary authentication and/or complex authentication when primary authentication is not successful due to the bad external environment.

For example, when the reliability obtained from face authentication is low because there are few features capable of authenticating a face since a user wears heavy makeup even though the user was himself or herself or since the user grows a beard or wears a hat or mask compared to the biometric data of the electronic apparatus, the electronic apparatus may authenticate the user by using iris authentication.

For example, when the electronic apparatus is in the LI environment, the obtained face image may be too dark or too noisy. In this case, when the reliability of authentication is not enough because there is not enough face features capable of being obtained within the first image, the electronic apparatus may authenticate the user via iris authentication.

As such, efficient authentication may be performed by supplementing the disadvantages of first authentication with second authentication and considering the state of the electronic apparatus.

Referring to <FIG>, when the primary authentication fails, the electronic apparatus may determine whether to perform the secondary authentication, based on the state (or, situation) of an external object. For example, the electronic apparatus may determine whether to perform the secondary authentication, in consideration of a situation where the user is wearing glasses or is placed outdoors. The operation of the electronic apparatus (e.g., the electronic apparatus <NUM> of <FIG>) described below may be performed by a processor (e.g., the processor <NUM> of <FIG>) of the electronic apparatus. The following operations may be stored in the memory of the electronic apparatus in the form of instructions.

In operation <NUM>, the electronic apparatus may obtain an image. In operation <NUM> and operation <NUM>, the electronic apparatus may preferentially perform primary authentication using a second image. When the primary authentication fails, in operation <NUM>, the electronic apparatus may identify the state of the external object (or the electronic apparatus) and may perform secondary authentication using a first image in operation <NUM> based on the state of the external object. Operation <NUM> may be the same as or similar to operation <NUM> of <FIG>; operation <NUM> may be the same as or similar to operation <NUM> of <FIG>; operation <NUM> may be the same as or similar to operation <NUM> of <FIG>. For convenience of description, the detailed description will be omitted.

In operation <NUM>, when the second object recognition fails, the electronic apparatus may identify the state (or the state of a specified object) of the electronic apparatus. When the electronic apparatus is in the specified state, the electronic apparatus may obtain the next image; when the electronic apparatus is not in the specified state, the electronic apparatus may activate the secondary authentication and may perform operation <NUM>. the specified state is exemplified in <FIG> as an outdoor state, but the embodiments are not limited thereto. For example, the specified state may include a state in which the electronic apparatus cannot accurately recognize a user. For example, when it is difficult to recognize the user because the user is outdoors, or when the probability of recognizing the user as another person increases because the user wears glasses, the electronic apparatus may additionally determine whether the user coincides with the user of the electronic apparatus, through the secondary authentication.

The secondary authentication may be a complex authentication using a plurality of specified objects. The electronic apparatus may try to perform first object recognition in operation <NUM>; when the second object recognition is successful, the electronic apparatus may perform complex authentication using the first specified object and the second specified object in operation <NUM>.

According to the example disclosed in <FIG>, the electronic apparatus may perform iris authentication in primary authentication, may determine whether to perform secondary authentication depending on an external environment when applying a relatively high security mode for performing face authentication in secondary authentication, and may perform user authentication using secondary authentication and/or complex authentication when primary authentication is not successful due to the bad external environment. In this case, in the examples of <FIG> and/or <FIG>, flexible authentication according to security and user convenience may be performed by determining the authentication criteria of complex authentication depending on the FAR in the primary authentication.

As such, when primary authentication, secondary authentication and/or complex authentication is used, user authentication may be performed more flexibly than single biometric authentication, and efficient user authentication may be performed by reflecting an external environment. The security and user usability may be secured as the authentication means is changed depending on the security level. In addition, the disadvantages of single biometric authentication may be compensated when primary authentication, secondary authentication and/or complex authentication is used. According to various examples of the present disclosure, the electronic apparatus may provide the optimized security and convenience for each service. Anti-spoofing using heterogeneous sensors may be enhanced.

<FIG> illustrates an authentication screen of an electronic apparatus, according to an example that provides context to the present invention.

Referring to <FIG>, an electronic apparatus (e.g., the electronic apparatus <NUM> of <FIG>) may provide a first screen <NUM> including a graphic image while obtaining an image for authentication or may provide a second screen <NUM> including an image <NUM> obtained through at least one camera (e.g., the second camera <NUM> of <FIG>), via a display.

The first screen <NUM> and/or the second screen <NUM> may provide guides <NUM> and <NUM> that allow a user to try authentication again.

<FIG> illustrates an authentication setting screen not forming a part of the claimed invention and is included for illustration purposes only.

An electronic apparatus (e.g., the electronic apparatus <NUM> of <FIG>) may display an authentication setting screen <NUM> including at least one icon <NUM>, <NUM>, <NUM>, or <NUM> that allows a user to select an authentication method that the user desires.

The authentication setting screen <NUM> may include icons <NUM>, <NUM>, <NUM>, and <NUM> for setting various authentication methods, and icons <NUM>, <NUM>, <NUM>, and <NUM> indicating corresponding authentication methods.

In <FIG>, the icon <NUM> indicating fingerprint recognition (fingerprints), the icon <NUM> indicating intelligent scan, the icon <NUM> indicating face recognition (face), the icon <NUM> indicating iris recognition (iris), and icons <NUM>, <NUM>, <NUM>, and <NUM> for respectively selecting the authentication methods, in the authentication setting screen <NUM> are exemplified. In addition, various modifications may be possible, such as including icons indicating various authentication methods, including some of the icons, or the like.

The authentication setting screen <NUM> may include icons <NUM> and <NUM> associated with an intelligent scan method for setting an adaptive authentication method (hereinafter referred to as "intelligent scan") according to the present disclosure. As illustrated in <FIG>, when the intelligent scan is set, the electronic apparatus may perform authentication according to various embodiments disclosed in the present disclosure, in response to a request associated with the authentication.

According to an embodiment, as illustrated in <FIG>, even though intelligent scan is not set, the electronic apparatus may perform the adaptive authentication method disclosed in the present disclosure while a plurality of authentication methods are set together. For example, while both the face authentication and the iris authentication are set together through the icon <NUM> for setting face authentication and the icon <NUM> for setting iris authentication, the electronic apparatus may perform an adaptive authentication method using the face authentication and the iris authentication, in response to a request associated with authentication.

In <FIG> the icons <NUM>, <NUM>, <NUM>, and <NUM> capable of setting the authentication method, which a user desires, are exemplified in a swipe format. However, the icons <NUM>, <NUM>, <NUM>, and <NUM> may be implemented in various methods.

<FIG> illustrates a screen for displaying a set authentication method not forming a part of the claimed invention and is included for illustration purposes only.

Referring to <FIG>, an electronic apparatus (e.g., the electronic apparatus <NUM> of <FIG>) may display a screen <NUM> including a state display icon <NUM> for notifying a user of an authentication method, through a display.

The state display icon <NUM> may be an icon associated with the authentication method currently being executed.

When the electronic apparatus performs secondary authentication after performing primary authentication, the electronic apparatus may display an icon indicating the authentication method associated with a secondary authentication in a screen, after displaying an icon indicating the authentication method associated with the primary authentication.

<FIG> illustrates the case where an intelligent scan using iris authentication and face authentication is applied. <FIG> illustrates that the authentication method associated with the primary authentication is iris authentication and the authentication method associated with the secondary authentication is face authentication.

While the primary authentication is performed, the electronic apparatus may display an icon <NUM> associated with iris authentication on the screen <NUM>; while the primary authentication fails and the secondary authentication is performed, the electronic apparatus may display an icon <NUM> associated with the face authentication on the screen <NUM>. When obtaining an image again because secondary authentication or complex authentication fails, the electronic apparatus may display an icon <NUM> associated with iris authentication again on the screen <NUM>; when the primary authentication fails, the electronic apparatus may display an icon <NUM> associated with the face authentication on the screen <NUM>. When authentication is completed, the electronic apparatus may disable the security. <FIG> illustrates the home screen <NUM> of the electronic apparatus. However, the icons may be displayed on an application execution screen.

The user may take a location or posture suitable for the authentication method, by identifying the state display icon <NUM> and intuitively recognizing the currently executing authentication method.

For example, when it is expected that the quality of the image obtained using a first camera (e.g., the first camera <NUM> of <FIG>) is poor in the LI environment, the electronic apparatus may notify the user that the iris authentication is more suitable, by displaying the icon <NUM> associated with the iris authentication, and thus may implicitly request the user to take a posture suitable for iris authentication.

When it is expected that the quality of an image obtained using a second camera is not good when an external object or an electronic apparatus is located in an outdoor environment, the electronic apparatus may implicitly request the user to take a posture suitable for face authentication by displaying the icon <NUM> associated with face authentication on the screen.

The state display icon <NUM> may be an icon indicating the authentication method set by the user. In this case, the authentication method currently performed by the electronic apparatus may not coincide with the authentication method indicated by the icon.

An electronic apparatus may include a first camera having a first field of view (FOV) and disposed on one surface of the electronic apparatus, a second camera having a second FOV included in the first FOV and disposed on the one surface, and a processor. The processor may be configured to obtain a request associated with biometric authentication, to obtain at least one first image corresponding to the first FOV by using the first camera, based at least on the request, to obtain at least one second image corresponding to the second FOV by using the second camera, based at least on the request, to identify a first external object associated with the biometric authentication among one or more external objects included in the at least one first image, while obtaining the at least one first image, and to provide notification information for obtaining the at least one second image including the second external object while obtaining the at least one second image, when a second external object, which is at least part of the first external object and which is associated with the biometric authentication, is not included in the at least one second image.

While obtaining the at least one second image, the processor may be configured to perform authentication using at least part of the at least one second image when the second external object is included in the at least one second image and satisfies a condition associated with a distance, and to provide notification information associated with the distance when the second external object associated with the biometric authentication, which is at least part of the first external object, is included in the at least one second image and does not satisfy the condition associated with the distance.

<FIG> is a block diagram illustrating an electronic device <NUM> in a network environment <NUM> according to an example that provides context to the present invention. The electronic device <NUM> may communicate with the electronic device <NUM> via the server <NUM>. The electronic device <NUM> may include a processor <NUM>, memory <NUM>, an input device <NUM>, a sound output device <NUM>, a display device <NUM>, an audio module <NUM>, a sensor module <NUM>, an interface <NUM>, a haptic module <NUM>, a camera module <NUM>, a power management module <NUM>, a battery <NUM>, a communication module <NUM>, a subscriber identification module (SIM) <NUM>, or an antenna module <NUM>. At least one (e.g., the display device <NUM> or the camera module <NUM>) of the components may be omitted from the electronic device <NUM>, or one or more other components may be added in the electronic device <NUM>. Some of the components may be implemented as single integrated circuitry.

The processor 2120may execute, for example, software (e.g., a program <NUM>) to control at least one other component (e.g., a hardware or software component) of the electronic device <NUM> coupled with the processor <NUM>, and may perform various data processing or computation.

The receiver may be implemented as separate from, or as part of the speaker.

The connecting terminal <NUM> may include, for example, a HDMI connector, a USB connector, a SD card connector, or an audio connector (e.g., a headphone connector),
The haptic module <NUM> may convert an electrical signal into a mechanical stimulus (e.g., a vibration or a movement) or electrical stimulus which may be recognized by a user via his tactile sensation or kinesthetic sensation.

The communication module <NUM> may include a wireless communication module <NUM> (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module <NUM> (e.g., a local area network (LAN) communication module or a power line communication (PLC) module).

The antenna module <NUM> may include one or more antennas, and, therefrom, at least one antenna appropriate for a communication scheme used in the communication network, such as the first network <NUM> or the second network <NUM>, may be selected, for example, by the communication module <NUM> (e.g., the wireless communication module <NUM>).

According to the conventional technology, an electronic apparatus may not provide a feedback associated with the state of a specified object, when the specified object is not positioned within the recognition range of a camera used for biometric authentication. For example, it may be difficult to provide the feedback (location correction, or position correction) based on the location and/or distance of a specified object.

Since the biometric authentication is sensitive to an external environment (e.g., user motion or illumination), the recognition rate of an object may vary greatly depending on the external environment. According to the conventional technology, once the authentication method is set, the electronic apparatus performs authentication only using the corresponding authentication method, and thus the convenience of authentication is degraded depending on the external environment.

Aspects of the present disclosure are to address at least the above-mentioned problems and/or disadvantages and to provide at least the advantages described below. Accordingly, an aspect of the present disclosure is to provide a method, in which an electronic apparatus performs biometric authentication or provides a user with a feedback in various situations using a plurality of cameras, and an electronic apparatus using the same.

As used herein, each of such phrases as "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" may include all possible combinations of the items enumerated together in a corresponding one of the phrases. As used herein, such terms as "<NUM>st" and "<NUM>nd" or "first" and "second" may be used to simply distinguish a corresponding component from another, and does not limit the components in other aspect (e.g., importance or order). It is to be understood that if an element (e.g., a first element) is referred to, with or without the term "operatively" or "communicatively", as "coupled with", "coupled to", "connected with", or "connected to" another element (e.g., a second element), it means that the element may be coupled with the other element directly (e.g., wiredly), wirelessly, or via a third element.

For example, The module may be implemented in a form of an application-specific integrated circuit (ASIC).

A method according to appended claims of the disclosure may be included and provided in a computer program product.

Claim 1:
An electronic apparatus (<NUM>) comprising:
a first camera (<NUM>) disposed on one surface of the electronic apparatus (<NUM>);
a second camera (<NUM>) disposed on the one surface (<NUM>); and
a processor (<NUM>), connected to the first camera (<NUM>) and the second camera (<NUM>), configured to:
obtain a request associated with biometric authentication;
obtain, based on the request, at least one first image (<NUM>) using the first camera (<NUM>) having a first field of view, FOV;
obtain, based on the request, at least one second image (<NUM>) using the second camera (<NUM>) having a second FOV corresponding to a part of the first FOV;
identify a first external object associated with the biometric authentication from the at least one first image;
identify a second external object associated with the biometric authentication and corresponding to a part of the first external object, from the at least one second image;
provide a first notification indicating that the first external object is not identified from the at least one first image and the second external object is not identified from the at least one second image, when the first external object is not identified from the at least one first image and the second external object is not identified from the at least one second image;
provide a second notification for positioning the second external object in the second FOV, when the first external object is identified from the at least one first image and the second external object is not identified from the at least one second image; and
perform authentication using biometric information corresponding to at least a part of the second external object, when the second external object is identified from the at least one second image,
wherein the second notification includes information guiding at least one of a movement upward, a movement downward, a movement to the left, or a movement to the right and the information is determined based on the location of the first external object identified from the at least one first image.