Patent Description:
An electronic device may acquire user's biometric information using a light sensor. To acquire the user's biometric information, the electronic device requires a light emitting device and the light sensor.

<CIT> describes an electronic device including a display emitting light to provide optics-based fingerprint detection. <NPL>, discloses an approach for camera oximetry on smartphones. <CIT> discloses an electronic device including a display and a camera. <CIT> discloses a system and a method for calculating a patient's capillary refill time using a mobile device with an integrated camera and light source. <NPL>, relates to a method for non-invasive measurement of blood glucose concentration using a smartphone.

Conventionally, an electronic device may require dedicated light emitting device and light sensor, in order to provide the user with various functions associated with biometric information. In addition, since the light emitting device and the light sensor are exposed on a surface of a housing of the electronic device, design of the electronic device may be limited, and the cost for purchasing and installing the light emitting device and the light sensor increases.

Hence, research into acquisition of biometric information without needing dedicated light emitting device and light sensor has been conducted.

An electronic device according to an embodiment includes a device according to claim <NUM>.

An operating method of an electronic device that includes a housing according to an embodiment includes a method according to claim <NUM>. Further aspects are recited in the dependent claims.

Other aspects, advantages, and salient features of the disclosure will become apparent to those skilled in the art from the following detailed description, which, taken in conjunction with the annexed drawings, discloses an embodiment of the disclosure.

The electronic device (e.g., the electronic device <NUM> of <FIG>) and its operating method may provide the user with various functions associated with biometric information acquisition, without dedicated light emitting devices and optical sensors.

Throughout the drawings, like reference numerals will be understood to refer to like parts, components and structures.

<FIG> is a block diagram illustrating an electronic device <NUM> in a network environment <NUM> according to an embodiment.

According to an embodiment, the antenna module <NUM> may include an antenna including a radiating element composed of a conductive material or a conductive pattern formed in or on a substrate (e.g., printed circuit board (PCB)).

<FIG> is a block diagram <NUM> illustrating the display device <NUM> according to an embodiment. Referring to <FIG>, the display device <NUM> may include a display <NUM> and a display driver integrated circuit (DDI) <NUM> to control the display <NUM>. The DDI <NUM> may include an interface module <NUM>, memory <NUM> (e.g., buffer memory), an image processing module <NUM>, or a mapping module <NUM>. The DDI <NUM> may receive image information that contains image data or an image control signal corresponding to a command to control the image data from another component of the electronic device <NUM> via the interface module <NUM>. For example, according to an embodiment, the image information may be received from the processor <NUM> (e.g., the main processor <NUM> (e.g., an application processor)) or the auxiliary processor <NUM> (e.g., a graphics processing unit) operated independently from the function of the main processor <NUM>. The DDI <NUM> may communicate, for example, with touch circuitry <NUM> or the sensor module <NUM> via the interface module <NUM>. The DDI <NUM> may also store at least part of the received image information in the memory <NUM>, for example, on a frame by frame basis.

The image processing module <NUM> may perform pre-processing or post-processing (e.g., adjustment of resolution, brightness, or size) with respect to at least part of the image data. According to an embodiment, the pre-processing or post-processing may be performed, for example, based at least in part on one or more characteristics of the image data or one or more characteristics of the display <NUM>.

The mapping module <NUM> may generate a voltage value or a current value corresponding to the image data pre-processed or post-processed by the image processing module <NUM>. According to an embodiment, the generating of the voltage value or current value may be performed, for example, based at least in part on one or more attributes of the pixels (e.g., an array, such as an RGB stripe or a pentile structure, of the pixels, or the size of each subpixel). At least some pixels of the display <NUM> may be driven, for example, based at least in part on the voltage value or the current value such that visual information (e.g., a text, an image, or an icon) corresponding to the image data may be displayed via the display <NUM>.

According to an embodiment, the display device <NUM> may further include the touch circuitry <NUM>. The touch circuitry <NUM> may include a touch sensor <NUM> and a touch sensor IC <NUM> to control the touch sensor <NUM>. The touch sensor IC <NUM> may control the touch sensor <NUM> to sense a touch input or a hovering input with respect to a certain position on the display <NUM>. To achieve this, for example, the touch sensor <NUM> may detect (e.g., measure) a change in a signal (e.g., a voltage, a quantity of light, a resistance, or a quantity of one or more electric charges) corresponding to the certain position on the display <NUM>. The touch circuitry <NUM> may provide input information (e.g., a position, an area, a pressure, or a time) indicative of the touch input or the hovering input detected via the touch sensor <NUM> to the processor <NUM>. According to an embodiment, at least part (e.g., the touch sensor IC <NUM>) of the touch circuitry <NUM> may be formed as part of the display <NUM> or the DDI <NUM>, or as part of another component (e.g., the auxiliary processor <NUM>) disposed outside the display device <NUM>.

According to an embodiment, the display device <NUM> may further include at least one sensor (e.g., a fingerprint sensor, an iris sensor, a pressure sensor, or an illuminance sensor) of the sensor module <NUM> or a control circuit for the at least one sensor. In such a case, the at least one sensor or the control circuit for the at least one sensor may be embedded in one portion of a component (e.g., the display <NUM>, the DDI <NUM>, or the touch circuitry <NUM>)) of the display device <NUM>. For example, when the sensor module <NUM> embedded in the display device <NUM> includes a biometric sensor (e.g., a fingerprint sensor), the biometric sensor may obtain biometric information (e.g., a fingerprint image) corresponding to a touch input received via a portion of the display <NUM>. As another example, when the sensor module <NUM> embedded in the display device <NUM> includes a pressure sensor, the pressure sensor may obtain pressure information corresponding to a touch input received via a partial or whole area of the display <NUM>. According to an embodiment, the touch sensor <NUM> or the sensor module <NUM> may be disposed between pixels in a pixel layer of the display <NUM>, or over or under the pixel layer.

<FIG> is a block diagram <NUM> illustrating the camera module <NUM> according to an embodiment. Referring to <FIG>, the camera module <NUM> may include a lens assembly <NUM>, a flash <NUM>, an image sensor <NUM>, an image stabilizer <NUM>, memory <NUM> (e.g., buffer memory), or an image signal processor <NUM>. The lens assembly <NUM> may collect light emitted or reflected from an object whose image is to be taken. The lens assembly <NUM> may include one or more lenses. According to an embodiment, the camera module <NUM> may include a plurality of lens assemblies <NUM>. In such a case, the camera module <NUM> may form, for example, a dual camera, a <NUM>-degree camera, or a spherical camera. Some of the plurality of lens assemblies <NUM> may have the same lens attribute (e.g., view angle, focal length, auto-focusing, f number, or optical zoom), or at least one lens assembly may have one or more lens attributes different from those of another lens assembly. The lens assembly <NUM> may include, for example, a wide-angle lens or a telephoto lens.

The flash <NUM> may emit light that is used to reinforce light reflected from an object. According to an embodiment, the flash <NUM> may include one or more light emitting diodes (LEDs) (e.g., a red-green-blue (RGB) LED, a white LED, an infrared (IR) LED, or an ultraviolet (UV) LED) or a xenon lamp. The image sensor <NUM> may obtain an image corresponding to an object by converting light emitted or reflected from the object and transmitted via the lens assembly <NUM> into an electrical signal. According to an embodiment, the image sensor <NUM> may include one selected from image sensors having different attributes, such as a RGB sensor, a black-and-white (BW) sensor, an IR sensor, or a UV sensor, a plurality of image sensors having the same attribute, or a plurality of image sensors having different attributes. Each image sensor included in the image sensor <NUM> may be implemented using, for example, a charged coupled device (CCD) sensor or a complementary metal oxide semiconductor (CMOS) sensor.

The image stabilizer <NUM> may move the image sensor <NUM> or at least one lens included in the lens assembly <NUM> in a particular direction, or control an operational attribute (e.g., adjust the read-out timing) of the image sensor <NUM> in response to the movement of the camera module <NUM> or the electronic device <NUM> including the camera module <NUM>. This allows compensating for at least part of a negative effect (e.g., image blurring) by the movement on an image being captured. According to an embodiment, the image stabilizer <NUM> may sense such a movement by the camera module <NUM> or the electronic device <NUM> using a gyro sensor (not shown) or an acceleration sensor (not shown) disposed inside or outside the camera module <NUM>. According to an embodiment, the image stabilizer <NUM> may be implemented, for example, as an optical image stabilizer.

The memory <NUM> may store, at least temporarily, at least part of an image obtained via the image sensor <NUM> for a subsequent image processing task. For example, if image capturing is delayed due to shutter lag or multiple images are quickly captured, a raw image obtained (e.g., a Bayer-patterned image, a high-resolution image) may be stored in the memory <NUM>, and its corresponding copy image (e.g., a low-resolution image) may be previewed via the display device <NUM>. Thereafter, if a specified condition is met (e.g., by a user's input or system command), at least part of the raw image stored in the memory <NUM> may be obtained and processed, for example, by the image signal processor <NUM>. According to an embodiment, the memory <NUM> may be configured as at least part of the memory <NUM> or as a separate memory that is operated independently from the memory <NUM>.

The image signal processor <NUM> may perform one or more image processing with respect to an image obtained via the image sensor <NUM> or an image stored in the memory <NUM>. The one or more image processing may include, for example, depth map generation, three-dimensional (3D) modeling, panorama generation, feature point extraction, image synthesizing, or image compensation (e.g., noise reduction, resolution adjustment, brightness adjustment, blurring, sharpening, or softening). Additionally or alternatively, the image signal processor <NUM> may perform control (e.g., exposure time control or read-out timing control) with respect to at least one (e.g., the image sensor <NUM>) of the components included in the camera module <NUM>. An image processed by the image signal processor <NUM> may be stored back in the memory <NUM> for further processing, or may be provided to an external component (e.g., the memory <NUM>, the display device <NUM>, the electronic device <NUM>, the electronic device <NUM>, or the server <NUM>) outside the camera module <NUM>. According to an embodiment, the image signal processor <NUM> may be configured as at least part of the processor <NUM>, or as a separate processor that is operated independently from the processor <NUM>. If the image signal processor <NUM> is configured as a separate processor from the processor <NUM>, at least one image processed by the image signal processor <NUM> may be displayed, by the processor <NUM>, via the display device <NUM> as it is or after being further processed.

According to an embodiment, the electronic device <NUM> may include a plurality of camera modules <NUM> having different attributes or functions. In such a case, at least one of the plurality of camera modules <NUM> may form, for example, a wide-angle camera and at least another of the plurality of camera modules180 may form a telephoto camera. Similarly, at least one of the plurality of camera modules <NUM> may form, for example, a front camera and at least another of the plurality of camera modules <NUM> may form a rear camera.

The electronic device according to an embodiment may be one of various types of electronic devices. The electronic devices may include, for example, and without limitation, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, a home appliance, or the like.

It should be appreciated that an embodiment of the present disclosure and the terms used therein are not intended to limit the technological features set forth herein to particular embodiments.

It is to be understood that if an element (e.g., a first element) is referred to, with or without the term "operatively" or "communicatively", as "coupled with," "coupled to," "connected with," or "connected to" another element (e.g., a second element), the element may be coupled with the other element directly (e.g., wiredly), wirelessly, or via a third element.

An embodiment as set forth herein may be implemented as software (e.g., the program <NUM>) including one or more instructions that are stored in a storage medium (e.g., internal memory <NUM> or external memory <NUM>) that is readable by a machine (e.g., the electronic device <NUM>). Wherein, the "non-transitory" storage medium is a tangible device, and may not include a signal (e.g., an electromagnetic wave), but this term does not differentiate between where data is semi-permanently stored in the storage medium and where the data is temporarily stored in the storage medium.

According to an embodiment, a method according to an embodiment of the disclosure may be included and provided in a computer program product.

According to an embodiment, each component (e.g., a module or a program) of the above-described components may include a single entity or multiple entities. According to an embodiment, one or more of the above-described components may be omitted, or one or more other components may be added. In such a case, according to an embodiment, the integrated component may still perform one or more functions of each of the plurality of components in the same or similar manner as they are performed by a corresponding one of the plurality of components before the integration. According to an embodiment, operations performed by the module, the program, or another component may be carried out sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations may be executed in a different order or omitted, or one or more other operations may be added.

<FIG> are views illustrating an electronic device <NUM> according to an embodiment. <FIG> illustrates the electronic device <NUM> according to an embodiment. <FIG> is a view illustrating when the electronic device <NUM> acquires biometric information using the light of a display <NUM> according to an embodiment. <FIG> illustrates a side view of the electronic device <NUM> according to an embodiment, which is taken along a reference line A-A' in <FIG>. In an embodiment, the electronic device <NUM> of <FIG> may correspond to the electronic device <NUM> of <FIG>. In an embodiment, the electronic device <NUM> of <FIG> shall be described by referring to the configuration of the electronic device <NUM> of <FIG>.

Referring to <FIG>, in an embodiment, the electronic device <NUM> includes the display <NUM> and /or a camera <NUM>. In an embodiment, the display <NUM> and the camera <NUM> may correspond to the display <NUM> and the camera <NUM> of <FIG> respectively. In an embodiment, the electronic device <NUM> further includes a processor (e.g., the processor <NUM> of <FIG>).

The processor <NUM> may include a microprocessor or any suitable type of processing circuitry, such as one or more general-purpose processors (e.g., ARM-based processors), a Digital Signal Processor (DSP), a Programmable Logic Device (PLD), an Application-Specific Integrated Circuit (ASIC), a Field-Programmable Gate Array (FPGA), a Graphical Processing Unit (GPU), a video card controller, etc. In addition, it would be recognized that when a general purpose computer accesses code for implementing the processing shown herein, the execution of the code transforms the general purpose computer into a special purpose computer for executing the processing shown herein. Certain of the functions and steps provided in the Figures may be implemented in hardware, software or a combination of both and may be performed in whole or in part within the programmed instructions of a computer.

Referring to <FIG>, in an embodiment, the display <NUM> is exposed through, for example, most of a front plate <NUM>. In an embodiment, an opening is formed in part of the screen display area of the display <NUM>, and the camera <NUM> and, optionally, a proximity sensor (not shown), and/or a light sensor (not shown), is aligned with the opening.

In an embodiment, the processor (e.g., the processor <NUM> of <FIG>) displays a first user interface on the display <NUM> for receiving an input for acquiring user's biometric information. In an embodiment, the first user interface receives an input (e.g., a touch input) for selecting the type of the user's biometric information to measure while a biometric information measurement application is running. In an embodiment, the processor <NUM> identifies the type of the user's biometric information to measure based on the input received through the first user interface. In an embodiment, the first user interface may be generated by another running application that is not the biometric information measurement application. In an embodiment, the input for acquiring the user's biometric information includes a touch which covers the camera <NUM> with a user's finger <NUM>. In an embodiment, the biometric information includes heart rate, oxygen saturation, stress index, blood pressure, blood sugar, tissue hydration, tissue dehydration, or a combination thereof. The biometric information may include a fingerprint.

Referring to <FIG>, in an embodiment, the processor <NUM> receives the input for acquiring the user's biometric information through the display <NUM>. In an embodiment, the processor <NUM> detects the touch which covers the camera <NUM> with the user's finger <NUM> on the display <NUM>.

In an embodiment, if the touch that covers the camera <NUM> with the user's finger <NUM> is detected, the processor <NUM> displays a second user interface on the display <NUM>. In an embodiment, the second user interface is associated with the measurement of the user's biometric information while the biometric information measurement application is running.

In an embodiment, while displaying the second user interface, the processor <NUM> sets an emissive area <NUM> in response to detecting a touch area <NUM> from the touch that is covering the camera <NUM> with the user's finger <NUM>, and control the display <NUM> to emit lights <NUM> and <NUM> from the set emissive area <NUM>. In an embodiment, the touch area <NUM> may be detected by using a touch sensor (not shown) and/or a pressure sensor (not shown) of the display <NUM>. In an embodiment, the intensity of the lights <NUM> and <NUM> emitted from the emissive area <NUM> may be higher than the intensity of a light emitted from other areas of the second user interface. In an embodiment, the intensity of the lights <NUM> and <NUM> emitted from the emissive area <NUM> may be, for example, higher than the light intensity from the display <NUM> when the first user interface is displayed. Alternatively, the intensity of the lights <NUM> and <NUM> emitted from the emissive area <NUM> may be higher than or equal to the light intensity from the display <NUM> when the first user interface is displayed. In an embodiment, while the first user interface is displayed, light may be emitted from the display <NUM> at a first intensity, and the lights <NUM> and <NUM> may be emitted from the emissive area <NUM> at a second intensity which is higher than the first intensity.

In an embodiment, the processor <NUM> sets the emissive area <NUM> within the touch area <NUM> that corresponds to the touch input that is covering the camera <NUM> with the finger <NUM>. In an embodiment, the processor <NUM> sets the edge of the emissive area <NUM> to be within a set distance from the camera <NUM> based on the touch area <NUM> which covers the camera <NUM> with the finger <NUM>. In an embodiment, the processor <NUM> sets the size of the emissive area <NUM> to correspond to the touch area <NUM>. In an embodiment, the boundary of the emissive area <NUM> may be within the boundary of the touch area <NUM>. In an embodiment, the processor <NUM> may change the size and/or the boundary of the emissive area <NUM> as the touch area <NUM> changes.

In an embodiment, the processor <NUM> sets the emissive area <NUM> based on the type of the biometric information to be acquired. In an embodiment, the processor <NUM> adjusts the shape of the emissive area <NUM> and/or the position of the emissive area <NUM> on the display <NUM> in response to the type of the biometric information to be acquired. In an embodiment, information relating to the shape of the emissive area <NUM>, the position of the emissive area <NUM> on the display <NUM>, or their combination may be preset in a memory (e.g., the memory <NUM> of <FIG>) per type of the biometric information to be acquired. In an embodiment, the shape of the emissive area <NUM> may include a polygon, a circle, an oval, or a combination thereof. In an embodiment, the position of the emissive area <NUM> includes a position away from the camera <NUM> by a preset distance on the display <NUM>, and may include a position surrounding the camera <NUM>.

In an embodiment, the processor <NUM> adjusts the color of the lights <NUM> and <NUM>, the intensity of the lights <NUM> and <NUM>, or a combination thereof, in response to the type of the biometric information to acquire. In an embodiment, the processor <NUM> adjusts the color of the lights <NUM> and <NUM>, the intensity of the lights <NUM> and <NUM>, or a combination thereof, in response to the touch area of the finger <NUM>. In an embodiment, the processor <NUM> adjusts the intensity of the lights <NUM> and <NUM> to increase as the touch area of the finger <NUM> narrows. In an embodiment, information relating to the color of the lights <NUM> and <NUM>, the intensity of the lights <NUM> and <NUM>, or their combination per the type of the biometric information to be acquired may be preset in the memory (e.g., the memory <NUM> of <FIG>).

Referring to <FIG>, in an embodiment, the processor <NUM> may receive reflection lights <NUM> and <NUM> of the lights <NUM> and <NUM> emitted from the emissive area <NUM>, through the camera <NUM>. In an embodiment, the processor <NUM> may acquire the user's biometric information, based on the received reflection lights <NUM> and <NUM>.

In an embodiment, the processor <NUM> may reset the emissive area <NUM> based on the reflection lights <NUM> and <NUM>. In an embodiment, if asymmetry for a reference direction of an image acquired based on the reflection lights <NUM> and <NUM> is identified, the processor <NUM> may reset the emissive area <NUM>, based on the degree of the asymmetry for the reference direction of the image. In an embodiment, the processor <NUM> may reset the emissive area <NUM> to generate a symmetric image acquired based on the reflection lights <NUM> and <NUM>. In an embodiment, the processor <NUM> may acquire the user's biometric information based on the reset emissive area.

In an embodiment, the lights <NUM> and <NUM> are the lights of the display <NUM> by way of example, but the lights <NUM> and <NUM> may be emitted by a light source which emits infrared light (e.g., an infrared light emitting diode (LED)). In an embodiment, if the lights <NUM> and <NUM> are the infrared lights, the camera <NUM> may be a time of flight (TOF) sensor or a fingerprint sensor.

<FIG> are views each illustrating biometric information measurement using an electronic device <NUM> according to an embodiment. <FIG> are views each illustrating an example of an emissive area of an electronic device <NUM> according to an embodiment. In an embodiment, the electronic device <NUM> of <FIG> or the electronic device <NUM> of <FIG> may correspond to the electronic device <NUM> of <FIG> or the electronic device <NUM> of <FIG>. In an embodiment, <FIG> and <FIG> are described by referring to the configuration of the electronic device <NUM> of <FIG>.

In an embodiment, referring to <FIG>, a camera <NUM> of the electronic device <NUM> may overlap the display <NUM>, if the electronic device <NUM> is viewed from a first direction (e.g., a front direction of the electronic device <NUM>). In an embodiment, the overlapping area of the camera <NUM> of the electronic device <NUM> on the display <NUM> may not include a light emitting device of the display <NUM>. In an embodiment, the display <NUM> may be exposed through, for example, most of the front plate <NUM>.

In an embodiment, referring to <FIG>, a processor (e.g., the processor <NUM>) displays a first user interface <NUM> on the display <NUM>. In an embodiment, the first user interface <NUM> receives an input (e.g., a touch input) for selecting the type of user's biometric information to measure while, for example, a biometric information measurement application is running. In an embodiment, the first user interface <NUM> may be generated by another running application than is not the biometric information measurement application.

In an embodiment, referring to <FIG>, the processor <NUM> identifies a touch covering the camera <NUM> with a user's finger (e.g., the finger <NUM> of <FIG>), while displaying the first user interface <NUM> on the display <NUM>. In an embodiment, if the touch covering the camera <NUM> is identified, the processor <NUM> displays a second user interface <NUM> which is different from the first user interface <NUM> on the display <NUM>.

In an embodiment, the processor <NUM> identifies the touch covering the camera <NUM>, based on a touch area detected by a touch sensor (not shown) of the display <NUM> that corresponds to a touch area <NUM> of the finger <NUM>. In an embodiment, if the detected touch area surrounds the camera <NUM>, the processor <NUM> may identify that the touch is covering the camera <NUM>. In an embodiment, if the touch of the finger <NUM> is detected, the processor <NUM> may identify the touch covering the camera <NUM> based on an image acquired through the camera <NUM>. In an embodiment, in response to the touch input in a preset area (e.g., a preset area to surround the camera <NUM>) of the display <NUM>, the processor <NUM> may enable the camera <NUM> and identify the touch covering the camera <NUM> based on the image acquired through the camera <NUM>.

In an embodiment, if the touch covering the camera <NUM> is identified, the processor <NUM> may identify whether the camera <NUM> is completely covered with the finger <NUM>. In an embodiment, the processor <NUM> may identify whether the camera <NUM> is completely covered based on light acquired through an image sensor (not shown) of the camera <NUM>. In an embodiment, if the light acquired through the image sensor (not shown) of the camera <NUM> includes light other than the reflection light of the light emitted from the display <NUM>, the processor <NUM> may identify that the camera <NUM> is not completely covered with the finger <NUM>. In an embodiment, if the light acquired through the image sensor (not shown) of the camera <NUM> does not include light other than the reflection light of the light emitted from the display <NUM>, the processor <NUM> may identify that the camera <NUM> is completely covered with the finger <NUM>.

In an embodiment, if the camera <NUM> is completely covered with the finger <NUM>, the processor <NUM> displays the second user interface <NUM> for biometric measurement as shown in <FIG>. In an embodiment, if the camera <NUM> is not completely covered with the finger <NUM>, the processor <NUM> may display a third user interface <NUM> including an indicator <NUM> which guides the user to retouch the display <NUM> with his or her finger <NUM> as shown in <FIG>. In an embodiment, the second user interface <NUM> may be displayed when measuring the user's biometric information while the biometric information measurement application is running. In an embodiment, the third user interface <NUM> may indicate to the user that retouch is required in order for biometric information to be measured.

In an embodiment, referring to <FIG>, the processor <NUM> displays the second user interface <NUM> on the display <NUM>. In an embodiment, the processor <NUM> may set part of the second user interface <NUM> as an emissive area <NUM>. In an embodiment, the processor <NUM> may set the emissive area <NUM> based on the touch area <NUM> of the finger <NUM>. In an embodiment, the processor <NUM> may set the emissive area <NUM> so that its boundary is within the touch area <NUM> of the finger <NUM>. In an embodiment, the processor <NUM> may set the emissive area <NUM> to surround the camera <NUM>. In an embodiment, the processor <NUM> determines the shape, pattern, size, position, or their combination of the emissive area <NUM>, based on the type of the biometric information to be acquired, where the type is selected by the user while the first user interface <NUM> is displayed.

In an embodiment, the processor <NUM> may emit preset lights (e.g., the lights <NUM> and <NUM> of <FIG>) in the emissive area <NUM> on the display <NUM>. In an embodiment, the processor <NUM> may determine the color, intensity, or their combination of the lights <NUM> and <NUM>, based on the type of the biometric information to be acquired. In an embodiment, the processor <NUM> may determine the color, intensity, or their combination of the lights <NUM> and <NUM>, while the first user interface <NUM> is displayed.

In an embodiment, the processor <NUM> may emit the lights <NUM> and <NUM> in the emissive area <NUM> on the display <NUM>, and measure the user's biometric information, based on the reflection lights <NUM> and <NUM> of the lights <NUM> and <NUM> acquired through the camera <NUM>.

While the emissive area <NUM> of <FIG> is shown in this example in a ring shape, the instant disclosure is not so limited and the emissive area <NUM> may adopt various shapes. In an embodiment, referring to <FIG>, the electronic device <NUM> may include two or more emissive areas <NUM> and <NUM> on the display <NUM>, where the display <NUM> is exposed through most of a front plate <NUM> of the electronic device <NUM>. In an embodiment, the emissive areas <NUM> and <NUM> collectively may have a circular shape. In an embodiment, the emissive areas <NUM> and <NUM> may be disposed symmetrically around the center of a camera <NUM>, by way of example. Alternatively, the emissive areas <NUM> and <NUM> may be disposed asymmetrically around the center of the camera <NUM>.

In an embodiment, the processor <NUM> may control to illuminate the emissive areas <NUM> and <NUM> at different times. In an embodiment, the processor <NUM> may illuminate the emissive area <NUM> in a first time duration, and illuminate the emissive area <NUM> in a second time duration after the expiration of the first time duration. In an embodiment, the first time duration and the second time duration may each be a time duration for the biometric measurement.

In an embodiment, the processor <NUM> may control to illuminate the emissive areas <NUM> and <NUM> in different colors. In an embodiment, the processor <NUM> may emit light of a first color (e.g., red) from the emissive area <NUM>, and emit light of a second color (e.g., green) from the emissive area <NUM> by way of example. Alternatively, the processor <NUM> may control to illuminate the emissive areas <NUM> and <NUM> in the same color.

In an embodiment, the processor <NUM> may control to emit light of the first color (e.g., red) from the emissive areas <NUM> and <NUM> in the first time duration, and to emit light of the second color (e.g., green) from the emissive areas <NUM> and <NUM> in the second time duration. In an embodiment, the processor <NUM> may control the emissive areas <NUM> and <NUM> to emit light in a color (e.g., yellow) mixed from the first color (e.g., red) and the second color (e.g., green).

In an embodiment, referring to <FIG>, an emissive area <NUM> of the display <NUM> exposed through most of the front plate <NUM> of the electronic device <NUM> may include two or more emissive subareas <NUM> and <NUM>. In an embodiment, to emit the light in a preset pattern, the processor <NUM> may divide the emissive area <NUM> into two or more emissive subareas <NUM> and <NUM>. In an embodiment, the processor <NUM> may control the display <NUM> to emit the light corresponding to the preset pattern from the emissive subareas <NUM> and <NUM>.

In an embodiment, the processor <NUM> may control to illuminate the emissive subareas <NUM> and <NUM> at different times. In an embodiment, the processor <NUM> may control to illuminate the emissive subareas <NUM> and <NUM> in different colors.

In an embodiment, referring to <FIG>, emissive areas <NUM> and <NUM> of the display <NUM> exposed through most of the front plate <NUM> of the electronic device <NUM> may include the emissive area <NUM> directly adjacent to the camera <NUM> and the emissive area <NUM> in which the emissive area <NUM> is interposed between the emissive area <NUM> and the camera <NUM>. In an embodiment, the processor <NUM> may control to illuminate the emissive areas <NUM> and <NUM> at different times. In an embodiment, the processor <NUM> may control to illuminate the emissive areas <NUM> and <NUM> in different colors. In an embodiment, the processor <NUM> may control the emissive areas <NUM> and <NUM> so that light sources closer to the camera <NUM> emit light of relatively shorter wavelengths. For example, the emissive area <NUM>, which is farther from the camera <NUM>, may emit light of the first color (e.g., red), and the emissive area <NUM>, which is closer to the camera <NUM>, may emit light of the second color (e.g., green).

In an embodiment, the processor <NUM> may control to illuminate the emissive areas <NUM> and <NUM> with different intensities. In an embodiment, the processor <NUM> may control to illuminate the emissive area <NUM> with light of a first intensity, and to illuminate the emissive area <NUM> with light of a second intensity. In different embodiments, the first intensity may be higher or lower than the second intensity.

In an embodiment, referring to <FIG>, two or more emissive areas <NUM> and <NUM> of the display <NUM> exposed through most of the front plate <NUM> of the electronic device <NUM> may be configured. In an embodiment, the emissive areas <NUM> and <NUM> together may form a quadrangular shape.

In an embodiment, referring to <FIG>, a quadrangular emissive area <NUM> of the display <NUM> exposed through most of the front plate <NUM> of the electronic device <NUM> may include two or more emissive subareas <NUM> and <NUM>.

In an embodiment, referring to <FIG>, emissive areas <NUM> and <NUM> of the display <NUM> of the front plate <NUM> of the electronic device <NUM> may include the quadrangular emissive area <NUM> directly adjacent to the camera <NUM> and the quadrangular emissive area <NUM>, in which the emissive area <NUM> is interposed between the quadrangular emissive area <NUM> and the camera <NUM>.

The emissive areas <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, and <NUM> are shown here either as circular or quadrangular. However, these are only examples, and the emissive areas may be additional shapes such as polygons.

In an embodiment, referring to <FIG>, if the processor <NUM> identifies that the camera <NUM> is not completely covered with the finger <NUM>, the processor <NUM> may display the indicator <NUM> on the third user interface <NUM> which guides the user to retouch the display <NUM> with his or her finger <NUM>. In an embodiment, the indicator <NUM> may be an image object in a shape indicating the camera <NUM> by way of example. The indicator <NUM> may include a phrase, an image, or their combination, for requesting the retouch.

In an embodiment, the processor <NUM> may determine the position of the indicator <NUM>, based on the position of the light other than the reflection light acquired through the image sensor (not shown) of the camera <NUM>. The position of the light other than the reflection light may be a position corresponding to an area exposed to the light other than the reflection light. In an embodiment, if the position of the light other than the reflection light is in a first direction from the center of the camera <NUM>, for example, the processor <NUM> may determine the position of the indicator <NUM> to be a position that is a set distance in the first direction away from a preset reference position. In an embodiment, the processor <NUM> may determine the set distance in response to the area exposed to the light other than the reflection light on the image acquired through the image sensor (not shown) of the camera <NUM>. In an embodiment, the processor <NUM> may determine the set distance in response to the width of the area exposed to the light other than the reflection light.

In an embodiment, referring to <FIG>, if the indicator <NUM> is displayed and then the touch covering the camera <NUM> is identified, the processor <NUM> may identify whether the camera <NUM> is completely covered with the finger <NUM>. In an embodiment, if it is identified that the camera <NUM> is completely covered by the retouch of the finger <NUM>, the processor <NUM> may store position information of the indicator <NUM> in memory (e.g., the memory <NUM> of <FIG>).

In an embodiment, if the camera <NUM> is completely covered by the retouch of the finger <NUM>, the processor <NUM> may display the second user interface <NUM> for the biometric measurement as shown in <FIG>. In an embodiment, if the camera <NUM> is not completely covered by the retouch of the finger <NUM>, the processor <NUM> may display again the third user interface <NUM> including the indicator <NUM> that guides the user to retouch the display <NUM> as shown in <FIG>.

In an embodiment, the processor <NUM> may emit the lights <NUM> and <NUM> from the emissive area of the display <NUM> after the retouch of the finger <NUM> while displaying the second user interface <NUM>, and measure the user's biometric information, based on the reflection lights <NUM> and <NUM> of the lights <NUM> and <NUM> acquired through the camera <NUM>.

In an embodiment, while displaying the third user interface <NUM>, the processor <NUM> may redisplay the indicator <NUM> which requests the retouch of the finger <NUM>. In an embodiment, the processor <NUM> may display the indicator <NUM> at a redetermined position based on the touch area <NUM> of the finger <NUM>.

<FIG> are views each illustrating biometric information measurement using an electronic device <NUM> according to an embodiment. <FIG> are views each illustrating an example of an emissive area of an electronic device <NUM> according to an embodiment. In an embodiment, the electronic device <NUM> of <FIG> or the electronic device <NUM> of <FIG> may correspond to the electronic device <NUM> of <FIG> or the electronic device <NUM> of <FIG>. In an embodiment, <FIG> and <FIG> are described by referring to the configuration of the electronic device <NUM> of <FIG>. Redundant descriptions of <FIG> and <FIG> shall be omitted in the descriptions of <FIG> and <FIG>.

A display <NUM> and a camera <NUM> of <FIG> may overlap each other, if the user views the electronic device <NUM> in a first direction (e.g., a front direction of the electronic device <NUM>). In an embodiment, a light emitting device of the display <NUM> may be disposed in the overlapping area of the camera <NUM> of the electronic device <NUM> in the display <NUM>. In an embodiment, the display <NUM> may be exposed through, for example, most of a front plate <NUM>.

In an embodiment, if the camera <NUM> is disabled, the user may not be able to see the camera <NUM>. In an embodiment, if the camera <NUM> is disabled, the light emitting device of the overlapping area of the camera <NUM> in the display <NUM> may emit light. Alternatively, if the camera <NUM> is enabled, the user may be able to see the camera <NUM>. In an embodiment, if the camera <NUM> is enabled, the light emitting device of the overlapping area of the camera <NUM> in the display <NUM> may not emit light.

In an embodiment, referring to <FIG>, a processor (e.g., the processor <NUM>) may display a first user interface <NUM> on the display <NUM>.

In an embodiment, referring to <FIG>, the processor <NUM> may identify a touch covering the camera <NUM> with a user's finger (e.g., the finger <NUM> of <FIG>), while the first user interface <NUM> is displayed on the display <NUM>. In an embodiment, if the touch covering the camera <NUM> is identified, the processor <NUM> may display a second user interface <NUM> which is different from the first user interface <NUM> on the display <NUM>.

In an embodiment, the processor <NUM> may identify the touch covering the camera <NUM>, based on a touch area detected by a touch sensor (not shown) of the display <NUM> that corresponds to a touch area <NUM> of the finger <NUM>. In an embodiment, if the detected touch area corresponds to the overlapping area of the camera <NUM> in the display <NUM>, the processor <NUM> may identify the touch covering the camera <NUM>. In an embodiment, if the detected touch area surrounds the camera <NUM>, the processor <NUM> may identify the touch covering the camera <NUM>. In an embodiment, if the touch of the finger <NUM> is detected, the processor <NUM> may identify the touch covering the camera <NUM> based on an image acquired through the camera <NUM>. In an embodiment, in response to the touch input in a preset area (e.g., a preset area to surround the camera <NUM>) of the display <NUM>, the processor <NUM> may enable the camera <NUM> and identify the touch covering the camera <NUM> based on the image acquired through the camera <NUM>.

In an embodiment, if the camera <NUM> is completely covered with the finger <NUM>, the processor <NUM> may display the second user interface <NUM> for biometric measurement as shown in <FIG>. In an embodiment, if the camera <NUM> is not completely covered with the finger <NUM>, the processor <NUM> may display a third user interface <NUM> including an indicator <NUM> which guides the user to retouch the display <NUM> with his or her finger <NUM> as shown in <FIG>.

In an embodiment, referring to <FIG>, the processor <NUM> may display the second user interface <NUM> on the display <NUM>. In an embodiment, the processor <NUM> may set part of the second user interface <NUM> as an emissive area <NUM>. In an embodiment, the processor <NUM> may set the emissive area <NUM> based on the touch area <NUM> of the finger <NUM>. In an embodiment, the processor <NUM> may set the emissive area <NUM> so that its boundary is within the touch area <NUM> of the finger <NUM>.

In an embodiment, the processor <NUM> may emit preset lights (e.g., the lights <NUM> and <NUM> of <FIG>) from the emissive area <NUM> on the display <NUM>. In an embodiment, the processor <NUM> may determine the color, intensity, or their combination of the lights <NUM> and <NUM>, based on the type of the biometric information to be acquired.

In an embodiment, the processor <NUM> may emit the lights <NUM> and <NUM> from the emissive area <NUM> on the display <NUM>, and measure the user's biometric information, based on the reflection lights <NUM> and <NUM> of the lights <NUM> and <NUM> acquired through the camera <NUM>.

While the emissive area <NUM> of <FIG> shown in this example is in a ring shape, the instant disclosure is not so limited and the emissive area <NUM> may adopt various shapes. In an embodiment, referring to <FIG>, the electronic device <NUM> may include two or more emissive areas <NUM> and <NUM> on a display <NUM>, where the display <NUM> is exposed through most of a front plate <NUM> of the electronic device <NUM>. In an embodiment, the emissive areas <NUM> and <NUM> collectively may have a circular shape. In an embodiment, the emissive areas <NUM> and <NUM> may be disposed symmetrically around the center of the camera <NUM>, by way of example. Alternatively, the emissive areas <NUM> and <NUM> may be disposed asymmetrically around the center of the camera <NUM>.

In an embodiment, the processor <NUM> may control to illuminate the emissive areas <NUM> and <NUM> at different times. In an embodiment, the processor <NUM> may control to illuminate the emissive areas <NUM> and <NUM> in different colors.

In an embodiment, the processor <NUM> may control the emissive areas <NUM> and <NUM> to emit light of a first color (e.g., red) in a first time duration, and to emit light of a second color (e.g., green) in a second time duration. In an embodiment, the processor <NUM> may control to illuminate the emissive areas <NUM> and <NUM> in light of a color (e.g., yellow) mixed from the first color (e.g., red) and the second color (e.g., green).

In an embodiment, referring to <FIG>, emissive areas <NUM> and <NUM> of the display <NUM> exposed through most of the front plate <NUM> of the electronic device <NUM> may include the emissive area <NUM> directly adjacent to the camera <NUM> and the emissive area <NUM> in which the emissive area <NUM> is interposed between the emissive area <NUM> and the camera <NUM>. In an embodiment, the processor <NUM> may control to illuminate the emissive areas <NUM> and <NUM> at different times. In an embodiment, the processor <NUM> may control to illuminate the emissive areas <NUM> and <NUM> in different colors. In an embodiment, the processor <NUM> may control to illuminate the emissive areas <NUM> and <NUM> so that light sources closer to the camera <NUM> emit light of relatively shorter wavelengths. For example, the emissive area <NUM>, which is farther from the camera <NUM>, may emit light of the first color (e.g., red), and the emissive area <NUM>, which is closer to the camera <NUM>, may emit light of the second color (e.g., green).

In an embodiment, referring to <FIG>, emissive areas <NUM> and <NUM> of the display <NUM> exposed through most of the front plate <NUM> of the electronic device <NUM> may include the quadrangular emissive area <NUM> directly adjacent to the camera <NUM> and the quadrangular emissive area <NUM>, in which the emissive area <NUM> is interposed between the quadrangular emissive area <NUM> and the camera <NUM>.

In an embodiment not covered by the claims, referring to <FIG>, an emissive area <NUM> of the display <NUM> may be configured with an area of the same size as the camera <NUM>. Accordingly, in this embodiment, the camera <NUM> is not disposed in a recess or opening of the display <NUM> but rather it overlaps with pixels of the display <NUM>. In an embodiment, the emissive area <NUM> of the display <NUM> may emit light on a periodic basis. In an embodiment, in response to the periodic emission of the emissive area <NUM> of the display <NUM>, the camera <NUM> may receive the reflected light of the light emitted from the emissive area <NUM> of the display <NUM>. In an embodiment, light emission by the emissive area <NUM> and light detection by the camera <NUM> may be separated in time. In such an embodiment, the processor <NUM> may control the emissive area <NUM> not to emit light while the camera <NUM> is receiving light. In an embodiment, the processor <NUM> may set a shadow area (not shown) around the emissive area <NUM>. In an embodiment, the shadow area (not shown) may emit light during the biometric measurement. In an embodiment, the shadow area (not shown) may be set within the touch area <NUM> of the finger <NUM>.

The emissive areas <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, and <NUM> are shown here either as circular or quadrangular. However, these are only examples, and the emissive areas may be additional shapes such as polygons.

In an embodiment, referring to <FIG>, if the indicator <NUM> is displayed and then the touch covering the camera <NUM> is identified, the processor <NUM> may identify whether the camera <NUM> is completely covered with the finger <NUM>. In an embodiment, if it is identified that the camera <NUM> is completely covered by the retouch of the finger <NUM>, the processor <NUM> may store position information of the indicator <NUM> in a memory (e.g., the memory <NUM> of <FIG>).

<FIG> are views each illustrating biometric information measurement using an electronic device <NUM> according to an embodiment. <FIG>, and <FIG> are views each illustrating an example of an emissive area of an electronic device <NUM> according to an embodiment. In an embodiment, the electronic device <NUM> of <FIG> or the electronic device <NUM> of <FIG> may correspond to the electronic device <NUM> of <FIG> or the electronic device <NUM> of <FIG>. In an embodiment, <FIG> and <FIG>, <FIG>, and <FIG> are described by referring to the configuration of the electronic device <NUM> of <FIG>.

In an embodiment, referring to <FIG>, a camera <NUM> of the electronic device <NUM> may not overlap a display <NUM>, if the electronic device <NUM> is viewed in a first direction (e.g., a front direction of the electronic device <NUM>). In an embodiment, the camera <NUM> may be disposed in an area where the display <NUM> is not exposed, on a front plate <NUM>.

In an embodiment, the processor <NUM> may identify the touch covering the camera <NUM>, based on a touch area detected by a touch sensor (not shown) of the display <NUM> that corresponds to a touch area <NUM> of the finger <NUM>. In an embodiment, if detecting the touch of the finger <NUM>, the processor <NUM> may identify the touch covering the camera <NUM> based on an image acquired through the camera <NUM>. In an embodiment, in response to the touch input in a preset area (e.g., an area adjacent to the camera <NUM> on the display <NUM>) of the display <NUM>, the processor <NUM> may enable the camera <NUM> and identify the touch covering the camera <NUM> based on the image acquired through the camera <NUM>.

In an embodiment, referring to <FIG>, the processor <NUM> may display the second user interface <NUM> on the display <NUM>. In an embodiment, the processor <NUM> may set part of the second user interface <NUM> as an emissive area <NUM>. In an embodiment, the processor <NUM> may set the emissive area <NUM> based on the touch area <NUM> of the finger <NUM>. In an embodiment, the processor <NUM> may set the emissive area <NUM> so that its boundary is within the touch area <NUM> of the finger <NUM>. In an embodiment, the processor <NUM> may set the emissive area <NUM> close to the camera <NUM>. In an embodiment, the processor <NUM> may determine the shape, pattern, size, position, or their combination of the emissive area <NUM>, based on the type of the biometric information to be acquired, where the type may be selected by the user while the first user interface <NUM> is displayed.

While the emissive area <NUM> of <FIG> is shown in this example in an oval shape, the instant disclosure is not so limited and the emissive area <NUM> may adopt various shapes. In an embodiment, referring to <FIG>, an emissive area <NUM> of a display <NUM> may be quadrangular in shape, by way of example. The emissive area <NUM> may have shapes such as polygons, circles, ovals, etc..

Referring to <FIG>, emissive areas <NUM> and <NUM> of the display <NUM> may include two or more emissive areas. In an embodiment, the processor <NUM> may control to illuminate the emissive areas <NUM> and <NUM> at different times. Thus, in this embodiment, the processor <NUM> may control to illuminate the emissive area <NUM> in a first time duration and to illuminate the emissive area <NUM> in a second time duration.

In an embodiment, the processor <NUM> may control the emissive areas <NUM> and <NUM> to emit light of a first color (e.g., red) in a first time duration, and to emit light of a second color (e.g., green) in a second time duration. In an embodiment, the processor <NUM> may control to illuminate the emissive areas <NUM> and <NUM> in a color (e.g., yellow) mixed from the first color (e.g., red) and the second color (e.g., green).

In an embodiment, referring to <FIG>, an emissive area <NUM> of the display <NUM> may include two or more emissive subareas <NUM> through <NUM>. In an embodiment, to emit the light in a preset pattern, the processor <NUM> may divide the emissive area <NUM> into two or more emissive subareas <NUM> through <NUM>. In an embodiment, the processor <NUM> may control the display <NUM> to emit the light corresponding to the preset pattern from the emissive subareas <NUM> through <NUM>.

In an embodiment, the processor <NUM> may control the emissive subareas <NUM> through <NUM> at different times. In an embodiment, the processor <NUM> may control to illuminate the emissive subareas <NUM> through <NUM> in different colors.

<FIG> illustrates a flowchart of operations of an electronic device (e.g., the electronic device <NUM> of <FIG>) according to an embodiment. The operations of <FIG> shall be described by referring to the configurations of the electronic device <NUM> of <FIG> and the electronic device <NUM> of <FIG>.

Referring to <FIG>, in operation <NUM>, a processor (e.g., the processor <NUM> of <FIG>) displays a user interface on a display (e.g., the display <NUM>). In an embodiment, the user interface displayed in operation <NUM>, in connection with a sensor (e.g. touch sensor), may receive an input (e.g., a touch input) for selecting a type of user's biometric information to be measured while, for example, a biometric information measurement application is running. In an embodiment, the user interface may be generated by another running application that is different from the biometric information measurement application.

In an embodiment, the processor <NUM> determines the type of the biometric information to acquire through the user interface displayed in operation <NUM>. In an embodiment, the biometric information includes heart rate, oxygen saturation, stress index, blood pressure, blood sugar, tissue hydration, tissue dehydration, or a combination thereof. The biometric information acquired with the reflection light is not limited thereto, and may include fingerprint.

In operation <NUM>, the processor <NUM> identifies a touch which covers a camera (e.g., the camera <NUM>) with the user's finger (e.g., the finger <NUM> of <FIG>). In an embodiment, the processor <NUM> may identify the touch covering the camera <NUM>, based on a touch area detected by a touch sensor (not shown) of the display <NUM> that corresponds to the touch area <NUM> of the finger <NUM>. In an embodiment, if the detected touch area surrounds the camera <NUM>, the processor <NUM> may identify the touch covering the camera <NUM>. In an embodiment, if the touch of the finger <NUM> is detected, the processor <NUM> may identify the touch covering the camera <NUM> based on an image acquired through the camera <NUM>. In an embodiment, in response to the touch input in a preset area (e.g., a preset area to surround the camera <NUM>) of the display <NUM>, the processor <NUM> may enable the camera <NUM> and identify the touch covering the camera <NUM> based on the image acquired through the camera <NUM>.

In an embodiment, if the touch covering the camera <NUM> is identified ('YES'), the processor <NUM> may perform operation <NUM>. In an embodiment, if the touch covering the camera <NUM> is not identified ('NO'), the processor <NUM> may return to operation <NUM>.

In operation <NUM>, the processor <NUM> changes the user interface to a user interface for biometric information acquisition. In an embodiment, the user interface displayed in operation <NUM> may be associated with the measurement of the user's biometric information while the biometric information measurement application is running.

In operation <NUM>, the processor <NUM> acquires biometric information using light emitted from the display <NUM>. In an embodiment, the processor <NUM> may acquire the biometric information, by emitting light (e.g., the lights <NUM> and <NUM> of <FIG>) from an emissive area (e.g., the emissive area <NUM> of <FIG>) of the user interface, obtaining reflection light (e.g., the lights <NUM> and <NUM> of <FIG>) of the lights <NUM> and <NUM> through the camera <NUM>, and analyzing the obtained reflection lights <NUM> and <NUM>.

In an embodiment, the processor <NUM> sets part of the user interface as the emissive area <NUM>. In an embodiment, the processor <NUM> may set the emissive area <NUM> based on the touch area <NUM> of the finger <NUM>. In an embodiment, the processor <NUM> may set the emissive area <NUM> so that its boundary is within the touch area <NUM> of the finger <NUM>. In an embodiment, the processor <NUM> may set the emissive area <NUM> to surround the camera <NUM>. In an embodiment, the processor <NUM> determines the shape, pattern, size, position, or their combination of the emissive area <NUM>, based on the type of the biometric information to be acquired while the user interface is displayed in operation <NUM>.

In an embodiment, the processor <NUM> may emit preset light (e.g., the lights <NUM> and <NUM> of <FIG>) from the emissive area <NUM> on the display <NUM>. In an embodiment, the processor <NUM> may determine the color, intensity, or their combination of the lights <NUM> and <NUM>, based on the type of the biometric information to be acquired while the user interface is displayed in operation <NUM>.

In an embodiment, operation <NUM> of <FIG> may correspond to operation <NUM> of <FIG>. In an embodiment, operation <NUM> of <FIG> may correspond to operation <NUM> of <FIG>.

Referring to <FIG>, in operation <NUM>, a processor (e.g., the processor <NUM> of <FIG> may identify a touch which covers a camera (e.g., the camera <NUM>) with a user's finger (e.g., the finger <NUM> of <FIG>).

In operation <NUM>, the processor <NUM> may identify whether a change of the touch position is required. In an embodiment, if the camera <NUM> is not completely covered with the finger <NUM>, the processor <NUM> may identify that it is necessary to change the touch position.

In an embodiment, if light acquired through an image sensor (not shown) of the camera <NUM> includes light other than the reflection light of light emitted from the display (e.g., the display <NUM> of <FIG>), the processor <NUM> may identify that the camera <NUM> is not completely covered with the finger <NUM>.

In an embodiment, if the processor <NUM> identifies that it is necessary to change the touch position ('YES'), the processor <NUM> may perform operation <NUM>. In an embodiment, if the processor <NUM> identifies that the touch position does not need to change ('NO'), the processor <NUM> may perform operation <NUM>.

In operation <NUM>, the processor <NUM> may guide the user to retouch the display <NUM>. In an embodiment, the processor <NUM> may display an indicator requesting the retouch of the finger <NUM> on a user interface. In an embodiment, the position of the indicator requesting the retouch may be determined based on information stored in memory (e.g., the memory <NUM> of <FIG>).

In an embodiment, the processor <NUM> may display the indicator requesting the retouch on the user interface, return to operation <NUM>, and thus re-detect the user touch. In an embodiment, if the user touch is released and then detected again, if the touch area <NUM> is changed, or a combination thereof occurs, the processor <NUM> may identify the user touch is re-detected. In an embodiment, if the processor <NUM> identifies that no additional retouches are required once the re-detected user touch is detected in operation <NUM>, the processor <NUM> may store position information of the indicator displayed in operation <NUM> in memory (e.g., the memory <NUM> of <FIG>).

In operation <NUM>, the processor <NUM> may acquire biometric information using light emitted from the display <NUM>. In an embodiment, the processor <NUM> may acquire the biometric information, by emitting light (e.g., the lights <NUM> and <NUM> of <FIG>) from an emissive area (e.g., the emissive area <NUM> of <FIG>) of the user interface, obtaining reflection light (e.g., the lights <NUM> and <NUM> of <FIG>) of the lights <NUM> and <NUM> through the camera <NUM>, and analyzing the obtained reflection lights <NUM> and <NUM>.

As set forth above, the electronic device (e.g., the electronic device <NUM> of <FIG>) and its operating method may provide the user with various functions associated with biometric information acquisition, without dedicated light emitting devices and optical sensors.

As mentioned above, an electronic device (e.g., the electronic device <NUM> of <FIG>) may include a housing, a display exposed through at least part of a first surface of the housing, an image sensor exposed through at least part of the first surface of the housing, a processor operatively connected with the display and the image sensor, and a memory operatively connected with the processor. The memory may store instructions that, when executed, cause the processor to detect a touch of a finger of a user on the image sensor, while displaying a user interface using the display, in response to detecting the touch, while the touch of the finger is maintained on the image sensor, change the user interface in an area of the display within a preset distance from the image sensor, and acquire biometric information of the user based on reflection light of light emitted from the display, where the reflection light is acquired using the image sensor.

In an embodiment, the instructions may cause the processor to emit light with a first intensity in the area of the display within the preset distance from the image sensor before detecting the touch, and in response to detecting the touch, emit light with a second intensity higher than the first intensity in the area of the display within the preset distance from the image sensor.

In an embodiment, the instructions may cause the processor to, in response to receiving, at the image sensor, light other than the reflection light, display another user interface to guide the user to retouch the display.

In an embodiment, the instructions may cause the processor to, in response to detecting the touch, identify an area where the finger of the user touches on the display, and based on the identified area, set the area of the display within the preset distance from the image sensor.

In an embodiment, the image sensor may be disposed in a display area of the display, when viewed in a front view of the housing.

In an embodiment, the area of the display within the preset distance from the image sensor may surround the image sensor, when viewed in a front view of the housing.

In an embodiment, the instructions may cause the processor to, in response to detecting the touch, while the touch of the finger is maintained on the image sensor, change the user interface at designated time intervals.

In an embodiment, the instructions may cause the processor to, in response to detecting the touch, emit light of a first intensity from a first portion of the area of the display within the preset distance from the image sensor, and in response to detecting the touch, emit light of a second intensity higher than the first intensity from a second portion of the area of the display within the preset distance from the image sensor.

In an embodiment, the instructions may cause the processor to receive an input, based on the received input, identify first biometric information to be acquired from the user, and in response to detecting the touch, emit light corresponding to the identified first biometric information from the area of the display within the preset distance from the image sensor.

As mentioned above, an operating method of an electronic device (e.g., the electronic device <NUM> of <FIG>) may include, while displaying a user interface using a display exposed through at least part of a first surface of a housing, detecting a touch of a finger of a user on an image sensor exposed through at least part of the first surface of the housing, in response to detecting the touch, while the touch of the finger is maintained on the image sensor, changing the user interface in an area of the display within a preset distance from the image sensor, and acquiring biometric information of the user based on reflection light of light emitted from the display, where the reflection light is acquired using the image sensor.

In an embodiment, light with a first intensity is emitted in the area of the display within the preset distance from the image sensor before detecting the touch, and in response to detecting the touch, light with a second intensity higher than the first intensity is emitted in the area of the display within the preset distance from the image sensor.

In an embodiment, the method may further include, in response to receiving, at the image sensor, light other than the reflection light, displaying another user interface to guide the user to retouch the display.

In an embodiment, the method may further include, in response to detecting the touch, identifying an area where the finger of the user touches on the display, and based on the identified area, setting the area of the display within the preset distance from the image sensor.

In an embodiment, the image sensor may be disposed in a display area of the display, when viewed in a front view of the housing, and the area of the display within the preset distance from the image sensor may surround the image sensor, when viewed in the front view of the housing.

In an embodiment, the method may further include, in response to detecting the touch, emitting light of a first intensity from a first portion of the area of the display within the preset distance from the image sensor, and in response to detecting the touch, emitting light of a second intensity higher than the first intensity from a second portion of the area of the display within the preset distance from the image sensor.

In an embodiment, the method may further include receiving an input, based on the received input, identifying first biometric information to be acquired from the user, and in response to detecting the touch, emitting light corresponding to the identified first biometric information from the area of the display within the preset distance from the image sensor.

In an embodiment, the method may further include identifying asymmetry with respect to a reference direction of an image acquired by the image sensor based on the reflection light, in response to identifying the asymmetry with respect to the reference direction of the image, identifying a degree of the asymmetry with respect to the reference direction of the image, and based on the identified degree of the asymmetry, changing the area of the display within the preset distance.

As mentioned above, an electronic device (e.g., the electronic device <NUM> of <FIG>) may include a housing, a display exposed through at least part of a first surface of the housing, an image sensor disposed in a display area of the display, when viewing the first surface of the housing, a processor operatively connected with the display and the image sensor, and a memory operatively connected with the processor, wherein the memory may store instructions that, when executed, cause the processor to display an indicator indicating a preset touch request area, on a user interface displayed on the display, detect a touch of a finger of a user, in at least part of the touch request area after the indicator is displayed in the user interface, in response to detecting the touch, control the display to emit light of a preset intensity in a preset second area which surrounds the image sensor, when viewed in a front view of the housing, and acquire biometric information of the user based on reflection light of the light of the preset intensity emitted from the display, where the reflection light is acquired using the image sensor.

In an embodiment, characteristics of light emitted from a first portion of the second area are different from characteristics of light emitted from a second portion of the second area.

In an embodiment, the instructions may cause the processor to adjust a position of the indicator, based on an image acquired by the image sensor based on the reflection light, display the indicator at the adjusted position, on the user interface displayed on the display, after displaying the indicator at the adjusted position, detect a retouch of the finger of the user, and in response to detecting the retouch of the finger of the user, when biometric information of the user based on the reflection light is acquired, store the adjusted position of the indicator on the user interface, in the memory.

Methods according to an embodiment of the present disclosure may be implemented in hardware, software, or a combination of hardware and software.

The one or more program may include instructions that cause the electronic device to perform the methods according to an embodiment of the present disclosure as defined by the appended claims and/or disclosed herein.

Any combination of some or all of them may form a memory in which the program is stored.

In addition, the programs may be stored in an attachable storage device which is accessible through communication networks such as the Internet, Intranet, local area network (LAN), wide area network (WAN), and storage area network (SAN), or a combination thereof.

In the above-described example embodiments of the present disclosure, a component included in the present disclosure is expressed in the singular or the plural according to a presented example embodiment. However, the singular form or plural form is selected for convenience of description suitable for the presented situation, and an embodiment of the present disclosure are not limited to a single element or multiple elements thereof. Further, either multiple elements expressed in the description may be configured into a single element or a single element in the description may be configured into multiple elements.

Certain of the above-described embodiments of the present disclosure can be implemented in hardware, firmware or via the execution of software or computer code that can be stored in a recording medium such as a CD ROM, a Digital Versatile Disc (DVD), a magnetic tape, a RAM, a floppy disk, a hard disk, or a magneto-optical disk or computer code downloaded over a network originally stored on a remote recording medium or a non-transitory machine readable medium and to be stored on a local recording medium, so that the methods described herein can be rendered via such software that is stored on the recording medium using a general purpose computer, or a special processor or in programmable or dedicated hardware, such as an ASIC or FPGA. As would be understood in the art, the computer, the processor, microprocessor controller or the programmable hardware include memory components, e.g., RAM, ROM, Flash, etc. that may store or receive software or computer code that when accessed and executed by the computer, processor or hardware implement the processing methods described herein.

Claim 1:
An electronic device (<NUM>, <NUM>) comprising:
a housing (<NUM>, <NUM>);
a display (<NUM>, <NUM>) exposed through at least part of a first surface of the housing, the display comprises an opening;
a camera (<NUM>, <NUM>) aligned with the opening in the display;
a processor (<NUM>) operatively connected with the display and the camera; and
a memory operatively connected with the processor,
wherein the memory stores instructions that, when executed, cause the processor to:
display a first user interface (<NUM>) on the display for receiving an input for acquiring user's biometric information and for selecting the type of the user's biometric information to measured;
detect a touch, covering the camera, of a finger (<NUM>) of a user on the first user interface, and
in response to detecting the touch
identify an area (<NUM>, <NUM>) where the finger of the user touches on the display;
identify the type of biometric information to be acquired from the user,
display a second user interface (<NUM>) for measuring the user's biometric information,
while displaying the second user interface, set an emissive area (<NUM>, <NUM>) of the display for emitting light (<NUM>, <NUM>), wherein the emissive area is set within a preset distance from the camera based on the identified area (<NUM>, <NUM>) where the finger of the user touches the display; and
control the display (<NUM>) to emit light (<NUM>, <NUM>) from the emissive area (<NUM>);
acquire the biometric information of the user based on reflection light (<NUM>, <NUM>) of the light emitted from the emissive area (<NUM>, <NUM>) of the display (<NUM>, <NUM>), wherein the reflection light is acquired using the camera and the biometric information comprises at least one of heart rate, oxygen saturation, stress index, blood pressure, blood sugar, tissue hydration, and tissue dehydration, and
wherein the instructions further cause the processor to adjust at least one of a shape of the emissive area (<NUM>, <NUM>), a pattern of the emissive area, a size of the emissive area, a position of the emissive area, a color of the light, and an intensity of the light based on the type of the biometric information to be acquired.