Electronic device for processing biometric information and method of controlling same

An electronic device includes a processor and a memory functionally connected to the processor. The electronic device acquires user's biometric information through a biometric sensor, determines virtual biometric information corresponding to the acquired biometric information, and transmits the virtual biometric information to an external electronic device through communication circuitry. The electronic device may include the biometric sensor, the communication circuitry, and the memory may be electrically connected to the biometric sensor and the communication module and store instructions to be executed by the processor.

CROSS-REFERENCE TO RELATED APPLICATION

This application is based on and claims priority under 35 U.S.C. § 119 to Korean Application Serial No. 10-2015-0186804, which was filed in the Korean Intellectual Property Office on Dec. 24, 2015, the contents of which is incorporated by reference herein in its entirety.

TECHNICAL FIELD

The present disclosure relates generally to an electronic device for processing biometric information and a method of controlling the same and, for example, to an electronic device for processing various pieces of biometric information for user recognition and a method of controlling the same.

BACKGROUND

Recently, a user recognition-related technology using a user's body characteristic such as fingerprint, iris, and the like has been developed. For example, a fingerprint recognition technology may include an element for radiating a light to the surface of the user's finger and acquiring an image of the fingerprint from a light reflected from the surface of the finger. The conventional fingerprint recognition technology includes an element for comparing the acquired image of the fingerprint and a conventionally registered image of the fingerprint and identifying the user based on a result of the comparison. The fingerprint recognition technology may be useful in that every person has different fingerprints. People may have individually different body characteristics and for example, everyone's fingerprint shapes, iris shapes, shapes of vein near the wrist are different. The conventional fingerprint recognition technology may sense the corresponding body characteristic and compare the sensed body characteristic and a pre-registered body characteristic, so as to recognize the user. In a viewpoint of the user, the fingerprint recognition technology may increase user convenience since the user can simply input his/her own body characteristic without passing through a separate complex authentication process.

As described above, the user's body characteristic is unique and considerable efforts may be required to prevent the user's body characteristic from being leaked. When only a password is leaked, the user can change the corresponding password into a new password, but cannot change the user's body characteristic. Such a problem may become serious when the conventional sensor and processing device are separated from each other. The conventional sensor may sense the user's body characteristic and transmit the sensing data to the processing device. In this case, when the sensing data is leaked, the user's body characteristic is also leaked, so the conventional biometric information recognition system has a vulnerability in terms of security.

SUMMARY

The present disclosure has been made to address the above described problem and other problems, and an electronic device and a method of controlling the same according to various example embodiments of the present disclosure may authenticate the user based on virtual biometric information.

In accordance with an example aspect of the present disclosure, an electronic device is provided. The electronic device includes: a biometric sensor; a communication module comprising communication circuitry; a processor electrically connected to the biometric sensor and the communication module; and a memory electrically connected to the processor, wherein the memory stores instructions that, when executed by the processor, cause the processor to perform operations comprising: acquiring biometric information of a user through the biometric sensor, determining virtual biometric information corresponding to the acquired biometric information, and transmitting the virtual biometric information to an external electronic device through the communication circuitry.

In accordance with another example aspect of the present disclosure, a method of controlling an electronic device is provided. The method includes: acquiring biometric information of a user; determining virtual biometric information corresponding to the acquired biometric information; and transmitting the virtual biometric information to an external electronic device.

In accordance with another example aspect of the present disclosure, an electronic device is provided. The electronic device includes: a biometric sensor; a communication module comprising communication circuitry; and a processor functionally connected to the biometric sensor and the communication module, wherein the processor is configured to acquire biometric information through the biometric sensor, to authenticate a user at least based on the biometric information, to determine virtual biometric information to be used for authenticating the user by at least one external electronic device at least based on a determination that the user is successfully authenticated, and to transmit the virtual biometric information to the at least one external electronic device through the communication circuitry.

Various example embodiments of the present disclosure may provide an electronic device and a method of providing the same capable of authenticating the user based on virtual biometric information. Accordingly, even though the virtual biometric information is leaked, the user's body characteristic can be protected and security can be enhanced.

DETAILED DESCRIPTION

The expression “configured to” used in the present disclosure may be exchanged with, for example, “suitable for”, “having the capacity to”, “designed to”, “adapted to”, “made to”, or “capable of” according to the situation. The term “configured to” may not necessarily imply “specifically designed to” in hardware. Alternatively, in some situations, the expression “device configured to” may refer, for example, to a situation in which the device, together with other devices or components, “is able to”. For example, the phrase “processor adapted (or configured) to perform A, B, and C” may refer, for example, to various processing circuitry, such as, for example, and without limitation, a dedicated processor (e.g., embedded processor) only for performing the corresponding operations or a generic-purpose processor (e.g., central processing unit (CPU) or application processor (AP)) that can perform the corresponding operations by executing one or more software programs stored in a memory device.

Hereinafter, an electronic device according to various example embodiments will be described with reference to the accompanying drawings. In the present disclosure, the term “user” may indicate a person using an electronic device or a device (e.g., an artificial intelligence electronic device) using an electronic device.

Referring toFIG. 1, an electronic device101within a network environment100according to various example embodiments will be described. The electronic device101may include a bus110, a processor (e.g., including processing circuitry)120, a memory130, an input/output interface (e.g., including input/output circuitry)150, a display160, a communication module (e.g., including communication circuitry)170and a biometric sensor190. In some example embodiments, the electronic device101may omit at least one of the elements, or may further include other elements.

The bus110may include, for example, a circuit that interconnects the components110to170and delivers communication (for example, a control message and/or data) between the components110to170.

The processor120may include various processing circuitry, such as, for example, and without limitation, one or more of a dedicated processor, a Central Processing Unit (CPU), an Application Processor (AP), and a Communication Processor (CP). The processor120, for example, may carry out operations or data processing relating to the control and/or communication of at least one other element of the electronic device101.

The memory130may include a volatile and/or non-volatile memory. The memory130may store, for example, instructions or data relevant to at least one other element of the electronic device101. According to an example embodiment, the memory130may store software and/or a program140. The program140may include a kernel141, middleware143, an Application Programming Interface (API)145, and/or application programs (or “applications”)147. At least some of the kernel141, the middleware143, and the API145may be referred to as an Operating System (OS).

The kernel141may control or manage system resources (for example, the bus110, the processor120, or the memory130) used for executing an operation or function implemented by other programs (for example, the middleware143, the API145, or the application147). Furthermore, the kernel141may provide an interface through which the middleware143, the API145, or the application programs147may access the individual elements of the electronic device101to control or manage the system resources.

The middleware143may function as, for example, an intermediary for allowing the API145or the application programs147to communicate with the kernel141to exchange data.

Furthermore, the middleware143may process one or more task requests, which are received from the application programs147, according to priorities thereof. For example, the middleware143may assign priorities for using the system resources (for example, the bus110, the processor120, the memory130, and the like) of the electronic device101to one or more of the application programs147. For example, the middleware143may perform scheduling or load balancing on the one or more task requests by processing the one or more task requests according to the priorities assigned to the one or more application programs.

The API145, which is an interface through which the applications147control functions provided from the kernel141or the middleware143, may include, for example, at least one interface or function (for example, an instruction) for file control, window control, image processing, text control, and the like.

The input/output interface150, for example, may include various input/output circuitry configured to function as an interface that may forward instructions or data, which is input from a user or another external device, to the other element(s) of the electronic device101. Furthermore, the input/output interface150may output instructions or data, which are received from the other element(s) of the electronic device101, to the user or the external device.

Examples of the display160may include a Liquid Crystal Display (LCD), a Light-Emitting Diode (LED) display, an Organic Light-Emitting Diode (OLED) display, a MicroElectroMechanical Systems (MEMS) display, and an electronic paper display, or the like, but is not limited thereto. The display160may display, for example, various types of contents (for example, text, images, videos, icons, symbols, and the like) for a user. The display160may include a touch screen and may receive, for example, a touch, gesture, proximity, or hovering input using an electronic pen or the user's body part.

The communication interface170may include various communication circuitry that configures communication, for example, between the electronic device101and an external device (for example, a first external electronic device102, a second external electronic device104, or a server106). For example, the communication circuit170may be connected to a network162through wireless or wired communication to communicate with the external device (for example, the second external electronic device104or the server106).

The biometric sensor190may sense various biometric characteristics and transfer biometric information of the sensed biometric characteristics to the processor120.

The wireless communication may use, for example, at least one of Long Term Evolution (LTE), LTE-Advance (LTE-A), Code Division Multiple Access (CDMA), Wideband CDMA (WCDMA), Universal Mobile Telecommunications System (UNITS), WiBro (Wireless Broadband), Global System for Mobile Communications (GSM), and the like, as a cellular communication protocol. In addition, the wireless communication may include, for example, short range communication164. The short range communication164may include, for example, at least one of Wi-Fi, Bluetooth, Near Field Communication (NFC), Global Navigation Satellite System (GNSS), and the like. The GNSS may include at least one of, for example, a Global Positioning System (GPS), a Global Navigation Satellite System (Glonass), a Beidou Navigation Satellite System (hereinafter referred to as “Beidou”), and a European Global Satellite-based Navigation System (Galileo), according to a use area, a bandwidth, or the like. Hereinafter, in the present disclosure, the “GPS” may be interchangeably used with the “GNSS”. The wired communication may include, for example, at least one of a Universal Serial Bus (USB), a High Definition Multimedia Interface (HDMI), Recommended Standard 232 (RS-232), a Plain Old Telephone Service (POTS), and the like. The network162may include at least one of a communication network such as a computer network (for example, a LAN or a WAN), the Internet, and a telephone network.

Each of the first and second external electronic devices102and104may be of a type identical to or different from that of the electronic device101. According to an example embodiment, the server106may include a group of one or more servers. According to various example embodiments, all or some of the operations executed in the electronic device101may be executed in another electronic device or a plurality of electronic devices (for example, the electronic devices102and104or the server106). According to an example embodiment, when the electronic device101has to perform some functions or services automatically or in response to a request, the electronic device101may request another device (for example, the electronic device102or104or the server106) to perform at least some functions relating thereto instead of, or in addition to, performing the functions or services by itself. The other electronic device (for example, the electronic device102or104or the server106) may perform the requested functions or the additional functions and may transfer the execution result to the electronic device101. The electronic device101may provide the received result as it is, or may additionally process the received result to provide the requested functions or services. To this end, for example, cloud computing, distributed computing, or client-server computing technology may be used.

According to various example embodiments of the present disclosure, the memory130may store instructions that, when executed by the processor120, cause the processor120to acquire biometric information of a user through the biometric sensor190, to determine virtual biometric information corresponding to the acquired biometric information, and to transmit the virtual biometric information to an external electronic device through the communication module170.

According to various example embodiments of the present disclosure, the memory130may store instructions that, when executed by the processor120, cause the processor120to acquire other biometric information to be registered in at least one of the external electronic device and the electronic device, to generate virtual biometric information corresponding to the other biometric information, and to share the generated virtual biometric information with the external electronic device through the communication module170before a user authentication.

According to various example embodiments of the present disclosure, the memory130may store instructions that, when executed by the processor120, cause the processor120to store relevant information between the other biometric information and the virtual biometric information according to each user.

According to various example embodiments of the present disclosure, the memory130may store instructions that, when executed by the processor120, cause the processor120to compare the acquired biometric information with the relevant information and to determine the virtual biometric information corresponding to the acquired biometric information.

According to various example embodiments of the present disclosure, the memory130may store instructions that, when executed by the processor120, cause the processor120to determine the virtual biometric information corresponding to the other biometric information as the virtual biometric information when the acquired biometric information is identical to the other biometric information.

According to various example embodiments of the present disclosure, the memory130may store instructions that, when executed by the processor120, cause the processor120to acquire other virtual biometric information for updating the virtual biometric information, to replace the virtual biometric information with the other virtual biometric information to update the relevant information, and to transmit the other virtual biometric information to the external electronic device through the communication module170.

According to various example embodiments of the present disclosure, the memory130may store instructions that, when executed by the processor120, cause the processor120to transmit generated user-specific virtual biometric information to the external electronic device through the communication module170, and the external electronic device may store the user-specific virtual biometric information received from the electronic device before the user authentication and compare the virtual biometric information with the pre-stored user-specific virtual biometric information to perform the user authentication.

According to various example embodiments of the present disclosure, the memory130may store instructions that, when executed by the processor120, cause the processor120to transmit encryption information for encrypting the virtual biometric information to the external electronic device through the communication module170, and to encrypt the virtual biometric information based on the encryption information and to transmit the encrypted virtual biometric information to the external electronic device through the communication module170.

According to various example embodiments of the present disclosure, the memory130may store instructions that, when executed by the processor120, cause the processor120to encrypt the virtual biometric information and additional information based on the encryption information and to transmit the encrypted virtual biometric information and additional information to the external electronic device through the communication module170.

According to various example embodiments of the present disclosure, the memory130may store instructions that, when executed by the processor120, cause the processor120to provide a plurality of pieces of data for generating the virtual biometric information and to generate the virtual biometric information based on at least one selected from the plurality of pieces of data.

According to various example embodiments of the present disclosure, the processor120may acquire biometric information of a user, authenticate a user at least based on the biometric information, determine virtual biometric information to be used for authenticating the user by at least one external electronic device at least based on a determination that the user is successfully authenticated, and transmits the virtual biometric information to the at least one external electronic device through the communication module170.

According to various example embodiments of the present disclosure, the processor120may select an external device having no sensor for acquiring the biometric information or an inactive external device among one or more external electronic devices, which can make a communication connection through the communication module170, as the at least one external electronic device.

According to various example embodiments of the present disclosure, the processor120may receive a request for the virtual biometric information from the external electronic device through the communication module170and transmit the virtual biometric information to the external electronic device having transmitted the request through the communication module170.

According to various example embodiments of the present disclosure, the processor120may generate the virtual biometric information based on the biometric information and identification information of the electronic device before the user is authenticated.

FIG. 2is a block diagram illustrating an example electronic device201according to various embodiments. The electronic device201may include, for example, the whole or part of the electronic device101illustrated inFIG. 1.

The electronic device201may include at least one Application Processor (AP) (e.g., including processing circuitry)210, a communication module (e.g., including communication circuitry)220, a Subscriber Identification Module (SIM) card224, a memory230, a sensor module240, an input device (e.g., including input circuitry)250, a display260, an interface (e.g., including interface circuitry)270, an audio module280, a camera module291, a power management module295, a battery296, an indicator297, and a motor298.

The processor210may include various processing circuitry configured to control a plurality of hardware or software elements connected thereto and may perform various data processing and operations by driving an operating system or an application program. The processor210may be embodied, for example, as a System on Chip (SoC). According to an example embodiment, the processor210may further include a Graphic Processing Unit (GPU) and/or an image signal processor. The processor210may also include at least some (for example, a cellular module221) of the elements illustrated inFIG. 2. The processor210may load, in a volatile memory, instructions or data received from at least one of the other elements (for example, a non-volatile memory) to process the loaded instructions or data, and may store various types of data in the non-volatile memory.

The communication module220may have a configuration equal or similar to that of the communication module170ofFIG. 1. The communication module220may include various communication circuitry, such as, for example, and without limitation, one or more of a cellular module221, a Wi-Fi module223, a Bluetooth module225, a GNSS module227(for example, a GPS module, a Glonass module, a Beidou module, or a Galileo module), an NFC module228, and a Radio Frequency (RF) module229.

The cellular module221may provide, for example, a voice call, a video call, a text message service, an Internet service, and the like through a communication network. According to an embodiment, the cellular module221may identify and authenticate the electronic device201within a communication network using the subscriber identification module224(for example, a SIM card). According to an embodiment, the cellular module221may perform at least some of the functions that the processor210may provide. According to an embodiment, the cellular module221may include a Communication Processor (CP).

The Wi-Fi module223, the BT module225, the GNSS module227, or the NFC module228may include, for example, a processor for processing data that is transmitted and received through the corresponding module. According to some embodiments, at least some (two or more) of the cellular module221, the Wi-Fi module223, the Bluetooth module225, the GNSS module227, and the NFC module228may be included in one Integrated Chip (IC) or IC package.

The RF module229, for example, may transmit/receive a communication signal (for example, an RF signal). The RF module229may include, for example, a transceiver, a Power Amplifier Module (PAM), a frequency filter, a Low Noise Amplifier (LNA), an antenna, and the like. According to another embodiment, at least one of the cellular module221, the Wi-Fi module223, the BT module225, the GNSS module227, and the NFC module228may transmit/receive an RF signal through a separate RF module.

The subscriber identification module224may include, for example, a card including a subscriber identity module and/or an embedded SIM, and may contain unique identification information (for example, an Integrated Circuit Card Identifier (ICCID)) or subscriber information (for example, an International Mobile Subscriber Identity (IMSI)).

The memory230(for example, the memory130) may include, for example, an internal memory232and/or an external memory234. The internal memory232may include, for example, at least one of a volatile memory (for example, a Dynamic Random Access Memory (DRAM), a Static RAM (SRAM), a Synchronous Dynamic RAM (SDRAM), and the like) and a non-volatile memory (for example, a One Time Programmable Read Only Memory (OTPROM), a Programmable ROM (PROM), an Erasable and Programmable ROM (EPROM), an Electrically Erasable and Programmable ROM (EEPROM), a mask ROM, a flash ROM, a flash memory (for example, a NAND flash memory, a NOR flash memory, and the like), a hard disc drive, a Solid State Drive (SSD), and the like).

The external memory234may further include a flash drive, for example, a Compact Flash (CF), a Secure Digital (SD), a Micro Secure Digital (Micro-SD), a Mini Secure Digital (Mini-SD), an eXtreme Digital (xD), a Multi-Media Card (MMC), a memory stick, and the like. The external memory234may be functionally or physically connected to the electronic device201through various interfaces.

The sensor module240may, for example, measure a physical quantity or detect the operating state of the electronic device201and may convert the measured or detected information into an electrical signal. The sensor module240may include, for example, at least one of a gesture sensor240A, a gyro sensor240B, an atmospheric pressure sensor240C, a magnetic sensor240D, an acceleration sensor240E, a grip sensor240F, a proximity sensor240G a color sensor240H (for example, a red, green, blue (RGB) sensor), a biometric sensor240I, a temperature/humidity sensor240J, a light (e.g., illumination) sensor240K, and a ultraviolet (UV) sensor240M. Additionally or alternatively, the sensor module240may include, for example, an E-nose sensor, an electromyography (EMG) sensor, an electroencephalogram (EEG) sensor, an electrocardiogram (ECG) sensor, an Infrared (IR) sensor, an iris sensor, and/or a fingerprint sensor. The sensor module240may further include a control circuit for controlling one or more sensors included therein. In some embodiments, the electronic device201may further include a processor, which is configured to control the sensor module240, as a part of the processor210or separately from the processor210in order to control the sensor module240while the processor210is in a sleep state.

The input device250may include various input circuitry, such as, for example, and without limitation, one or more of a touch panel252, a (digital) pen sensor254, a key256, or an ultrasonic input unit258. The touch panel252may use, for example, at least one of a capacitive type, a resistive type, an infrared type, and an ultrasonic type. Furthermore, the touch panel252may further include a control circuit. The touch panel252may further include a tactile layer to provide a tactile reaction to a user.

The (digital) pen sensor254may include, for example, a recognition sheet which is a part of the touch panel or is separated from the touch panel. The key256may include, for example, a physical button, an optical key, or a keypad. The ultrasonic input device258may detect ultrasonic waves, which are generated by an input tool, through a microphone (for example, a microphone288) to identify data corresponding to the detected ultrasonic waves.

The display260(for example, the display160) may include a panel262, a hologram device264or a projector266. The panel262may include the same or a similar configuration to the display160illustrated inFIG. 1. The panel262may be implemented to be, for example, flexible, transparent, or wearable. The panel262, together with the touch panel252, may be implemented as one module. The hologram device264may show a three-dimensional image in the air by using an interference of light. The projector266may display an image by projecting light onto a screen. The screen may be located, for example, in the interior of, or on the exterior of, the electronic device201. According to one embodiment, the display260may further include a control circuit for controlling the panel262, the hologram device264, or the projector266.

The audio module280may convert, for example, a sound into an electrical signal, and vice versa. At least some elements of the audio module280may be included, for example, in the input/output interface150illustrated inFIG. 1. The audio module280may process sound information that is input or output through, for example, a speaker282, a receiver284, earphones286, the microphone288, and the like.

The camera module291is a device that can photograph a still image and a dynamic image. According to an embodiment, the camera module291may include one or more image sensors (for example, a front sensor or a rear sensor), a lens, an Image Signal Processor (ISP), or a flash (for example, an LED, a xenon lamp, and the like).

The power management module295may manage, for example, the power of the electronic device201. According to an embodiment, the power management module295may include a Power Management Integrated Circuit (PMIC), a charger Integrated Circuit (IC), or a battery or fuel gauge. The PMIC may have a wired and/or wireless charging scheme. Examples of the wireless charging method may include a magnetic resonance method, a magnetic induction method, an electromagnetic wave method, and the like. Additional circuits (for example, a coil loop, a resonance circuit, a rectifier, and the like) for wireless charging may be further included. The battery gauge may measure, for example, a residual quantity of the battery296, and a voltage, a current, or a temperature while charging. The battery296may include, for example, a rechargeable battery and/or a solar battery.

The indicator297may indicate a particular state (for example, a booting state, a message state, a charging state, and the like) of the electronic device201or a part (for example, the processor210) thereof. The motor298may convert an electrical signal into a mechanical vibration and may generate a vibration, a haptic effect, and the like. Although not illustrated, the electronic device201may include a processing unit (for example, a GPU) for supporting mobile TV. The processing unit for supporting the mobile TV may process media data according to a standard, such as Digital Multimedia Broadcasting (DMB), Digital Video Broadcasting (DVB), MediaFlo™, and the like.

FIG. 3is a block diagram illustrating an example program module according to various example embodiments. According to an example embodiment, the program module310(for example, the program140) may include an Operating System (OS) that controls resources relating to an electronic device (for example, the electronic device101) and/or various applications (for example, the application programs147) that are executed in the operating system. The operating system may be, for example, Android, iOS, Windows, Symbian, Tizen, Bada, and the like

The program module310may include a kernel320, middleware330, an Application Programming Interface (API)360, and/or applications370. At least a part of the program module310may be preloaded on the electronic device, or may be downloaded from an external electronic device (for example, the electronic device102or104or the server106).

The kernel320(for example, the kernel141) may include, for example, a system resource manager321and/or a device driver323. The system resource manager321may control, allocate, or retrieve system resources. According to an embodiment, the system resource manager321may include a process manager, a memory manager, or a file system manager. The device driver323may include, for example, a display driver, a camera driver, a Bluetooth driver, a shared memory driver, a USB driver, a keypad driver, a Wi-Fi driver, an audio driver, or an Inter-Process Communication (IPC) driver.

The middleware330may provide, for example, a function required by the applications370in common, or may provide various functions to the applications370through the API360such that the applications370can efficiently use limited system resources within the electronic device. According to an embodiment, the middleware330(for example, the middleware143) may include, for example, at least one of a runtime library335, an application manager341, a window manager342, a multimedia manager343, a resource manager344, a power manager345, a database manager346, a package manager347, a connectivity manager348, a notification manager349, a location manager350, a graphic manager351, and a security manager352.

The runtime library335may include, for example, a library module that a compiler uses in order to add a new function through a programming language while the applications370are being executed. The runtime library335may perform input/output management, memory management, the functionality for an arithmetic function, and the like.

The application manager341may manage, for example, the life cycle of at least one of the applications370. The window manager342may manage Graphical User Interface (GUI) resources used on a screen. The multimedia manager343may determine formats required to reproduce various media files and may encode or decode a media file using a coder/decoder (codec) appropriate for the corresponding format. The resource manager344may manage resources, such as the source code, the memory, the storage space, and the like of at least one of the applications370.

The power manager345may operate together with, for example, a Basic Input/Output System (BIOS) to manage a battery or power and provide power information required for the operation of the electronic device. The database manager346may generate, search for, and/or change a database to be used by at least one of the applications370. The package manager347may manage the installation or update of an application that is distributed in the form of a package file.

The connectivity manager348may manage a wireless connection, such as Wi-Fi, Bluetooth, and the like. The notification manager349may display or notify of an event, such as an arrival message, an appointment, a proximity notification, and the like, in such a manner as not to disturb a user. The location manager350may manage location information of the electronic device. The graphic manager351may manage a graphic effect to be provided to a user and a user interface relating to the graphic effect. The security manager352may provide various security functions required for system security, user authentication, and the like. According to an embodiment, in a case where the electronic device (for example, the electronic device101) has a telephone call function, the middleware330may further include a telephony manager for managing a voice or video call function of the electronic device.

The middleware330may include a middleware module that forms a combination of various functions of the above-described elements. The middleware330may provide specialized modules according to the types of operating systems in order to provide differentiated functions. Furthermore, the middleware330may dynamically remove some of the existing elements, or may add new elements.

The API360(for example, the API145) is, for example, a set of API programming functions, and may be provided with different configurations according to operating systems. For example, in the case of Android or iOS, one API set may be provided for each platform, and in the case of Tizen, two or more API sets may be provided for each platform.

The applications370(for example, the application programs147) may include one or more applications that can perform functions, for example, home371, dialer372, SMS/MMS373, Instant Message (IM)374, browser375, camera376, alarm377, contacts378, voice dial379, e-mail380, calendar381, media player382, album383, clock384, health care (for example, measuring exercise quantity or blood sugar), and environment information (for example, atmospheric pressure, humidity, temperature information, and the like).

According to an example embodiment, the applications370may include an application (hereinafter, referred to as an “information exchange application” for convenience of description) that supports information exchange between the electronic device (for example, the electronic device101) and an external electronic device (for example, the electronic device102or104). The information exchange application may include, for example, a notification relay application for transferring specific information to an external electronic device or a device management application for managing an external electronic device.

For example, the notification relay application may include a function of delivering, to the external electronic device (for example, the electronic device102or104), notification information generated by other applications (for example, an SMS/MMS application, an email application, a health care application, an environmental information application, and the like) of the electronic device101. Furthermore, the notification relay application may, for example, receive notification information from the external electronic device and may provide the received notification information to a user.

The device management application may manage (for example, install, delete, or update), for example, at least one function of an external electronic device (for example, the electronic device102or104) that communicates with the electronic device (for example, a function of turning on/off the external electronic device itself (or some components thereof) or a function of adjusting the brightness (or resolution) of a display), applications that operate in the external electronic device, or services (for example, a call service, a message service, and the like) that are provided by the external electronic device.

According to an example embodiment, the applications370may include applications (for example, a health care application of a mobile medical appliance, and the like) that are specified according to attributes of an external electronic device (for example, the electronic device102or104). According to an embodiment, the applications370may include an application received from the external electronic device (for example, the server106, or the electronic device102or104). According to an embodiment, the applications370may include preloaded applications or third-party applications that can be downloaded from a server. Names of the elements of the program module310, according to the above-described embodiments of the present disclosure, may change depending on the type of OS.

According to various example embodiments of the present disclosure, at least some of the program module310may be implemented in software, firmware, hardware, or a combination of two or more thereof. At least some of the program module310may be implemented (for example, executed) by, for example, the processor (for example, the processor210). At least some of the program module310may include, for example, a module, a program, a routine, a set of instructions, and/or a process for performing one or more functions.

FIG. 4is a block diagram illustrating an example electronic device according to various example embodiments of the present disclosure.

As illustrated inFIG. 4, the electronic device101may include, for example, the processor (e.g., including processing circuitry)120, the memory130, and the biometric sensor190. The biometric sensor190may sense a biometric feature491by which the user can be recognized. For example, the biometric feature491may be information on different characteristics belonging to every person. For example, the biometric feature491may include body characteristics that are different for everyone, such as, for example, different fingerprint shapes, different iris shapes, different retina shapes, different shapes of vein near the wrist, different ear shapes, different face shapes, different hand shapes, and the like. As described above, recognition based on the uniqueness of the shapes may be named visual recognition, and there is no limitation on the biometric feature491if a body feature can be a target of the visual recognition. The biometric feature491may be physical information of various signals output from the user's body such as a voice, a brainwave, or a heartbeat waveform, and there is no limitation on the type if the signal is output from a body having an individually specific characteristic. The biometric feature491may include a user's behavior such as a gait habit or a typing habit. The above described recognition may be named behavior recognition, and there is no limitation if behavior information is individually distinctive. The biometric feature491may include information used for chemical recognition such as DNA matching or smell. As described above, the biometric feature491may have no limitation if information is used for recognizing a user, and the biometric sensor190may have no limitation if the sensor can sense various biometric features491. For example, when biometric information for visual recognition is acquired, the biometric feature491may include a device for image acquisition and a device for light radiation. The biometric sensor190may include a microphone for sensing a voice and an electrode for measuring a brainwave or a heartbeat. The biometric sensor190may include a reagent control device or a chemical analysis device for acquiring biometric information used for chemical recognition.

The biometric sensor190may sense the biometric feature491and deliver biometric information492, which is generated by converting the biometric feature491into an electrical signal, to the processor120. The biometric information492may, for example, be raw data sensed by the biometric sensor190or data converted based on a specific format.

According to an embodiment, the memory130may store user-specific biometric information in advance. For example, the memory130may store user-specific biometric information as Table 1 below in advance.

At a time when the user is registered in an authentication system, the electronic device101may acquire biometric information of the fingerprint shape, map the biometric information and the user, and store the mapped biometric information and user. In Table 1, although the fingerprint shape is disclosed as the biometric information, this is only an example and the aforementioned various pieces of biometric information may be used. In addition, the electronic device101according to various example embodiments of the present disclosure may manage together a plurality of pieces of biometric information according to the user. For example, the electronic device101may store a first fingerprint shape, a first voice feature, and a first smell as biometric information of a first user, and store various pieces of biometric information such as a second fingerprint shape, a second iris shape, and a second ear shape with respect to a second user.

The processor120may read user-specific biometric information431from the memory130and compare the user-specific biometric information431with acquired biometric information492. The processor120may authenticate the user based on a result of the comparison. For example, when the acquired biometric information492is the second fingerprint shape, it may be determined that an authentication target is the second user. According to another example embodiment, when the electronic device101manages various pieces of biometric information together, the processor120may combine results of comparison between a plurality of pieces of biometric information to authenticate the user.

According to various example embodiments of the present disclosure, the processor120may perform pre-processing such as removing noise from the acquired biometric information492. The processor120may extract a feature from the acquired biometric information492and compare the extracted feature with the user-specific biometric information431which has been already stored based on features.

Meanwhile, according to various example embodiments of the present disclosure, the memory130may store user-specific virtual biometric information, and the processor120may authenticate the user based on the virtual biometric information. This will be described in greater detail below with reference toFIG. 6.

According to the above description, the electronic device101may authenticate the user based on the pre-stored biometric information or the virtual biometric information.

FIGS. 5A and 5Bare block diagrams illustrating an example operation of an electronic device according to a comparative example for comparison with the present disclosure.

A first electronic device501may include, for example, a processor520, a memory530, and a communication module (e.g., including communication circuitry)570. A second electronic device502may include, for example, a biometric sensor590and a communication module (e.g., including communication circuitry)571. For example, the first electronic device501may be an electronic device which does not include the biometric sensor. The communication modules570and571may transmit/receive data to/from each other.

The biometric sensor590of the second electronic device502may sense a biometric feature591and transfer biometric information592to the communication module571. The communication module571may transmit a signal593including the received biometric information592to the communication module570of the first electronic device501.

The communication module570of the first electronic device501may process biometric information594from the received signal593and transfer the biometric information594to the processor520. The processor520may compare user-specific biometric information541read from the memory530with the received biometric information594and perform an authentication based on a result of the comparison.

However, when the communication module571of the second electronic device502transmits the signal593including the biometric information to the communication module570of the first electronic device501, the biometric information may be leaked during a signal transmission/reception process.

Referring toFIG. 5B, the second electronic device502according to another comparative example may include a memory531. The second electronic device502may store user-specific biometric information in the memory531in advance, and the processor521may compare the read user-specific biometric information532with data592on the acquired biometric information. The processor521may authenticate the user based on a result of the comparison and transfer an authentication result594to the communication module571. The communication module571may transmit a signal595including the authentication result, for example, information indicating that the second user has been authenticated to the communication module570of the first electronic device501. The communication module570of the first electronic device501may process an authentication result596from the received signal595and transfer the authentication result596to the processor520. The processor520may perform the authentication based on the acquired authentication result596. According to another comparative example, there is no possibility of leakage of the biometric information during a process of transmitting and receiving the signal595, but it is difficult to implement an integrated authentication program since different operations should be performed when an algorithm by which the first electronic device501authenticates the biometric information and an algorithm for processing the authentication result are stored.

FIG. 6is a block diagram illustrating an example operation of an electronic device according to various example embodiments of the present disclosure.

A first electronic device101-1may include, for example, a first processor120-1, a first memory130-1, a first communication module170-1, and a first biometric sensor190-1. According to various example embodiments of the present disclosure, the first electronic device101-1may include the biometric sensor190-1or not include the biometric sensor190-1. A second electronic device101-2may include, for example, a second processor120-2, a second memory130-2, a second communication module170-2, and a second biometric sensor190-2.

The second biometric sensor190-2may sense a biometric feature693. The second biometric sensor190-2may transfer biometric information694processed from the sensed biometric feature693to the second processor120-2. The second memory130-2may store relevant information between user-specific biometric information and virtual biometric information, and may be, for example, as shown in Table 2. The relevant information may include a mapping relation between the biometric information and the virtual biometric information. For example, as shown in Table 2, the biometric information and the virtual biometric information may be mapped and stored one to one.

The second processor120-2may acquire biometric information at a time when the user is registered in the authentication system. The second processor120-2may generate virtual biometric information corresponding to the biometric information. For example, the second processor120-2may generate virtual biometric information “0100011011” based on the first fingerprint shape. The second processor120-2may generate virtual biometric information corresponding to the first fingerprint shape through a preset virtual biometric information generation algorithm. Meanwhile, the virtual biometric information may be required to be unique within the authentication system, and the second processor120-2according to various example embodiments of the present disclosure may generate virtual biometric information through a unique code generation algorithm. According to another example embodiment, the second processor120-2may generate virtual biometric information based on user identification information. For example, the second processor120-2may generate virtual biometric information based on user identification information such as a phone number corresponding to the second user, an ID, a MAC address, and an IEMI address, or the like. As the user identification information is used, uniqueness of the virtual biometric information may be guaranteed. According to various example embodiments of the present disclosure, the second electronic device101-2may display a user interface for selecting user identification information used as the virtual biometric information. The second electronic device101-2may set the user identification information selected through the user interface as the virtual biometric information. For example, the virtual biometric information may be a value that can be used instead of the biometric information and differently set according to the user. There is no limitation on the virtual biometric information if the virtual biometric information has a value different from the biometric information. According to various example embodiments of the present disclosure, the virtual biometric information may have the same format as that used in the conventional biometric information recognition algorithm. For example, when data on a fingerprint shape defined in a fingerprint recognition algorithm may use a binary number of 10 digits, the electronic device may generate and mange virtual biometric information of binary numbers of 10 digits. For example, according to various example embodiments of the present disclosure, the electronic device may generate and manage virtual biometric information having the same format as that used in the conventional biometric information recognition algorithm or generate and manage virtual biometric information having data independent from the format used in the conventional biometric information recognition algorithm.

Meanwhile, according to various example embodiments of the present disclosure, the virtual biometric information may be referred to as authentication information. For example, the electronic device may generate and manage data, for example, “0100011011” as the authentication information and use the data during a user authentication process.

Meanwhile, although Table 2 shows that a data field of the biometric information is different from a field of the virtual biometric information, this is only for convenience of the description, and the electronic devices101-1and101-2according to various example embodiments of the present disclosure may manage the biometric information and the virtual biometric information as one category without any difference. For example, the electronic devices101-1and101-2may manage the biometric information and the virtual biometric information as shown in Table 3 below.

As the biometric information and the virtual biometric information are managed as one category, the electronic devices101-1and101-2may authenticate the user based on the virtual biometric information without significantly modifying the conventional user authentication algorithm.

At a time when the user is registered, the second electronic device101-2may store the relevant information between the user-specific biometric information and the virtual biometric information as shown in Table 2 or Table 3 in the second memory130-2and share the relevant information with another electronic device including the first electronic device101-1. Accordingly, the first memory130-1of the first electronic device101-1may also store the relevant information of the user-specific biometric information and the virtual biometric information as shown in Table 2 or Table 3 in advance.

Meanwhile, according to various example embodiments of the present disclosure, the second electronic device101-2may share only the user-specific virtual biometric information with the first electronic device101-1. For example, the second electronic device101-2may share user-specific virtual biometric information as shown in Table 4 below with the first electronic device101-1.

Accordingly, the first electronic device101-1may store only the user-specific biometric information in the first memory130-1and, in this example, security for the biometric information of the user may further increase.

Meanwhile, the second processor120-2may authenticate the user by comparing the acquired biometric information694with relevant information632between the read user-specific biometric information and virtual biometric information. For example, the second biometric sensor190-2may sense the second fingerprint shape and transfer the biometric information694processed from the second fingerprint shape to the second processor120-2. The second processor120-2may compare the acquired biometric information694with the relevant information632between the user-specific biometric information and the virtual biometric information and determine that the authenticated user is the second user and the corresponding virtual biometric information is “0100011100”.

The second processor120-2may transfer virtual biometric information695corresponding to the acquired biometric information to the second communication module170-2. The second communication module170-2may transmit a signal696including the received virtual biometric information695to the first communication module170-1of the first electronic device101-1. The communication modules170-1and170-2may communicate based on various communication schemes. For example, even though the signal696is exposed (e.g., in the clear), security for the user's biometric information may increase since the virtual biometric information is exposed instead of the user's actual biometric information.

The first communication module170-1may process virtual biometric information697from the received signal696and transfer the virtual biometric information697to the first processor120-1. The first processor120-1may authenticate the user by comparing, for example, the relevant information631between the user-specific biometric information and the virtual biometric information as shown in Table 2 or Table 3, which are read from the first memory130, with the received virtual biometric information697. The first processor120-1may authenticate the user by comparing, for example, the user-specific virtual biometric information read from the first memory130with the received virtual biometric information697. For example, when the acquired virtual biometric information697is “0100011100”, the first processor120-1may determine that a target to be authenticated is the second user. Accordingly, the first electronic device101-1and the second electronic device101-2may authenticate the user of which biometric information is not exposed.

In addition, when the first electronic device101-1includes the first biometric sensor190-1, the first biometric sensor190-1may directly sense a biometric feature691. For example, the first biometric sensor190-1may transfer biometric information692processed from the biometric feature691to the first processor120-1. The first processor120-1may authenticate the user by comparing, for example, the relevant information631between the read user-specific biometric information and virtual biometric information as shown in Table 2 or Table 3 with the acquired biometric information692. For example, when the acquired biometric information692corresponds to the “second fingerprint shape”, the first processor120-1may determine that a target to be authenticated is the second user. Accordingly, the first electronic device101-1and the second electronic device101-2may authenticate the user based on at least one piece of the virtual biometric information and the biometric information.

According to the above description, when it is required to transmit biometric information from one electronic device to another electronic device, virtual biometric information is transmitted instead of the biometric information, so that the biometric information can be protected.

FIG. 7is a flowchart illustrating an example method of controlling the electronic device according to various example embodiments of the present disclosure. According to the example embodiment ofFIG. 7, the first electronic device101-1may be a host device that authenticates the user, and the second electronic device101-2may be a client device that senses biometric information. The host device may refer to an electronic device that authenticates the user based on data from the client device. The client device may refer to a device that transfers the data to the host device.

In operation710, the second electronic device101-2may sense a biometric feature and acquire biometric information. In operation720, the second electronic device101-2may compare the acquired biometric information with pre-stored biometric information. For example, the second electronic device101-2may store relevant information between the user-specific biometric information and the virtual biometric information as shown in Table 2 or Table 3 in advance. The second electronic device101-2may identify whether there is stored biometric information that is mapped to the sensed biometric information.

In operation730, the second electronic device101-2may determine whether the user is successfully authenticated based on a result of the identification. When biometric information, which is the same as the sensed biometric information, is included in the pre-stored information, the second electronic device101-2may determine that the authentication has succeeded. For example, the second electronic device101-2may sense the “second fingerprint shape”. When it is identified that the sensed “second fingerprint shape” is included in the relevant information as shown in Table 2 or Table 3, the second electronic device101-2may determine that the user is successfully authenticated.

When the user is successfully authenticated, the second electronic device101-2may acquire virtual biometric information in operation740. As described above, the relevant information which the second electronic device101-2stored in advance may include biometric information and virtual biometric information that are mapped to each other. The second electronic device101-2may acquire virtual biometric information corresponding to the sensed biometric information based on the pre-stored relevant information. For example, the second electronic device101-2may acquire virtual biometric information of “0100011100” corresponding to the sensed “second fingerprint shape”. As described above, the virtual biometric information “0100011100” has no limitation if the virtual biometric information has a value having uniqueness within the user authentication system, and may be variously implemented as, for example, a MAC address of the second electronic device101-2, a user ID, a phone number allocated to the user, or a simply generated dummy value.

In operation750, the second electronic device101-2may transmit the virtual biometric information to the first electronic device101-1. According to various example embodiments of the present disclosure, the second electronic device101-2may transmit the virtual biometric information to the first electronic device101-1in the form of raw data. According to another example embodiment of the present disclosure, the second electronic device101-2may encrypt the virtual biometric information to generate a cryptogram and transmit the generated cryptogram to the first electronic device101-1. In this example, the second electronic device101-2may share a key for an encryption and a decryption with the first electronic device101-1in advance and encrypt the virtual biometric information by using the shared key. It may be readily understood by those skilled in the art that there is not limitation on an encryption method for encrypting the virtual biometric information and a decryption method of decrypting the cryptogram.

In operation760, the first electronic device101-1may compare the received virtual biometric information with the pre-stored virtual biometric information. In operation770, the first electronic device101-1may determine whether the user is successfully authenticated based on a result of the comparison. According to various example embodiments of the present disclosure, the first electronic device101-1may share and store in advance, for example, the relevant information between the user-specific biometric information and the virtual biometric information as shown in Table 2 or Table 3 with the second electronic device101-2. According to another example embodiment, the first electronic device101-1may share and store in advance, for example, the user-specific virtual biometric information as shown in Table 4 with the second electronic device101-2.

The first electronic device101-1may determine whether the user is successfully authenticated by determining whether virtual biometric information, which is the same as the received virtual biometric information, is included in the pre-stored relevant information. For example, the first electronic device101-1may determine that the user is successfully authenticated by identifying that virtual biometric information “0100011100” is included in the relevant information as shown in Table 2 or Table 3 or the user-specific virtual biometric information as shown in Table 4. Further, the first electronic device101-1may determine that a target to be authenticated is the second user.

In operation780, the first electronic device101-1may perform an operation corresponding to the authentication success. For example, the first electronic device101-1may authenticate the user during an electronic commerce application process, and may continue or stop the electronic commerce based on a result of the user authentication. According to various example embodiments of the present disclosure, the first electronic device101-1may use the user authentication in various processes and there is no limitation on the operation corresponding to the user authentication.

As described above, the first electronic device101-1may authenticate the user based on the virtual biometric information received from the second electronic device101-2. For example, as the virtual biometric information is received between the electronic devices101-1and101-2, the user's biometric information may be protected even though the virtual biometric information is exposed in the transmission/reception process.

FIGS. 8A, 8B and 8Care flowcharts illustrating an example operation of the electronic device while biometric information is registered according to various example embodiments of the present disclosure.

Referring toFIG. 8A, in operation810, the electronic device101may acquire biometric information to be registered. According to various example embodiments of the present disclosure, at a time when the user subscribes to the user authentication system, the electronic device101may display a user interface for asking the user to register a biometric feature. The user may input the biometric feature into the electronic device101according to the user interface, and the electronic device101may acquire biometric information based on the sensed biometric feature.

In operation820, the electronic device101may generate virtual biometric information corresponding to the acquired biometric information. According to various example embodiments of the present disclosure, the electronic device101may generate virtual biometric information having a value of which uniqueness is guaranteed in the user authentication system. For example, the electronic device101may generate the virtual biometric information through an algorithm for determining the value of which uniqueness is guaranteed. The electronic device101may use user relevant information such as a user ID of which uniqueness is guaranteed or a phone number allocated to the user may be used as the virtual biometric information. The electronic device101may user electronic device relevant information such as a MAC address as the virtual biometric information.

In operation830, the electronic device101may store relevant information between the acquired biometric information and the virtual biometric information based on the user.

According to the above description, the electronic device101may generate user-specific virtual biometric information and generate relevant information between the biometric information and the virtual biometric information. When another user additionally subscribes, the electronic device101may repeat the above described process for the subscribed user, and add and manage relevant information.

Referring toFIG. 8B, in operation840, the electronic device101may transmit the generated virtual biometric information to an external device (for example, a host electronic device) to allow the external device to register the virtual biometric information and/or store the virtual biometric information in the memory. The electronic device101may make a request for registration. For example, the electronic device101may share relevant information between user-specific biometric information and virtual biometric information with another electronic device, for example, the host electronic device.

Referring toFIG. 8C, in operation850, the electronic device101may update the virtual biometric information. As described above in connection withFIG. 7, the electronic device101may transmit and receive the virtual biometric information to and from another electronic device in the user authentication process. The virtual biometric information may be used instead of the biometric information, and thus periodic replacement thereof may be needed. Accordingly, when a periodic or user command is input, the electronic device101may update the user-specific biometric information to be another value. The electronic device101may determine updated virtual biometric information based on a user's selection or determine the updated virtual biometric information through a preset selection algorithm.

In operation860, the electronic device101may store relevant information between the updated virtual biometric information and the biometric information according to the user. In operation870, the electronic device101may register the updated virtual biometric information in the host electronic device and/or in the electronic device101. For example, the electronic device101may share the relevant information between the user-specific biometric information and the updated virtual biometric information with another electronic device, for example, the host electronic device.

According to the above description, the security may further increase by the present disclosure compared to the conventional user authentication system using biometric information itself that cannot be updated to be another value.

FIG. 9is a flowchart illustrating an example process of selecting virtual biometric information according to various example embodiments of the present disclosure. The embodiment ofFIG. 9will be described in greater detail below with reference toFIGS. 10A and 10B.FIGS. 10A and 10Bare diagrams illustrating an example operation of the electronic device according to various example embodiments of the present disclosure.

Referring toFIG. 9, in operation910, the electronic device101may acquire biometric information by sensing a biometric feature to be registered. According to various example embodiments of the present disclosure, at a time when the user subscribes to the user authentication system, the electronic device101may display a user interface that asks the user to register biometric information. The user may input the biometric feature into the electronic device101according to the user interface, and the electronic device101may acquire biometric information. For example, as illustrated inFIG. 10A, the electronic device101may display a user interface1010that makes a request for inputting a biometric feature, for example, fingerprint on the display160. The user may input the fingerprint according to the user interface1010, and the electronic device101may display a shape1020of the input fingerprint in order to help user recognition.

In operation920, the electronic device101may display candidates of virtual biometric information. For example, as illustrated inFIG. 10B, the electronic device101may display a selection box1030for selecting one piece of data on the display1601031to1035to generate virtual biometric information. In the example embodiment ofFIG. 10B, the data1031to1035for generating virtual biometric information may include various pieces of information such as, for example, and without limitation, a basic value of which uniqueness is guaranteed, a Media Access Control (MAC) address, an International Mobile Equipment Identity (IMEI) address, a user ID, and a phone number.

In operation930, the electronic device101may detect a selection of one piece of the displayed data for generating the virtual biometric information. For example, the user may select the phone number1035in the selection box1030, and the electronic device101may identify a selected target based on a touch position by the user.

In operation940, the electronic device101may generate virtual biometric information using the selected data for generating the virtual biometric information. For example, when the phone number1035is selected inFIG. 10B, the electronic device101may generate virtual biometric information using the phone number. For example, the electronic device101may determine the phone number as the virtual biometric information or determine a value generated using the phone number as the virtual biometric information. In operation950, the electronic device101may store relevant information between the acquired biometric information and the virtual biometric information. For example, the electronic device101may store information the relevant information as shown in Table 2 or Table 3 such that the user is linked with input fingerprint information and a phone number. The electronic device101may share the relevant information with another electronic device such as a host device.

Thereafter, when the user is authenticated, the electronic device101may ask the user to input the fingerprint and, when the input fingerprint information matches pre-stored fingerprint information, may transmit the phone number to the host device as the virtual biometric information. The host device may compare the received phone number with the pre-stored relevant information and authenticate the user based on a result of the comparison.

FIGS. 11A, 11B, 11C and 11Dare diagrams illustrating an example process of registering a vein shape.

Referring toFIG. 11A, a vein1101may be located at the inner side of a wrist of a user's hand1100. The vein1101corresponds to a blood vessel through which blood circulating an arterial system flows toward the heart, and the shape of the vein1101located at the inner side of the wrist may vary depending on each person. Since the shape varies depending on each person, the vein1101may be used for authenticating the user and many conventional technologies for an authentication by the shape of the vein1101have been developed.

Referring toFIG. 11B, the electronic device101according to various example embodiments of the present disclosure may be implemented, for example, as a wrist watch type wearable electronic device. The electronic device101may include inward sensors1131to1136and1150on the back surface thereof. The inward sensors1131to1136may be implemented as, for example, a pressure sensor, an optical sensor, and an electrode, and may recognize a user's touch, an ECG signal, and a fingerprint. According to an example embodiment, the inward sensor1150may be implemented as an optical sensor and may include a Heart Rate Monitor (HRM) sensor, a Blood Pressure (BP) sensor, a glucose sensor, a body temperature sensor, a vein sensor, and a bio-marker sensor, or the like.

For example, as illustrated inFIG. 11C, the inward sensor1150may radiate a light1151toward the wrist of the user's hand1100. The light1151may be reflected by the vein1101, and the reflected light1152may be input into the inward sensor1150. The inward sensor1150may recognize the shape of the vein1101by using the received reflected light1152.

The electronic device101may display a selection box1190for selecting one piece of data1192to1195on the display160to generate virtual biometric information as illustrated, for example, inFIG. 11D. In an example embodiment ofFIG. 11D, the data1192to1195for generating the virtual biometric information may include various pieces of information such as a basic value of which uniqueness is guaranteed, a MAC address, an IMEI address, a user ID, and a phone number, or the like. The electronic device101may detect a selection of one piece of the displayed data for generating the virtual biometric information. For example, the user may select the phone number1195in the selection box1190, and the electronic device101may identify a selected target based on a touch position by the user. The electronic device101may determine virtual biometric information based on the selected data1195. For example, the electronic device101may determine the selected data1195itself as the virtual biometric information or determine a value generated using the selected data1195as the virtual biometric information, and may store the virtual biometric information to be linked with the shape of the vein1101. Meanwhile, according to various example embodiments of the present disclosure, the electronic device101may acquire virtual biometric information corresponding to the shape of the vein1101based on a preset virtual biometric information determination method without the user's selection.

FIGS. 12A and 12Bare diagrams illustrating an example iris shape registration according to various example embodiments of the present disclosure.

Referring toFIG. 12A, the electronic device101may display a user interface1210for iris recognition on the display160. The electronic device101may photograph a user's face portion by using a camera1201as indicated by reference numeral1202. The user interface1210for iris recognition according to various example embodiments of the present disclosure may include a shape of an iris1211photographed to help user recognition. The electronic device101may determine virtual biometric information corresponding to the shape of the iris.

For example, as illustrated inFIG. 12B, the electronic device101may display a selection box1220for selecting one piece of data1221to1225on the display160to generate virtual biometric information. In the example embodiment ofFIG. 12B, the data1221to1225for generating the virtual biometric information may include various pieces of information such as a basic value of which uniqueness is guaranteed, a MAC address, an IMEI address, a user ID, and a phone number, or the like. The electronic device101may detect a selection of one piece of the displayed data for generating the virtual biometric information. For example, the user may select the IMEI1223in the selection box1220, and the electronic device101may identify a selected target based on a touch position by the user. The electronic device101may determine virtual biometric information based on the selected data1223. For example, the electronic device101may determine the selected data1195itself as the virtual biometric information or determine a value generated using the selected data1195as the virtual biometric information, and may store the virtual biometric information to be linked with the shape of the iris1211. Meanwhile, according to various example embodiments of the present disclosure, the electronic device101may acquire virtual biometric information corresponding to the shape of the iris1221based on a preset virtual biometric information determination method without user's selection.

FIG. 13is a flowchart illustrating an example method of controlling an electronic device in an Internet of Things (IoT) environment according to various example embodiments of the present disclosure. The example embodiment ofFIG. 13will be described in greater detail below with reference toFIGS. 14A and 14B.FIGS. 14A and 14Bare diagrams illustrating an example operation of the electronic device in the IoT environment according to various example embodiments of the present disclosure.

In operation1310, the first electronic device101-1may share virtual biometric information with the second electronic device101-2and the third electronic device101-3. It is assumed that operation1310is performed at a time when biometric information and virtual biometric information are registered.

According to various example embodiments of the present disclosure, the first electronic device101-1may acquire biometric information at the time when the biometric information is registered, and generate virtual biometric information corresponding to the acquired biometric information. The first electronic device101-1may share relevant information between user-specific biometric information and virtual biometric information with other electronic devices101-2and101-3. According to another example embodiment, the first electronic device101-1may share user-specific virtual biometric information with other electronic devices101-2and101-3.

For example, as illustrated inFIG. 14A, the first electronic device101-1may share relevant information between user-specific biometric information and virtual biometric information or user-specific virtual biometric information with other electronic devices101-2,101-3, and101-4. For example, the first electronic device101-1may be implemented as a wrist watch type wearable electronic device, and may sense a user's vein shape and share virtual biometric information corresponding to the user's vein shape with other electronic devices101-2,101-3, and101-4. In the example embodiment ofFIG. 14, it is assumed that the electronic device shares only virtual biometric information with other electronic devices. For example, virtual biometric information of a first user that the first electronic device101-1shares with other electronic devices101-2,101-3, and101-4may be as shown in Table 5.

As shown in Table 5, the first electronic device101-1may generate a phone number allocated to the first electronic device101-1as virtual biometric information on the vein shape and share the phone number with other electronic devices101-2,101-3, and101-4. Meanwhile, the first electronic device101-1may store relevant information between the vein shape and the virtual biometric information.

Further, the fourth electronic device101-4may include a camera and sense a user's face shape and a gait habit as the biometric information. The fourth electronic device101-4may determine virtual biometric information corresponding to the biometric information such as the user's face shape or the user's gait habit and share the virtual biometric information with other electronic devices101-1,101-2, and101-3.

For example, the virtual biometric information of the first user which the fourth electronic device101-4shares with the other electronic devices101-1,101-2, and101-3may be as shown in Table 6.

As shown in Table 6, the fourth electronic device101-4may determine a dummy value of which uniqueness is guaranteed as the virtual biometric information of the face shape, determine a MAC address allocated to the fourth electronic device101-4as the virtual biometric information of the gait habit, and share the determined virtual biometric information with the other electronic devices101-1,101-2, and101-3. Meanwhile, the fourth electronic device101-4may store relevant information between the face shape and gait habit, and the virtual biometric information.

Accordingly, all the electronic devices101-1to101-4within the system may store user-specific virtual biometric information as shown in Table 7.

Referring back toFIG. 13, in operation1320, the first electronic device101-1may sense or acquire biometric information. In the example embodiment ofFIG. 13, it is assumed that operation1310is performed at a registration time and operations after operation1320are performed in an authentication process. According to various example embodiments of the present disclosure, the first electronic device101-1may provide a user interface that induces the user to input biometric information and sense the biometric information. Meanwhile, according to another example embodiment, the first electronic device101-1may sense the biometric information from the user without consciousness of the user.

For example, as illustrated inFIG. 14B, a host device (for example, the third electronic device101-3) that authenticates the user may transmit a user authentication command to the first electronic device101-1and the fourth electronic device101-4, and the first electronic device101-1and the fourth electronic device101-4may authenticate the user. The host device (for example, the third electronic device101-3) may output an authentication request screen1430.

In operation1330, the first electronic device101-1may determine whether the acquired biometric information is the same as pre-stored biometric information. In operation1340the first electronic device101-1may determine virtual biometric information corresponding to the acquired biometric information. In operation1350and operation1360, the first electronic device101-1may transmit virtual biometric information to the host device (for example, the third electronic device101-3) or another electronic device (for example, the second electronic device101-2). Further, in operation1370, the second electronic device101-2may transmit the received virtual biometric information to the host device (for example, the third electronic device101-3).

For example, as illustrated inFIG. 14B, the first electronic device101-1may sense the user's vein shape. The first electronic device101-1may transmit virtual biometric information1422corresponding to the sensed vein shape (for example, “010-1234-1111”) to the host device (for example, the third electronic device101-3) based on relevant information between the pre-stored vein shape and the virtual biometric information.

When the first electronic device101-1is connected only to the second electronic device101-2through short-range communication such as Bluetooth communication, the first electronic device101-1may transmit virtual biometric information1421to the second electronic device101-2and the second electronic device101-2may transmit virtual biometric information1423to the third electronic device101-3.

Further, the fourth electronic device101-4may transmit virtual biometric information1425corresponding to the sensed face shape and the gait habit (for example, “0100011011” and “11.22.33.44.55.66”) based on relevant information between the pre-stored face shape and gait habit, and the virtual biometric information to the third electronic device101-3.

Accordingly, the host device (for example, the third electronic device101-3) may receive “010-1234-1111”1422, and “0100011011” and “11.22.33.44.55.66”1425. The host device (for example, the third electronic device101-3) may compare the pre-stored user-specific virtual biometric information as shown in Table 7 and the received virtual biometric information1422and1425and determine that a target to be authenticated is a first user. The host device (for example, the third electronic device101-3) may output an identified authentication screen1430.

As described above, the host device in the IoT environment may receive virtual biometric information corresponding to various pieces of biometric information from electronic devices including various types of sensors and authenticate the user. Particularly, when information sharing is frequently generated like in the IoT environment, security may be more focused on as virtual biometric information is used instead of biometric information.

FIG. 15is a diagram illustrating an example user authentication process in a car.

As illustrated inFIG. 15, the car may include an electronic system1510for performing a user authentication. The electronic system1510may control at least one other electronic device included in the car based on a result of the performance of the user authentication. The electronic system1510may communicate with the electronic device101. Meanwhile, at a time when biometric information of the user is registered, the electronic device101may acquire the biometric information and store the biometric information to be linked with virtual biometric information corresponding to the biometric information. Further, the electronic device101may share relevant information between user-specific biometric information and virtual biometric information with the electronic system1510. In addition, the electronic device101may share the user-specific virtual biometric information with the electronic system1510.

Meanwhile, at a time when the user is authenticated, the electronic device101may sense a biometric feature from the user. For example, the electronic device101may sense the user's vein shape as the biometric feature. The electronic device101may determine virtual biometric information corresponding to the acquired vein shape and transmit virtual biometric information1520to the electronic system1510. The electronic system1510may compare the received virtual biometric information1520with pre-stored virtual biometric information and authenticate the user based on a result of the comparison. Accordingly, even though a sensor for sensing the biometric information is not included in the car, the user authentication using the biometric information is possible.

FIG. 16is a flowchart illustrating an example biometric information registration process of the electronic device according to various example embodiments of the present disclosure.

In operation1610, the second electronic device101-2may acquire biometric information at, for example, a time when the biometric information is registered. In operation1620, the second electronic device101-2may generate virtual biometric information corresponding to the biometric information. As described above, the second electronic device101-2may generate, as the virtual biometric information, a value which is different from the biometric information and of which uniqueness is guaranteed.

In operation1630, the second electronic device101-2may store relevant information between the acquired biometric information and the virtual biometric information. In operation1640, the second electronic device101-2may share the virtual biometric information and encryption information with the first electronic device101-1. The first electronic device101-1may store user-specific virtual biometric information and encryption information.

FIG. 17is a flowchart illustrating an example user authentication process of the electronic device according to various example embodiments of the present disclosure.

In operation1710, the second electronic device101-2may acquire biometric information at, for example, a time when the user is authenticated. In operation1720, the second electronic device101-2may determine whether the acquired biometric information is the same as pre-stored biometric information. When the acquired biometric information is the same as the pre-stored biometric information, the second electronic device101-2may determine virtual biometric information corresponding to the pre-stored biometric information in operation1730.

In operation1740, the second electronic device101-2may encrypt the virtual biometric information. The second electronic device101-2may encrypt the virtual biometric information using, for example, the encryption information which the second electronic device101-2shares with the first electronic device101-1inFIG. 16. In operation1750, the second electronic device101-2may transmit the encrypted virtual biometric information to the first electronic device101-1.

In operation1760, the first electronic device101-1may decrypt the encrypted virtual biometric information. For example, the first electronic device101-1may decrypt the encrypted virtual biometric information by using the encryption information received from the second electronic device101-2inFIG. 16. In operation1770, the first electronic device101-1may authenticate the user based on the virtual biometric information.

As described above, the electronic device according to various example embodiments of the present disclosure may encrypt the virtual biometric information and then transmit the encrypted virtual biometric information, thereby increasing security of the virtual biometric information.

FIG. 18is a flowchart illustrating an example method of controlling the electronic device according to a comparative example for a comparison with the present disclosure.

In operation1810, the electronic device according to the comparative example may acquire biometric information. In operation1820, the electronic device according to the comparative example may generate a cryptogram based on the acquired biometric information and additional information. The additional information may be added information used for a user authentication such as a credit card number.

In operation1830, the electronic device according to the comparative example may transmit an authentication request including the generated cryptogram to a processing server through a reader. The processing server may decrypt the cryptogram and authenticate the user based on the biometric information sensed by the electronic device. In operation1840, the electronic device according to the comparative example may receive a result of the authentication from the processing server. In this example, the biometric information may be encrypted with other additional information and transmitted to the processing server, but the biometric information may be leaked during the transmission process.

FIG. 19is a flowchart illustrating an example method of controlling the electronic device according to various example embodiments of the present disclosure. The embodiment ofFIG. 19will be described in greater detail below with reference toFIG. 20.FIG. 20is a diagram illustrating an example operation of the electronic device according to various example embodiments of the present disclosure.

In operation1910, the electronic device101may acquire biometric information. For example, as illustrated inFIG. 20, the electronic device101may display a user interface2060on the display160that induces acquisition of biometric features, for example, fingerprint information. The user may input the biometric feature, for example, fingerprint information through the user interface2060. The electronic device101may display acquired fingerprint information2061to aid in the user recognition.

In operation1920, the electronic device101may determine virtual biometric information corresponding to the acquired biometric information. For example, in the example embodiment ofFIG. 20, it is assumed that the electronic device101completes biometric information registration and stores relevant information between user-specific biometric information and virtual biometric information. The electronic device101may determine whether there is pre-stored biometric information that is the same as the acquired biometric information. When there is the biometric information that is the same as the acquired biometric information, the electronic device101may determine virtual biometric information corresponding to the corresponding biometric information.

In operation1930, the electronic device101may generate a cryptogram based on the determined virtual biometric information and additional information. The additional information may be information used in electronic commerce such as a credit card number. The electronic device101may, for example, store an electronic commerce algorithm that performs an encryption based on the additional information and the biometric information in advance and generate a cryptogram through the electronic commerce algorithm. For example, while the cryptogram according to the comparative example is generated based on the biometric information and the additional information such as the credit card number, the cryptogram according to the present disclosure may be generated based on the virtual biometric information and the additional information.

In operation1940, the electronic device101may transmit an authentication request including the generated cryptogram to a processing server2090through a reader2080. The reader2080may receive a cryptogram2071from the electronic device101based on, for example, short-range communication such as Near Field Communication (NFC) or Magnetic Secure Transfer (MST) communication. The reader2080may transmit the received cryptogram2072to the processing server2090. In operation1950, the electronic device101may receive a result of the authentication from the processing server2090. For example, the processing server2090may decrypt the received cryptogram2072to acquire virtual biometric information and additional information, and authenticate the user based on the acquired virtual biometric information and additional information. The processing server2090may determine whether to conduct the electronic commerce based on a result of the performance of the user authentication.

As described above, the electronic device101according to various example embodiments of the present disclosure may generate the cryptogram based on both the additional biometric information and other additional information and use the generated cryptogram for the user authentication as well as directly encrypting the virtual biometric information.

FIG. 21is a flowchart illustrating an example method of controlling the electronic device according to various example embodiments of the present disclosure.

In operation2110, the electronic device101may acquire biometric information. In operation2120, the electronic device101may authenticate the user at least based on the acquired biometric information. For example, the electronic device101may store relevant information between user-specific biometric information and virtual biometric information before the user authentication. The electronic device101may authenticate the user based on whether the acquired biometric information exists in the relevant information.

In operation2130, the electronic device may determine virtual biometric information to be used for the user authentication in at least one external electronic device at least based on the determination that the user is successfully authenticated. The electronic device may determine virtual biometric information based on a comparison result between the pre-stored relevant information and the acquired biometric information. In operation2140, the electronic device may transmit virtual biometric information to at least one external electronic device.

FIG. 22is a flowchart illustrating an example method of controlling the electronic device according to various example embodiments of the present disclosure. In the example embodiment ofFIG. 22, it is assumed that the first electronic device101-1is a host electronic device and the second electronic device101-2is a client electronic device.

In operation2210, the second electronic device101-2may acquire biometric information at, for example, a time when the user is authenticated. The second electronic device101-2may determine virtual biometric information corresponding to the acquired biometric information based on the relevant information between the pre-stored biometric information and the virtual biometric information in operation2220.

In operation2230, the second electronic device101-2may receive a request for virtual biometric information from, for example, the first electronic device101-1. In operation2240, the second electronic device101-2may determine the first electronic device101-1having transmitted a request as a target to which the virtual biometric information is transmitted. According to another example embodiment, operation2230may not be performed. In this example, the second electronic device101-2may determine the target to which the virtual biometric information is transmitted by itself. For example, the second electronic device101-2may determine an electronic device that does not include a sensing module for sensing the corresponding biometric information as the target to which the virtual biometric information is transmitted based on a type of the acquired biometric information. The second electronic device101-2may determine an electronic device having an inactive sensing module for sensing the acquired biometric information as the target to which the virtual biometric information is transmitted. The second electronic device101-2may determine a host device as the target to which the virtual biometric information is transmitted.

In operation2250, the second electronic device101-2may transmit the virtual biometric information to the determined target (for example, the first electronic device101-1). In operation2260, the first electronic device101-1may authenticate the user by comparing the received virtual biometric information with the pre-stored virtual biometric information.

A method of controlling an electronic device according to various example embodiments of the present disclosure may include: an operation of acquiring biometric information of a user; an operation of generating virtual biometric information corresponding to the acquired biometric information; and an operation of transmitting the virtual biometric information to an external electronic device.

The method of controlling the electronic device according to various example embodiments of the present disclosure may further include: an operation of acquiring other biometric information to be registered in at least one of the external electronic device and the electronic device; an operation of generating virtual biometric information corresponding to the other biometric information; and an operation of sharing the generated virtual biometric information with the external electronic device before a user authentication.

The method of controlling the electronic device according to various example embodiments of the present disclosure may further include an operation of storing relevant information between the other biometric information and the virtual biometric information according to each user.

The operation of determining the virtual biometric information corresponding to the acquired biometric information according to various example embodiments of the present disclosure may include an operation of comparing the acquired biometric information and the relevant information and determining the virtual biometric information corresponding to the acquired biometric information.

The operation of determining the virtual biometric information corresponding to the acquired biometric information according to various example embodiments of the present disclosure may include an operation of, when the acquired biometric information and the other biometric information are equal to each other, determining the virtual biometric information corresponding to the other biometric information as the virtual biometric information.

The operation of generating the virtual biometric information according to various example embodiments of the present disclosure may include: an operation of providing a plurality of pieces of data to generate the virtual biometric information; and an operation of generating the virtual biometric information based on at least one selected from the plurality of pieces of data.

A method of controlling an electronic device according to various example embodiments of the present disclosure may include: an operation of acquiring user's biometric information through the biometric sensor, an operation of authenticating a user at least based on the biometric information, an operation of determining virtual biometric information to be used for authenticating the user by at least one external electronic device at least based on a determination that the user is successfully authenticated, and an operation of transmitting the virtual biometric information to the at least one eternal electronic device through the communication module.

The operation of generating the virtual biometric information according to various example embodiments of the present disclosure may include an operation of selecting an external device having no sensor for acquiring the biometric information or an inactive external device as the at least one external electronic device.

The operation of generating the virtual biometric information according to various example embodiments of the present disclosure may include: an operation of receiving a request for the virtual biometric information from the external electronic device; and an operation of transmitting the virtual biometric information to the external electronic device having transmitted the request.

The method of controlling the electronic device according to various example embodiments of the present disclosure may further include an operation of generating the virtual biometric information based on the biometric information and identification information of the electronic device before the user is authenticated.

Each of the components of the electronic device according to the present disclosure may be implemented by one or more components and the name of the corresponding component may vary depending on a type of the electronic device. In various example embodiments, the electronic device may include at least one of the above-described elements. Some of the above-described elements may be omitted from the electronic device, or the electronic device may further include additional elements. Further, some of the components of the electronic device according to the various example embodiments of the present disclosure may be combined to form a single entity, and thus, may equivalently execute functions of the corresponding elements prior to the combination.

The term “module” as used herein may, for example, refer to a unit including one of hardware, software, and firmware or a combination of two or more of them. The “module” may be interchangeably used with, for example, the term “unit”, “logic”, “logical block”, “component”, or “circuit”. The “module” may be the smallest unit of an integrated component or a part thereof.

The “module” may be the smallest unit that performs one or more functions or a part thereof. The “module” may be mechanically or electronically implemented. For example, the “module” according to the present disclosure may include at least one of a dedicated processor, a CPU, an Application-Specific Integrated Circuit (ASIC) chip, a Field-Programmable Gate Arrays (FPGA), and a programmable-logic device for performing operations which has been known or are to be developed hereinafter.

According to various example embodiments, at least some of the devices (for example, modules or functions thereof) or the method (for example, operations) according to the present disclosure may be implemented by a command stored in a computer-readable storage medium in a programming module form. When the command is executed by one or more processors (for example, the processor120), the one or more processors may execute a function corresponding to the command. The computer-readable storage medium may, for example, be the memory130.

The programming module according to the present disclosure may include one or more of the aforementioned components or may further include other additional components, or some of the aforementioned components may be omitted. Operations executed by a module, a programming module, or other component elements according to various embodiments of the present disclosure may be executed sequentially, in parallel, repeatedly, or in a heuristic manner. Further, some operations may be executed according to another order or may be omitted, or other operations may be added.

According to various example embodiments of the present disclosure, a storage medium storing instructions is provided. The instructions are configured to cause at least one processor to perform at least one operation when being executed by the at least one processor. The at least one operation may include: an operation of acquiring biometric information of a user; an operation of determining virtual biometric information corresponding to the acquired biometric information; and an operation of transmitting the virtual biometric information to an external electronic device.

Various example embodiments disclosed herein are provided merely to easily describe technical details of the present disclosure and to aid in understanding of the present disclosure, and are not intended to limit the scope of the present disclosure. Therefore, it should be understood that all modifications and changes or modified and changed forms based on the technical idea of the present disclosure fall within the scope of the present disclosure.