Electronic device having a plurality of piezoelectric elements

An electronic device having one or more piezoelectric elements is provided. The electronic device includes a housing including at least one portion of a surface of the electronic device, a first piezoelectric element formed at a partial area of the housing and configured to output a signal of a designated frequency band, and a second piezoelectric element formed at another partial area of the housing and configured to receive a reflection signal in which the signal output from the first piezoelectric element is reflected by an external object that has contacted the at least one portion of the housing.

CROSS-REFERENCE TO RELATED APPLICATION(S)

This application claims the benefit under 35 U.S.C. § 119(a) of a Korean patent application filed on Mar. 16, 2017 in the Korean Intellectual Property Office and assigned Ser. No. 10-2017-0033264, the entire disclosure of which is hereby incorporated by reference.

TECHNICAL FIELD

The present disclosure relates to an electronic device having a plurality of piezoelectric elements.

BACKGROUND

Nowadays, with increases in the degree of integration of electronic devices and development of high technology, various functions have been mounted in the electronic devices. Further, electronic devices having a touchscreen as an input and output means for an interaction with a user are being widely used. The electronic device may have a fingerprint recognition sensor as a user authentication means for protection of personal information, Internet banking, and payments.

The fingerprint recognition sensor may be implemented with an optical method, a capacitive method, or an ultrasonic method. The fingerprint recognition sensor of an ultrasonic method may receive a signal in which sound waves generated through a piezoelectric element (e.g., oscillator) that generates sound waves are reflected by responding to a contact with a user body to generate data for fingerprint recognition. Because the fingerprint recognition sensor of an ultrasonic method can variously recognize biometric information other than a fingerprint such as a blood vessel within a finger, compared with the fingerprint recognition sensor of an optical method and a capacitive method, interest has increased in the fingerprint recognition technology field using an ultrasonic method. However, there is a structural problem that the fingerprint recognition sensor of an ultrasonic method should be mounted in an area other than a display area of a touch screen, i.e., a peripheral area of the display. Despite this problem, a user may request recognition of a touch and a fingerprint in a display area of the electronic device.

SUMMARY

Aspects of the present disclosure are to address at least the above-mentioned problems and/or disadvantages and to provide at least the advantages described below. Accordingly, an aspect of the present disclosure is to provide an electronic device that can detect each of a touch and a fingerprint in a display area of an electronic device having a fingerprint recognition sensor of an ultrasonic method.

In accordance with an aspect of the present disclosure, an electronic device is provided. The electronic device includes a housing including at least one portion of a surface of the electronic device, a first piezoelectric element formed at a partial area of the housing and configured to output a signal of a designated frequency band, and a second piezoelectric element formed at another partial area of the housing and configured to receive a reflection signal in which the signal output from the first piezoelectric element is reflected by an external object that has contacted the at least one portion of the housing.

In accordance with another aspect of the present disclosure, an electronic device is provided. The electronic device includes a housing, a display including at least one portion received in the housing, a first piezoelectric element formed at a partial area of the housing and configured to output a signal of a designated frequency band, and a second piezoelectric element formed in at least a partial area of the display and configured to receive a reflection signal in which the signal is reflected by the external object that has contacted at least one portion of the display.

In accordance with another aspect of the present disclosure, an electronic device is provided. The electronic device includes a including a surface of the electronic device, a first piezoelectric element formed in at least a partial area of the housing, a second piezoelectric element formed in another partial area of the housing, and at least one processor configured to determine situation information related to the electronic device, designate a mode of the first piezoelectric element to a first operation mode and a mode of the second piezoelectric element to a second operation mode based on at least the situation information, and perform a designated function using the first piezoelectric element and the second piezoelectric element.

In accordance with another aspect of the present disclosure, an electronic device is provided. The electronic device includes a touchscreen, a plurality of ultrasonic sensors each disposed in at least a partial area or another area of the touchscreen, and at least one processor electrically connected to the touchscreen module, the plurality of ultrasonic sensors, and the memory, wherein the at least one processor is configured to select a first ultrasonic sensor, among the plurality of ultrasonic sensors, that operates in an ultrasonic generation mode for outputting a signal of a designated frequency band among the plurality of ultrasonic sensors, and select a second ultrasonic sensor, among the plurality of ultrasonic sensors, that operates in a receiving mode for receiving a signal of the designated frequency band based on at least one of operation information of the plurality of ultrasonic sensors and state information of the electronic device, and perform a designated function using the selected ultrasonic sensors.

DETAILED DESCRIPTION

In the description, the term “A or B” or “at least one of A and/or B” includes all possible combinations of words enumerated together. The terms “first” and “second” may describe various constituent elements, but they do not limit the corresponding constituent elements. For example, the above-described terms do not limit the order and/or importance of the corresponding constituent elements, but may be used to differentiate a constituent element from other constituent elements. When it is described that an (e.g., first) element is “connected” or “coupled” to another (e.g., second) element (e.g., functionally or communicatively), the element may be “directly connected” to the other element or “connected” to the other element through another (e.g., third) element.

The terms used in describing the various embodiments of the present disclosure are for the purpose of describing particular embodiments and are not intended to limit the present disclosure. As used herein, the singular forms are intended to include the plural forms as well, unless the context clearly indicates otherwise. All of the terms used herein including technical or scientific terms have the same meanings as those generally understood by an ordinary skilled person in the related art unless they are defined otherwise. The terms defined in a generally used dictionary should be interpreted as having the same or similar meanings as the contextual meanings of the relevant technology and should not be interpreted as having ideal or exaggerated meanings unless they are clearly defined herein. According to circumstances, even the terms defined in this disclosure should not be interpreted as excluding the various embodiments of the present disclosure.

Hereinafter, an electronic device will be described with reference to the accompanying drawings. In the present disclosure, the term “user” may indicate a person using an electronic device or a device (e.g., an artificial intelligence electronic device) using an electronic device.

FIG. 1is a diagram of a network environment100including an electronic device101, according to an embodiment of the present disclosure. The electronic device101includes a bus110, a processor120, a memory130, an input/output (I/O) interface150, a display160, and a communication interface170.

The bus110may be a circuit connecting the above described components and transmitting communication (e.g., a control message) between the above described components. The processor120may receive commands from other components (e.g., the memory130, the I/O interface150, the display160, the communication interface/module170, or the communication control module) through the bus110, analyze the received commands, and execute calculation or data processing according to the analyzed commands.

The memory130may store commands or data received from the processor120or other components (e.g., the I/O interface150, the display160, the communication interface/module170, or generated by the processor120or other components. The memory130may include programming modules, for example, a kernel141, middleware143, an application programming interface (API)145, or an application147. Each of the aforementioned programming modules may be implemented by software, firmware, hardware, or a combination of two or more thereof.

The kernel141may control or manage system resources (e.g., the bus110, processor120, memory130, etc.) used to execute operations or functions of the programming modules, e.g., the middleware143, API145, and application147. The kernel141may also provide an interface that may access and control/manage the components of the electronic device101via the middleware143, API145, and application147.

The middleware143may make it possible for the API145or application147to perform data communication with the kernel141. The middleware143may also perform control operations (e.g., scheduling, load balancing) for task requests transmitted from the application147by methods, e.g., a method for assigning the order of priority to use the system resources (e.g., the bus110, processor120, memory130, etc.) of the electronic device101to at least one of the applications147.

The API145is the interface for the applications147to control the function provided by the kernel141or the middleware143and may include at least one interface or function (e.g. command) for file control, window control, image control, or text control.

The I/O interface150may receive a command or data as input from a user via in-output apparatus (e.g., sensor, keyboard, or touchscreen, or the like) and may deliver the received command or data to the processor120or the memory130through the bus110. The I/O interface150may display a video, an image, data, or the like to the user.

The display160may be a liquid crystal display (LCD) and an active matrix organic light emitting diode (AM-OLED) display, microelectromechanical systems (MEMS), electronic paper display and the like. The display160may include the touch panel and one module. The display160may display the received various information (e.g., multi-media data, text data) from the above-described elements.

The communication interface170may connect communication between the electronic device101and an electronic device104or server106. For example, the communication interface170may access a network162through wireless or wired communication to communicate with the external device. Additionally, the communication interface170may establish a short-range wireless communication164between the electronic device101and any other electronic device (e.g., electronic device102). The wireless communication may include at least one of WiFi, Bluetooth (BT), near field communication (NFC), a global positioning system (GPS), and cellular communication (e.g., long-term evolution (LTE), LTE-advanced (LTE-A), code division multiple access (CDMA), wideband CDMA (WCDMA), universal mobile telecommunications system (UMTS), wireless broadband (WiBro) or global system for mobile communications (GSM)). The wired communication may include at least one of, for example, a universal serial bus (USB), a high definition multimedia interface (HDMI), recommended standard 232 (RS-232), and a plain old telephone service (POTS).

The wireless communication may include global navigation satellite system (GNSS). The GNSS may include at least one of, for example, a GPS, a global navigation satellite system (Glonass), a navigation satellite system (Beidou), and a European global satellite-based navigation system (Galileo), according to a use area, a bandwidth, or the like.

FIG. 2is a block diagram of an electronic device201, according to an embodiment of the present disclosure. The electronic device201may include some or all of the parts of the electronic device101illustrated inFIG. 1. The electronic device201may include one or more application processors (APs)210, a communication module220, a subscriber identification module (SIM)224, a memory230, a sensor module240, an input device250, a display260, an interface270, an audio module280, a camera module291, a power managing module295, a battery296, an indicator297, and a motor298.

The AP210operates an operation system or an application program so as to control a plurality of hardware or software component elements connected to the AP210and execute various data processing and calculations including multimedia data. The AP210may be implemented by a system on chip (SoC). The processor210may further include a graphics processing unit (GPU).

The communication module220may transmit/receive data in communication between different electronic devices (e.g., the electronic device104and the server106connected to the electronic device201through a network. The communication module220may include a cellular module221, a WiFi module223, a BT module225, a GPS module (e.g., a GNSS module227), an NFC module228, and a radio frequency (RF) module229.

The cellular module221may provide a voice call, a video call, a short message service (SMS), or an internet service through a communication network (e.g., LTE, LTE-A, CDMA, WCDMA, UMTS, WiBro, GSM or the like). Further, the cellular module221may distinguish and authenticate electronic devices within a communication network by using the SIM224. The cellular module221may perform at least some of the functions which can be provided by the AP210and may perform at least some of the multimedia control functions.

The cellular module221may include a communication processor (CP), and may be implemented by an SoC.

Although the components such as the cellular module221(e.g., a CP), the memory230, and the power managing module295are illustrated as components separated from the AP210inFIG. 8, the AP210may include at least some (e.g., cellular module221) of the aforementioned components in one embodiment.

The AP210or the cellular module221may load a command or data received from at least one of a non-volatile memory and other components connected to each of the AP210and the cellular module221to a volatile memory and process the loaded command or data. Further, the AP210or the cellular module221may store data received from at least one of other components or generated by at least one of other components in a non-volatile memory.

Each of the WiFi module223, the BT module225, the GPS module227, and the NFC module228may include a process for processing data transmitted/received through the corresponding module. Although the cellular module221, the WiFi module223, the BT module225, the GPS module227, and the NFC module228are illustrated as blocks separated from each other inFIG. 2, at least some (e.g., two or more) of the cellular module221, the WiFi module223, the BT module225, the GPS module227, and the NFC module228may be included in one integrated chip (IC) or one IC package. For example, at least some (e.g., the CP corresponding to the cellular module221and the WiFi processor corresponding to the WiFi module223) of the processors corresponding to the cellular module221, the WiFi module223, the BT module225, the GPS module221, and the NFC module223may be implemented by one SoC.

The RF module229may transmit/receive data, e.g., an RF signal. Although not illustrated, the RF module229may include a transceiver, a power amplifier module (PAM), a frequency filter, a low noise amplifier (LNA) or the like. Further, the RF module229may further include a component for transmitting/receiving electronic waves over a free air space in wireless communication, e.g., a conductor, a conducting wire or the like. Although the cellular module221, the WiFi module223, the BT module225, the GPS module227, and the NFC module228share one RF module229inFIG. 2, at least one of the cellular module221, the WiFi module223, the BT module225, the GPS module227, and the NFC module228may transmit/receive an RF signal through a separate RF module.

The SIM224may be inserted into a slot formed in a particular portion of the electronic device201. The SIM224may include unique identification information (e.g., integrated circuit card identifier (ICCID)) or subscriber information (e.g., international mobile subscriber identity (IMSI).

The memory230may include an internal memory232or an external memory234. The internal memory232may include at least one of a volatile memory (e.g., a dynamic random access memory (DRAM), a static RAM (SRAM), a synchronous dynamic RAM (SDRAM), and the like), and a non-volatile Memory (e.g., a one-time programmable read only memory (OTPROM), a programmable ROM (PROM), an erasable and programmable ROM (EPROM), an electrically erasable and programmable ROM (EEPROM), a mask ROM, a flash ROM, a NAND flash memory, an NOR flash memory, and the like).

The internal memory232may be a solid state drive (SSD). The external memory234may further include a flash drive, for example, a compact flash (CF), a secure digital (SD), a micro-SD, a mini-SD, an extreme digital (xD), or a memory stick. The external memory234may be functionally connected to the electronic device201through various interfaces. The electronic device201may further include a storage device (or storage medium) such as a hard drive.

The sensor module240may measure a physical quantity or detect an operation state of the electronic device201, and convert the measured or detected information to an electronic signal. The sensor module240may include at least one of a gesture sensor240A, a gyro sensor240B, an atmospheric pressure sensor240C, a magnetic sensor240D, an acceleration sensor240E, a grip sensor240F, a proximity sensor240G, a color sensor240H (e.g., red, green, and blue (RGB) sensor)240H, a biometric sensor240I, a temperature/humidity sensor240J, an illumination sensor240K, and an ultra violet (UV) sensor240M. Additionally or alternatively, the sensor module240may include, for example, an e-nose sensor, an electromyography (EMG) sensor, an electroencephalogram (EEG) sensor, an electrocardiogram (ECG) sensor, an infrared (IR) sensor, an iris sensor, a fingerprint sensor, and the like. The sensor module240may further include a control circuit for controlling one or more sensors included in the sensor module240.

The input device250may include a touch panel252, a (digital) pen sensor254, a key256, or an ultrasonic input device258. The touch panel252may recognize a touch input in at least one type of a capacitive type, a resistive type, an infrared type, and an acoustic wave type. The touch panel252may further include a control circuit. In the capacitive type, the touch panel252can recognize proximity as well as a direct touch. The touch panel252may further include a tactile layer. In this event, the touch panel252may provide a tactile reaction to the user.

The (digital) pen sensor254may be implemented using a method identical or similar to a method of receiving a touch input of the user, or using a separate recognition sheet. The key256may include a physical button, an optical key, or a key pad. The ultrasonic input device258is a device which can detect an acoustic wave by a microphone288of the electronic device201through an input means generating an ultrasonic signal to identify data and can perform wireless recognition. The electronic device201may receive a user input from an external device (e.g., computer or server) connected to the electronic device201by using the communication module220.

The display260may include a panel262, a hologram device264, or a projector266. The panel262may be an LCD or an AM-OLED. The panel262may be flexible, transparent, or wearable. The panel262may be configured by the touch panel252and one other module. The hologram device264may show a stereoscopic image in the air by using interference of light. The projector266may project light on a screen to display an image. The screen may be located inside or outside the electronic device201. The display260may further include a control circuit for controlling the panel262, the hologram device264, or the projector266. The interface270may include an HDMI272, a USB274, an optical interface276, or a d-subminiature (D-sub)278. The interface270may be included in the communication interface (e.g., communication module/interface170) illustrated inFIG. 1. Additionally or alternatively, the interface270may include a mobile high-definition link (MHL) interface, a secure digital (SD) card/multi-media card (MMC), or an IR data association (IrDA) standard interface.

The audio module280may bi-directionally convert a sound and an electronic signal. At least some components of the audio module280may be included in the input/output (I/O) interface140illustrated inFIG. 1. The audio module280may process sound information input or output through, for example, a speaker282, a receiver284, an earphone286, the microphone288or the like.

The camera module291is a device which can photograph a still image and a video. The camera module291may include one or more image sensors (e.g., a front sensor or a back sensor), an image signal processor (ISP) or a flash (e.g., an LED or xenon lamp).

The power managing module295may manage power of the electronic device201. Although not illustrated, the power managing module295may include a power management integrated circuit (PMIC), a charger integrated circuit (IC), or a battery gauge.

The PMIC may be mounted to an integrated circuit or an SoC. A charging method may include wired and wireless methods. The charger IC may charge a battery and prevent over voltage or over current from being flowed from a charger. The charger IC may include a charger IC for at least one of the wired charging method and the wireless charging method. The wireless charging method may include a magnetic resonance method, a magnetic induction method and an electromagnetic wave method, and additional circuits for wireless charging, e.g., circuits such as a coil loop, a resonant circuit, a rectifier or the like may be added.

The battery gauge may measure a remaining quantity of the battery296, or a voltage, a current, or a temperature during the charging. The battery296may store or generate electricity and supply power to the electronic device201by using the stored or generated electricity. The battery296may include a rechargeable battery or a solar battery.

The indicator297may show particular statuses of the electronic device201or a part (e.g., AP210) of the hardware, e.g., a booting status, a message status, a charging status and the like. The motor298may convert an electrical signal to a mechanical vibration.

Although not illustrated, the electronic device201may include a processing unit (e.g., GPU) for supporting a module TV. The processing unit for supporting the mobile TV may process media data according to a standard of digital multimedia broadcasting (DMB), digital video broadcasting (DVB), media flow or the like.

Each of the components of the electronic device201may be implemented by one or more components and the name of the corresponding component may vary depending on a type of the electronic device. The electronic device201may include at least one of the above described components, a few of the components may be omitted, or an additional component may be further included. Also, some of the components of the electronic device201may be combined to form a single entity, and thus may equivalently execute functions of the corresponding components before being combined.

FIG. 3is a block diagram of a programming module310, according to an embodiment of the present disclosure. The programming module310may be included (stored) in the electronic device101(e.g., memory130) illustrated inFIG. 1. At least some of the programming module310may be formed of software, firmware, hardware, or a combination of at least two of software, firmware, and hardware. The programming module310may be executed in the hardware (e.g., electronic device201) to include an operating system (OS) controlling resources related to the electronic device101or various applications driving on the OS. For example, the OS may be Android™, iOS™ Windows™, Symbian™, Tizen™, Bada™ or the like. Referring toFIG. 3, the programming module310may include a kernel320, a middleware330, an API360, or an application370.

The kernel320may include a system resource manager321or a device driver323. The system resource manager321may include a process manager, a memory manager, or a file system manager. The system resource manager may perform a system resource control, allocation, or recall. The device driver323may include a display driver, a camera driver, a BT driver, a shared memory driver, a USB driver, a keypad driver, a WiFi driver, or an audio driver. Further, the device driver323may include an inter-process communication (IPC) driver.

The middleware330may include a plurality of modules to provide a function required in common by the applications370. Further, the middleware330may provide a function through the API360to allow the application370to efficiently use limited system resources within the electronic device. For example, as illustrated inFIG. 3, the middleware330may include at least one of a runtime library335, an application manager341, a window manager342, a multimedia manager343, a resource manager344, a power manager345, a database manager346, a package manager347, a connectivity manager348, a notification manager349, a location manager350, a graphic manager351, and a security manager352.

The runtime library335may include a library module used by a complier to add a new function through a programming language while the application370is executed. The runtime library335may execute input and output, management of a memory, a function associated with an arithmetic function or the like.

The application manager341may manage a life cycle of at least one of the applications370. The window manager342may manage graphical user interface (GUI) resources used on the screen. The multimedia manager343may detect a format required for reproducing various media files and perform an encoding or a decoding of a media file by using a codec suitable for the corresponding format. The resource manager344may manage resources such as a source code, a memory, or a storage space of at least one of the applications370.

The power manager345may operate together with a basic input/output system (BIOS) to manage a battery or power and provide power information required for the operation. The database manager346may manage generation, search, or change of a database to be used by at least one of the applications370. The package manager347may manage an installation or an update of an application distributed in a form of a package file.

The connectivity manager348may manage a wireless connection such as WiFi or BT. The notification manager349may display or notify a user of an event such as an arrival message, an appointment, a proximity alarm or the like, in a manner that does not disturb the user. The location manager350may manage location information of the electronic device. The graphic manager351may manage a graphic effect provided to the user or a user interface related to the graphic effect. The security manager352may provide a general security function required for a system security or a user authentication. When the electronic device101has a call function, the middleware330may further include a telephony manager for managing a voice of the electronic device or a video call function.

The middleware330may generate a new middleware module through a combination of various functions of the aforementioned internal component modules and use the generated new middleware module. The middleware330may provide a module specified for each type of operating system (OS) to provide a differentiated function. Further, the middleware330may dynamically delete some of the components of the related art or add new components. Accordingly, some of the components may be omitted, replaced with other components having different names but performing similar functions, or other components may be further included.

The API360is a set of API programming functions, and may be provided with a different configuration according to an OS. For example, in Android™ or iOS™ a single API set may be provided for each platform. In Tizen™, two or more API sets may be provided.

The applications370may include a preloaded application or a third party application.

At least some of the programming module310may be implemented by a command stored in a computer-readable storage medium. When the command is executed by one or more processors210, the one or more processors may perform a function corresponding to the command. The computer-readable storage medium may be, for example, the memory260. At least some of the programming module310may be implemented or executed by, for example, the processor210. At least some of the programming module310may include, for example, a module, a program, a routine, sets of instructions, or a process for performing one or more functions.

Names of components of the programming module310may vary depending on a type of operating system (OS). Further, the programming module may include one or more of the aforementioned components, omit some of the components, or further include other additional components.

The applications370may include one or more applications that can perform functions, such as home application371, dialer application372, SMS/multimedia messaging service (MMS) application373, instant message application (IM)374, browser application375, camera application376, alarm application377, contacts application378, voice dial application379, e-mail application380, calendar application381, media player application382, album application383, clock application384, health care (e.g., measure exercise quantity or blood sugar level), or environment information (e.g., atmospheric pressure, humidity, temperature information or the like).

Hereinafter, an illustration of a configuration of an electronic device having a plurality of ultrasonic sensors will be described.

FIG. 4is a block diagram illustrating a configuration of an electronic device having a plurality of ultrasonic sensors according to various embodiments of the present disclosure.

Referring toFIG. 4, an electronic device401(e.g., the electronic device101or201) according to various embodiments of the present disclosure may include a plurality of ultrasonic sensors, a touchscreen420, a memory430(e.g., the memory130or230), and a processor410(e.g., the processor120or210). The electronic device401according to various embodiments may have two ultrasonic sensors, but it may have two or more ultrasonic sensors. The electronic device401may include an entire configuration or a partial configuration of the electronic device101or201ofFIG. 1 or 2.

The touchscreen420may include a display421(e.g., the display160or260) and a touch panel422(e.g., the touch panel252) for an interaction between the electronic device and a user. The touchscreen420may be electrically connected to the processor410, display various information through the display421, and respond to a contact of an object (e.g., a finger) at an upper surface of the touch panel422to generate and output a touch signal. The display421may display various information (e.g., text, image, video, icon, or symbol) to the user under the control of the processor410. Alternatively, the display421may display a screen of a user interface (UI) related to an operation state of a touchscreen module or the electronic device and an operation thereof. The display421may be formed with, for example, any one of a liquid crystal display (LCD), light-emitting diode (LED) display, organic light-emitting diode (OLED) display, or microelectromechanical systems (MEMS) display, and electronic paper display.

The touch panel422may recognize a touch point based on a user's touch input signal (e.g., touch or proximity) and measure a location value of the touch input. The touch panel422may be implemented into an add-on type located on the display421or an on-cell type or an in-cell type inserted into the display421. The touch panel422may use a resistive type, capacitive type, electromagnetic induction type, and optical method.

Ultrasonic sensors441and442may be integrally formed in an in-cell structure within a module of the touchscreen420or may be formed separately from a module of the touch screen420.

According to various embodiments, the ultrasonic sensors441and442may be mounted in various structures at a location of the electronic device that uses the entire or a portion of a window that protects a module of the touchscreen420as an area for detecting a fingerprint. The window may be cover glass attached to a front surface of the touchscreen420.

According to an embodiment, a fingerprint detection area may be an area of the window in which the ultrasonic sensors441and442are disposed at a lower portion and may be changed according to a location in which the ultrasonic sensors441and442are disposed. A detailed illustration of a mounting location of the ultrasonic sensors441and442will be described with reference toFIGS. 5 to 8, 9A, 9B, 10A, and 10B.

According to an embodiment, each of the ultrasonic sensors441and442may include at least one piezoelectric element including a piezoelectric material, for example, at least one material of zirconate titanate ceramics (PZT), lead scandium tantalate (PST), Quartz, (Pb, Sm)TiO3, PMN(Pb(MgNb)O3)—PT(PbTiO3), polyvinylidene fluoride (PVDF), and PVDF-TrFe. The piezoelectric material may be a material in which a potential difference (voltage) occurs when a pressure is applied to a material or a material in which a vibration occurs by a physical displacement when a potential difference (voltage) occurs in a material.

According to an embodiment, the ultrasonic sensors441and442may perform at least one function of a generation mode that outputs ultrasonic waves and a receiving mode that receives ultrasonic waves. An ultrasonic sensor in an ultrasonic generation mode may generate ultrasonic waves (or sound). For example, when a voltage is applied under the control of the processor410to the ultrasonic sensor in an ultrasonic generation mode, a material constituting a piezoelectric element increases or reduces to generate a vibration, and constituent elements of a touchscreen window or a display generate a vibration by the generated vibration; thus, ultrasonic waves (or sound) may be generated.

An ultrasonic sensor in a receiving mode may receive ultrasonic waves (or sound). When ultrasonic waves are applied to a piezoelectric element, the piezoelectric element vibrates and a potential difference (voltage) occurs by a vibration of the piezoelectric element; thus, the ultrasonic sensors441and442may receive an ultrasonic signal.

According to an embodiment, ultrasonic waves generated by any one ultrasonic sensor operating in an ultrasonic generation mode among the ultrasonic sensors441and442may be transferred to an external object (e.g., a user hand or finger) that has contacted an upper surface of the electronic device, and the ultrasonic waves transferred to the external object may be reflected by the external object to be transferred to another one ultrasonic sensor operating in a receiving mode. The ultrasonic sensor operating in a receiving mode may receive ultrasonic waves reflected by the external object and convert the ultrasonic waves to an electric signal and transfer biometric information (e.g., fingerprint data or acoustic fingerprint image) corresponding to the external object to the processor410.

According to an embodiment, the ultrasonic sensors441and442may operate in a receiver/speaker mode that outputs a sound signal of an audible frequency band other than an ultrasonic wave band. For example, the ultrasonic sensors441and442operating in a receiver/speaker mode may apply an electric signal corresponding to a sound signal to induce vibration occurrence of a piezoelectric element and output a sound of an audible frequency band according to vibration occurrence. According to an embodiment, a biometric information recognition area of the ultrasonic sensors441and442and a touch detection area or a fingerprint recognition area of the touch panel422may be shared. The electronic device401may control to simultaneously activate the touch panel422and the ultrasonic sensor and receive a user touch signal through a shared area and an ultrasonic signal reflected by ultrasonic generation. For example, the processor410may control to simultaneously or selectively activate the ultrasonic sensors441and442and the touch panel422.

The processor410may be electrically connected to a plurality of ultrasonic sensors441and442, the touchscreen420, and the memory430and process data for selectively driving the plurality of ultrasonic sensors441and442as an ultrasonic receiver or an ultrasonic generator. The processor410may analyze biometric information (e.g., fingerprint information) based on a signal transferred from the plurality of ultrasonic sensors441and442to control an operation of an application or a function of the electronic device.

According to an embodiment, the processor410may control a portion of the ultrasonic sensors441and442to selectively operate in a receiving mode or a generation mode based on situation information of the electronic device. According to another embodiment, a portion of the ultrasonic sensors441and442may be located at an upper end portion of the display to be used in a receiver and/or speaker mode.

According to an embodiment, the processor410may determine situation information related to the electronic device and control to selectively change an operation mode of each of the ultrasonic sensors441and442based on occurrence of a predetermined specific condition or situation information. For example, when the first ultrasonic sensor441operates in a receiving mode, the processor410may control the second ultrasonic sensor442to operate in a generation mode. In contrast, when the first ultrasonic sensor441operates in a generation mode, the processor410may control the second ultrasonic sensor442to operate in a receiving mode.

The memory430may be a well-known volatile memory and non-volatile memory and is not limited to a detailed implementation example. The memory430may be disposed within a housing to be electrically connected to the processor410. The memory430may include at least a portion of a configuration and/or a function of the memory130ofFIG. 1and/or the memory230ofFIG. 2.

The memory430may store user biometric information (e.g., fingerprint information) for user authentication. The processor410may compare biometric information obtained through the ultrasonic sensor with user biometric information stored at the memory430to determine whether the user is a user having authority.

FIGS. 5 to 8are cross-sectional views illustrating a touchscreen module in which a plurality of ultrasonic sensors are mounted at different locations in an electronic device according to various embodiments of the present disclosure.

The electronic device (e.g., the electronic device401) according to various embodiments may include two ultrasonic sensors, but the present disclosure is not limited thereto and the electronic device may include two or more ultrasonic sensors. In the electronic device401according to various embodiments, two ultrasonic sensors may operate in at least one operation mode of a receiving mode that receives ultrasonic waves and a generation mode that generates ultrasonic waves. In the electronic device401according to various embodiments, an area corresponding to a disposition location of an ultrasonic sensor operating in a receiving mode may be a biometric information recognition area, and the electronic device401may control to output information that indicates biometric information recognition to a partial area of the display. Hereinafter,FIGS. 5 to 8illustrate a structure in which two ultrasonic sensors are disposed, but the present disclosure is not limited thereto.

Referring toFIG. 5, the electronic device401according to an embodiment may have, for example, a structure in which a window510, touch panel520, first ultrasonic sensor530, display540, and second ultrasonic sensor535are sequentially layered.

The window510may be located at an upper surface of the touch panel520and be located at an uppermost portion among the constituent elements of the touchscreen module. An upper surface of the window510may be exposed at a front surface of the electronic device (e.g., the electronic device401) and may be a contact area of an object (e.g., hand, finger). The touch panel520may be located at a lower surface of the window510. The touch panel520may detect a touch signal (e.g., touch or proximity) of an object that has contacted the window510.

According to an embodiment ofFIG. 5, the first ultrasonic sensor530may be located at a lower surface of the touch panel520and be located at an upper surface of the display540. The second ultrasonic sensor535may be located at a lower surface of the display540. The first ultrasonic sensor530and the second ultrasonic sensor535may operate in at least one mode of a receiving mode and a generation mode. For example, the ultrasonic sensor may be configured to generate ultrasonic waves corresponding to a wavelength range of approximately 1 MHz to 10 MHz or may be configured to receive a reflected ultrasonic signal of generated ultrasonic waves by responding to a contact of a user body.

Further, according to various embodiments of the present disclosure, some of a plurality of ultrasonic sensors may be used as a fingerprint sensor. For example, when ultrasonic waves generated in an ultrasonic sensor in a generation mode are transferred to a user body (e.g., finger bottom), a portion of the ultrasonic waves contact a valley and a crest of a fingerprint and another portion thereof contact air. The ultrasonic sensor in a receiving mode receives ultrasonic waves reflected by the valley and the crest of the fingerprint of the finger, converts the reflected ultrasonic signals to a digital value representing signal strength, and converts the converted digital value to an image, thereby generating the user's biometric information (e.g., fingerprint image).

The display540may display a predetermined image (e.g., fingerprint-shaped image or button image) such that the user recognizes a biometric information recognition area. An upper surface corresponding to a disposition location of the first ultrasonic sensor530and the second ultrasonic sensor535may be a biometric information recognition area (or fingerprint detection area). In an embodiment ofFIG. 5, the biometric information recognition area may be an entire area of the display540and the touch panel520. That is, an entire touch detection area of the touch panel520may be overlapped with the biometric information recognition area.

Referring toFIG. 6, in the electronic device401according to another embodiment, a window610may be located at an uppermost portion of a touch panel620, first ultrasonic sensor630, and second ultrasonic sensor635. In this case, the window610may have a size relatively larger than a display size of the touch panel620and a display640. The window610may be divided into a touch detection area, a disposition area of the first ultrasonic sensor630, and a disposition area of the second ultrasonic sensor635. For example, when the first ultrasonic sensor630operates in a generation mode and when the second ultrasonic sensor635operates in a receiving mode, a disposition area of the second ultrasonic sensor635may be a biometric information recognition area. In this case, the display640may display a predetermined image (e.g., a fingerprint-shaped image or a button image) that indicates a biometric information recognition area in an area corresponding to a disposition location of the second ultrasonic sensor635.

The first ultrasonic sensor630may transfer a vibration to the window610located at an upper end portion to generate ultrasonic waves. Accordingly, ultrasonic waves may be transferred to an external object that has contacted the biometric information recognition area, and ultrasonic waves reflected by the external object may be received in the second ultrasonic sensor635disposed at a lower portion of the biometric information recognition area. The second ultrasonic sensor635may convert an ultrasonic signal reflected and transferred from the external object to a digital value representing signal strength and convert the converted digital value to an image to obtain biometric information corresponding to the object that has contacted the biometric information recognition area.

In the electronic device401according to another embodiment, at a lower surface of a display area, two ultrasonic sensors may be disposed. For example, referring toFIG. 7, in the electronic device401, a window710, touch panel720, and display740may be sequentially disposed, and at a lower portion of a first area of the display740, a first ultrasonic sensor730may be disposed, and at a lower portion of a second area of the display740, a second ultrasonic sensor735may be disposed. In an embodiment ofFIG. 7, the window710may be located at an upper surface of the touch panel720, and the window710may have substantially the same area as that of the touch panel720and the display740.

According to an embodiment, the first ultrasonic sensor730may operate in a receiving mode that receives ultrasonic waves, and the second ultrasonic sensor735may operate in a generation mode that generates ultrasonic waves and vice versa. In the electronic device401, when the first ultrasonic sensor730is in a receiving mode, an area corresponding to a disposition location of the first ultrasonic sensor730may be a biometric information recognition area. Alternatively, when the second ultrasonic sensor735is in a receiving mode, a disposition area of the second ultrasonic sensor735may be a biometric information recognition area.

When one of the first ultrasonic sensor730and the second ultrasonic sensor735is in a receiving mode, the electronic device401according to an embodiment of the present disclosure may control to display a predetermined image (e.g., a fingerprint-shaped image or a button image) that indicates a biometric information recognition area in a display area corresponding to a disposition location of the ultrasonic sensor in a receiving mode.

The electronic device401may obtain biometric information (e.g., fingerprint information) through any one ultrasonic sensor operating in a receiving mode among the first ultrasonic sensor730and the second ultrasonic sensor735and perform user authentication based on the obtained biometric information.

Referring toFIG. 8, in the electronic device401according to various embodiments, two ultrasonic sensors may be disposed in different sizes. In an embodiment ofFIG. 8, a first ultrasonic sensor830is disposed between a touch panel820and a display840, but the present disclosure is not limited thereto and the first ultrasonic sensor830may be disposed between a window810and the touch panel820or may be disposed at a lower surface of the display840. In this case, a second ultrasonic sensor835may be disposed at an area that is not overlapped with a disposition area of the window810, the touch panel820, the second ultrasonic sensor830, and the display840, for example, at a peripheral area.

FIGS. 9A and 9Bare diagrams illustrating an electronic device having a plurality of ultrasonic sensors according to various embodiments of the present disclosure.

The electronic device (e.g., the electronic device401) according to various embodiments may include at least three ultrasonic sensors. For convenience of description, a disposition structure of ultrasonic sensors is illustrated, but a disposition location and size of each ultrasonic sensor may be implemented into various forms. The electronic device401according to various embodiments may include constituent elements constituting the same and a housing for protecting the constituent elements. For example, the electronic device401may include three ultrasonic sensors930,935, and937disposed in a structure ofFIG. 9A.FIG. 9Ais a cross-sectional view of a display module including ultrasonic sensors, andFIG. 9Billustrates an upper surface of the electronic device401in which ultrasonic sensors are formed. InFIG. 9B, a dotted line portion indicates a disposition area of each ultrasonic sensor, but for convenience of description, reference numerals corresponding to reference numerals of ultrasonic sensors are given to the area. That is, as shown inFIG. 9A, when viewed from an upper surface, a window910of the electronic device may be divided into a disposition area of the first ultrasonic sensor930, a disposition area of the second ultrasonic sensor935, and a disposition area of the third ultrasonic sensor937and having a size corresponding to a touch detection area. This is represented with a dotted line for convenience of description and is not visually divided.

In a cross-sectional view ofFIG. 9A, in the electronic device401, the window910may be located at an uppermost portion of a touch panel920, the first ultrasonic sensor930, and the second ultrasonic sensor935on a lower surface thereof. In this case, the window910may have a relatively larger area than that of the touch panel920and a display940.

According to various embodiments, the electronic device401may control some of three ultrasonic sensors to operate in at least one mode of a receiver mode that outputs a sound of an audible frequency and a generation mode that generates ultrasonic waves and control some other ultrasonic sensors to operate in a receiving mode that receives ultrasonic waves.

According to various embodiments, the electronic device401may control an ultrasonic sensor operating in a receiving mode to use as an ultrasonic fingerprint sensor that authenticates a user fingerprint.

According to various embodiments, the electronic device401may change a mode of a plurality of ultrasonic sensors to operate in a speaker mode that generates an audible frequency. In an example, an ultrasonic sensor that may have a mode thereof changed in order to operate in a speaker mode may be disposed at a side of the display instead of a lower surface of the display in order to generate a specific volume or more.

FIGS. 10A and 10Bare diagrams illustrating an electronic device having a plurality of ultrasonic sensors according to various embodiments of the present disclosure.

According to an embodiment, the electronic device401may select an ultrasonic sensor to operate in a receiving mode that receives ultrasonic waves or may change a mode of an ultrasonic sensor in order to enable the ultrasonic sensor to operate in a receiving mode among a plurality of ultrasonic sensors according to a specific condition occurrence or situation information thereof.

For another example, the electronic device (e.g., the electronic device401) may have 6 ultrasonic sensors, as in a structure ofFIGS. 10A and 10B. In this case, the electronic device (e.g., the electronic device401) may control at least two ultrasonic sensors to operate in a receiving mode among a plurality of ultrasonic sensors and control to change a mode of an ultrasonic sensor in order to enable the ultrasonic sensor to operate in a receiving mode according to a specific condition occurrence or situation information thereof.

FIG. 10Ais a cross-sectional view of a display module including an ultrasonic sensor, andFIG. 10Billustrates an upper surface of an electronic device in which an ultrasonic sensor is formed. InFIG. 10B, a dotted line portion indicates a disposition area of each ultrasonic sensor, but for convenience of description reference numerals corresponding to reference numerals of ultrasonic sensors are given to the area. That is, an area designated by a dotted line at an upper surface ofFIG. 10Bmay be a disposition area of a first ultrasonic sensor1030, a disposition area of a second ultrasonic sensor1035, a disposition area of a third ultrasonic sensor1033, a disposition area of a fourth ultrasonic sensor1037, a disposition area of a fifth ultrasonic sensor1034, and a disposition area of a sixth ultrasonic sensor1036.

In an example, when executing a function of an application, the electronic device401may control only a second ultrasonic sensor to operate in a receiving mode; and when executing a function of a music reproduction application, the electronic device401may control the second, fourth, and fifth ultrasonic sensors to operate in a speaker mode or a receiving mode.

In another example, when the first ultrasonic sensor1030of a plurality of ultrasonic sensors receives a request related to a second function while operating in a receiving mode in relation to a first function, the electronic device401may control to change a mode of the first ultrasonic sensor1030from a receiving mode to a generation mode to operate the first ultrasonic sensor1030in a generation mode and control to change a mode of the third ultrasonic sensor1033to a receiving mode.

FIGS. 11A, 11B, 11C, and 11Dare diagrams illustrating a fingerprint recognition operation of an electronic device having a plurality of ultrasonic sensors according to various embodiments of the present disclosure.

Referring toFIGS. 11A, 11B, 11C, and 11D, in the electronic device (e.g., the electronic device401) according to various embodiments, as shown inFIG. 11Aa first ultrasonic sensor1130may be disposed at a partial area and a second ultrasonic sensor1135may be disposed at another partial area. Here, the first ultrasonic sensor1130may operate in a generation mode, and the second ultrasonic sensor1135may operate in a receiving mode. A disposition structure of a plurality of ultrasonic sensors may be changed according to a display type and the present disclosure is not limited thereto.

When the electronic device has two ultrasonic sensors of the first ultrasonic sensor1130and the second ultrasonic sensor1135, as shown in a disposition structure ofFIG. 11B, a window1110, touch panel1120, and display1140may be sequentially layered, a second ultrasonic sensor1135amay be disposed at a lower portion of the display, and the first ultrasonic sensor1130may be disposed at an area different from a disposition area of the second ultrasonic sensor1135a. In another example, as shown in a disposition structure ofFIG. 11C, at a lower portion of a touch panel1120, a second ultrasonic sensor1135bmay be disposed in an in-cell structure in the display. In another example, as shown in a disposition structure ofFIG. 11D, a second ultrasonic sensor1135cmay be located at the same layer as that of the display (not shown) or may be located at a side of the display.

As in the above-described structures, the electronic device may distinguish an ultrasonic sensor operating in a receiving mode and an ultrasonic sensor operating in a generation mode among a plurality of ultrasonic sensors and control to display a predetermined image that indicates a biometric information recognition area in a display area corresponding to a disposition area of the ultrasonic sensor operating in a receiving mode.

For example, ultrasonic waves generated in the first ultrasonic sensor1130operating in a generation mode may be transferred through a window and be reflected by a user body (e.g., finger) that has contacted a biometric information recognition area to be received in the second ultrasonic sensor1135located at a lower portion of the display. Accordingly, the second ultrasonic sensor1135in a receiving mode may convert an ultrasonic signal reflected by a valley and a crest of a user fingerprint to a digital value representing signal strength and convert the converted digital value to an image to obtain the user's biometric information (e.g., a fingerprint image or fingerprint data). The second ultrasonic sensor1135may transfer the user's biometric information to the processor (e.g., the processor410) electrically connected thereto. The processor410may compare the user's biometric information transferred from the ultrasonic sensor with the user's biometric information stored at the memory (e.g., the memory430) and determine whether the user's biometric information is biometric information of a user having the authority to perform biometric information authentication.

FIGS. 12A and 12Bare diagrams illustrating a layer structure having a plurality of ultrasonic sensors according to various embodiments of the present disclosure.

Referring toFIGS. 12A and 12B, an ultrasonic sensor may be disposed at a lower surface of a display according to various embodiments of the present disclosure or an ultrasonic sensor may be disposed in an in-cell structure in the display. In an example, a layer structure in which an ultrasonic sensor is disposed at a lower surface of the display may be a layer structure of a window1210, touch panel1220, first ultrasonic sensor1230, display1240, and second ultrasonic sensor1235, as shown inFIG. 12A. Here, any one of the first ultrasonic sensor1230and the second ultrasonic sensor1235may operate in a receiving mode that receives ultrasonic waves according to a specific condition occurrence or a state of the electronic device.

In order to convert a received ultrasonic signal to the user's biometric information (e.g., fingerprint information or fingerprint image), the first ultrasonic sensor1230and the second ultrasonic sensor1235may include at least one block or pixel. In another example, a structure in which an ultrasonic sensor is disposed in an in-cell structure in the display may be a layer structure of a window1210, a touch panel1220, and a display and sensor integrated module1237in which an ultrasonic sensor operating in a receiving mode is disposed in an in-cell structure in the display, as shown inFIG. 12B.

In order to convert a received ultrasonic signal to the user's biometric information (e.g., fingerprint information or fingerprint image), an ultrasonic sensor according to various embodiments may include at least one block or pixel.

FIGS. 13A, 13B, and 13Care diagrams illustrating a pixel structure of ultrasonic sensors according to various embodiments of the present disclosure.

Referring toFIGS. 13A, 13B, and 13C, in the electronic device according to various embodiments, an ultrasonic sensor disposed in an in-cell structure in the display may be formed in a structure in which each pixel group constituting the display includes an ultrasonic receiving pixel or an ultrasonic generation pixel together with light emitting pixels. When viewing an enlarged view of one pixel constituting the display, the display may include a plurality of pixel groups. Each pixel group may include an ultrasonic pixel U (e.g., ultrasonic receiving pixel or ultrasonic generation pixel) that receives or generates ultrasonic waves together with red R, green G, and blue B light emitting pixels. In an example, in a pixel group of a disposition structure ofFIG. 13A, the blue light emitting pixel B and the ultrasonic pixel U may have a relatively smaller size than that of the red light emitting pixel R and the green light emitting pixel G.

In another example, pixels of the display having a disposition structure ofFIG. 13Bmay have an RGBU pattern, and a portion of the green pixel G may be replaced with the ultrasonic pixel U. In another example, in pixels of the display having a disposition structure ofFIG. 13C, green G, red R, and blue B light emitting pixels may be disposed in the same size, and the ultrasonic pixel U may have a size different from that of the light emitting pixels and be included in one pixel group.

According to various embodiments, the ultrasonic pixel U may be included in a partial area instead of an entire area of the display. For example, when the ultrasonic sensor should be disposed at an upper end portion or a lower end portion of the display, only pixels disposed at an upper end area and a lower end area of the display may include an ultrasonic pixel, and pixels of a central area of the display may include only red R, green G, and blue B light emitting pixels including no ultrasonic pixel U.

FIGS. 14A, 14B, and 14Care diagrams illustrating a selective use method of a plurality of ultrasonic sensors in an electronic device according to various embodiments of the present disclosure.

According to various embodiments, the electronic device (e.g., the electronic device401) may determine an operation mode of an ultrasonic sensor and control to change an operation mode of the ultrasonic sensor provided therein to a first operation mode or a second operation mode according to a specific condition occurrence or situation information thereof. An operation mode of the ultrasonic sensor may be at least one of a generation mode that generates ultrasonic waves, a receiving mode that receives ultrasonic waves, and a receiver/speaker mode that outputs a sound of an audible frequency.

According to an embodiment, referring toFIG. 14A, the electronic device401may include a first ultrasonic sensor1430, second ultrasonic sensor1431, and third ultrasonic sensor1432. InFIG. 14A, a dotted line portion indicates a disposition area of each ultrasonic sensor and may be divided into a disposition area1401aof the first ultrasonic sensor1430, a disposition area1401bof the second ultrasonic sensor1431, and a disposition area1401cof the third ultrasonic sensor1432. This is represented with a dotted line for convenience of description and is not visually divided. The second ultrasonic sensor1431and the third ultrasonic sensor1432may be disposed at a lower portion of a structure in which a window1410, touch panel1420, and display1440are sequentially layered.

The electronic device401having a structure ofFIG. 14Amay enable the first ultrasonic sensor1430to operate in a generation mode that generates ultrasonic waves and enable the second ultrasonic sensor1431and the third ultrasonic sensor1432to operate in a receiving mode that receives ultrasonic waves. The electronic device401may apply a voltage to the first ultrasonic sensor1430to enable a piezoelectric element to vibrate and to vibrate the window to generate ultrasonic waves. The electronic device401may receive ultrasonic waves reflected by a user fingerprint that has contacted an upper portion of a disposition area of the second ultrasonic sensor1431or the third ultrasonic sensor1432to obtain the user's fingerprint information, thereby performing ultrasonic fingerprint authentication.

According to an embodiment, the electronic device401may control at least one of the second ultrasonic sensor1431and the third ultrasonic sensor1432to operate in a receiving mode for fingerprint authentication according to a situation thereof. While the electronic device401executes a specific application, the electronic device may control a display area corresponding to a disposition area of the third ultrasonic sensor1432to display a screen related to a specific application and control a display area corresponding to a disposition area of the second ultrasonic sensor1431to display at least one image representing a biometric information recognition area for fingerprint authentication. The electronic device401may perform fingerprint authentication using the second ultrasonic sensor1431.

According to another embodiment, as shown inFIGS. 14B and 14C, the electronic device401may include four ultrasonic sensors of a first ultrasonic sensor1430, second ultrasonic sensor1431, third ultrasonic sensor1432, and fourth ultrasonic sensor1433. As shown inFIGS. 14B and 14C, a dotted line portion indicates a disposition area of each ultrasonic sensor and may be divided into disposition areas1402aand1403aof the first ultrasonic sensor1430, disposition areas1402band1403bof the second ultrasonic sensor1431, disposition areas1402cand1403cof the third ultrasonic sensor1432, and disposition areas1402dand1403dof the fourth ultrasonic wave1433.

The electronic device401may control any one of the first ultrasonic sensor1430and the fourth ultrasonic sensor1433to operate in a generation mode that generates ultrasonic waves and control any one of the second ultrasonic sensor1431and the third ultrasonic sensor1432to operate in a receiving mode that receives ultrasonic waves.

In an example, referring toFIG. 14B, when the electronic device401changes a mode of the first ultrasonic sensor1430to a generation mode and when the first ultrasonic sensor1430generates ultrasonic waves, the electronic device401may change a mode of the second ultrasonic sensor1431adjacent to the first ultrasonic sensor1430to a receiving mode to perform fingerprint authentication. In this case, the electronic device may control the display area1402bcorresponding to a disposition area of the second ultrasonic sensor1431to display at least one image representing a biometric information recognition area for fingerprint authentication.

However, referring toFIG. 14C, when the electronic device401changes a mode of the fourth ultrasonic sensor1433to a generation mode and when the fourth ultrasonic sensor1433generates ultrasonic waves, the electronic device401may change a mode of the third ultrasonic sensor1432adjacent to the fourth ultrasonic sensor1433to a receiving mode to perform fingerprint authentication. In this case, the electronic device401may control the display area1403ccorresponding to a disposition area of the third ultrasonic sensor1432to display at least one image representing a biometric information recognition area for fingerprint authentication.

According to various embodiments, when the first ultrasonic sensor operates in a speaker/receiver mode, the electronic device401may perform fingerprint authentication using the third ultrasonic sensor and/or the fourth ultrasonic sensor. An operation mode of the ultrasonic sensor provided in the electronic device401may be changed by various conditions, for example, screen information about an executing application and operation information about each ultrasonic sensor, but the present disclosure is not limited thereto and a condition may be changed according to setup.

FIGS. 15A and 15Bare diagrams illustrating a fingerprint recognition situation of an electronic device according to various embodiments of the present disclosure.

Referring toFIGS. 15A and 15B, an electronic device (e.g., the electronic device401) according to various embodiments of the present disclosure may use an ultrasonic sensor in a receiver mode/speaker mode that outputs/receives a sound signal of an audible frequency band in addition to an ultrasonic generation/reception mode. The electronic device401may control to change an operation mode of each ultrasonic sensor according to a predetermined method and to perform a function corresponding to a changed operation mode.

According to an embodiment, the electronic device401may request a user authentication function for personal information protection and payment information exchange while executing another function thereof. For example, by connecting a communication channel with an electronic device of another party, the electronic device401may be in a call connection state. In this case, the electronic device401may control some of a plurality of ultrasonic sensors to operate in a receiver mode/speaker mode for transmitting and receiving a sound signal in an audible frequency band. In a state in which a call is connected with an electronic device of another party (e.g., Samsung pay customer center), the electronic device of another party may transmit a signal that requests authentication of a user of the electronic device to the electronic device. The electronic device401may determine an ultrasonic sensor operating in a receiver/speaker mode and select an ultrasonic sensor to use in a receiving mode.

Accordingly, as shown inFIG. 15A, the electronic device401may control to display a screen that guides biometric information authentication for user authentication in a display of a disposition area of an ultrasonic sensor to correspond to the disposition area of the ultrasonic sensor selected as a receiver of an ultrasonic signal on a communicating connection screen.

For example, as shown inFIGS. 15A and 15B, the electronic device may be divided into a disposition area of a first ultrasonic sensor1510, a disposition area of a second ultrasonic sensor1520, and a disposition area of a third ultrasonic sensor1530. In a state in which a communicating function is activated, the electronic device401may control the first ultrasonic sensor1510and the third ultrasonic sensor1530to operate in a receiver/speaker mode that outputs an audible frequency. For example, in a state in which a communicating function of the electronic device401is activated, when a situation to change a mode of an ultrasonic sensor to a generation mode occurs, the electronic device401may control to change a mode of the first ultrasonic sensor1510from a speaker mode to a generation mode. In a state in which a communicating function is activated, when a situation to change a mode of an ultrasonic sensor to a generation mode occurs, for example, when a user authentication determination request signal occurs, the electronic device401may control the third ultrasonic sensor1530to operate in a generation mode that generate ultrasonic waves and control the second ultrasonic sensor1520to operate in a receiving mode that receives ultrasonic waves.

The electronic device401may selectively use the first ultrasonic sensor1510and the third ultrasonic sensor1530to output a voice signal to an electronic device of another party, vibrate glass through generation of an ultrasonic signal, and receive reflected ultrasonic waves of ultrasonic waves generated in the first ultrasonic sensor or the third ultrasonic sensor using the second ultrasonic sensor1520to perform fingerprint authentication. The electronic device401compares fingerprint information obtained through the second ultrasonic sensor1520with user biometric information stored at the memory and, when the authority of the user is authenticated, the electronic device may provide information notifying that user authentication has been determined to an electronic device of another party. The user can easily perform user authentication while communicating without a separate user authentication process.

According to various embodiments, the electronic device401may selectively change an operation mode of the first ultrasonic sensor1510, the second ultrasonic sensor1520, and the third ultrasonic sensor1530according to a predetermined method. The electronic device401may change a display location of a screen that guides biometric information authentication for user authentication according to an operation mode of the ultrasonic sensor.

According to another embodiment, the electronic device401may determine information about a location in which a user finger has contacted using a touch panel functionally connected thereto, a touchscreen, or a second ultrasonic sensor that detects a vibration change upon contacting and display a screen that guides biometric information authentication of fingerprint recognition on the display to correspond to the determined location.

FIGS. 16A, 16B, 16C, and 16Dare diagrams illustrating a fingerprint recognition situation of an electronic device according to various embodiments of the present disclosure.

Referring toFIGS. 16A, 16B, 16C, and 16D, the electronic device according to various embodiments may control some of a plurality of ultrasonic sensors to operate in a speaker mode that outputs a sound of an audible frequency band other than an ultrasonic band. In a state in which the ultrasonic sensor is used in a speaker mode, when a predetermined condition (e.g., a high sound request signal of a predetermined threshold value or more) occurs, the electronic device may select at least two ultrasonic sensors and control the at least two ultrasonic sensors to operate in a speaker mode. Further, when the electronic device should control the one ultrasonic sensor while operating in a speaker mode to operate in an ultrasonic receiving mode, the electronic device may control to change a mode of the ultrasonic sensor from a speaker mode to a receiving mode and control an ultrasonic sensor of another location to operate in a speaker mode.

For example, in a state in which a music reproduction application is executed, when a situation requiring user authentication occurs, as in digital writing management contents, the electronic device may control to display a screen that guides biometric information authentication for user authentication in a display of a disposition area of an ultrasonic sensor.

For example, an electronic device ofFIG. 16Amay include a first ultrasonic sensor1610, second ultrasonic sensor1620, and third ultrasonic sensor1630. Here, for convenience of description, areas are divided, but a disposition area of the first ultrasonic sensor1610, second ultrasonic sensor1620, and third ultrasonic sensor1630is not visually represented.

The electronic device having the first ultrasonic sensor1610, second ultrasonic sensor1620, and third ultrasonic sensor1630may control the second ultrasonic sensor1620to operate in a speaker mode as shown inFIG. 16Bor may control the first ultrasonic sensor1610to operate in a speaker mode as shown inFIG. 16Caccording to situation information thereof. Alternatively, as shown inFIG. 16D, when the electronic device should output a sound to a volume larger than a predetermined sound setup value upon reproducing music, the electronic device may control the first ultrasonic sensor1610and the second ultrasonic sensor1620to operate in a speaker mode.

When the electronic device should guide biometric information authentication for user authentication upon reproducing music, the electronic device may change a mode of other ultrasonic sensors, except for an ultrasonic sensor operating in a speaker mode among a plurality of ultrasonic sensors to a receiving mode for user authentication and control to display a screen that guides biometric information authentication in a display area in which the ultrasonic sensor changed to a receiving mode is disposed.

FIG. 17is a flowchart illustrating a method of authenticating biometric information of an electronic device according to various embodiments of the present disclosure.

Referring toFIG. 17, the electronic device (e.g., the electronic device401or the processor410of the electronic device) according to various embodiments may receive a fingerprint recognition request at operation1710. For example, the fingerprint recognition request may be a request signal by a user input and may be a request signal from another electronic device. For example, when fingerprint recognition is set as an authentication method for lock release in a lock state, the electronic device401may recognize that a fingerprint recognition request has occurred in response to a user's lock release request. Alternatively, when the electronic device401receives a user authentication determination request from another electronic device or when a request signal that allows only access of a user having authority occurs, the electronic device401may recognize that a fingerprint recognition request has occurred. The fingerprint recognition request may be changed according to setup, and the electronic device may receive a fingerprint recognition request in various situations.

The electronic device401may, at operation1720, distinguish and select a sensor to operate in a generation mode and a sensor to operate in a receiving mode based on a mounting location among a plurality of ultrasonic sensors in response to reception of a fingerprint recognition request.

For example, the electronic device401may select an ultrasonic sensor to operate in a generation mode and an ultrasonic sensor to operate in a receiving mode using at least one of a current operation mode of each of ultrasonic sensors, executing application information, and situation information. Here, as an ultrasonic sensor to operate in a generation mode and a receiving mode, the electronic device401may select different ultrasonic sensors or may select the same sensor.

The electronic device401may apply a voltage to the ultrasonic sensor selected to operate in a generation mode to generate ultrasonic waves at operation1730. In this case, the electronic device401may control to display a screen that guides fingerprint authentication in a display area in which the ultrasonic sensor selected to operate in a receiving mode is disposed. Accordingly, the user may contact the user's hand at an upper surface of a display area corresponding to a disposition location of the ultrasonic sensor selected to operate in a receiving mode through a screen that guides fingerprint authentication.

The electronic device401may, at operation1740, receive ultrasonic waves reflected by the user's hand (e.g., fingerprint) through a vibration by generated ultrasonic waves through the ultrasonic sensor operating in a receiving mode. The electronic device401may, at operation1750, obtain a user fingerprint image (or image) based on the received ultrasonic waves that were reflected from the user's hand.

The electronic device401may perform fingerprint authentication at operation1760based on the obtained fingerprint image. For example, the electronic device401may compare the obtained fingerprint image with user biometric information stored at the memory, and if the obtained fingerprint image corresponds to the user biometric information, the electronic device401may determine that the user is a user having authority and release lock or may perform an operation (e.g., payment approval) related to personal information or security information. If the obtained fingerprint image does not correspond to the user biometric information, the electronic device401may determine that the user is a user having no authority and block an operation (e.g., payment approval) related to personal information or security information or may control to stop an operation thereof.

According to various embodiments of the present disclosure, an electronic device that can detect a touch and a fingerprint in a display area can be provided.