Patent Description:
With the development of technology, electronic devices have advanced to provide various services and functions through multitasking and execution of various applications, beyond basic functions such as communication and data transmission.

Electronic devices having a frontal display screen has a gradually increase in screen size in order to provide better service to a user through a large viewing area. The screen size is limited by placement of other components, such as a camera, receiver, and sensor disposed at an upper end portion of the front surface of the device, or a home button disposed at a lower end portion of the front surface of the device.

<CIT>, is about a mobile terminal comprising at least one of a speaker (<NUM>) configured to output sound data, a microphone (<NUM>) configured to receive voice data and a camera (<NUM>) configured to capture image data. The mobile terminal further comprises a sensing unit (<NUM>) configured to sense a touching operation of at least one of the speaker, the microphone, the camera and/or a neighborhood area of at least one of the speaker, the microphone and the camera, and a controller (<NUM>) configured to control at least one of a volume of the speaker, a volume of the microphone and an operation of the camera, based on the sensed touching operation.

<CIT>, is about an electronic device with a touchscreen display, comprising an active touchscreen region and a virtual bezel area, the active touchscreen region functioning to process a first set of touch-based inputs from a user of the electronic device according to a first mode of operation, and the virtual bezel area functioning to process a second set of touch-based inputs from a user of the electronic device according to a second mode of operation.

<CIT>, is about mobile electronic device is provided. The mobile electronic device includes a display configured to display at least one object, at least one hardware component disposed in an area other than an area of the display, a guard touch area disposed within a distance from the at least one hardware component, wherein a touch event is generated when the guard touch area is touched, and a processor configured to control the display to display an object associated with operation of one or more of the at least one hardware component based on the touch event.

<CIT>, is about a method for operating an electronic device, the method comprising the steps of obtaining input information input to a display screen and fingerprint information input to a fingerprint sensor (<NUM>), and executing a command matching a combination of the obtained screen input information and fingerprint information (<NUM>).

The solution is set out in the appended set of claims.

The present disclosure has been made in view of the above problem and provides an electronic device having a hole area and a method of controlling a hole area thereof that can enlarge a content through a display having a main area and an extension area.

In accordance with an aspect of the present disclosure, a method in an electronic device includes: defining a main area and an extension area of a display of the electronic device, detecting selecting selection of a displayed content, detecting by a processor whether a characteristic of a portion of the content disposed along an edge of the content is equal to or less than a threshold, and enlarging the selected displayed content for display on the main area and extending to the extension area based on whether the characteristic of the portion is equal to or less than the threshold.

In accordance with another aspect of the present disclosure, an electronic device includes: a housing comprising including a first surface facing in a first direction and a second surface facing in a second direction opposite to the first direction, a touch screen display disposed between the first surface and the second surface, such that a portion of the touch screen is exposed through the first surface, and having the touch screen display including a main area and an extension area, the extension area including at least one opening, and at least one hole area positioned at the extension area, at least one processor electrically connected coupled to the display, configured to: detect selection of a content displayed on the touch screen and detecting whether a characteristic of a portion of the content disposed along an edge of the content is equal to or less than a threshold, display the selected content on the main area and extending to the extension area when the characteristic is equal to or less than the threshold, and excluding the selected content from display in the extension area when the characteristic is greater than the threshold.

The objects and features present disclosure will be more apparent from the following detailed description in conjunction with the accompanying drawings, in which:.

The following description with reference to the accompanying drawings is provided to assist in a comprehensive understanding of various embodiments of the present disclosure as defined by the claims and their equivalents. It includes various specific details to assist in that understanding but these are to be regarded as merely example. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the various embodiments described herein can be made without departing from the present disclosure.

It is to be understood that the singular forms "a," "an," and "the" include plural referents unless the context clearly indicates otherwise.

In this disclosure, the expression "A or B" or "at least one of A and/or B" may include A, may include B, or may include both A and B. Expressions including ordinal numbers, such as "first" and "second," etc., may modify various elements. However, the above expressions do not limit the sequence and/or importance of the elements and are used merely for the purpose to distinguish an element from the other elements. In case where a certain (e.g., the first) element is referred to as being "connected" or "accessed" (functionally or communicatively) to other (e.g., the second) element, it should be understood that the element is connected or accessed directly to the other element or through another (e.g., the third) element. In this disclosure, the expression "configured to" may be used, depending on situations, interchangeably with "adapted to", "having the ability to", "modified to", "made to", "capable of", or "designed to". In some situations, the expression "device configured to" may mean that the device may operate with other device(s) or other component(s). For example, the expression "processor configured to perform A, B and C" may mean a dedicated processor (e.g., an embedded processor) for performing the above operations, or a general-purpose processor (e.g., central processing unit (CPU) or an application processor (AP)) capable of performing the above operations by executing one or more software programs stored in a memory device. An electronic device according to various embodiments of this disclosure may include at least one of a smart phone, a tablet personal computer (PC), a mobile phone, a video phone, an e-book reader, a desktop PC, a laptop PC, a netbook computer, a workstation, a server, a personal digital assistant (PDA), a portable multimedia player (PMP), a Moving Picture Experts Group phase <NUM> or phase <NUM> (MPEG-<NUM> or MPEG-<NUM>) audio layer <NUM> (MP3) player, a medical device, a camera, and a wearable device. For example, a wearable device may include at least one of an accessory type (e.g., a watch, a ring, a bracelet, an anklet, a necklace, an electronic accessory, eyeglasses, contact lenses, or a head-mounted device (HMD)), a textile or cloth assembled type (e.g., electronic clothing), a body attached type (e.g., a skin pad or tattoo), and a body transplant circuit. In some embodiments, an electronic device may include at least one of a television (TV), a digital versatile disc (DVD) player, an audio device, a refrigerator, an air-conditioner, a vacuum cleaner, an oven, a microwave, a washing machine, an air cleaner, a set-top box, a home automation control panel, a security control panel, a media box (e.g., Samsung HomeSync™, Apple TV™, or Google TV™) a game console (e.g., Xbox™, PlayStation™), an electronic dictionary, an electronic key, a camcorder, and an electronic frame.

In various embodiments of the present disclosure, an electronic device may include at least one of various medical devices (e.g., magnetic resonance angiography (MRA), magnetic resonance imaging (MRI), computed tomography (CT), a scanning machine, an ultrasonic wave device, etc.), a navigation device, a global navigation satellite system (GNSS), an event data recorder (EDR), a flight data recorder (FDR), a vehicle infotainment device, an electronic equipment for a ship (e.g., navigation equipment for a ship, gyrocompass, etc.), avionics, a security device, a head unit or device for a vehicle, an industrial or home robot, a drone, an automated teller machine (ATM), a point of sales (POS), and various Internet of things (IoT) devices (e.g., a lamp, various sensors, a sprinkler, a fire alarm, a thermostat, a street light, a toaster, athletic equipment, a hot water tank, a heater, a boiler, etc.). According to a certain embodiment, an electronic device may include at least one of furniture, a portion of a building/structure or car, an electronic board, an electronic signature receiving device, a projector, and various measuring meters (e.g., a water meter, an electric meter, a gas meter, a wave meter, etc.). In various embodiments, an electronic device may be flexible or a combination of two or more of the aforementioned devices. An electronic device according to various embodiments of this disclosure is not limited to the aforementioned devices. In this disclosure, the term a user may refer to a person who uses an electronic device, or a machine (e.g., an artificial intelligence device) which uses an electronic device.

<FIG> is a block diagram illustrating a network environment <NUM> including therein an electronic device <NUM> in accordance with various embodiments of the present disclosure.

Referring to <FIG>, the electronic device <NUM> may include, but is not limited to, a bus <NUM>, a processor <NUM>, a memory <NUM>, an input/output interface <NUM>, a display <NUM>, and a communication interface <NUM>. The bus <NUM> may be a circuit designed for connecting the above-discussed elements and communicating data (e.g., a control message) between such elements. The processor <NUM> may receive commands from the other elements (e.g., the memory <NUM>, the input/output interface <NUM>, the display <NUM>, or the communication interface <NUM>, etc.) through the bus <NUM>, interpret the received commands, and perform the arithmetic or data processing based on the interpreted commands. The memory <NUM> may store therein commands or data received from or created at the processor <NUM> or other elements (e.g., the input/output interface <NUM>, the display <NUM>, or the communication interface <NUM>, etc.). The memory <NUM> may include programming modules <NUM> such as a kernel <NUM>, a middleware <NUM>, an application programming interface (API) <NUM>, and an application <NUM>. Each of the programming modules may be implemented by software, firmware, hardware, and any combination thereof.

The kernel <NUM>, as illustrated in <FIG>, may control or manage system resources (e.g., the bus <NUM>, the processor <NUM>, the memory <NUM>, etc.) used to execute operations or functions implemented by other programming modules (e.g., the middleware <NUM>, the API <NUM>, and the application <NUM>). Also, the kernel <NUM> may provide an interface capable of accessing and controlling or managing the individual elements of the electronic device <NUM> by using the middleware <NUM>, the API <NUM>, or the application <NUM>.

The middleware <NUM> may serve to go between the API <NUM> or the application <NUM> and the kernel <NUM> in such a manner that the API <NUM> or the application <NUM> communicates with the kernel <NUM> and exchanges data therewith. Also, in relation to work requests received from one or more applications <NUM> and/or the middleware <NUM>, for example, may perform load balancing of the work requests by using a method of assigning a priority, in which system resources (e.g., the bus <NUM>, the processor <NUM>, the memory <NUM>, etc.) of the electronic device <NUM> can be used, to at least one of the one or more applications <NUM>. The API <NUM> is an interface through which the application <NUM> is capable of controlling a function provided by the kernel <NUM> or the middleware <NUM>, and may include, for example, at least one interface or function for file control, window control, image processing, character control, or the like. The input/output interface <NUM> may deliver commands or data, entered by a user through an input/output unit or device (e.g., a sensor, a keyboard, or a touch screen), to the processor <NUM>, the memory <NUM>, or the communication interface <NUM> via the bus <NUM>.

The display module <NUM> may include, for example, a liquid crystal display (LCD), a light emitting diode (LED) display, an organic LED (OLED) display, a micro electro mechanical system (MEMS) display, or an electronic paper display. The display <NUM> may display various types of contents (e.g., text, images, videos, icons, or symbols) for users. The display module <NUM> may include a touch screen, and may receive, for example, a touch, gesture, proximity, or hovering input by using an electronic device or a part of the user's body.

The communication interface <NUM> may establish communication between the electronic device <NUM> and any external device (e.g., the first external electronic device <NUM>, the second external electronic device <NUM>, or the server <NUM>). For example, the communication interface <NUM> may be connected with a network <NUM> through wired or wireless communication <NUM> and thereby communicate with any external device (e.g., the second external electronic device <NUM>, or the server <NUM>).

Wireless communication may use, as cellular communication protocol, at least one of long-term evolution (LTE), LTE advanced (LTE-A), code division multiple access (CDMA), wideband CDMA (WCDMA), universal mobile telecommunications system (UMTS), wireless broadband (WiBro), global system for mobile communications (GSM), and the like, for example. A short-range communication may include, for example, at least one of Wi-Fi, Bluetooth (BT), near field communication (NFC), magnetic secure transmission or near field magnetic data stripe transmission (MST), and GNSS, and the like. The GNSS may include at least one of, for example, a global positioning system (GPS), a global navigation satellite system (GLONASS), a BeiDou navigation satellite system (hereinafter, referred to as "BeiDou"), and Galileo (European global satellite-based navigation system). Hereinafter, the "GPS" may be interchangeably used with the "GNSS" in the present disclosure.

The wired communication may include, but not limited to, at least one of universal serial bus (USB), high definition multimedia interface (HDMI), recommended standard <NUM> (RS-<NUM>), or plain old telephone service (POTS). The network <NUM> includes, as a telecommunications network at least one of a computer network (e.g., local area network (LAN) or wide area network (WAN)), the internet, and a telephone network. The types of the first and second external electronic devices <NUM> and <NUM> may be the same as or different from the type of the electronic device <NUM>. The server <NUM> may include a group of one or more servers. A portion or all of operations performed in the electronic device <NUM> may be performed in one or more other electronic devices <NUM> or <NUM> or the server <NUM>. In the case where the electronic device <NUM> performs a certain function or service automatically or in response to a request, the electronic device <NUM> may request at least a portion of functions related to the function or service from another electronic device <NUM> or <NUM> or the server <NUM> instead of or in addition to performing the function or service for itself. The other electronic device <NUM> or <NUM> or the server <NUM> may perform the requested function or additional function, and may transfer a result of the performance to the electronic device <NUM>. The electronic device <NUM> may additionally process the received result to provide the requested function or service. To this end, for example, a cloud computing technology, a distributed computing technology, or a client-server computing technology may be used.

<FIG> is a block diagram illustrating an electronic device <NUM> according to various embodiments of the present disclosure. The electronic device <NUM> may form, for example, the whole or part of the electronic device <NUM> shown in <FIG>.

Referring to <FIG>, the electronic device <NUM> may include at least one processor or "AP" <NUM>, a communication module <NUM>, a subscriber identification module (SIM) card <NUM>, a memory <NUM>, a sensor module <NUM>, an input unit or input device <NUM>, a display or display module <NUM>, an interface <NUM>, an audio module <NUM>, a camera module <NUM>, a power management module <NUM>, a battery <NUM>, an indicator <NUM>, and a motor <NUM>. The processor <NUM> is capable of driving, for example, an operating system or an application program to control a plurality of hardware or software components connected to the processor <NUM>, processing various data, and performing operations. The processor <NUM> may be implemented as, for example, a system on chip (SoC). According to an embodiment, the processor <NUM> may further include a graphics processing unit (GPU) and/or an image signal processor.

The processor <NUM> may also include at least part of the components shown in <FIG>, e.g., a cellular module <NUM>. The processor <NUM> is capable of loading commands or data received from at least one of other components (e.g., a non-volatile memory) on a volatile memory, processing the loaded commands or data. The processor <NUM> is capable of storing various data in a non-volatile memory. The communication module <NUM> (e.g., the communication interface <NUM>) may perform a data communication with any other electronic device (e.g., the electronic device <NUM> or the server <NUM>) connected to the electronic device <NUM> (e.g., the electronic device <NUM>) through the network. According to an embodiment, the communication module <NUM> may include therein a cellular module <NUM>, a Wi-Fi module <NUM>, a BT module <NUM>, a GNSS or GPS module <NUM>, an NFC module <NUM>, and a radio frequency (RF) module <NUM>. The cellular module <NUM> is capable of providing a voice call, a video call, a short message service (SMS), an internet service, etc., through a communication network, for example. According to an embodiment, the cellular module <NUM> is capable of identifying and authenticating an electronic device <NUM> in a communication network by using a SIM <NUM> (e.g., a SIM card). According to an embodiment, the cellular module <NUM> is capable of performing at least part of the functions provided by the processor <NUM>. According to an embodiment, the cellular module <NUM> is also capable of including a communication processor (CP).

As illustrated in <FIG>, the Wi-Fi module <NUM>, the BT module <NUM>, the GNSS module <NUM>, and the NFC module <NUM> are each capable of including a processor for processing data transmitted or received through the corresponding module.

The NFC module <NUM> is capable of including a processor for processing data transmitted or received through the corresponding module. According to various embodiments, at least part of the cellular module <NUM>, Wi-Fi module <NUM>, BT module <NUM>, GNSS module <NUM>, NFC module <NUM>, and other modules, such as a MST module (e.g., two or more modules) may be included in one integrated chip (IC) or one IC package. The RF module <NUM> is capable of transmission/reception of communication signals, e.g., RF signals. The RF module <NUM> is capable of including a transceiver, a power amp module (PAM), a frequency filter, a low noise amplifier (LNA), an antenna, etc. According to an embodiment, at least one of the cellular module <NUM>, the Wi-Fi module <NUM>, the BT module <NUM>, the GNSS module <NUM>, and the NFC module <NUM> is capable of transmission/reception of RF signals through a separate RF module. The SIM module <NUM> is capable of including a card including a SIM and/or an embodied SIM. The SIM module <NUM> is also capable of containing unique identification information, e.g., integrated circuit card identifier (ICCID), or subscriber information, e.g., international mobile subscriber identity (IMSI).

As illustrated in <FIG>, memory <NUM> (e.g., memory <NUM> shown in <FIG>) is capable of including a built-in or internal memory <NUM> and/or an external memory <NUM>. The built-in or internal memory <NUM> is capable of including at least one of the following: a volatile memory, e.g., a dynamic random access memory (DRAM), a static RAM (SRAM), a synchronous dynamic RAM (SDRAM), etc.; and a non-volatile memory, e.g., a one-time programmable read only memory (OTPROM), a programmable ROM (PROM), an erasable and programmable ROM (EPROM), an electrically erasable and programmable ROM (EEPROM), a mask ROM, a flash ROM, a flash memory (e.g., an NAND flash memory, an NOR flash memory, etc.), a hard drive, a solid state drive (SSD), etc..

The sensor module <NUM> is capable of measuring/detecting a physical quantity or an operation state of the electronic device <NUM>, and converting the measured or detected information into an electronic signal. The sensor module <NUM> is capable of including at least one of the following: a gesture sensor 240A, a gyro sensor 240B, an atmospheric pressure or barometer sensor 240C, a magnetic sensor 240D, an acceleration sensor 240E, a grip sensor 240F, a proximity sensor <NUM>, a color or RGB sensor <NUM> (e.g., a red, green and blue (RGB) sensor), a biometric sensor 240I, a temperature/humidity sensor 240J, an illuminance sensor <NUM>, and an ultraviolet (UV) sensor <NUM>.

Additionally or alternatively, the sensor module <NUM> is capable of further including on or more of the following sensors or operations (not shown): an electronic nose (E-nose) sensor, an electromyography (EMG) sensor, an electroencephalogram (EEG) sensor, an electrocardiogram (ECG) sensor, an infrared (IR) sensor, an iris sensor and/or a fingerprint sensor. The sensor module <NUM> is capable of further including a control circuit for controlling one or more sensors included therein.

In various embodiments of the present disclosure, the electronic device <NUM> is capable of including a processor, configured as part of the processor <NUM> or a separate component, for controlling the sensor module <NUM>. In this case, while the processor <NUM> is operating in a sleep mode, the processor is capable of controlling the sensor module <NUM>. The input device <NUM> is capable of including a touch panel <NUM>, a (digital) pen sensor (digital pen or stylus) <NUM>, a key <NUM>, or an ultrasonic input unit or device <NUM>. The touch panel <NUM> may be implemented with at least one of the following: a capacitive touch system, a resistive touch system, an infrared touch system, and an ultrasonic touch system. The touch panel <NUM> may further include a control circuit. The touch panel <NUM> may also further include a tactile layer to provide a tactile response to the user. The (digital) pen sensor <NUM> may be implemented with a part of the touch panel or with a separate recognition sheet. The key <NUM> may include a physical button, an optical key, or a keypad. The ultrasonic input unit <NUM> is capable of detecting ultrasonic waves, created in an input tool, through a microphone <NUM>, and identifying data corresponding to the detected ultrasonic waves.

The display <NUM> (e.g., the display <NUM> shown in <FIG>) is capable of including a panel <NUM>, a hologram unit or device <NUM>, or a projector <NUM>. The panel <NUM> may include the same or similar configurations as the display <NUM> shown in <FIG>. The panel <NUM> may be implemented to be flexible, transparent, or wearable.

The panel <NUM> may also be incorporated into one module together with the touch panel <NUM>. The hologram unit <NUM> is capable of showing a stereoscopic image in the air by using light interference. The projector <NUM> is capable of displaying an image by projecting light onto a screen. The screen may be located inside or outside of the electronic device <NUM>. According to an embodiment, the display <NUM> may further include a control circuit for controlling the panel <NUM>, the hologram unit <NUM>, or the projector <NUM>.

The interface <NUM> is capable of including an HDMI <NUM>, a USB <NUM>, an optical interface <NUM>, or a D-subminiature (D-sub) <NUM>. The interface <NUM> may be included in the communication interface <NUM> shown in <FIG>. Additionally or alternatively, the interface <NUM> is capable of including a mobile high-definition link (MHL) interface, an SD card/MMC interface, or an infrared data association (IrDA) standard interface.

The audio module <NUM>, as illustrated in <FIG>, is capable of providing bidirectional conversion between a sound and an electronic signal. At least part of the components in the audio module <NUM> may be included in the input/output interface <NUM> shown in <FIG>. The audio module <NUM> is also capable of processing sound information input or output through a speaker <NUM>, a receiver <NUM>, earphones <NUM>, microphone <NUM>, etc..

The camera module <NUM> refers to a device capable of taking both still and moving images. According to an embodiment, the camera module <NUM> is capable of including one or more image sensors (e.g., a front image sensor or a rear image sensor), a lens, an image signal processor (ISP), a flash (e.g., an LED or xenon lamp), etc..

The power management module <NUM> is capable of managing power of the electronic device <NUM>. According to an embodiment, the power management module <NUM> is capable of including a power management IC (PMIC), a charger IC, or a battery or fuel gauge. The PMIC may employ wired charging and/or wireless charging methods. Examples of the wireless charging method are magnetic resonance charging, magnetic induction charging, and electromagnetic charging. To this end, the PIMC may further include an additional circuit for wireless charging, such as a coil loop, a resonance circuit, a rectifier, etc. The battery gauge is capable of measuring the residual capacity, charge in voltage, current, or temperature of the battery <NUM>. The battery <NUM> takes the form of either a rechargeable battery or a solar battery.

The indicator <NUM> is capable of displaying a specific status of the electronic device <NUM> or a part thereof (e.g., the processor <NUM>), e.g., a boot-up status, a message status, a charging status, etc. The motor <NUM> is capable of converting an electrical signal into mechanical vibrations, such as, a vibration effect, a haptic effect, etc. Although not shown, the electronic device <NUM> is capable of further including a processing unit (e.g., GPU) for supporting a mobile TV. The processing unit for supporting a mobile TV is capable of processing media data pursuant to standards, e.g., digital multimedia broadcasting (DMB), digital video broadcasting (DVB), or mediaFlo™, etc..

Each of the elements described in the present disclosure may be formed with one or more components, and the names of the corresponding elements may vary according to the type of the electronic device. In various embodiments, the electronic device may include at least one of the above described elements described in the present disclosure, and may exclude some of the elements or further include other additional elements. Further, some of the elements of the electronic device according to various embodiments may be coupled to form a single entity while performing the same functions as those of the corresponding elements before the coupling.

<FIG> is a block diagram illustrating a configuration of a programming module <NUM> according to various embodiments of the present disclosure.

The programming module <NUM> may be included (or stored) in the electronic device <NUM> (e.g., the memory <NUM>) illustrated in <FIG>, or may be included (or stored) in the electronic device <NUM> (e.g., the memory <NUM>) illustrated in <FIG>. At least a part of the programming module <NUM> may be implemented in software, firmware, hardware, or a combination of two or more thereof. The programming module <NUM> may be implemented in hardware (e.g., the hardware <NUM> of <FIG>), and may include an operating system (OS) controlling resources related to an electronic device (e.g., the electronic device <NUM>) and/or various applications (e.g., an application <NUM>) executed in the OS. For example, the OS may be Android, iOS, Windows, Symbian, Tizen, Bada, and the like.

Referring to <FIG>, the programming module <NUM> may include a kernel <NUM>, a middleware <NUM>, an API <NUM>, and/or the application <NUM>.

The kernel <NUM> (e.g., the kernel <NUM> in <FIG>) may include a system resource manager <NUM> and/or a device driver <NUM>. The system resource manager <NUM> may include, for example, a process manager (not illustrated), a memory manager (not illustrated), and a file system manager (not illustrated). The system resource manager <NUM> may perform the control, allocation, recovery, and/or the like of system resources. The device driver <NUM> may include, for example, a display driver (not illustrated), a camera driver (not illustrated), a BT driver (not illustrated), a shared memory driver (not illustrated), a USB driver (not illustrated), a keypad driver (not illustrated), a Wi-Fi driver (not illustrated), and/or an audio driver (not illustrated). Also, according to an embodiment of the present disclosure, the device driver <NUM> may include an inter-process communication (IPC) driver (not illustrated).

The middleware <NUM> may include multiple modules previously implemented so as to provide a function used in common by the applications <NUM>. Also, the middleware <NUM> may provide a function to the applications <NUM> through the API <NUM> in order to enable the applications <NUM> to efficiently use limited system resources within the electronic device. For example, as illustrated in <FIG>, the middleware <NUM> (e.g., the middleware <NUM>) may include at least one of a runtime library <NUM>, an application manager <NUM>, a window manager <NUM>, a multimedia manager <NUM>, a resource manager <NUM>, a power manager <NUM>, a database manager <NUM>, a package manager <NUM>, a connectivity or connection manager <NUM>, a notification manager <NUM>, a location manager <NUM>, a graphic manager <NUM>, a security manager <NUM>, and any other suitable and/or similar manager(s).

The runtime library <NUM> may include, for example, a library module used by a complier, in order to add a new function by using a programming language during the execution of the application(s) <NUM>. According to an embodiment of the present disclosure, the runtime library <NUM> may perform functions which are related to input and output, the management of a memory, an arithmetic function, and/or the like.

The application manager <NUM> may manage, for example, a life cycle of at least one of the applications <NUM>. The window manager <NUM> may manage graphical user interface (GUI) resources used on the screen. The multimedia manager <NUM> may detect a format used to reproduce various media files and may encode or decode a media file through a codec appropriate for the relevant format. The resource manager <NUM> may manage resources, such as a source code, a memory, a storage space, and/or the like of at least one of the applications <NUM>.

The power manager <NUM>, as illustrated in <FIG>, may operate together with a basic input/output system (BIOS), may manage a battery or power, and may provide power information and the like used for an operation. The database manager <NUM> may manage a database in such a manner as to enable the generation, search and/or change of the database to be used by at least one of the applications <NUM>. The package manager <NUM> may manage the installation and/or update of an application distributed in the form of a package file.

The connectivity or connection manager <NUM> may manage a wireless connectivity such as, for example, Wi-Fi and BT. The notification manager <NUM> may display or report, to the user, an event such as an arrival message, an appointment, a proximity alarm, and the like in such a manner as not to disturb the user. The location manager <NUM> may manage location information of the electronic device. The graphic manager <NUM> may manage a graphic effect, which is to be provided to the user, and/or a user interface related to the graphic effect. The security manager <NUM> may provide various security functions used for system security, user authentication, and the like. According to an embodiment of the present disclosure, when the electronic device (e.g., the electronic device <NUM>) has a telephone function, the middleware <NUM> may further include a telephony manager (not illustrated) for managing a voice telephony call function and/or a video telephony call function of the electronic device.

The middleware <NUM> may generate and use a new middleware module through various functional combinations of the above-described internal element modules. The middleware <NUM> may provide modules specialized according to types of OSs in order to provide differentiated functions. Also, the middleware <NUM> may dynamically delete some of the existing elements, or may add new elements. Accordingly, the middleware <NUM> may omit some of the elements described in the various embodiments of the present disclosure, may further include other elements, or may replace the some of the elements with elements, each of which performs a similar function and has a different name.

The API <NUM> (e.g., the API <NUM>) is a set of API programming functions, and may be provided with a different configuration according to an OS. In the case of Android or iOS, for example, one API set may be provided to each platform. In the case of Tizen, for example, two or more API sets may be provided to each platform.

The applications <NUM> (e.g., the applications <NUM>) may include, for example, a preloaded application and/or a third party application. The applications <NUM> (e.g., the applications <NUM>) may include, for example, a home application <NUM>, a dialer application <NUM>, a short message service (SMS)/multimedia message service (MMS) application <NUM>, an instant message (IM) application <NUM>, a browser application <NUM>, a camera application <NUM>, an alarm application <NUM>, a contact application <NUM>, a voice dial application <NUM>, an electronic mail (e-mail) application <NUM>, a calendar application <NUM>, a media player application <NUM>, an album application <NUM>, a clock application <NUM>, and any other suitable and/or similar application(s).

At least a part of the programming module <NUM> may be implemented by instructions stored in a non-transitory computer-readable storage medium. When the instructions are executed by one or more processors (e.g., the one or more processors <NUM>), the one or more processors may perform functions corresponding to the instructions. The non-transitory computer-readable storage medium may be, for example, the memory <NUM>. At least a part of the programming module <NUM> may be implemented (e.g., executed) by, for example, the one or more processors <NUM>. At least a part of the programming module <NUM> may include, for example, a module, a program, a routine, a set of instructions, and/or a process for performing one or more functions.

<FIG> is a front view illustrating an electronic device according to various example embodiments.

<FIG> illustrates a front surface of an electronic device <NUM> according to various example embodiments. The electronic device <NUM> may include a display <NUM>, housing <NUM>, optical sensor <NUM>, receiver <NUM>, camera <NUM>, and fingerprint sensor <NUM>. According to an example embodiment, the display <NUM> may be formed at an entire front surface of the electronic device <NUM>. Accordingly, the housing <NUM> may not be formed at the front surface of the electronic device <NUM>.

The display <NUM> may be extended to, for example, the side surface of the electronic device <NUM>. Further, according to an example embodiment, the display <NUM> may be formed in a portion of the front surface of the electronic device <NUM>. Accordingly, the housing <NUM> may be formed in the remaining portions of the front surface of the electronic device <NUM>.

The display <NUM> may be protected by cover glass <NUM> (see <FIG>). According to an example embodiment, the cover glass <NUM> may have a plurality of holes (or openings). For example, the cover glass <NUM> may include an optical sensor hole 430a, receiver hole 440a, camera hole 450a, and fingerprint sensor hole (or home button hole) 460a. The cover glass <NUM> may further include a light emitting diode (LED) hole <NUM> (see <FIG>). Further, the cover glass <NUM> may further include an opening, hole or an exsect portion (e.g., a 'cut out' portion <NUM>) (see <FIG>).

According to various example embodiments of the present disclosure, the optical sensor <NUM>, the receiver <NUM>, the camera <NUM>, and the fingerprint sensor <NUM> may be positioned at, for example, the low end of the housing <NUM> or the display <NUM>. According to various example embodiments of the present disclosure, the optical sensor <NUM>, the receiver <NUM>, the camera <NUM>, and the fingerprint sensor <NUM> may be included in, for example, the display <NUM>. The optical sensor <NUM> may include, for example, a proximity sensor, illumination sensor, iris sensor, or UV sensor.

According to an example embodiment, a position of the optical sensor <NUM>, the receiver <NUM>, the camera <NUM>, and the fingerprint sensor <NUM> is not limited to that of <FIG>. For example, the optical sensor <NUM> may be positioned at the low end of the electronic device <NUM>.

<FIG> is a rear view illustrating an electronic device according to various example embodiments.

<FIG> illustrates a rear surface and a side surface of an electronic device <NUM> according to various example embodiments. The electronic device <NUM> may include a housing <NUM>, bio sensor <NUM>, camera <NUM>, interface <NUM>, and speaker <NUM>.

According to an example embodiment, the housing <NUM> may be formed at a rear surface and a side surface of the electronic device <NUM>. According to an example embodiment, the bio sensor <NUM> and the camera <NUM> may be positioned at a rear surface of the electronic device <NUM>. According to an example embodiment, the interface <NUM> and the speaker <NUM> may be positioned at a side surface of the electronic device <NUM>. According to an example embodiment, a position of the bio sensor <NUM>, the camera <NUM>, the interface <NUM>, and the speaker <NUM> is not limited to that of <FIG>.

<FIG> is a perspective view and a set of <NUM> drawings illustrating an electronic device according to an example embodiment.

With reference to <FIG>, an electronic device <NUM> according to an example embodiment may include a housing <NUM>, cover glass <NUM>, display panel <NUM>, camera module <NUM>, receiver hole <NUM>, and home button <NUM>.

The housing <NUM> may include a first surface <NUM> facing in a first direction (front surface), a second surface <NUM> facing in a second direction (rear surface) opposite to the first direction, and a side surface <NUM> that encloses a space between the first surface <NUM> (or "front" surface) and the second surface <NUM> (or "rear" surface).

The cover glass <NUM> may protect a configuration such as the display panel <NUM> of the electronic device <NUM>. The cover glass <NUM> may correspond to at least a front surface of the electronic device <NUM>. For example, the cover glass <NUM> may occupy the entire front surface. The cover glass <NUM> may occupy a portion of the front surface and the side surface. The cover glass <NUM> may be formed in a plane or in a curved surface in which the upper end, the low end, the left side end and/or the right side end are bent. The cover glass <NUM> may be made of a transparent material. The cover glass <NUM> may be made of a material such as reinforced glass, plastic (e.g., polyethylene terephthalate (PET)), or aluminum oxide.

The display panel <NUM> may be disposed under the cover glass <NUM>. The display panel <NUM> may be bent such that the left side end, the right side end, the upper end and/or the low end form a curved surface and may to be disposed within the housing <NUM>.

The display panel <NUM> may be a full front display occupying most of the front surface of the electronic device. A disposition of other configurations may be changed by enlargement of the display panel <NUM>. For example, configurations such as the camera module <NUM> and a receiver (not shown) may be disposed at an outermost edge of the electronic device <NUM>.

The display panel <NUM> may include an active area <NUM> and an inactive area <NUM>. The active area <NUM> may be exposed through a transparent area of the cover glass <NUM>. The active area <NUM> may output light according to an electric signal supplied through a scan line and a data line. An aspect ratio of the active area <NUM> may be, for example, <NUM>:<NUM>. Further, an aspect ratio of the active area <NUM> may include <NUM>:<NUM>, <NUM>:<NUM>, <NUM>:<NUM>, <NUM>:<NUM>, <NUM>:<NUM>, or <NUM>:<NUM>.

According to an example embodiment, the active area <NUM> may occupy at least a portion of a front surface and a side surface. For example, the active area <NUM> may be disposed in a form that encloses the front surface and the side surface. The active area <NUM> of the electronic device <NUM> according to an example embodiment may be further adjacent to a side surface than a common active area.

A side portion of the active area <NUM> may perform a function of a soft key that can adjust a volume. A position of the soft key may be changed based on a user grip state or use history. The active area <NUM> may occupy most (e.g., about <NUM>% or more of a front area) of the front surface.

The inactive area <NUM> may be an area that encloses the active area <NUM>. The inactive area <NUM> of the electronic device <NUM> according to an example embodiment may be smaller than the inactive area <NUM> of the common electronic device <NUM>. At least a portion of the inactive area <NUM> may be exposed through the cover glass <NUM>.

The inactive area <NUM> may be, for example, a peripheral portion of the display panel <NUM> and may be an area covered by an opaque masking layer. The opaque masking layer may be formed by printing a layer in the cover glass <NUM>. A thickness ratio between the inactive area <NUM> of a horizontal direction and the inactive area <NUM> of a vertical direction may be, for example, <NUM>:<NUM>, <NUM>:<NUM>, or <NUM>:<NUM>. In another example, a thickness ratio between the inactive area <NUM> of the upper end, the inactive area <NUM> of the side end, and the inactive area <NUM> of the low end may be, for example, <NUM>:<NUM>:<NUM>.

The display panel <NUM> may include at least one opening portion (or opening) or at least one cut out portion. For example, the display panel <NUM> may include at least one opening portion <NUM> formed at an upper end portion of the active area <NUM>. The display panel <NUM> may be bent such that the opening portion <NUM> is positioned at a corner and may be disposed within the housing <NUM>.

As shown in <FIG>, when viewing from a front surface of the electronic device <NUM>, the opening portion <NUM> may form a U-shaped space. Various modules of the electronic device <NUM> may be exposed through a space formed by the opening portion <NUM>.

In this specification, a touch screen display may mean a module including a configuration such as a touch screen, cover glass and/or polarizing plate together with the display panel <NUM>.

The camera module <NUM> may be disposed at a position corresponding to at least one opening portion or at least one cut out portion. For example, the camera module <NUM> may be disposed at a space formed by at least one opening portion or at least one cut out portion. For example, the camera module <NUM> may be disposed at a space formed by the opening portion <NUM> formed at an upper end portion of the active area <NUM>. The camera module <NUM> may be exposed at the outside through the cover glass <NUM>. For example, the camera module <NUM> may be viewed at the outside through the cover glass <NUM> in a state disposed under the cover glass <NUM>. The camera module <NUM> may detect light applied from the outside through the cover glass <NUM> to acquire an image.

According to an example embodiment, the camera module <NUM> may be disposed to be exposed through the center of the upper end of the cover glass <NUM>.

According to an example embodiment, the camera module <NUM> may be disposed to be adjacent to the maximum at an outer edge of the front surface.

The receiver hole <NUM> may transfer a sound generated by a receiver disposed within the housing <NUM> to an exterior of the housing. The receiver hole <NUM> may be formed at the front surface <NUM> of the housing <NUM>. For example, the receiver hole <NUM> may be formed in a metal frame of the side surface <NUM>.

The front surface <NUM> of the housing <NUM> may be formed including or incorporating a single metal frame with the side surface <NUM> with a predetermined curvature. As shown in <FIG>, the electronic device <NUM> may include a plurality of receiver holes <NUM>. By forming the receiver hole <NUM> at the side surface <NUM>, a sound generated by the receiver may be transferred to an exterior without impacting configuration of the display panel <NUM> occupying the front surface <NUM> of the electronic device <NUM>. In <FIG>, the receiver hole <NUM> is formed at the front surface <NUM> of the housing <NUM>, but the present disclosure is not limited thereto and the receiver hole <NUM> may be formed at the side surface <NUM> of the housing <NUM>.

The home button <NUM> may be disposed at the low end of the front surface of the electronic device <NUM>. The home button <NUM> may be a physical key or a soft key. When the home button <NUM> is a physical key, for a disposition of the home button, the display panel <NUM> may include an opening portion (e.g., the same as an opening portion of the upper end) or a cut out portion formed at the low end of the active area <NUM>. The home button <NUM> may be disposed within a space formed by the opening portion <NUM> (e.g., or the cut out portion).

The home button <NUM> may be implemented as a 'soft' key (e.g., implemented by software) at the low end of the front surface <NUM> of the electronic device <NUM>. When the home button <NUM> is a soft key, a fingerprint sensor may be disposed under an area of the home button <NUM> of the display panel <NUM>. The cover glass <NUM> may include a recess portion formed at a position where the fingerprint sensor is disposed.

As described above, the electronic device <NUM> according to an example embodiment may include the display panel <NUM> exposed through the front surface <NUM> of the electronic device <NUM> and the camera module <NUM> positioned within the display panel <NUM>.

<FIG> is a front view illustrating an electronic device according to an example embodiment.

<FIG> illustrates a front surface of an electronic device <NUM> according to an example embodiment. In a display (e.g., a full front display) <NUM> of the electronic device <NUM>, a content (e.g., image) 750a is displayed. The display <NUM> may include an edge display enlarged to one side surface (or both side surfaces). For example, at a front surface of the electronic device <NUM>, at the upper end and/or the low end of the display <NUM>, the housing <NUM> may be exposed. At a front surface of the electronic device <NUM>, at the left side and/or the right side of the display <NUM>, the housing <NUM> may be exposed. According to various example embodiments of the present disclosure, at a front surface of the electronic device <NUM>, at the left side and/or the right side of the display <NUM>, the housing <NUM> may not be exposed.

The display <NUM> includes a main area <NUM> and an extension area <NUM>. The extension area <NUM> may include a first extension area 752a extended at an upper end portion of the main area <NUM> and a second extension area 752b extended at the low end of the main area <NUM>.

In the first extension area 752a, one or a plurality of holes or 'hole areas' (at least one of <NUM>, <NUM>, <NUM>, and <NUM>) may be positioned. According to various example embodiments of the present disclosure, in the second extension area 752b, one or a plurality of hole areas <NUM> may be positioned.

A size of the main area <NUM> may be greater than that of the extension area <NUM>. A size of the first extension area 752a may be the same as or different from that of the second extension area 752b. For example, a size of the second extension area 752b may be greater than that of the first extension area 752a.

The display <NUM> may include a main area <NUM> and a first extension area 752a. The display <NUM> may include a main area <NUM> and a second extension area 752b. Further, the display <NUM> may include the entire of the main area <NUM>, the first extension area 752a, and the second extension area 752b.

The main area <NUM> may include a first area 751a1 positioned at an upper end portion of the main area <NUM> and connected to the first extension area 752a. Further, the main area <NUM> may include a second area 751a2 positioned at the low end of the main area <NUM> and connected to the second extension area 752b of the low end. A size of the first area 751a1 may be the same as or different from that of the second area 751a2.

According to various example embodiments of the present disclosure, the first area 751a1 and/or the second area 751a2 may be an edge area of the main area <NUM>. The first area 751a1 and/or the second area 751a2 may correspond to an edge area of one side of an image (or a content).

According to various example embodiments of the present disclosure, in the display <NUM>, a size of the main area <NUM> may be, for example, <NUM> x <NUM> pixels. A size of the first extension area 752a may be <NUM> x <NUM> pixels. A size of the second extension area 752b may be <NUM> x <NUM> pixels. A size of the first area 751a1 may be <NUM> x <NUM> pixels. Further, a size of the second area 751a2 may be <NUM> x <NUM> pixels.

A size of the main area <NUM>, a size of the first extension area 752a, a size of the second extension area 752b, a size of the first area 751a1 and/or a size of the second area 751a2 are an example, and it may be easily understood to a person of ordinary skill in the art that the sizes each may be changed to correspond to an aspect ratio of the display <NUM>.

Analysis of the first area 751a1 or analysis of the second area 751a2 may mean analysis of an edge area positioned at one side of an image (or a content).

The processor <NUM> may analyze the first area 751a1 to enlarge and display the content 750a displayed in the main area <NUM> to the first extension area 752a. The processor <NUM> may analyze the second area 751a2 to enlarge and display the content 750a displayed in the main area <NUM> to the second extension area 752b.

The processor <NUM> may analyze the first area 751a1 and/or the second area 751a2 to enlarge and display the content 750a displayed in the main area <NUM> to the first extension area 752a and/or the second extension area 752b.

The first extension area 752a may be divided into an extension area 752a1 and an extension area 752a2. A size of the extension area 752a1 may be different from that of the extension area 752a2. A size of the extension area 752a1 may be determined by a position of a camera (or a camera hole) <NUM>. When the center (or optical axis) of the camera (or the camera hole) <NUM> is positioned at a position (e.g., adjacent to the main area) lower than a central point (e.g., a position of an intermediate pixel among pixels corresponding to a length of the first extension area) of the first extension area 752a, a size of the extension area 752a1 may be different from that of the extension area 752a2.

The second extension area 752b may be divided into an extension area 752b1 and an extension area 752b2. A size of the extension area 752b1 may be different from that of the extension area 752b2. A size of the extension area 752b1 may be determined by a position of a fingerprint sensor (or the home button) <NUM>. When the fingerprint sensor <NUM> is positioned at a position (e.g., adjacent to the main area) upper than a central point (e.g., a position of an intermediate pixel among pixels corresponding to a length of the second extension area) of the second extension area 752b, a size of the extension area 752b1 may be different from that of the extension area 752b2.

The processor <NUM> may analyze the first area 751a1 to enlarge and display the content 750a displayed in the main area <NUM> to the extension area 752a2. Further, the processor <NUM> may analyze the second area 751a2 to enlarge and display the content 750a displayed in the main area <NUM> to the extension area 752b2.

The content 750a may be displayed in the main area <NUM> of the display <NUM> by the processor <NUM>. The content 750a displayed in the main area <NUM> may be enlarged to the main area <NUM> and the first extension area 752a of the display <NUM> by the processor <NUM>. The content 750a displayed in the main area <NUM> may be enlarged to the main area <NUM> and the second extension area 752b of the display <NUM> by the processor <NUM>. The content 750a displayed in the main area <NUM> may be enlarged to the main area <NUM>, the first extension area 752a, and the second extension area 752b of the display <NUM> by the processor <NUM>.

The content 750a displayed in the main area <NUM> may be enlarged to the main area <NUM>, the first extension area 752a, and the extension area 752b2 of the display <NUM> by the processor <NUM>. Further, the content 750a displayed in the main area <NUM> may be enlarged to the main area <NUM>, the extension area 752a2, and the extension area 752b2 of the display <NUM> by the processor <NUM>.

In an example embodiment, a hole, opening, or cut out portion of the front surface may be referred to as a hole area. In an example embodiment, a hole, opening, or cut out portion of the side surface (e.g., a volume button or a power button) may be referred to as a hole area. In an example embodiment, a hole, opening, or cut out portion of the rear surface (e.g., camera, flashlight) may be referred to as a hole area.

An electronic device according to an example embodiment of the present disclosure includes a housing including a first surface facing in a first direction and a second surface facing in a second direction opposite to the first direction; a touch screen display disposed between the first surface and the second surface, exposed through the first surface, and having a main area and an extension area; a hole area positioned at the extension area; at least one processor electrically connected to the display; and a memory electrically connected to the processor, such that the memory stores at least one instruction executed by the processor upon executing a function, and the processor controls to analyze an edge area of a selected content, to enlarge the content by one of interference enlargement and/or non-interference enlargement according to an analysis result, and to display the content in the display area.

In an example embodiment, when an analysis result is interference enlargement, the processor may control to display the content in the main area and the extension area, and enlargement of the content may be limited by the hole area.

In an example embodiment, when an analysis result is non-interference enlargement, the processor may control to display the content in a partial area of the main area and the extension area.

In an example embodiment, the hole area may include one of a hole, opening, and cut out portion.

<FIG> is a flowchart illustrating a method of controlling an electronic device according to an example embodiment, and <FIG> are diagrams illustrating a method of controlling an electronic device according to an example embodiment.

At step <NUM> of <FIG>, the electronic device may select an image displayed by a user input.

With reference to <FIG>, in a display <NUM> of an electronic device <NUM>, an image (or thumbnail corresponding to an image) <NUM> is displayed. In the display <NUM> of the electronic device <NUM>, an image (or shortcut corresponding to an image) (which is not shown in <FIG>) is displayed. According to various example embodiments of the present disclosure, in the display <NUM> of the electronic device <NUM>, one or a plurality of images (or thumbnail corresponding to an image) <NUM>-<NUM> to <NUM>-<NUM> may be displayed through an application (e.g., via execution of a gallery or a photo application).

The application (e.g., a photo application) is an example and should be an application (e.g., web browser) that can display an image. The application for example may include a video player that displays an image or video.

The display <NUM> of the electronic device <NUM> according to an example embodiment may display an application screen, home screen, or lock screen including an image (or video).

With reference to <FIG>, in one image <NUM>-<NUM>, a first user input (e.g., touch or hovering) <NUM> is received.

The processor <NUM> may detect the first user input <NUM> using the panel <NUM>. The processor <NUM> may calculate a first user input position (e.g., X1 coordinate and Y1 coordinate) 990a corresponding to the first user input <NUM> using an electric signal received from the panel <NUM>.

According to various example embodiments, the processor <NUM> may store the first user input position 990a, a touch detection time (e.g., <NUM>:<NUM> AM) of the detected touch, and touch information corresponding to the touch at the memory <NUM>.

According to an example embodiment, in another image <NUM>-<NUM>, a second user input (e.g., touch or hovering) <NUM> may be received.

The processor <NUM> may detect the second user input <NUM> using the panel <NUM>. The processor <NUM> may calculate a second user input position (e.g., X1 coordinate and Y1 coordinate) 991a corresponding to the second user input <NUM> using an electric signal received from the panel <NUM>.

The processor <NUM> may store the second user input position 991a, a touch detection time (e.g., <NUM>:<NUM> AM) of the detected touch, and touch information corresponding to the touch at the memory <NUM>.

The first user input <NUM> and/or the second user input <NUM> contacting the display <NUM> may occur by one of fingers including a thumb or a touchable input pen (or stylus (not shown).

Referring to <FIG>, step <NUM>, the processor <NUM> may analyze an image. For example, image <NUM>-<NUM> corresponding to the second user input <NUM> and to display the image <NUM>-<NUM> in the display <NUM>. In an example embodiment, an image may include images <NUM>-<NUM> and <NUM>-<NUM>. In an example embodiment, an image may include images <NUM>-<NUM> to <NUM>-<NUM>. Further, in an example embodiment, an image may have a meaning including an image (already stored at the electronic device or capable of being downloaded at the electronic device).

With reference to <FIG>, the processor <NUM> analyzes an image <NUM>-<NUM> or <NUM>-<NUM> corresponding to a selected thumbnail. The processor <NUM> may analyze a first area 751a1 of an image corresponding to the selected thumbnail. The processor <NUM> may analyze a pixel count (e.g., <NUM> x <NUM> pixels) included in the first area 751a1. Further, the processor <NUM> may analyze one or more of the pixels (e.g., <NUM>, <NUM>, <NUM>, <NUM>, <NUM> pixels, <NUM>, <NUM>, <NUM> pixels, or a random pixel of <NUM> pixels) indicated by the pixel count (e.g., <NUM> x <NUM> pixels) included in the first area 751a1.

The processor <NUM> may analyze a color of each adjacent pixel. The processor <NUM> may analyze a chroma of adjacent each pixel. According to various example embodiments of the present disclosure, the processor <NUM> may analyze a texture of adjacent each pixel. That is, the processor <NUM> may analyze a value of a color, chroma, or texture of each pixel. Specific algorithms corresponding to such pixel analysis is well-known technology; therefore, a detailed description thereof may be omitted.

When the difference between colors, chromas or textures of each pixel matches a particular threshold (e.g., <NUM> %, may be changed) or less, the processor <NUM> may select execution of enlargement of the image to encompass the first extension area 752a. Further, when the difference between colors, chromas, or textures of each pixel exceeds a predetermined threshold (e.g., <NUM> %), the processor <NUM> may determine that an image cannot be enlarged to the first extension area 752a.

The processor <NUM> may determine enlargement (e.g., enlargement of a background color) of an image to the first extension area 752a through analysis of the first area 751a1.

The processor <NUM> may analyze a second area 751a2 of an image corresponding to a selected thumbnail. The processor <NUM> may analyze a pixel (e.g., <NUM> x <NUM> pixels) included in the second area 751a2.

Analysis of the second area 751a2 through the processor <NUM> is substantially similar to that of the first area 751a1 through the processor <NUM>; therefore, a detailed description thereof may be omitted.

The processor <NUM> may analyze a value of a color, chroma, or texture of each pixel included in the second area 751a2. When the difference between colors chromas, or textures of each pixel is a threshold (e.g., <NUM>) or less, the processor <NUM> may determine enlargement of an image to the second extension area 752b. Further, when the difference between colors, chromas, or textures of each pixel exceeds a threshold (e.g., <NUM> %, may be changed), the processor <NUM> may determine that an image cannot be enlarged to the second extension area 752b.

The processor <NUM> may determine that an image cannot be enlarged to the second extension area 752b through analysis (e.g., comparison against a predetermined threshold variance) of the second area 751a2. In such a case, the processor <NUM> may additionally determine enlargement of an image to the area 752b2. For example, when the difference between colors, chromas, or textures of each pixel in the second area 751a2 is (in one embodiment) <NUM>% or less, the processor <NUM> may determine enlargement of an image to the area 752b2.

The processor <NUM> may sequentially perform analysis of the first area 751a1 and analysis of the second area 751a2 or may perform analysis of the first area 751a1 and analysis of the second area 751a2 in reverse order.

At step <NUM> of <FIG>, the processor may determine whether to enlarge the image using an 'interference enlargement' process.

That is, the processor <NUM> may determine whether to enlarge interference of an image. The processor <NUM> may determine whether to enlarge an image to at least one area of the first extension area 752a and the second extension area 752b according to an analysis result (e.g., threshold or less).

In an example embodiment, enlargement of an image may include image interference enlargement and image non-interference enlargement. Image interference enlargement may mean enlargement of an image to at least one area of the first extension area 752a and the second extension area 752b through analysis (e.g., a threshold or less) of the first area 751a1 or analysis (e.g., a threshold or less) of the second area 751a2. Enlargement of an image may include extension of an image.

"Interference enlargement" of an image may mean an image enlargement limit (or an image display limit in a partial area or a hole area) due interference (e.g., partial area or hole area) of the image enlargement by a hole, opening, or cut out portion of the front surface of the device. Further, image interference enlargement may mean interference (e.g., an image enlargement limit or an image display limit in a partial area) of image enlargement by a constituent element (e.g., sensor, receiver, camera, home button, or fingerprint sensor) corresponding to the hole, opening, or cut out portion of the front surface.

"Image non-interference" enlargement may mean non-interference (e.g., enlargement to a periphery of the hole, opening, or cut out portion of the front surface) of image enlargement by the hole, opening, or cut out portion of the front surface, such that the hole does not interfere with the display of the image. Further, image interference enlargement may mean non-interference of image enlargement by a constituent element (e.g., sensor, receiver, camera, home button, or fingerprint sensor) corresponding to the hole, opening, or cut out portion of the front surface.

Image non-interference enlargement may mean enlargement of an image to at least one area of the area 752a2 and the extension area 752b2 through analysis (e.g., more than a threshold) of the first area 751a1 or analysis (e.g., more than a threshold) of the second area 751a2.

When both the first area 751a1 and the second area 751a2 are a threshold or less according to an analysis result, the processor <NUM> may determine image interference enlargement. When one of the first area 751a1 and the second area 751a2 is a threshold or less according to an analysis result, the processor <NUM> may determine image interference enlargement. Further, when both the first area 751a1 and the second area 751a2 exceed a threshold according to an analysis result, the processor <NUM> may determine image non-interference enlargement.

According to determination of image interference enlargement, the processor <NUM> may enlarge an image to one of enlargement of the main area <NUM> and the first extension area 752a, enlargement of the main area <NUM> and the second extension area 752b, and enlargement of the main area <NUM>, the first extension area 752a, and the second extension area 752b.

Returning to step <NUM> of <FIG>, if the processor determines to utilize 'image interference' enlargement, the process continues at step <NUM>. At step <NUM>, if image interference is not enlarged (e.g., image non-interference enlargement), the process continues at step <NUM>.

At step <NUM>, the processor <NUM> may determine whether to enlarge an entire image using "image entire enlargement" or "image partial enlargement.

That is, when "image interference" is selected for enlarging an image, the processor <NUM> may determine to utilize one of image entire enlargement and image partial enlargement according to an analysis result.

"Image entire enlargement" may mean enlargement of an image to an entire area (including the main area <NUM>, the first extension area 752a, and the second extension area 752b) of the display. Further, an entire area of the display may be referred to as an interference area of the display.

"Image partial enlargement" may mean enlargement of an image to a partial area (the main area <NUM> and the first extension area 752a or the first extension area 752a and the second extension area 752b) of the display. Further, a partial area of the display may be referred to as a non-interference area of the display.

At step <NUM> of <FIG>, if an entire image is enlarged, the process continues at step <NUM>. At step <NUM>, if an entire image is not enlarged (e.g., image partial enlargement), the process continues at step <NUM>.

At step <NUM>, an enlarged image is displayed on an entire screen.

With reference to <FIG>, the processor <NUM> may control to enlarge and display an image (e.g., <NUM>-<NUM>) on an entire screen. The processor <NUM> may control to enlarge and display an image <NUM>-<NUM> on an entire screen according to an analysis result. The entire screen is an area including the main area <NUM>, the first extension area 752a, and the second extension area 752b. A size of the entire screen may be <NUM> x <NUM> pixels.

A size of the entire screen may be may be changed according to a screen size and/or an aspect ratio of the electronic device <NUM>.

In an example embodiment, a screen of an application as well as an image may be displayed on the entire screen.

With reference to <FIG>, an application screen (e.g., a communication application screen <NUM>) may be displayed on entire screens <NUM>, 752a, and 752b.

Before analyzing a first area and a second area, the processor <NUM> may control to display a communication application screen <NUM> in the main area <NUM>. When setup (e.g., one of interference enlargement and non-interference enlargement) does not exist, the processor <NUM> may control to display the communication application screen <NUM> in the main area <NUM>.

The processor <NUM> may analyze a first area and a second area of the communication application screen <NUM> to determine one of interference enlargement and non-interference enlargement in the communication application screen <NUM>. The processor <NUM> may enlarge interference of the communication application screen <NUM> according to an analysis result (e.g., threshold or less). The processor <NUM> may control to enlarge and display the communication application screen <NUM> to an entire screen according to an analysis result (e.g., threshold or less).

The application (e.g., a communication application) is an example and the present disclosure is not limited thereto and may be an application (e.g., music application, moving picture application) already installed in the electronic device <NUM> or an application that may be downloaded and installed in the electronic device <NUM>.

<FIG> and <FIG> illustrate an example of an image enlarged on an entire screen.

<FIG> illustrates, for example, a lock screen. In the lock screen, an image 957a may be enlarged and displayed on entire screens <NUM>, 952a, and 952b. The processor <NUM> may control to enlarge and display the image 957a on the entire screens <NUM>, 952a, and 952b according to an analysis result (e.g., threshold or less).

<FIG> illustrates, for example, a home screen. In the home screen, an image 957b may be enlarged and displayed on entire screens <NUM>, 952a, and 952b. The processor <NUM> may control to enlarge and display the image 957b on the entire screens <NUM>, 952a, and 952b according to an analysis result (e.g., threshold or less). The processor <NUM> may enable a shortcut and a tray 957t displayed behind the shortcut to be positioned on a home screen without interference by a hole, opening, or cut out portion of the front surface.

The tray 957t may have transparency (e.g., <NUM> - <NUM>%, may be changed by setup). Further, the tray 987t may be displayed with a color distinguished from the shortcut and the enlarged image 957b.

At step <NUM> of <FIG>, when an enlarged image is displayed on an entire screen, a process of a method of controlling a hole area of an electronic device is terminated.

At step <NUM>, if an entire image is not enlarged (e.g., image partial enlargement), the process continues at step <NUM>.

At step <NUM>, a partially enlarged image is displayed on the entire screen.

With reference to <FIG>, the processor <NUM> may control to enlarge and display an image (e.g., <NUM>-<NUM>) in a partial area of the entire screen. The processor <NUM> may control to enlarge and display the image <NUM>-<NUM> in a partial area of the entire screen according to an analysis result. The partial area of the entire screen may mean the main area <NUM> and the first extension area 752a or the main area <NUM> and the second extension area 752b. A size of the partial area of the entire screen may be <NUM> x <NUM> pixels.

In an example embodiment, an added partial area of the entire screen may further include one of the extension area 752a2 and the extension area 725b2. The processor <NUM> may control to enlarge and display the image (e.g., <NUM>-<NUM>) in an added partial area of the entire screen.

The added partial area of the entire screen may include the main area <NUM>, the first extension area 752a, and the extension area 752b2. Further, the added partial area of the entire screen may include the main area <NUM>, the second extension area 752b, and the extension area 752a2. A size of the partial area of the entire screen according to an example embodiment may be <NUM> x <NUM> pixels.

A size of a partial area of the entire screen may be changed according to a screen size and/or an aspect ratio of the electronic device <NUM>. Further, a size of the added partial area of the entire screen may be changed according to a screen size and/or an aspect ratio of the electronic device <NUM>.

At step <NUM> of <FIG>, when an enlarged image is displayed in a partial area (or an added partial area of the entire screen) of the entire screen, a process of a method of controlling a hole area of an electronic device is terminated.

At step <NUM>, if "image interference" enlargement is not utilized (e.g., image non-interference enlargement), the process continues at step <NUM>.

At step <NUM>, enlargement of the image using "non-interference" enlargement is determined.

The processor <NUM> may determine whether to enlarge image non-interference. Enlargement of the image using "non-interference" may mean enlargement of the image (e.g., <NUM>-<NUM>) to the area 752a2 and the extension area 752b2 through analysis (e.g., more than a threshold) of the first area 751a1 or analysis (e.g., more than a threshold) of the second area 751a2.

When both the first area 751a1 and the second area 751a2 of the image (e.g., <NUM>-<NUM>) are more than a threshold according to an analysis result, the processor <NUM> may determine whether to enlarge image non-interference.

The processor <NUM> may enlarge an image (e.g., <NUM>-<NUM>) to the main area <NUM>, the area 752a2, and the extension area 752b2 according to enlargement determination of image non-interference.

At step <NUM> of <FIG>, if image "non-interference" enlargement is determined to be utilized, the process continues at step <NUM>. If image "non-interference" enlargement is not utilized at step <NUM>, the process continues at step <NUM>.

At step <NUM>, an image in which "non-interference" enlargement is applied is displayed on the entire screen.

With reference to <FIG>, the processor <NUM> may control to enlarge and display an image (e.g., <NUM>-<NUM>) in a partial area (e.g., non-interference areas <NUM>, 952a2, 952b2 of the entire screen. The processor <NUM> may enlarge and display the image <NUM>-<NUM> in the non-interference areas <NUM>, 952a2, and 952b2 of the entire screen according to an analysis result. The non-interference area of the entire screen may mean the main area <NUM> and the first extension area 752a or the main area <NUM> and the second extension area 752b. A size of the non-interference area of the entire screen may be <NUM> x <NUM> pixels. A size of the non-interference area may be <NUM>% of that of the entire screen.

A size of the non-interference area of the entire screen may be changed according to a screen size and/or an aspect ratio of the electronic device <NUM>. Further, a size of the non-interference area of the entire screen may be changed according to a position and/or a size of a hole, opening, or cut out portion of a screen of the electronic device <NUM>.

At step <NUM> of <FIG>, when an enlarged image is displayed in a non-interference area of the entire screen, a process of a method of controlling a hole area of an electronic device is terminated.

At step <NUM>, if non-interference enlargement is not utilized, the process continues at step <NUM>.

At step <NUM>, an image is displayed in a main area.

When interference enlargement and non-interference enlargement is not applied (or when interference enlargement and non-interference enlargement is not set) to an image, the processor <NUM> may control to display the image (e.g., <NUM>-<NUM>) in the main area <NUM>. A size of the main area of the entire screen may be <NUM> x <NUM> pixels. A size of the main area may be <NUM>% of that of the entire screen.

In an example embodiment, in an executing moving picture application, a subtitle <NUM> may be displayed in the extension areas 752a and 752b. Further, a text (or subtitle) may be displayed at one side (e.g., the extension areas 752a and 752b) of the application screen displayed in the main area <NUM>.

With reference to <FIG>, a moving picture application screen <NUM> may be displayed on entire screens <NUM>, 952a, and 952b. Further, a moving picture application screen <NUM> may be displayed in the main area <NUM>.

Before analyzing the first area and the second area, the processor <NUM> may control to display the moving picture application screen <NUM> in the main area <NUM>. When setup (e.g., one of interference enlargement and non-interference enlargement) does not exist, the processor <NUM> may control to display the moving picture application screen <NUM> in the main area <NUM>.

The processor <NUM> may analyze the first area and the second area of the moving picture application screen <NUM> and determine use of interference enlargement and non-interference enlargement of the moving picture application screen <NUM>. The processor <NUM> may enlarge interference of the moving picture application screen <NUM> according to an analysis result (e.g., threshold or less). The processor <NUM> may enlarge and display the moving picture application screen <NUM> on an entire screen according to an analysis result (e.g., threshold or less).

The processor <NUM> may control to display the moving picture application screen <NUM> in the main area <NUM> according to an analysis result (e.g., more than a threshold). Further, the processor <NUM> may control to display the moving picture application screen <NUM> in the main area <NUM> and the extension area 752b2 according to an analysis result (e.g., more than a threshold).

The moving picture application screen <NUM> may include a moving picture display area 954a and a text providing area (or a subtitle area) 954b. The moving picture display area 954a may be the main area <NUM>. The moving picture display area 954a may include a portion of the main area <NUM> and the first extension area 752a. The moving picture display area 954a may include a portion of the main area <NUM> and the second extension area 752b. Further, the moving picture display area 954a may include the main area <NUM>, a portion of the first extension area 752a, and a portion of the second extension area 752b.

The text providing area 954b may be one or the plural. The text providing area 954b may include a portion or the entire of the first extension area 752a. The text providing area 954b may include a portion or the entire of the second extension area 752b. Further, the text providing area 954b may include a portion of the first extension area 752a and a portion or the entire of the second extension area 752b.

In an example embodiment, the processor <NUM> may control to display a moving picture in the moving picture display area (or main area) 954a and to display the subtitle <NUM> in the text providing area (or a portion of the extension area) 954b.

In the text providing area 954b, a background of the subtitle <NUM> may be black, white, or gray. Further, in the text providing area 954b, a background of the subtitle <NUM> may be a background of a single color or a background of a plurality of colors. In the text providing area 954b, a color of the subtitle <NUM> should be distinguished from the background.

A direction (or flow) of the subtitle <NUM> may be determined to correspond to a direction of the electronic device <NUM>. For example, when a direction of the electronic device <NUM> is landscape, a direction of the subtitle <NUM> may be portrait. Further, when a direction of the electronic device <NUM> is portrait, a direction of the subtitle <NUM> may be landscape.

In the text providing area 954b, the subtitle <NUM> may be displayed in a partial area (e.g., the extension area 752b2 that is not interfered by a hole, opening, or cut out portion). In the text providing area 954b, the subtitle <NUM> may be displayed in a partial area (e.g., the extension area 752a2 or the extension area 752b2).

In an example embodiment, a text (e.g., alarm (or notification)) 955t may be displayed at one side (e.g., the extension areas 752a and 752b) of an application screen displayed in the main area <NUM>.

With reference to <FIG>, the main area <NUM> may be displayed on an executed application screen (e.g., web browser) <NUM>.

The processor <NUM> may analyze a first area and a second area of the application screen <NUM> to determine one of interference enlargement and non-interference enlargement of the application screen <NUM>.

The processor <NUM> may control to display the application screen <NUM> in the main area <NUM> according to an analysis result (e.g., more than a threshold).

Separately from the application screen, the text 955t corresponding to alarm (or notification) may be displayed in the extension area 752a or 752b. The processor <NUM> may control to display the text 955t corresponding to alarm (or notification) in the extension area 752a or 752b.

When displaying the text 955t in the extension area 752a or 752b, the processor <NUM> may gradually move (e.g., a direction of an arrow 955a) the text 955t corresponding to alarm (or notification). When displaying the text 955t in the extension area 752a or 752b, the processor <NUM> may control to display the text 955t corresponding to alarm (or notification) to avoid (e.g., non-interference) a position of a hole, opening, or cut out portion. Further, when displaying the text 955t in the extension area 752a or 752b, the processor <NUM> may gradually move (e.g., a direction of the arrow 955a) the text 955t corresponding to alarm (or notification) to avoid (e.g., non-interference) a position of a hole, opening, or cut out portion.

In an example embodiment, at one side (e.g., the extension areas 752a and 752b) of an application screen displayed in the main area <NUM>, an image (or symbol, icon) 956i may be displayed.

With reference to <FIG>, the executed application screen (e.g., web browser) <NUM> may be displayed in the main area <NUM>. The processor <NUM> may analyze a first area and a second area of an application screen <NUM> and determine one of interference enlargement and non-interference enlargement of the application screen <NUM>. The processor <NUM> may control to display the application screen <NUM> in the main area <NUM> according to an analysis result (e.g., more than a threshold).

Separately from the application screen, at a position of the hole, opening, or cut out portion of the extension area 752a or 752b, an image 956i corresponding to masking may be displayed. The processor <NUM> may control to display the image 956i corresponding to masking in at least one of the first extension area 752a and the second extension area 752b at a position of the opening or the cut out portion. The image 956i is an example of an image corresponding to the camera (or camera hole) <NUM>. A size of the image 956i may be greater than that of the camera (or camera hole) <NUM>. Further, the image 956i should have a size to cover the camera (or camera hole) <NUM>.

It may be easily understood to a person of ordinary skill in the art that various images corresponding to positions <NUM> to <NUM> or <NUM> of the hole, opening, or cut out portion of <FIG> as well as the foregoing image exist.

At step <NUM> of <FIG>, when an image is displayed in a main area of the entire screen, a process of a method of controlling a hole area of an electronic device is terminated.

At step <NUM> of <FIG>, a touch input is detected on a screen.

With reference to <FIG> and <FIG>, in the display <NUM> of the electronic device <NUM>, a user input (e.g., touch or hovering) <NUM> is received. The user input <NUM> may be detected as a first extension area 952a of the display <NUM> of the electronic device <NUM>. Further, the user input <NUM> may be detected in the first extension area 952a continued from the main area <NUM> in which an application (e.g., a photo application) is displayed.

With reference to <FIG>, the user input <NUM> may be received in an outer edge area <NUM> of a first hole (camera, or camera hole) <NUM>. The first hole <NUM> may correspond to an opening or cut out portions <NUM> to <NUM> or <NUM>. For example, when the first hole is a camera (or a camera hole), a second hole may correspond to an optical sensor.

In <FIG>, a gap d1 between the outer edge area <NUM> and the first hole (camera or camera hole) <NUM> may be <NUM>. Further, a gap d1 between the outer edge area <NUM> and the first hole (camera or camera hole) <NUM> may be <NUM>≤ d1 ≤ <NUM>. The gap d1 is an example and may be changed.

In <FIG>, a gap d2 between the first outer edge area <NUM> and the first hole (camera or camera hole) <NUM> may be <NUM>. A gap d3 between the first outer edge area <NUM> and the second outer edge area <NUM> may be <NUM>. A gap d2 between the first outer edge area <NUM> and the first hole (camera or camera hole) <NUM> may be <NUM> ≤ d1 ≤ <NUM>. Further, a gap d3 between the first outer edge area <NUM> and the second outer edge area <NUM> may be <NUM> ≤ d1 ≤ <NUM>. A precisely used input may be detected by the first outer edge area <NUM> and the second outer edge area <NUM>. The gaps d2 and d3 are an example and may be changed.

The application (e.g., photo application) is an example and should be an application (e.g., web browser) that may be executed or installed in the electronic device <NUM>.

The processor <NUM> may detect the user input <NUM> using the panel <NUM>. The processor <NUM> may calculate a user input position (e.g., X11 coordinate and Y11 coordinate) 992a corresponding to the user input <NUM> using an electric signal received from the panel <NUM>.

The processor <NUM> may store the user input position 990a, a touch detection time (e.g., <NUM>:<NUM> AM) of a detected touch, and touch information corresponding to the touch at the memory <NUM>.

At step <NUM> of <FIG>, a direction of a continuous movement of the touch input is detected.

With reference to <FIG>, a continuous movement of a user input (e.g., touch or hovering) <NUM> is received in the display <NUM> of the electronic device <NUM>.

The processor <NUM> may detect continuous movement (e.g., a plurality of X coordinates and Y coordinates corresponding to a continuous touch) of the user input <NUM> using the panel <NUM>. The processor <NUM> may calculate continuous movement positions (e.g., a plurality of X coordinates and a plurality of Y coordinates) 992a and 992b of an user input corresponding to the user input <NUM> using an electric signal received from the panel <NUM>.

At the first outer edge area <NUM>, a continuous movement (e.g., a movement from an initial position 992a to a final position 992b) of the user input <NUM> may indicate a touch gesture input to the display <NUM>. At the first outer edge area <NUM>, a continuous movement (e.g., a movement from the initial position 992a to the camera (or the camera hole) <NUM>) of the user input <NUM> may mean a touch gesture input to the display <NUM>. At the first outer edge area <NUM>, a continuous movement (e.g., a movement from the initial position 992a to the outer edge area <NUM> via the camera (or the camera hole) <NUM>) of the user input <NUM> may mean a touch gesture input to the display <NUM>. Further, in the first outer edge area <NUM>, a continuous movement (e.g., a movement from the initial position 992a to the first outer edge area <NUM> via the camera (or the camera hole) <NUM>) of the user input <NUM> may mean a touch gesture input to the display <NUM>.

A touch gesture of the display <NUM> may include swipe, drag, or flick using the position 992a of the user input <NUM> as an initial position.

The processor <NUM> may determine a direction of a continuous movement of the user input using a continuous movement position of a stored user input. In <FIG>, the processor <NUM> may determine a direction of a continuous movement of the user input to a direction of the first hole <NUM>.

At step <NUM> of <FIG>, the processor <NUM> may detect that the touch input has moved to a position corresponding to the first hole <NUM>.

With reference to <FIG>, a continuous movement of the user input arrives at the first hole <NUM>. Further, a continuous movement of the user input may pass through the first hole <NUM>. The processor <NUM> may determine that a continuous movement of the user input arrives at the first hole <NUM> using a continuous movement position of a stored user input.

At step <NUM> of <FIG>, a function corresponding to arrival at the first hole may be executed (e.g., responsive to the arrival of the touch input at the corresponding location).

With reference to <FIG>, the processor <NUM> may execute a quick panel when detecting arrival of the continuous movement of the user input at the first hole <NUM>. However, it is noted the processor <NUM> may be configured to perform any function (e.g., call of the quick panel <NUM>) in response to detecting arrival of a continuous movement of the user input at the first hole <NUM>. The processor <NUM> may perform a function (e.g., execution of a preset panel which is not shown) in response to detecting arrival of a continuous movement of the eleventh user input at the first hole <NUM>. Execution of the quick panel <NUM> may include a execution of a preset panel (which is not shown).

The processor <NUM> may further perform a function responsive to arrival of a continuous movement of the user input at any hole (e.g., an "n-th" hole). The processor <NUM> may perform a preset function at the n-th hole responsive to arrival of a continuous movement of the user input at the n-th hole.

For example, when a second hole <NUM> is a camera or a camera hole, the processor <NUM> may perform a screenshot function or camera function responsive to arrival of a continuous movement of the user input at the second hole <NUM>. When a third hole <NUM> is a receiver or a receiver hole, the processor <NUM> may perform voice recording or "S voice" accessibility (e.g., vocal recognition based data retrieval or execution) responsive to arrival of a continuous movement of the user input at the third hole <NUM>. Further, when a fourth hole <NUM> is a fingerprint sensor (or a home button) hole, the processor <NUM> may perform one function of fingerprint recognition and Samsung pay to correspond to arrival of a continuous movement of the user input at the fourth hole <NUM>.

In an example embodiment, a function corresponding to the n-th hole may be implemented with reception of the user input at the n-th hole as well as arrival of a continuous movement of the user input at the n-th hole.

In an outer edge area <NUM>, a first outer edge area <NUM>, and a second outer edge area <NUM> of the n-th hole implemented as shown in <FIG>, when the user input is detected, the processor <NUM> may perform a function corresponding to the n-th hole.

In an example embodiment, an application screen (e.g., web browser) is displayed on entire screens <NUM>, 752a, and 752b.

With reference to <FIG>, at the upper end (e.g., including a portion of the first extension area 752a) of the screen, head-up notification <NUM> may be displayed. Further, in a main area of the screen, the head-up notification <NUM> may be displayed.

The processor <NUM> may perform a function responsive to arrival of a continuous movement of a user input at the hole. The hole may be, for example, the receiver hole <NUM>, the camera hole <NUM>, and the fingerprint sensor hole <NUM>. The hole may further include an optical sensor hole <NUM>. Further, the hole may include a front hole or a rear hole (e.g., rear camera hole, LED hole) of the electronic device <NUM>.

The user input <NUM> is generated at the head-up notification <NUM> by the user. The user may input a continuous movement from an initial position 993a to a final position (e.g., 993b, 993c, or 993d).

The processor <NUM> may perform a function responsive to arrival of a continuous movement (e.g., from the initial position 993a to the final position (e.g., 993b, 993c or 993d of the detected user input <NUM>.

When the user input <NUM> arrives at the hole, the operations are substantially similar (e.g., the difference between user inputs) to arrival of a continuous movement of the user input at the first hole; therefore, a detailed description thereof will be omitted.

A function corresponding to arrival of a continuous movement of the user input <NUM> at the hole in the head-up notification <NUM> may include holding of head-up notification (from the initial position 993a to the final position 993b), deletion of head-up notification (from the initial position 993a to the final position 993c), or storage of head-up notification (from the initial position 993a to the final position 993d). The function is understood to be merely an example and describes an example function provided from the electronic device <NUM>.

In an example embodiment, visual feedback 995a to 995f are provided, corresponding to a continuous movement (or a user input) of a user input.

With reference to <FIG>, the processor <NUM> may provide visual feedback 995a to 995c corresponding to a continuous movement of the received user input.

The visual feedback 995a to 995c may be displayed corresponding to a direction or a trajectory of a continuous movement of a user input. The visual feedback 995a to 995c may be displayed using a shape (e.g., circle, oval) of a hole corresponding to an initial position of a received user input. Further, the visual feedback 995a to 995c may be displayed to correspond to a direction or a trajectory of a continuous movement of a user input, using for example, a color and brightness added to a shape (e.g., circle, oval) of a hole corresponding to an initial position of a received user input.

With reference to <FIG>, the processor <NUM> may provide visual feedback 995e to 995f corresponding to a received user input.

The visual feedback 995e to 995f may be displayed to correspond to a position of the received user input. The visual feedback 995e to 995f may be displayed using a shape (e.g., circle, oval) of a hole corresponding to a position of the received user input. Further, the visual feedback 995e to 995f may be displayed to gradually enlarge using a color and brightness added to a shape (e.g., circle, oval) of a hole corresponding to an initial position of the received user input.

At step <NUM> of <FIG>, when a function is executed responsive to detecting arrival of the user input at the first hole, a process of a method of controlling a hole area of an electronic device is terminated.

A method of controlling a hole area of an electronic device having at least one hole area in a display according to an example embodiment of the present disclosure includes operations of selecting a displayed content; determining one of interference enlargement and non-interference enlargement through edge analysis of the content; and enlarging the content by one of the interference enlargement and the non-interference enlargement, such that the hole area is formed by one of a camera, receiver, optical sensor, and home button.

In an example embodiment, the display may include a main area and an extension area, and the hole area may be positioned at the extension area.

In an example embodiment, the extension area may be distinguished into a first extension area positioned at an upper end portion of the main area and a second extension area positioned at a lower end portion of the main area.

In an example embodiment, the first extension area may be distinguished into an extension area in which one hole area of the hole areas is positioned and a extension area positioned at a low end portion of the extension area.

In an example embodiment, the second extension area may be distinguished into an extension area in which another one hole area of the hole areas is positioned and an extension area positioned at an upper end portion of the extension area.

In an example embodiment, the main area may be distinguished into a first area connected to the first extension area and a second area connected to the second extension area, and edge analysis of the content may include edge analysis of the content corresponding to the first area and edge analysis of the content corresponding to the second area.

In an example embodiment, the interference enlargement may be enlargement that limits enlargement of the content by the hole area, and the non-interference enlargement may be enlargement that does not limit enlargement of the content by the hole area.

In an example embodiment, the interference enlargement may be to enlarge and display the content in an interference area of the display, and the interference area of the display may include the main area and the extension area.

In an example embodiment, the interference enlargement may limit the display of a partial area of the content enlarged by the hole area.

In an example embodiment, the non-interference enlargement may be to enlarge and display the content in a non-interference area of the display, and the non-interference area of the display may include the main area and a partial area of the extension area.

In an example embodiment, an area of the first extension area and an area of the second extension area may be different.

In an example embodiment, an area of the extension area and an area of the extension area may be different.

In an example embodiment, an area of the extension area may be greater than that of one area of the first area and the second area.

In an example embodiment, one hole area may be positioned in the first extension area to correspond to the camera.

The term "module" used in the present disclosure may refer to, for example, a unit including one or more combinations of hardware, software, and firmware. The "module" may be interchangeable with a term, such as "unit," "logic," "logical block," "component," "circuit," or the like. The "module" may be a minimum unit of a component formed as one body or a part thereof. The "module" may be a minimum unit for performing one or more functions or a part thereof. The "module" may be implemented mechanically or electronically. For example, the "module" according to an embodiment of the present disclosure may include at least one of an application-specific IC (ASIC) chip, a field-programmable gate array (FPGA), and a programmable-logic device for performing certain operations which have been known or are to be developed in the future.

Examples of computer-readable media include: magnetic media, such as hard disks, floppy disks, and magnetic tape; optical media such as compact disc ROM (CD-ROM) and DVD; magneto-optical media, such as floptical disks; and hardware devices that are specially configured to store and perform program instructions (e.g., programming modules), such as ROM, RAM, flash memory, etc. Examples of program instructions include machine code instructions created by assembly languages, such as a compiler, and code instructions created by a high-level programming language executable in computers using an interpreter, etc. The described hardware devices may be configured to act as one or more software modules in order to perform the operations and methods described above, or vice versa.

Modules or programming modules according to the embodiments of the present disclosure may include one or more components, remove part of them described above, or include new components. The operations performed by modules, programming modules, or the other components, according to the present disclosure, may be executed in serial, parallel, repetitive or heuristic fashion. Part of the operations can be executed in any other order, skipped, or executed with additional operations.

A method for adjusting a camera exposure in an electronic device according to various embodiments of the present disclosure can identify an exposure state of a partial area selected by a user from the whole area of a preview image, and provide a screen for adjusting an exposure correctly based on the identification result of the exposure state.

While the present disclosure has been shown and described with reference to various embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the present disclosure as defined by the appended claims.

Claim 1:
An electronic device (<NUM>), comprising:
a touch display screen (<NUM>) comprising a main area (<NUM>) and an extension area (752a), the extension area (752a) including an opening (<NUM>), and wherein the opening (<NUM>) is surrounded by a first edge defining a first edge area (<NUM>) around the opening (<NUM>); and
a processor (<NUM>);
wherein the processor is configured to:
detect a touch input (<NUM>) on the main area of the touch display screen;
calculate continuous movement positions of a continuous movement of the touch input using an electric signal;
determine a direction of the continuous movement of the touch input using the continuous movement positions;
detect whether the continuous movement of the touch input reaches the first edge area (<NUM>) via starting from an initial position (992a) in the extension area (752a) and passing across the opening (<NUM>), based on the continuous movement positions and the direction of the continuous movement of the touch input; and
when the continuous movement reaches the first edge area (<NUM>) via starting from an initial position (992a) in the extension area (752a) and passing across the opening (<NUM>), perform a function corresponding to the opening (<NUM>).