Patent Description:
Advancement in the display technology has enabled development of a flexible display, a transparent display, and the like. A flexible display is a display apparatus that can be bent.

The flexible display is imparted with flexibility that allows folding and unfolding, as the glass substrate covering the liquid crystal in the related liquid crystal display (LCD) and organic light emitting diode (OLED) is replaced with a plastic film. The flexible display has an advantages, such as bendability or foldability, and the ability to be formed into a variety of forms.

For example, the flexible display may be applied to a portable phone that allows the display of the portable phone to be folded and rolled, an information technology (IT) product such as micro size personal computer (PC), and an electronic book that can substitute the publications such as magazines, textbooks, books, and comic books. In addition, because the flexible display uses flexible plastic substrate, the use thereof can be extended to fields such as clothing and the medical diagnostic devices.

Along with commercialization of the flexible display, various interfaces are developed in the foldable or rollable electronic devices, by using the bending or folding properties of the flexible display.

<CIT> discloses a foldable electronic device which allows to detect one or more objects using capacitive sensors arranged in each of a first and a second part of the foldable electronic device.

Aspects of the present disclosure are to address at least the above-mentioned problems and/or disadvantages and to provide at least the advantages described below. Accordingly, an aspect of the present disclosure is to provide an electronic device including a flexible display, and a method for processing hovering gesture on a flexible display, and more particularly, on a folding area of the flexible display at which the flexible display is folded.

In accordance with an embodiment of the present disclosure, a method of an electronic device for processing a gesture is provided as defined in the appended claims.

In accordance with another embodiment of the present disclosure, an electronic device is provided as defined in the appended claims.

The invention relates to the specific embodiments as defined by the appended claims while other embodiments described throughout the description that do not fall within such clearly defined scope shall be understood merely as examples.

According to various embodiments of the present disclosure, an accurate hovering point corresponding to the hovering gesture on the flexible display can be determined.

According to an embodiment of the present disclosure, it is possible to determine a hovering point corresponding to the hovering gesture in the folding area, according to the hovering gesture on the folding area where the flexible display is bent. As a result, the electronic device is capable of accurately reflecting the intention of a user performing the hovering gesture. Since functions such as selecting, implementing, moving, and so on of an object on the flexible display can be performed in response to an accurate hovering point corresponding to the hovering gesture, satisfaction of a user of the electronic device can be enhanced.

The following description with reference to the accompanying drawings is provided to assist in a comprehensive understanding of various embodiments of the present disclosure as defined by the claims. It includes various specific details to assist in that understanding, but these are to be regarded as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the various embodiments described herein can be made without departing from the scope of the present disclosure.

The terms and words used in the following description and claims are not limited to the bibliographical meanings, but are merely used by the inventor to enable a clear and consistent understanding of the present disclosure. Accordingly, it should be apparent to those skilled in the art that the following description of various embodiments of the present disclosure is provided for illustration purposes only and not for the purpose of limiting the present disclosure as defined by the appended claims.

Throughout the description, the expression such as "have", "may have", "comprise" or "may comprise", and so on refer to an existence of a corresponding characteristic (e.g., element such as number, function, component, and so on), and does not foreclose the existence of additional characteristic.

The expression "A or B", "at least one of A or/and B", or "at least one or more of A or and/B", and so on, may encompass every possible combination of items listed with the expression. For example, "A or B", "at least one of A and B", or "at least one of A or B" may refer to every instance including (<NUM>) comprising at least one A; (<NUM>) comprising at least one B; or (<NUM>) comprising all of at least one A and at least one B".

The expression "<NUM>", "<NUM>", "first", or "second" as used herein may modify a variety of elements, irrespective of order and/or importance thereof, and only to distinguish one element from another. Accordingly, without limiting the corresponding elements.

When a certain element (e.g., first element) and another element (e.g., second element) are described as being "operatively or communicatively) coupled with/to" each other, or "connected to" each other, this should be understood as meaning that the certain element and another element are directly coupled or coupled via yet another element (e.g., third element). On the other hand, when a certain element (e.g., first element) and another element (e.g., second element) are stated as being "directly coupled" or "directly connected" with each other, this may be understood as meaning that the certain element and another element are not intervened by yet another element (e.g., third element) present therebetween.

The expression "configured to" as used herein may be exchanged depending on occasions, with, for example, "suitable for", "having the capacity to", "designed to", "adapted to", "made to" or "capable of" and used. The term "configured to" does not necessarily refer to an example of being hardware-wise "specifically designed to". Instead, in any circumstances, the expression "configured to" may refer to a meaning that a device "may be able to" perform with another devices or components. For example, in a phrase "a process configured to perform A, B, and C?, the "processor" may refer to a dedicated processor (e.g., embedded process) provided to perform a corresponding operation, or a generic-purpose processor capable of performing corresponding operations by implementing one or more software programs stored on a memory device (e.g., central processing unit (CPU) or application processor).

A "user input" as used herein may include at least one of bending input, voice input, button input, and multimodal input, but not limited thereto. Further, the "user input" may include a touch gesture input as a contact touch, and a hovering gesture as a non-contact touch. The user may select, execute or move an object on a flexible display by a hovering gesture manner. The hovering gesture may be performed with a variety of input tools (e.g., user's finger, stylus pen, digitizer pen).

Throughout the description, an application may be a group of a series of computer programs that are designed to perform a specific service.

The terminology used herein, including technical and scientific terminologies, may have a meaning that is same as that generally understood by those skilled in the art of the technical fields described herein. Among the terms used herein, the terms defined in general dictionaries may be interpreted to be the same or similar meaning based on the context of the related technology, and unless otherwise specified herein, are not interpreted to be ideal or excessively formal meaning. Depending on occasions, even a term defined herein cannot be interpreted as foreclosing the various embodiments of the description.

<FIG> is a view to explain an electronic device according to an embodiment of the present disclosure.

Referring to <FIG>, the electronic device <NUM> employs a flexible display <NUM> that can be bent and folded. For example, the electronic device <NUM> may apply various forms of the flexible display <NUM> that can change a form with an external force, such as, a foldable display that can be folded or spread by a certain angle or curvature, a bendable display that can be bent or spread by a certain curvature, and a rollable display that can be rolled into a cylinder shape. The flexible display <NUM> is categorized into a first area <NUM> and a second area <NUM> based on a folding line <NUM>. Upon folding, a folding area <NUM> including the folding line <NUM> is determined on the flexible display <NUM>. The folding area <NUM> includes a portion of each of the first area <NUM> and the second area <NUM>. The folding area <NUM> refers to a surrounding area of the folding line.

The folding area <NUM> is determined to be different sizes and shapes adjacent to the folding line according to the folding state of the electronic device <NUM>. In particular, the size of the folding area <NUM> is determined according to the folding angle at which the electronic device <NUM> is folded inward or outward. In this case, as a folding angle (θ1) of the electronic device <NUM> folded inward increases, the size of the folding area <NUM> increases. As a folding angle of the electronic device <NUM> folded outward increases, the size of the folding area <NUM> increases.

The folding line <NUM> refers to a line on which the flexible display <NUM> is bent or folded. The folding line <NUM> may be a line corresponding to the boundary that can distinguish the first and second areas. When the flexible display <NUM> is bent, at least a portion of the flexible display <NUM> may have a deformation, in which case a line connecting the points of the greatest deformation may be regarded as the folding line.

For example, the folding line <NUM> may be an axis of bending or folding about a hinging means provided in the electronic device <NUM>. When the electronic device <NUM> is folded symmetrically, the folding line <NUM> may be the line at the center of the flexible display <NUM>.

The electronic device <NUM> may not be provided with the hinging means. In this case, the folding line <NUM> may be an arbitrary line on which the flexible display <NUM> is bent or folded by various angles and directions (e.g., vertical, horizontal or diagonal direction, and so on) with the external force from a user.

The "folding state" as used throughout the description may refer to a state in which the electronic device <NUM> is bent inward or outward with reference to the folding line <NUM>. The "folding state" may include any of "in-folding state" and "out-folding state". As a term distinguished from the "folding state", "un-folding state" may be used herein, which refers to a state that the electronic device <NUM> is spread as the folding angle (θ1) of the electronic device <NUM> is <NUM>° or close to <NUM>°, as illustrated in <FIG>.

Referring to <FIG>, the electronic device <NUM> may be converted, for example, from the un-folding state as in <FIG> into the in-folding state as in <FIG>.

The "in-folding state" as used throughout the description may refer to a state in which the electronic device <NUM> is bent inward with reference to the folding line <NUM>. In this case, the folding angle (θ1) of the electronic device <NUM> may be from <NUM>° to <NUM>°. In this case, the state of the folding angle (θ1) being <NUM>° may indicate a state in which the electronic device <NUM> is completely folded inward based on the folding line <NUM> so that the first area <NUM> and the second area <NUM> are in parallel or almost parallel with each other with the ventral surfaces thereof facing each other. This state may be referred to as a "complete in-folding state" of the electronic device <NUM>.

Referring to <FIG>, the electronic device <NUM> may be converted, for example, from the un-folding state as in <FIG> into the out-folding state as in <FIG>.

The "out-folding state" as used throughout the description may refer to a state in which the electronic device <NUM> is bent outward with reference to the folding line <NUM>. In this case, the folding angle (θ1) of the electronic device <NUM> may be from <NUM>° to <NUM> °. In this case, the state of the folding angle (θ1) being <NUM>° may indicate a state in which the electronic device <NUM> is completely folded outward based on the folding line <NUM> so that the first area <NUM> and the second area <NUM> are in parallel or almost parallel with each other with the rear surfaces thereof facing each other. This state may be referred to as a "complete out-folding state" of the electronic device <NUM>.

As illustrated in <FIG>, the electronic device <NUM> may include a plurality of folding lines <NUM> and <NUM>. In this case, the electronic device <NUM> may include both the in-folding state and the out-folding state. Further, the flexible display <NUM> may include the first area <NUM>, the second area <NUM>, and a third area <NUM> based on a plurality of folding lines <NUM> and <NUM>. The flexible display <NUM> may include a plurality of folding areas <NUM> and <NUM> each containing the plurality of folding lines <NUM> and <NUM>.

<FIG> illustrate a state in which a bezel area covering the surrounding area of the flexible display <NUM> is provided with the hinging means. In this case, the number, and positions of the folding lines may be fixed according to the number, and positions of the hinging means. Further, the folding areas may be determined to be flat areas neighboring the folding lines, and the sizes thereof may vary according to the folding degrees.

The bezel of the electronic device <NUM> may itself be formed from a flexible materials, or the electronic device may be implemented in a structure that excludes the bezel. <FIG> illustrates the embodiment described above. When the electronic device <NUM> is not provided with the hinging means, the flexible display <NUM> may be bent or folded by various angles and directions with the external force from a user. In this case, the flexible display <NUM> may include a plurality of folding lines <NUM>, <NUM>, and <NUM> based on the line where the flexible display is bent or folded with the external force from a user. The flexible display <NUM> may include the first area <NUM>, the second area <NUM>, the third area <NUM>, and a fourth area <NUM> based on a plurality of folding lines <NUM>, <NUM>, and <NUM>. Further, the flexible display <NUM> may include a plurality of folding areas <NUM>, <NUM>, <NUM> each containing a plurality of folding lines <NUM>, <NUM>, <NUM>.

A plurality of folding lines may be formed at various positions as intended by a user. The folding area may be used to generally indicate all the areas of the neighboring area of the folding line where the deformation occurs.

In the various embodiments described below, it is assumed that the electronic device <NUM> includes one folding line <NUM>, although all the various embodiments are applicable to an example in which the electronic device <NUM> includes a plurality of folding lines as illustrated in <FIG>.

<FIG> is a side view of an electronic device, provided to explain a sensing degree according to a hovering gesture according to an embodiment of the present disclosure.

Referring to <FIG>, the electronic device <NUM> may be bent inward and become the folding state. In the folding state, the electronic device <NUM> may sense the hovering gesture made by a user using the inputting means <NUM> on the folding area <NUM> of the flexible display <NUM>. In this case, even when a user performs the hovering gesture at the hovering point <NUM> where a user desires to select, the sensed value of a peak point (e.g., capacitance value or magnetic field value) may not be measured from the hovering point <NUM>. When the hovering gesture is performed in the folding state, the hovering gesture may be sensed from several areas of the flexible display <NUM> as illustrated in <FIG>. For convenience of explanation, the point of the first area <NUM> where the hovering gesture is sensed is referred to as the first position <NUM>, and the point of the second area <NUM> where the hovering gesture is sensed is referred to as the second position <NUM>. For example, the sensed value of the peak point <NUM> according to the hovering gesture may be measured at the first position <NUM> of the first area <NUM>, and the sensed value of the peak point <NUM> according to the hovering gesture may be measured at the second position <NUM> of the second area <NUM>.

When a distance from the inputting means <NUM> to the first position <NUM> and to the second position <NUM> is shorter than the distance from the inputting means <NUM> to the hovering point <NUM>, the hovering gesture may be sensed differently at the first position <NUM> than at the second position <NUM> from the user's intention. In this case, the hovering gesture may be sensed at both the first position <NUM> and the second position <NUM>. Further, the hovering gesture may be sensed across the first position <NUM> and the second position <NUM>.

The electronic device <NUM> may determine a hovering point on the flexible display <NUM> corresponding to the hovering gesture, based on the first position <NUM> and the second position <NUM>. Specific methods for determining a hovering point are described below with respect to <FIG>.

<FIG> are views illustrating a sensing degree on X and Y axes according to a hovering gesture in folding state according to an embodiment of the present disclosure.

Referring to <FIG>, the flexible display <NUM> may be folded by <NUM>° so as to have a 5R rounding (curvature). In this case, the graphs <NUM> and <NUM> of <FIG> represent the sensed values (e.g., capacitance values) measured on a touch panel according to the hovering gesture of a user.

The touch panel of the flexible display <NUM> is provided to sense the hovering gesture, and may include a plurality of horizontal electrodes and a plurality of vertical electrodes. The points where a plurality of horizontal electrodes and a plurality of vertical electrodes intersect will be referred to as electrode junctions.

<FIG> illustrates the horizontal electrodes of the flexible display <NUM>, and <FIG> illustrates the vertical electrodes of the flexible display <NUM>.

Referring to <FIG>, the horizontal electrodes constituting the flexible display <NUM> may measure the capacitance value generated from the horizontal direction of the flexible display <NUM> according to the hovering gesture. For example, it may be assumed that the pitch between the horizontal electrodes is about <NUM>, and the width of the horizontal electrodes is <NUM>.

Referring to <FIG>, the vertical electrodes constituting the flexible display <NUM> may measure the capacitance value generated from the vertical direction of the flexible display <NUM> according to the hovering gesture. For example, it may be assumed that the pitch between the vertical electrodes is about <NUM>, and the width of the vertical electrodes is about <NUM>.

<FIG> illustrates the coordinates that represent the capacitance values measured through the horizontal and the vertical electrodes. The numbers on X axis may respectively represent the horizontal and the vertical electrodes of <FIG>. For example, '<NUM>' on X axis may represent the horizontal electrode <NUM>. Further, '<NUM>' on X axis may represent the vertical electrode <NUM>. The numbers on Y axis respectively represent the capacitance values that can be measured through the horizontal and the vertical electrodes. The unit of the capacitance value may be pF (picofarad).

Referring to <FIG>, the graphs may be categorized into four series <NUM>, <NUM>, <NUM>, and <NUM> according to the distances from the inputting means <NUM> to the flexible display <NUM>. The series <NUM> indicates that the inputting means <NUM> contacts to the flexible display <NUM>. The series <NUM>, <NUM>, and <NUM> indicate that the distances from the inputting means <NUM> to the flexible display <NUM> are <NUM>, <NUM>, and <NUM>, respectively.

Referring to <FIG>, the graphs <NUM>, <NUM>, <NUM>, and <NUM> represent the capacitance values measured through the horizontal electrodes according to the four series described above. The graphs <NUM>, <NUM>, <NUM>, and <NUM> represent the capacitance values measured through the vertical electrodes according to the four series described above.

The graph <NUM> may represent the capacitance value which may be measured and represented to be a peak point at the position <NUM> where the inputting means <NUM> contacts the flexible display <NUM>. As a result, the electronic device <NUM> may determine the position <NUM> to be a hovering point a user desires to select with the hovering gesture.

Referring to the graph <NUM>, the inputting means <NUM> and the flexible display <NUM> may be displaced from each other by a certain distance. The capacitance value may be measured and represented as a peak point at positions <NUM> and <NUM> other than the position a user desires to select with the hovering gesture. In this case, the electronic device <NUM> may determine a correct hovering point on the flexible display <NUM> corresponding to the hovering gesture of a user based on the values measured from the two positions <NUM> and <NUM>.

<FIG> is a block diagram of an electronic device <NUM> according to an embodiment of the present disclosure.

Referring to <FIG>, the electronic device <NUM> may be a smart phone, but is not limited thereto. For example, the electronic device <NUM> of <FIG> may include at least one of a tablet personal computer, a mobile phone, a video phone, an e-book reader, a netbook computer, a workstation, a personal digital assistant (PDA), a portable multimedia player (PMP), a Moving Picture Experts Group phase <NUM> or phase <NUM> (MPEG-<NUM> or MPEG-<NUM>) audio layer <NUM> (MP3) player, a mobile medical device, a camera, or a wearable device. The wearable device may include at least one of an accessory type (e.g., watch, ring, bracelet, anklet, necklace, glasses or head mounted device (HMD)), a fabric or cloth-integration type (e.g., electronic clothing), a body attached type (e.g., skin pad or tattoo), or a bio-implant type (e.g., implantable circuit).

In another embodiment, the electronic device <NUM> may be home appliance. The home appliance may include at least one of a television, a digital video disc (DVD) player, an audio, a refrigerator, an air conditioner, a cleaning machine, a laundry machine, an air cleaner, a set-top box, a home automation control panel, a security control panel, a television (TV) box (e.g., Samsung HomeSync™, Apple TV™, or Google TV™), a game console (e.g., Xbox™ or PlayStation™), an electronic dictionary, an electronic key, a camcorder, or an electronic frame.

In another embodiment, the electronic device <NUM> may include at least one of various medical devices (e.g., various portable medical diagnostic devices (e.g., blood sugar diagnostic device, heart beat diagnostic device, blood pressure diagnostic device, or temperature diagnostic device), magnetic resonance angiography (MRA), magnetic resonance imaging (MRI), computed tomography (CT), photographing device, and ultrasound device), a navigation device, global navigation satellite system (GNSS), event data recorder (EDR), flight data recorder (FDR), a car infotainment device, a ship electronic device (e.g., a ship navigation device, a gyro compass, and so on), avionics, a security device, a car head unit, an industrial or domestic robot, automatic teller machine (ATM) of a financial organization, point of sales (POS) at a shop, or an internet of things device (e.g., bulb, various sensors, electric or gas meter, sprinkler device, fire warning device, thermostat, streetlamp, toaster, exercise machine, hot water tank, heater, boiler, etc.).

In another embodiment, the electronic device <NUM> may include at least one of furniture or a portion of a building/structure, an electronic board, an electronic signature receiving device, a projector, or various measuring devices (e.g., water, electricity, gas, or electromagnetic wave measuring devices).

The electronic device <NUM> may be a combination of one or more of a variety of devices stated above, and may include a new electronic device as the technology develops. The electronic device <NUM> may include a folding structure implemented with a hinge and a flexible material on the folding line <NUM>.

Referring to <FIG>, the electronic device <NUM> includes at least one of a state sensor <NUM>, a processor <NUM>, and the flexible display <NUM>.

The state sensor <NUM> senses the folding state of the electronic device <NUM>. For example, the state sensor <NUM> may sense whether the electronic device <NUM> is in un-folding or folding state. The state sensor <NUM> may sense whether the electronic device <NUM> is in in-folding or out-folding state. The state sensor <NUM> senses a folding angle as the folding state of the electronic device <NUM>.

The state sensor <NUM> may sense the folding state by using various sensors. For example, the state sensor <NUM> may include a plurality of bend sensors disposed on the flexible display <NUM> or at a bezel side of the electronic device <NUM>. The bend sensor refers to a sensor that is bendable and has such a property that the bend sensor varies resistance value according to the bending degree. The bend sensor may be implemented in various forms, such as fiber optic bending sensor, pressure sensor, strain gauge, and the like. The state sensor <NUM> may sense the change in the resistance value by applying the voltage to the bend sensor, and thus sense whether the electronic device <NUM> is folded or not. By the larger change in the resistance value, it may be determined that the greater folding occurs. Additionally, when the electronic device <NUM> includes the hinging means, the state sensor <NUM> may sense the folding state by using a contact sensor, a light receiving sensor, a hall sensor, or magnetic sensor, and so on, provided in the hinging means.

When the folding state of the electronic device <NUM> is determined by the state sensor <NUM>, the state sensor <NUM> may provide the determined result to the processor <NUM>. In this case, the processor <NUM> may identify the folding state of the electronic device <NUM> according to the outputting of the state sensor <NUM> without having to separately determine the folding state of the electronic device <NUM>. Alternatively, when the state sensor <NUM> provides information regarding the folding state or sensing information of the state sensor to the processor <NUM>, the processor <NUM> may determine the folding state of the electronic device <NUM>.

The flexible display <NUM> may include a display panel which displays a screen showing information. Further, the flexible display <NUM> may include at least one of a touch panel and a pen recognition panel.

The flexible display <NUM> may be bent or folded asymmetrically or symmetrically.

The flexible display <NUM> may display the information processed or to be processed by an operating system (OS) driven within the electronic device <NUM>. For example, the flexible display <NUM> may display a screen of implementing an application processed by the OS, a lock screen, a background screen, an application list screen, and so on.

The flexible display <NUM> may include a function to detect a duration of the touch as well as a touch position, a touch pressure, a touch speed, and an area of touch according to a touch gesture as the contact touch. Further, the flexible display <NUM> may include a function to detect a duration of hovering as well as a hovering position and an area of hovering according to the hovering gesture as a contactless touch.

The processor <NUM> may control the overall operation of the electronic device <NUM>. For example, the processor <NUM> may perform an operation to implement and control the OS, an operation to process various data, an operation to control each element of the electronic device <NUM>, and so on. The processor <NUM> may drive a plurality of different OSs. Generally, OS manufacturers may provide various OSs (e.g., smart phone OS, tablet OS, computer OS, and so on) according to the screen size of the target device in which OS is driven. Thus, the processor <NUM> may provide different OS to the first area and the second area, based on the position of the folding line or the folding state of the electronic device <NUM>.

The processor <NUM> determines a hovering point corresponding to the hovering gesture based on the first hovering position and the second hovering position sensed in the flexible display according to the hovering gesture of a user on the flexible display <NUM>.

The processor <NUM> may determine a hovering point corresponding to the hovering gesture by correcting at least one sensed position on the folding area <NUM> according to the hovering gesture of a user on the folding area <NUM> including the folding line <NUM>, and control the flexible display <NUM> to display user interface (UI) at the hovering point.

When the user hovering gesture is moved on the folding area <NUM> including the folding line <NUM>, the processor <NUM> may determine a plurality of hovering points by correcting a plurality of hovering positions sensed on the folding area according to the movement. Further, the processor <NUM> may determine the moving direction of the hovering gesture based on a plurality of determined hovering points.

When the user hovering gesture using the inputting means is moved on the folding area <NUM> including the folding line <NUM>, the processor <NUM> may determine the moving direction of the hovering gesture based on the motion characteristic of the inputting means.

In <FIG>, the state sensor <NUM> is illustrated and described as a separate element from the processor <NUM> and the flexible display <NUM>. However, in actual implementation, the state sensor <NUM> may be implemented such that the state sensor <NUM> is a function performed at the processor <NUM>. For example, the processor <NUM> may directly receive the sensing result from the sensors within the flexible display <NUM>, and sense the folding state.

<FIG> is a flowchart of a method of an electronic device <NUM> for processing a gesture according to an embodiment of the present disclosure.

Referring to <FIG>, the electronic device <NUM> may be in-folded by the external force from a user, at operation S501.

At operation S502, the electronic device <NUM> may sense the in-folding state of the electronic device <NUM> as the electronic device <NUM> is folded. In this case, when the electronic device <NUM> is folded based on a plurality of axes, the electronic device <NUM> may sense a plurality of in-folding states, respectively. When the electronic device <NUM> is folded in an arbitrary direction by the external force from a user, the electronic device <NUM> may sense a plurality of in-folding states on a plurality of folding lines according to the arbitrary directions, respectively.

When the in-folding state is sensed, the electronic device <NUM> may determine the in-folding area where it is necessary to determine a hovering point, by correcting the hovering positions based on the in-folding state, at operation S503. When a plurality of in-folding states are sensed, the electronic device <NUM> may determine a plurality of in-folding areas based on a plurality of folding lines.

The in-folding area as used herein may indicate a folding area of the electronic device <NUM> in the in-folding state.

At operation S504, the electronic device <NUM>, being in an in-folding state, may sense the hovering gesture of a user on the flexible display <NUM>.

At operation S505, the electronic device <NUM> may determine if the hovering gesture is sensed in the in-folding area.

When the hovering gesture is sensed within the in-folding area at operation S505-Y, the electronic device <NUM> may determine a hovering point by correcting the hovering positions sensed according to the hovering gesture, at operation S506. When the hovering gesture is sensed outside the in-folding area at operation S505-N, the electronic device <NUM> may determine the hovering position sensed according to the hovering gesture to be hovering point, at operation S507.

<FIG> are views to explain a method for determining a hovering point at an electronic device in an in-folding state, according to an embodiment of the present disclosure.

Referring to <FIG>, when the state sensor <NUM> senses the in-folding state of the electronic device <NUM>, the processor <NUM> may determine the in-folding area of the electronic device <NUM>. The in-folding area may be determined within a certain distance from both side areas based on the folding line. The size of the in-folding area may be differently determined according to the folding state, i.e., folding angle. When the hovering gestures is sensed on the flexible display <NUM>, the processor <NUM> may determine whether there are a plurality of hovering positions in which the sensed values (e.g., capacitance values) have peak points according to the hovering gesture. Further, the processor <NUM> may determine whether a plurality of hovering positions may be within the in-folding area.

As a result of determination, when a plurality of hovering positions are determined to be within the in-folding area, the processor <NUM> may determine the hovering points by using the values associated with a plurality of hovering positions.

For example, as illustrated in <FIG>, the peak point <NUM> and the peak point <NUM> may be measured according to the hovering gesture. In this case, the processor <NUM> may determine a hovering point Ph1 corresponding to the hovering gesture by using sensed values Ca, Cb at the peak points <NUM> and <NUM>, distance values Pa, Pb from the folding line to the hovering position where the peak point is measured, and variable k according to the folding angle of the electronic device <NUM>. This may be expressed as the following Equation <NUM>. <MAT> where f( ) indicates a function implemented to calculate a hovering point with the inputting variables Ca, Cb, Pa, Pb, and k. For example, when a user performs the hovering gesture linearly, the peak point may be changed from <FIG>, and then to <FIG>. In this case, as in the case of <FIG>, when the capacitance values of the peak points respectively measured on the first area and the second area are the same or almost the same as each other, the processor <NUM> may determine the position of the folding line to be the hovering point.

When the hovering gesture is moved continuously, the processor <NUM> may further perform filtering so that a hovering point is continuously changed. Thus, the processor <NUM> may further perform filtering so that a hovering point is continuously changed along the hovering positions at which the peak point changes in <FIG>, C, and D, and so that the gap between the hovering positions is linear.

Referring to <FIG>, a method of determining Ph according to the capacitance values Ca and Cb at the peak points <NUM>, <NUM> may be divided as follows.

In the above case, when Pa and Pb are the same or almost the same as each other, a hovering point may be a position at which "Ph1 = <NUM>". In this case, the position at which "Ph1 = <NUM>" may be on the folding line <NUM>.

In the above case, when Pa is greater than Pb, the processor <NUM> may determine the hovering point to be a specific position of the first area within the folding area where Pa is measured. The hovering point may be a position moved from the folding line to the first area direction at a Pa-Pb : Pa ratio.

In the above case, when Pa is much greater than Pb, the processor <NUM> may determine whether the hovering gesture is the hovering gesture made with a plurality of stylus pens. When the hovering gesture is determined to be the one made by using the multi-pen, the processor <NUM> may determine that the first position and the second position are selected, respectively, and perform the corresponding specific functions. In contrast, when the hovering gesture is determined not to be the one made by using the multi-pen, the processor <NUM> may generate an error event.

In the above case, when Pa and Pb are the same or almost the same as each other, the processor <NUM> may determine the hovering point to be a specific position of the first area within the folding area where Pa is measured. The hovering point may be a position moved from the folding line to the first area direction at a Ca-Cb ratio. In this case, Ca and Cb may be calculated as log scale values.

In the above case, when Pa is greater than Pb, the processor <NUM> may determine the hovering point to be a specific position of the first area within the folding area where Pa is measured. The hovering point may be a position moved from the folding line to a first area direction at a Pa-Pb : Pa ratio or Ca-Cb : Ca ratio. The ratio calculated from Pa and Pb and the ratio calculated from Ca and Cb may be applied to the calculation of the hovering point as almost the same ratios. Ca and Cb may be calculated as log scale values.

In the above case, when Pa is much greater than Pb, the processor <NUM> may determine whether the hovering gesture is the hovering gesture made with multi-pen. When the hovering gesture is determined to be the one made by using the multi-pen, the processor <NUM> may determine that the first hovering position and the second hovering position may be selected, respectively, and process various data according to such determination. In contrast, when the hovering gesture is determined not to be the one made by using the multi-pen, the processor <NUM> may generate an error event.

<FIG> are views to explain a method of an electronic device for determining a hovering point according to an embodiment of the present disclosure.

Referring to <FIG>, coordinate values and graphs on the coordinate of <FIG> will not be redundantly described below, as these are same as those of <FIG>.

When the hovering gesture is sensed on the flexible display <NUM>, the processor <NUM> may measure the capacitance values through the horizontal electrodes and the vertical electrodes.

<FIG> shows a table listing the capacitance values measured by the horizontal electrodes.

The row <NUM> of the table lists capacitance values measured by the horizontal electrodes when the inputting means <NUM> contacts the flexible display <NUM>. In this case, the peak point may be <NUM> pF (<NUM>-<NUM>) which may be measured on the folding line <NUM>. Thus, the hovering point may be positioned on the folding line <NUM>.

The row <NUM> of the table lists capacitance values measured by the horizontal electrodes when the distance from the inputting means to the flexible display <NUM> is <NUM>. In this case, the peak points Ca and Cb may be almost same as each other and may be respectively <NUM> pF (<NUM>-<NUM>) and <NUM> pF (<NUM>-<NUM>). The distances Pa and Pb to the horizontal electrodes at which Ca and Cb are measured may be respectively displaced from the folding line by <NUM>. The row <NUM> may correspond to the case in which Ca and Cb are almost same as each other and Pa and Pb are almost same as each other. Therefore, a hovering point may be positioned on the folding line <NUM>.

The row <NUM> of the table lists capacitance values measured by the horizontal electrodes when the distance from the inputting means to the flexible display <NUM> is <NUM>. In this case, the peak points Ca and Cb may be almost same as each other and may be respectively <NUM>. 021191pF (<NUM>-<NUM>) and <NUM>. 021841pF (<NUM>-<NUM>). The distances Pa and Pb to the horizontal electrodes at which Ca and Cb are measured may be respectively displaced from the folding line by <NUM>. The row <NUM> may correspond to the case in which Ca and Cb are almost same as each other and Pa and Pb are almost same as each other. Therefore, a hovering point may be positioned on the folding line <NUM>.

The row <NUM> of the table lists capacitance values measured by the horizontal electrodes when the distance from the inputting means to the flexible display <NUM> is <NUM>. In this case, the peak points Ca and Cb may be almost same as each other and may be respectively <NUM>. 013406pF (<NUM>-<NUM>) and <NUM>. 014022pF (<NUM>-<NUM>). The distances Pa and Pb to the horizontal electrodes at which Ca and Cb are measured may be respectively displaced from the folding line by <NUM>. Thus, the row <NUM> may correspond to the case in which Ca and Cb are almost same as each other and Pa and Pb are almost same as each other. Therefore, a hovering point may be positioned on the folding line <NUM>.

<FIG> is a view to explain a method of an electronic device <NUM> for determining a hovering point according to an embodiment of the present disclosure.

Referring to <FIG>, when the hovering gesture is sensed on the flexible display, the processor <NUM> may determine a hovering point by considering the angle between the inputting means <NUM> performing the hovering gesture and the flexible display <NUM>.

For example, when the angle (θ2) between the inputting means <NUM> and the first area <NUM> of the flexible display <NUM> is vertical or almost vertical (e.g., from <NUM>° to <NUM>°), the processor <NUM> may determine a hovering point by giving a weight to the position <NUM> of the horizontal electrode in the first area at which the peak point Ca is measured. When the peak point Ca measured in the first area and the peak point Cb measured in the second area are same as each other, the processor <NUM> may also determine that a user performs the hovering gesture to select the first area <NUM>, and thus determine the position <NUM> of the horizontal electrode in the first area <NUM> at which the peak point Ca is measured to be the hovering point. This may be expressed as the following Equation <NUM>.

The processor <NUM> may use the sensed value sensed at the flexible display <NUM> according to the hovering gesture in order to determine the angle between the inputting means <NUM> and the flexible display <NUM>. For example, according to the hovering gesture, the inputting means <NUM> may be parallel or almost parallel to the second area <NUM> of the flexible display <NUM>. In this case, there may be more peak points measured in the second area <NUM> than the peak points measured in the first area <NUM>. Accordingly, the processor <NUM> may estimate the position and the tilting angle of the inputting means by using the ratio between the peak points measured in the first area <NUM> and the peak points measured in the second area <NUM>, and the sensing degree at the peak points.

The method for determining a hovering point corresponding to the hovering gesture may be divided as follows.

In this case, the processor <NUM> may determine the middle position of the hovering points derived from Ph1 and the hovering points derived from Ph2 to be the final hovering point.

<NUM>) The Ph2 hovering points according to the Equation <NUM> are respectively different from the Ph1 hovering points according to the Equation <NUM>, and either the Ph2 hovering points or the Ph1 hovering points are positioned in the first area <NUM>, and the other are positioned in the second area <NUM>.

In this case, when the angle between the inputting means <NUM> for the hovering gesture and the second area <NUM> is from - <NUM>° to + <NUM>°, the processor <NUM> may determine the hovering point derived from Ph1 to be the final hovering point. In contrast, when the angle between the inputting means <NUM> for the hovering gesture and the second area <NUM> is outside the - <NUM>° - + <NUM>° range, the processor <NUM> may determine the hovering point derived from Ph2 to be the final hovering point.

<NUM>) Either the Ph2 hovering points by the Equation <NUM> or the Ph1 hovering points by the Equation <NUM> are positioned on the folding line, and the other are positioned in the first area <NUM>.

In this case, when the angle between the inputting means <NUM> for the hovering gesture and the second area <NUM> is from - <NUM>° to + <NUM>°, the processor <NUM> may determine the hovering point derived from Ph1 (Equation <NUM>) to be the final hovering point. In contrast, when the angle between the inputting means <NUM> for the hovering gesture and the second area <NUM> is outside the - <NUM>° - + <NUM>° range, the processor <NUM> may determine the hovering point derived from Ph2 (Equation <NUM>) to be the final hovering point.

<FIG> are views provided to explain a method of an electronic device for determining a hovering point according to an embodiment of the present disclosure.

Referring to <FIG>, when the folding state is sensed at operation <NUM>, the processor <NUM> may determine the folding area <NUM> based on the folding state, and amplify the capacitance value measured from at least one horizontal electrode positioned in the folding area <NUM>, at operation <NUM>. For example, the processor <NUM> may adjust the amp gain value of the value measured by at least one horizontal electrode influenced by the hovering gesture inn the folding area <NUM>, and thus prevent the capacitance inverse phenomenon from occurring in at least one horizontal electrode. In this case, at least one horizontal electrode as a target of the amp gain value adjustment, and the size of the amp gain value may vary according to the folding angle of the electronic device <NUM>.

Referring to <FIG>, the graph <NUM> represents a graph of the values measured by the horizontal electrodes according to the hovering gesture on the folding area <NUM> before the amp gain value is adjusted. Further, the graph <NUM> represents a graph of the values measured by the horizontal electrodes according to the hovering gesture on the folding area <NUM> after the amp gain value is adjusted.

Regarding the graph <NUM>, the hovering positions at which the capacitance values of the peak points <NUM>-<NUM> and <NUM>-<NUM> are measured may be different from the positions the user desires to select with the hovering gesture. In contrast, regarding the graph <NUM>, the hovering positions at which the capacitance value of the peak point <NUM>-<NUM> is measured may be same as the position the user desires to select with the hovering gesture.

<FIG> and <FIG> are views to explain a method of an electronic device for determining a hovering point according to an embodiment of the present disclosure.

Referring to <FIG> and <FIG>, the horizontal electrodes may measure the capacitance values generated according to the hovering gesture. The closer the horizontal electrodes are to the folding line <NUM>, the more the electrodes are influenced by the hovering gesture on the folding area <NUM>. Thus, when the electronic device <NUM> becomes the folding state, some of the horizontal electrodes adjacent to the folding line <NUM> may be switched to the off state, thus preventing generating of the peak points of the capacitance values from the horizontal electrodes irrelevant with the hovering point.

For example, as illustrated in <FIG>, the processor <NUM> may maintain the off state of some horizontal electrodes in every alternate line to minimize the influence of the horizontal electrode according to the hovering gesture. As a result, the horizontal electrode <NUM>, the horizontal electrode <NUM>, and the horizontal electrode <NUM> may be kept in on state, while the horizontal electrode <NUM>, the horizontal electrode <NUM>, the horizontal electrode <NUM>, and the horizontal electrode <NUM> may be kept in the off state.

<FIG> illustrates the horizontal electrodes in <FIG> selectively turned to off state, as viewed from the side of the flexible display <NUM>. The horizontal electrode <NUM>, the horizontal electrode <NUM>, and the horizontal electrode <NUM> may be kept in the on state, while the horizontal electrode <NUM> and the horizontal electrode <NUM> may be kept in the off state.

<FIG> are views to explain a method of an electronic device <NUM> for determining a hovering point according to an embodiment of the present disclosure.

Referring to <FIG>, when a user performs the hovering gesture, the moving direction of the hovering gesture may be consistent empirically. Further, the hovering gesture random quickly hops to another position, and the moving speed of the hovering gesture may be empirically consistent or positioned within a certain range. Accordingly, the processor <NUM> may determine a hovering point according to new hovering gesture by using the characteristics of the hovering gesture described above and the history in which the hovering gesture is performed.

The electronic device <NUM> may use the position determined to be hovering point <NUM> at time point t, and the position determined to be hovering point <NUM> at time point t-<NUM> in order to determine a hovering point <NUM> at time point t+<NUM>. For example, when it is assumed that the hovering gesture performing direction <NUM> or the hovering gesture moving speed of a user is consistent, the electronic device <NUM> may determine a hovering point <NUM> at time point t+<NUM> by considering the moving speed of the hovering gesture along a line of the moving direction <NUM> of the previously-determined hovering points <NUM>, <NUM>.

<FIG> are views to explain a method of an electronic device for determining a hovering point according to a folding angle, according to an embodiment of the present disclosure.

Referring to <FIG>, the electronic device <NUM> may determine a hovering point by considering the folding angle (θ3) of the electronic device <NUM>.

For example, as illustrated in <FIG>, when the folding angle (θ3) of the electronic device is less than <NUM>°, the electronic device <NUM> may skip the calculation of a hovering point. The electronic device <NUM> may control so that the selecting according to the hovering gesture is not performed.

As illustrated in <FIG>, when the folding angle (θ3) of the electronic device <NUM> is equal to, or greater than <NUM>° and less than <NUM>°, the electronic device <NUM> may determine an accurate hovering point by using the positions determined to be hovering points in the previous time point. For example, the electronic device <NUM> may determine the position corresponding to an average point of the position determined to be hovering point at the current time point and the positions determined to be hovering points at the previous time point.

As illustrated in <FIG>, when the folding angle (θ3) of the electronic device <NUM> is <NUM>°, the electronic device <NUM> may determine the hovering point calculated according to the Equation <NUM> described with reference to <FIG> to be the final hovering point.

In the same manner, as illustrated in <FIG>, when the folding angle (θ3) of the electronic device exceeds <NUM>°, but is not greater than <NUM>°, the electronic device <NUM> may determine the final hovering point by selecting one from the hovering points calculated according to the Equation <NUM> and the hovering points calculated according to the Equation <NUM>.

Additionally, the electronic device <NUM> according to an embodiment may determine a hovering point based on a curvature of the folding line of the electronic device <NUM>. For example, the electronic device <NUM> may calculate a hovering point by distinguishing a circumstance in which the Pa and Pb are positioned on the curvature due to considerably high curvature of the curved electronic device <NUM> from a circumstance in which the Pa and Pb are positioned outside the curvature due to considerably low curvature.

Further, the electronic device <NUM> may previously store in a memory a table for correcting the hovering positions according to the hovering gesture. In this case, the table may store the folding angle, the height of the hovering gesture, the position of the hovering gesture, various types of the sensed waveforms according to the tilting angle of the inputting means of the hovering gesture, and store correcting values regarding the hovering positions according to each sensed waveform. In this case, the electronic device <NUM> may determine an accurate hovering point according to the hovering gesture by using the table.

<FIG> are side views of an electronic device <NUM>, provided to explain an out-folding state according to an embodiment of the present disclosure.

Referring to <FIG>, the electronic device <NUM> may be bent outward and become the out-folding state. In the out-folding state, the electronic device <NUM> may sense the hovering gesture made by a user on the folding area <NUM> of the flexible display <NUM>. Referring to <FIG>, a graph <NUM> is a representation of the sensed values (e.g., capacitance values or electromagnetic values) measured on the touch panel of the flexible display <NUM> according to the hovering gesture on the folding area <NUM>. In this case, when the sensed value of the peak point <NUM>-<NUM> is measured by the horizontal electrode positioned on the folding line <NUM>, the hovering position where the horizontal electrode is positioned may be determined to be hovering point.

As illustrated in <FIG>, the electronic device <NUM> may sense the movement of the hovering gesture on the flexible display <NUM>. In this case, the electronic device <NUM> may determine that a hovering point corresponding to the hovering gesture is positioned nearer to the folding line <NUM> rather than at a position to which the hovering gesture is substantially moved.

Usually, as the folding angle (θ4) increases, the distance between the inputting means for the hovering gesture and the horizontal electrodes adjacent to the folding line <NUM> may increase, and accordingly, the sensed values measured by the horizontal electrodes adjacent to the folding line may decrease. As a result, when the hovering gesture is moved on the folding area <NUM>, the hovering point may not instantly follow to the position intended to be selected by the hovering gesture.

Thus, when the hovering gesture is moved on the folding area <NUM>, the electronic device <NUM> determines a hovering point corresponding to the hovering gesture by correcting the hovering position where the sensed value of the peak point <NUM>-<NUM> is measured for the accurate determination of a hovering point.

<FIG> is a flowchart provided to explain a method of an electronic device for processing a user gesture according to an embodiment of the present disclosure.

Referring to <FIG>, the electronic device <NUM> may be folded by a user or an external force, at operation S1401.

At operation S1402, the electronic device <NUM> may sense the folding state of the electronic device <NUM>. In this case, when the electronic device <NUM> is folded based on a plurality of axes, the electronic device <NUM> may sense a plurality of folding states, respectively. When the electronic device <NUM> is folded in an arbitrary direction by the user, the electronic device <NUM> may sense a plurality of in-folding states on a plurality of folding lines according to the arbitrary directions, respectively.

At operation S1403, the electronic device <NUM> may determine whether the electronic device <NUM> is in the in-folding state or the out-folding state. When a plurality of folding states are sensed, the electronic device <NUM> may determine whether a plurality of folding states are in-folding states or out-folding states, respectively.

When the electronic device <NUM> is in the in-folding state at S1403, the electronic device <NUM> may determine the in-folding area where it is necessary to determine a hovering point, by correcting the hovering position based on the in-folding state, at operation S1404.

At operation S1405, the electronic device <NUM>, being in an in-folding state, may sense the hovering gesture of a user on the flexible display <NUM>.

At operation S1406, the electronic device <NUM> may determine if the hovering gesture is sensed in the in-folding area.

When the hovering gesture is sensed within the in-folding area at operation S1406, the electronic device <NUM> may determine a hovering point by correcting the hovering positions sensed according to the hovering gesture, at operation S1407. When the hovering gesture is sensed outside the in-folding area at operation S1406, the electronic device <NUM> may determine the hovering position sensed according to the hovering gesture to be hovering point, at operation S1408.

When the result of the determination at operation S1403 indicates the electronic device <NUM> to be in the out-folding state at operation S1403, the electronic device <NUM> may determine the out-folding area where it is necessary to determine a hovering point, by correcting the hovering position based on the out-folding state, at operation S1414.

The out-folding area may be a folding area of the electronic device <NUM> in the out-folding state.

At operation S1415, the electronic device <NUM>, being in an out-folding state, may sense the hovering gesture of a user on the flexible display <NUM>.

At operation S1416, the electronic device <NUM> may determine if the hovering gesture is sensed in the out-folding area.

When the hovering gesture is sensed within the out-folding area at operation S1416-Y, the electronic device <NUM> may determine a hovering point by correcting the hovering positions sensed according to the hovering gesture, at operation S1417. When the hovering gesture is sensed outside the out-folding area at operation S1416-N, the electronic device <NUM> may determine the hovering position sensed according to the hovering gesture to be hovering point, at operation S1418.

<FIG> are views to explain a method for determining a hovering point at an electronic device in an out-folding state, according to an embodiment of the present disclosure.

Referring to <FIG>, when the state sensor <NUM> senses the out-folding state of the electronic device <NUM>, the processor <NUM> may determine the out-folding area of the electronic device <NUM>.

When the hovering gestures is sensed on the flexible display <NUM>, the processor <NUM> may determine sensed values (e.g., capacitance values) measured according to the hovering gesture in motion, and determine the hovering point by using the hovering position having a peak point.

For example, as illustrated in <FIG>, the peak point may be measured according to a movement of the hovering gesture. In this case, the processor <NUM> may determine a hovering point Ph3 corresponding to the hovering gesture, by using sensed value Ca of the peak point <NUM>, a distance value Pa from the folding line to the hovering position where the peak point is measured, a distance value P1 from the folding line to the front point of the sensed waveform, a distance value P2 from the folding line to the back point of the sensed waveform, and a variable k according to the folding angle of the electronic device <NUM>. This may be expressed as the following Equation <NUM>.

According to the Equation <NUM>, the processor <NUM> may modify the sensed waveform measured according to the hovering gesture to be gradual, as illustrated in <FIG>. The processor <NUM> may modify the sensed waveform by amplifying the sensing values measured by the horizontal electrodes adjacent to the folding line. The processor <NUM> may determine a hovering point Ph3 corresponding to the hovering gesture based on the peak point <NUM> of the modified sensing waveform.

Accordingly, in response to the movement of the hovering gesture of a user, a hovering point corresponding to the hovering gesture may be moved gradually.

When a user performs the hovering gesture linearly, with the electronic device <NUM> being in the out-folding state, the peak point may be changed from <FIG>, and then to <FIG>. In this case, the processor <NUM> may further perform filtering so that a hovering point is continuously changed. For example, the processor <NUM> may modify the sensed waveform measured at <FIG> to a gradual form. The processor <NUM> may further perform filtering by using the peak point measured at <FIG> and the peak points acquired from the gradually-changed, sensed waveforms at <FIG>, so that the hovering point is continuously changed and the gap between the hovering positions become linear.

<FIG> is a block diagram of an electronic device according to an embodiment of the present disclosure.

Referring to <FIG>, the electronic device <NUM> may include at least one of a processor <NUM>, a display <NUM>, a memory <NUM>, a sensor <NUM>, a communicator <NUM>, a video processor <NUM>, an audio processor <NUM>, an input unit <NUM>, a microphone <NUM>, a photographer <NUM>, a speaker <NUM>, and a motion sensor <NUM>.

The input unit <NUM> may sense a first hovering position and a second hovering position according to the hovering gesture of a user on the flexible display <NUM>. The processor <NUM> may determine a hovering point corresponding to the hovering gesture based on the first and second positions sensed on the flexible display <NUM>. The processor <NUM> may correct the hovering position sensed according to the hovering gesture of a user on the folding area of the flexible display <NUM>, and determine a hovering point corresponding to the hovering gesture on the folding area.

The processor <NUM> may include at least one of random access memory (RAM) <NUM>, read-only memory (ROM) <NUM>, CPU <NUM>, graphics processing unit (GPU) <NUM> and a bus <NUM>. The RAM <NUM>, ROM <NUM>, CPU <NUM> and GPU <NUM> may be connected to one another through the bus <NUM>.

The CPU <NUM> may access the memory <NUM> and perform booting by using OS stored in the memory <NUM>. The CPU <NUM> may perform various operations by using the various programs, contents, data, and the like stored in the memory <NUM>.

The ROM <NUM> may store a command set for system booting, and so on. For example, when a turn-on command is inputted and the electrical power is supplied to the electronic device <NUM>, the CPU <NUM> may copy the stored OS in the memory <NUM> to RAM <NUM> according to the commands stored in ROM <NUM>, and boot the system by executing the OS. When the booting is completed, the CPU <NUM> may copy the various programs stored in the memory <NUM> to the RAM <NUM>, and perform various operations by implementing the programs copied to the RAM <NUM>. The GPU <NUM> may display a UI screen on the display <NUM> when the booting of the electronic device <NUM> is competed. The screen generated at the GPU <NUM> may be provided to the display <NUM> and displayed on the respective areas of the display <NUM>.

The display <NUM> may include a controller (not illustrated) to control the display panel <NUM>. The display panel <NUM> may be implemented in various forms of display such as a liquid crystal display (LCD), organic light emitting diode (OLED) display, active matrix-OLED (AM-OLED), plasma display panel (PDP), and so on. The display panel <NUM> may be implemented flexible, transparent, or wearable.

The display <NUM> may be combined with at least one of a touch panel <NUM> and a pen recognition panel <NUM>, and thus provided as the flexible display <NUM> that can sense the contact touch or the contactless touch.

For example, the flexible display <NUM> may include an integrated module of the display panel <NUM> coupled with at least one of the touch panel <NUM> and the pen recognition panel <NUM> in a stack structure.

The flexible display <NUM> may sense the hovering gesture which is a contact touch and a contactless touch. The flexible display <NUM> may sense the contact touch and the contactless touch made by the input unit <NUM> as well as user's fingers.

The memory <NUM> may include at least one of an internal memory (not illustrated) and an external memory (not illustrated).

The internal memory may include at least one of a volatile memory (e.g., dynamic RAM (DRAM)), static RAM (SRAM), synchronous dynamic RAM (SDRAM), and so on), a non-volatile memory (e.g., one time programmable ROM (OTPROM), programmable ROM (PROM), erasable and programmable ROM (EPROM), electrically erasable and programmable ROM (EEPROM), mask ROM, flash ROM, and so on), a hard disk drive (HDD) or a solid state drive (SSD).

The processor <NUM> may load and process the command or the data received from at least one of the non-volatile memory or the other element. The processor <NUM> may store the data received, or generated from the other element in the non-volatile memory.

The external memory may include at least one of compact clash (CF), secure digital (SD), micro-SD, mini-SD, extreme digital (xD) and memory stick.

The memory <NUM> may store various programs and data used for the operation of the electronic device <NUM>. For example, the memory <NUM> may store at least a portion of the contents to be displayed on the lock screen temporarily or semi-permanently. The memory <NUM> may store the information or the table necessary for determining a hovering point corresponding to the hovering gesture of a user.

The sensor <NUM> senses the folding state of the electronic device <NUM>. For example, the sensor <NUM> may sense the folding state or un-folding state by using the hall sensor or the magnetic sensor provided at the folding structure.

The sensor <NUM> measures the bending angle or the folding angle (or spreading angle) of the electronic device <NUM>. The sensor <NUM> may detect the position of the folding line which serves as a reference for the bending or folding of the electronic device <NUM>. The sensor <NUM> may include state sensors at such points that the state sensors are brought into proximity to each other by the bending or the folding of the electronic device <NUM>, and thus can sense the folding state. The state sensor may include at least one of a near field sensor, an illumination sensor, a magnetic sensor, a hall sensor, a touch sensor, a bending sensor and an infrared sensor, or a combination of the above.

According to another embodiment of the present disclosure, some of the functions of the sensor <NUM> may be performed at the processor <NUM>. For example, the sensor <NUM> may provide various measured sensed values to the processor <NUM>, and the processor <NUM> may detect the position of the folding line, or sense the folding state of the electronic device <NUM> by using the provided sensed values.

The sensor <NUM> may sense the folding state of a housing of the electronic device <NUM> by using the hall sensor or the magnetic sensor provided at the folding structure of the electronic device <NUM>. When the electronic device <NUM> is provided with the hinge structure, the folding angle may be measured from the hinge structure. The sensor <NUM> may include state sensors at such points that the state sensors are brought into proximity to each other by the bending or the folding of the housing of the electronic device <NUM>, and thus can sense the bending state or the folding state. The state sensor may include at least one of a near field sensor, an illumination sensor, a magnetic sensor, a hall sensor, a touch sensor, a bending sensor and an infrared sensor, or a combination of the above. The sensor <NUM> may sense the position of the folding line which serves as a reference for the bending or the folding of the housing.

The communicator <NUM> may communicate with various types of external devices according to various manners of communication. The communicator <NUM> may include at least one of a WiFi chip <NUM>, a Bluetooth chip <NUM>, a wireless communication chip <NUM>, and a near field communication (NFC) chip <NUM>. The processor <NUM> may transmit and receive calls and messages to and from various external devices by using the communicator <NUM>.

The WiFi chip <NUM> and the Bluetooth chip <NUM> may perform communication according to WiFi and Bluetooth schemes, respectively. When using the WiFi chip <NUM> or the Bluetooth chip <NUM>, various connecting information such as service set identifier (SSID), session key, and so on may be first transmitted and received, so that connection for communication may be made by using the same for the transmission and reception of various data. The wireless communication chip <NUM> refers to a chip that performs communication according to the various communication standards such as institute of electrical and electronics engineers (IEEE), Zigbee, 3rd generation (<NUM>), 3rd generation partnership project (3GPP), and long term evolution (LTE). The NFC chip <NUM> refers to a chip that operates in an NFC scheme, using <NUM> bandwidth among various radio frequency (RF)-ID frequency bandwidths such as <NUM>, <NUM>. <NUM>, <NUM>, <NUM>~<NUM>, <NUM>, and so on.

The video processor <NUM> may process content received through the communicator <NUM> or the video data included in the content stored in the memory <NUM>. The video processor <NUM> may perform various image-processing regarding the video data, such as decoding, scaling, noise-filtering, frame rate converting, resolution conversion, and so on.

The audio processor <NUM> may process content received through the communicator <NUM> or the audio data included in the content stored in the memory <NUM>. The audio processor <NUM> may perform various processing regarding the audio data, such as decoding, amplifying, noise filtering, and so on.

The processor <NUM> may drive the video processor <NUM> and the audio processor <NUM> to play back the corresponding content, when the play-back program regarding the multimedia content is implemented. The speaker <NUM> may output the audio data generated at the audio processor <NUM>.

The input unit <NUM> may receive various commands from a user. The input unit <NUM> may include at least one of a key <NUM>, the touch panel <NUM> and the pen recognition panel <NUM>.

The touch panel <NUM> may sense a user gesture, and output an event value corresponding to the sensed gesture. The touch panel <NUM> may receive a user gesture including at least one of a hovering gesture, a tap gesture, a touch and hold gesture, a double tap gesture, a drag gesture, a panning gesture, and a flick gesture. In the case of a touch screen (not illustrated) combining the touch panel <NUM> with the display panel <NUM>, the touch screen may be realized with various types of touch sensors such as capacitive sensors, resistive sensors, piezoelectric sensors, and the like.

The capacitive type uses a dielectric material coated on the surface of the touch screen, and senses the micro electricity excited by part of the user body as it touches on the surface of the touch screen and calculates a touch coordinate. The resistive type includes two electrode plates embedded within the touch screen, and senses an electric current flow as the user touches on the screen and the upper and the lower plates at the touched point are brought into contact each other, and calculates a touch coordinate. The touch event generated on the touch screen may be generated by the human finger mainly, although the touch event may also be generated by a conductive material that can cause capacitance changes.

The key <NUM> may include various forms of keys such as mechanical buttons and wheels formed on various areas such as front, side, and back, of the exterior main body of the electronic device <NUM>.

The pen recognition panel <NUM> may sense a pen approaching input or a pen touch input according to a maneuvering of the user touch pen (e.g., stylus pen, digitizer pen), and output the sensed pen approaching event or pen touch event. The pen recognition panel <NUM> may be implemented so as to accommodate the active manner or the passive manner according to an inputting manner of the touch pen. The active manner involves embedding a battery or a coil within the touch pen, in which the pen recognition panel <NUM> can sense a touch or approaching according to changes in the magnitude of the electromagnetic field as these are caused in response to the approaching or the touching. The passive manner involves sensing approaching or touch input of a touch pen, by using the conductive property of the touch pen itself and without separately providing an internal element.

For example, the active manner may include an EMR manner. In this case, a pen recognition panel <NUM> may include an electromagnetic induction coil sensor (not illustrated) having a grid structure, and an electromagnetic signal processor (not illustrated) providing an alternating current (AC) signal of a predetermined frequency to respective loop coils of the electromagnetic induction coil sensor in a sequential order. When a pen with a resonance circuit embedded therein is present in the vicinity to the loop coils of the pen recognition panel <NUM>, the magnetic field transmitted from the corresponding loop coils generates electric current at the resonance circuit within the pen based on the mutual electromagnetic induction. Based on this current, an induction field is generated from the coils of the resonance circuit within the pen, and the pen recognition panel <NUM> detects this induction field from the loop coil in a signal reception state. Accordingly, the approaching position or touching position of the pen may be sensed. The pen recognition panel <NUM> may be provided on a lower portion of the display panel <NUM>, while having a predetermined area that can cover a display area of the display panel <NUM>, for example.

The microphone <NUM> may receive an input of the user voice or other sounds and convert into audio data. The processor <NUM> may use the user voice inputted through the microphone <NUM> for a call operation, or convert it into the audio data and store in the memory <NUM>.

The camera <NUM> may photograph still image or video according to controlling of a user. The cameras <NUM> may be implemented as a plurality of cameras such as a front camera and a rear camera.

When the camera <NUM> and the microphone <NUM> are provided, the processor <NUM> may perform controlling operation according to the user voice inputted through the microphone <NUM> or the user motion recognized by the camera <NUM>. For example, the electronic device <NUM> may operate in a motion control mode or a voice control mode. When operating in the motion control mode, the processor <NUM> may photograph a user by activating the camera <NUM>, track the change in the user motion, and perform controlling operations accordingly. When operating in the voice control mode, the processor <NUM> may analyze the user voice inputted through the microphone <NUM>, and perform controlling operation according to the analyzed user voice.

The motion sensor <NUM> may sense the movement of the main body of the electronic device <NUM>. The electronic device <NUM> may rotate or tilt in various directions. The motion sensor <NUM> may sense motion characteristics such as rotating direction, angle, inclination, and so on, by using at least one of various sensors such as geomagnetic sensor, gyro sensor, acceleration sensor, and so on.

Although not illustrated in <FIG>, the electronic device <NUM> may include a universal serial bus (USB) port that can be connected to a USB connector, various external input ports that can connect to various external components such as headset, mouse and local area network (LAN), digital multimedia broadcasting (DMB) chip which receives and processes DMB signals, other various sensors, and the like.

The constituent elements of the electronic device <NUM> described above may be named differently. Further, the electronic device <NUM> according to an embodiment may be configured by including at least one of the constituent elements described above, and some of the constituent elements may be omitted or other additional constituent element may be added.

The processor <NUM> of <FIG> may correspond to the processor <NUM> of <FIG>, and the sensor <NUM> of <FIG> may correspond to the state sensor <NUM> of <FIG>. The display <NUM> of <FIG> may be combined with at least one of the touch panel <NUM> and the pen recognition panel <NUM> of <FIG>, which may correspond to the display <NUM> of <FIG>.

<FIG> is a flowchart of a method of an electronic device for processing a user gesture according to an embodiment of the present disclosure.

Referring to <FIG>, at operation S1701, the electronic device <NUM> may sense the first position in the first area and the second position in the second area according to the hovering gesture of a user on the flexible display.

At operation S1702, the electronic device <NUM> may determine a hovering point corresponding to the hovering gesture based on the sensed, first and second positions.

Referring to <FIG>, at operation S1801, the electronic device <NUM> senses the folding state of the electronic device <NUM>. The folding state may be in-bending state in which the electronic device <NUM> is bent inward, or out-bending state in which the electronic device <NUM> is bent outward.

At operation S1802, the electronic device <NUM> determines the folding area of the flexible display according to the folding state of the electronic device <NUM>. The folding area increases as the folding angle of the electronic device <NUM> increases. For example, the folding area may increase linearly or non-linearly in proportional to the increasing of the folding angle. As the folding angle increases, the folding area may increase in stages based on threshold values.

At operation S1803, the electronic device <NUM> determines if the hovering gesture of a user is sensed.

When the hovering gesture of a user is sensed at operation S1803, the electronic device <NUM> determines whether the hovering gesture of a user is performed within the folding area or outside the folding area, at operation S1804.

When the hovering gesture is determined to be performed within the folding area the folding area, at operation S1804, the electronic device <NUM> senses the first hovering position in the first area and the second hovering position in the second area according to the hovering gesture, at operation S1805. At operation S1806, the electronic device <NUM> determines a hovering point corresponding to the hovering gesture based on the first and second hovering positions.

When the hovering gesture is determined to be performed outside the folding area, at operation S1804, the electronic device <NUM> may sense the third hovering position in the first or the second area according to the hovering gesture, at operation S1815. At operation S1816, the electronic device <NUM> may determine the sensed third hovering position to be hovering point.

<FIG> are views of a screen of an electronic device displaying a UI on a folding area according to an embodiment of the present disclosure.

Referring to <FIG>, the electronic device <NUM> may be in an in-bending state in which the device <NUM> is bent inward. In this state, the processor <NUM> may sense at least one hovering position on the folding area <NUM> according to the hovering gesture of a user on the folding area <NUM> of the flexible display <NUM>. The processor <NUM> may determine a hovering point corresponding to the hovering gesture with the methods described above, based on at least one sensed hovering position.

For example, from the flexible display <NUM> divided into a first area <NUM> and a second area <NUM> based on the folding line <NUM>, the processor <NUM> may sense the first position in the first area <NUM> and the second position in the second area <NUM> according to the hovering gesture of a user. The processor <NUM> may determine a hovering point corresponding to the hovering gesture based on the sensed first and second positions.

The processor <NUM> may sense at least one position on the folding area according to the hovering gesture of a user. The processor <NUM> may determine a hovering point corresponding to the hovering gesture by correcting the sensed position. In this case, the processor <NUM> may control the flexible display <NUM> to display a UI on the hovering point determined from the folding area <NUM>.

For example, as illustrated in <FIG>, the processor <NUM> may control the flexible display <NUM> to newly display an indicator <NUM> (e.g., cursor, pointer, and insertion marker) representing the position designated by a user, or move the indicator from other position and display the same. As illustrated in <FIG>, the processor <NUM> may control the flexible display <NUM> to newly display an item <NUM> interactive with a user (e.g., icon, content, etc.), or move the item from other position and display. In this case, the flexible display <NUM> may display the item <NUM> so that the center area of the item <NUM> is positioned on the hovering point, or so that one side or one edge of the item <NUM> (e.g., upper-left position of the item) is positioned on the hovering point. When the item <NUM> is displayed, a user may input the touch gesture to select the item. The processor <NUM> may sense the touch gesture to select the item <NUM> on the folding area <NUM>. When the touch gesture of a user is sensed, the processor <NUM> may perform function corresponding to the selected item <NUM>.

Referring to <FIG>, the electronic device <NUM> may be in an out-bending state in which the device is bent outward. In this state, when the hovering gesture of a user is inputted on the folding area <NUM> of the flexible display <NUM>, the processor <NUM> may sense at least one hovering position on the folding area <NUM>. Next, the processor <NUM> may determine a hovering point corresponding to the hovering gesture based on at least one sensed hovering position, and control the flexible display <NUM> to display the UI on the determined hovering point.

For example, as illustrated in <FIG>, the processor <NUM> may control the flexible display <NUM> to newly display the indicator <NUM> representing the position designated by a user, or move the indicator from other position and display. As illustrated in <FIG>, the processor <NUM> may control the flexible display to newly display the item <NUM> interactive with a user, or move the item from other position and display the same. In this case, the flexible display <NUM> may display the item so that the center area of the item <NUM> can be positioned on the hovering point, or so that one side or one edge of the item <NUM> (e.g., the upper-left position of the item) is positioned on the hovering point. When the item <NUM> is displayed, the processor <NUM> may sense the touch gesture of a user to select the item <NUM> on the folding area <NUM>. In response to the touch gesture of a user, the processor <NUM> may perform function corresponding to the selected item <NUM>.

<FIG> and <FIG> are views of a screen of an electronic device displaying a drawing or handwriting on a folding area according to an embodiment of the present disclosure.

Referring to <FIG>, the electronic device <NUM> may be in an in-bending state in which the device is bent inward. In this state, the processor <NUM> may sense a plurality of hovering positions on the folding area <NUM> according to the movement of the hovering gesture of a user who draws or writes on the folding area <NUM> of the flexible display <NUM>. The processor <NUM> may determine a plurality of hovering points corresponding to the hovering gesture with the methods described above, based on a plurality of sensed hovering positions. The processor <NUM> may control the flexible display <NUM> to display the drawing result or the handwriting result <NUM> on the folding area <NUM> according to the determined hovering points. When the determined hovering points are discrete, the processor <NUM> may control the flexible display <NUM> to connect the determined hovering points and display the consecutive drawing result or handwriting result.

Referring to <FIG>, the electronic device <NUM> may be in an out-bending state in which the device is bent outward. In this state, the processor <NUM> may sense a plurality of hovering positions on the folding area <NUM> according to the hovering gesture of a user who draws or writes on the folding area <NUM> of the flexible display <NUM>, and determine a plurality of hovering points corresponding to the hovering gesture based on a plurality of sensed hovering positions. The processor <NUM> may control the flexible display <NUM> to display the drawing result or the handwriting result <NUM> on the folding area <NUM> according to the determined hovering points.

<FIG> are views of a screen of an electronic device selecting an item displayed on a folding area according to an embodiment of the present disclosure.

Referring to <FIG>, the electronic device <NUM> may be in an in-bending state in which the device is bent inward. In this state, referring to <FIG>, the processor <NUM> may control the flexible display <NUM> to display a plurality of items <NUM> (e.g., icons, content, and so on). At least a portion <NUM> of a plurality of items <NUM> may be positioned in the folding area <NUM>. When the hovering gesture is inputted on the folding area <NUM>, the processor <NUM> may determine a hovering point corresponding to the hovering gesture in the folding area <NUM> according to the hovering gesture. The processor <NUM> may control the flexible display <NUM> to display the item <NUM> positioned on the hovering point in highlighting.

When a user performs touch to select the highlighted item <NUM>, the processor <NUM> may sense the user touch gesture to select the highlighted item <NUM>, as illustrated in <FIG>.

In response to the user touch gesture, the processor <NUM> may display the application implementing screen <NUM> corresponding to the selected item <NUM>, as illustrated in <FIG>.

According to another embodiment of the present disclosure, referring to <FIG>, the electronic device <NUM> may be in an out-bending state in which the device is bent outward. In this state, referring to <FIG>, the processor <NUM> may control the flexible display <NUM> to display a plurality of items <NUM>. At least a portion <NUM> of a plurality of items <NUM> may be positioned in the folding area <NUM>. In this case, the processor <NUM> may determine a hovering point corresponding to the hovering gesture in the folding area <NUM>, according to the hovering gesture on the folding area <NUM>. The processor <NUM> may control the flexible display <NUM> to highlight the item <NUM> positioned on the hovering point.

Referring to <FIG>, the processor <NUM> may sense the user touch gesture to select the highlighted item <NUM>. In response to the user touch gesture, the processor <NUM> may display the application implementing screen <NUM> corresponding to the selected item <NUM>, as illustrated in <FIG>.

<FIG> are views provided to explain a method of an electronic device for recognizing a movement of a hovering point according to an embodiment of the present disclosure.

Referring to <FIG>, the electronic device <NUM> may be in an in-bending state in which the device is bent inward. In this circumstance, the processor <NUM> may sense a hovering gesture of a user who moves on the folding area <NUM> of the flexible display <NUM> by using the inputting means <NUM>. In this case, the processor <NUM> may determine a plurality of hovering points in the folding area <NUM>, according to the movement of the hovering gesture. The processor <NUM> may determine a plurality of hovering gestures corresponding to the hovering gesture, based on a plurality of sensed hovering positions.

The processor <NUM> may determine the moving direction (v1) of the hovering gesture based on the trajectory of the hovering points determined over time.

The processor <NUM> may determine the moving direction (v1) of the hovering gesture based on the motion characteristic of the inputting means <NUM>. For example, the motion characteristic of the inputting means <NUM> such as inclination, acceleration or moving direction may be sensed with the value measured in the sensor equipped in the inputting means <NUM>. The processor <NUM> may determine the moving direction (v1) of the hovering gesture based on at least one of a plurality of hovering points and the motion characteristics according to the movement of the user hovering gesture.

The processor <NUM> may selectively use the motion characteristics of the inputting means <NUM> in order to determine the moving direction (v1) of the hovering gesture. For example, the processor <NUM> may usually determine the moving direction (v1) of the hovering gesture based on the trajectory of a plurality of hovering points. However, when the values measured by the electrodes according to the hovering gesture respectively sensed in the first area <NUM> and the second area <NUM> based on the folding line <NUM> are the same or almost the same as one another (e.g., when the measured values are within a certain range), the processor <NUM> may determine the moving direction of the hovering gesture by using the motion characteristic of the inputting means <NUM>.

For example, referring to <FIG>, when the values (m1, m2) measured in the first area <NUM> and the second area <NUM> according to the hovering gesture at time point t+<NUM> are the same or almost the same as each other, the processor <NUM> may determine one measured value (m1) among the measured values according to the hovering gesture to be hovering point corresponding to the moved hovering gesture based on the motion characteristic of the inputting means <NUM>. The processor <NUM> may determine the moving direction (v1) of the hovering gesture based on the hovering point determined at time point t and another hovering point determined at time point t+<NUM>.

Referring to <FIG>, the electronic device <NUM> may be in an in-bending state in which the device <NUM> is bent inward. In this circumstance, the processor <NUM> may sense a hovering gesture of a user who moves on the folding area <NUM> of the flexible display <NUM> by using the inputting means <NUM>. In this case, the processor <NUM> may determine a plurality of hovering points in the folding area <NUM>, according to the movement of the hovering gesture. The processor <NUM> may determine a plurality of hovering gestures corresponding to the hovering gesture, based on a plurality of sensed hovering positions.

The processor <NUM> may determine the moving direction (v2) of the hovering gesture based on the trajectory of the hovering points determined over time.

The processor <NUM> may determine the moving direction of the hovering gesture based on the motion characteristic of the inputting means <NUM>.

Referring to <FIG>, when the values (m3, m4) measured in the first area <NUM> and the second area <NUM> according to the hovering gesture at time point t+<NUM> are the same or almost the same as each other, the processor <NUM> may determine one measured value (m3) among the measured values according to the hovering gesture to be hovering point corresponding to the moved hovering gesture based on the motion characteristic of the inputting means <NUM>. The processor <NUM> may determine the moving direction (v2) of the hovering gesture based on the hovering point determined at time point t and another hovering point determined at time point t+<NUM>.

<FIG> are views of a screen of an electronic device displaying a UI in response to a movement of a hovering gesture according to an embodiment of the present disclosure.

Referring to <FIG> and <FIG>, the electronic device <NUM> may be in an in-bending state in which the device <NUM> is bent inward. In this circumstance, the processor <NUM> may sense a hovering gesture of a user who moves on the folding area <NUM> of the flexible display <NUM> by using the inputting means <NUM>. In this case, the processor <NUM> may determine a plurality of hovering points in the folding area <NUM>, according to the movement of the hovering gesture. The processor <NUM> may determine a plurality of hovering points corresponding to the hovering gesture with the methods described above, based on a plurality of sensed hovering positions.

The processor <NUM> may determine the moving direction of the hovering gesture based on at least one of a plurality of hovering points and the motion characteristics with the methods described above with reference to <FIG>.

The processor <NUM> may display the UI or the graphic on the position corresponding to the moved hovering gesture based on the determined moving direction of the hovering gesture.

For example, as illustrated in <FIG>, when the hovering gesture is moved toward a certain direction (v3), the processor <NUM> may determine a hovering point corresponding to the hovering gesture at time point t. The processor <NUM> may wait until time point t+<NUM> and determine the moving direction of the hovering gesture from time point t to time point t+<NUM>. For example, the moving direction of the hovering gesture may be a vector direction from the hovering point determined at time point t to the hovering point determined at time point t+<NUM>. The processor <NUM> may display a UI or the graphic indicating the moving trajectory of the hovering gesture at time point t+<NUM> based on the moving direction of the hovering gesture. In this case, the time delay (t+<NUM>) - (t) may be generated since performing of the hovering gesture until the displaying of UI or the graphic. However, the UI or the graphic may be displayed on the position where the intention of the user performing the hovering gesture is correctly reflected.

Referring to <FIG>, when the hovering gesture is moved toward a certain direction (v4), the processor <NUM> may determine a hovering point corresponding to the hovering gesture at time point t. The processor <NUM> may determine the moving direction of the hovering gesture based on the history of the hovering point. For example, the moving direction of the hovering gesture may be vector direction from the hovering point determined at time point t-<NUM> to the hovering point determined at time point t. The processor <NUM> may display a UI indicating the moving trajectory of the hovering gesture at time point t based on the moving direction of the hovering gesture. In this case, because the history of the hovering point in which the hovering gesture is previously performed is used without using additional waiting time, the time delay from performing of the hovering gesture until displaying of the UI or the graphic can be minimized.

The methods described above with reference to <FIG> and <FIG> may be combined. For example, when the hovering gesture is moved toward a certain direction, the processor <NUM> may display the UI or the graphic on the positions corresponding to the moved hovering gesture by using the method in <FIG> until the history of the moved hovering point is accumulated for a certain time (e.g., <NUM> sec to <NUM> sec) or longer. When the history of the hovering point is accumulated for a certain time or longer, the processor <NUM> may display the UI or the graphic on the positions corresponding to the moved hovering gesture by using the method in <FIG>.

When the hovering gesture is moved toward a certain direction, the processor <NUM> may determine the moving direction of the hovering gesture based on the motion characteristic of the inputting means <NUM> performing the hovering gesture. For example, the processor <NUM> may obtain the measured values related with the inclination direction of the inputting means <NUM>, and determine the moving direction of the hovering gesture based on the obtained values. The processor <NUM> may display the UI or the graphic indicating the moving trajectory according to the hovering gesture based on the moving direction of the hovering gesture.

The hovering gesture may be moved to the folding area <NUM> from the first area <NUM> or the second area <NUM> which are outside the folding area <NUM> based on the folding line <NUM>. In this case, the processor <NUM> may display the UI or the graphic indicating the moving trajectory according to the movement of the hovering gesture on the folding area <NUM> based on the moving direction of the hovering gesture determined in the first area <NUM> or the second area <NUM> which are outside the folding area <NUM>. For example, based on the moving direction of the hovering gesture determined in the first area <NUM> which is outside the folding area <NUM>, the processor <NUM> may display the UI or the graphic indicating the moving trajectory of the hovering gesture on the folding area <NUM> to be positioned on the extended line of the moving direction.

Referring to <FIG>, the electronic device <NUM> may be in the out-bending state in which the device is bent outward. In this case, the processor <NUM> may sense a hovering gesture of a user who moves on the folding area <NUM> of the flexible display <NUM> by using the inputting means <NUM>. The processor <NUM> may determine a plurality of hovering points in the folding area <NUM>, according to the movement of the hovering gesture. The processor <NUM> may determine a plurality of hovering points corresponding to the hovering gesture with the methods described above, based on a plurality of sensed hovering positions.

The processor <NUM> may determine the moving direction of the hovering gesture based on at least one of a plurality of hovering points and motion characteristics, and display a UI or a graphic on the positions corresponding to the hovering gesture in motion, based on the determined moving direction.

For example, as illustrated in <FIG>, when the hovering gesture is moved toward a certain direction (v5), the processor <NUM> may determine a hovering point corresponding to the hovering gesture at time point t. The processor <NUM> may wait until time point t+<NUM> and determine the moving direction of the hovering gesture from time point t to time point t+<NUM>. The processor <NUM> may display the UI or the graphic indicating the moving trajectory of the hovering gesture at time point t based on the moving direction of the hovering gesture.

Referring to <FIG>, when the hovering gesture is moved toward a certain direction (v6), the processor <NUM> may determine a hovering point corresponding to the hovering gesture at time point t. The processor <NUM> may determine the moving direction of the hovering gesture based on the history of the hovering point. For example, the moving direction of the hovering gesture may be vector direction from the hovering point determined at time point t-<NUM> to the hovering point determined at time point t. The processor <NUM> may display the UI or the graphic indicating the moving trajectory of the hovering gesture at time point t based on the moving direction of the hovering gesture.

The methods described above with reference to <FIG> may be combined. For example, until the history of the moved hovering points are accumulated for more than a certain time, the UI or the graphic may be displayed on the position corresponding to the moved hovering gesture by using the method in <FIG>. When the history of the hovering point is accumulated for a certain time or longer, the processor <NUM> may display the UI or the graphic on the positions corresponding to the moved hovering gesture by using the method in <FIG>.

<FIG> is a flowchart provided to explain a method of an electronic device <NUM> for processing a user gesture according to another embodiment of the present disclosure.

At operation S2801, the electronic device <NUM> may determine if at least one hovering position is sensed on the folding area <NUM> according to the user hovering gesture on the folding area <NUM> including the folding line <NUM>.

At operation S2802, when the hovering position is sensed, the electronic device <NUM> may determine a hovering point corresponding to the hovering gesture by correcting the sensed hovering position.

At operation S2803, the electronic device <NUM> may display the UI or the graphic on the determined hovering point.

At operation S2901, the electronic device <NUM> may determine if a plurality of hovering positions are sensed on the folding area <NUM> according to the user hovering gesture on the folding area <NUM> including the folding line <NUM>.

At operation S2902, the electronic device <NUM> may determine a plurality of hovering points by correcting a plurality of hovering positions.

At operation S2903, the electronic device <NUM> may determine the moving direction of the hovering gesture based on a plurality of determined hovering points. In this case, the electronic device <NUM> may display UI or the graphic indicating the moving trajectory of the hovering gesture according to the moving direction of the hovering gesture.

At operation S3001, the electronic device <NUM> may sense the hovering gesture of a user using the inputting means on the folding area <NUM>.

At operation S3002, when the motion characteristic of the inputting means is sensed, the electronic device <NUM> may determine the moving direction of the hovering gesture based on the motion characteristic of the inputting means.

The various embodiments and all of the function operations described herein may be implemented within a digital electronic circuit, or within a computer software, firmware, or hardware comprising the structures achieved herein or equivalent structures of these, or a combination of one or more of these.

A non-transitory computer readable recording medium may be an arbitrary available medium storing that is accessible by a computer, and the computer readable recording medium encompasses a volatile and non-volatile medium, removable and non-removable medium. Further, the non-transitory computer readable recording medium may encompass a computer recording medium and communication medium. The computer recording medium encompasses volatile and non-volatile, removable and non-removable medium that is realized with an arbitrary method or technology for the storage of information such as computer readable commands, data structure, program modules or other data. The communication medium includes computer readable commands, data structure, program module, or other data of the modified data signal.

Claim 1:
A method of an electronic device (<NUM>) for processing a gesture, the method comprising:
in response to an input of a hovering gesture to a folding area (<NUM>), which is determined (S1802) according to a sensed (S1801) folding state of the electronic device (<NUM>) and includes a folding line (<NUM>) of a flexible display (<NUM>) of the electronic device (<NUM>), being input (S1803) while the flexible display (<NUM>) is folded with reference to the folding line (<NUM>), wherein the flexible display (<NUM>) is divided in response to folding of the electronic device (<NUM>) into a first area (<NUM>) and a second area (<NUM>) with reference to the folding line (<NUM>), determining whether the hovering gesture is performed within the folding area (<NUM>), wherein the folding area (<NUM>) includes a portion of each of the first area (<NUM>) and the second area (<NUM>), and sensing (S1805) a position of the hovering gesture in the first area (<NUM>) and the second area (<NUM>), respectively; and
determining a hovering point corresponding to the hovering gesture, based on the sensed positions of the first area (<NUM>) and the second area (<NUM>), respectively
wherein a size of the folding area (<NUM>) is increased together as a folding angle of the electronic device (<NUM>) is increased.