Mobile device and method of controlling the same

The present disclosure discloses a mobile device and a method of controlling the same. In this case, the mobile device according to the present invention includes a sensor unit configured to detect a first action and a second action of a user to fold the mobile device, a control unit configured to control a folding indicator to be outputted on a screen according to the detected first action of the user, configured to control a function corresponding to the detected second action to be executed, configured to control data resulted from executing the function to be outputted on the screen, configured to control the mobile device based on the outputted data, and a display configured to output the folding indicator and the data resulted from executing the function.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is the National Stage filing under 35 U.S.C. 371 of International Application No. PCT/KR2014/001730, filed on Mar. 3, 2014, the contents of which are all hereby incorporated by reference herein in their entirety.

TECHNICAL FIELD

The present invention relates to a mobile device and a method of controlling the same, and more particularly, to a method of controlling the mobile device according to folding of the mobile device.

BACKGROUND ART

Efforts are ongoing to support and increase the functionality of mobile terminals. Such efforts include software and hardware improvements, as well as changes and improvements in the structural components.

A legacy display is mainly used for a monitor of a TV or a PC only. Yet, as a mobile market is rapidly developing, a study on the display used for a smartphone or a tablet PC is vitalizing.

Until a recent date, interest in a display technology has been focused on a resolution. For instance, product satisfaction and sales volume of a smartphone or a tablet PC are considerably affected by a resolution of a display adopted to the smartphone or the tablet PC. The interest in the resolution can be easily seen by interest in such a display as a digital TV supporting a recently highlighted UHD, i.e., ultra high definition resolution, and the like.

Meanwhile, in a point of view different from the resolution, a display can be described as follows. A legacy display is mostly made of a flat and hard material in a square-shape. Yet, according to a recent display technology, a display device is evolving to a device having flexibility and capable of being folded instead of the legacy display. The development of the display technology is contributing to commercialization of a wearable device together with formation and development of the mobile market.

Yet, according to a currently introduced display technology, since a folding is implemented in an angle within a prescribed range only or the folding is performed for a specific area only, the currently introduced technology is used only for a purpose of making a user more concentrate on a screen or the like.

Hence, if a foldable display is adopted according to the development of a wearable device or a mobile device for which a recent study is vitalizing and relevant market is forming, it may cause a problem since a concrete method of using the foldable display or the like is not defined yet.

DISCLOSURE OF INVENTION

Technical Problem

The present invention is proposed to satisfy the aforementioned necessity. One object of the present invention is to provide a mobile device configured to perform an operation according to folding of the mobile device and a method of controlling the same.

According to at least one of embodiments of the present invention, another object of the present invention is to output data consistent with an intention of a user according to a folding action of the user.

According to at least one of embodiments of the present invention, another object of the present invention is to perform various control operations according to a single folding action and multi-folding actions of a user.

According to at least one of embodiments of the present invention, another object of the present invention is to perform various control operations according to a folding angle, a folding number, and the like for a folding action of a user.

According to at least one of embodiments of the present invention, the other object of the present invention is to provide a function consistent with a folding action of a user in accordance with content currently using on a screen and data according to the function.

Solution to Problem

To achieve these and other advantages and in accordance with the purpose of the present invention, as embodied and broadly described, a method of controlling a mobile device includes the steps of detecting a first action of a user, outputting a folding indicator on a screen according to the detected first action of the user, detecting a second action of the user, executing a function corresponding to the detected second action and outputting data resulted from executing the function on the screen, and controlling the device based on the outputted data.

In the foregoing description, the folding indicator may include at least one of one or more foldable lines and data on a function corresponding to the at least one foldable line on the screen.

And, the data resulted from executing the function can be outputted in one or more areas which are divided according to the second action of the user on the screen.

And, each area divided on the screen can be individually controlled according to a third action of the user.

And, the second action includes at least one action of an action for a single folding and an action for multi-folding. The multi-folding can include at least one of folding for an identical foldable line and folding for foldable lines different from each other.

And, the function corresponding to the detected second action may vary according to whether the detected second action corresponds to the action for the single folding or the action for the multi-folding.

And, the executed function can be determined according to at least one selected from the group consisting of a folding line, a folding angle, and the number of folding.

And, the method may further include one or more steps of identifying a folding line on the screen according to the detected second action of the user, comparing the identified folding line with a folding line to execute a specific function on the screen, and if the folding lines are positioned within a predetermined range according to the comparison, generating the data to execute the function.

And, the step of executing the function corresponding to the detected second action and outputting the data resulted from executing the function on the screen is to generate an auxiliary data for the data resulted from executing the function and output the auxiliary data on the screen together with the data resulted from executing the function.

And, the method may further include the steps of identifying at least one object capable of being selected or separated from content outputted on the screen and outputting the identified at least one object in one area among the areas divided by the second action of the user on the screen in a manner of separating the identified at least one object from the content.

To further achieve these and other advantages and in accordance with the purpose of the present invention, a mobile device includes a sensor unit configured to detect a first action and a second action of a user to fold the mobile device, a control unit configured to control a folding indicator to be outputted on a screen according to the detected first action of the user, configured to control a function corresponding to the detected second action to be executed, configured to control data resulted from executing the function to be outputted on the screen, and configured to control the mobile device based on the outputted data, and a display configured to output the folding indicator and the data resulted from executing the function.

In the foregoing description, the folding indicator may include at least one of one or more foldable lines and data on a function corresponding to the at least one foldable line on the screen.

And, the control unit can control the data resulted from executing the function to be outputted in one or more areas which are divided according to the second action of the user on the screen.

And, the control unit can individually control each area divided on the screen according to a third action of the user.

And, the second action includes at least one action of an action for a single folding and an action for multi-folding and the multi-folding may include at least one of folding for an identical foldable line and folding for foldable lines different from each other.

And, the control unit can control the function corresponding to the detected second action to be differently executed according to whether the detected second action corresponds to the action for the single folding or the action for the multi-folding.

And, the control unit can determine the executed function according to at least one selected from the group consisting of a folding line, a folding angle, and the number of folding.

And, the control unit identifies a folding line on the screen according to the detected second action of the user, compares the identified folding line with a folding line to execute a specific function on the screen, and if the folding lines are positioned within a predetermined range according to the comparison, can generate the data to execute the function.

And, the control unit executes the function corresponding to the detected second action, outputs the data resulted from executing the function on the screen, generates an auxiliary data for the data resulted from executing the function, and can control the auxiliary data to be outputted on the screen together with the data resulted from executing the function.

And, the control unit identifies at least one object capable of being selected or separated from content outputted on the screen and can control the identified at least one object to be outputted in one area among the areas divided by the second action of the user on the screen in a manner of separating the identified at least one object from the content.

Advantageous Effects of Invention

Accordingly, a mobile device and a method of controlling the same according to the present invention provide the following effects or advantages.

First of all, according to at least one of embodiments of the present invention, it is able to output data consistent with an intention of a user according to a folding action of the user.

According to at least one of embodiments of the present invention, it is able to perform various control operations according to a single folding action and multi-folding actions of a user.

According to at least one of embodiments of the present invention, it is able to perform various control operations according to a folding angle, a folding number, and the like for a folding action of a user.

According to at least one of embodiments of the present invention, it is able to provide a function consistent with a folding action of a user in accordance with content currently using on a screen and data according to the function.

BEST MODE FOR CARRYING OUT THE INVENTION

Reference is now made toFIGS. 1a-1c, whereFIG. 1ais a block diagram of a mobile terminal in accordance with the present disclosure, andFIGS. 1band 1care conceptual views of one example of the mobile terminal, viewed from different directions.

The sensing unit140is typically implemented using one or more sensors configured to sense internal information of the mobile terminal, the surrounding environment of the mobile terminal, user information, and the like. For example, inFIG. 1a, the sensing unit140is shown having a proximity sensor141and an illumination sensor142.

The broadcast managing entity may be implemented using a server or system which generates and transmits a broadcast signal and/or broadcast associated information, or a server which receives a pre-generated broadcast signal and/or broadcast associated information, and sends such items to the mobile terminal. The broadcast signal may be implemented using any of a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and combinations thereof, among others. The broadcast signal in some cases may further include a data broadcast signal combined with a TV or radio broadcast signal.

The broadcast signal may be encoded according to any of a variety of technical standards or broadcasting methods (for example, International Organization for Standardization (ISO), International Electrotechnical Commission (IEC), Digital Video Broadcast (DVB), Advanced Television Systems Committee (ATSC), and the like) for transmission and reception of digital broadcast signals. The broadcast receiving module111can receive the digital broadcast signals using a method appropriate for the transmission method utilized.

Examples of broadcast associated information may include information associated with a broadcast channel, a broadcast program, a broadcast event, a broadcast service provider, or the like. The broadcast associated information may also be provided via a mobile communication network, and in this case, received by the mobile communication module112.

The broadcast associated information may be implemented in various formats. For instance, broadcast associated information may include an Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB), an Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H), and the like. Broadcast signals and/or broadcast associated information received via the broadcast receiving module111may be stored in a suitable device, such as a memory170.

In general, a 3D stereoscopic image may include a left image (e.g., a left eye image) and a right image (e.g., a right eye image). According to how left and right images are combined into a 3D stereoscopic image, a 3D stereoscopic imaging method can be divided into a top-down method in which left and right images are located up and down in a frame, an L-to-R (left-to-right or side by side) method in which left and right images are located left and right in a frame, a checker board method in which fragments of left and right images are located in a tile form, an interlaced method in which left and right images are alternately located by columns or rows, and a time sequential (or frame by frame) method in which left and right images are alternately displayed on a time basis.

Also, as for a 3D thumbnail image, a left image thumbnail and a right image thumbnail can be generated from a left image and a right image of an original image frame, respectively, and then combined to generate a single 3D thumbnail image. In general, the term “thumbnail” may be used to refer to a reduced image or a reduced still image. A generated left image thumbnail and right image thumbnail may be displayed with a horizontal distance difference there between by a depth corresponding to the disparity between the left image and the right image on the screen, thereby providing a stereoscopic space sense.

A left image and a right image required for implementing a 3D stereoscopic image may be displayed on the stereoscopic display unit using a stereoscopic processing unit. The stereoscopic processing unit can receive the 3D image and extract the left image and the right image, or can receive the 2D image and change it into a left image and a right image.

FIG. 2is a conceptual view of a deformable mobile terminal according to an alternative embodiment of the present invention. In this figure, mobile terminal200is shown having display unit251, which is a type of display that is deformable by an external force. This deformation, which includes display unit251and other components of mobile terminal200, may include any of curving, bending, folding, twisting, rolling, and combinations thereof. The deformable display unit251may also be referred to as a “flexible display unit.” In some implementations, the flexible display unit251may include a general flexible display, electronic paper (also known as e-paper), and combinations thereof. In general, mobile terminal200may be configured to include features that are the same or similar to that of mobile terminal100ofFIGS. 1a-1c.

The flexible display of mobile terminal200is generally formed as a lightweight, non-fragile display, which still exhibits characteristics of a conventional flat panel display, but is instead fabricated on a flexible substrate which can be deformed as noted previously.

The term e-paper may be used to refer to a display technology employing the characteristic of a general ink, and is different from the conventional flat panel display in view of using reflected light. E-paper is generally understood as changing displayed information using a twist ball or via electrophoresis using a capsule.

When in a state that the flexible display unit251is not deformed (for example, in a state with an infinite radius of curvature and referred to as a first state), a display region of the flexible display unit251includes a generally flat surface. When in a state that the flexible display unit251is deformed from the first state by an external force (for example, a state with a finite radius of curvature and referred to as a second state), the display region may become a curved surface or a bent surface. As illustrated, information displayed in the second state may be visual information output on the curved surface. The visual information may be realized in such a manner that a light emission of each unit pixel (sub-pixel) arranged in a matrix configuration is controlled independently. The unit pixel denotes an elementary unit for representing one color.

According to one alternative embodiment, the first state of the flexible display unit251may be a curved state (for example, a state of being curved from up to down or from right to left), instead of being in flat state. In this embodiment, when an external force is applied to the flexible display unit251, the flexible display unit251may transition to the second state such that the flexible display unit is deformed into the flat state (or a less curved state) or into a more curved state.

If desired, the flexible display unit251may implement a flexible touch screen using a touch sensor in combination with the display. When a touch is received at the flexible touch screen, the controller180can execute certain control corresponding to the touch input. In general, the flexible touch screen is configured to sense touch and other input while in both the first and second states.

One option is to configure the mobile terminal200to include a deformation sensor which senses the deforming of the flexible display unit251. The deformation sensor may be included in the sensing unit140.

The deformation sensor may be located in the flexible display unit251or the case201to sense information related to the deforming of the flexible display unit251. Examples of such information related to the deforming of the flexible display unit251may be a deformed direction, a deformed degree, a deformed position, a deformed amount of time, an acceleration that the deformed flexible display unit251is restored, and the like. Other possibilities include most any type of information which can be sensed in response to the curving of the flexible display unit or sensed while the flexible display unit251is transitioning into, or existing in, the first and second states.

In some embodiments, controller180or other component can change information displayed on the flexible display unit251, or generate a control signal for controlling a function of the mobile terminal200, based on the information related to the deforming of the flexible display unit251. Such information is typically sensed by the deformation sensor.

The mobile terminal200is shown having a case201for accommodating the flexible display unit251. The case201can be deformable together with the flexible display unit251, taking into account the characteristics of the flexible display unit251.

A battery (not shown in this figure) located in the mobile terminal200may also be deformable in cooperation with the flexible display unit261, taking into account the characteristic of the flexible display unit251. One technique to implement such a battery is to use a stack and folding method of stacking battery cells.

The deformation of the flexible display unit251not limited to perform by an external force. For example, the flexible display unit251can be deformed into the second state from the first state by a user command, application command, or the like.

First of all, in describing a mobile device and a method of controlling the same according to the present invention, the present disclosure describes activation of a function according to folding a part of a display and then describes relevant specific embodiment(s) in the following.

As mentioned in the foregoing description, the activation of the function according to the folding of the mobile device to which a flexible display is adopted is explained as follows.

A user of the mobile device to which the flexible display is adopted can variously fold a part of the display in the course of using the mobile device. Yet, although the part of the display is folded, a prescribed function is not always activated. This is because the mobile device is generally configured to execute a function mapped in advance when a prescribed area of the display is folded within a prescribed range according to a predetermined configuration only. Hence, although the user folds a part of the display, if the folded area does not correspond to a predetermined area or if a folding angle does not correspond to a predetermined angle, a certain function is activated or inactivated. Or, an unwanted function may be executed due to the action of the user.

Hence, it is necessary for the mobile device to identify an area in which a function is activated and a function to be activated as the part of the display is folded.

FIG. 3toFIG. 6is a diagram for explaining a folding area for a flexible display of a mobile device according to the present invention.

For instance,1-1′ to6-6′ depicted inFIG. 3may indicate an area capable of being folded on a display300.

In particular, among the1-1′ to6-6′,1-1′ to3-3′ indicates an area capable of being vertically folded and4-4′ to6-6′ indicates an area capable of being horizontally folded.

WhileFIG. 3explains a horizontal or vertical folding of a display on the basis of a display plane such as an orthogonal coordinate system,FIG. 4shows an implementation capable of folding corner areas of the display300.

Referring toFIG. 4, A-A′ indicates an area capable of being folded in the top left part of the display300, B-B′ indicates an area capable of being folded in the top right part of the display, C-C′ indicates an area capable of being folded in the bottom left part of the display, and D-D′ indicates an area capable of being folded in the bottom right part of the display.

FIG. 4is different fromFIG. 3in that the display300of a square-shape is not folded in a right angle form as depicted inFIG. 3.

Meanwhile,FIG. 5shows one embodiment that the aforementionedFIG. 3andFIG. 4are combined with each other.

In this case, the display300of the device can display an area capable of being folded as depicted inFIG. 3toFIG. 5for the convenience of folding of a user automatically or according to a request of the user.

And, in relation to the present invention, the areas capable of being folded maybe identically provided in general as depicted inFIG. 3toFIG. 5or maybe not. In the latter case, for instance, the areas capable of being folded may be not identically provided and activated. Instead, the areas capable of being folded are provided and activated in a specific area only to provide convenience to a user. This is because if the display is capable of being identically folded irrespective of a state of the display, it may cause inconvenience to the user due to an operation different from an intention of the user or occurrence of an error resulted from executing an unintended function.

Moreover, although it is not depicted in the present disclosure, a folding may include a single folding and multi-folding. Meanwhile, a mapping function to execute the single folding and the mapping function to execute the multi-folding may be different from each other.

In this case, for instance, the single folding indicates a case that a prescribed single area is folded only among a plurality of areas capable of being folded depicted inFIG. 3toFIG. 5and the multi-folding indicates a case that at least two areas are folded at the same time.

Meanwhile, in case of performing the multi-folding, although folding is performed for areas identical to each other, functions different from each other can be activated according to an order of the folding.

For instance, referring toFIG. 5, if A-A′ area corresponding to an area capable of being folded on a first area510of the bottom left part is firstly folded and then B-B′ area corresponding to an area capable of being folded on a second area520is folded, on the contrary, if B-B′ area is firstly folded and then A-A′ area is folded, an identical function may be executed in both cases. Or, a totally different function may be executed in each case.

Meanwhile, if folding is sequentially performed for two or more areas among the areas capable of being folded and time interval between a first folding and a second folding is within a predetermined time range, the device recognizes it as multi-folding and may be then able to execute a function configured according to the multi-folding.

On the contrary, despite the folding is performed for a plurality of areas, if the time interval between pluralities of the folding exceeds the predetermined time range, the device recognizes it as an individual single folding and may be then able to execute a function configured according to the single folding.

In this case, if each of the single folding is performed for a plurality of the areas, despite the folding is performed for an area identical to the area where a single folding is performed for a single area, a different function may be activated. On the contrary, if a single folding is performed for a plurality of the areas, respectively, a function configured to be performed for a corresponding area can be identically activated to meet user experience or memory for the single folding of the corresponding area.

Besides, if a single or multi-folding is performed for a certain part of the display, the device may differently operate according to whether each of the folding is sustained. For instance, a user of the device can continuously maintain folding after a prescribed area of the device is folded. On the other hand, the user of the device can cancel or release the folding within a predetermined time after the prescribed area of the device is folded. In the former case, for instance, in case that an E-book application is executed in the device, a user may put the device on a certain place instead of continuously carrying the device. In this case, the user may attempt to have convenience of using the device by folding an area of the device necessary for putting the device on. On the contrary, in the latter case, for instance, if brightness or an amount of volume adjustment of a certain area varies according to each folding, the user temporarily folds the area and releases the area again instead of continuously maintaining a folded state. As mentioned in the foregoing description, the device can differently control the display according to whether a folded state is sustained in the display or time of maintaining the folded state.

Meanwhile, the device may differently operate according to the number of folding. For instance, in case that folding and folding release are repeated for an area, the device may perform a different function according to the number of the folding the area. This can be mainly performed for an identical area but various operations can be defined and controlled in a manner of being combined with the folding number for a different area.

Moreover, in case that a single or multi-folding is performed for a certain area in the display, the device may differently operate according to a folding angle of each folding. For instance, as depicted inFIG. 6, assume that there exist two areas620/630in a manner that the display of the device is folded between610-610′. In this case, for instance, the display can be differently controlled according to the folding angle formed by a second area630on the basis of a first area620.

FIG. 7is a diagram for a display of a device seen from a side according to the present invention.

FIG. 7 (a)is a diagram for explaining a folding angle to be described in the following. In this case, the folding angle may correspond to either an angle of 45 degrees710or an angle of 135 degrees720. Yet, for clarity, if it is assumed that a first area becomes a reference and the first area is horizontally maintained with a flat surface, an angle710formed by the flat surface and a rear side of a second area is defined as the folding angle.

According to the aforementioned definition,FIG. 7 (a)shows the folding angle of 45 degrees,FIG. 7 (b)shows the folding angle of 30 degrees,FIG. 7 (c)shows the folding angle of 60 degrees, FIG. (d) shows the folding angle of 90 degrees,FIG. 7 (e)shows the folding angle of 120 degrees, andFIG. 7 (f)shows the folding angle of 135 degrees.

Hence, the device can be differently controlled according to a folding angle even in case of a single folding.

The aforementioned contents can also be identically applied to a multi-folding of the device as depicted inFIG. 6 (b).

For instance, referring toFIG. 6 (b), a first folding (610-610′) and a second folding (650-650′), i.e., multi-folding are performed in the display. Due to the multi-folding, there exist three areas660/670/680capable of outputting contents different from each other. In this case, as depicted inFIG. 7, a folding angle of each area can be known on the basis of an angle formed by areas contacted with each other. Or, as depicted inFIG. 6 (b), in case that there exist three areas, the folding angle of a different area can be known on the basis of a most core area or an area contacted with different areas most, e.g., an area660positioned at the middle of the display.

A folding is performed in the device to which a flexible display is adopted according to the aforementionedFIG. 3toFIG. 7.

In the following description, activation of a function according to a folding of the present invention is explained in more detail.

FIG. 8is a diagram for explaining an operation of a device in accordance with a difference between an area folded by a user and a folding area where a function is activated according to the present invention.

FIG. 8ashows a display of the device before a folding is performed,FIG. 8bshows the display where a folding is performed by a user, andFIG. 8cshows the display outputting an indicator830for the convenience of the folding performed by the user.

Referring toFIG. 8a, the display executes a function or an application. In this case, for instance, there exists an area810where a single folding can be performed in the display of a corresponding screen.

Yet, as depicted inFIG. 8b, if a user folds a different area820irrespective of whether the user knows the folding area810, there may exist a problem for the device to process the above situation.

The device may process the above situation in various ways.

If there exists one area capable of being folded only in the corresponding screen, an intention of the user may correspond to folding the area. Hence, as depicted inFIG. 8b, although the user has folded the different area820, the device considers it as folding for a folding area and may process it in a manner of being identical to a case that the folding area810is folded.

Or, the device compares the folding area810with the area820folded by the user. If a distance between the folding area and the area folded by the user is within a predetermined range, since it is difficult for the user to fold the area in a manner of exactly matching with the folding area, this can be determined as the intention of the user to fold the folding area810. If the distance exceeds the predetermined range, an operation performed in case that the folding area810is folded may not be performed despite the area is folded by the user. For instance, the above-mentioned content can also be utilized for a case that there exists a plurality of areas capable of being folded on a screen. In particular, the device determines which folding area is close to the area folded by the user among the areas capable of being folded to identify a folding intention of the user and can make an operation corresponding to the folding intention to be performed. If distances between the area folded by the user and two folding areas are exactly matched with each other, the device may consider it as an intention of folding one of the two folding areas or may not map to any folding area.

Hence, in order to avoid the aforementioned complexity, as depicted inFIG. 8c, the device informs the user of the folding area where a function is activated via an indicator830and the like in the corresponding screen and may accommodate folding convenience of the user. Meanwhile, although it is not depicted, if the folding indicator830is activated, the device may preferentially inform a user of a function or an application performed in case that the area is folded via surroundings of the indicator830, an audio, or the like to make the user identify the function or the application.

FIG. 9is a diagram for explaining one embodiment of controlling an operation of a device in accordance with folding of the device according to the present invention.

FIG. 9ashows a device before a folding is performed andFIG. 9bshows the device after the folding is performed.

For instance,FIG. 9relates to a method of controlling an operation of the device according to folding of the device in a screen where a virtual keyboard is required such as a contact application.

Meanwhile, referring toFIG. 9, the aforementioned virtual keyboard is provided to the user according to folding of the device and a focusing can move to a screen interlocked with an input inputted via the virtual keyboard.

Referring toFIG. 9a, as mentioned in the foregoing description, there exist a search window910and a folding area indicator920in a screen of the device. In this case, assume that the focusing does not exist in the search window910.

Referring toFIG. 9b, if a user folds a display according to the folding area indicator920, a virtual keyboard930is provided in a folded area and a focusing940moves to the search window910as the virtual keyboard930is provided in the folded area.

Hence, in a state that the display is folded as depicted inFIG. 9b, if the user pushes a prescribed button on the virtual keyboard930, the focusing940of the search window910moves and text data or the like can be provided to the user.

Meanwhile, although it is not depicted, if the folding area indicator920is provided in the screen, the user can randomly change/control the indicator920. For instance, when a predetermined indicator920is used, if a size of the virtual keyboard930provided after the display is folded is different from an intention of the user, the size of the virtual keyboard can be freely controlled before the display is folded. As an example, the user selects the indicator920and may be then able to configure the indicator in a manner of changing a position of the indicator to up/down or a different line. As the configuration of the indicator changes, the device stores the corresponding change in the device and can enable the focusing to be performed while providing the virtual keyboard after the display is folded as depicted inFIG. 9b.

And, a change control of the user performed for the folding area may or may not function as one-time only. In the latter case, the device analyzes a pattern of use of the user in a corresponding screen, determines a folding line different from the folding line configured in the process of manufacturing the device, and may be then able to provide the folding line to the user.

Meanwhile, a folding area and a virtual keyboard area provided according to folding are not always matched with each other. In particular, a screen interlocked with a function or an application, which is activated according to the folding, may exist in the folding area. It is not mandatory for the screen to be matched with a whole of the folding area.

FIG. 10is a diagram for explaining a different embodiment of controlling an operation of a device in accordance with folding of the device according to the present invention.

FIG. 10ashows a device before a folding is performed andFIG. 10bshows the device after the folding is performed.

For instance,FIG. 10relates to a method of controlling an operation of the device according to folding of the device in a screen on which a web application is provided and a virtual keyboard is required for searching similar to the aforementionedFIG. 9.

Similar toFIG. 9, the virtual keyboard is provided to a user and a focusing can move as the virtual keyboard is provided.

Referring toFIG. 10a, there exists a folding area indicator1010in a screen of the device.

Referring toFIG. 10b, if a user folds a display according to the folding area indicator1010, a search window1020is provided to a folded area. As the search window1020is provided, a focusing (not depicted) for searching convenience can move and a virtual keyboard1030is provided in a prescribed area (in the bottom of the screen inFIG. 10b) in a manner of being activated.

Or, in the foregoing description, although the search window1020is provided according the folding, the focusing may be not activated or moved and the virtual keyboard1030may not be provided as well. Subsequently, if a user randomly moves the focusing by touching the search window1020, the virtual keyboard can be provided on the screen at that time in a manner of being activated.

FIG. 11is a diagram for explaining one embodiment of controlling a function of a device in accordance with a folding area (or line) in a screen of the device according to the present invention.

FIG. 11atoFIG. 11fshows that an operation of the device varies according to a folding area.

FIG. 11atoFIG. 11bcorresponds to an example of implementing a first keyboard1120according to a first folding area1110,FIG. 11ctoFIG. 11dcorresponds to an example of implementing a second keyboard1140according to a second folding area1130, andFIG. 11etoFIG. 11fcorresponds to an example of implementing a third keyboard1160according to a third folding area1150.

In this case, the first folding area1110is formed in a lowest position in the screen, the third folding area is formed in a highest position in the screen, and the second folding area1130is formed between the first folding area1110and the third folding area1150.

Meanwhile, the device can notify the user of the first to the third folding area1110/1130/1150in advance using at least one indicator automatically or according to a user selection.

And, the first keyboard1120corresponds to a writing recognition keyboard, the second keyboard1140corresponds to a standard keyboard, and the third keyboard may correspond to a multi-function keyboard.

In other word, if a user folds the display on the basis of the first folding area1110depicted inFIG. 11a, the device provides the first keyboard, i.e., the writing recognition keyboard1120depicted inFIG. 11bto the user.

If the user folds the display on the basis of the second folding area1130depicted inFIG. 11c, the device provides the second keyboard, i.e., the standard keyboard1140depicted inFIG. 11dto the user.

If the user folds the display on the basis of the third folding area1150depicted inFIG. 11e, the device provides the third keyboard, i.e., the multi-function keyboard1160depicted inFIG. 11fto the user.

As mentioned in the foregoing description, a function, a tool, or the like may vary in an identical screen according to a folding area or a folding position of the user.

Meanwhile, as mentioned in the foregoing description, for instance, if the user folds a line between the first folding area1110depicted inFIG. 11aand the second folding area1130depicted inFIG. 11b, the device can provide the first keyboard1120depicted inFIG. 11bor the second keyboard depicted inFIG. 11dto the user according to a distance between the folding position of the user and the line between the first folding area1110and the second folding area1130.

In this case, if the folding position of the user corresponds to a line positioned in the middle of the first folding area1110and the second folding area1130, the device can randomly provide the first keyboard1120depicted inFIG. 11bor the second keyboard depicted inFIG. 11dto the user and may further refer to a different condition.

In general, the device provides the standard keyboard1140depicted inFIG. 11dto the user to satisfy a user convenience. Yet, if the user has a stylus pen separated from the device, the device may provide the writing recognition keyboard depicted inFIG. 11bto the user.

FIG. 12toFIG. 16is a diagram for explaining a method of controlling an e-book application in accordance with folding of a device when the e-book application is executed in the device according to the present invention.

In case that an e-book application is executed in the device according to the present invention,FIG. 12relates to a method of controlling the application according to folding in the device.

Referring toFIG. 12a, the device outputs a text or an image of a page form on a display screen via a browser interlocked with the e-book application. In this case, if a user takes such a user action as a touch, an eye-tracking, a gesture, or the like on a prescribed area of the display screen or a certain area, the device outputs an area capable of being folded in one area1210of the screen.

In this case, if the user folds the area1210capable of being folded, the device provides a preview area1220and a page selection area1230to the user as depicted inFIG. 12b.

In a state ofFIG. 12b, if the user inputs a certain input on the page selection area1230, which is provided according to the folding, via a finger1240, the device performs a control for the application according to the input. In this case, for instance, the control may include selecting a page, moving a page, and the like.

For instance, in a state that a page is selected via the finger1240, if a contact of the finger1240on the page selection area1230is released again and folding of the display is released, the page used to be watched by the user can be maintained. If the folding of the display is released while the finger1240for selecting the page is contacted with the page selection area, the device can display the corresponding page as a main page in a manner of jumping to a preview page. And, the device may intuitively display that the page selection area has the small number of pages only in a state that the display is folded since the page selection area is reducing as a page moves to following pages.

For instance,FIG. 13is a diagram for explaining the page selection area1230depicted inFIG. 12in more detail.

Referring toFIG. 13a, the page selection area1230includes an icon or an item of a chapter unit for a convenience of a page movement and a quick page movement of a user using the device.

Referring toFIG. 13b, the page selection area1230includes an icon or an item1320indicating a reduced image of each page for a convenience of identifying a page of a user using the device. In this case, the icon or the item1320indicating the reduced image of the each page may include an image data, a text data, a page number for identifying a corresponding page, or the like.

FIG. 13cshows a scroll bar1330used for a page jumping or a prompt page switching of a user using the device.

In relation to this, referring toFIG. 13a, if the user selects an icon1310corresponding to a chapter to move in a predetermined chapter unit, the user can move to a first page of the chapter.

Referring toFIG. 13b, since the user can move in a page unit, if a page difference is not considerable on the basis of a current page, the user can accurately move to a preferred page.

On the contrary, if the user intends to move the large number of pages all at once,FIG. 13cmay be much more effective compared toFIG. 13aorFIG. 13b.

In the followingFIG. 14toFIG. 16, content duplicated with the content described inFIG. 12can be invoked, detail explanation on the duplicated content is omitted, and a different point is mainly explained inFIG. 14toFIG. 16.

FIG. 14explains a case that a folding area is positioned at an upper edge unlike the folding area positioned at the right edge depicted inFIG. 12and a method of controlling an operation of the device in that case.

Referring toFIG. 14a, a folding area1410exists in an upper edge. If the folding area is folded as depicted inFIG. 14b, a main data or an image is outputted in a first area1420.

As depicted inFIG. 14c, if the device is folded, the device identifies that the upper edge of the device is folded and activates a searching function according to the folding. Hence, as depicted inFIG. 14c, a focus1440is provided on a second area, i.e., a folding area1430and a virtual keyboard1450related to the activated searching function is outputted within the first area1420. The device outputs a text data of the user, which is inputted via the virtual keyboard1450, in the folding area1430according to the focus.

For instance, the searching function searches for the data inputted by the user based on a corresponding application or an index of a book, contents, or a page of the book according to execution of the application. Or, the searching function may correspond to a web search function depicted inFIG. 10toFIG. 11.

FIG. 15explains a case that a folding area is positioned at a bottom edge instead of the folding area positioned at the right edge depicted inFIG. 12and the folding area positioned at the upper edge depicted inFIG. 14and a method of controlling an operation of the device in that case.

Referring toFIG. 15a, a folding area1510exists in a bottom edge. If the folding area is folded as depicted inFIG. 15b, a main data or an image is outputted in a first area1520.

As depicted inFIG. 15c, if the device is folded, the device identifies that the bottom edge of the device is folded and activates a bookmark function according to the folding.

Hence, as depicted inFIG. 15b, the device outputs an icon or an item1540indicating that a corresponding page is bookmarked in a prescribed position of a first area1520and provides an icon for a pre-stored bookmark or item(s) in a second area, i.e., a folding area1530.

For instance, referring toFIG. 15c, the folding area1530provides the icon displaying a bookmark function and a page list bookmarked in advance for a corresponding content.

In this case, if a user selects a bookmark icon in the list provided by the device depicted inFIG. 15c, the user can immediately jump or switch to a page corresponding to the selected bookmark icon.

In this case, the book mark list provided in the folding area1530may be non-limited to the corresponding content. Instead, all book mark lists set to the device or stored in the device can be provided in the folding area.

Meanwhile,FIG. 16explains a control operation of the device according to folding in case that a folding area exists in the middle of a display.

First of all,FIG. 16ashows a display screen1610before folding is performed. Content of a page unit can be provided on the screen and a screen partition function can be activated by folding a middle of the display screen.

Hence, as depicted inFIG. 16b, the content used to be provided in one page unit can be provided in two or more page units. A first area1620positioned at the left of the screen depicted inFIG. 16bis identical to the content page1610used to be provided on the screen depicted inFIG. 16aand a second area1630positioned at the right of the screen may correspond to a next page of the screen depicted inFIG. 16a.

FIG. 17toFIG. 19is a diagram for explaining a method of controlling each area divided by folding a device according to the present invention.

FIG. 17atoFIG. 17ccorresponds to contents of individually controlling areas in a screen which is divided according to folding of the device.

FIG. 17amay correspond to a first screen which is provided due to the folding of the device.

Referring toFIG. 17a, an upper area and a bottom area can be individually controlled. A control for each of the areas can be performed by folding and/or flicking the corresponding area.

For instance,FIG. 17bshows a screen provided in a manner of flicking a bottom area left/right without controlling an upper area on the device depicted inFIG. 17aor folding a prescribed area capable of being folded of the bottom area.

Meanwhile,FIG. 17cshows a screen provided by controlling the upper area on the device depicted inFIG. 17a, i.e., the screen provided in a manner of flicking the upper area left/right or folding a prescribed area capable of being folded of the upper area as well as controlling the bottom area depicted inFIG. 17b.

FIG. 18explains that content of an upper area and content of a bottom area on a device are switched to each other according to folding.

In particular,FIG. 18ashows a device before the device is folded. Content A is provided in the upper area of the device and content B is provided in the bottom area of the device. In this case, if folding is performed, the device outputs the content A, which is used to be provided in the upper area, in the bottom area and outputs the content B, which is used to be provided in the bottom area, in the upper area. Meanwhile, if a size or resolution of the upper area and that of the bottom area are different from each other, corresponding content can be provided in a manner of being converted to the size, resolution, and the like of the corresponding area when the switching is performed.

If the device includes at least one object capable of being separated, individually selected, or controlled,FIG. 19relates to a method of dividing or individually controlling the at least one object by folding the device.

FIG. 19ashows content A including an object, which is called B, capable of being selected or separated.

Referring toFIG. 19b, if folding is performed in a state ofFIG. 19a, the device separates the object B from the content A, provides the object B in the bottom area divided by the folding, and outputs the content A, which is used to be provided, in the upper area in a manner of reducing (content A′) the content A.

For instance, data on breaking news, weather condition, stock quotations, and the like provided in the course of watching news (content A) is separated from the content A and provided in the bottom area and data (A/V) on the news can be provided in the upper area only.

Meanwhile, referring toFIG. 19b, as mentioned earlier inFIG. 17toFIG. 18, each area of the device divided by the folding can be individually controlled as well.

FIG. 20is a flowchart for explaining a method of controlling the device according to the present invention in case that the device is folded

First of all, the device detects a first action of a user [S2010] and outputs a folding indicator on a screen according to the detected first action of the user [S2020].

Subsequently, the device detects a second action of the user [S2030], executes a function corresponding to the detected second action, and outputs data resulted from executing the function on the screen [S2070].

Subsequently, the device performs an operation controlling the device based on the outputted data [S2080].

In the foregoing description, the folding indicator may include at least one of at least one foldable line and data on a function corresponding to the foldable line on the screen.

And, the data resulted from executing the function can be outputted in at least one of areas of the screen divided by the second action of the user.

And, each of the divided areas on the screen can be individually controlled according to a third action of the user.

And, the second action includes a prescribed action among an action for a single folding and an action for multi-folding. The multi-folding may include at least one of folding for an identical foldable line and folding for foldable lines different from each other.

And, the function corresponding to the detected second action can vary according to whether the detected second action corresponds to the action for the single folding or the action for the multi-folding.

And, the function can be determined by at least one selected from the group consisting of a folding line according to the second action, a folding angle, and the number of folding.

And, the device identifies a folding line on the screen according to the detected second action of the user [S2040] and compares the identified folding line with a folding line to execute a specific function on the screen [S2050].

Subsequently, according to the comparison, if the folding lines are positioned within a predetermined range, the device generates the data to execute the function [S2060].

And, the step of executing the function corresponding to the detected second action and the step of outputting the data resulted from executing the function on the screen may include a step of generating and outputting auxiliary data for the data resulted from executing the function on the screen.

And, the device identifies at least one object capable of being selected or separated from content outputted on the screen and may output the identified at least one object in one area among the areas on the screen divided by the second action of the user in a manner of separating it from the content.

Meanwhile, in the present disclosure, if pluralities of areas are divided by folding, it may randomly determine at least one reference area and may output an audio data, which is outputted in the randomly determined reference area, via a speaker or the like. In this case, audio data of content A outputted via the speaker is muted and audio data of content B, which is switched by the folding, can be outputted instead.

Besides, although it is not depicted, the device can individually control each of the areas divided by the folding and may provide the content provided in each of the areas in a manner of switching the content to a front part or a rear part of the screen.

For instance, as depicted inFIG. 6b, in case that multi-folding are performed, content can be provided in a rear part of one area670and content can be provided in a front part of another areas660/680. This is because if the device is folded, since a user can watch the content in various angles compared to the device which is not folded, it is intended to prepare for a situation capable of being occurred in case that a user watches the content in various angles. In this case, if an eye-tracking sensor exists in at least one area, the sensor predicts a movement of a pupil and a gaze of the user. By doing so, the device can control a screen to be switched between the front part and the rear part.

Meanwhile, as depicted inFIG. 6b, as the multi-folding are enabled, the device can sequentially provide a main menu, a first sub menu, and a second sub menu (a sub menu of the first sub menu) in one area, a different adjacent area, and a further different area, respectively. Moreover, the device can simultaneously play a series and a different channel in each of the areas and may provide such an image as a relevant picture and the like in each of the areas in a panorama form.

Meanwhile, the present disclosure has explained that the device provides a foldable line or an area capable of being identified to the user. In this case, there may exist a problem of when the folding line or the area is provided to the user. This is because if a small foldable line or an area is provided to the user, it may interrupt the user to watch a screen. Hence, when the device provides identification information on the folding line or the area to the user at least once in a corresponding application or a function, if there is no user action within a predetermined time, the device may not provide the identification information to the user. In relation to this, the identification information can be provided to the user when the user touches at least one edge among each of the edges of the screen. The device outputs mapping function data corresponding to the identification information on the folding line or the area in the screen together with the identification information in order for the user to easily select a specific folding line or an area.

The present disclosure has mainly explained a control operation of the device in case that a user directly folds a display. Yet, it may also be able to control the device with a concept opposite to the aforementioned concept.

For instance, if a user activates or selects a search window provided in an upper edge of a mobile device (before folding), a virtual keyboard and the like should be provided to enable the user to use a search function via the selected or activated search window. In this case, since the virtual keyboard blocks a screen or is provided in an unfolded screen, it may give inconvenience to the user. Hence, if folding is automatically performed on the basis of an area corresponding to the activated virtual keyboard and the virtual keyboard is provided in a prescribed area divided by the folding, it may give convenience to the user.

All of the aforementioned contents or a part of the aforementioned contents can be identically or similarly applied to a device to which a flexible display is not adopted via a different scheme, which replaces the folding or corresponds to the folding. In the foregoing description, as the different scheme, a touch line or a tap-bar is moved from a first edge to a second edge to activate a function according to a position where the touch line or the tap-bar is put.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the invention.

The present invention mentioned in the foregoing description can be implemented with a code readable by a computer in a media in which a program is recorded. The media readable by the computer may include all kinds of recording devices for storing data capable of being read by the computer system. The examples of the media readable by the computer may include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disc, an optical data storing device and the like. And, implementing in a form of a carrier wave (e.g., transmission via the internet) is also included. And, the computer may include a control unit180of a device.

While the present invention has been described and illustrated herein with reference to the preferred embodiments and diagrams thereof, the present invention may be non-limited to the aforementioned embodiments and it will be apparent to those skilled in the art that various modifications and variations can be made therein without departing from the spirit and scope of the present disclosure. Thus, it is intended that the present disclosure covers the modifications and variations of this invention that come within the scope of the appended claims and their equivalents.

INDUSTRIAL APPLICABILITY

The present invention relates to a mobile device and a method of controlling the same and is applicable to all digital apparatus.