Patent Description:
With the development of electronic technology, various types of user terminal devices have been developed and distributed. Recently, the size of such user terminal devices has been minimized while the functions of the devices have become diverse and thus, the demands for user terminal devices have been increasing continuously.

A user terminal device may provide various contents such as multimedia contents and application screens according to a user's request. A user may select a desired function using a button or a touch screen provided with a user terminal device. A user terminal device may execute a program selectively according to a user interaction and display the result of execution.

Meanwhile, as a user terminal device provides more diverse functions, there are various needs for a method of displaying contents or a user interface method. In other words, as the method of displaying contents has changed and the type and function of contents have been increasing, the existing interaction methods such as simply selecting a button or touching a screen may not be sufficient to perform various functions of a user terminal device.

Particularly, a user terminal device of which display can be folded with reference to a folding line has been developed in order to minimize the size of the user terminal device. When the display is folded symmetrically with reference to the hinge, however, the display is folded completely and a user may not use or watch the display.

<CIT>discloses a flexible portable communication device including a housing with at least three foldable housing portions. <CIT> discloses a notebook computer including a touch screen arranged such that, when the computer is folded, a part of the touch screen is exposed and displays a lock screen for unlocking the computer and starting an OS of the computer.

Aspects of one or more exemplary embodiments relate to a user terminal device that, when a display is folded asymmetrically with reference to a hinge or folding line, exposing a part of the display, provides various User Interfaces (UI) through the exposure area, and a displaying method thereof.

As described above, according to various exemplary embodiments, a user may perform various functions of a user terminal device through a UI displayed on the exposure area even when the display is folded, and may be provided with a variety of information.

The above and/or other aspects of one or more certain exemplary embodiments will be more apparent with reference to the accompanying drawings, in which:.

One or more exemplary embodiments may vary and may be provided in different types of exemplary embodiments. Specific exemplary embodiments will be described with reference to accompanying drawings and detailed explanation. However, this does not necessarily limit the scope of the exemplary embodiments to a specific embodiment form. Instead, modifications, equivalents and replacements included in the disclosed concept and technical scope of this specification may be employed. While describing exemplary embodiments, if a specific description regarding a known technology might obscure the gist of an inventive concept, the specific description may be omitted.

In the present disclosure, relational terms such as first and second, and the like, may be used to distinguish one entity from another entity, without necessarily implying any actual relationship or order between such entities.

A singular term includes a plural form unless it expressly says otherwise. The terms "include", "comprise", "is configured to," etc., of the description are used to indicate that there are features, numbers, steps, operations, elements, parts or combination thereof, and they should not exclude the possibilities of combination or addition of one or more features, numbers, steps, operations, elements, parts or a combination thereof.

In an exemplary embodiment, 'a module' or 'a unit' performs at least one function or operation, and may be realized as hardware, software, or combination thereof. In addition, a plurality of 'modules' or a plurality of 'units' may be integrated into at least one module and may be realized as at least one processor except for 'modules' or 'units' that should be realized in a specific hardware.

An exemplary embodiment will now be described in detail with accompanying drawings. <FIG> is a block diagram illustrating configuration of a user terminal device <NUM> according to an exemplary embodiment. As illustrated in <FIG>, the user terminal device <NUM> includes a display <NUM>, a detector <NUM>, and a controller <NUM>. The user terminal device <NUM> may be realized as various types of devices such as a TV, monitor, PC, laptop PC, mobile phone, tablet PC, PDA, MP3 player, kiosk, electronic album, table display device, LCD display, LED display, OLED display, camera, watch, wearable device, etc. If a user terminal device is realized as portable device such as mobile phone, tablet PC, touchscreen, PDA, MP3 player, laptop PC, watch, wearable device, etc., the user terminal device may be referred to a mobile device. Throughout this specification, for convenience and not for any limiting purposes, it may be referred to as a user terminal device.

The display <NUM> displays various image data and UIs. In particular, the display <NUM> may be realized as a touch screen as it is combined with a touch detector. In addition, the display <NUM> may include a hinge or folding line so that the display <NUM> may be folded.

In particular, the display <NUM> consists of a first area and a second area which is larger than the first area with reference to the hinge or folding line. If the display is folded such that the first area comes in touch with the second area with reference to the hinge or folding line, the display <NUM> may display on an exposure area of the second area, the area being exposed while the display <NUM> is folded, at least one of a UI including information regarding the user terminal device <NUM> and a UI for controlling the user terminal device <NUM>.

The detector <NUM> detects a user interaction. In particular, the detector <NUM> may include a touch detector which detects a user's touch interaction. In addition, the detector <NUM> may include a folding detector which detects a folding interaction where the display <NUM> is folded with reference to the hinge or folding line and an unfolding interaction where the display <NUM> is unfolded with reference to the hinge or folding line.

The controller <NUM> controls overall operations of the user terminal device <NUM>. In particular, if the display is folded with reference to the hinge or folding line, the controller <NUM> may control the display <NUM> to display a predetermined UI on an exposure area of the second area. In this case, the predetermined UI may include at least one of a UI representing state information of the user terminal device <NUM> and a UI for controlling the user terminal device <NUM>. In addition, the exposure area represents an area of the second area, which is exposed to the outside when the first area completely comes into contact with the second area.

In particular, if a folding interaction of folding the display <NUM> with reference to the hinge or folding line is detected through the detector <NUM> while the user terminal device <NUM> executes a specific application, the controller <NUM> may control the display <NUM> to display a UI for controlling the specific application in the exposure area of the second area. For example, if a folding interaction of folding the display <NUM> with reference to the hinge or folding line is detected through the detector while the user terminal device <NUM> executes a music application, the controller <NUM> may control the display <NUM> to display a UI for controlling reproduction of music on the exposed area.

In addition, if a predetermined user interaction (for example, a touch interaction of touching the exposed area) occurs while the display <NUM> is folded, the controller <NUM> may control the display <NUM> to display a UI for releasing the lock state of the user terminal device <NUM> on the exposure area of the second area.

If a predetermined user interaction (for example, a touch interaction of touching the exposed area) occurs while the display <NUM> is folded, the controller <NUM> may control the display <NUM> to display a UI for changing an audio, video, or other setting of the user terminal device on the exposed area. For example, a touch interaction of touching the exposure area is detected while the display <NUM> is folded, the controller <NUM> may control the display <NUM> to display a UI for changing the audio setting of the user terminal device on the exposed area.

In addition, if a message is received from outside of the device while the display <NUM> is folded, the controller <NUM> may control the display <NUM> to display a UI for informing that the message is received on the exposed area. In this case, the UI displayed on the exposure area may include information regarding a sender and the message.

If the UI informing that a message is received is displayed on the exposure area while the display <NUM> is folded and an unfolding interaction of unfolding the display to a predetermined angle is detected while the UI is touched, the controller <NUM> may control the display <NUM> to display a message window for responding to the received message.

However, the device is not limited to using a predetermined angle. It may be a range of angles. It may also be an angle or a range of angles that may be set by a user.

In addition, the controller <NUM> may control the display <NUM> to display a plurality of icons on the exposure area while the display <NUM> is folded. If one of the plurality of icons is touched through the detector <NUM> while the plurality of icons are displayed on the exposure area while the display <NUM> is folded and an unfolding interaction of unfolding the display <NUM> is detected through the detector <NUM> while one of the plurality of icons is touched, the controller <NUM> may control the display <NUM> to display a screen corresponding to the touched icon. For example, if an unfolding interaction of unfolding the display <NUM> is detected while a message icon from among the plurality of icons is touched, the controller <NUM> may control the display <NUM> to display a message window corresponding to the message icon. Of course, the device is not limited to a message icon. It could be any number of icons, e.g., a music icon, a telephone icon, a document icon, etc..

In addition, if a message is received from outside while the user terminal device executes a specific application in a folding state, the controller <NUM> may control the display <NUM> to display a UI informing that the message is received on the exposed area. If an unfolding interaction of unfolding the display <NUM> is detected through the detector <NUM> while the UI is touched, the controller <NUM> may control the display <NUM> to display a message window for responding to the message. If an unfolding action of unfolding the display is detected through the detector <NUM> while the UI is not touched, the controller <NUM> may control the display <NUM> to display an execution screen for the specific application.

If a UI for releasing a lock state of the user terminal device <NUM> is displayed on the exposure area while the display <NUM> is folded, a lock release command is input through the UI and then, an unfolding interaction of unfolding the display <NUM> is detected through the detector <NUM>, the controller <NUM> controls the display <NUM> to display a home screen. However, if a lock release command is not input through the UI, and an unfolding interaction of unfolding the display <NUM> is detected through the detector <NUM>, the controller <NUM> may control the display <NUM> to display the UI for releasing the lock state of the user terminal device <NUM> on full screen.

In addition, if a call request is received from outside while the display <NUM> is folded, the controller <NUM> may control the display <NUM> to display a UI on the exposed area for informing that a call request is received from outside. If an unfolding interaction of unfolding the display to a first angle range is detected, the controller <NUM> may control the display <NUM> to display at least one icon for controlling a telephone call function. If an unfolding interaction of unfolding the display to a second angle that is greater than the first angle scope is detected, the controller <NUM> may accept the call request and control the display <NUM> to display a telephone call screen.

If a call request is received from outside while the display executes a specific application as it is being folded, the controller <NUM> may control the display <NUM> to display a UI for informing that a call request is received on the exposed area. If an unfolding interaction of unfolding the display <NUM> is detected through the detector <NUM>, the controller <NUM> may accept the call request and control the display <NUM> to display a telephone call screen. When a telephone call is completed, the controller <NUM> may control the display <NUM> to display the execution screen of the specific application again.

If a first folding interaction of folding the display to the first angle is detected while the display <NUM> displays the execution screen of a specific application, the controller <NUM> may control the display <NUM> to display part of the execution screen of the specific application on at least part of the second area. If a second folding interaction of folding the display <NUM> such that the first area and the second area of the display <NUM> come in contact with each other is detected, the controller <NUM> may control the display <NUM> to display a brief information providing screen of the specific application on the exposed area.

In the above-described one or more exemplary embodiments, a user may perform various functions of a user terminal device through a UI displayed on the exposure area even when the display <NUM> is in a folding state and thus, the user may be provided with various information and options for interaction.

One or more exemplary embodiments will be described in greater detail with reference to <FIG>. <FIG> is a block diagram illustrating configuration of a user terminal device <NUM> in detail according to an exemplary embodiment. As illustrated in <FIG>, the user terminal device includes an image receiver <NUM>, an image processor <NUM>, a display <NUM>, a communicator <NUM>, a storage <NUM>, an audio processor <NUM>, a speaker <NUM>, a detector <NUM>, and a controller <NUM>.

Meanwhile, <FIG> illustrates various components comprehensively, assuming that the user terminal device <NUM> is an apparatus having various functions such as contents providing function, display function, etc. Accordingly, depending on one or more exemplary embodiments, a part of the components illustrated in <FIG> may be omitted or changed, or other components may be further added.

The image receiver <NUM> receives image data through various sources. For example, the image receiver <NUM> may receive broadcasting data from an external broadcasting station, VOD data in real time from an external server, or image data from an external apparatus.

The image processor <NUM> processes image data received from the image receiver <NUM>. The image processor <NUM> may perform various image processing with respect to image data, such as decoding, scaling, noise filtering, frame rate conversion, resolution conversion, etc..

The display <NUM> displays at least one of a video frame which is generated as the image processor <NUM> processes image data received from the image receiver <NUM> and various screens generated by a graphic processor <NUM>.

In particular, as illustrated in <FIG>, the display <NUM> may consist of a first area <NUM> and a second area <NUM> which is larger than the first area <NUM> with reference to a hinge or folding line <NUM>. As illustrated in <FIG>, if the display <NUM> is folded with reference to the folding line <NUM>, the display <NUM> may include an exposure area <NUM> which is the exposed part of the second area <NUM>. Meanwhile, <FIG> is a view illustrating a cover which is on the rear side of the user terminal device <NUM> when the user terminal device <NUM> is folded.

Meanwhile, in the above-described exemplary embodiment, the length of the hinge or folding line <NUM> is in parallel with a short side, but this is only an example. As illustrated in <FIG>, the length of the hinge <NUM> may be in parallel with a long side. In this case, the display <NUM> may consist of a first area <NUM> and a second area <NUM> with reference to the hinge or folding line <NUM>. As illustrated in <FIG>, if the display <NUM> is folded with reference to the hinge or folding line <NUM>, the display <NUM> may include an exposure area <NUM> of the second area <NUM>, which is exposed to outside.

Meanwhile, in the above-exemplary embodiments, the folding line <NUM> may be a line which is generated by a physical hinge. In addition, if the display <NUM> is a flexible display, the folding line <NUM> may be a line which can be folded by a user.

The communicator <NUM> performs communication with various types of external apparatuses according to various types of communication methods. The communicator <NUM> may include a WiFi chip <NUM>, a Bluetooth chip <NUM>, a wireless communication chip <NUM>, and a Near Field Communication (NFC) chip <NUM>. The controller <NUM> performs communication with various external apparatuses using the communicator <NUM>.

In particular, the WiFi chip <NUM> and the Bluetooth chip <NUM> perform communication according to a WiFi method and a Bluetooth method, respectively. In the case of the WiFi chip <NUM> or the Bluetooth chip <NUM>, various connection information such as SSID and a session key may be transmitted/received first for communication connection and then, various information may be transmitted/received. The wireless communication chip <NUM> represents a chip which performs communication according to various communication standards such as IEEE, Zigbee, 3rd Generation (<NUM>), 3rd Generation Partnership Project (3GPP), Long Term Evolution (LTE) and so on. The NFC chip <NUM> represents a chip which operates according to an NFC method which uses <NUM> band among various RF-ID frequency bands such as <NUM>, <NUM>, <NUM>, <NUM>~<NUM>, <NUM>, and so on.

The storage <NUM> may store various programs and data necessary to operate the user terminal device <NUM>. Specifically, the storage <NUM> may store programs and data to configure various screens to be displayed on a main area and a sub area. <FIG> is a view provided to explain the structure of software stored in the user terminal device <NUM>. According to <FIG>, the storage <NUM> may store an Operating System (OS) <NUM>, a kernel <NUM>, middleware <NUM>, an application <NUM>, etc..

The OS <NUM> controls and manages overall operations of hardware. In other words, the OS <NUM> manages hardware and is responsible for basic functions such as memory and security.

The kernel <NUM> serves as a path transmitting various signals detected at the display <NUM>, such as a touch signal, to the middleware <NUM>.

The middleware <NUM> includes various software modules for controlling the operation of the user terminal device <NUM>. According to <FIG>, the middleware <NUM> includes an X11 module <NUM>-<NUM>, an APP manager <NUM>-<NUM>, a connection manager <NUM>-<NUM>, a security module <NUM>-<NUM>, a system manager <NUM>-<NUM>, a multimedia framework <NUM>-<NUM>, a UI framework <NUM>-<NUM>, a window manager <NUM>-<NUM>, and a writing recognition module <NUM>-<NUM>.

The X11 module <NUM>-<NUM> receives various event signals from various hardware provided in the user terminal device <NUM>. Herein, the event may vary, ranging from an event of setting of a system alarm, an event of executing or terminating a specific program, etc..

The APP manager <NUM>-<NUM> manages the execution state of various applications <NUM> which are installed in the storage <NUM>. When an application execution event is detected from the X11 module <NUM>-<NUM>, the APP manager <NUM>-<NUM> calls and executes an application corresponding to the event.

The connection manager <NUM>-<NUM> supports wired or wireless network connection. The connection manager <NUM>-<NUM> may include various detailed modules such as a DNET module, a UPnP module, etc..

The security module <NUM>-<NUM> supports certification, permission, secure storage, etc. with respect to hardware.

The system manager <NUM>-<NUM> monitors the state of each element of the user terminal device <NUM>, and provides the monitoring result to other modules. For example, if there is not enough battery left, an error occurs, or connection is cut off, the system manager <NUM>-<NUM> may provide the monitoring result to a main UI framework <NUM>-<NUM> or a sub UI framework <NUM>-<NUM> and output an alarm message or an alarm sound.

The multimedia framework <NUM>-<NUM> may be stored in the user terminal device <NUM>, or may reproduce multimedia contents provided from an external source. The multimedia framework <NUM>-<NUM> may include a player module, a camcorder module, a sound processing module, etc. Accordingly, the multimedia framework <NUM>-<NUM> may reproduce various multimedia contents, and generate and reproduce screens and sounds.

The main UI framework <NUM>-<NUM> provides various UIs to be displayed on a main area of the display <NUM>, and the sub UI framework <NUM>-<NUM> provides various UIs to be displayed on a sub area. The main UI framework <NUM>-<NUM> and the sub UI framework <NUM>-<NUM> may include an image compositor module to configure various objects, a coordinates composite module to calculate a coordinates where an object is to be displayed, a rendering module to render the configured object on the calculated coordinates, a 2D/3D UI toolkit to provide a tool for configuring a UI in 2D or 3D form, etc..

The window manager <NUM>-<NUM> may detect a touch event using a user's body part or pen or other input events. When such an event is detected, the window manager <NUM>-<NUM> transmits an event signal to the main UI framework <NUM>-<NUM> or the sub UI framework <NUM>-<NUM> so that an operation corresponding to the event is performed.

In addition, if a user touches and drags a screen, various program modules such as a writing module for drawing a line according to a drag trace and an angle calculation module for calculating a pitch angle, a roll angle, a yaw angle, etc. based on a sensor value sensed by a movement detector <NUM> may be stored.

The application module <NUM> includes applications <NUM>-<NUM>~<NUM>-n for supporting various functions. For example, program modules for providing various services, such as a navigation program module, a game module, an electronic book module, a calendar module, an alarm management module, a music module, an electronic banking module, a stock module, a calculator module, an electronic mail module, a spreadsheet module, a word processor module, etc., may be included. Such applications may be set as default or may be set temporarily by a user when necessary. If an object is selected, the main CPU <NUM> may execute an application corresponding to the selected object using the application module <NUM>.

The software structure displayed in <FIG> is only an example and thus, an exemplary embodiment is not necessarily limited thereto. Thus, part of the structure may be omitted or changed, or new structure may be added, if necessary. For example, the storage <NUM> may additionally provide various programs such as a sensing module for analyzing signals sensed by various sensors, a messaging module including a messenger program, a Short Message Service (SMS) & Multimedia Message Service (MMS) program, an e-mail program, etc., a call info aggregator program module, a VoIP module, a web browser module, etc..

Referring back to <FIG>, the audio processor <NUM> processes audio data of image contents. The audio processor <NUM> may perform various processing such as decoding, amplification, noise filtering, compression, equalization, noise cancellation, echo or reverb removal or addition, etc., with respect to audio data. The audio data processed by the audio processor <NUM> may be output to the audio output unit <NUM> (e.g., audio outputter).

The audio output unit <NUM> outputs not only various audio data which is processed in many ways such as decoding, amplification, and noise filtering by the audio processor <NUM> but also various alarm sounds or voice messages. In particular, the audio output unit <NUM> may be realized as a speaker, but this is only an example. The audio output unit <NUM> may be realized as an output terminal which may output audio data.

The detector <NUM> detects various user interactions. In particular, the detector <NUM> may include a touch detector <NUM>, a movement detector <NUM>, and a folding detector <NUM> as illustrated in <FIG>.

Specifically, the touch detector <NUM> may detect a user's touch interaction using a touch panel attached to the rear side of a display panel. The movement detector <NUM> may detect a movement (for example, a rotation movement, a vertical movement, or a horizontal movement, etc.) of the user terminal device <NUM> using at least one of an accelerator sensor, a geomagnetic sensor, and a gyro sensor. The folding detector <NUM> may detect at least one of whether the user terminal device <NUM> is folded with reference to the hinge or folding line <NUM> and the angle at which the terminal device <NUM> is folded using a bending sensor (for example, a light sensor, a fiber optic sensor, a conductive ink-based sensor, a conductive fabric sensor, etc.).

Meanwhile, the touch detector <NUM> might activate only a touch sensor disposed on the exposure area while the display <NUM> is folded, and inactivate a touch sensor disposed on the other areas.

The controller <NUM> controls overall operations of the user terminal device <NUM> using various programs stored in the storage <NUM>.

As illustrated in <FIG>, the controller <NUM> includes a RAM <NUM>, a ROM <NUM>, a graphic processor <NUM>, a main CPU <NUM>, a first to an nth interface <NUM>-<NUM>~<NUM>-n, and a bus <NUM>. In this case, the RAM <NUM>, the ROM <NUM>, the graphic processor <NUM>, the main CPU <NUM>, the first to the nth interface <NUM>-<NUM>~<NUM>-n, etc. may be interconnected through the bus <NUM>.

The ROM <NUM> stores a set of commands for system booting. If a turn-on command is input and thus, power is supplied, the main CPU <NUM> copies O/S stored in the storage <NUM> in the RAM <NUM> according to a command stored in the ROM <NUM>, and boots a system by executing the O/S. When the booting is completed, the main CPU <NUM> copies various application programs stored in the storage <NUM> in the RAM <NUM>, and executes the application programs copied in the RAM <NUM> to perform various operations.

The graphic processor <NUM> generates a screen including various objects such as an icon, an image, a text, etc. using a computing unit (e.g., computer) and a rendering unit (e.g., renderer). The computing unit computes property values such as coordinates, shape, size, and color of each object to be displayed according to the layout of the screen using a control command received from the detector <NUM>. The rendering unit generates a screen with various layouts including objects based on the property values computed by the computing unit. The screen generated by the rendering unit is displayed in a display area of the display <NUM>.

The main CPU <NUM> accesses the storage <NUM>, and performs booting using the O/S stored in the storage <NUM>. The main CPU <NUM> performs various operations using various programs, contents, data, etc. stored in the storage <NUM>.

The first to the nth interface <NUM>-<NUM>~<NUM>-n are connected to the above-described various elements. One of the above interface may be a network interface which is connected to an external apparatus via network.

In particular, the controller <NUM> may provide various functions using an exposure area which is exposed to outside when the display <NUM> is folded.

If the display <NUM> is folded with reference to the hinge or folding line <NUM> such that the first area <NUM> and the second area <NUM> come in contact with each other, the controller <NUM> may control the display <NUM> to display a predetermined UI on the exposure area <NUM> of the second area <NUM>, which is exposed to the outside. In this case, the predetermined UI may include at least one of a UI including the state information of the user terminal device <NUM> and a UI for controlling the user terminal device <NUM>.

In an exemplary embodiment, if a folding interaction of folding the display <NUM> with reference to the hinge or folding line <NUM> such that the first area <NUM> and the second area <NUM> come in contact with each other is detected, the controller <NUM> may control the display <NUM> to display a UI <NUM> providing a memo function on the exposure area as illustrated in <FIG>. In this case, if a user input, e.g., a finger, pen, or stylus, is detected through the UI <NUM> which provides a memo function, the controller <NUM> may control the display <NUM> to display an image according to the user input.

In addition, the controller <NUM> may control the display <NUM> to display a UI for controlling a specific application on the exposure area. Specifically, if a folding interaction of folding the display <NUM> with reference to the hinge or folding line <NUM> such that the first area <NUM> and the second area <NUM> come in contact with each other is detected while a specific application is executed, the controller <NUM> may control the display <NUM> to display a UI for controlling the specific application on the exposure area. For example, if a folding interaction of folding the display <NUM> with reference to the hinge or folding line <NUM> such that the first area <NUM> and the second area <NUM> come in contact with each other is detected while a music application is executed, the controller <NUM> may control the display <NUM> to display a UI <NUM> controlling the music application on the exposure area as illustrated in <FIG>. In this case, the UI <NUM> for controlling a music application may include information regarding currently-played music, a play/stop icon, a skip icon, a rewind icon, a next song, a past song, thumbs up, thumbs down, etc..

In addition, the controller <NUM> may control the display <NUM> to display a UI including a shortcut or hot key icon for checking the current state of the user terminal device <NUM> on the exposure area. For example, if a predetermined user interaction (for example, an interaction of touching or tapping the exposure twice in a row) is detected while the display <NUM> is folded, the controller <NUM> may control the display <NUM> to display a UI <NUM> including a shortcut icon for checking the current state of the user terminal device <NUM> on the exposure area as illustrated in <FIG>. In this case, the shortcut or hot key icon for checking the current state of the user terminal device <NUM> may include a shortcut or hot key icon for checking a battery state, a shortcut icon for checking a network state, a shortcut or hot key icon for checking display brightness setting, etc..

In addition, the controller <NUM> may control the display <NUM> to display a UI informing that a message or data is received from outside on the exposure area. For example, if an SNS message or SMS message is received from the outside through the communicator <NUM> while the display <NUM> is folded, the controller <NUM> may control the display <NUM> to display a UI <NUM> informing that the SNS message or SMS message is received on the exposure area as illustrated in <FIG>. In this case, the UI <NUM> informing that an SNS message or SMS message is received may include at least one of information regarding a sender and information regarding the SNS message or SMS message.

Further, the controller <NUM> may control the display <NUM> to display various types of UIs for releasing a lock state of the user terminal device <NUM> on the exposure area.

Specifically, as illustrated in <FIG>, the controller <NUM> may control the display <NUM> to display a UI <NUM> for inputting a pin number to release the lock state of the user terminal device <NUM> on the exposure area. In this case, the UI <NUM> for inputting a pin number may change the pin number by a touch interaction of swiping up and down. If a predetermined pin number is input on the UI <NUM> displayed on the exposure area, the controller <NUM> may release the lock state of the user terminal device <NUM>. Additionally, the user may set the pin number through user input.

In addition, as illustrated in <FIG>, the controller <NUM> may control the display <NUM> to display a UI <NUM> including a plurality of dots on a corner of the exposure area to release the lock state of the user terminal device <NUM> on the exposure area. In this case, if a touch interaction of connecting dots in a predetermined pattern is detected on the UI <NUM>, the controller <NUM> may release the lock state of the user terminal device <NUM>. Additionally, the user may set the pin number through user input.

As illustrated in <FIG>, the controller <NUM> may control the display <NUM> to display a UI <NUM> in the form of a keyboard, e.g., piano, to release the lock state of the user terminal device <NUM> on the exposure area. In this case, if a touch interaction of touching the keyboard, i.e., piano, in a predetermined rhythm is detected on the UI <NUM>, the controller may release the lock state of the user terminal device <NUM>.

In addition, as illustrated in <FIG>, the controller <NUM> may control the display <NUM> to display a UI <NUM> including a home icon to release the lock state of the user terminal device on the exposure area. In this case, if a touch interaction of pinching out with reference to the home icon included in the UI <NUM> is detected, the controller <NUM> may release the lock state of the user terminal device <NUM>.

The controller <NUM> may control the display <NUM> to display a UI for changing the setting of the user terminal device <NUM> on the exposure area.

Specifically, as illustrated in <FIG>, the controller <NUM> may control the display <NUM> to display a UI <NUM> in the form of an arc for adjusting the volume of the user terminal device <NUM>. Meanwhile, in the above exemplary embodiment, the UI displayed on the exposure area adjusts the volume, but this is only an example. A UI for adjusting another setting of the user terminal device <NUM> (for example, display brightness, etc.) may be displayed.

In addition, as illustrated in <FIG>, if a touch interaction of dragging one of a plurality of vertexes included in the exposure area in a diagonal direction is detected, the controller <NUM> may control the display <NUM> to display a UI <NUM> for turning off the power of the user terminal device <NUM> at the corner area corresponding to the vertex where the touch interaction is detected.

If a plurality of icons are displayed on the exposure area while the display <NUM> is folded, and an unfolding interaction of unfolding the display <NUM> while one of the plurality of icons is touched, the controller <NUM> may control the display <NUM> to display a screen corresponding to the touched icon on full screen.

Specifically, as illustrated in <FIG>, the display <NUM> displays the first to the fourth icons <NUM> to <NUM> while the display <NUM> is folded. If an unfolding interaction of unfolding the display <NUM> is detected while the fourth icon <NUM> out of the first to the fourth icon <NUM> to <NUM> is touched, the controller <NUM> may control the display <NUM> to display a message window <NUM> corresponding to the fourth icon <NUM> on full screen as illustrated in <FIG>.

Meanwhile, in the above exemplary embodiment, an unfolding interaction is detected while the fourth icon <NUM> is touched, but this is only an example. If an unfolding interaction is detected while another icon is touched, a screen corresponding to the other touched icon may be displayed on the full screen of the display <NUM>. For example, if an unfolding interaction is detected while the first icon <NUM> is touched, the controller <NUM> may control the display <NUM> to display an execution screen of a call application corresponding to the first icon <NUM> (for example, a recent call list screen, an address book screen, a call sending screen, etc.) on full screen. In addition, if an unfolding interaction is detected while the second icon <NUM> is touched, the controller <NUM> may control the display <NUM> to display a web browser screen corresponding to the second icon <NUM> on full screen. If an unfolding interaction is detected while the third icon <NUM> is touched, the controller <NUM> may control the display <NUM> to display an execution screen of a music application corresponding to the third icon <NUM> (for example, a music play screen, a music list screen, etc.) on full screen.

In addition, if the exposure area is touched while the display <NUM> is folded and then, an unfolding interaction of unfolding a hinge angle of the display <NUM> as much as a predetermined angle is detected, the controller <NUM> may control the display <NUM> to display a screen for executing a specific function.

Specifically, if a call request is received while the display <NUM> is folded, the controller <NUM> may control the display <NUM> to display a UI <NUM> informing that a call request is received on the exposure area as illustrated in <FIG>. If an unfolding interaction of unfolding a hinge angle of the display <NUM> as much as a predetermined angle (for example, <NUM>° to <NUM>°) is detected while the UI <NUM> informing that a call request is received is touched, the controller <NUM> may accept the call request, execute a speaker phone function, and control the display <NUM> to display an execution screen <NUM> including various icons as illustrated in <FIG>.

Specifically, if a message is received from outside while news information <NUM> is displayed at the same as the display <NUM> is folded, the controller <NUM> may control the display <NUM> to display a UI <NUM> informing that the message is received along with the news information <NUM> on the exposure area as illustrated in <FIG>. If an unfolding interaction of unfolding a hinge angle of the display <NUM> as much as a predetermined angle (for example, <NUM>° to <NUM>°) is detected while the UI <NUM> informing that a message is received is touched, the controller <NUM> may control the display <NUM> to display a message window <NUM> for writing a reply to the received message as illustrated in <FIG>.

In addition, the controller <NUM> may control the display <NUM> to display different screens when the exposure area is touched and then, an unfolding interaction is detected and when an unfolding interaction is detected.

Specifically, the controller <NUM> may control the display <NUM> to display a UI <NUM> corresponding to a music application on the exposure area as illustrated in <FIG>.

If a message is received from outside while the UI <NUM> corresponding to a music application is displayed on the exposure area, the controller <NUM> may control the display <NUM> to display a UI <NUM> informing that the message is received along with the music application UI <NUM> on the exposure area as illustrated in <FIG>.

In this case, if an unfolding interaction of unfolding the display <NUM> is detected while the exposure area is not touched, the controller <NUM> may control the display <NUM> to display an execution screen <NUM> of the existing music application as illustrated in <FIG>. In this case, a UI <NUM> informing that a message is received may be displayed on one area of the execution screen <NUM> of the music application for a predetermined time.

However, if an unfolding interaction of unfolding the display <NUM> is detected while the UI <NUM> informing that a message is received is displayed on the exposure area, the controller <NUM> may control the display <NUM> to display a message window <NUM> for writing a reply to the received message as illustrated in <FIG>.

In addition, the controller <NUM> may control the display <NUM> to display different screens according to the order of detecting an unfolding interaction and a touch interaction for lock-releasing.

Specifically, as illustrated in the left side of <FIG>, if a touch interaction for lock-releasing is detected while a UI <NUM> for releasing the lock of the user terminal device <NUM> is displayed on the exposure area, the controller <NUM> may release the lock state of the user terminal device <NUM>, and as illustrated in the right side of <FIG>, may control the display <NUM> to display a first home screen <NUM> including time information on the exposure area.

In addition, as illustrated in the left side of <FIG>, if a touch interaction for lock-releasing is detected while the UI <NUM> for releasing the lock of the user terminal device <NUM> is displayed on the exposure area, and an unfolding interaction is detected, the controller <NUM> releases the lock state of the user terminal device <NUM>, and as illustrated in the right side of <FIG>, controls the display <NUM> to display a second home screen <NUM> on full screen.

As illustrated in the left side of <FIG>, if an unfolding interaction is detected while an image is not displayed on the exposure area, the controller <NUM> may control the display <NUM> to display a UI <NUM> for releasing the lock of the user terminal device on full screen as illustrated in the right side of <FIG>. If a touch interaction for lock-releasing is detected on the UI <NUM> for releasing the lock of the user terminal device <NUM>, which is displayed on full screen, the controller <NUM> may release the lock state of the user terminal device <NUM>, and as illustrated in the right side of <FIG>, may control the display <NUM> to display the second home screen <NUM> on full screen.

In addition, the controller <NUM> may control the display <NUM> to display distinctively a screen which is displayed when only an unfolding interaction is detected while a UI corresponding to a specific application is displayed on the exposure area and a screen which is displayed when an unfolding interaction is detected after the exposure area is touched.

Specifically, if a call request is received from outside while the display <NUM> is folded, the controller <NUM> may control the display <NUM> to display a UI <NUM> informing a call request is received on the exposure area as illustrated in the left side of <FIG>. If the UI <NUM> displayed on the exposure area is touched and then, an unfolding interaction of unfolding the display <NUM> is detected, the controller <NUM> may control the display <NUM> to display an execution screen <NUM> of a calendar application which is related to a call request function on full screen (in another example, an execution screen of a memo application) as illustrated in the lower left side of <FIG>. On the other hand, if an unfolding interaction of unfolding the display <NUM> is detected while the UI <NUM> displayed on the exposure area is not touched, the controller <NUM> may control the display <NUM> to display a call screen <NUM> on full screen as illustrated in the lower right side of <FIG>.

If a folding interaction of folding the display <NUM> is detected while a music application is executed, the controller <NUM> may control the display <NUM> to display a UI <NUM> for controlling the music application on the exposure area as illustrated in the upper portion of <FIG>. If the UI <NUM> displayed on the exposure area is touched and then, an unfolding interaction of unfolding the display <NUM> is detected, the controller <NUM> may control the display <NUM> to maintain music play and display a play list <NUM> on full screen as illustrated in the lower left side of <FIG>. On the other hand, if an unfolding interaction of unfolding the display <NUM> is detected while the UI <NUM> displayed on the exposure area is not touched, the controller <NUM> may control the display <NUM> to display a music player screen <NUM> on full screen as illustrated in the lower right side of <FIG>.

If a first unfolding interaction of unfolding a hinge angle of the display <NUM> as much as a predetermined angle is detected, the controller <NUM> may control the display <NUM> to display at least one icon for executing a specific function. If a second unfolding interaction of unfolding the display <NUM> completely while at least one icon is touched, the controller <NUM> may execute a function corresponding to the touched icon.

According to an exemplary embodiment, if a call request is received from outside while the display <NUM> is folded, the controller <NUM> may control the display <NUM> to display a UI <NUM> informing that a call request is received on the exposure area as illustrated in <FIG>.

If the first unfolding interaction of unfolding a hinge angle of the display <NUM> as much as a predetermined angle (for example, <NUM>° to <NUM>°) is detected while the UI <NUM> informing that a call request is received is displayed, the controller <NUM> may control the display <NUM> to display a UI <NUM> including a plurality of icons <NUM>-<NUM> to <NUM>-<NUM> for performing various functions in relation with making a call as illustrated in <FIG>.

If an unfolding interaction of unfolding the display <NUM> completely (that is, unfolding the display <NUM> such that a hinge angle of the display <NUM> becomes <NUM>°) is detected while a photo sharing icon is touched from among the plurality of icons <NUM>-<NUM> to <NUM>-<NUM>, the controller <NUM> may accept a call request, and as illustrated in <FIG>, may control the display <NUM> to display a call screen <NUM> on the upper area and a list <NUM> for selecting a photo to be shared. In this case, if a touch interaction of dragging one of a plurality of photos included in the list <NUM> to the call screen <NUM> is selected, the controller <NUM> may control the communicator <NUM> to transmit the photo where the touch interaction is detected to a receiver.

If an unfolding interaction is detected, the controller <NUM> may control the display <NUM> to display a plurality of guidance messages according to a hinge angle of the display <NUM> while the unfolding interaction is detected. In this case, the guidance messages may include a guidance message for informing an incoming text message, a guidance message for informing an absence call, a guidance message for informing an incoming an SNS message or SMS message, a guidance message for informing update of applications, etc..

Specifically, as illustrated in <FIG>, the controller <NUM> may control the display <NUM> to display one guidance message while the display <NUM> is folded. Subsequently, if an unfolding interaction of unfolding the display <NUM> is detected, the controller <NUM> may control the display <NUM> to display the different number of guidance messages according to a hinge angle of the display <NUM>. For example, if a hinge angle of the display <NUM> is within a first angle range (for example, between <NUM>° and <NUM>°), the controller <NUM> may control the display <NUM> to display two guidance messages (possibly overlapping) <NUM>, <NUM>. If a hinge angle of the display <NUM> is within a second angle range (for example, between <NUM>° and <NUM>°), the controller <NUM> may control the display <NUM> to display three guidance messages (possibly overlapping) <NUM>, <NUM>, <NUM>. That is, the controller <NUM> may increase the number of guidance messages displayed as a hinge angle of display <NUM> becomes greater.

If a hinge angle of the display <NUM> is within a fourth angle range (for example, between <NUM>° and <NUM>°), the controller <NUM> may control the display <NUM> to display five guidance messages (possibly overlapping) <NUM> to <NUM> as illustrated in <FIG>. In this case, as illustrated in <FIG>, the first guidance message <NUM> which is updated most recently may be disposed on the top.

As illustrated in <FIG>, if a folding interaction of folding the display <NUM> again is detected when the second guidance message <NUM> is touched while the five guidance messages <NUM> to <NUM> are displayed, the controller <NUM> may control the display <NUM> to display the second guidance message <NUM> on the exposure area as illustrated in <FIG>.

In addition, as illustrated in <FIG>, if an unfolding interaction of unfolding the display <NUM> completely is detected when the second guidance message <NUM> is touched while the five guidance messages <NUM> to <NUM> are displayed, the controller <NUM> may control the display <NUM> to display a screen corresponding to the second guidance message <NUM> on full screen as illustrated in <FIG>.

Further, the controller <NUM> may perform different functions according to the direction of a touch interaction which is detected on the exposure area while the display <NUM> is folded.

Specifically, if a message is received from outside while the display <NUM> is folded, the controller <NUM> may control the display <NUM> to display a UI <NUM> informing that the message is received on the exposure area as illustrated in <FIG>.

In this case, if a touch interaction in the left-and-right direction is detected on the UI <NUM> informing that a message is received, the controller <NUM> may control the display <NUM> to display a UI informing the previous message or the next message on the exposure area according to the touch interaction.

If a touch interaction in the down direction is detected on the UI <NUM> informing that a message is received, the controller <NUM> may delete a currently-received message.

If a touch interaction in the up direction is detected on the UI <NUM> informing that a message is received, the controller <NUM> may store the received messages. Specifically, as illustrated in the upper left side of <FIG>, if a touch interaction in the up direction is detected on a UI <NUM> informing that a first message is received, a touch interaction in the up direction is detected on a UI <NUM> informing a second message is received, a touch interaction in the up direction is detected on a UI <NUM> informing that a third message is received and then, an unfolding interaction of unfolding the display <NUM> is detected, the controller <NUM> may control the display <NUM> to display a screen <NUM>' including the first message, a screen <NUM>' including the second message, a screen <NUM>' including the third message and a home screen <NUM> as illustrated in the lower right side of <FIG>.

The controller <NUM> may maintain the current function even if the shape of the display <NUM> changes according to a folding interaction or an unfolding interaction, and control the display <NUM> to display a screen corresponding to the current function.

According to an exemplary embodiment, if a folding interaction of folding the display <NUM> is detected while a music application is executed, the controller <NUM> may control the display <NUM> to display a UI <NUM> corresponding to the music application on the exposure area as illustrated in <FIG>. If a call request is received while the UI <NUM> corresponding to the music application is displayed on the exposure area, the controller <NUM> may control the display <NUM> to display a UI <NUM> informing that a call request is received on the exposure area as illustrated in <FIG>. If an unfolding interaction of unfolding the display <NUM> is detected while the UI <NUM> informing that a call request is received is displayed on the exposure area, the controller <NUM> may control the display <NUM> to display a call screen <NUM> on full screen as illustrated in <FIG>. Subsequently, when the telephone call is completed, the controller <NUM> may control the display <NUM> to display an execution screen <NUM> of the music application on full screen as illustrated in <FIG>. If a folding interaction of folding the display <NUM> is detected again, the controller <NUM> may control the display <NUM> to display the UI corresponding to the music application on the exposure area as illustrated in <FIG>.

According to another exemplary embodiment, as illustrated in <FIG>, the controller <NUM> may control the display <NUM> to display an execution screen <NUM> of a music application on full screen while the music application is executed. If a call request is received from outside, the controller <NUM> may control the display <NUM> to display a screen <NUM> for confirming whether to accept the call request as illustrated in <FIG>. If a folding interaction of folding the display <NUM> is detected while the screen <NUM> for confirming whether to accept the call request is displayed, the controller <NUM> may control the display <NUM> to display a UI <NUM> informing that a call request is rejected on the exposure area as illustrated in <FIG>. When the telephone call is completed, the controller <NUM> may control the display <NUM> to display a UI <NUM> corresponding to the music application on the exposure area as illustrated in <FIG>. Subsequently, if an unfolding interaction of unfolding the display <NUM> is detected again, the controller <NUM> may control the display <NUM> to display the execution screen <NUM> of the music application on full screen as illustrated in <FIG>.

The controller <NUM> may determine a display area which can be watched by a user according to a hinge angle of the display <NUM>, and control the display <NUM> to display a screen including different amount of information on the determined display area. In this case, the hinge angle of the display <NUM> may be matched with the watchable display area and then stored.

According to an exemplary embodiment, if the display <NUM> is unfolded while a telephone call is performed, the controller <NUM> may control the display <NUM> to display a first telephone call screen <NUM> on full screen as illustrated in <FIG>.

If a hinge angle of the display <NUM> is folded as much as θ while a telephone call is performed, the controller <NUM> may determine a display area corresponding to the hinge angle, and as illustrated in <FIG>, may control the display <NUM> to display a second telephone call screen <NUM> on the determined display area. In this case, the second telephone call screen <NUM> may include the amount of information and icons which are smaller than those included in the first telephone call screen <NUM>.

In addition, if the display <NUM> is folded while a telephone call is performed, the controller <NUM> may control the display <NUM> to display a UI <NUM> informing that a telephone call is being performed on the exposure area as illustrated in <FIG>.

According to another exemplary embodiment, if the display <NUM> is unfolded while a navigation application is executed, the controller <NUM> may control the display <NUM> to display a first navigation screen <NUM> on full screen as illustrated in <FIG>.

If a hinge angle of the display <NUM> is folded as much as θ while a navigation application is executed, the controller <NUM> may determine a display area corresponding to the hinge angle, and as illustrated in <FIG>, may control the display <NUM> to display a second navigation screen <NUM> on the determined display area. In this case, the guiding area of the second navigation screen <NUM> may smaller than the guiding area of the first navigation screen <NUM>.

If the display <NUM> is folded while a navigation application is executed, the controller <NUM> may control the display <NUM> to display a third navigation screen <NUM> on the exposure area as illustrated in <FIG>. In this case, the third navigation screen <NUM> might include only direction information and distance information instead of a map screen included in the first navigation screen <NUM> and the second navigation screen <NUM>. However, a map screen may also be included on the exposure area in third navigation screen <NUM>.

Whenever a folding interaction or an unfolding interaction is detected, the controller <NUM> may control the display <NUM> to reconfigure and display information such that the information corresponds to the size and direction of a screen.

Specifically, as illustrated in <FIG>, if a folding interaction of folding the display <NUM> is detected while a first address book list <NUM> is displayed on full screen, the controller <NUM> may control the display <NUM> to display a second address book list <NUM> on the exposure area as illustrated in <FIG>. In this case, the first address book list <NUM> might include user information such as image, name, telephone number, direct call icon, etc., and the second address book list <NUM> might include user information such as image and name only, but the display is not limited to this.

In addition, as illustrated in <FIG>, if an unfolding interaction of unfolding the display <NUM> is detected while a news title <NUM> is displayed on the exposure area when the display <NUM> is folded, the controller <NUM> may control the display <NUM> to display a full screen <NUM> including not only the news title but also the news image and the news text as illustrated in <FIG>.

In addition, the controller <NUM> may control the display <NUM> to display different information on the exposure area and the hidden area when the display <NUM> is folded. In this case, as illustrated in <FIG>, the controller <NUM> may control the display <NUM> to display public information on an exposure area <NUM> and private information on a hidden area <NUM>. For example, as illustrated in <FIG>, the controller <NUM> may control the display <NUM> to display barcode information which is public information on the exposure area <NUM>, and credit card list and transaction information which is private information on the hidden area <NUM>.

Hereinafter, a displaying method of the user terminal device <NUM> according to an exemplary embodiment will be described with reference to <FIG>.

Specifically, the user terminal device <NUM> displays an image on the display <NUM> which is divided into a first area and a second area which is larger than the first area with reference to a hinge or folding line (S2410).

The user terminal device <NUM> determines whether the display <NUM> is folded or not (S2420).

If the display <NUM> is folded (S2420-Y), the user terminal device <NUM> displays a predetermined UI on the exposure area which is an exposed part of the second area (S2430). In this case, the predetermined UI may include a UI including state information of the user terminal device <NUM> and a UI for controlling the user terminal device <NUM>.

As described above, a UI is displayed on the exposure area which is exposed to outside when the display <NUM> is folded and thus, a user may perform various functions of the user terminal device through the UI displayed on the exposure area and receive various information even if the display is folded.

<FIG> are views provided to explain an interaction method based on a folding state of a user terminal device, and <FIG> is a flowchart illustrating a process of treating an interaction based on a folding state of a user terminal device.

Referring to <FIG>, a user terminal device <NUM> may include a display <NUM> divided into a first area <NUM> and a second area <NUM> which is larger than the first area <NUM>, a cover <NUM> (illustrated in <FIG>) which is disposed on the rear side of the display <NUM>, a detector <NUM> which detects a user interaction on the display <NUM> and the cover <NUM>, a controller which, if the display is folded such that the first area <NUM> and the second area <NUM> face each other with reference to the folding line <NUM>, controls the detector to detect a user interaction through an exposure area <NUM> (<FIG>) which is an exposed part of the second area <NUM>, and the cover <NUM>, and, if the display is folded such that the back covers face each other with reference to the folding line, controls the detector to detect a user interaction through both the first area and the second area.

The user terminal device <NUM> may detect a first folding state of the display <NUM> and a second folding state where the display is folded in an opposite direction to the first folding state (S4701, <FIG>).

The user terminal device <NUM> may, in the first folding state (<FIG>), enable a user interaction to be detected through an exposure area <NUM>, which is an exposed part of the second area <NUM>, and the cover <NUM>, and, in the second folding state (<FIG> and <FIG>), enable a user interaction to be detected through the first area <NUM> and the second area <NUM> (S4703).

The display <NUM> of the user terminal device <NUM> may include a folding state and an unfolding state. A screen may be displayed on the display <NUM>. The display may include a folding line <NUM>. The folding line <NUM> may be an imaginary line or a line which is generated on the display <NUM>, and the display <NUM> may be folded with reference to the folding line <NUM>.

The display <NUM> may be divided into a first area <NUM> and a second area <NUM> with reference to a folding line. The second area <NUM> may be larger in size and area than the first area <NUM>.

A cover <NUM> may be disposed on the rear side of the display <NUM>. <FIG> illustrates a cover <NUM>. The cover may include a touch sensor. The cover <NUM> may detect a user interaction through the touch sensor.

The display <NUM> may be folded in a first folding state or a second folding state. The first folding state refers to a state where the displays are folded such that first area and the second area face each other.

Referring to <FIG>, the display is folded in the first folding state. In the first folding state, a user interaction may be detected through an exposure area <NUM> which is an exposed part of the second area, and the cover <NUM>. That is, when the display is folded such that the first area <NUM> and the second area <NUM> face each other, a portion <NUM> of the second area may be exposed to outside.

The second folding state may be a state where the display <NUM> is folded in an opposite direction to a direction where the display is folded in the first folding state. In the second folding state, the display may be folded such that the covers disposed on the rear side of the display unit <NUM> face each other. Also, in the second folding state, the display <NUM> may be folded such that the first area <NUM> and the second area <NUM> are headed in opposite directions with respect to each other.

<FIG> and <FIG> illustrate the display <NUM> which is folded in the second folding state. In the second folding state, the first area <NUM> and the second area <NUM> of the display <NUM> may be exposed to the outside. Also, in the second folding state, a user interaction may be detected through the first area <NUM> and the second area <NUM> of the display <NUM>.

Also, in the second folding state, a user interaction might not be detected areas except for the first area <NUM> and the second area <NUM>. That is, in the second folding state, a user interaction may be detected on the first area <NUM> and the second area <NUM> but might not be detected on the cover <NUM> disposed on the rear side of the display <NUM>.

<FIG> are views illustrating an exemplary embodiment where a user interaction is detected on the back cover while the display <NUM> of the user terminal device is unfolded, and a screen corresponding to the interaction is displayed on the display. <FIG> is a flowchart illustrating a process performed when a user interaction is detected while the display <NUM> of the user terminal device <NUM> is unfolded.

<FIG> illustrates that an application <NUM> being executed when the display <NUM> is unfolded is displayed. The controller <NUM> may control the display <NUM> to display the application being executed. A plurality of applications may be executed in the user terminal device <NUM>, and at least one of the plurality of applications may be displayed on the display <NUM>.

<FIG> illustrates that, if a plurality of applications are executed in the user terminal device <NUM>, and if a user interaction is detected on the cover disposed on the rear side of the display <NUM> while the display <NUM> is unfolded (S4801, <FIG>), the user terminal device <NUM> may control the currently executed plurality of applications to be rotated in a direction of a Z axis based on the user interaction to be displayed on the display <NUM> (S4803).

The user interaction may be detected on the cover disposed on the rear side of the display <NUM>. The user interaction may be detected on the display <NUM>.

<FIG> illustrates that, a plurality of applications <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM> may be displayed on the display <NUM>. If a user interaction <NUM> is detected on the cover, while one application <NUM> among currently executed applications is displayed when the display is unfolded as shown in <FIG>, a plurality of applications <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM> may be displayed on the display as illustrated in <FIG>. Here, the plurality of applications <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM> may be applications which are being executed in the user terminal device <NUM>. The plurality of applications <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM> being executed in the user terminal device may be rotated in a direction of Z axis <NUM> and be displayed on the display <NUM>.

The plurality of applications <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, and <NUM> being executed in a user terminal device <NUM> may be displayed to be in a trapezoid shape and may be seen as a three-dimensional structure. A Z-axis direction <NUM> may be a direction perpendicular to the surface of the display.

If the plurality of applications <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM> are displayed on the display <NUM>, and a user selects any one of the applications by interacting with the cover or the display, the selected application may be displayed on the display <NUM>.

<FIG> illustrates that one application <NUM> selected from among the plurality of applications <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, <NUM> are displayed on the display.

If the plurality of applications <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, and <NUM> are displayed on the display, and a user interaction of selecting one of the plurality of applications is detected, the controller <NUM> may control the display <NUM> to display one application on the display, in response to the user interaction.

<FIG> are views illustrating one or more exemplary embodiments that if a telephone call request is received in a first folding state, possibilities of action are displayed on an exposure area, and <FIG> is a flowchart illustrating a process performed when a telephone call request is received while a display of a user terminal device is in a first folding state.

<FIG> illustrates that the display <NUM> is folded in a vertical direction and in a first folding state. In the first folding state, the second area of the display <NUM> is covered with a cover <NUM>. If the user terminal device <NUM> receives a call request from outside while the display is in the first folding state (S4901, <FIG>), the controller <NUM> may control the display <NUM> to display a UI informing that a call request is received from outside, on an exposure area <NUM> which is an exposed part of the second area.

The detector <NUM> may detect a user interaction <NUM> on the cover (S4903, <FIG>) and output an electronic signal. The controller <NUM> may accept or reject a telephone call request according to the user interaction, e.g., swiping right or swiping left (S4905, <FIG>). Specifically, the controller <NUM> may accept or rejection a telephone call request according to an electronic signal outputted from the detector <NUM>.

The user interaction <NUM> may be a dragging gesture or a flicking gesture. A UI displayed on an exposure area <NUM> may be a list of possible actions which indicate a user interaction's direction.

For example, as illustrated in <FIG>, if a telephone call request is received while the display <NUM> of the user terminal device <NUM> is folded in a first folding state, a UI of 'Accept' or 'Reject' of the telephone call request may be displayed on an exposure area <NUM>. If a user brings his finger into contact with a cover <NUM> and drags in an 'Accept' direction, the call request is accepted, and if a user brings his finger into contact with a cover <NUM> and drags in a 'Reject' direction, the call request may be rejected.

<FIG> illustrates that the display <NUM> is folded in a lateral direction and in a first folding state. In the first folding state, the second area of the display <NUM> is covered with the cover <NUM>. If the user terminal device <NUM> receives a call request from outside while the display <NUM> is in the first folding state (S4901, <FIG>), the controller <NUM> may display the display <NUM> to display a UI informing that the telephone call request is being received from outside, on an exposure area <NUM>, which is an exposed portion of the second area.

The detector <NUM> may detect a user interaction <NUM> on the cover <NUM> (S4903) and output an electronic signal. The controller <NUM> may accept or reject a telephone call request according to the user interaction (S4905, <FIG>). Specifically, the controller <NUM> may accept or reject a telephone call request according to an electronic signal outputted from the detector <NUM>.

The user interaction <NUM> may be a dragging gesture or a flicking gesture. A UI displayed on an exposure area <NUM> may be an affordance which indicates a user interaction's direction.

For example, if a telephone call request is received while the display <NUM> of the user terminal device <NUM> is folded in a first folding state, a UI of 'Accept' or 'Reject' of a telephone call request may be displayed on an exposure area <NUM>. If a user brings his finger into contact with a cover <NUM> and drags in a 'Reject' direction, the call request is accepted, and if a user brings his finger into contact with a cover <NUM> and drags in an 'Accept' direction, the call request is rejected.

<FIG> illustrates that the display <NUM> is folded in a vertical direction and in a first folding state. In the first folding state, the second area of the display <NUM> is covered with a cover <NUM>. If a user terminal device <NUM> receives a telephone call request from outside while the display <NUM> is in a first folding state (S4901, <FIG>), the controller <NUM> may the display <NUM> to display an UI informing that the telephone call request is received from outside, on an exposure area <NUM> which is an exposed part of the second area.

The detector <NUM> may detect a user interaction <NUM> on the cover <NUM> (S4903) and output an electronic signal. The controller <NUM> may accept or reject a telephone call request according to the user interaction <NUM> (S4905). Specifically, the controller <NUM> may accept or reject the telephone call request based on an electronic signal outputted from the detector.

The user interaction <NUM> may be a tapping gesture. The user interaction <NUM> may be a knocking gesture of knocking lightly on the user terminal device <NUM>. A UI displayed on an exposure area <NUM> may be a list of possible actions which indicates a user interaction's direction.

For example, if a telephone call request is received while the display of the user terminal device <NUM> is folded in a first folding state, a UI of 'Accept' or 'Reject' of the call request may be displayed on an exposure area <NUM>. If a user brings his finger into contact with a cover <NUM> and drags in an 'Accept' direction, the call request is accepted, and if a user brings his finger into contact with a cover <NUM> and drag in a 'Reject' direction, the call request is rejected.

<FIG> illustrates that the display is folded in a lateral direction and in a first folding state. In the first folding state, the second area of the display <NUM> is covered with the cover <NUM>. If the user terminal device <NUM> receives a telephone call request from outside while the display <NUM> is in a first folding state (S4901, <FIG>), the controller <NUM> may the display <NUM> to display an UI informing that the telephone call request is received from outside, on an exposure area <NUM> which is an exposed part of the second area.

The detector <NUM> may detect a user interaction <NUM> on the cover <NUM> (S4903) and output electronic signal. The controller <NUM> may accept or reject a telephone call request according to the user interaction (S4905). Specifically, the controller <NUM> may accept or reject the telephone call request according to an electronic signal outputted from the detector <NUM>.

The user interaction <NUM> may be a tapping gesture. The user interaction <NUM> may be a knocking gesture of knocking lightly on the user terminal device <NUM>. A UI displayed on an exposure area <NUM> may be an affordance which indicates a user interaction's direction.

For example, if a telephone call request is received while the display <NUM> of the user terminal device <NUM> is folded in a first folding state, a UI of 'Accept' or 'Reject' of the call request may be displayed on an exposure area <NUM>. If a user brings his finger into contact with a cover <NUM> and drags in an 'Accept' direction, the call request may be accepted, and if a user brings his finger into contact with a cover <NUM> and drag in a 'Reject' direction, the call request may be rejected.

<FIG> are views illustrating one or more exemplary embodiments where a user interaction is detected simultaneously on a display <NUM> and a back cover while the display <NUM> of the user terminal device <NUM> is unfolded, and a plurality of applications being executed are displayed on the display, and <FIG> is a flowchart illustrating a process performed if a user interaction is detected simultaneously on the display <NUM> and a back cover while the display <NUM> of the display <NUM> is unfolded.

<FIG> illustrates that the display is unfolded, and a currently executed application is displayed on the display <NUM>.

A plurality of applications may be executed on the user terminal device <NUM>. While at least one application of the plurality of applications is displayed on the display <NUM>, the detector <NUM> may detect a first user interaction <NUM> on the display <NUM> and detect a second user interaction <NUM> on a back cover simultaneously (S5001, <FIG>).

Here, the term "simultaneously" may be interpreted to have an overlapping section in terms of time, and the start of a first time section and the start of a second time section do not necessarily have to coincide.

The first user interaction <NUM> and the second user interaction <NUM> may be a dragging gesture. Also, the first user interaction <NUM> and the second user interaction <NUM> may be a flicking gesture.

The first user interaction <NUM> and the second user interaction <NUM> may be in the same direction.

The detector <NUM> may detect the first user interaction <NUM> on the display <NUM>, detect the second user interaction <NUM> on the cover, and output an electronic signal. The controller may control a currently executed plurality of applications to overlap one another to be displayed on the display, according to the first user interaction and the second user interaction (S5003, <FIG>).

Specifically, the controller <NUM> may control a currently executed plurality of applications to overlap one another to be displayed on the display <NUM>, based on electronic signal outputted from the detector <NUM>.

<FIG> illustrates that a currently executed plurality of applications <NUM>, <NUM>, <NUM>, <NUM> are displayed on the display <NUM>. The plurality of applications <NUM>, <NUM>, <NUM>, <NUM> overlap one another to be displayed. That is, the application <NUM> may be over the application <NUM> to overlap the application <NUM>, the application <NUM> may be over the application <NUM> to overlap the application <NUM>, and the application <NUM> may be over the application <NUM> to overlap the application <NUM>.

<FIG> illustrates that a display <NUM> is unfolded, and currently executed applications are displayed on the display <NUM>.

A plurality of applications may be executed in a user terminal device. While one application of the plurality of applications is executed on the display <NUM>, the detector <NUM> may detect a first user interaction <NUM> on the display <NUM> and detect a second user interaction <NUM> on a cover simultaneously (S5001).

The first user interaction <NUM> and the second user interaction <NUM> may be in an opposite direction. The first user interaction <NUM> and the second user interaction <NUM> may each be in any direction.

The detector <NUM> may detect the first user interaction <NUM> on the display <NUM>, detect the second user interaction <NUM> on the cover, and output an electronic signal. The controller <NUM> may control a currently executed plurality of applications to overlap one another to be displayed on the display, according to the first user interaction and the second user interaction (S5003, <FIG>).

Specifically, the controller <NUM> may control a currently executed plurality of applications to overlap one another to be displayed on a display <NUM> according to the electronic signal outputted from the detector <NUM>.

If a first interaction direction <NUM> and a second interaction direction <NUM> are headed in different directions, the plurality of applications may overlap one another by a predetermined angle to be displayed on the display <NUM>.

If a first interaction direction <NUM> and a second interaction direction <NUM> are headed in opposite directions, the plurality of applications may overlap one another by a predetermined angle to be displayed on the display <NUM>. The angle may also be set by a user.

<FIG> illustrates that a currently executed plurality of applications <NUM>, <NUM>, <NUM>, and <NUM> are displayed on a display <NUM>. The plurality of applications <NUM>, <NUM>, <NUM>, and <NUM> overlap one another by a predetermined angle to be are displayed. That is, the application <NUM> is over the application <NUM> to be displayed to overlap with the application <NUM>, the application <NUM> is over the application <NUM> to be displayed to overlap with the application <NUM>, and the application <NUM> is over the application <NUM> to be displayed to overlap with the application <NUM>.

<FIG> are drawings illustrating exemplary embodiments that user interactions are simultaneously detected on the display <NUM> on both first area and second area, while the display <NUM> is in the second folding state, and a second screen is displayed on the display <NUM>. <FIG> is a flowchart illustrating a process performed when user interactions are detected simultaneously on the first and second areas of the display, while the display is folded in a second folding state.

<FIG> illustrates that the display <NUM> is folded in a second folding state. The display <NUM> may be divided into a second area and a first area, and on the second area, a first screen <NUM> may be displayed.

The controller <NUM> may detect user interactions <NUM> and <NUM> simultaneously on the first area and the second area in the second folding state of the display <NUM> (S5101), and control a first screen displayed on the first area or the second area to be changed to a second screen, in response to the user interaction <NUM> and <NUM> (S5103).

The user interactions <NUM> and <NUM> may be a touching interaction. The second screen may be a screen which is included as a menu displayed on the first screen. Also, the second screen may be a personalized home screen. Also, the second screen may be a blank screen. The blank screen may be a screen in a state where a screen is turned off.

For example, as illustrated in <FIG>, if touch interactions <NUM> and <NUM> are detected simultaneously on the second area and the first area in a second folding state, the controller <NUM> may control a currently displayed first screen <NUM> to be changed to a second screen which includes a menu screen <NUM> regarding the first screen <NUM>.

<FIG> illustrates that a second screen is displayed. The second screen may include a first screen and a menu <NUM> regarding the first screen <NUM>. The menu <NUM> may be associated with the first screen.

<FIG> illustrates that a second screen which includes another form of menus <NUM> is included in a first screen <NUM>.

<FIG> illustrates that the display <NUM> is folded in a second folding state. The display <NUM> may be divided into the second area and the first area, and in the second area, the first screen <NUM> may be displayed.

The controller <NUM> may detect the user interactions <NUM> and <NUM> simultaneously on the first area and the second area (S5101, <FIG>) in a second folding state of the display <NUM>, and control a first screen displayed on the first area or the second area to be changed to a second screen, in response to the user interactions <NUM> and <NUM> (S5103, <FIG>).

The user interactions <NUM> and <NUM> may be a dragging gesture. Also, the user interactions <NUM> and <NUM> may be a flicking gesture.

For example, as illustrated in <FIG>, if touch interactions <NUM> and <NUM> are detected simultaneously on the second area and the first area of the display, and while the display <NUM> is in the second folding state, an application execution screen of the display <NUM> is displayed, the controller <NUM> may change an application execution screen <NUM> displayed currently on the display to be changed to a home screen <NUM> to be displayed.

<FIG> illustrates that a personalized home screen <NUM> is displayed on the second area.

<FIG> illustrates where the first screen is a lock screen <NUM>, dragging gestures <NUM> and <NUM> are detected simultaneously on the second area and the first area of the display <NUM>. The controller <NUM> may detect dragging interactions of simultaneously dragging on the second area and the first area, while the display <NUM> is in the second folding state and a lock screen is displayed on the second screen, and control the display to display a personalized home screen <NUM> (<FIG>) to be displayed in response to the dragging interactions.

<FIG> are views illustrating that user interactions are detected simultaneously on a display <NUM> where a first screen is displayed, and a cover, and then the first screen is temporarily turned off or a lock screen is displayed based on the user interaction.

<FIG> illustrates that the first screen <NUM> is displayed on the display <NUM> which is folded in a second folding state, and user interactions <NUM> and <NUM> are detected simultaneously on the second area and on first area of the display <NUM>.

The controller <NUM> may control the display <NUM> to change the first screen to be in a screen-off state or display a lock screen, in response to user interactions <NUM> and <NUM>.

<FIG> illustrates that a first screen <NUM> is displayed on the display <NUM> folded in the second folding state, and user interactions <NUM> and <NUM> are detected simultaneously on the second area and the first area of the display <NUM>.

The controller <NUM> may control the display <NUM> to change the first screen to a screen-off state or display a lock screen, in response to user interactions <NUM> and <NUM>.

<FIG> illustrates that the first screen of the display <NUM> is changed to the second screen. The second screen many be in a screen-off state. Also, the second screen may be a lock screen.

<FIG> are views illustrating that, in a screen-off state of the display <NUM>, a screen-off state of the display <NUM> of the user terminal device <NUM> is converted to be in a screen-on state, while the display <NUM> or the cover is touched.

While a touch is being detected, a state of the full screen of the display may be changed to a screen-on state. Or, while a touch is being detected, a state of an area where a touch is being detected may be changed to a screen-on state.

<FIG> illustrates a second folding state of a display <NUM>. The second area <NUM> and the first area <NUM> of the display <NUM> are exposed to outside, and the second area <NUM> and the first area <NUM> may detect a touch, in a screen-off state.

If a user touches the second area <NUM> in a screen-off state (<NUM>), the detector <NUM> may detect the user's touch, and the controller <NUM> may change, to a screen-on state, a state of a screen of the full area of the second area <NUM> or a screen in the vicinity of an area which is a touch-detecting part of the second area <NUM>, while the user's touch is detected. On an area which is in a screen-on state, information may be displayed.

The screen-off state may be a black screen state.

<FIG> illustrates that a user's touch <NUM> is detected on a second area <NUM> of the display, and a state of the second area <NUM> where the touch is detected is changed to a screen-on state.

<FIG> illustrates a second folding state of the display. The first area <NUM> and the second area <NUM> of the display are exposed to outside, and the first area <NUM> and the second area <NUM> can detect a touch, in a screen-off state.

If a user touches the first area <NUM> in a screen-off state <NUM>, the detector may detect the user's touch, and the controller <NUM> may change, to a screen-on state, a state of a screen of the full area of the first area <NUM> or a screen in the vicinity of an area which is a touch-detecting part of the first area <NUM>, while the user's touch is detected. On an area which is a screen-on state, information may be displayed.

<FIG> illustrates that that a user's touch <NUM> is detected at the first area <NUM> of the display <NUM>, and a state of the first area <NUM> where the touch is detected is changed to a screen-on state.

<FIG> illustrates a first folding state of the display <NUM>. Covers <NUM> and <NUM> can detect a user's touch, and a part of the second area of the display <NUM> is exposed to outside. A user's touch may be detected on the covers <NUM> and <NUM>.

<FIG> illustrates a cover <NUM>, and an exposure area <NUM> which is an exposed part of the second area.

If user touches (<NUM>) the cover <NUM> in a screen-off state, the exposure area <NUM> is changed from a screen-off state to a screen-on state, and information may be displayed.

The screen-off state may be a black screen.

<FIG> are drawings illustrating that a volume of the user terminal device <NUM> may be regulated in a screen-off state of the display <NUM>, in response to a user's interaction detected on the display <NUM> and the cover.

The user terminal device <NUM> may detect a user interaction on the display <NUM> and the cover, in a screen-off state of the display. The user terminal device <NUM> may regulate volume of the user terminal device <NUM> according to a user interaction.

The screen-off state is a black screen state.

<FIG> illustrates that the display <NUM> is folded such that covers face each other. The second area <NUM> and the first area <NUM> of the display are exposed to the outside, and a user interaction <NUM> can be detected on a second area <NUM>.

<FIG> illustrates that if a user interaction <NUM> is detected on a second area <NUM> in a screen-off state, while an application for outputting audio such as a music application is executed, the user terminal device <NUM> may regulate volume of the user terminal device <NUM>, in response to the user interaction <NUM>.

The screen-off state may be black screen state.

<FIG> illustrates that a display may be folded such that covers face each other. A first area <NUM> and a second area <NUM> of the display are exposed to outside, and a user interaction <NUM> can be detected on the first area <NUM>.

<FIG> illustrates that if an application for outputting audio such as a music application is executed, and a user interaction <NUM> is detected on a first area <NUM> in screen-off state, the user terminal device <NUM> may regulate volume of the user terminal device <NUM> in response to the user interaction <NUM>.

<FIG> illustrates that a display may be folded such that a first area and a second area face each other. Only a part <NUM> (<FIG>) of a second area of the display <NUM> is exposed to outside, and a user interaction <NUM> may be detected on covers <NUM> and <NUM>.

<FIG> illustrates that if an application for outputting audio such as a music application is executed, and a user interaction <NUM> is detected in screen-off state, the user terminal device <NUM> may regulate volume of the user terminal device <NUM> in response to the user interaction <NUM>.

An exposure area <NUM> of the second area of the display <NUM> may be maintained to be in a screen-off state.

<FIG> illustrates that a display <NUM> may be folded such that the first area and the second area face each other. Only a part of a second area of the display <NUM> is exposed to the outside, and a user interaction <NUM> can be detected on covers <NUM> and <NUM>.

<FIG> illustrates that if an application for outputting audio such as a music application is executed, and a user interaction <NUM> is detected on a cover <NUM> in screen-off state, the user terminal device <NUM> may regulate volume of the user terminal device <NUM> in response to the user interaction <NUM>.

<FIG> are views illustrating one or more exemplary embodiments that various affordances, i.e., visual indicators, are provided on a cover which includes a plurality of light emitting parts, in response to a user interaction, and <FIG> is a flowchart illustrating a processing of displaying an affordance, i.e., visual indicator, on a cover which includes a plurality of light emitting parts, in response to the user interaction.

The user terminal device <NUM> may include a display <NUM> and a cover. The display may be divided into a first area and a second area larger than the first area.

The cover may be disposed on a rear side of the display <NUM> and include a plurality of light emitting parts. The detector <NUM> may detect a user interaction on the display <NUM> and the cover.

If the display is folded such that the first area and the second area face each other with reference to a folding line, the user terminal device <NUM> may display an object on an exposure area which is an exposed part of the second area (S5201), and control light-emitting parts such that an area of the cover is turned on based on the object. Specifically, the controller may control the light emitting parts such that an affordance, i.e., visual indicator, corresponding to the object is displayed on a cover.

<FIG> illustrates that a display is folded such that a first area and a second area of the display <NUM> face each other.

The second area of the display may be covered with a cover <NUM> and may include an exposure area which is an exposed part of a second area <NUM>. On the exposure area <NUM>, information such as a telephone number, a received SNS or SMS message, an informing message, an application, etc., may be displayed.

The cover <NUM> may include a plurality of light emitting parts. For instance, a plurality of LEDs may be disposed in a form of <NUM> X <NUM> (<FIG>). The controller <NUM> may control the light emitting parts to provide an affordance, i.e., visual indicator, corresponding to a displayed object. Specifically, the controller <NUM> may turn on or turn off one or more of the plurality of LEDs and provide an affordance, i.e. visual indicator, corresponding to a displayed object.

For example, as illustrated in <FIG>, if weather information of a specific region is displayed on an exposure area <NUM>, the controller <NUM> may control light emitting arts of the cover to provide an affordance for displaying weather information of another region. The controller <NUM> may turn on two LEDs <NUM>, <NUM> and provide an affordance so that a user can touch the affordance. If the user touches the LED <NUM>, weather information of another region may be displayed on an exposure area <NUM>. The term "touching a LED" refers to directly touching an LED or touching an area in the vicinity of an LED.

<FIG> illustrates that a display <NUM> is folded such that a first area and a second area face each other.

The second area of the display <NUM> is covered with a cover <NUM>, and may include an exposure area <NUM>, which is a part of the second area, which is exposed to outside. If chatting message information is displayed on the exposure area <NUM>, other messages may be displayed by scrolling in up/down/left/right direction. The controller <NUM> may control a plurality of LEDs to provide an affordance for inducing a user interaction for scrolling in up/down/left/right direction. The controller <NUM> may turn on four LEDs <NUM>, <NUM>, <NUM>, <NUM> and provide an affordance so that a user can touch the affordance. If the user touches <NUM> the LED <NUM>, other messages may be displayed on the exposure area <NUM>. The term "touching a LED" refers to directly touching an LED or touching an area in the vicinity of an LED.

<FIG> illustrates that other message information may be displayed on an exposure area <NUM> in response to a user's touching a LED <NUM> as illustrated in <FIG>. On the cover <NUM>, four LEDs are turned on.

<FIG> illustrates that a display <NUM> may be folded such that a first area and a second area face each other.

The second area of the display <NUM> is covered with a cover, and may include an exposure area <NUM>, which is a part of the second area, which is exposed to the outside. On the exposure area <NUM>, a GUI for inputting a telephone number may be displayed.

On the cover, affordances informing an inputting of a telephone number may be provided. The controller <NUM> may control all of the <NUM> LEDs to be turned on and, if a user touches the LEDs, control numbers corresponding to the locations of the LEDs to be input.

For example, if the user touches an LED <NUM> located in a position corresponding to "<NUM>," '<NUM>' may be displayed on an exposure area <NUM>.

The term "touching a LED" refers to directly touching an LED or touching an area in the vicinity of an LED.

The second area of the display <NUM> is covered with a cover <NUM> and may include an exposure area <NUM>, which is a part of the second area, which is exposed to the outside. If a telephone call request is received, a message for informing that the telephone call request is received may be displayed on the exposure area <NUM>. An affordance <NUM> which is associated with the telephone call request may be provided on a cover <NUM>. Specifically, the affordance may be provided by turning on three LEDs sequentially, such that a user may perform an interaction <NUM> along a direction where the LEDs are sequentially turned on.

For example, if, upon receipt of a telephone call request, a UI for informing that the telephone call request is displayed on the exposure area <NUM>, and a user drags along a cover <NUM> from right to left side <NUM> along a direction where LEDs are turned on, the telephone call request may be rejected as illustrated in <FIG>. If a user drags along a cover <NUM> from left to right the call may be accepted.

<FIG> illustrates that a display is folded such that a first area and a second area face each other.

The second area of the display <NUM> is covered with a cover <NUM> and may include an exposure area <NUM>, which is an area of the second area, which is exposed to outside. An affordance which induces a user interaction may be provided on the exposure area <NUM> and a cover <NUM>.

For instance, if an interaction which requires rotation of a user's finger is needed, a GUI object may be displayed on the exposure area <NUM>, and an affordance corresponding to the object may be provided on a cover. Specifically, a plurality of LEDs <NUM> and <NUM> may flick or drag in a circular form on the cover <NUM>.

The second area of the display <NUM> is covered with a cover <NUM>, and may include an exposure area <NUM>, which is a part of the second area, which is exposed to the outside. If a music application is executed in the user terminal device <NUM>, information regarding a currently-played music may be displayed on the exposure area <NUM>.

An affordance for playing a next song or a previous song and an affordance for turning up or turning down volume of a currently replayed song may be provided on the cover <NUM>. Specifically, the affordance may be provided by turning on five LEDs <NUM>, <NUM>, <NUM>, <NUM>, <NUM> from among <NUM> LEDs disposed on the cover, which are disposed in the center of the display.

For instance, if a user touches (<NUM>) the LED <NUM>, a next song may be selected. If a user touches the LED <NUM>, a previous song may be selected. If the user touches the LED <NUM>, volume may be turned up. If the user touches the LED <NUM>, volume may be turned down. If the user touches the LED <NUM>, a currently selected song may be replayed or stopped. These are merely examples of functions. The inventive concept is not limited to these functions.

<FIG> illustrates information on a currently replayed song is displayed on an exposure area <NUM>. Five LEDs among <NUM> LEDs, which are disposed on the center, are turned on the cover.

If a user touches <NUM> an LED <NUM>, volume may be turned up.

Referring to <FIG>, information on the volume is displayed on an exposure area <NUM>. <FIG> illustrate that if a user touches an LED <NUM>, which is included on a cover <NUM> (<FIG>), information displayed on the exposure area is changed to information on a volume to be displayed.

<FIG> are views illustrating that if a screen is turned off while a display <NUM> is folded such that a first area and a second area of the display <NUM> face each other, a state of a screen is changed to be a screen-on state, in response to a user interaction detected on the cover.

<FIG> illustrates that the display <NUM> is folded such that the first area and the second area face each other.

The second area of the display <NUM> is covered with a cover <NUM> and may include an exposure area <NUM>, which is a part of the second area, which is exposed to outside. If a user touches <NUM> a cover in a screen-off state, a user terminal device may provide an affordance for inducing an interaction of turning on the screen, on the cover.

<FIG> illustrates that affordances <NUM> and <NUM> of inducing an interaction of turning on a screen on a cover <NUM> is provided, in response to a user interaction of touching a cover as illustrated in <FIG>.

The exposure area <NUM> maintains a screen-off state.

The user terminal device may display an object on the exposure area (<NUM>, <FIG>) if the user brings his finger into contact with an provided affordance, drags in the bottom direction <NUM> (<FIG>), and then keeps dragging in the right direction <NUM>.

<FIG> illustrates that an object is displayed on an exposure area <NUM>. An affordance <NUM> associated with the currently displayed object may be displayed on the cover <NUM>.

<FIG> are views illustrating that an affordance corresponding to a user's touching a cover is provided, while the display <NUM> is folded such that a first area and a second area face each other.

The second area of the display <NUM> is covered with a cover <NUM>, and may include an exposure area <NUM>, which is an part of the second area, which is exposed to outside. If a user touches <NUM> the cover, an affordance may be provided with reference to the touched point.

<FIG> illustrates that an object is displayed on an exposure area <NUM>, and affordances <NUM> and <NUM> are provided on a cover <NUM>. An affordance for selecting a next or a previous song upon a user's touching a cover may be provided. Specifically, LEDs flick in left and right direction, and thus a user's interaction of dragging in left and right direction may be induced.

<FIG> illustrates that an object is displayed on an exposure area <NUM>, and affordances <NUM> and <NUM> are provided on a cover <NUM>.

If a user touches an LED <NUM>, a previous song is selected, and if a user touches an LED <NUM>, a next song may be selected.

A displaying method of a user terminal device according to various exemplary embodiments may be realized as a program and provided in a user terminal device. Specifically, a non-transitory computer readable medium which stores a program including a controlling method of a user terminal device may be provided.

The non-transitory recordable medium refers to a medium which may store data semi-permanently rather than storing data for a short time such as a register, a cache, and a memory and may be readable by an apparatus. Specifically, the non-transitory readable medium may be CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM, etc..

Claim 1:
A user terminal device (<NUM>) comprising:
a flexible display (<NUM>);
a hinge (<NUM>) configured to asymmetrically fold together the flexible display into a folded state in which an exposed area that is a portion of the flexible display (<NUM>) is viewable; and
a controller (<NUM>) comprising one or more processors (<NUM>, <NUM>) configured to:
control the flexible display (<NUM>) to display a first user interface on the flexible display (<NUM>) in an unfolded state in which the flexible display (<NUM>) is unfolded; and
control the flexible display (<NUM>) to display a second user interface which is different from the first user interface on the exposed area of the flexible display (<NUM>) in the folded state, and
characterized in that
the controller (<NUM>) is further configured to:
control the flexible display (<NUM>) to display, as the second user interface, a lock screen (<NUM>) on the exposed area of the flexible display (<NUM>) in the folded state,
detect a touch interaction on the exposed area to release the lock state of the user terminal device (<NUM>),
detect an unfolding interaction, and,
based on both the detected touch interaction and the detected unfolding interaction, release the lock state and control the flexible display (<NUM>) to display, as the first user interface, a home screen (<NUM>) on full screen.