User terminal device and displaying method thereof

A user terminal device and a displaying method thereof are provided. The user terminal device includes a display which is divided by a folding line into a first area and a second area, the second area being larger than the first area and comprising an exposure area that is exposed while the display is folded along the folding line such that the first area faces the second area, a detector configured to detect a first user interaction of moving along a long side of the exposure area and a second user interaction of moving along a short side of the exposure area, and a controller configured to display a first function execution screen on the exposure area in response to detecting the first user interaction, and display a second function execution screen on the exposure area in response to detecting the second user interaction.

BACKGROUND

Apparatuses and methods consistent with exemplary embodiments relate to a user terminal device and a displaying method thereof, and more particularly, to a user terminal device where a display may be asymmetrically folded with reference to a folding line so as to expose a part of the display and a displaying method thereof.

2. Description of Related Art

With the development of electronic technology, various types of user terminal devices have been developed and distributed. Recently, the size of such user terminal devices has been minimized while the functions of the devices have become diverse and thus, the demands for user terminal devices have been increasing continuously.

A user terminal device may provide various content, such as multimedia content and application screens according to a user's request. A user may select a desired function using a button or a touch screen provided with a user terminal device. A user terminal device may execute a program selectively according to a user interaction, and display the result of execution.

Meanwhile, as a user terminal device provides more diverse functionality, there are various needs for a method of displaying contents and a user interface method. In other words, as the method of displaying content has changed and the type and function of content have been increasing, the existing interaction methods, such as simply selecting a button or touching a screen, may not be sufficient to perform various functions of a user terminal device.

Particularly, a user terminal device of which the display can be folded with reference to a folding line has been developed in order to minimize the size of the user terminal device. However, when the display is folded symmetrically with reference to the folding line, the display is folded completely and a user may not use or watch the display.

SUMMARY

Aspects of one or more exemplary embodiments relate to a user terminal device that, when a display is folded asymmetrically with reference to a folding line, exposing a part of the display, provides various User Interfaces (UI) through the exposed area, and a displaying method thereof.

According to an aspect of an exemplary embodiment, there is provided a displaying method of a user terminal device including a display which is divided into a first area and a second area by a folding line, the second area being larger than the first area and comprising an exposure area, the method including, detecting at least one of a first user interaction of moving along a long side of the exposure area and a second user interaction of moving along a short side of the exposure area while the display is folded forward along the folding line, and displaying a first function execution screen on the exposure area in response to detecting the first user interaction, and displaying a second function execution screen on the exposure area in response to detecting the second user interaction.

The first user interaction of moving along a long side of the exposure area may be the first user interaction of moving in one direction in parallel with the long side of the exposure area, and the second user interaction of moving along the short side of the exposure area may be the second user interaction of moving perpendicular to the one direction in parallel with a short side of the exposure area.

The application providing the first function execution screen may be the same as the application providing the second function execution screen.

The first user interaction may include a movement in a first direction along the long side of the exposure area movement in a second direction opposite to the first direction along the long side of the exposure area, and the displaying the execution screen of the application providing the first function on the exposure area may include, displaying a third function execution screen in response to detecting movement in the first direction, and displaying a fourth function execution screen on the exposure area in response to detecting movement in the second direction.

The second user interaction may include movement in a third direction along the short side of the exposure area and movement in a fourth direction opposite to the third direction along the short side of the exposure area, and the first function execution screen may include, displaying a fifth function execution screen on the exposure area in response to detecting movement in the third direction, and displaying a sixth function execution screen on the exposure area in response to detecting movement in the fourth direction.

The first function execution screen displays one of a home screen, public information, state information of the user terminal device, and the environment setting user interface of the user terminal device, and the second function execution screen another one of the home screen, public information, state information of the user terminal device, and the environment setting user interface of the user terminal device.

The first function may display image information and a first user interface for requesting one or more of storing the image information, deleting the image information, displaying other information related to the image information, a lower menu and an upper menu, and the second function execution screen displays a second user interface for requesting another one of storing the image information, deleting the image information, displaying other information related to the image information, a lower menu and an upper menu.

The first function execution screen may be a telephone application execution screen for indicating that one of a telephone call request is accepted, the telephone call request is rejected, a telephone number of a counterpart requesting the telephone call is stored in a contact list, and a telephone number of a counterpart requesting the telephone call is stored in a spam list, and the second function execution screen may be another telephone application execution screen for indicating another one of the telephone call request is accepted, the telephone call request is rejected, the telephone number of the counterpart requesting the telephone call is stored in the contact list, and the telephone number of the counterpart requesting the telephone call is stored in the spam list.

The first function execution screen may be a message application execution screen for providing one of a received message, a next message, a previous message, an indication that the message is stored, and an indication that the message is deleted, and the second function execution screen may be a message application execution screen for providing another one of the next message, a previous message, an indication that the message is stored, and an indication that the message is deleted.

The first function execution screen may be a music application execution screen for providing one of playlist information, next song information, previous song information, and other playlist information, and the second function execution screen may be another music application execution screen for providing another one of playlist information, next song information, previous song information, and other playlist information.

The method may further include detecting a third user interaction of touching the exposure area, and displaying a third function execution screen on the exposure area in response to detecting the third user interaction.

According to another exemplary embodiment, there is provided a user terminal device including a display which divided by a folding line into a first area and a second area, the second area being larger than the first area and comprising an exposure area that is exposed while the display is folded along the folding line such that the first area faces the second area, a detector configured to detect at least one of a first user interaction of moving along a long side of the exposure area and a second user interaction of moving along a short side of the exposure area, and a controller configured to display a first function execution screen on the exposure area in response to detecting the first user interaction, and display a second function execution screen on the exposure area in response to detecting the second user interaction.

The first user interaction of moving along the long side of the exposure area may be the first user interaction of moving in one direction in parallel with the long side of the exposure area, and the second user interaction of moving along the short side of the exposure area may be the second user interaction of moving perpendicular to the one direction in parallel with a short side of the exposure area.

The application providing the first function execution screen may be the same as the application providing the second function execution screen.

The first user interaction may include movement in a first direction along a long side of the exposure area and movement in a second direction opposite to the first direction along the long side of the exposure area, and the controller may be configured to control the display to display a third function execution screen on the exposure area in response to detecting movement in the first direction, and may control the display to display a fourth function execution screen on the exposure area in response to detecting movement in the second direction.

The second user interaction may include movement in a third direction along the short side of the exposure area and movement in a fourth user direction opposite to the third direction along the short side of the exposure area, and the controller may be configured to control the display to display a fifth execution screen on the exposure area in response to detecting movement in the third direction, and may control the display to display a sixth function execution screen on the exposure area.

The first function execution screen may display one of a home screen, public information, state information of the user terminal device, and the environment setting user interface of the user terminal device, and the second function execution screen may be another one of execution screens of the home screen, public information, state information of the user terminal device, and the environment setting user interface of the user terminal device.

The first function execution screen may display image information and a first user interface for requesting one or more of storing the image information, deleting the image information, displaying other information related to the image information, a lower menu and an upper menu, and the second function execution screen displays a second user interface for requesting another one of storing the image information, deleting the image information, displaying other information related to the image information, a lower menu and an upper menu.

The first function execution screen may be a telephone application execution screen for indicating that one of a telephone call request is accepted, the telephone call request is rejected, a telephone number of a counterpart requesting the telephone call is stored in a contact list, and a telephone number of a counterpart requesting the telephone call is stored in a spam list, and an the second function execution screen may be another telephone application execution screen for indicating another one of the telephone call request is accepted, the telephone call request is rejected, a telephone number of a counterpart requesting the telephone call is stored in the contact list, and indicating that the telephone number of the counterpart requesting the telephone call is stored in the spam list.

The first function execution screen may be a message application for providing one of a received message, a next message, a previous message, an indication that the message is stored, and an indication that the message is deleted, and the second function execution screen may be another one a next message, a previous message, the indication that the message is stored, and the indication that the message is deleted.

The first function execution screen may be a music application execution screen for providing one of playlist information, next song information, previous song information, and other playlist information, and the second function execution screen may be another music application execution screen for displaying another one of playlist information, next song information, previous song information, and other playlist information.

The detector may be configured to detect a third user interaction of touching the exposure area, and the controller may control the display to display a third function execution screen on the exposure area in response to the third user interaction being detected.

According to still another aspect of an exemplary, a device includes a display configured to fold along a folding line dividing the display into a first area and a second area larger than the first area, the second area comprising an exposure area that is exposed when the display is folded; a detector configured to detect a folding state of the display and a touch interaction on the device; and a controller configured to generate a user interface and control the display to display the generated user interface based on the folding state and the touch interaction.

The controller may be configured to generate and display a lock screen on the exposure area of the display.

The controller may be configured to generate and display a public information user interface on the exposure area of the display.

As described above, according to various exemplary embodiments, a user may perform various functions of a user terminal device through a user interface displayed on the exposure area even when the display is folded, and may be provided with various information.

DETAILED DESCRIPTION

Specific exemplary embodiments will be described with reference to accompanying drawings and detailed explanation. However, this does not necessarily limit the scope of the exemplary embodiments to a specific form. Instead, modifications, equivalents and replacements included in the disclosed concept and technical scope of this specification may be employed. While describing exemplary embodiments, if a specific description regarding a known technology might obscure the gist of an inventive concept, the specific description may be omitted.

In the present disclosure, relational terms such as first and second, and the like, may be used to distinguish one entity from another entity, without necessarily implying any actual relationship or order between such entities.

The terms used in the following description are provided to explain a specific exemplary embodiment and are not intended to limit the scope of rights. A singular term includes a plural form unless expressly stated otherwise. The terms “include”, “comprise”, “is configured to”, etc., of the description, are used to indicate that there are features, numbers, steps, operations, elements, parts or combinations thereof, and they should not exclude the possibilities of combination or addition of one or more features, numbers, steps, operations, elements, parts or combination thereof.

In an exemplary embodiment, ‘a module’ or ‘a unit’ performs at least one function or operation, and may be realized as hardware, software, or a combination thereof. In addition, a plurality of ‘modules’ or a plurality of ‘units’ may be integrated into at least one module and may be realized as at least one processor except for ‘modules’ or ‘units’ that should be realized in a specific hardware.

An exemplary embodiment will now be described in detail with reference to the accompanying drawings.FIG. 1is a block diagram illustrating configuration of a user terminal device100according to an exemplary embodiment. As illustrated inFIG. 1, the user terminal device100includes a display110, a detector120, and a controller130. The user terminal device100may be realized as various types of devices such as TV, monitor, PC, laptop PC, mobile phone, tablet PC, touchscreen, PDA, MP3 player, kiosk, electronic album, table display device, LCD display, LED display, OLED display, camera, watch, wearable device, etc. If a user terminal device is realized as portable device such as mobile phone, tablet PC, PDA, MP3 player, laptop PC, watch, wearable device, etc., the user terminal device may be referred to as a mobile device. Throughout this specification, for convenience and not for any limiting purposes, it may be referred to as a user terminal device.

The display110displays various image data and UIs. In particular, the display110may be realized as a touch screen as it is combined with a touch detector. In addition, the display110may include a folding line so that the display110may be folded.

In particular, the display110is divided by a folding line to form a first area and a second area which is larger than the first area. If the display is folded such that the first area comes in touch with the second area, the display110may display on an exposure area of the second area, the area exposed while the display110is folded, at least one of a UI including information regarding the user terminal device100and a UI for controlling the user terminal device100.

The detector120detects a user interaction. In particular, the detector120may include a touch detector which detects a user's touch interaction. In addition, the detector120may include a folding detector which detects a folding interaction of folding the display110and an unfolding interaction of unfolding the display110.

The controller130controls overall operations of the user terminal device100. In particular, the controller130may control the detector120to detect a first user interaction of moving along a long side of the exposure area or a second user interaction of moving along a short side of the exposure area while the first area and the second area are folded forward to face each other, exposing a part of the second area. If the first user interaction is detected, the controller130may control the display110to display an execution screen of an application providing a first function on the exposure area and if the second user interaction is detected the controller130may control the display110to display an execution screen of an application providing a second function.

In particular, if a third user interaction is detected, the controller130may control the display110to display an execution screen of an application providing a third function on the exposure area, and if a fourth user interaction is detected, may control the display110to display an execution screen of an application providing a fourth function.

In addition, if the third user interaction is detected on the exposure area through the detector120, the controller130may control the display110to display an execution screen of an application providing the third function on the exposure area.

As described above, according to various exemplary embodiments, a user may perform various functions of a user terminal device and may be provided with various information through a UI displayed on the exposure area even when the display110is folded.

One or more exemplary embodiments will be described in greater detail with reference toFIGS. 2 to 23B. Hereinafter, an exemplary embodiment will be described in greater detail with reference toFIGS. 2 to 23B.FIG. 2is a block diagram illustrating configuration of a user terminal device200in detail according to an exemplary embodiment. As illustrated inFIG. 2, the user terminal device includes an image receiver210, an image processor220, a display230, a communicator240, a storage250, an audio processor260, a speaker270, a detector280, and a controller290.

Meanwhile,FIG. 2illustrates various components of the user terminal device200is an apparatus having various functions, such as content providing function, display function, etc. One or more exemplary embodiments, a part of the components illustrated inFIG. 2may be omitted or changed, or other components may be further added.

The image receiver210receives image data through various sources. For example, the image receiver210may receive broadcasting data from an external broadcasting station, VOD data in real time from an external server, or image data from an external apparatus.

The image processor220processes image data received from the image receiver210. The image processor220may perform various image processing with respect to image data, such as decoding, scaling, noise filtering, frame rate conversion, resolution conversion, etc.

The display230displays at least one of a video frame which is generated as the image processor220processes image data received from the image receiver220and various screens generated by a graphic processor293.

In particular, as illustrated inFIG. 3A, the display230may consist of a first area320and a second area330which is larger than the first area320with reference to a folding line310. As illustrated inFIG. 3B, if the display230is folded with reference to the folding line310, the display230may include an exposure area340which is the exposed a part of the second area330. Meanwhile,FIG. 3Cis a view illustrating a cover which is on the rear side of the user terminal device200when the user terminal device200is folded. In other words, the rear side of the user terminal device200may include a first cover350corresponding to the first area320and a second cover360corresponding to the second area330.

Meanwhile, in the above-described exemplary embodiment, the length of the folding line310is in parallel with a short side, but this is only an example. As illustrated inFIG. 3D, the length of the folding line310may be in parallel with a long side. In this case, the display230may consist of a first area370and a second area380with reference to the folding line310. As illustrated inFIG. 3E, if the display230is folded with reference to the folding line310, the display230may include an exposure area390of the second area380, which is exposed to outside.

Meanwhile, in the above-exemplary embodiment, the folding line310may be a line generated by a physical hinge. In addition, if the display230is a flexible display, the folding line310may be a line which can be folded by a user.

The communicator240performs communication with various types of external apparatuses according to various types of communication methods. The communicator240may include a WiFi chip241, a Bluetooth chip242, a wireless communication chip243, and a Near Field Communication (NFC) chip244. The controller290performs communication with various external apparatuses using the communicator240.

In particular, the WiFi chip241and the Bluetooth chip242perform communication according to a WiFi method and a Bluetooth method, respectively. In the case of the WiFi chip241or the Bluetooth chip242, various connection information, such as an SSID and a session key may be transmitted/received first for communication connection and then, various information may be transmitted/received. The wireless communication chip243represents a chip which performs communication according to various communication standards such as IEEE, Zigbee, 3rdGeneration (3G), 3rdGeneration Partnership Project (3GPP), Long Term Evolution (LTE) and so on. The NFC chip244represents a chip which operates according to an NFC method which uses 13.56 MHz band among various RF-ID frequency bands such as 135 kHz, 13.56 MHz, 433 MHz, 860˜960 MHz, 2.45 GHz, and so on.

The storage250may store various programs and data necessary to operate the user terminal device200. Specifically, the storage250may store programs and data to configure various screens to be displayed on a main area and a sub area.FIG. 4is a view provided to explain the structure of software stored in the user terminal device200. According toFIG. 4, the storage250may store an Operating System (OS)410, a kernel420, middleware430, an application440, etc.

The OS410controls and manages overall operations of hardware. In other words, the OS410manages hardware and is responsible for basic functions such as memory and security.

The kernel420serves as a path transmitting various signals detected at the display230, such as a touch signal, to the middleware430.

The middleware430includes various software modules for controlling the operation of the user terminal device200. According toFIG. 4, the middleware430includes an X11module430-1, an APP manager430-2, a connection manager430-3, a security module430-4, a system manager430-5, a multimedia framework430-6, a UI framework430-7, a window manager430-8, and a writing recognition module430-9.

The X11module430-1receives various event signals from various hardware provided in the user terminal device200. Herein, the event may vary, ranging from an event of setting of a system alarm, an event of executing or terminating a specific program, etc.

The APP manager430-2manages the execution state of various applications440which are installed in the storage250. When an application execution event is detected from the X11module430-1, the APP manager430-2calls and executes an application corresponding to the event.

The connection manager430-3supports wired or wireless network connection. The connection manager430-3may include various detailed modules such as a DNET module, a UPnP module, etc.

The security module430-4supports certification, permission, secure storage, etc., with respect to hardware.

The system manager430-5monitors the state of each element of the user terminal device200, and provides the monitoring result to other modules. For example, if there is not enough battery left, an error occurs, or connection is cut off, the system manager430-5may provide the monitoring result to a main UI framework430-7or a sub UI framework430-9and output an alarm message or an alarm sound.

The multimedia framework430-6may be stored in the user terminal device200, or may reproduce multimedia content provided from an external source. The multimedia framework430-6may include a player module, a camcorder module, a sound processing module, etc. Accordingly, the multimedia framework430-6may reproduce various multimedia content, and generate and reproduce screens and sounds.

The main UI framework430-7provides various UIs to be displayed on a main area of the display230, and the sub UI framework430-9provides various UIs to be displayed on a sub area. The main UI framework430-7and the sub UI framework430-9may include an image composite module to configure various objects, a coordinates composite module to calculate a coordinates where an object is to be displayed, a rendering module to render the configured object on the calculated coordinates, a 2D/3D UI toolkit to provide a tool for configuring a UI in 2D or 3D form, etc. The main UI framework430-7and the sub UI framework430-9may include an image composite module to configure various objects, a coordinates composite module to calculate a coordinates where an object is to be displayed, a rendering module to render the configured object on the calculated coordinates, a 2D/3D UI toolkit to provide a tool for configuring a UI in 2D or 3D form, etc.

The window manager430-8may detect a touch event using a user's body part or pen or other input events. When such an event is detected, the window manager430-8transmits an event signal to the main UI framework430-7or the sub UI framework430-9so that an operation corresponding to the event is performed.

In addition, if a user touches and drags a screen, various program modules such as a writing module for drawing a line according to a drag trace and an angle calculation module for calculating a pitch angle, a roll angle, a yaw angle, etc. based on a sensor value sensed by a movement detector282may be stored.

The application module440includes applications440-1-440-nfor supporting various functions. For example, program modules for providing various services, such as a navigation program module, a game module, an electronic book module, a calendar module, an alarm management module, a music module, an electronic banking module, a stock module, a calculator module, an electronic mail module, a spreadsheet module, a word processor module, etc. may be included. Such applications may be set as default or may be set temporarily by a user when necessary. If an object is selected, the main CPU294may execute an application corresponding to the selected object using the application module440.

The software structure displayed inFIG. 4is only an example and thus, an exemplary embodiment is not necessarily limited thereto. Thus, part of the structure may be omitted or changed, or new structure may be added, if necessary. For example, the storage250may additionally provide various programs such as a sensing module for analyzing signals sensed by various sensors, a messaging module including a messenger program, a Short Message Service (SMS) & Multimedia Message Service (MMS) program, an e-mail program, etc., a call info aggregator program module, a VoIP module, a web browser module, etc.

Referring back toFIG. 2, the audio processor260processes audio data of image content. The audio processor260may perform various processing such as decoding, amplification, noise filtering, compression, equalization, noise cancellation, echo or reverb removal or addition, etc. with respect to audio data. The audio data processed by the audio processor260may be output to the audio output unit270(e.g., audio outputter).

The audio output unit270outputs not only various audio data which is processed in many ways such as decoding, amplification, and noise filtering by the audio processor260but also various alarm sounds or voice messages. In particular, the audio output unit270may be realized as a speaker, but this is only an example. The audio output unit270may be realized as an output terminal which may output audio data.

The detector280detects various user interactions. In particular, the detector280may include a touch detector281, a movement detector282, and a folding detector283, as illustrated inFIG. 2.

Specifically, the touch detector281may detect a user's touch interaction using a touch panel attached to the rear side of a display panel. The movement detector282may detect a movement (for example, a rotation movement, a vertical movement, a horizontal movement, etc.) of the user terminal device100using at least one of an accelerator sensor, a geomagnetic sensor, and a gyro sensor. The folding detector283may detect at least one of whether the user terminal device200is folded with reference to the folding line310and the angle at which the terminal device200is folded using a bending sensor (for example, a light sensor, a fiber optic sensor, a conductive ink-based sensor, a conductive fabric sensor, etc.).

Meanwhile, the touch detector281might activate only a touch sensor disposed on the exposure area while the display230is folded, and inactivate a touch sensor disposed on the other areas.

The controller290controls overall operations of the user terminal device200using various programs stored in the storage250.

As illustrated inFIG. 2, the controller290includes a RAM291, a ROM292, a graphic processor293, a main CPU294, a first to an nth interface295-1˜295-n, and a bus296. In this case, the RAM291, the ROM292, the graphic processor293, the main CPU294, the first to the nth interface295-1˜295-n, etc. may be interconnected through the bus296.

The ROM292stores a set of commands for system booting. If a turn-on command is input and thus, power is supplied, the main CPU294copies O/S stored in the storage250in the RAM291according to a command stored in the ROM292, and boots a system by executing the O/S. When the booting is completed, the main CPU294copies various application programs stored in the storage250to the RAM291, and executes the application programs copied in the RAM291to perform various operations.

The graphic processor293generates a screen including various objects such as an icon, an image, a text, etc. using a computing unit (e.g., computer) and a rendering unit (e.g., renderer). The computing unit computes property values such as coordinates, shape, size, and color of each object to be displayed according to the layout of the screen using a control command received from the detector280. The rendering unit generates a screen with various layouts including objects based on the property values computed by the computing unit. The screen generated by the rendering unit is displayed in a display area of the display230.

The main CPU294accesses the storage250, and performs booting using the O/S stored in the storage250. The main CPU294performs various operations using various programs, content, data, etc. stored in the storage250.

The first to the nth interface295-1˜295-nare connected to the above-described various elements. One of the above interface may be a network interface which is connected to an external apparatus via network.

In particular, the controller290may provide various functions using an exposure area which is exposed to the outside when the display110is folded.

A UI Provided on the Exposure Area

If the display230is folded with reference to the folding line310such that the first area320and the second area330come in contact with each other, the controller290may control the display230to display a predetermined UI on the exposure area340of the second area320, which is exposed to the outside. In this case, the predetermined UI may include at least one of a UI including the state information of the user terminal device200and a UI for controlling the user terminal device200.

In an exemplary embodiment, if a folding interaction of folding the display230with reference to the folding line310such that the first area320and the second area330come in contact with each other is detected, the controller290may control the display230to display a UI510providing a memo function on the exposure area as illustrated inFIG. 5A. In this case, if a user input, such as a finger, pen or stylus, is detected through the UI510which provides a memo function, the controller290may control the display230to display an image according to the user input.

In addition, the controller290may control the display230to display a UI for controlling a specific application on the exposure area. Specifically, if a folding interaction of folding the display230with reference to the folding line310such that the first area320and the second area330come in contact with each other is detected while a specific application is executed, the controller290may control the display230to display a UI for controlling the specific application on the exposure area. For example, as shown inFIG. 5B, if a folding interaction of folding the display230with reference to the folding line310such that the first area320and the second area330come in contact with each other is detected while a music application is executed, the controller290may control the display230to display a UI520for controlling the music application on the exposure area. In this case, the UI520for controlling a music application may include information regarding currently-played music, a play/stop icon, a skip icon, a rewind icon, a next song, a past song, thumbs up, thumbs down, etc.

In addition, the controller290may control the display230to display a UI including a hot key icon for checking the current state of the user terminal device200on the exposure area. For example, if a predetermined user interaction (for example, an interaction of touching or tapping the exposure area twice in a row) is detected while the display230is folded, the controller290may control the display230to display a UI530including a hot key icon for checking the current state of the user terminal device200on the exposure area as illustrated inFIG. 5C. In this case, the hot key icon for checking the current state of the user terminal device200may include a hot key icon for checking a battery state, a hot key icon for checking a network state, a hot key icon for checking display brightness setting, etc.

In addition, the controller290may control the display230to display a UI informing that a message or data is received from the outside on the exposure area. For example, if a social network message (SNS) message is received from the outside through the communicator240while the display230is folded, the controller290may control the display230to display a UI540informing that the SNS message is received on the exposure area as illustrated inFIG. 5D. In this case, the UI540informing that an SNS message is received may include at least one of information regarding a sender and information regarding the SNS message.

Further, the controller290may control the display230to display various types of UIs for releasing a lock state of the user terminal device200on the exposure area.

Specifically, as illustrated inFIG. 6A, the controller290may control the display230to display a UI610for inputting a pin number to release the lock state of the user terminal device200on the exposure area. In this case, the UI610for inputting a pin number may change the pin number by a touch interaction of swiping up and down. If a predetermined pin number is input on the UI610displayed on the exposure area, the controller290may release the lock state of the user terminal device200. Additionally, the user may set the pin number through user input.

In addition, as illustrated inFIG. 6B, the controller290may control the display230to display a UI620including a plurality of dots on a corner of the exposure area to release the lock state of the user terminal device200on the exposure area. In this case, if a touch interaction of connecting dots in a predetermined pattern is detected on the UI620, the controller290may release the lock state of the user terminal device200. Additionally, the user may set the pattern through user input.

As illustrated inFIG. 6C, the controller290may control the display230to display a UI630in the form of a keyboard, e.g., a piano, to release the lock state of the user terminal device200on the exposure area. In this case, if a touch interaction of touching the keyboard in a predetermined rhythm is detected on the UI630, the controller may release the lock state of the user terminal device200. Additionally, the user may set the rhythm through user input.

In addition, as illustrated inFIG. 6D, the controller290may control the display230to display a UI640including a home icon to release the lock state of the user terminal device on the exposure area. In this case, if a touch interaction of pinching out with reference to the home icon included in the UI640is detected, the controller290may release the lock state of the user terminal device200.

The controller290may control the display230to display a UI for changing the setting of the user terminal device200illustrated inFIG. 2on the exposure area.

Specifically, as illustrated inFIG. 7A, the controller290may control the display230to display a UI710in the form of an arc for adjusting the volume of the user terminal device200. Meanwhile, in the above exemplary embodiment, the UI displayed on the exposure area adjusts the volume, but this is only an example. A UI for adjusting another setting of the user terminal device200(for example, display brightness, etc.) may be displayed.

In addition, as illustrated inFIG. 7B, if a touch interaction of dragging one of a plurality of vertexes included in the exposure area in a diagonal direction is detected, the controller290may control the display230to display a UI730for turning off the power of the user terminal device200at the corner area corresponding to the vertex where the touch interaction is detected.

A Folding Interaction and an Unfolding Interaction

If a plurality of icons are displayed on the exposure area while the display230is folded, and an unfolding interaction of unfolding the display230while one of the plurality of icons is touched, the controller290may control the display230to display a screen corresponding to the touched icon on full screen.

Specifically, as illustrated inFIG. 8A, the display230displays first to fourth icons810to840while the display230is folded. If an unfolding interaction of unfolding the display230is detected while the fourth icon840out of the first to the fourth icon810to840is touched, the controller290may control the display230to display a message window850corresponding to the fourth icon840, as illustrated inFIG. 8B.

Meanwhile, in the above exemplary embodiment, an unfolding interaction is detected while the fourth icon840is touched, but this is only an example. If an unfolding interaction is detected while another icon is touched, a screen corresponding to the other-touched icon may be displayed on the full screen of the display230. For example, if an unfolding interaction is detected while the first icon810is touched, the controller290may control the display230to display a full screen execution screen of a call application corresponding to the first icon810(for example, a recent call list screen, an address book screen, a call sending screen, etc.). In addition, if an unfolding interaction is detected while the second icon820is touched, the controller290may control the display230to display a web browser screen corresponding to the second icon820on full screen. If an unfolding interaction is detected while the third icon830is touched, the controller290may control the display230to display a full screen execution screen of a music application corresponding to the third icon830(for example, a music play screen, a music list screen, etc.).

In addition, if the exposure area is touched while the display230is folded and then, an unfolding interaction of unfolding a hinge angle of the display230as much as a predetermined angle is detected, the controller290may control the display230to display a screen for executing a specific function.

Specifically, if a call request is received while the display230is folded, the controller290may control the display230to display a UI910informing that a call request is received on the exposure area, as illustrated inFIG. 9A. If an unfolding interaction of unfolding a hinge angle of the display230as much as a predetermined angle (for example, 70° to 120°) is detected while the UI910informing that a call request is received is touched, the controller290may accept the call request, execute a speaker phone function, and control the display230to display an execution screen920including various icons as illustrated inFIG. 9B.

Specifically, if a message is received from outside while news information1010is displayed at the same as the display230is folded, the controller290may control the display230to display a UI1020informing that the message is received along with the news information1010on the exposure area as illustrated inFIG. 10A. If an unfolding interaction of unfolding a hinge angle of the display230as much as a predetermined angle (for example, 70° to 120°) is detected while the UI1020informing that a message is received is touched, the controller290may control the display230to display a message window1030for writing a reply to the received message as illustrated inFIG. 10B.

In addition, the controller290may control the display230to display different screens when the exposure area is touched and then, an unfolding interaction is detected and when an unfolding interaction is detected.

Specifically, the controller290may control the display230to display a UI1110corresponding to a music application on the exposure area as illustrated inFIG. 11A.

If a message is received from outside while the UI1110corresponding to a music application is displayed on the exposure area, the controller290may control the display230to display a UI1120informing that the message is received along with the music application UI1110on the exposure area as illustrated inFIG. 11B.

In this case, if an unfolding interaction of unfolding the display230is detected while the exposure area is not touched, the controller290may control the display230to display an execution screen1130of the existing music application as illustrated inFIG. 11C. In this case, a UI1135informing that a message is received may be displayed on one area of the execution screen1130of the music application for a predetermined time.

However, if an unfolding interaction of unfolding the display230is detected while the UI1120informing that a message is received is displayed on the exposure area, the controller290may control the display230to display a message window1140for writing a reply to the received message as illustrated inFIG. 11D.

In addition, the controller290may control the display230to display different screens in the order of detecting an unfolding interaction and a touch interaction for lock-releasing.

Specifically, as illustrated in the left side ofFIG. 12A, if a touch interaction for lock-releasing is detected while a UI1210for releasing the lock of the user terminal device200is displayed on the exposure area, the controller290may release the lock state of the user terminal device200, and as illustrated in the right side ofFIG. 12A, may control the display230to display a first home screen1220including time information on the exposure area.

In addition, as illustrated in the left side ofFIG. 12B, if a touch interaction for lock-releasing is detected while the UI1210for releasing the lock of the user terminal device200is displayed on the exposure area, and an unfolding interaction is detected, the controller290may release the lock state of the user terminal device200, and as illustrated in the right side ofFIG. 12B, may control the display230to display a second home screen1230on full screen.

As illustrated in the left side ofFIG. 12C, if an unfolding interaction is detected while an image is not displayed on the exposure area, the controller290may control the display230to display a UI1240for releasing the lock of the user terminal device on full screen as illustrated in the right side ofFIG. 12C. If a touch interaction for lock-releasing is detected on the UI1240for releasing the lock of the user terminal device200, which is displayed on full screen, the controller290may release the lock state of the user terminal device200, and as illustrated in the right side ofFIG. 12B, may control the display230to display the second home screen1230on full screen.

In addition, the controller290may control the display230to display a distinctive screen which is displayed only when an unfolding interaction is detected while a UI corresponding to a specific application is displayed on the exposure area and a screen which is displayed when an unfolding interaction is detected after the exposure area is touched.

Specifically, if a call request is received from outside while the display230is folded, the controller290may control the display230to display a UI1310informing a call request is received on the exposure area as illustrated in the left side ofFIG. 13A. If the UI1310displayed on the exposure area is touched and then, an unfolding interaction of unfolding the display230is detected, the controller290may control the display230to display an execution screen1320of a calendar application which is related to a call request function on full screen, as illustrated in the lower left side ofFIG. 13A. Other applications, such as a memo application may display execution screens in response to the UI1310displayed on the exposure area being touched and then, an unfolding interaction of unfolding the display230being detected. On the other hand, if an unfolding interaction of unfolding the display230is detected while the UI1310displayed on the exposure area is not touched, the controller290may control the display230to display a call screen1330on full screen as illustrated in the lower right side ofFIG. 13A.

If a folding interaction of folding the display230is detected while a music application is executed, the controller290may control the display230to display a UI1340for controlling the music application on the exposure area as illustrated in the upper portion ofFIG. 13B. If the UI1340displayed on the exposure area is touched and then an unfolding interaction of unfolding the display230is detected, the controller290may control the display230to maintain music play and display a play list1350on full screen as illustrated in the lower left side ofFIG. 13B. On the other hand, if an unfolding interaction of unfolding the display230is detected while the UI1340displayed on the exposure area is not touched, the controller290may control the display230to display a music player screen1360on full screen as illustrated in the lower right side ofFIG. 13B.

If a first unfolding interaction of unfolding a hinge angle of the display230as much as a predetermined angle is detected, the controller290may control the display230to display at least one icon for executing a specific function. If a second unfolding interaction of unfolding the display230completely while at least one icon is touched, the controller290may execute a function corresponding to the touched icon.

According to an exemplary embodiment, if a call request is received from outside while the display230is folded, the controller290may control the display230to display a UI1410informing that a call request is received on the exposure area as illustrated inFIG. 14A.

If the first unfolding interaction of unfolding a hinge angle of the display230as much as a predetermined angle (for example, 30° to 150°) is detected while the UI1410informing that a call request is received is displayed, the controller290may control the display230to display a UI1420including a plurality of icons1430-1to1430-3for performing various functions in relation with making a call as illustrated inFIG. 14B.

If an unfolding interaction of completely unfolding the display230(that is, unfolding the display230such that a hinge angle of the display230becomes 180°) is detected while a photo sharing icon is touched from among the plurality of icons1430-1to1430-3, the controller290may accept a call request, and as illustrated inFIG. 14C, may control the display230to display a call screen1440on the upper area and a list1450for selecting a photo to be shared. In this case, if a touch interaction of dragging one of a plurality of photos included in the list1450to the call screen1440is selected, the controller290may control the communicator240to transmit the photo where the touch interaction is detected to a receiver.

If an unfolding interaction is detected, the controller290may control the display230to display a plurality of guidance messages according to a hinge angle of the display230while the unfolding interaction is detected. In this case, the guidance messages may include a guidance message for informing an incoming text message, a guidance message for indicating a missed call, a guidance message for informing an incoming an SNS message, a guidance message for informing of application updates, etc.

Specifically, as illustrated inFIG. 15A, the controller290may control the display230to display one guidance message1510while the display230is folded. Subsequently, if an unfolding interaction of unfolding the display230is detected, the controller290may control the display230to display a different number of guidance messages according to a hinge angle of the display230. For example, if a hinge angle of the display230is within a first angle range (for example, between 5° and 15°), the controller290may control the display230to display two guidance messages1510,1520. If a hinge angle of the display230is within a second angle range (for example, between 15° and 25°), the controller290may control the display230to display three guidance messages1510,1520,1530. That is, the controller290may increase the number of guidance messages displayed as a hinge angle of display230becomes greater.

If a hinge angle of the display230is within a fourth angle range (for example, between 35° and 45°), the controller290may control the display230to display five guidance messages (possibly overlapping)1510to1550, as illustrated inFIG. 15B. In this case, as illustrated inFIG. 15B, the first guidance message1510which is updated most recently may be disposed on the top.

As illustrated inFIG. 15B, if a folding interaction of folding the display230again is detected when the second guidance message1520is touched while the five guidance messages1510to1550are displayed, the controller290may control the display230to display the second guidance message1520on the exposure area as illustrated inFIG. 15C.

In addition, as illustrated inFIG. 15B, if an unfolding interaction of unfolding the display230completely is detected when the second guidance message1520is touched while the five guidance messages1510to1550are displayed, the controller290may control the display230to display a screen corresponding to the second guidance message1520on full screen as illustrated inFIG. 15D.

Further, the controller290may perform different functions according to the direction of a touch interaction which is detected on the exposure area while the display230is folded.

Specifically, if a message is received from outside while the display230is folded, the controller290may control the display230to display a UI1610informing that the message is received on the exposure area as illustrated inFIG. 16A.

In this case, if a touch interaction in the left-and-right direction is detected on the UI1610informing that a message is received, the controller290may control the display230to display a UI informing the previous message or the next message on the exposure area according to the touch interaction.

If a touch interaction in the down direction is detected on the UI1610informing that a message is received, the controller290may delete a currently-received message.

If a touch interaction in the up direction is detected on the UI1610informing that a message is received, the controller290may store the received messages. Specifically, as illustrated inFIG. 16B, if a touch interaction in the up direction is detected on a UI1620informing that a first message is received, a touch interaction in the up direction is detected on a UI1630informing a second message is received, a touch interaction in the up direction is detected on a UI1640informing that a third message is received and then, an unfolding interaction of unfolding the display230is detected, the controller290may control the display230to display a screen1620′ including the first message, a screen1630′ including the second message, a screen1640′ including the third message and a home screen1650.

Maintain the Current Function Despite the Change in the Shape of the Display230

The controller290may maintain the current function even if the shape of the display230changes according to a folding interaction or an unfolding interaction, and control the display230to display a screen corresponding to the current function.

According to an exemplary embodiment, if a folding interaction of folding the display230is detected while a music application is executed, the controller290may control the display230to display a UI1710corresponding to the music application on the exposure area as illustrated inFIG. 17A. If a call request is received while the UI1710corresponding to the music application is displayed on the exposure area, the controller290may control the display230to display a UI1720informing that a call request is received on the exposure area as illustrated inFIG. 17B. If an unfolding interaction of unfolding the display230is detected while the UI1720informing that a call request is received is displayed on the exposure area, the controller290may control the display230to display a call screen1730on full screen as illustrated inFIG. 17C. Subsequently, when the telephone call is completed, the controller290may control the display230to display an execution screen1740of the music application on full screen as illustrated inFIG. 17D. If a folding interaction of folding the display230is detected again, the controller290may control the display230to display the UI1710corresponding to the music application on the exposure area as illustrated inFIG. 17E.

According to another exemplary embodiment, as illustrated inFIG. 18A, the controller290may control the display230to display an execution screen1810of a music application on full screen while the music application is executed. If a call request is received from outside, the controller290may control the display230to display a screen1820for confirming whether to accept the call request as illustrated inFIG. 18B. If a folding interaction of folding the display230is detected while the screen1820for confirming whether to accept the call request is displayed, the controller290may control the display230to display a UI1830informing that a call request is rejected on the exposure area as illustrated inFIG. 18C. When the telephone call is completed, the controller290may control the display230to display a UI1840corresponding to the music application on the exposure area as illustrated inFIG. 18D. Subsequently, if an unfolding interaction of unfolding the display230is detected again, the controller290may control the display230to display the execution screen1810of the music application on full screen as illustrated inFIG. 18E.

The controller290may determine a display area which can be watched by a user according to a hinge angle of the display230, and control the display230to display a screen including different amount of information on the determined display area. In this case, the hinge angle of the display230may be matched with the watchable display area and then stored. According to an exemplary embodiment, if the display230is unfolded while a telephone call is performed, the controller290may control the display230to display a first telephone call screen1910on full screen as illustrated inFIG. 19A.

If a hinge angle of the display230is folded as much as θ while a telephone call is performed, the controller290may determine a display area corresponding to the hinge angle, and as illustrated inFIG. 19B, may control the display230to display a second telephone call screen1920on the determined display area. In this case, the second telephone call screen1920may include less information and fewer icons than those included in the first telephone call screen1910.

In addition, if the display230is folded while a telephone call is performed, the controller290may control the display230to display a UI1930informing that a telephone call is being performed on the exposure area as illustrated inFIG. 19C.

According to another exemplary embodiment, if the display230is unfolded while a navigation application is executed, the controller290may control the display230to display a first navigation screen2010on full screen as illustrated inFIG. 20A.

If a hinge angle of the display230is folded as much as θ while a navigation application is executed, the controller290may determine a display area corresponding to the hinge angle, and as illustrated inFIG. 20B, may control the display230to display a second navigation screen2020on the determined display area. In this case, the area guided by the second navigation screen2020may be smaller than the area guided by the first navigation screen2010.

If the display230is folded while a navigation application is executed, the controller290may control the display230to display a third navigation screen2030on the exposure area as illustrated inFIG. 20C. In this case, the third navigation screen2030may include only direction information and distance information instead of a map screen included in the first navigation screen2010and the second navigation screen2020. However, a map screen may also be included on the exposure area in third navigation screen2030.

Whenever a folding interaction or an unfolding interaction is detected, the controller290may control the display230to reconfigure and display information such that the information corresponds to the size and direction of a screen.

Specifically, as illustrated inFIG. 21A, if a folding interaction of folding the display230is detected while a first address book list2110is displayed on full screen, the controller290may control the display230to display a second address book list2120on the exposure area as illustrated inFIG. 21B. In this case, the first address book list2110might include user information such as image, name, telephone number, direct call icon, etc., and the second address book list2120might include user information such as image and name only, but the display is not limited thereto.

In addition, as illustrated inFIG. 22A, if an unfolding interaction of unfolding the display230is detected while a news title2210is displayed on the exposure area when the display230is folded, the controller290may control the display230to display a full screen2220including not only the news title but also the news image and the news text as illustrated inFIG. 22B.

In addition, the controller290may control the display230to display different information on the exposure area and the hidden area when the display230is folded. In this case, as illustrated inFIG. 23A, the controller290may control the display230to display common information on an exposure area2310and private information on a hidden area2320. For example, as illustrated inFIG. 23B, the controller290may control the display230to display barcode information which is common information on the exposure area2330, and credit card list and transaction information which is private information on the hidden area2340.

An Interaction on an Exposure Area

According to an exemplary embodiment, while the display230is folded forward such that the first area faces the second area with reference to the folding line and a part of the second area is exposed to outside, the detector280may detect a first user interaction of moving along a long side of the exposed area or a second user interaction of moving along a short side of the exposed area. If the first user interaction is detected through the detector280, the controller290may control the display230to display an execution screen of an application which provides a first function on the exposure area. On the other hand, if the second user interaction is detected through the detector280, the controller290may control the display230to display an execution screen of an application which provides a second function on the exposure area.

The first user interaction of moving along a long side of the exposed area may include, for example, the first user interaction of moving in a direction in parallel with a long side of the exposed area. On the other hand, the second user interaction of moving along a short side of the exposed area may include, for example, the second user interaction of moving at right angles to the direction in parallel with a short side of the exposed area.

In this case, being in parallel may include, for example, a state where a prolonged line of the long side of the exposed area and a prolonged line of a trace of the first user interaction which moves in a horizontal direction do not meet with each other or meet in an area outside the exposed area. Alternatively, being in parallel may include, for example, a state where a prolonged line of the short side of the exposed area and a prolonged line of a trace of the second user interaction which moves in a vertical direction do not meet with each other or meet in an area outside the exposed area.

In addition, the first user interaction moving in one direction and the second user interaction moving at right angles to the one direction may include a case where a cross angle between a prolonged line of a trace of the first user interaction and a prolonged line of a trace of the second user interaction is either 90° or almost 90°. For example, if a cross angle between the prolonged lines is a value between 80° and 100°, it can be seen that the motion direction of the first user interaction is at right angles to the motion direction of the second user interaction.

Hereinafter, one or more exemplary embodiments will be described in greater detail with reference toFIGS. 24-31.

FIGS. 24A to 24Dare views illustrating an exemplary embodiment of performing various functions of the user terminal device200illustrated inFIG. 2according to a user interaction on an exposure area.

As illustrated in2410ofFIG. 24A, while an image is not displayed on an exposure area, the detector280may detect a user interaction of moving in one direction (for example, in a right direction) along a long side2411of the exposure area. The state where an image is not displayed on the exposure area may include, for example, a state where the display230is inactive. If the detector280detects the user interaction, as illustrated in2420ofFIG. 24A, the controller290may control the display230to display an execution screen2421of an application for displaying a home screen on the exposure area. The home screen2421may include, for example, the current time information or a timeline.

As illustrated in2430ofFIG. 24B, while an image is not displayed on the exposure area, the detector280may detect a user interaction of moving in an opposite direction to the one direction (for example, in a left direction) along the long side2411of the exposure area. If the detector280detects the user interaction, as illustrated in2440ofFIG. 24B, the controller290may control the display230to display an execution screen2441of an application for displaying public information (for example, the number of unread messages, message sender information, etc.) on the exposure area.

As illustrated in2450ofFIG. 24C, while an image is not displayed on the exposure area, the detector280may detect a user interaction of moving in one direction (for example, in an upward direction, a folding line direction, or a direction of a covered area) along a short side of the exposure area. If the detector280detects the user interaction, as illustrated in2460ofFIG. 24C, the controller290may control the display230to display an execution screen2461of an application for displaying glanceable information on the exposure area. The glanceable information may be information that a user may check quickly (for example, within 1-2 seconds), and may include information such as the current time, the current weather, etc. When a predetermined time elapses after the glanceable information is displayed, the controller290may control the display230to not display an image.

As illustrated in2470ofFIG. 24D, while an image is not displayed on the exposure area, the detector280may detect a user interaction of moving in one direction (for example, in a downward direction, and a direction outside the display230) along a short side2412of the exposure area. If the detector280detects the user interaction, as illustrated in2480of24D, the controller290may control the display230to display an execution screen2481of an application for displaying state information of the user terminal device200(for example, volume information, networking information, battery information) on the exposure area. Alternatively, the controller290may control the display230to display a screen providing a UI for environment setting of the user terminal device200on the exposure area.

FIGS. 25A to 25Dare views provided to explain an exemplary embodiment of performing various functions of the user terminal device200illustrated inFIG. 2according to a user interaction on the exposure area.

As illustrated in2510of25A, while an execution screen2511of a telephone application for requesting a telephone call is displayed on the exposure area, the detector280may detect a user interaction of moving in one direction (for example, in a right direction) along a long side of the exposure area. If the detector280detects the user interaction, as illustrated in2520ofFIG. 25A, the controller290may accept the telephone call request, and control the display230to display an execution screen2521of the telephone application indicating that the telephone call request has been accepted on the exposure area. The execution screen2521of the telephone application for accepting a telephone call request may include, for example, at least one of a telephone call acceptance icon and a telephone call time.

As illustrated in2530ofFIG. 25B, while the execution screen2511of the telephone application for requesting a telephone call is displayed on the exposure area, the detector280may detect a user interaction of moving in one direction (for example, in a left direction) along a long side of the exposure area. If the detector280detects the user interaction, as illustrated in2540ofFIG. 25B, the controller290may refuse the telephone call request, and may control the display230to display an execution screen2541of a telephone application indicating that the telephone call request has been refused on the exposure area. The execution screen2541of the telephone application for refusing a telephone call request may include, for example, at least one of a telephone call refusal phrase and a telephone call refusal icon.

As illustrated in2550ofFIG. 25C, while the execution screen2511of the telephone application for requesting a telephone call is displayed on the exposure area, the detector280may detect a user interaction of moving in one direction (for example, in an upward direction) along a short side of the exposure area. If the detector280detects the user interaction, as illustrated in2560ofFIG. 25C, the controller290may control the display230to display an execution screen2561of a telephone application indicating that a counterpart telephone number is stored in a contact list on the exposure area. Subsequently, if the detector280detects an unfolding interaction of unfolding the display230up to a predetermined angle, the controller290may control the display230to display an execution screen of a telephone application including various functions such as the function of managing counterpart telephone numbers using a contact list.

According to another exemplary embodiment, as described above with reference to2520ofFIG. 25A, while the execution screen2521of the telephone application indicating a telephone call request has been accepted is displayed on the exposure area, the detector280may detect a user interaction of moving in one direction (for example, in an upward direction) along a short side of the exposure area. In this case, as illustrated in2560of25C, the controller290may control the display230to display the execution screen2561of the telephone application indicating that a counterpart telephone number is stored in a contact list on the exposure area.

As illustrated in2570ofFIG. 25D, while the execution screen2511of the telephone application for requesting a telephone call is displayed on the exposure area, the detector280may detect a user interaction of moving in one direction (for example, in a downward direction) along a short side of the exposure area. If the detector280detects the user interaction, as illustrated in2580ofFIG. 25D, the controller290may control the display230to display an execution screen2581of a telephone application indicating that a telephone number of the counterpart who requests a telephone call is stored in a spam list on the exposure area. In addition, the controller290may control the display230to display an execution screen of a telephone application indicating that a counterpart telephone number is deleted from a telephone history list on the exposure area.

According to another exemplary embodiment, as illustrated in2540ofFIG. 25B, while the execution screen2541of the telephone application indicating that a telephone call request is refused is displayed on the exposure area, the detector280may detect a user interaction of moving in one direction (for example, in a downward direction) along a short side of the exposure area. In this case, as illustrated in2580ofFIG. 25D, the controller290may control the display230to display the execution screen2581of the telephone application indicating that a counterpart telephone number is stored in a spam list on the exposure area.

FIGS. 26A to 26Dillustrate an exemplary embodiment of performing various functions of the user terminal device200illustrated inFIG. 2according to a user interaction on the exposure area.

As illustrated in2610ofFIG. 26A, while an execution screen2611of a message application for displaying a received message is displayed on the exposure area, the detector280may detect a user interaction of moving in one direction (for example, in a right direction) along a long side of the exposure area. If the detector280detects the user interaction, as illustrated in2620ofFIG. 26A, the controller290may control the display230to display an execution screen2621of the message application for displaying a previously received message.

As illustrated in2630ofFIG. 26B, while the execution screen2611of the message application for displaying a received message is displayed on the exposure area, the detector280may detect a user interaction of moving in one direction (for example, in a left direction) along a long side of the exposure area. If the detector280detects the user interaction, as illustrated in2640ofFIG. 26B, the controller290may control the display230to display an execution screen2641of a message application for displaying a message after the message.

As illustrated in2650ofFIG. 26C, while the execution screen2611of the message application for displaying a received message is displayed on the exposure area, the detector280may detect a user interaction of moving in one direction (for example, in a upward direction) along a short side of the exposure area. If the detector280detects the user interaction, as illustrated in2660ofFIG. 26C, the controller290controls the display230to display an execution screen2661of an application indicating that the received message is stored.

As illustrated in2670ofFIG. 26D, while the execution screen2611of the message application for displaying a received message is displayed on the exposure area, the detector280may detect a user interaction of moving in one direction (for example, in a downward direction) along a short side of the exposure area. If the detector280detects the user interaction, as illustrated in2680ofFIG. 26D, the controller290may control the display230to display an execution screen2681of an application indicating that the received message is deleted.

As described above, the controller290may provide different functions of an application according to the type of a detected user interaction.

According to an exemplary embodiment, if the detector290detects a user interaction of moving in one direction (for example, in an upward direction) while image information is displayed on the exposure area, the controller290may perform functions related to storage, such as keeping, scrapping, and reminding of the displayed image information. Alternatively, if the detector280detects a user interaction of moving in one direction (for example, in a downward direction) along a short side of the exposure area, the controller290may perform the function of deleting the displayed image information. If the detector280detects a user interaction of moving in one direction (for example, in a left or right direction) along a long side of the exposure area, the controller290may perform the feature of displaying other information related to the displayed image information.

According to another exemplary embodiment, if the detector280detects a user interaction of moving in one direction (for example, in an upward or downward direction) along a short side of the exposure area while an execution screen of an application is displayed on the exposure area, the controller290may control the display230to display an upper menu or a lower menu of the execution screen of the displayed application on the exposure area. Alternatively, the controller290may control the display230to display an execution screen of an application providing a specialized function (for example, storing or deleting a telephone number) on the execution screen of the application. If the detector290detects a user interaction of moving in one direction (for example, in a left or right direction) along a long side of the exposure area, the controller290may control the display230to immediately display an execution screen of an application providing the function of controlling information in the execution screen.

According to another exemplary embodiment, if the detector280detects a user interaction of moving in one direction (for example, in an upward or downward direction) along a short side of the exposure area while an image is not displayed on the exposure area, the controller290may control the display230to display a home screen the size of the exposure area, a notice, and an execution screen of an application provided by a third party. Alternatively, if the detector280detects a user interaction of moving in one direction (for example, in a left or right direction) along a long side of the exposure area, the controller290may provide a function that replaces a hard key, or may control the display230to display an execution screen of an application providing a quick setting menu.

FIGS. 27A to 27Care views illustrating an exemplary embodiment of performing various functions of the user terminal device200illustrated inFIG. 2according to a user interaction on the exposure area.

As illustrated in2710ofFIG. 27A, the controller290may control the display230to display an execution screen2711of a music player application for displaying information on music which is currently reproduced (for example, the name of the music or singer information) on the exposure area. In this case, the controller290may control the display230to display a graphic which shows that a Long Playing Record (LPR) is inserted between the first display area and the second display area and part of the LPR is exposed on the exposure area. In this case, the detector280may detect a user interaction of touching the exposed area.

If the detector280detects the user interaction, as illustrated in2720ofFIG. 27A, the controller290may control the display230to display an execution screen2721of a music player application for displaying a menu to control music which is currently reproduced on the exposure area. The menu to control music may include, for example, a UI for pausing currently-reproduced music, a UI for searching a playlist where the currently-reproduced music is included or searching music which comes next to the currently-reproduced music from a music album, and a UI for searching music before the currently-reproduced music from a playlist where the currently-reproduced music is included. While the menu to control the currently-reproduced music is displayed, the detector280may detect a user interaction of touching the UI for pausing the currently-reproduced music.

If the detector280detects the user interaction, as illustrated in2730ofFIG. 27A, the controller290may pause the currently-reproduced music, and control the display230to display an execution screen2731of a music player application for displaying a menu to control the paused music. While the menu to control the paused music is displayed, the detector280may detect a user interaction of touching the UI for searching music which comes next to the currently-paused music from a playlist or a music album where the currently-paused music is included.

If the detector280detects the user interaction, as illustrated in2740ofFIG. 27A, the controller290may search music which comes next to the currently-paused music from a playlist or a music album, and control the display230to display an execution screen2741of a music player application for displaying information regarding the music which comes next to the currently-paused music. In this case, the execution screen2741of the music player application may also display a menu to control the music which comes next. While the menu to control the music which comes next is displayed, the detector280may detect a user interaction of touching a UI for reproducing the next music.

If the detector290detects the user interaction, as illustrated in2750ofFIG. 27A, the controller290may reproduce the next music. Subsequently, after a predetermined time elapses, the controller290may control the display230to not display the menu to control the next music.

As illustrated in2760ofFIG. 27B, while the execution screen2711of the music player application for displaying information related to the music which is currently reproduced is displayed on the exposure area, the detector280may detect a user interaction of moving in one direction (for example, in a left direction) along a long side of the exposure area. If the detector280detects the user interaction, as illustrated in2770ofFIG. 27B, the controller290may reproduce music which comes after the currently-reproduced music in a playlist or a music album where the currently-reproduced music is included, and control the display230to display an execution screen2771of a music player application for displaying information regarding the currently-reproduced music (that is, the next music).

According to another exemplary embodiment, the detector280may detect a user interaction of moving in one direction (for example, in a right direction) along a long side of the exposure area. In this case, the controller290may reproduce music before the currently-reproduced music in a playlist or a music album where the currently-reproduced music is included, and control the display230to display an execution screen of a music player application for displaying information regarding the currently-reproduced music (that is, the previous music).

As illustrated in2780ofFIG. 27C, while the execution screen2711of the music player application for displaying information regarding the currently-reproduced music is displayed on the exposure area, the detector280may detect a user interaction of moving in one direction (for example, in a downward direction) along a short side of the exposure area. If the detector280detects the user interaction, as illustrated in2790ofFIG. 27C, the controller290may control the display230to display an execution screen2791of a music player application for displaying information regarding a playlist or a music album including the currently-reproduced music (for example, the name of the playlist or the music album). In this case, the controller290may control the display230to display a graphic which shows part of the LPR inserted between the first display area and the second display area is extracted on the exposure area. Here, the detector280may detect a user interaction of moving in one direction (for example, in a left direction) along a long side of the exposure area. If the detector280detects the user interaction, as illustrated in2795ofFIG. 27C, the controller290may control the display230to display an execution screen2796of a music player application for displaying information related to the playlist or music album which comes next in the folder including the currently-reproduced playlist or music album on the exposure area. While the information regarding the next playlist or music album is displayed, the detector280may detect a user interaction of moving in one direction (for example, in an upward direction) along a short side of the exposure area. If the detector280detects the user interaction, as illustrated in2798ofFIG. 27C, the controller290may control the display230to display a graphic which shows that part of the extracted LPR is inserted between the first display area and the second display area on the exposure area. Subsequently, the controller290may reproduce music included in the next playlist or music album, and control the display230to display an execution screen2799of a music player application for displaying information regarding the currently-reproduced music.

FIG. 28is a view illustrating an exemplary embodiment of performing various functions of the user terminal device200illustrated inFIG. 2according to a user interaction on the exposure area.

As illustrated in2810ofFIG. 28, the controller290may control the display230to display an execution screen2811of an application where a graphic showing that a message is popping out of a pocket when the message is received is displayed on the exposure area. In this case, the detector280may detect a user interaction of tilting the user terminal device200towards the direction of the exposure area. If the detector280detects the user interaction, as illustrated in2820ofFIG. 28C, the controller290may control the display230to display an execution screen2821of an application where the content of a message is displayed on the exposure area.

As illustrated in2830ofFIG. 28, while the execution screen2811of an application where a graphic showing that a message is popping out of a pocket is displayed is displayed on the exposure area, the detector280may detect a user interaction of tilting the user terminal device200in an opposite direction to the exposure area. If the detector280detects the user interaction, as illustrated in2840ofFIG. 28, the controller290may store a message in the storage250, and control the display230to display an execution screen2841of an application for displaying a graphic showing that a message is inserted and kept in a pocket on the exposure area.

FIG. 29is a view illustrating an exemplary embodiment of performing various functions of the user terminal device200illustrated inFIG. 2according to a user interaction on the exposure area.

As illustrated in2910ofFIG. 29, the controller290may control the display230to display an execution screen2911of an application for displaying a graphic showing that part of a content (for example, a message) is protruded between the first and the second display areas when the message is received on the exposure area. In this case, the detector280may detect a user interaction of tapping one side of the user terminal device200. For example, the detector280may detect a user interaction of tapping a hinge unit, a folding line or around the folding line of the display230. If the detector280detects the user interaction, as illustrated in2920ofFIG. 29, the controller290may control the display230to display an execution screen2921of an application for displaying a graphic showing that most of the content is protruded between the first and the second display areas on the exposure area so that the content can be identified. While the graphic showing that most of the content is protruded between the first and the second display areas is displayed on the exposure area, the detector280may detect a user interaction of tapping another side of the user terminal device200. For example, the detector280may detect a user interaction of tapping a bezel on the exposure area or a corner of the exposure area. If the detector280detects the user interaction, as illustrated in2930ofFIG. 29, the controller290may control the display230to display an execution screen2931of an application for displaying a graphic showing that part of a content is protruded between the first and the second display areas on the exposure area. Alternatively, the controller290may control the display230to not display the content on the exposure area.

FIG. 30is a view illustrating an exemplary embodiment of performing various functions of the user terminal device200illustrated inFIG. 2according to a user interaction on the exposure area.

As illustrated in3010ofFIG. 30, the controller290may control the display230to display an execution screen3011of an application for displaying a graphic showing that a zipper is locked to indicate that the exposed screen is in a lock state on the exposure area. In this case, the detector280may detect a user interaction of moving in one direction (for example, in a downward direction) along a long side of the exposure area. If the detector280detects the user interaction, as illustrated in3020ofFIG. 30, the controller290may display at least one content (for example, public information) by releasing the lock state of the exposed screen, and control the display230to display an execution screen3021of an application for displaying a graphic showing that the zipper is opened on the exposure area.

FIGS. 31A and 31Bare views illustrating an exemplary embodiment of performing various functions of the user terminal device200illustrated inFIG. 2according to a user interaction on the exposure area.

As illustrated in3110ofFIG. 31A, the detector280may detect a user interaction of pressing a cover of the user terminal device200. In this case, the exposure area may not display any image, or may display an image in a lock state. While the detector290detects the user interaction of pressing the cover, as illustrated in3120ofFIG. 31A, the controller290may control the display230to display part of an application which is currently used. While the part of the application is displayed, the detector280may detect a user interaction of stopping the operation of pressing the cover of the user terminal device200. If the detector280detects the user interaction, the controller290may control the display230to not display the part of the application on the exposed screen.

As illustrated in3130ofFIG. 31B, the detector280may detect a user interaction of pressing the cover of the user terminal device200. In this case, the exposure area may not display any image, or may display an image in a lock state. While the detector280detects the user interaction of pressing the cover, as illustrated in3140ofFIG. 31B, the controller290may control the display230to display a preview screen of an application which is currently used. For example, if the application is a music application, the preview screen of the application may be a menu to control the music which is currently reproduced. While the preview screen of the application is displayed, the detector280may detect a user interaction of stopping the operation of pressing the cover of the user terminal device200. If the detector280detects the user interaction, the controller290may control the display230to not display the preview screen of the application on the exposed screen.

FIG. 32is a flowchart illustrating a displaying method of the user terminal device200according to another exemplary embodiment.

First of all, the display230may be folded forward such that a first area faces a second area with reference to a folding line, and a part of the second area may be exposed to outside (S3210).

In this state, the user terminal device200may receive a user interaction on the exposure area (S3220). The user terminal device200may determine whether the received user interaction is a first user interaction of moving along a long side of the exposure area, a second user interaction of moving along a short side of the exposure area, or a third user interaction of touching the exposure area (S3230).

If it is determined that the received user interaction is the first user interaction of moving along a long side of the exposure area, the user terminal device200may display an execution screen of an application providing a first function on the exposure area (S3240).

If it is determined that the received user interaction is the second user interaction of moving along a short side of the exposure area, the user terminal device200may display an execution screen of an application providing a second function on the exposure area (S3250).

If it is determined that the received user interaction is the third user interaction of touching the exposure area, the user terminal device200may display an execution screen of an application providing a third function on the exposure area (S3260).

As described above, the display230displays a UI on the exposure area which is an exposed area when the display230is folded and thus, a user may perform various functions of the user terminal device through the UI displayed on the exposure area, even when the display is folded, and the displayed UI may provide various information.

The displaying method of a user terminal device according to the above-described various exemplary embodiments may be realized as a program and provided in the user terminal device. Specifically, a non-transitory computer readable medium including a program of a control method of the user terminal device is stored may be provided.

The non-transitory recordable medium refers to a medium which may store data semi-permanently and a memory, and may be readable by an apparatus. Specifically, the non-transitory readable medium may be CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM, etc.