Patent Description:
Display apparatuses are among the most important electronic products. In recent years, the size of electronic devices, including display apparatuses, has been reduced. However, many consumers demand large screens. Therefore, flexible displays that may be rolled into electronic devices or that have foldable screens have been actively researched and developed.

In particular, rollable displays that may be rolled into rolls have been actively researched, and electronic devices including rollable displays are expected to be commercialized soon.

<CIT> discloses a method of controlling a portable device including the steps of: ifthe portable device is a first mode to lock the portable device, detecting an unlocking triggering signal; if the unlocking triggering signal is detected, converting the portable device to a second mode to display an unlocking interface in the expandable display; if a touch input signal for the unlocking interface is detected when the portable device is the second mode, recognizing a touch input pattern from the detected touch input, displaying the unlocking interface by reflecting to the touch input pattern and if the touch input pattern is matched with a pre-set pattern, converting the portable device to a third mode to unlock the portable device; and if the expandable display expands when the portable device is the second mode, displaying the unlocking interface by reflecting to an expansion of the expandable display and if a degree of expansion of the expandable display is greater than a threshold, converting the portable device to the third mode.

<CIT> discloses a rollable display equipped with a rotation sensor for measuring the display size and adapting the displayed content according to the display size.

Exemplary embodiments overcome the above disadvantages and other disadvantages not described above. Also, exemplary embodiments are not required to overcome the disadvantages described above, and an exemplary embodiment may not overcome any of the problems described above.

Exemplary embodiments provide an electronic device that, if a size of a display area of a display is changed by a rolling interaction or an unrolling interaction, changes one of a size and a layout of an element included in a screen according to a changed size of the screen, and a method of controlling the electronic device.

According to an embodiment, an electronic device is provided as defined in the appended claims.

According to another embodiment, a method of controlling an electronic device is provided as defined in the appended claims.

In response to the at least one element including a plurality of contents, the priority order of the at least one element is determined according to types of the plurality of contents.

Additional and/or other aspects and advantages of the exemplary embodiments will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the exemplary embodiments.

The above and/or other aspects of the exemplary embodiments will be more apparent by describing certain exemplary embodiments with reference to the accompanying drawings, in which:.

Certain aspects of exemplary embodiments will now be described in greater detail with reference to the accompanying drawings.

In the following description, same drawing reference numerals are used for the same elements even in different drawings. The matters defined in the description, such as detailed construction and elements, are provided to assist in a comprehensive understanding of the exemplary embodiments. Thus, it is apparent that the exemplary embodiments can be carried out without those specifically defined matters.

Hereinafter, while exemplary embodiments are capable of various modifications and alternative forms, embodiments thereof are shown by way of example in the drawings and will herein be described in detail. It may be understood, however, that there is no intent to limit exemplary embodiments to the particular forms disclosed, but on the contrary, exemplary embodiments are to cover all modifications, equivalents, and alternatives. Like numbers refer to like elements throughout the description of the figures.

The terms "include", "comprise", etc. used herein designate the presence of disclosed corresponding functions, operations, elements, etc. and do not limit additional one or more functions, operations, elements, etc. Also, the terms "include" or "comprise", "have", etc. designate the presence of features, numbers, steps, operations, components, elements, or a combination thereof that are written in the specification, but do not exclude the presence or possibility of addition of one or more other features, numbers, steps, operations, components, elements, or a combination thereof.

For example, the term "and/or" may include "A and/or B", "A", "B", or both of "A" and "B".

Expressions "first", "second", etc. used herein may modify various exemplary embodiments but do not restrict corresponding elements. For example, the expressions do not restrict orders and/or importances, etc. of corresponding elements. The expressions may be used to distinguish one element from another element. For example, a first user device and a second user device are all user devices and indicate different user devices. For example, a first element may be termed a second element, and, similarly, a second element may be termed a first element, without departing from the scope of example embodiments.

It will be understood that when an element is referred to as being coupled with/to or connected to another element, the element may be connected to the another element directly or indirectly through another element. In contrast, when an element is referred to as being "directly coupled with/to" or "directly connected to" another element, there are no intervening elements between the element and the another element. The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the exemplary embodiments. As used herein, the singular forms are intended to include the plural forms as well, unless the context clearly indicates otherwise.

Also, in the present disclosure, a user interaction may include at least one selected from a touch interaction, a rolling interaction, an unrolling interaction, a bending interaction, a voice interaction, a button interaction, a motion interaction, and a multimodal interaction, but is not limited thereto.

In particular, the "rolling interaction" used herein may be an interaction of rolling a flexible display to decrease a display area of the flexible display, i.e., an interaction of inserting the flexible display into a housing of an electronic device by a rotation of a roll. Also, the "unrolling interaction" used herein may be an interaction of unrolling the flexible display to increase the display area of the flexible display, i.e., an interaction of taking the flexible display out of the housing of the electronic device by a rotation of the roll.

Also, the "application" used herein refers to a series of computer program sets designed to perform a particular job. Here, the application may be one or more of various types of applications. For example, the application may be a game application, a moving image play application, a map application, a memo application, a schedule application, a phonebook application, a broadcast application, an exercise support application, a payment application, a photo folder application, a medical device control application, an application providing user interfaces of a plurality of medical devices, or the like but is not limited thereto.

In addition, the "layout" used herein may refer to a method of displaying the number of elements configuring a screen, locations of the elements, and display items of the elements. In other words, a change in the layout of the screen may mean that the number of elements configuring the screen is changed, the locations of the elements are changed, or a display method of the display items of the elements is changed (e. , a moving image content is changed into an icon). Here, the locations of the elements may be relative locations between the elements.

Hereinafter, various aspects of exemplary embodiments will be described with reference to the attached drawings. <FIG> illustrates the providing of an execution screen of an application according to a size of a display area of an electronic device <NUM>, according to an aspect of an unclaimed, exemplary embodiment. The electronic device <NUM> according to the present exemplary embodiment may be a portable terminal such as a smartphone. However, this is merely an exemplary embodiment, and thus the electronic device <NUM> may be realized as various types of electronic devices such as a tablet personal computer (PC), a notebook PC, a desktop PC, a digital TV, etc..

Referring to <FIG>, the electronic device <NUM> may display a screen including at least one element. Here, the screen may be one of various types of screens such as an application execution screen, a menu screen, an unlock screen, etc. Also, the at least one element may include various types of elements such as a content, an icon, a text, a widget, a graphic item (e.g., a progress bar or the like), etc. For example, the electronic device <NUM> may display a menu screen including a plurality of widgets and a plurality of icons, an execution screen of an application including a plurality of image contents, and an unlock screen including current time information and a graphic item for unlocking.

As shown in drawings (a), (b), and (c) of <FIG>, the electronic device <NUM> according to the present exemplary embodiment includes a left housing <NUM>-<NUM>, a right housing <NUM>-<NUM>, and a rollable display <NUM>. In particular, as shown in <FIG>, the left housing <NUM>-<NUM> may include a roll <NUM> on which the rollable display <NUM> may be rolled and an opening <NUM> through which the rollable display <NUM> may be inserted into and/or taken out of the electronic device <NUM>. According to various exemplary embodiments, the roll <NUM> may take the form of a dowel, pin, rod, shaft, spindle, axle, or the like. Also, the right housing <NUM>-<NUM> may be combined with the rollable display <NUM> to form a single body.

Also, the rollable display <NUM> may be inserted into and/or taken out of the electronic device <NUM> through the opening <NUM> according to a rotation of the roll <NUM>. If the rollable display <NUM> is inserted into the electronic device <NUM> through the opening <NUM>, the size of a display area of the rollable display <NUM> may decrease. If the rollable display <NUM> is taken out of the electronic device <NUM> through the opening <NUM>, the size of the display area of the rollable display <NUM> may increase. Here, the rotation of the roll <NUM> may be performed by a user interaction of gripping the right housing <NUM>-<NUM> to pull or push the right housing <NUM>-<NUM>, but this is merely an exemplary embodiment. Therefore, the rotation of the roll <NUM> may be automatically performed by a driver that drives the roll <NUM>.

In the above-described exemplary embodiment, the rotation of the roll <NUM> has been described as being performed through an interaction of gripping the right housing <NUM>-<NUM> only to pull or push the right housing <NUM>-<NUM>. However, this is merely an exemplary embodiment, and thus the rotation of the roll <NUM> may be performed through an interaction of gripping at least one of the left and right housings <NUM>-<NUM> and <NUM>-<NUM> both having rolls to pull or push the at least one of the left and right housings <NUM>-<NUM> and <NUM>-<NUM>.

Also, although not shown in <FIG>, the electronic device <NUM> may include an element that may fix a rolling state and an unrolling state of the rollable display <NUM>.

In particular, if an unrolling interaction is input by a user, the electronic device <NUM> may take the display <NUM> out of the housing of the electronic device <NUM> according to a rotation of the roll <NUM> that is performed by the unrolling interaction. Alternatively, if a rolling interaction is input by the user, the electronic device <NUM> may insert the display <NUM> into the housing of the electronic device <NUM> according to a rotation of the roll <NUM> that is performed by the rolling interaction.

If a size of a display area of the display <NUM> is changed according to a rotation of the roll <NUM> that is performed according to a rolling interaction or an unrolling interaction, the electronic device <NUM> may change one of a size and a layout of an element of a screen according to the size of the display area. In detail, if the size of the display area increases by the rotation of the roll that is performed according to the unrolling interaction, the electronic device <NUM> may increase a size of at least one element included in the screen when the size of the display area is a preset first size. Here, while sizes of elements increase, relative locations between the elements, the number of elements, and display forms of the elements may be kept the same. Also, the increases in the sizes of the elements may mean increases in display areas occupied by the elements and increases in various types of contents (e.g., a text, an image, a moving image, a hyperlink, etc.) included in the display areas occupied by the elements. In particular, if an element is a text, an increase in a size of the element may mean an increase in a size of the text and an increase in an amount of the text. Also, if the element is an image or a moving image, the increase in the size of the element may mean an increase in a size of the image or the moving image. If the element is a hyperlink, the increase in the size of the element may mean an increase in a display amount of the text indicating the hyperlink.

If the size of the display area exceeds the preset first size according to the rotation of the roll that is performed according to the unrolling interaction, the electronic device <NUM> may change a layout of the screen from a first layout into a second layout. Here, the change in the layout may mean a change in relative dispositions of elements, a change in the number of elements, or a change in display areas of the elements on the screen. For example, if first and second elements included in the layout are disposed to the left and right and then disposed up and down, this may mean a change in the layout. Also, if the elements included in the layout are removed or a new element is added, this may mean a change in the layout. If display forms of the elements included in the layout are changed (e.g., if a moving image is changed into an icon), this may mean a change in the layout. If the layout is changed, the electronic device <NUM> may selectively increase or decrease sizes of the elements.

For example, as shown in drawing (a) of <FIG>, a size of a display area of a display <NUM> is a first size (e.g., <NUM>% of a maximum size of the display), the electronic device <NUM> may display a screen on the display <NUM> including a plurality of elements in a first layout.

If an unrolling interaction of pulling a right housing <NUM>-<NUM> of the electronic device <NUM> to the left is input by a user, the electronic device <NUM> may increase a display area of a display according to a rotation of a roll. Here, as shown in drawing (b) of <FIG>, the electronic device <NUM> may maintain the first layout and increase sizes of a plurality of elements included in a screen when the size of the display is a preset first size (e.g., <NUM>% of a whole size). Here, the electronic device <NUM> may increase the sizes of the plurality of elements in proportion to the size of the display area.

Also, if the size of the display area exceeds the preset first size by an unrolling interaction of pulling a right housing of the electronic device <NUM> to the right, the electronic device <NUM> may change a layout of the screen from the first layout to a second layout as shown in drawing (c) of <FIG>. Here, the second layout may be a layout including a new element besides an element included in the first layout.

Also, if the display area decreases by a rotation of the roll that is performed according to a rolling interaction, the electronic device <NUM> may decrease a size of at least one element included in the screen when the size of the display is a preset second size. Here, while the size of the element decreases, relative locations of elements, the number of elements, and display forms of the elements may be kept the same. In addition, the decrease in the size of the element may mean a decrease in a display area occupied by the element and a decrease in various types of contents (e.g., a text, an image, a moving image, a hyperlink, etc.) included in the display area occupied by the element. In particular, if the element is a text, the decrease in the size of the element may mean a decrease in a size of the text and a decrease in an amount of the text. If the element is an image or a moving image, the decrease in the size of the element may mean a decrease in a size of the image or the moving image or may mean that a part of the image or the moving image is cropped. If the element is a hyperlink, the decrease in the size of the element may mean a decrease in a display amount of the text indicating the hyperlink or a change of the hyperlink into a replacement hyperlink.

If the size of the display area decreases to be lower than the preset second size by a rotation of the roll that is performed according to a rolling interaction, the electronic device <NUM> may change the layout of the screen from the second layout into the first layout. Here, the change in the layout may mean a change in a relative disposition of elements included in the screen, a change in the number of elements, or a change in display forms of the elements.

<FIG> is a block diagram of a simple configuration of the electronic device <NUM>, according to an aspect of an exemplary embodiment. As shown in <FIG>, the electronic device <NUM> includes a display <NUM>, a sensor <NUM>, and a processor <NUM>.

The display <NUM> displays image data. In particular, the display <NUM> may be realized as a flexible display. The display <NUM> may also be inserted into or taken out of a housing <NUM> of the electronic device <NUM> according to a rotation of a roll included in the housing <NUM> of the electronic device <NUM>.

If the display <NUM> is inserted into or taken out of the housing <NUM> according to the rotation of the roll, a display area of the display <NUM> may be changed according to the rotation of the roll. In detail, if the display <NUM> is inserted into the housing <NUM> according to a rotation of the roll, the display area of the display <NUM> may decrease. If the display <NUM> is taken out of the housing <NUM> according to a rotation of the roll, the display area of the display <NUM> may increase.

Also, the display <NUM> may display a screen including at least one element under control of the processor <NUM>. For example, the display <NUM> may display an execution screen of an application (e.g., a web application, a camera application, a gallery application, a message application, or the like) including a plurality of contents and an icon. The display <NUM> may also display an idle screen including a plurality of widgets and a plurality of icons. Also, the display <NUM> may display an unlock screen including a plurality of widgets and an unlock icon.

The sensor <NUM> may include various types of sensors and transmit information collected respectively from the sensors to the processor <NUM>. In particular, the sensor <NUM> may include a sensor that senses an amount of the display <NUM> that is acquired according to a rotation of the roll <NUM>. In detail, referring to <FIG>, the left housing <NUM>-<NUM>, the display <NUM>, and the sensor <NUM> are illustrated. The display <NUM> may be rolled into the left housing <NUM>-<NUM> or may be taken out of the left housing <NUM>-<NUM>. A taken direction of the display <NUM> may be a lower direction <NUM>. The sensor <NUM> may be a light sensor and may sense a pattern <NUM> printed on the display <NUM>. The pattern <NUM> may be a Quick Response (QR) code, a bar code, a black and white pattern, or a color pattern corresponding to a pixel line of the display <NUM>. As the display <NUM> is taken out of the left housing <NUM>-<NUM>, a value of the pattern <NUM> printed on the display <NUM> may be changed, and the processor <NUM> may sense a taken amount of the display <NUM> according to the changed value of the pattern <NUM>.

The above-described exemplary embodiment is merely an exemplary embodiment, and thus the taken amount of the display <NUM> may be determined according to various methods. For example, the taken amount of the display <NUM> may be determined through a motion sensor such as a gyro sensor or the like or through a rotation sensor that senses a rotation of the roll.

The processor <NUM> is electrically connected to the display <NUM> and the sensor <NUM> and controls an overall operation of the electronic device <NUM>. In detail, if a size of a display area is changed according to a rotation of the roll sensed through the sensor <NUM>, the processor <NUM> may control the display <NUM> to change one of a size and a layout of an element included in a screen according to a size of a display area.

In particular, the processor <NUM> may control the display <NUM> to maintain a layout to a preset threshold size and change a size of an element if the size of the display area is changed according to a rotation of the roll <NUM> and may change the layout if the size of the display area exceeds the preset threshold size.

In detail, if the display area increases by the rotation of the roll <NUM>, the processor <NUM> may control the display <NUM> to increase a size of at least one element included in the screen when the size of the display is smaller than or equal to a preset first size. Also, if the size of the display area exceeds the preset first size by a rotation of the roll <NUM>, the processor <NUM> may control the display <NUM> to change the layout of the screen from a first layout to a second layout. Here, the second layout may be a layout where the first layout further includes additional information, i.e., wherein the first layout is a subcomponent of the second layout.

For example, if the display area increases by a rotation of the roll <NUM> while a web application screen including a text and a photo content is displayed, the processor <NUM> may control the display <NUM> to increase the sizes of the text and the photo content included in the web application screen when the size of the display area is up to a preset first size (e.g., <NUM> % of a maximum size). Also, if the size of the display area exceeds the preset first size by a rotation of the roll <NUM>, the processor <NUM> may control the display <NUM> to change the layout by adding a moving image to the web application screen.

If the display area continuously increases by a rotation of the roll <NUM> after the layout of the screen is changed into the second layout, the processor <NUM> may maintain the layout of the screen in the second layout and increase a size of at least one element included in the screen when the size of the display area is up to a preset second size (e.g., <NUM> % of the maximum size). Also, if the size of the display area exceeds the preset second size by a rotation of the roll <NUM>, the processor <NUM> may control the display <NUM> to change the layout of the screen from the second layout into a third layout. Here, the third layout may further include additional information in comparison with the first layout and the second layout. For instance, the second layout may be a subcomponent of the third layout.

If the display area decreases by a rotation of the roll <NUM> after the layout of the screen is changed into the second layout, the processor <NUM> may control the display <NUM> to maintain the layout of the screen in the second layout and decrease a size of at least one element included in the screen when the size of the display area is the preset first size. Also, if the size of the display area becomes smaller than the preset first size, the processor <NUM> may control the display <NUM> to change the layout of the screen from the second layout into the first layout.

Also, the processor <NUM> may control the display <NUM> to change the layout or further display an existing element on the screen according to an increase in the display area based on an orientation of the electronic <NUM> sensed by the sensor <NUM>. In detail, if the size of the display area exceeds the preset first size while the location of the electronic device <NUM> is kept in a horizontal direction, the processor <NUM> may control the display <NUM> to change the layout by adding a new element. Also, if the size of the display area exceeds the preset first size while the location of the electronic device <NUM> is kept in a vertical direction, the processor <NUM> may control the display <NUM> to further display an existing element in the increased display area. In other words, a layout displayed when the display area increases in the vertical direction may be different from a layout displayed when the display area increases in the horizontal direction.

Also, the processor <NUM> may control the display <NUM> to change the layout or further display an existing element on the screen according to an increase in the display area based on a type of application that is executed. In detail, if the size of the display area exceeds the preset first size when a first application (e.g., a web application or the like) is executed in the electronic device <NUM>, the processor <NUM> may control the display <NUM> to change the layout. If the size of the display area exceeds the preset first size when a second application (e.g., an e-book application or the like) is executed in the electronic device <NUM>, the processor <NUM> may control the display <NUM> to further display an existing element on the screen.

In particular, if the size of the display area exceeds a threshold size, and thus the layout of the screen is changed, the processor <NUM> may control the display <NUM> to change the layout by adding or deleting an element or by changing a location of an element based on a priority order of an element included in the screen. For example, the processor <NUM> may control the display <NUM> not to change a display location of an element having a first priority order among elements included in the screen, to change a display location of an element having a second priority order among the elements included in the screen according to a change in the size of the display area, and to add or delete an element having a third priority order among the elements included in the screen according to a change in the size of the display area. Here, if an element includes a plurality of contents, a priority order of the element may be determined according to types of the plurality of contents. For example, a content having a first priority order may be a text content, a content having a second priority order may be a photo content, and a content having a third priority order may be a moving image content.

<FIG> is a block diagram of a detailed configuration of the electronic device <NUM>, according to an aspect of an exemplary embodiment. As shown in <FIG>, the electronic device <NUM> includes a sensor <NUM>, a processor <NUM>, a memory <NUM>, a driving module <NUM>, a user input module <NUM>, a display <NUM>, a communication module <NUM>, and a bus <NUM>. Elements of <FIG> are merely an exemplary embodiment, and thus a new element may be added, and at least one element may be deleted according to exemplary embodiments.

For example, the processor <NUM> may receive instructions from other elements (e.g., the memory <NUM>, the driving module <NUM>, the user input module <NUM>, the display <NUM>, the communication module <NUM>, etc.) through the bus <NUM>, decipher the received instructions, and perform an operation or data processing according to the deciphered instructions.

The processor <NUM> may also control an overall operation of the electronic device <NUM>. In particular, the processor <NUM> may change one of a size and a layout of an element according to a change in a display area sensed by the sensor <NUM>. The processor <NUM> may be realized as at least one selected from a Graphic Processing Unit (GPU), a Central Processing Unit (CPU), and an application processor (AP) or as one chip.

The memory <NUM> may store instructions or data received from or generated by the processor <NUM> or other elements (e.g., the driving module <NUM>, the user input module <NUM>, the display <NUM>, the communication <NUM>, etc.). For example, the memory <NUM> may include programming modules such as a kernel <NUM>, middleware <NUM>, an application programming interface (API) <NUM>, an application <NUM>, etc. Each of the above-mentioned programming modules may include software, firmware, hardware, or a combination of at least two or more of them.

The memory <NUM> may be realized as various types of memories. For example, the memory <NUM> may be realized as an internal memory or an external memory. The driving module <NUM> is a module capable of driving a rotation of the roll <NUM> for rolling or unrolling a display. Here, the driving module <NUM> may automatically rotate the roll <NUM> according to a user instruction input through the user input module <NUM> or may semi-automatically rotate the roll <NUM> according to an external force (e.g., a pushing and pulling force) of a user input into a housing. The driving module <NUM> may also roll or unroll the display through another driving method not through a rotation of the roll <NUM>.

Here, the driving module <NUM> may be realized as a motor or a circuit for controlling the motor, but this is merely an exemplary embodiment. Therefore, the driving module <NUM> may be realized as another element.

For example, the user input module <NUM> may receive an instruction or data from the user and transmit the instruction or data to the processor <NUM> or the memory <NUM> through the bus <NUM>.

The user input module <NUM> may include various types of user input units such as a touch panel, a (digital) pen sensor, a key, an ultrasonic input unit, etc..

The display <NUM> may display a picture, an image, data, or the like to the user. In particular, the display <NUM> may be realized as a liquid crystal display (LCD), an active-matrix organic light-emitting diode (AM-OLED), or the like or may be realized to be flexible, transparent, or wearable.

The communication module <NUM> may transmit a communication between another electronic device <NUM> and the electronic device <NUM> and perform communications with another electronic device <NUM> and a sever <NUM> through a network <NUM>. The communication module <NUM> may support a preset short-range communication protocol (e.g., wireless fidelity (WiFi), Bluetooth (BT), or near field communication (NFC)), a preset network communication (e.g., Internet, a local area network (LAN), a wire area network (WAN), a telecommunication network, a cellular network, a satellite network, or a plain old telephone service (POTS), or the like). The electronic devices <NUM> and <NUM> may be the same as (e.g., the same type of electronic devices as) or different from (e.g., different types of electronic devices from) the electronic device <NUM>.

In particular, the communication module <NUM> may receive data about a web application by performing a communication connection to the server <NUM> through the network <NUM>.

The sensor <NUM> may include various types of sensors such as a gyro sensor, a gesture sensor, a grip sensor, an acceleration sensor, etc. and provide the processor <NUM> with information collected respectively from the gyro sensor, the gesture sensor, the grip sensor, the acceleration sensor, etc. in preset time units.

In particular, the sensor <NUM> may include at least one selected from a gesture sensor, a gyro sensor, a pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a red, green, blue (RGB) sensor, a biometric sensor, a temperature/humidity sensor, an illumination sensor, and an ultraviolet (UV) sensor. The sensor <NUM> may measure a physical quantity or sense an operation status of the electronic device <NUM> and convert measured or sensed information into an electric signal. The sensor <NUM> may further include a control circuit for controlling at least one or more sensors belonging to the sensor <NUM>. The sensor <NUM> may also include various types of sensors for sensing a rotation of the roll <NUM>.

The bus <NUM> may be a circuit that connects the above-described elements to one another and transmits communication signals (e.g., control messages) between the above-described elements.

The term "part" or "module" used herein may refer to a unit including one of hardware, software, and firmware or a combination of two or more of them. The "part" or "module" may be interchanged with the term such as a logic, a logical block, a component, a circuit, or the like. The "part" or "module" may be a minimum unit of components that are integrated into one body or a part of the minimum unit. The "module" may be a minimum unit that performs one or more functions or a part of the minimum unit. The "module" may be mechanically or electronically realized. For example, the "module" used herein may include at least one selected from an application-specific integrated circuit (ASIC) chip, a field-programmable gate arrays (FPGAs), and a programmable-logic device that are known or will be developed and perform operations.

<FIG> is a block diagram of a configuration of a programming module <NUM> of an electronic device, according to an aspect of an exemplary embodiment.

The programming module <NUM> may be included (e.g., stored) in the electronic device <NUM> (in particular, in the memory <NUM>). At least a part of the programming module <NUM> may include software, firmware, hardware, or a combination of at least two or more of them. The programming module <NUM> may be realized in hardware of the electronic device <NUM> to include various types of applications (e.g., an application <NUM>) that are driven on the electronic device <NUM> (e.g., an operating system (OS) controlling resources associated with the electronic device <NUM>) or on the OS. For example, the OS may be Android, iOS, Windows, Symbian, Tizen, Bada, or the like. Referring to <FIG>, the programming module <NUM> may include a kernel <NUM>, middleware <NUM>, an API <NUM>, and the application <NUM>.

The kernel <NUM> may include a system resource manager <NUM> and a device driver <NUM>. The system resource manager <NUM> may control, allocate, or collect system resources. The device driver <NUM> may, for example, include a display driver, a camera driver, a BT driver, a shared memory driver, a universal serial bus (USB) driver, a keypad driver, a WiFi driver, or an audio driver.

The middleware <NUM> may include a plurality of modules that are realized in advance to provide functions commonly required by the application <NUM>. Also, the middleware <NUM> may provide a function through the API <NUM> so as to enable the application <NUM> to efficiently use limited system resources of the electronic device <NUM>.

A runtime library <NUM> may, for example, include a library module that is used by a compiler to add a new function through a programming language while the application <NUM> is executed.

An application manager <NUM> may, for example, manage a life cycle of at least one application of the application <NUM>. A window manager <NUM> may manage GUI resources used on a screen. A multimedia manager <NUM> may check a format required for playing various types of media files and encode or decode the media files by using a codec appropriate for the corresponding format. A resource manager <NUM> may manage resources of a source code, a memory, a storage space, or the like of at least one application of the application <NUM>. Here, the resource manager <NUM> may manage sizes and layouts of elements configuring the screen. A power manager <NUM> may operate along with a basic input/output system (BIOS) or the like to manage a battery or a power source and provide power information, etc. necessary for an operation. A database (DB) manager <NUM> may manage a DB, which will be used in at least one application of the application <NUM>, so as to generate, search, or change the DB. A package manager <NUM> may manage installing or updating of an application that is distributed in a package file format. A connection manager <NUM> may manage a wireless connection such as WiFi, BT, or the like. A notification manager <NUM> may display or notify an event, such as an arrived message, an appointment, a proximity notification, or the like, to the user in a way of not disturbing the user. A location manager <NUM> may manage location information of the electronic device <NUM>. A graphic manager <NUM> may manage a graphic effect that will be provided to the user or a user interface associated with the graphic effect. A security manager <NUM> may provide all security functions necessary for a system security, a user authentication, or the like. According to an exemplary embodiment, if an electronic device (e.g., the electronic device <NUM>) includes a phone call function, the middleware <NUM> may further include a telephone manager (not shown) that manages a voice or video call function of the electronic device. Also, a user interface (UI) conversion manager <NUM> converts a UI according to a particular event. In particular, the UI conversion manager <NUM> may change a layout of the UI according to a change in a size of a display. Here, the UI conversion manager <NUM> may change the layout in an application that is executed, change the layout by converting the application (e.g., a mobile application), which is executed, into another application (e.g., a tablet application), and change the layout by changing an OS. If the electronic device <NUM> executes a web application through the sever <NUM>, the UI conversion manager <NUM> may operate along with the server <NUM> to change a layout of the web application.

The middleware <NUM> may dynamically delete existing elements or add new elements. Therefore, some of elements described herein may be omitted, other elements may further included, or the elements may be replaced with elements having different names and performing similar functions.

The API <NUM> (e.g., the API <NUM>) may be provided as a set of API programming functions, i.e., as different elements according to OSs. For example, if Android or iOS is used, one API set may be provided according to each platform. If Tizen is used, two or more API sets may be provided.

The application <NUM> may, for example, include a preloaded application or a third party application. The application <NUM> may include one or more application modules including a home module <NUM> for providing a home screen or home function, a dialer module <NUM> for providing voice telephone calls, an SMS/MMS module <NUM> for provided SMS/MMS messaging capability, an IM module <NUM> for providing instant or direct messaging, a browser module <NUM> for providing internet browsing capability, a camera module <NUM> for providing picture photography capabilities, an alarm module <NUM> for providing an alarm clock or other alarm functions, a contact module <NUM> for providing a contact list or database of contacts, a voice dial module <NUM> for providing the ability to utilize the telephone functionality of the dialer module <NUM> using voice commands or the like, an email module <NUM> for providing email functionality, a calendar module <NUM> for providing a user-friendly calendar listing appointments and events corresponding to particular dates, a media player module <NUM> for playback of various file types, an album module <NUM> for storing and organizing photograph pictures and the like, and a clock module <NUM> for keeping track of and displaying the current time.

At least a part of the programming module <NUM> may be realized as an instruction that is stored on a computer-readable storage medium. If the instruction is executed by one or more processors (e.g., the processor <NUM>), the one or more processors may perform a function corresponding to the instruction. The computer-readable storage medium may, for example, be the memory <NUM>. At least a part of the programming module <NUM> may, for example, be implemented (e.g., executed) by the processor <NUM>. At least the part of the programming module <NUM> may include modules, programs, routines, sets of instructions, and/or processes for performing at least one function.

Names of elements of the programming module <NUM> according to the present exemplary embodiment may vary according to types of OSs. The programming module <NUM> according to the present exemplary embodiment may include at least one or more of the above-described elements, omit some of the above-described elements, or further include additional other elements. A programming module according to an aspect of an exemplary embodiment or operations performed by different elements may be processed according to a sequential, parallel, repetitive, and/or heuristic method. Also, some of the operations may be omitted or other operations may be added.

Hereinafter, aspects of an exemplary embodiment will be described in more detail with reference to <FIG>, <FIG>, <FIG>, <FIG>, <FIG>, <FIG>, <FIG>, <FIG>, and <FIG>. <FIG> illustrates a method of providing a screen by using the electronic device <NUM> if a display area increases according to a rotation of the roll <NUM>, according to an aspect of an unclaimed, exemplary embodiment.

Referring to drawing (a) of <FIG>, the processor <NUM> may control the display <NUM> to display a screen including a plurality of elements <NUM>, <NUM>, and <NUM>. For example, the processor <NUM> may control the display <NUM> to display an execution screen of a web application including a photo content <NUM>, a hyperlink list <NUM>, and a text <NUM> as shown in drawing (a) of <FIG>. Here, the execution screen of the web application may be a screen received from the server <NUM> through the network <NUM>.

In particular, the screen shown in drawing (a) of <FIG> may have an area of <NUM> % of a whole screen size. Here, the processor <NUM> may control the display <NUM> to display the photo content <NUM> on an upper left side of the screen, the hyperlink list <NUM> on an upper right side of the screen, and the text <NUM> on a lower part of the screen. In particular, a layout where the photo content <NUM> is displayed on the upper left side of the screen, the hyperlink list <NUM> is displayed on the upper right side of the screen, and the text <NUM> is displayed on the lower part of the screen may be a first layout of the web application.

Also, if a display area increases by a rotation of the roll <NUM> that is performed according to an unrolling interaction of a user, the processor <NUM> may control the display <NUM> to maintain the first layout and increase sizes of the plurality of elements <NUM>, <NUM>, and <NUM> as shown in drawing (b) of <FIG>.

Here, the processor <NUM> may control the display <NUM> to increase the sizes of the plurality of elements <NUM>, <NUM>, and <NUM> in proportion to the display area that increases according to the rotation of the roll <NUM>. For example, if a size of the display area increases from <NUM> % of a maximum size screen to <NUM> % of the maximum size screen, the processor <NUM> may control the display <NUM> to increase the sizes of the elements <NUM>, <NUM>, and <NUM> by a factor of <NUM>.

The processor <NUM> may also control the display <NUM> to display the screen in a whole area of the display area without maintaining a picture ratio. In other words, if a vertical length of the display area is kept, and a horizontal length of the display area increases, the processor <NUM> may change the picture ratio into a ratio of the increased horizontal length and increase the sizes of the elements <NUM>, <NUM>, and <NUM>.

Also, the processor <NUM> may control the display <NUM> to increase the sizes of some elements without increasing the sizes of all of elements displayed in the display area. For example, when the display area increases, the processor <NUM> may control the display <NUM> to maintain the sizes of the menus displayed on a side of the screen and to increase the sizes of the contents displayed in a center of the screen.

If the size of the display area increases and then exceeds a preset first size (e.g., <NUM> % of the maximum screen size) by a rotation of the roll <NUM> that is performed according to an unrolling interaction of the user, the processor <NUM> may control the display <NUM> to change and display the layout of the web application as shown in drawing (c) of <FIG>. In detail, as shown in drawing (c) of <FIG>, the processor <NUM> may control the display <NUM> to display the photo content <NUM> on the upper left side of the screen, display the hyperlink list <NUM> on an upper center of the screen, and move and display the text <NUM> displayed on the lower part of the screen to an upper right side of the screen. The processor <NUM> may also control the display <NUM> to display a content list <NUM> as a new element in a middle part of the screen and to display a system control box <NUM> as a new element on a lower part of the screen.

In other words, the processor <NUM> may change the layout by changing a location of an existing element or by adding a new element. Here, a priority order of the existing element may determine a location of the existing element and whether the existing element is changed. For example, if the existing element has a high priority order, a size and a location of the existing element may not be changed. If the existing element has a lower priority order, at least one of the size and the location of the existing element may be changed.

In the above-described exemplary embodiment, a change in a layout has been described as a change in a location of an existing element or an addition of a new element. However, this is merely an exemplary embodiment, and the existing element may be deleted to change the layout. Here, if the existing element is deleted, a new element including contents of the existing element may be added.

If the display area continuously increases by a rotation of the roll <NUM> after the layout of the screen is changed into a second layout, the processor <NUM> may control the display <NUM> to maintain the layout of the screen in the second layout and to increase the sizes of at least one of elements <NUM>, <NUM>, <NUM>, <NUM>, and <NUM> included in the screen when the size of the display area is a preset second size.

Here, the processor <NUM> may control the display <NUM> to increase the sizes of the plurality of elements <NUM>, <NUM>, <NUM>, <NUM>, and <NUM> in proportion to the display area that increases according to a rotation of the roll <NUM>. For example, if the size of the display area increases from <NUM> % of the maximum size screen to <NUM> % of the maximum size screen, the processor <NUM> may control the display <NUM> to increase the sizes of the elements <NUM>, <NUM>, <NUM>, <NUM>, and <NUM> by a factor of <NUM>. The processor <NUM> may also control the display <NUM> to display the screen in a whole area of the display area without maintaining the picture ratio.

If the size of the display area exceeds a preset size (e.g., <NUM> % of a whole screen size) by a rotation of the roll <NUM>, the processor <NUM> may control the display <NUM> to change the layout of the screen from the second layout into a third layout. Here, the third layout may be a layout to which a new element is added, differently from the second layout.

<FIG> illustrates a method of providing a screen by using the electronic device <NUM> if a display area decreases according to a rotation of the roll <NUM>, according to an aspect of an exemplary embodiment.

Referring to drawing (a) of <FIG>, the processor <NUM> controls the display <NUM> to display a screen including a plurality of elements <NUM>, <NUM>, <NUM>, <NUM>, and <NUM>. For example, as shown in drawing (a) of <FIG>, the processor <NUM> may control the display <NUM> to display an execution screen of a web application including a photo content <NUM>, a hyperlink list <NUM>, a text <NUM>, a content list <NUM>, and a system control box <NUM>. In particular, the screen shown in drawing (a) of <FIG> may have an area of <NUM> % of a whole screen size. Here, the processor <NUM> may control the display <NUM> to display the photo content <NUM> on an upper left side, the hyperlink list <NUM> on an upper center, the text <NUM> on an upper right side, the content list <NUM> in a middle part, and the system control box <NUM> on a lower part. In particular, a layout of the web application shown in drawing (a) of <FIG> may be a second layout of the web application.

Also, if the display area decreases by a rotation of the roll <NUM> that is performed according to a rolling interaction of a user, the processor <NUM> controls the display <NUM> to maintain the second layout and decrease the sizes of the plurality of elements <NUM>, <NUM>, <NUM>, <NUM>, and <NUM> as shown in drawing (b) of <FIG>.

Here, the processor <NUM> may control the display <NUM> to decrease the sizes of the plurality of elements <NUM>, <NUM>, <NUM>, <NUM>, and <NUM> in proportion to the display area that decreases according to the rotation of the roll <NUM>. For example, if the size of the display area decreases from <NUM> % of the maximum size screen to <NUM> % of the maximum size screen, the processor <NUM> may control the display <NUM> to decrease the sizes of the elements <NUM>, <NUM>, <NUM>, <NUM>, and <NUM> by <NUM> %.

The processor <NUM> may also control the display <NUM> to display the screen in a whole area of the display area without maintaining a picture ratio. In other words, a vertical length of the display area is kept, and a horizontal length of the display area decreases, the processor <NUM> may change the picture ratio into a ratio of the decreased horizontal length and decrease the sizes of the elements <NUM>, <NUM>, <NUM>, <NUM>, and <NUM>.

The processor <NUM> may also control the display <NUM> to decrease the sizes of some elements without decreasing all of elements displayed in the display area. For example, when the display area decreases, the processor <NUM> may control the display <NUM> to maintain sizes of contents displayed in a center of the screen and decrease sizes of menus displayed on a side of the screen.

If the size of the display area decreases to be lower than a preset first size (e.g., <NUM> % of the maximum screen size) by a rotation of the roll <NUM> that is performed according to a rolling interaction of the user, the processor <NUM> controls the display <NUM> to change a layout. In detail, as shown in drawing (c) of <FIG>, the processor <NUM> may control the display <NUM> to display the photo content <NUM> on the upper left side of the screen, display the hyperlink list <NUM> on the upper right side of the screen, and move the text <NUM> displayed on the upper right side of the screen to the lower part of the screen. The processor <NUM> may also control the display <NUM> to remove the content list <NUM> and the system control box <NUM> from the screen.

In other words, the processor <NUM> changes the layout by, according to an unclaimed embodiment, changing a location of an existing element or , according to the claimed embodiments, deleting the existing element. Here, a priority order of the existing element determines a location of the existing element and whether the existing element is changed.

In the above-described exemplary embodiment, a change in a layout has been described as a change in a location of an existing element or a deletion of the existing element. However, this is merely an exemplary embodiment, and, according to unclaimed embodiments, the layout may be changed by adding a new element. Here, the added new element may include some of contents of the existing element.

Referring to <FIG> and <FIG> throughout, the electronic device <NUM> may display a screen in a first layout when a size of a display area is a preset first size (e.g., <NUM> % of a maximum screen size), display the screen in a second layout when the size of the display area is between the preset first size and a preset second size (e.g., <NUM> % of the maximum screen size), and display the screen in a third layout if the size of the display area exceeds the preset second size.

Here, if the electronic device <NUM> displays the screen in the first layout, the electronic device <NUM> may operate in a first mode (e.g., a phone mode). Also, if the electronic device <NUM> displays the screen in the second layout, the electronic device <NUM> may operate in a second mode (e.g., a note mode). If the electronic device <NUM> displays the screen in the third layout, the electronic device <NUM> may operate in a third mode (e.g., a tablet mode).

In the first through third modes, although a display area increases or decreases according to a rolling interaction or an unrolling interaction, sizes of elements included in the display area may be changed without changing a layout.

In the above-described exemplary embodiment, an electronic device has been described as operating in three types of modes. However, this is merely an exemplary embodiment, and the electronic device may operate in a plurality of modes besides the three types of modes. For example, the electronic device <NUM> may operate in first through third modes and in a fourth mode (e.g., in a TV mode).

Also, the processor <NUM> may control the driving module <NUM> to fix the size of the display area to one of the preset first size and the preset second size. In detail, if the user releases a right housing while an unrolling interaction of enabling the size of the display area to exceed the preset first size and increase to <NUM> % of a whole screen size is input, the processor <NUM> may control the driving module <NUM> so as to enable the size of the display area to return to the preset first size without fixing the size of the display area to a size of the display area at a moment when the user releases the right housing. In other words, the processor <NUM> may adjust the size of the display area so as to maintain an optimum picture ratio in each mode.

In the above-described exemplary embodiment, if the display area increases to a size that is less than a preset size, the processor <NUM> has been described as increasing a size of an element while maintaining a layout, i.e., without changing layout from a first layout to a second layout. However, this is merely an exemplary embodiment, and the processor <NUM> may control the display <NUM> to further display an existing element while maintaining the layout and a size of an element. For example, if the display area increases while an e-book application is executed, the processor <NUM> may control the display <NUM> to display a text having <NUM> lines on <NUM> lines with maintaining the layout and the size of the element to the size before the preset size.

In the above-described exemplary embodiment, a layout of an application or a size of an element of the application has been described as being changed according to a change in a display area while a web application is executed. However, this is merely an exemplary embodiment, and a layout of another application or a size of an element of the another application may be changed according to a change in the display area.

For example, if a phone call request is received while the electronic device <NUM> operates in a first mode, the processor <NUM> may control the display <NUM> to display information (e.g., a name, a phone number, etc.) about the party requesting the phone call and a phone call acceptance and/or rejection icon in the display area. Also, if a size of an element increases and then a mode of the electronic device <NUM> is changed into a second mode according to an increase in the display area caused by a rotation of the roll <NUM>, the processor <NUM> may control the display <NUM> to further display the information about the party requesting the phone call, the phone call acceptance and/or rejection icon, and a phone call setting icon (e.g., a video call change icon, a record icon, a speaker icon, etc.) in the display area. Also, if the size of the element increases and then the mode of the electronic device <NUM> is changed into a third mode according to the increase in the display area caused by the rotation of the roll <NUM>, the processor <NUM> may control the display <NUM> to further display the information about the party requesting the phone call, the phone call acceptance and/or rejection icon, the phone call setting icon (e.g., the video call change icon, the record icon, the speaker icon, etc.), and an address book list in the display area.

As another example, if a camera application is executed while the electronic device <NUM> operates in the first mode, the processor <NUM> may control the display <NUM> to display a live-view image and a capture icon in the display area. Also, if the size of the element increases and then the mode of the electronic device <NUM> is changed into a second mode according to the increase in the display area caused by the rotation of the roll <NUM>, the processor <NUM> may control the display <NUM> to further display the live-view image, the capture icon, and a capture setting icon (e.g., a brightness control icon, a flash operate icon, a background setting icon, etc.) in the display area. If the size of the element increases and then the mode of the electronic device <NUM> is changed into the third mode according to the increase in the display area caused by the rotation of the roll <NUM>, the processor <NUM> may control the display <NUM> to further display the live-view image, the capture icon, the capture setting icon, and a list including previously captured images in the display area.

In other words, the processor <NUM> may control the display <NUM> to add and display various types of elements as the display area increases while various types of applications are executed.

<FIG> illustrates removing of an element from a screen if a display area decreases, according to another aspect of an exemplary embodiment.

In detail, as shown in drawing (a) of <FIG>, the processor <NUM> controls the display <NUM> to display a screen including a plurality of elements <NUM>, <NUM>, <NUM>, <NUM>, and <NUM>. For example, the processor <NUM> may control the display <NUM> to display an execution screen of a web application including a photo content <NUM>, a hyperlink list <NUM>, a text <NUM>, a content list <NUM>, and a system control box <NUM>. In particular, the screen shown in drawing (a) of <FIG> may have an area of <NUM> % of a whole screen size. Here, the processor <NUM> may control the display <NUM> to display the photo content <NUM> on an upper left side of the screen, the hyperlink list <NUM> on an upper center of the screen, the content list <NUM> on a middle part of the screen, and the system control box <NUM> on a lower part of the screen. In particular, a layout of a web application shown in drawing (a) of <FIG> may be a second layout of the web application.

Also, if the display area decreases by a rotation of the roll <NUM> that is performed according to a rolling interaction of a user, the processor <NUM> controls <NUM> to remove the text <NUM> from a plurality of elements and to display the other elements. Here, a removed element is determined according a priority order or , according to unclaimed embodiments, a location thereof. For example, the removed element may be an element having a low priority order or may be an element located on a side of the screen.

The processor <NUM> may also control the display <NUM> so as to enable the removed element to gradually disappear according to the display area that decreases.

Also, the processor <NUM> may control the display <NUM> to maintain sizes of the elements <NUM>, <NUM>, <NUM>, and <NUM> although the display area decreases. For example, when the size of the display area decreases from <NUM> % of a maximum size screen to <NUM> % of the maximum size screen, the processor <NUM> may control the display <NUM> to maintain the sizes of the other elements <NUM>, <NUM>, <NUM>, and <NUM>.

Also, the processor <NUM> may control the display <NUM> to decrease the sizes of some elements without maintaining the sizes of all of the other elements displayed in the display area. For example, when the display area decreases, the processor <NUM> may control the display <NUM> to maintain the sizes of contents displayed in a center of the screen and to decrease the sizes of menus displayed on a side of the screen.

The processor <NUM> may also control the display <NUM> to maintain locations of other elements displayed in the display area.

If the size of the display area decreases and then decreases to be lower than a preset first size (e.g., <NUM> % of the maximum screen size) by a rotation of the roll <NUM> that is performed according to a rolling interaction of the user, the processor <NUM> may control the display <NUM> to change and display a layout by changing the locations of the other elements. As shown in drawing (b) of <FIG>, the processor <NUM> may control the display <NUM> to display the photo content <NUM> on the upper left side of the screen, display the hyperlink list <NUM> on the upper right side of the screen, and re-display the text <NUM>, which is removed, on the lower part of the screen. Also, the processor <NUM> may control the display <NUM> to remove the content list <NUM> and the system control box <NUM>, which are displayed, from the screen.

In other words, as described above with reference to drawings (a) and (b) of <FIG>, if the display area decreases according to the rotation of the roll <NUM>, the processor <NUM> decreases the sizes of elements included in the screen to the preset first size. However, this is merely an exemplary embodiment, and even if the display area decreases to the preset first size, the processor <NUM> may control the display <NUM> to remove at least one from a plurality of elements included in the screen and display the other elements.

<FIG> illustrates a method of displaying a screen according to a change in a display area when an unrolling interaction is continuously input, according to an aspect of an exemplary embodiment.

In detail, referring to drawing (a) of <FIG>, the processor <NUM> may control the display <NUM> to display a screen including a plurality of elements <NUM> and <NUM>. For example, as shown in drawing (a) of <FIG>, the processor <NUM> may control the display <NUM> to display an execution screen of a web application including a photo content <NUM> and a text <NUM>. In particular, the screen shown in drawing (a) of <FIG> may have an area of <NUM> % of a whole screen size. Here, the processor <NUM> may control the display <NUM> to display the photo content <NUM> on an upper part of the screen and the text <NUM> on a lower part of the screen. In particular, a layout where the photo content <NUM> is displayed on the upper part of the screen, and the text <NUM> is displayed on the lower part of the screen may be a first layout of the web application.

Also, if the display area increases by a rotation of the roll <NUM> that is performed according to an unrolling interaction of a user, the processor <NUM> may control the display <NUM> to maintain the first layout and increase sizes of the plurality of elements <NUM> and <NUM> as shown in drawing (b) of <FIG>.

Here, the processor <NUM> may control the display <NUM> to increase the sizes of the plurality of elements <NUM> and <NUM> in proportion to the display area that increases according to the rotation of the roll <NUM>. For example, if a size of the display area increases from <NUM> % of a maximum size screen to <NUM> % of the maximum size screen, the processor <NUM> may control the display <NUM> to increase the sizes of the elements <NUM> and <NUM> by a factor of <NUM>.

Also, the processor <NUM> may control the display <NUM> to display the screen in a whole area of the display area without maintaining a picture ratio. In other words, if a vertical length of the display area is kept, and only a horizontal length of the display area increases, the processor <NUM> may change the picture ratio into a ratio of the increased horizontal length and increase the sizes of the elements <NUM> and <NUM>.

If the size of the display area increases and then exceeds a predefined size (e.g., <NUM> % of the maximum screen size) by the rotation of the roll <NUM> that is performed according to the unrolling interaction of the user, the processor <NUM> may control the display <NUM> to change and display the layout of the web application as shown in drawing (c) of <FIG>. In detail, as shown in drawing (c) of <FIG>, the processor <NUM> may control the display <NUM> to display the photo content <NUM> on an upper left side of the screen, and move the text <NUM>, which is displayed on the lower part of the screen, to an upper right side of the screen and display the text <NUM> on the upper right side of the screen. Also, the processor <NUM> may control the display <NUM> to display a content list <NUM> as a new element in a middle part of the screen and a system control box <NUM> as a new element on the lower part of the screen.

In other words, the processor <NUM> may change the layout by changing a location of an existing element or adding a new element. Also, if the display area continuously increases by a rotation of the roll <NUM> after the layout of the screen is changed into a second layout, the processor <NUM> may control the display <NUM> to maintain the layout of the screen in the second layout and increase sizes of at least one elements <NUM>, <NUM>, <NUM>, and <NUM> included in the screen.

In other words, as described in the previous exemplary embodiment, when a display increases to a preset size, a layout is changed. However, in the present exemplary embodiment, a size into which an image is changed may be additionally preset between particular sizes, and when the image has a predefined size, a layout of the image may be changed.

<FIG> illustrates determining whether a layout of an execution screen of an application is changed according to an orientation of the electronic device <NUM>, according to an aspect of an exemplary embodiment.

Also, if a rotation of the roll <NUM> that is performed according to an unrolling interaction of a user is sensed, the processor <NUM> may sense an orientation of the electronic device <NUM> through the sensor <NUM>. Here, the processor <NUM> may determine a mode of the electronic device <NUM> as a horizontal mode (e.g., a landscape mode) or a vertical mode (e.g., a portrait mode) according to the orientation of the electronic device <NUM>.

Also, if a size of a display area exceeds a preset first size by the rotation of the roll <NUM> according to the unrolling interaction of the user in the horizontal mode, the processor <NUM> may control the display <NUM> to change the layout into a new layout by adding a content list <NUM> as a new element as shown in drawing (b) of <FIG>. In other words, the processor <NUM> may change the layout of the web application from the first layout into a second layout.

However, if the size of the display area exceeds the preset first size by the rotation of the roll <NUM> that is performed according to the unrolling interaction of the user in the vertical mode, the processor <NUM> may control the display <NUM> to maintain the layout of the screen and display more contents of the text <NUM> that is an existing element. In other words, if the text <NUM> is displayed on <NUM> lines as shown in drawing (a) of <FIG>, the processor <NUM> may control the display <NUM> to display the text <NUM> on <NUM> lines as shown in drawing (c) of <FIG>.

In other words, the processor <NUM> may determine whether the layout is changed according to the orientation of the electronic device <NUM>.

In the above-described exemplary embodiment, the change in the layout is determined according to the orientation of the electronic device <NUM>. However, this is merely an exemplary embodiment, and a method of changing the layout may be changed according to the orientation of the electronic device <NUM>.

In detail, if the size of the display area exceeds the preset first size by the rotation of the roll <NUM> that is performed according to the unrolling interaction of the user while maintaining the horizontal mode, the processor <NUM> may control the display <NUM> to change the layout of the screen from the first layout into the second layout. Also, if the size of the display area exceeds the preset first size by the rotation of the roll <NUM> that is performed according to the unrolling interaction of the user while maintaining the vertical mode, the processor <NUM> may control the display <NUM> to change the layout of the screen from the first layout into a third layout.

<FIG> illustrates determining whether a layout of an execution screen of an application is changed according to a type of executed content, according to an aspect of an exemplary embodiment.

In detail, referring to drawing (a) of <FIG>, the processor <NUM> may control the display <NUM> to display a screen including one element <NUM>. For example, as shown in drawing (a) of <FIG>, the processor <NUM> may control the display <NUM> to display an execution screen of an e-book application including a text <NUM>.

Also, if the size of the display area exceeds the preset first size by the rotation of the roll <NUM> that is performed according to the unrolling interaction of the user while the e-book application is executed, the processor <NUM> may control the display <NUM> to display more contents of the text <NUM>, which is an existing element, than existing contents of the text <NUM> as shown in drawing (b) of <FIG>.

In other words, although the size of the display area exceeds the preset first size while the e-book application is executed, the processor <NUM> may control the display <NUM> to maintain the layout and display more contents of an existing element.

However, referring to drawing (c) of <FIG>, the processor <NUM> may control the display <NUM> to display a screen including a plurality of elements <NUM> and <NUM>. For example, as shown in drawing (c) of <FIG>, the processor <NUM> may control the display <NUM> to display an execution screen of a web application including a photo content <NUM> and a text <NUM>.

Also, if the size of the display area exceeds the preset first size by the rotation of the roll <NUM> that is performed according to the unrolling interaction of the user while the web application is executed, the processor <NUM> may control the display <NUM> to change a location of the text <NUM> as an existing element, and to add and display a content list <NUM> as a new element as shown in drawing (d) of <FIG>.

In other words, if the size of the display area exceeds the preset first size while the web application is executed, the processor <NUM> may control the display <NUM> to change the layout of the screen from a first layout into a second layout.

In other words, the processor <NUM> may determine whether the layout is changed according to a type of an application that is currently being executed.

In the above-described exemplary embodiment, although the size of the display area exceeds the preset first size, an e-book application is described as an application of which layout is not changed. However, this is merely an exemplary embodiment, and although the display area exceeds the preset first size, a layout of another application (e.g., a moving image application, a gallery application, or the like) providing one content may also not be changed.

Also, in the above-described exemplary embodiment, if the size of the display area exceeds the preset first size, a web application is described as an application of which layout is changed. However, this is merely an exemplary embodiment, and although the size of the display area exceeds the preset first size, a layout of another application (e.g., a camera application, a phone application, or the like) may also be changed.

In addition, in the above-described exemplary embodiment, a change in a layout is determined according to a type of an application that is currently being executed. However, this is merely an exemplary embodiment, and a method of changing the layout may be changed according to a type of an executed application.

In detail, if the size of the display area exceeds the preset first size by the rotation of the roll <NUM> that is performed according to the unrolling interaction of the user while a first application is executed, the processor <NUM> may control the display <NUM> to change the layout of the screen from the first layout into the second layout. Also, if the size of the display area exceeds the preset first size by the rotation of the roll <NUM> that is performed according to the unrolling of the user while a second application is executed, the processor <NUM> may control the display <NUM> to change the layout of the screen from the first layout into the third layout.

Also, in the above-described exemplary embodiment, a change in a layout and a method of changing the layout are changed according to a type of an application that is currently executed. However, this is merely an exemplary embodiment, and the change in the layout and the method of changing the layout may be changed according to a currently displayed content type.

<FIG> illustrates a method of changing a layout according to priority orders of elements, according to an aspect of an exemplary embodiment.

Referring to drawing (a) of <FIG>, the processor <NUM> may control the display <NUM> to display a screen including a plurality of elements <NUM>, <NUM>, <NUM>, and <NUM>. For example, as shown in drawing (a) of <FIG>, the processor <NUM> may control the display <NUM> to display an application execution screen including a system bar <NUM>, an application bar <NUM>, a content area <NUM>, and a side navigation area <NUM>.

In particular, the screen shown in drawing (a) of <FIG> may have an area of <NUM> % of a whole screen size. Here, the processor <NUM> may control the display <NUM> to display the system bar <NUM> and the application bar <NUM> on an upper part of the screen, the content area <NUM> on a lower right side of the screen, and the side navigation area <NUM> on a lower left side. In particular, a layout shown in drawing (a) of <FIG> may be referred to as a first layout of a web application.

Also, if a display area decreases by a rotation of the roll <NUM> that is performed according to a rolling interaction of a user, the processor <NUM> may control the display <NUM> to maintain the first layout and decrease sizes of the plurality of elements <NUM>, <NUM>, <NUM>, and <NUM> as shown in drawing (b) of <FIG>.

Here, the processor <NUM> may control the display <NUM> to decrease the sizes of the plurality of elements <NUM>, <NUM>, <NUM>, and <NUM> in proportion to the display area that decreases according to the rotation of the roll <NUM>. For example, if a size of the display area decreases from <NUM> % of a maximum size screen to <NUM> % of the maximum size screen, the processor <NUM> may control the display <NUM> to decrease the sizes of the elements <NUM>, <NUM>, <NUM>, and <NUM> by <NUM> %.

The processor <NUM> may also control the display <NUM> to display the screen in a whole area of the display area without maintaining a picture ratio. In other words, if a vertical length of the display area is kept, and a horizontal length of the display area decreases, the processor <NUM> may change the picture ratio into a ratio of the decreased horizontal length and increase the sizes of the elements <NUM>, <NUM>, <NUM>, and <NUM>.

Also, the processor <NUM> may adjust a method of decreasing the size of an element displayed in the display area according to a priority order thereof. In detail, the system bar <NUM> or the application bar <NUM> having a high priority order may decrease so as to decrease display intervals between icons displayed in the system bar <NUM> or the application bar <NUM>. The side navigation area <NUM> having a low priority order may decrease so as to decrease the number of icons included in the side navigation area <NUM>.

If the size of the display area decreases to be lower than a preset first size (e.g., <NUM> % of a maximum screen size) by a rotation of the roll <NUM> that is performed according to the rolling interaction of the user, the processor <NUM> may control the display <NUM> to change and display the layout. In detail, as shown in drawing (c) of <FIG>, the processor <NUM> may control the display <NUM> to maintain locations of the system bar <NUM>, the application bar <NUM>, and the content area <NUM> or decrease the sizes of the system bar <NUM>, the application bar <NUM>, and the content area <NUM> and to make the side navigation area <NUM> displayed on the lower left side of the screen into an icon and to display the side navigation area <NUM> in the application bar <NUM>.

In particular, when the layout is changed, the processor <NUM> may change the layout according to the priority orders of the elements on the screen.

A display location of the system bar <NUM> having a first priority order may be kept all the time. Also, when a size of the system bar <NUM> decreases, display intervals of icons included in the system bar <NUM> may decrease.

A display location of the application bar <NUM> having a second priority order may be kept all the time, but an amount of contents included in the application bar <NUM> may be changed according to a size of the application bar <NUM>. For example, content title information may be included in the application bar <NUM> in the first layout, but content titles and content detailed information may be included in the application bar <NUM> in the second layout. Also, more icons may be included in the application bar <NUM> having the second layout than the application bar <NUM> having the first layout. In addition, the application bar <NUM> having the first layout may provide one depth menu, where the application bar <NUM> having the second layout may simultaneously provide several depth menus.

The content area <NUM> having a third priority order may be enlarged or reduced contents according to a change in the display area. If a content includes a plurality of pages, several pages may be displayed on one screen with an increase in the size of the screen, where only some of the pages may be displayed on the screen with a decrease in the size of the screen. Also, if the content area <NUM> includes a content list including thumbnails of a plurality of contents, the number of thumbnails included in the content list may be adjusted according to a size of the screen. A location of the content area <NUM> may be changed according to the size of the display area.

The side navigation area <NUM> having a fourth priority order may not be displayed on the screen according to a layout. In detail, if the display area is small, the side navigation area <NUM> may not be displayed on the screen but may be displayed as an additional icon form on the screen. In other words, if an icon is selected, the side navigation area <NUM> may be displayed. If the display area is large, the side navigation area <NUM> may be displayed on a side of the screen.

As described above, the processor <NUM> may change the layout by using different methods according to priority orders of elements when the layout is changed.

According to another exemplary embodiment, if a screen includes a main content, a sub content, and icons, the main content may be an element having a first priority order, the sub content may be an element having a second priority order, and the icons may be elements having a third priority order. Although a layout decreases, a size of the main content that is the element having the first priority order may decrease but a location of the main content may be kept all the time. The sub content that is the element having the second priority order may be displayed in a particular area in a layout including a large display area but may be displayed according to a user selection in a layout including a small display area. The number and locations of icons that are the element having the third priority order may be changed according to the layout.

<FIG> illustrates a method of changing a layout according to priority orders of elements, according to another aspect of an exemplary embodiment. Here, the elements may include a plurality of contents.

Referring to drawing (a) of <FIG>, the processor <NUM> may control the display <NUM> to display a screen including a plurality of elements <NUM>, <NUM>, and <NUM>. For example, as shown in drawing (a) of <FIG>, the processor <NUM> may control the display <NUM> to display an application execution screen including an article content <NUM> having a text form, an image content <NUM>, and a moving image content <NUM>. Here, a layout of drawings (a)-(c) of <FIG> may be referred to as a first layout of an application screen.

Also, if a size of a display area becomes smaller and thus is changed into a second layout while maintaining a first layout, the processor <NUM> may control the display <NUM> to decrease sizes of the article <NUM> and the image content <NUM>, to change the moving image content <NUM> into a moving image icon <NUM>, and to display the moving image icon <NUM> as shown in drawing (b) of <FIG>.

If the size of the display area becomes smaller and thus is changed into a third layout while maintaining the second layout, the processor <NUM> may control the display <NUM> to decrease the size of the article content <NUM>, and to move and display an image icon <NUM> corresponding to the image content <NUM> and the moving image icon <NUM> corresponding to the moving image content <NUM> into the article content <NUM> as shown in drawing (c) of <FIG>.

In other words, the processor <NUM> may not change a display location of the article content <NUM> having a first priority order among elements included in the screen, reduce and provide the image content <NUM> having a second priority order among the elements included in the screen to an icon merely in the third layout, reduce and provide the moving image content <NUM> having a third priority order to an icon from the second layout, and may omit the moving image content <NUM>.

Referring to drawing (a) of <FIG>, the processor <NUM> may control the display <NUM> to display a screen including a plurality of elements <NUM>, <NUM>, <NUM>, <NUM>, and <NUM>. For example, as shown in drawing (a) of <FIG>, the processor <NUM> may control the display <NUM> to display an application execution screen including a system bar <NUM>, an application bar <NUM>, a content area <NUM>, a first side navigation area <NUM>, and a second side navigation area <NUM>.

Here, the system bar <NUM>, the application bar <NUM>, and the content area <NUM> may be elements having first priority orders, the first side navigation area <NUM> may be an element having a second priority order, and the second side navigation area <NUM> may be an element having a third priority order.

Also, if a size of a display area decreases and then decreases to be lower than a preset size (e.g., <NUM> % of a maximum screen size) by a rotation of the roll <NUM> that is performed according to rolling interaction of a user, the processor <NUM> may control the display <NUM> to change and display a layout of an application screen as shown in drawing (b) of <FIG>.

In detail, display locations of the system bar <NUM>, the application bar <NUM>, and the content area <NUM> having the first priority orders among the elements included in the screen may not be changed. Also, a display area of the first side navigation area <NUM> having the second priority order among the elements included in the screen may be changed according to a change in the size of the display area. The second side navigation area <NUM> having the third priority order among the elements included in the screen may be deleted according to the change in the size of the display area.

In other words, as described above, locations, sizes, and existences of elements included in a screen may be determined by using different methods when changing a layout according to priority orders of the elements.

<FIG> is a flowchart of a method of controlling an electronic device, according to an aspect of ar unclaimed, exemplary embodiment. Here, the electronic device <NUM> may include a rollable display as described with reference to <FIG>.

In operation S1410, the electronic device <NUM> senses a change in a size of a display area according to a rotation of the roll <NUM>.

In operation S1420, the electronic device <NUM> may change one of a size and a layout of an element included in a screen according to the changed size.

In detail, if the display area increases by the rotation of the roll <NUM>, the electronic device <NUM> may increase a size of at least one element included in the screen when the size of the display area is a preset first size. If the size of the display area exceeds the preset first size, the electronic device <NUM> may change a layout of the screen from a first layout into a second layout. Also, if the display area decreases by the rotation of the roll <NUM> after the layout of the screen is changed into the second layout, the electronic device <NUM> may maintain the layout of the screen in the second layout and decrease a size of at least one element included in the screen when the size of the display area is the preset first size. If the size of the display area becomes smaller than the preset first size, the electronic device <NUM> may change the layout of the screen from the second layout to a first layout. Here, the second layout may be a layout where an element is added to the first layout, i.e., wherein the first layout is a subcomponent of the second layout.

As described above, an electronic device including a rollable display may adjust or change a size of an element according to a change in a display area so as to enable a user to view an optimum screen according to the changed size of the display area.

<FIG> illustrates providing zoom-in and/or zoom-out functions according to an extension of a display area, according to another aspect of an unclaimed, exemplary embodiment.

The processor <NUM> may provide zoom-in and/or zoom-out functions according to a change in the display area. In detail, if the display area increases according to an unrolling interaction, the processor <NUM> may provide the zoom-in function of zooming in an image displayed in the display area. Also, if the display area decreases according to a rolling interaction, the processor <NUM> may provide the zoom-out function of zooming out the image displayed in the display area.

In detail, as shown in drawing (a) of <FIG>, if a size of the display area is a first size, the processor <NUM> may control the display <NUM> to display a first image <NUM>. As shown in drawing (b) of <FIG>, if the display area increases to a second size according to an unrolling interaction, the processor <NUM> may control the display <NUM> to display a second image <NUM> of which magnification is enlarged more than the first image <NUM>. Also, as shown in drawing (c) of <FIG>, if the display area increases to a third size according to an unrolling interaction, the processor <NUM> may control the display <NUM> to display a third image <NUM> of which magnification is enlarged more than the second image <NUM>.

The second image <NUM> may be an image that is formed by cropping, enlarging, and zooming in an area of the first image <NUM>, and the third image <NUM> may be an image that is formed by cropping, enlarging, and zooming in an area of the second image <NUM>.

In particular, the processor <NUM> may determine a magnification, a picture ratio of an unrolled display, and a cropped location of an image to crop an area from the first image <NUM>. The processor <NUM> may enlarge the image so as to increase the magnification in proportion to an unrolled degree of a display. For example, if the display is unrolled by about <NUM>, the processor <NUM> may enlarge the image by a factor of <NUM>. If the display is unrolled by about <NUM>, the processor <NUM> may enlarge the image by a factor of <NUM>. Also, when the processor <NUM> enlarges the image, the processor <NUM> may crop the image in consideration of the picture ratio of the unrolled display. For example, if the display is unrolled so as to enable the picture ratio to be changed from <NUM>:<NUM> to <NUM>:<NUM>, the processor <NUM> may crop an original image at the picture ratio of <NUM>:<NUM> and provide the cropped image. Also, the processor <NUM> may determine an area, which is to be cropped, based on at least one selected from a center of the image, a location selected by a user, and an important area determined through an image analysis.

Also, if the processor <NUM> enlarges and provides the image, the processor <NUM> may provide a guide user interface (UI) that displays which part of the enlarged image the original image corresponds to. The processor <NUM> may change an area of the original image that is enlarged and provided according to an input user instruction by using the guide UI. In other words, if the processor <NUM> drags and move the guide UI into a new area, the processor <NUM> may perform the zoom-in function of enlarging the new area.

According to an aspect of an exemplary embodiment, if the display area of the display <NUM> is changed according to a rolling and/or unrolling interaction, the processor <NUM> may operate along with a change in the displayed display area to provide an optical zoom function of controlling a barrel of a camera to move.

In other words, if a housing of the electronic device <NUM> slides, and thus a horizontal length of the housing increases when the display <NUM> is unrolled, a length of the barrel connected to the housing may increase according to a sliding motion of the housing. Therefore, the optical zoom function may be provided.

In the above-described exemplary embodiment, a zoom-in function is provided with an increase in a display area. However, this is merely an exemplary embodiment, and a zoom-out function may be provided according to a decrease in the display area.

An apparatus (e.g., modules or the electronic device <NUM>) or a method (e.g., operations) according to various exemplary embodiments may be performed by at least one computer (e. , the processor <NUM>) that executes instructions included in at least one of programs maintained on a computer-readable storage medium.

If the instructions are executed by a computer (e.g., the processor <NUM>), the at least one computer may perform functions corresponding to the instructions. Here, the computer-readable medium may, for example, be the memory <NUM>.

A program may, for example, be included on a computer-readable medium such as a hard disc, a floppy disc, a magnetic medium (e.g., a magnetic tape), an optical medium, (e.g., a compact disc read only memory (CD-ROM), a digital versatile disc (DVD), a magneto-optical medium (e.g., a floptical disc), a hardware device (e.g., a ROM, a random access memory (RAM), a flash memory, or the like), or the like. In this case, a storage medium may be included as a part of components of the electronic device <NUM> but may be installed through a port of the electronic device <NUM>. Alternatively, the storage medium may be included in an external device (e.g., a cloud, a server, or another electronic device) located outside the electronic device <NUM>. Also, the program may be divided and then stored on a plurality of storage media. Here, at least some of the plurality of storage medium may be located outside the electronic device <NUM>.

The instructions may include machine language codes that are made by a compiler and high-level language codes that may be executed by a computer by using an interpreter or the like. The above-described hardware device may be configured to operate as one or more software modules so as to perform operations of various exemplary embodiments, and an opposite case is the same.

Claim 1:
An electronic device (<NUM>) comprising:
a housing (<NUM>);
a roll (<NUM>) at least partially contained in the housing (<NUM>);
a display (<NUM>) configured to be rolled on the roll (<NUM>), the display (<NUM>) comprising a display area having a size that changes according to a rotation of the roll (<NUM>);
a sensor (<NUM>) configured to sense the size of the display area; and
a processor (<NUM>) electrically connected to the display (<NUM>) and the sensor (<NUM>),
wherein the processor (<NUM>) is further configured to,
control the display (<NUM>) to display a plurality of elements (<NUM>, <NUM>) on a screen, each of the plurality of elements (<NUM>, <NUM>) including one or more contents of different types and having a priority order determined based on the types of included one or more contents of different types;
based on the size of the display area decreasing by the rotation of the roll (<NUM>) when the size of the display area is equal to or more than a preset size, control the display (<NUM>) to decrease a size of the plurality of elements (<NUM>, <NUM>) on the screen based on the size of the display area, and,
based on the size of the display area being less than the preset size, control the display (<NUM>) to remove a subset of the plurality of elements (<NUM>, <NUM>) based on the priority order.