Patent Description:
With the development of digital technology, electronic devices are provided in various forms like smartphones, tablet personal computers (PCs), or personal digital assistants (PDAs). Electronic devices are developing in portable or wearable forms so as to enhance portability and accessibility of users.

Recently, portable electronic devices such as smartphones, tablet PCs, or the like are becoming lighter and thinner for the easiness to carry, and are developing for many fields for the sake of user convenience. In particular, an electronic device of a foldable type provided with a flexible display provides a relatively larger screen than an electronic device of a normal bar type, and has its size reduced when the electronic device is folded, and is easy to carry, and accordingly, such electronic devices are being popularized as electronic devices for satisfying consumers' tastes. The <CIT> discloses a user terminal device that can be bent and divided into a plurality of display areas and be operated according to the detected bending state.

A foldable electronic device may include a hinge structure and may go into a folded state or an unfolded state according to a user's operation. The foldable electronic device may have a different resolution of a display according to whether it is in the folded state or the unfolded state. Accordingly, the foldable electronic device may require an image of a different resolution when a state changes between the folded state and the unfolded state. However, time required to draw a new image may be longer than time required to change the state between the folded state and the unfolded state. Therefore, a user may experience a delay in which no image is displayed on a display of the foldable electronic device when the state changes between the folded state and the unfolded state.

Accordingly, an aspect of the disclosure is to provide an electronic device which seamlessly displays images, and an operating method therefor.

In accordance with the present invention, an electronic device is provided according to claim <NUM>.

In accordance with another aspect of the invention, an electronic device is provided according to claim <NUM>.

According to various embodiments, the electronic device and the operating method thereof may take a snapshot of an existing image when a state changes between a folded state and an unfolded state, and may display the snapshot image on a new display area of the display, so that user's experience of a delay is reduced.

According to an embodiment, the connecting terminal <NUM> may include, for example, a HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

According to an embodiment, the antenna module <NUM> may include an antenna including a radiating element composed of a conductive material or a conductive pattern formed in or on a substrate (e.g., printed circuit board (PCB)).

At least some of the above-described components may be coupled mutually and communicate signals (e.g., commands or data) therebetween via an interperipheral communication scheme (e.g., a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)).

<FIG> is a block diagram <NUM> illustrating the program <NUM> according to an embodiment of the disclosure.

Referring to <FIG>, according to an embodiment, the program <NUM> may include an operating system (OS) <NUM> to control one or more resources of the electronic device <NUM>, middleware <NUM>, or an application <NUM> executable in the OS <NUM>. The OS <NUM> may include, for example, Android™, iOS™, Windows™, Symbian™, Tizen™, or Bada™. At least part of the program <NUM>, for example, may be pre-loaded on the electronic device <NUM> during manufacture, or may be downloaded from or updated by an external electronic device (e.g., the electronic device <NUM> or <NUM>, or the server <NUM>) during use by a user.

The OS <NUM> may control management (e.g., allocating or deallocation) of one or more system resources (e.g., process, memory, or power source) of the electronic device <NUM>. The OS <NUM>, additionally or alternatively, may include one or more driver programs to drive other hardware devices of the electronic device <NUM>, for example, the input device <NUM>, the sound output device <NUM>, the display device <NUM>, the audio module <NUM>, the sensor module <NUM>, the interface <NUM>, the haptic module <NUM>, the camera module <NUM>, the power management module <NUM>, the battery <NUM>, the communication module <NUM>, the subscriber identification module <NUM>, or the antenna module <NUM>.

The middleware <NUM> may provide various functions to the application <NUM> such that a function or information provided from one or more resources of the electronic device <NUM> may be used by the application <NUM>. The middleware <NUM> may include, for example, an application manager <NUM>, a window manager <NUM>, a multimedia manager <NUM>, a resource manager <NUM>, a power manager <NUM>, a database manager <NUM>, a package manager <NUM>, a connectivity manager <NUM>, a notification manager <NUM>, a location manager <NUM>, a graphic manager <NUM>, a security manager <NUM>, a telephony manager <NUM>, or a voice recognition manager <NUM>.

The application manager <NUM>, for example, may manage the life cycle of the application <NUM>. The window manager <NUM>, for example, may manage one or more graphical user interface (GUI) resources that are used on a screen. The multimedia manager <NUM>, for example, may identify one or more formats to be used to play media files, and may encode or decode a corresponding one of the media files using a codec appropriate for a corresponding format selected from the one or more formats. The resource manager <NUM>, for example, may manage the source code of the application <NUM> or a memory space of the memory <NUM>. The power manager <NUM>, for example, may manage the capacity, temperature, or power of the battery <NUM>, and determine or provide related information to be used for the operation of the electronic device <NUM> based at least in part on corresponding information of the capacity, temperature, or power of the battery <NUM>. According to an embodiment, the power manager <NUM> may interwork with a basic input/output system (BIOS) (not shown) of the electronic device <NUM>.

The database manager <NUM>, for example, may generate, search, or change a database to be used by the application <NUM>. The package manager <NUM>, for example, may manage installation or update of an application that is distributed in the form of a package file. The connectivity manager <NUM>, for example, may manage a wireless connection or a direct connection between the electronic device <NUM> and the external electronic device. The notification manager <NUM>, for example, may provide a function to notify a user of an occurrence of a specified event (e.g., an incoming call, message, or alert). The location manager <NUM>, for example, may manage locational information on the electronic device <NUM>. The graphic manager <NUM>, for example, may manage one or more graphic effects to be offered to a user or a user interface related to the one or more graphic effects.

The security manager <NUM>, for example, may provide system security or user authentication. The telephony manager <NUM>, for example, may manage a voice call function or a video call function provided by the electronic device <NUM>. The voice recognition manager <NUM>, for example, may transmit a user's voice data to the server <NUM>, and receive, from the server <NUM>, a command corresponding to a function to be executed on the electronic device <NUM> based at least in part on the voice data, or text data converted based at least in part on the voice data. According to an embodiment, the middleware <NUM> may dynamically delete some existing components or add new components. According to an embodiment, at least part of the middleware <NUM> may be included as part of the OS <NUM> or may be implemented as another software separate from the OS <NUM>.

The application <NUM> may include, for example, a home <NUM>, dialer <NUM>, short message service (SMS)/multimedia messaging service (MMS) <NUM>, instant message (IM) <NUM>, browser <NUM>, camera <NUM>, alarm <NUM>, contact <NUM>, voice recognition <NUM>, email <NUM>, calendar <NUM>, media player <NUM>, album <NUM>, watch <NUM>, health <NUM> (e.g., for measuring the degree of workout or biometric information, such as blood sugar), or environmental information <NUM> (e.g., for measuring air pressure, humidity, or temperature information) application. According to an embodiment, the application <NUM> may further include an information exchanging application (not shown) that is capable of supporting information exchange between the electronic device <NUM> and the external electronic device. The information exchange application, for example, may include a notification relay application adapted to transfer designated information (e.g., a call, message, or alert) to the external electronic device or a device management application adapted to manage the external electronic device. The notification relay application may transfer notification information corresponding to an occurrence of a specified event (e.g., receipt of an email) at another application (e.g., the email application <NUM>) of the electronic device <NUM> to the external electronic device. Additionally or alternatively, the notification relay application may receive notification information from the external electronic device and provide the notification information to a user of the electronic device <NUM>.

The device management application may control the power (e.g., turn-on or turn-off) or the function (e.g., adjustment of brightness, resolution, or focus) of the external electronic device or some component thereof (e.g., a display device or a camera module of the external electronic device). The device management application, additionally or alternatively, may support installation, delete, or update of an application running on the external electronic device.

<FIG> illustrates an example of an electronic device <NUM> of an out-folding method according to an embodiment of the disclosure. Part (A) of <FIG> illustrates an unfolded state of the electronic device <NUM>. Parts (B) and (C) of <FIG> illustrate a folded state of the electronic device <NUM>.

Referring to parts (A) to (C) of <FIG>, the electronic device <NUM> may include a foldable housing <NUM> and a flexible display <NUM>. In an embodiment, a front surface of the electronic device <NUM> when the electronic device <NUM> is in the unfolded state may be a surface on which the flexible display <NUM> is disposed. In an embodiment, a rear surface of the electronic device <NUM> when the electronic device <NUM> is in the unfolded state may be the opposite surface of the surface on which the flexible display <NUM> is disposed. In an embodiment, a front surface of the electronic device <NUM> when the electronic device <NUM> is in the folded state may be a surface on which a first area <NUM> of the flexible display <NUM> is disposed. In an embodiment, a rear surface of the electronic device <NUM> when the electronic device <NUM> is in the folded state may be a surface on which a second area <NUM> of the flexible display <NUM> is disposed.

Referring to parts (A) to (C) of <FIG>, the foldable housing <NUM> may include a first housing portion <NUM>, a second housing portion <NUM>, and a folding portion <NUM>. In an embodiment, the first housing portion <NUM> and the second housing portion <NUM> may have a substantially symmetrical shape with reference to a folding axis <NUM> of the folding portion <NUM>. In an embodiment, the folding portion <NUM> may connect the first housing portion <NUM> and the second housing portion <NUM> to be rotatable with respect to each other. In an embodiment, the folding portion <NUM> may provide a pivot movement of the first housing portion <NUM> and the second housing portion <NUM>.

Referring to part (A) of <FIG>, when the folding portion <NUM> is unfolded, the first housing portion <NUM> and the second housing portion <NUM> may be parallel to each other. In an embodiment, when the first housing portion <NUM> and the second housing portion <NUM> are parallel to each other, the electronic device <NUM> may be in the unfolded state.

Referring to part (A) of <FIG>, when the folding portion <NUM> is unfolded, all areas <NUM>, <NUM> of the flexible display <NUM> may face a user.

Referring to parts (B) and (C) of <FIG>, when the folding portion <NUM> is folded, a rear surface of the first housing portion <NUM> and a rear surface of the second housing portion <NUM> may face each other. In an embodiment, when the first housing portion <NUM> and the second housing portion <NUM> face each other, the electronic device <NUM> may be in the folded state.

Referring to part (B) of <FIG>, when the folding portion <NUM> is folded, the first area <NUM> of all areas <NUM>, <NUM> of the flexible display <NUM> may face the user, and the second area <NUM> may not face the user. Referring to part (C) of <FIG>, when the folding portion <NUM> is folded, the second area <NUM> of all areas <NUM>, <NUM> of the flexible display <NUM> may face the user, and the first area <NUM> may not face the user.

In an embodiment, when the folding portion <NUM> is unfolded in part and is folded in part, the first housing portion <NUM> and the second housing portion <NUM> may have a predetermined angle with reference to the folding axis <NUM>. In an embodiment, when the first housing portion <NUM> and the second housing portion <NUM> have a predetermined angle with reference to the folding axis <NUM>, the electronic device <NUM> may be in an intermediate state.

<FIG> illustrates an example of an electronic device <NUM> of an in-folding method according to an embodiment of the disclosure. Part (A) of <FIG> illustrates an unfolded state of the electronic device <NUM>. Parts (B) and (C) of <FIG> illustrate a folded state of the electronic device <NUM>.

Referring to parts (A) to (C) of <FIG>, the electronic device <NUM> may include a foldable housing <NUM>, a first display <NUM>, and a second display <NUM>. In an embodiment, a front surface of the electronic device <NUM> when the electronic device <NUM> is in the unfolded state may be a surface on which the first display <NUM> is disposed. In an embodiment, a rear surface of the electronic device <NUM> when the electronic device <NUM> is in the unfolded state may be the opposite surface of the surface on which the first display <NUM> is disposed. In an embodiment, a front surface of the electronic device <NUM> when the electronic device <NUM> is in the folded state may be a surface on which the second display <NUM> is disposed. In an embodiment, a rear surface of the electronic device <NUM> when the electronic device <NUM> is in the folded state may be the opposite surface of the surface on which the second display <NUM> is disposed. In an embodiment, the front surface and the rear surface of the electronic device <NUM> when the electronic device <NUM> is in the folded state may correspond to the rear surface of the electronic device <NUM> when the electronic device <NUM> is in the unfolded state.

Referring to parts (A) to (C) of <FIG>, the foldable housing <NUM> may include a first housing portion <NUM>, a second housing portion <NUM>, and a folding portion <NUM>. In an embodiment, the first housing portion <NUM> and the second housing portion <NUM> may have a substantially symmetrical shape with reference to a folding axis <NUM> of the folding portion <NUM>. In an embodiment, the second housing portion <NUM> may include a sensor region <NUM>. In an embodiment, the folding portion <NUM> may connect the first housing portion <NUM> and the second housing portion <NUM> to be rotatable with respect to each other. In an embodiment, the folding portion <NUM> may provide a pivot movement of the first housing portion <NUM> and the second housing portion <NUM>.

Referring to part (A) of <FIG>, when the folding portion <NUM> is unfolded, the first display <NUM> or the second display <NUM> may be visible to a user. In an embodiment, when the user views the front surface of the electronic device <NUM> in the unfolded state, the first display <NUM> may be visible to the user. In an embodiment, when the user views the front surface of the electronic device <NUM> in the unfolded state, the sensor region <NUM> may be visible to the user. In an embodiment, when the user views the rear surface of the electronic device <NUM> in the unfolded state, the second display <NUM> may be visible to the user.

Referring to parts (B) and (C) of <FIG>, when the folding portion <NUM> is folded, a front surface of the first housing portion <NUM> and a front surface of the second housing portion <NUM> may face each other. In an embodiment, when the first housing portion <NUM> and the second housing portion <NUM> face each other, the electronic device <NUM> may be in the folded state.

Referring to parts (B) and (C) of <FIG>, when the folding portion <NUM> is folded, the first display <NUM> may be folded.

Referring to parts (B) and (C) of <FIG>, when the folding portion <NUM> is folded, at least part of the first display <NUM> may be unviewable to the user. In an embodiment, referring to parts (B) and (C) of <FIG>, when the folding portion <NUM> is folded, the second display <NUM> may be visible to the user. In an embodiment, when the user views the front surface of the electronic device <NUM> in the folded state, the second display <NUM> may be visible to the user.

<FIG> is a block diagram of an electronic device <NUM> according to an embodiment of the disclosure. In an embodiment, the electronic device <NUM> of <FIG> may correspond to the electronic device <NUM> of <FIG>.

Referring to <FIG>, the electronic device <NUM> may include a processor <NUM>, a display <NUM>, a sensor module <NUM>, a memory <NUM>, or a combination of these. In an embodiment, the processor <NUM>, the display <NUM>, a display driver integrated circuit (DDI) <NUM>, the sensor module <NUM>, or the memory <NUM> of <FIG> may correspond to the processor <NUM>, the display device <NUM>, the sensor module <NUM>, or the memory <NUM> of <FIG>, respectively. In <FIG>, it is illustrated that the electronic device <NUM> includes one display <NUM>, but this is merely an example. In an embodiment, the electronic device <NUM> may include two or more displays.

In an embodiment, the processor <NUM> may generate an image to display on the display <NUM>, by using a program stored in the memory <NUM> (for example, the program <NUM> of <FIG>). In an embodiment, the processor <NUM> may generate the image by using an application installed in the electronic device <NUM>. In an embodiment, the processor <NUM> may generate the image at pre-designated intervals. In an embodiment, the image generated at the pre-designated intervals may be referred to as an image stream.

In an embodiment, the processor <NUM> may draw an image on a layer allocated to the application installed in the electronic device <NUM>. In an embodiment, drawing may be an operation of writing an image (or graphic data) on the memory <NUM> (for example, a buffer) allocated to the layer of the application. In an embodiment, the layer may be information for managing a screen area (for example, a layer area or a surface area) corresponding to the application. In an embodiment, the layer may be an object or an instance corresponding to a specified data structure, and may be generated and deleted according to an application request. In an embodiment, the layer may include an address of a graphic buffer for the application to draw an image (or graphic data), information of a frame area (a position occupied by the layer in the entire area of the frame buffer). In an embodiment, the layer may be referred to as a surface or a window.

In an embodiment, the processor <NUM> may generate an image to display on the display <NUM> by synthesizing a layer on a certain application, a layer on a status bar, a launcher layer, a wallpaper layer, a layer on a notification, or a combination of these.

In an embodiment, the processor <NUM> may transmit the generated image to the DDI <NUM>. In an embodiment, the DDI <NUM> may transmit the image to the display <NUM> through an interface which operatively connects or couples the DDI <NUM> and the display <NUM>. In an embodiment, the DDI <NUM> may package the received image according to a protocol of each interface, and may transmit the packaged image to the display <NUM>. In an embodiment, the interface may include a mobile industry processor interface (MIPI), a high definition multimedia interface (HDMI), a display port (DP), or a combination of these.

In an embodiment, the processor <NUM> may display the image on a display area of the display <NUM> corresponding to a state (for example, a folded state or an unfolded state) of the electronic device <NUM>. In an embodiment, the display area of the display <NUM> may indicate an activated area in the entire area of the display <NUM>. For example, the entire area of the display <NUM> may correspond to the area of the flexible display <NUM> of <FIG>. For example, the entire area of the display <NUM> may correspond to the area of the first display <NUM> of <FIG> and the area of the second display <NUM>.

In an embodiment, when the electronic device <NUM> uses an out-folding method and is in an unfolded state, the display area of the display <NUM> may correspond to the entire area (for example, the area of the flexible display <NUM> of <FIG>) of the display <NUM>. In an embodiment, when the electronic device <NUM> uses the out-folding method and is in a folded state, the display area of the display <NUM> may correspond to a certain area of the display <NUM> (for example, the first area <NUM> or the second area <NUM> of the flexible display <NUM> of <FIG>).

In an embodiment, when the electronic device <NUM> uses an in-folding method and is in an unfolded state, the display area of the display <NUM> may correspond to an area of a first display (for example, the first display <NUM> of <FIG>) of the display <NUM>. In an embodiment, when the electronic device <NUM> uses the in-folding method and is in a folded state, the display area of the display <NUM> may correspond to an area of a second display (for example, the second display <NUM> of <FIG>) of the display <NUM>.

In an embodiment, the processor <NUM> may generate an image indicating a result of executing an ongoing application (for example, the application <NUM> of <FIG>), and may display the generated image on the display <NUM>. In an embodiment, the processor <NUM> may generate an image of a first resolution corresponding to a first display area of the display <NUM> corresponding to a state of the electronic device <NUM>, and may display the image of the first resolution on the first display area of the display <NUM>. In an embodiment, the first display area may be a pre-designated display area when the electronic device is in a first state (for example, a folded state). In an embodiment, the first resolution may correspond to a resolution of the first display area. In an embodiment, displaying the image indicating the result of executing the application on the display <NUM> may indicate displaying the application on the display <NUM>.

In an embodiment, the processor <NUM> may identify a state change of the electronic device <NUM> in the middle of displaying the image of the first resolution on the first display area of the display <NUM>. In an embodiment, the processor <NUM> may identify the state change of the electronic device <NUM>, based on the sensor module <NUM>. In an embodiment, the processor <NUM> may identify a first state change from the folded state of the electronic device <NUM> to the unfolded state, based on the sensor module <NUM>. In an embodiment, the processor <NUM> may determine a state change from the unfolded state of the electronic device <NUM> to the folded state by utilizing two or more sensors, based on the sensor module <NUM>. For example, after a touch operation (a grip for folding or unfolding) occurs through a touch sensor, the processor <NUM> may determine a completely folded or unfolded state by identifying progress toward folding or unfolding through an angular velocity sensor.

In an embodiment, when the state change of the electronic device <NUM> is identified, the processor <NUM> may activate (for example, turn-on) a new display area of the display <NUM> corresponding to the changed state of the electronic device <NUM>. In an embodiment, when the state change of the electronic device <NUM> is identified, the processor <NUM> may inactivate the first display area of the display <NUM>. In an embodiment, the new display area corresponding to the changed state of the electronic device <NUM> may be a second display area.

In an embodiment, when the state change of the electronic device <NUM> is identified, the processor <NUM> may identify continuity information of the application (for example, the application <NUM> of <FIG>) which is being displayed on the first display area of the display <NUM>. In an embodiment, the continuity information may be information indicating whether the application already displayed will be displayed when the state of the electronic device <NUM> is changed. In an embodiment, the continuity information may be information indicating whether the application already displayed will be displayed when the first state change of the electronic device <NUM> occurs, and indicating whether the application already displayed will be displayed when a second state change of the electronic device <NUM> occurs. In an embodiment, for a certain application, continuity at the time of the first state change, and continuity at the time of the second state change may be set to be the same as each other or different from each other. For example, for a certain application, continuity at the time of the first state change, and continuity at the time of the second state change may be set. For example, for a certain application, continuity at the time of the first state change, and continuity at the time of the second state change may be disabled. For example, for a certain application, continuity at the time of the first state change may be set, whereas continuity at the time of the second state change may be disabled.

In an embodiment, when continuity at the time of a certain state change (for example, the first state change) is set for a certain application which is being displayed in the folded state of the electronic device <NUM>, and when the electronic device <NUM> changes from a first state (for example, the folded state) to a second state (for example, the unfolded state), the certain application may be displayed even in the second state (for example, the unfolded state).

In an embodiment, when the continuity at the time of the certain state change (for example, the first state change) is disabled for the certain application which is being displayed in the folded state of the electronic device <NUM>, and when the electronic device <NUM> changes from the first state (for example, the folded state) to the second state (for example, the unfolded state), displaying of the certain application may be stopped. In an embodiment, when the continuity at the time of certain state change (for example, the first state change) is disabled for all applications which are being displayed in the folded state of the electronic device <NUM>, and when the electronic device <NUM> changes from the first state (for example, the folded state) to the second state (for example, the unfolded state), the display <NUM> may be inactivated (for example, turned off). In an embodiment, when the continuity at the time of the certain state change (for example, the first state change) is disabled for all applications which are being displayed in the folded state of the electronic device <NUM>, and when the electronic device <NUM> changes from the first state (for example, the folded state) to the second state (for example, the unfolded state), the display <NUM> may display a pre-designated screen (for example, a home screen, a lock screen).

In an embodiment, when continuity of the application which is being displayed on the first display area of the display <NUM> is set, the processor <NUM> may newly generate an image indicating a result of executing the running application (for example, the application <NUM> of <FIG>). In an embodiment, the new image indicating the result of executing the running application (for example, the application <NUM> of <FIG>) may correspond to a resolution of the second display area of the display <NUM>. In an embodiment, the processor <NUM> may newly generate the image by newly drawing a layer on a certain application, a layer on a status bar, a launcher layer, a wallpaper layer, a layer on a notification, or a combination of these.

In an embodiment, the processor <NUM> may display the new image indicating the result of executing the running application (for example, the application <NUM> of <FIG>) on the second display area of the display <NUM>.

In an embodiment, when the state change of the electronic device <NUM> is identified, the processor <NUM> may take a snapshot of the existing image displayed on the first display area and may store the same in the memory <NUM>. In an embodiment, when the state change of the electronic device <NUM> is identified, the processor <NUM> may display a snapshot image of the existing image displayed on the first display area on the second display area of the display <NUM>. In an embodiment, the processor <NUM> may display the snapshot image on the second display area of the display <NUM> until a new image is generated.

In an embodiment, the processor <NUM> may perform image-processing (for example, scaling, rotation, blurring, or a combination of these) with respect to the snapshot image based on the resolution of the second display area, and then, may display the image-processed snapshot image on the second display area of the display <NUM>.

In an embodiment, when a new image is generated, the processor <NUM> may display the new image on the second display area of the display <NUM> instead of the existing image. In an embodiment, the processor <NUM> may perform image- processing with respect to the new image, and may display the image-processed new image on the second display area of the display <NUM> for a pre-designated time. In an embodiment, the processor <NUM> may display the image-processed new image for the pre-designated time, and then, may display the new image to which image- processing is not applied on the second display area of the display <NUM>.

It is illustrated that, only when the state of the electronic device <NUM> is changed, the snapshot image is displayed until a new image is generated. However, this is merely an example and the disclosure is not limited to the above-described example. In an embodiment, even when a display area of the display <NUM> is changed, the snapshot image regarding the existing image may be displayed until a new image is generated. In an embodiment, the change of the display area of the display <NUM> may include a change of an activated display (for example, a change between the first display <NUM> and the second display <NUM> of <FIG>), a change of an activated area in the entire area of the display, a change of a resolution, or a change based on a combination of these. In an embodiment, the change of the activated area of the display may include a change of a size, a position of the activated area in the entire area of the display, or a combination of these.

<FIG> is a block diagram illustrating a program (for example, the program <NUM> of <FIG>) of an electronic device (for example, the electronic device <NUM> of <FIG>) according to an embodiment of the disclosure.

Referring to <FIG>, the processor <NUM> may include a window manager <NUM>, a state management module <NUM>, a snapshot image processing module <NUM>, an application <NUM>, a window compositor <NUM>, or a combination of these. In an embodiment, a display controller <NUM> may correspond to the DDI <NUM> of <FIG>. In an embodiment, components of the processor <NUM> may be implemented in a hardware level or may be implement in a software level. In an embodiment, the sensor module <NUM>, and the display <NUM> of <FIG> may correspond to the sensor module <NUM>, and the display <NUM> of <FIG>, respectively.

In an embodiment, when a state change of the electronic device <NUM> is identified through the sensor module <NUM>, the window manager <NUM> may transmit information of a display area corresponding to the changed state of the electronic device <NUM> to the application <NUM>. In an embodiment, when the state change of the electronic device <NUM> is identified, the window manager <NUM> may transmit the information of the display area corresponding to the changed state of the electronic device <NUM> to the application <NUM> in which continuity is set among running applications. In an embodiment, a display area of the display <NUM> according to a state before the state of the electronic device <NUM> is changed may be referred to as a first display area, and a display area of the display <NUM> according to a state after the state of the electronic device <NUM> is changed may be referred to as a second display area. In an embodiment, the information of the display area may include information regarding a resolution of the second display area.

In an embodiment, when the state change of the electronic device <NUM> is identified through the sensor module <NUM>, the state management module <NUM> may activate the second display area of the display <NUM>. In an embodiment, the state management module <NUM> may activate the second display area of the display <NUM> through the display controller <NUM>. In an embodiment, when the state of the electronic device <NUM> changes from a folded state to an unfolded state, the state management module <NUM> may activate a display area of the display <NUM> corresponding to the unfolded state. In an embodiment, when the state of the electronic device <NUM> changes from the unfolded state to the folded state, the state management module <NUM> may activate a display area of the display <NUM> corresponding to the folded state. In an embodiment, in the case of an out-folding method, the display area of the display <NUM> corresponding to the folded state may be the first area <NUM> of the flexible display <NUM> of <FIG>. In an embodiment, in the case of an in-folding method, the display area of the display <NUM> corresponding to the folded state may be the area of the second display <NUM> of <FIG>. In an embodiment, in the case of the out-folding method, the display area of the display <NUM> corresponding to the unfolded state may be the entire area of the flexible display <NUM> of <FIG>. In an embodiment, in the case of the in-folding method, the display area of the display <NUM> corresponding to the unfolded state may be the area of the first display <NUM> of <FIG>.

In an embodiment, when the state change of the electronic device <NUM> is identified through the sensor module <NUM>, the snapshot image processing module <NUM> may take a snapshot of the image displayed on the first display area of the display <NUM> and may store the snapshot image in a memory (for example, the memory <NUM> of <FIG>). In an embodiment, the snapshot image processing module <NUM> may hook an image stored in the display controller <NUM> and may store the image in the memory (for example, the memory <NUM> of <FIG>).

In an embodiment, the snapshot image processing module <NUM> may process (for example, scaling, rotation, blurring, or a combination thereof) the snapshot image based on the second display area of the display <NUM>.

In an embodiment, the snapshot image processing module <NUM> may scale the snapshot image to correspond to a resolution of the second display area of the display <NUM>. In an embodiment, when a resolution of the snapshot image is lower than the resolution of the second display area of the display <NUM>, the snapshot image processing module <NUM> may up-scale the resolution of the snapshot image. In an embodiment, when the resolution of the snapshot image is higher than the resolution of the second display area of the display <NUM>, the snapshot image processing module <NUM> may down-scale the resolution of the snapshot image.

In an embodiment, the snapshot image processing module <NUM> may rotate the snapshot image to correspond to an aspect ratio of the second display area of the display <NUM>. In an embodiment, the snapshot image processing module <NUM> may rotate the snapshot image to make a major axis and a minor axis of the snapshot image correspond to a major axis and a minor axis of the second display area of the display <NUM>. In an embodiment, the snapshot image processing module <NUM> may rotate the snapshot image to correspond to a rotation direction and/or a degree of rotation of the display <NUM> according to the state change of the electronic device <NUM>.

In an embodiment, the snapshot image processing module <NUM> may blur (or smoothing) the scaled and/or rotated snapshot image.

In an embodiment, the display controller <NUM> may display the snapshot image processed based on the second display area of the display <NUM> on the second display area of the display <NUM>. In an embodiment, the display controller <NUM> may display the snapshot image on the second display area of the display <NUM> until a new image is generated.

In an embodiment, the application <NUM> may draw at least one layer based on the resolution of the second display area of the display <NUM>. In an embodiment, the application <NUM> may draw at least one layer based on the resolution of the second display area of the display <NUM> by using a drawing library (for example, a view).

In an embodiment, the window compositor <NUM> may generate a new image by combining layers of the application <NUM>.

In an embodiment, the display controller <NUM> may display the new image from the window compositor <NUM> on the second display area of the display <NUM>. In an embodiment, the display controller <NUM> may display an image where a pre-designated image effect (for example, blurring) is applied to the new image on the second display area of the display <NUM>, and then, may display the new image to which the pre-designated image effect is not applied on the second display area of the display <NUM>.

<FIG> is a block diagram illustrating a structure of an electronic device (for example, the electronic device <NUM> of <FIG>) according to an embodiment of the disclosure.

Referring to <FIG>, a structure of the electronic device (for example, the electronic device <NUM> of <FIG>) may include a kernel, a library, a framework, and an application layer. Referring to <FIG>, a hardware layer may include a sensor module <NUM>, a display <NUM>, or a combination of these. Referring to <FIG>, the kernel layer may include a state management module <NUM>, a snapshot image processing module <NUM>, a display controller <NUM>, or a combination of these. Referring to <FIG>, the library layer may include a surface flinger <NUM>. Referring to <FIG>, the framework layer may include a window manager <NUM>, a view <NUM>, or a combination of these. Referring to <FIG>, the application layer may include an application <NUM>. In an embodiment, some functions of a window compositor <NUM> may be implemented by the display controller <NUM>. In an embodiment, some functions of the window compositor <NUM> may be implemented by the surface flinger <NUM>.

In an embodiment, the display <NUM>, the sensor module <NUM>, the window manager <NUM>, the state management module <NUM>, the snapshot image processing module <NUM>, the application <NUM>, and the display controller <NUM> of <FIG> may correspond to the display <NUM>, the sensor module <NUM>, the window manager <NUM>, the state management module <NUM>, the snapshot image processing module <NUM>, the application <NUM>, and the display controller <NUM> of <FIG>, respectively.

In an embodiment, the view <NUM> may be a program for drawing at least one layer based on a resolution of a second display area of the display <NUM>. In an embodiment, the application <NUM> may draw at least one layer based on the resolution of the second display area of the display <NUM> by using the view <NUM>.

In an embodiment, the surface flinger <NUM> may synthesize a plurality of layers. In an embodiment, the surface flinger <NUM> may provide data indicating the synthesized plurality of layers to the display controller <NUM>.

<FIG> is a block diagram illustrating a display controller <NUM> of an electronic device (for example, the electronic device <NUM> of <FIG>) according to an embodiment of the disclosure.

Referring to <FIG>, the display controller <NUM> of the electronic device (for example, the electronic device <NUM> of <FIG>) may include at least one planes <NUM>, <NUM>, at least one scaler <NUM>, <NUM>, a blender <NUM>, an interface <NUM>, a write back plane <NUM>, or a combination of these.

In an embodiment, the at least one plane <NUM>, <NUM> may read images recorded on graphic buffers <NUM>, <NUM> corresponding to the at least one plane <NUM>, <NUM>, respectively.

In an embodiment, the at least one scaler <NUM>, <NUM> may perform graphicprocessing (for example, scaling) with respect to image data read by the at least one plane <NUM>, <NUM>.

In an embodiment, the blender <NUM> may generate a final image by synthesizing the image data graphic-processed by the at least one scaler <NUM>, <NUM>.

In an embodiment, the interface <NUM> may package the final image according to a protocol of the interface <NUM>, and may transmit the packaged image to a display <NUM>. In an embodiment, the interface may include an MIPI, an HDMI, a DP, or a combination of these.

In an embodiment, the write back plane <NUM> may hook the final image recorded on the blender <NUM> and may record the image on a write back buffer <NUM> of a memory <NUM>.

<FIG> is a flowchart illustrating an operation of an electronic device (for example, the electronic device <NUM>) according to an embodiment of the disclosure.

Referring to <FIG>, in operation <NUM>, a processor (for example, the processor <NUM>) of the electronic device <NUM> may identify a state change of the electronic device <NUM>. In an embodiment, the processor <NUM> may identify the state change of the electronic device <NUM> based on a sensor module <NUM>. In an embodiment, the processor <NUM> may identify a first state change from a folded state of the electronic device <NUM> to an unfolded state, based on the sensor module <NUM>. In an embodiment, the processor <NUM> may identify a second state change from the unfolded state of the electronic device <NUM> to the folded state, based on the sensor module <NUM>.

In an embodiment, when the state change of the electronic device <NUM> is identified, the processor <NUM> may activate (for example, turn-on) a new display area of the display <NUM> corresponding to the changed state of the electronic device <NUM>.

Referring to <FIG>, in operation <NUM>, the processor <NUM> identifies whether continuity is set for an application. In an embodiment, when the state change of the electronic device <NUM> is identified, the processor <NUM> may identify continuity information of an application (for example, the application <NUM> of <FIG>) which is being displayed on a first display area of the display <NUM>. In an embodiment, when the first state change is identified, the processor <NUM> may identify continuity information according to the first state change of the application which is being displayed on the first display area. In an embodiment, when the second state change is identified, the processor <NUM> may identify continuity information according to the second state change of the application which is being displayed on the first display area.

Referring to <FIG>, the processor <NUM> may process an operation according to operation <NUM> and an operation according to operation <NUM> in parallel.

Referring to <FIG>, in operation <NUM>, the processor <NUM> may generate a new image. In an embodiment, when the continuity of the application which is being displayed on the first display area of the display <NUM> is set, the processor <NUM> may newly generate an image indicating a result of executing the running application. In an embodiment, the new image indicating the result of executing the running application (for example, the application <NUM> of <FIG>) may correspond to a resolution of a second display area of the display <NUM>. In an embodiment, the processor <NUM> may newly generate the image by newly drawing a layer on a certain application, a layer on a status bar, a launcher layer, a wallpaper layer, a layer on a notification, or a combination of these.

Referring to <FIG>, in operation <NUM>, the processor <NUM> may take a snapshot of the existing image. In an embodiment, when the state change of the electronic device <NUM> is identified, the processor <NUM> may take a snapshot of the existing image displayed on the first display area and may store the snapshot image in the memory <NUM>.

Referring to <FIG>, in operation <NUM>, the processor <NUM> may display the snapshot image. In an embodiment, the processor <NUM> may display the snapshot image on the second display area of the display <NUM> until the new image is generated.

Referring to <FIG>, in operation <NUM>, the processor <NUM> may display the new image. In an embodiment, when the new image is generated, the processor <NUM> may display the new image on the second display area of the display <NUM> instead of the existing image.

<FIG> is a flowchart illustrating an operation of displaying a snapshot image of an electronic device (for example, the electronic device <NUM> of <FIG>) according to an embodiment of the disclosure. Operations of <FIG> may be included in the operations of <FIG>.

In an embodiment, operations of <FIG> may be performed after operation <NUM> of <FIG>. In an embodiment, operations of <FIG> may be performed before operation <NUM> of <FIG>.

Referring to <FIG>, in operation <NUM>, the processor (for example, the processor <NUM>) of the electronic device <NUM> may perform image-processing (for example, scaling, rotation, blurring, or a combination of these) with respect to a snapshot image. In an embodiment, the processor <NUM> may perform image-processing (for example, scaling, rotation, blurring, or a combination of these) with respect to the snapshot image based on a resolution of the second display area of the display <NUM>.

Referring to <FIG>, in operation <NUM>, the processor <NUM> may display the image-processed snapshot image. In an embodiment, the processor <NUM> may display the image-processed snapshot image on the second display area of the display <NUM>.

<FIG> is a flowchart illustrating an operation of processing a new image of an electronic device (for example, the electronic device <NUM> of <FIG>) according to an embodiment of the disclosure. Operations of <FIG> may be included in the operations of <FIG>.

In an embodiment, operations of <FIG> may be performed after operation <NUM>, and operation <NUM> of <FIG>. In an embodiment, operations of <FIG> may be performed before operation <NUM> of <FIG>.

Referring to <FIG>, in operation <NUM>, the processor (for example, the processor <NUM>) of the electronic device <NUM> may perform image-processing (for example, blurring) with respect to a new image.

Referring to <FIG>, in operation <NUM>, the processor <NUM> may display the image-processed new image. In an embodiment, the processor <NUM> may display the image-processed new image on the second display area of the display <NUM> for a pre-designated time.

Thereafter, in operation <NUM>, the processor <NUM> may display the new image to which image-processing is not applied on the second display area of the display <NUM>.

As described above, the electronic device <NUM> and the operating method thereof may take a snapshot of an existing image when a state of the display <NUM> changes between a folded state and an unfolded state, and may display the snapshot image on a new display area of the display <NUM>, so that user's experience of a delay is reduced.

As described above, according to the invention, an electronic device includes a first display disposed on a first surface of the electronic device; a second display disposed on a second surface of the electronic device and having a least a portion thereof being unviewable to a user according to a folding state of the electronic device; a memory configured to store instructions; and a processor electrically connected with the first display, the second display, and the memory. The processor is configured to execute the instructions to detect a change in the folding state of the electronic device while displaying a first image on one of the first display or the second display; when the change of the folding state is detected, generate a second image to display on the other of the first display or the second display, which did not display the first image; while generating the second image, store a snapshot image of the first image in the memory; display the snapshot image on the other of the first display or the second display; and when the second image is generated, display the second image on the other of the first display or the second display instead of the snapshot image.

The processor is further configured to execute the instructions to: when the change of the folding state is detected, identify a setting regarding continuity of a running application; and when the setting regarding the continuity of the running application is identified, generate the second image to display on the other of the first display or the second display.

In an embodiment, the processor may be further configured to execute the instructions to, when the setting regarding the continuity of the running application is not identified, display a pre-designated screen on the other of the first display or the second display.

In an embodiment, the processor may be further configured to execute the instructions to, when the setting regarding the continuity of the running application corresponding to the change of the folding state is identified, generate the second image to display on the other of the first display or the second display.

In an embodiment, the processor may be further configured to execute the instructions to perform image-processing with respect to the snapshot image, and to display the image-processed snapshot image on the other of the first display or the second display.

In an embodiment, the image-processing may be at least one of scaling, rotation, or blurring.

In an embodiment, the processor may be further configured to execute the instructions to perform image-processing with respect to the second image, and to display the image-processed second image on the other of the first display or the second display for a pre-set time.

In an embodiment, the electronic device may further include a display controller to provide data indicating an image to display on the first display, the second display or a display of a combination thereof, and the display controller may further include a write back plane to store the snapshot image on the first image in the memory by hooking the data temporarily stored in the display controller.

In an embodiment, the processor may be further configured to execute the instructions to, when the change of the folding state is detected, turn off the one of the first display or the second display and to turn on the other of the first display or the second display.

In an embodiment, a resolution of the first display and a resolution of the second display may be different from each other.

As described above, according to the invention, an electronic device includes a display in which an area facing a user is changed according to a folding state of the electronic device; a memory configured to store instructions; and a processor electrically connected with the display and the memory. The processor is configured to execute the instructions to detect a change of the folding state of the electronic device while displaying a first image on a first area of the display; when the change of the folding state is detected, identify a second area of the display corresponding to the changed folding state; generate a second image to display on the identified second area; while generating the second image, store a snapshot image regarding the first image in the memory and to display the snapshot image on the identified second area of the display; and when the second image is generated, display the second image on the identified second area of the display instead of the snapshot image.

The processor is further configured to execute the instructions to, when the change of the folding state is detected, identify a setting regarding continuity of a running application, and when the setting regarding the continuity of the running application is identified, generate the second image to display on the identified second area.

In an embodiment, the processor may be further configured to execute the instructions to, when the setting regarding the continuity of the running application is not identified, display a pre-designated screen on the identified second area.

In an embodiment, the processor may be further configured to execute the instructions to, when the setting regarding the continuity of the running application corresponding to the change of the folding state is identified, generate the second image to display on the identified second area.

In an embodiment, the processor may be further configured to execute the instructions to perform image-processing with respect to the snapshot image, and to display the image-processed snapshot image on the identified second area.

In an embodiment, the processor may be further configured to execute the instructions to perform image-processing with respect to the second image, and to display the image-processed second image on the identified second area for a pre-set time.

In an embodiment, the electronic device may further include a display controller configured to provide data indicating an image to display on the display, and the display controller may further include a write back plane configured to store the snapshot image regarding the first image in the memory by hooking the data temporarily stored in the display controller.

In an embodiment, the processor may be further configured to execute the instructions to, when the change of the folding state is detected, turn on the identified second area among the areas of the display.

In an embodiment, a resolution of the first area and a resolution of the second area may be different from each other.

Methods based on the claims or the embodiments disclosed in the disclosure may be implemented in hardware, software, or a combination of both.

When implemented in software, a non-transitory computer readable storage medium for storing one or more programs (software modules) may be provided. The one or more programs stored in the computer readable storage medium are configured for execution performed by one or more processors in an electronic device. The one or more programs include instructions for allowing the electronic device to execute the methods based on the claims or the embodiments disclosed in the disclosure.

The program (the software module or software) may be stored in a random access memory, a non-volatile memory including a flash memory, a read only memory (ROM), an electrically erasable programmable read only memory (EEPROM), a magnetic disc storage device, a compact disc-ROM (CD-ROM), digital versatile discs (DVDs) or other forms of optical storage devices, and a magnetic cassette. Alternatively, the program may be stored in a memory configured in combination of all or some of these storage media. In addition, the configured memory may be plural in number.

Further, the program may be stored in an attachable storage device capable of accessing the electronic device through a communication network such as the Internet, an Intranet, a local area network (LAN), a wide LAN (WLAN), or a storage area network (SAN) or a communication network configured by combining the networks. The storage device may access via an external port to a device which performs the embodiments of the disclosure. In addition, an additional storage device on a communication network may access to a device which performs the embodiments of the disclosure.

Claim 1:
An electronic device comprising:
a first display (<NUM>) disposed on a first surface of the electronic device;
a second display (<NUM>) disposed on a second surface of the electronic device and having a least a portion thereof being unviewable to a user according to a folding state of the electronic device;
a memory (<NUM>) configured to store instructions; and
a processor (<NUM>) electrically connected with the first display (<NUM>), the second display (<NUM>), and the memory (<NUM>),
wherein the processor (<NUM>) is configured to execute the instructions to:
detect (<NUM>) a change in the folding state of the electronic device while displaying a first image of a running application on one of the first display (<NUM>) or the second display (<NUM>),
when the change of the folding state is detected, identify (<NUM>) a setting regarding continuity of the running application wherein continuity information is information indicating whether the application already displayed will be displayed when the folding state of the electronic device is changed,
when the setting regarding the continuity of the running application is identified, generate (<NUM>) a second image indicating a result of executing the running application to display on the other of the first display (<NUM>) or the second display (<NUM>),
characterized in,
while generating the second image, store (<NUM>) a snapshot image of the first image in the memory (<NUM>) and display (<NUM>) the snapshot image on the other of the first display (<NUM>) or the second display (<NUM>), and
when the second image is generated, display (<NUM>) the second image on the other of the first display or the second display instead of the snapshot image.