Apparatus, systems, and methods for transferring objects between multiple display units

An apparatus for transferring objects between multiple display units includes a processor of an information handling device and a memory that stores code executable by the processor. The code is executable by the processor to detect a screen object and/or a pointing input mechanism selecting the screen object being moved to a predetermined region of a first display unit and, in response to the detection, display at least part of the screen object on a second display unit.

CROSS-REFERENCE TO RELATED APPLICATIONS

This patent application claims priority to Japan Patent Application No. JP2016-209650 filed on 26 Oct. 2016 for Kosugi, et al., the entire contents of which are incorporated herein by reference for all purposes.

FIELD

This disclosure relates to an information processing device, an image display method, and an image display program, and particularly to apparatus, systems, methods, and computer program products for transferring objects between multiple display units.

BACKGROUND

Recently, portable computing devices (e.g., laptop computers) having double screens have been developed. For example, Japan Patent Application No. JP2015-233198 discloses a portable computing device including a first casing provided with a first touch display and a second casing provided with a second touch display.

BRIEF SUMMARY

Various embodiments provide apparatus, systems, methods, and computer program products for transferring objects between multiple display units. In one embodiment, an apparatus includes a processor of an information handling device and a memory. The memory stores code executable by the processor to detect a screen object and/or a pointing input mechanism selecting the screen object being moved to a predetermined region of a first display unit and, in response to the detection, display at least part of the screen object on a second display unit.

DETAILED DESCRIPTION

Various embodiments include an information processing device, an image display method, and an image display program. In some embodiments, a user may use a portable information processing device with multiple screens arranged up and down to perform operations to move a window from the lower screen to the upper screen in a continuous fashion. As a user moves the window from the lower screen to the upper screen, the window may be maximized near the upper side of the lower screen depending on the setting of an operation system (OS), which can prevent the window from being moved onto the upper screen.

Further, since a pointing input mechanism (e.g., a human finger, stylus, pen, etc.) cannot continue to touch across multiple screens, it can be difficult to move the window displayed on the first touch display unit to the second touch display unit. Various embodiments discussed herein address at least this issue.

An information processing device according to one embodiment includes, among other components, an information processing device including multiple display units that can accept a touch operation with a pointing input mechanism to input an operation instruction on an object this is displayed, a movement determination unit that determines whether part of a screen object or the pointing input mechanism selecting the screen object is moved to enter a predetermined region provided near a side of one display unit on which the screen object displayed and/or to which another display unit adjoins, and an image control unit that displays, on the other display unit, at least part of the screen object when the movement determination unit determines that part of the screen object or the pointing input mechanism selecting the screen object is moved to a predetermined region.

An image display method according to another embodiment includes an image display method for an information processing device including multiple display units. The method can include determining whether part of a screen object or a pointing input mechanism selecting the screen object is moved to enter a predetermined region provided near a side of one display unit including the screen object displayed thereon and to which another display unit adjoins in the multiple display units capable of accepting a touch operation with a pointing input mechanism to input an operation instruction on an object to be displayed. The method can further include displaying at least part of the screen object on the other display unit in response to determining that part of the screen object or the pointing input mechanism selecting the screen object is moved to the predetermined region.

An image display program according to still another embodiment includes an image display program for an information processing device including multiple display units. The image display program can include a first process of determining whether part of a screen object or a pointing input mechanism selecting the screen object is moved to enter a predetermined region provided near a side of one display unit having the screen object displayed thereon and to which another display unit adjoins in the multiple display units capable of accepting a touch operation with a pointing input mechanism to input an operation instruction on an object to be displayed. The image display program can further include a second process of displaying at least part of the screen object on the other display unit in response to determining that part of the screen object or the pointing input mechanism selecting the screen object is moved to the predetermined region.

Turning to the figures,FIG. 1is a perspective view illustrating the appearance structure of a portable information processing device according to one embodiment.

A portable information processing device1A according to one embodiment includes, among other components, a first chassis10and a second chassis20in which the first chassis10and the second chassis20are coupled in a foldable manner through coupling mechanisms (e.g., hinges, etc.)30. A first chassis10can include, among other components, a substantially rectangular shape and a first display unit11to display images on one side of the first chassis10. A second chassis20can include, among other components, a substantially rectangular shape and a second display unit21on one side of the second chassis20. The first chassis10and the second chassis20are so described that the back faces of the respective display units will be the back faces of each respective chassis.

In the following description, the first chassis10and the second chassis20may be simply called “the chassis” when no distinction is made between both, and the first display unit11and the second display unit21may be simply called “the display unit” when no distinction is made between both.

On each face of the first chassis10and the second chassis20, an operational input, such as a button, to power ON or power OFF the portable information processing device1A, and a connecting part such as a Universal Serial Bus (USB) connectable to another information processing device and a storage medium are provided. Further, in the first chassis10and the second chassis20, a camera, a speaker, a microphone, and/or the like can be provided. Note that an interface used as a connecting part to connect to external peripheral devices is not limited to a USB and other suitable interfaces, such as the High-Definition Multimedia Interface (HDMI) standard and/or a Digital Visual Interface (DVI) standard may also be included.

The hinges30can couple the first chassis10and the second chassis20in a manner that can allow the first chassis10and the second chassis20to rotate 360 degrees about a rotating axis δ and to adjoin the first display unit11and the second display unit21to each other. As such, the hinges30can allow the portable information processing device1A to take on various configuration states.

An angle between the first chassis10and the second chassis20(hereinafter called, “orientation angle”) is defined as “θ.” When the orientation angle is smaller than 90 degrees, the first display unit11and the second display unit21face each other and form an internal surface of the portable information processing device1A.

FIGS. 2A through 2C,FIG. 3A, andFIG. 3Bare schematic diagrams illustrating various open and closed states of a portable information processing device1A. That is, the portable information processing device1A can take various configurations defined by the orientation of the first display unit11and the second display unit21. Specifically,FIG. 2Aillustrates a “closed” state in which orientation angle θ=0 degrees and the portable information processing device1A is closed.FIGS. 2B and 2Cillustrate “book” states in which the rotating axis δ is in the vertical direction and the orientation angle is 0 degrees<θ<180 degrees.

Note thatFIG. 2Bis a book state in which the orientation angle is 90 degrees or less, andFIG. 2Cis a book state in which the orientation angle is 90 degrees <θ<180 degrees. Further, inFIGS. 2B and 2Ca state in which the rotating axis δ is in the horizontal direction is also called a “clamshell” state.

FIG. 3Aillustrates a “tent” state in which the rotating axis δ is in the horizontal direction and the orientation angle is 180 degrees<θ<360 degrees.FIG. 3Billustrates a “tablet” state in which the orientation angle θ=360 degrees and the first display unit11and the second display unit21are opposed to each other while facing outward, respectively. In this embodiment, a user can have visual contact with either the first display unit11or the second display unit21.

FIG. 4is a block diagram illustrating an electrical configuration of the portable information processing device1A. As illustrated inFIG. 4, the portable information processing device1A includes, in addition to the first display unit11and the second display unit21, a control unit40, a Hall effect sensor41, a first acceleration sensor42, a second acceleration sensor43, a memory44, a storage unit45, a communication unit46, and a power supply unit47.

The first display unit11includes a display part11band a touch sensor11asuperimposed on the display part11b. The second display unit21includes a display part21band a touch sensor21asuperimposed on the display part21b.

The first display unit11and the second display unit21can accept a touch operation with a pointing input mechanism (e.g., a finger, stylus, pen, etc.) to enter an operation instruction on a target to be displayed. The touch operation may be a concept including operations in proximity (e.g., hover) positions, in addition to direct touch operations to the first display unit11and the second display unit2.

The touch sensors11aand21acan detect various operations carried out on the touch sensors11aand21ausing the pointing input mechanism, such as the finger, stylus, or pen together with positions of the operations on the touch sensors11aand21a, and provide the detection results to the control unit40. The operations detected by the touch sensors11aand21acan include a touch operation, a slide operation, a tap operation, a pitch operation, and a flick operation, among other operations that are possible and contemplated herein. Various embodiments of a touch sensor11aand/or21acan include a capacitive type and/or a pressure-sensitive type of touch sensor, among other types of touch sensors that are possible and contemplated herein.

Each of the display parts11band/or21bcan be, for example, a liquid display (LCD) or an organic Electro-Luminescence (organic EL) panel to display text and graphics under the control of the control unit40, among other types of displays that are possible and contemplated herein.

The control unit40can be, for example, Central Processing Unit (CPU), a microprocessor, a Digital Signal Processor (DSP), and/or the like to control the overall operation of the portable information processing device1A to implement various functions. Specifically, the control unit40can execute instructions included in a program stored in, for example, the storage unit45, while referring to data stored in the storage unit45and data developed in the memory44, as needed, to implement various functions, such as a telephone function, a mail function, a web browsing function, and an image display function, among other functions that are possible and contemplated herein.

A Hall effect sensor41can include a Hall element in either one of the first chassis10and the second chassis20, and a magnet in the other respective chassis. As a non-limiting example, a Hall element can be arranged inside the first chassis10. The position of the Hall element can correspond to the position of a magnet (not illustrated) arranged inside the second chassis20. That is, the Hall element and the magnet can be arranged to face each other in the closed state in which the portable information processing device1A is enclosed.

The Hall effect sensor41can be such that the Hall element detects the magnetic field produced by the magnet arranged inside the second chassis20and, in response thereto, output the detection result of the magnetic field to the control unit40. Since the Hall element can detect the magnetic field, the control unit40can determine an open/closed state of the portable information processing device1A.

A first acceleration sensor42can be arranged inside the first chassis10. The first acceleration sensor42can detect acceleration in an X1direction that is parallel to the long-side direction of the first display unit11, in a Y1direction that is parallel to the short-side direction of the first display unit11, and/or in an Z1direction that is perpendicular to the X1and Y1directions, and output, to the control unit40, the acceleration values Ax1(t), Ay1(t), and Az1(t) of the X1, Y1, and Z1directions. Accordingly, the first acceleration sensor42can detect acceleration in the X1, Y1, and Z1directions, which can lead to detecting the direction of the first display unit11.

The second acceleration sensor43can be arranged inside the second chassis20. The second acceleration sensor43can detect acceleration in an X2direction that is parallel to the long-side direction of the second display unit21, in a Y2direction that is parallel to the short-side direction of the second display unit21, and in a Z2direction that is perpendicular to the X2and Y2directions, and output, to the control unit40, the acceleration values Ax2(t), Ay2(t), and Az2(t) of the X2, Y2, and Z2directions. Accordingly, the second acceleration sensor43can detect acceleration in the X2, Y2, and Z2directions, which can lead to detecting the direction of the second display unit21.

The first acceleration sensor42and the second acceleration sensor43can function as detection units that determine the orientation of the first chassis10and the second chassis20. While the detection units can be used to determine the orientation of the first chassis10and the second chassis20, other types of detection units are possible and contemplated herein. For example, at least one type of angular velocity sensor and/or proximity sensor, in addition to the Hall effect sensor41, the first acceleration sensor42, and/or the second acceleration sensor43may be used.

Further, a switching mechanism may be used as a detection unit to detect the angle of the second chassis20relative to the first chassis10. In various embodiments, a switching mechanism may be provided in each of the hinges30.

A memory44can be, for example, a Random Access Memory (RAM) or a Dynamic Random Access Memory (DRAM), which can be used as a work area in which a program can be executed by the control unit40, data referred to by the control unit40, computational results of the control unit40, and/or the like can be at least temporarily stored.

A storage unit45may be a computer-readable storage medium that can hold programs executed by the control unit40and/or data. In various embodiments, a storage unit45can be a nonvolatile memory, such as an Electrically Erasable Programmable Read-Only Memory (EEPROM) or a Solid State Drive (SSD), etc., among other types of computer-readable storage mediums that are possible and contemplated herein.

Under the control of the control unit40, a communication unit46can establish a wireless signal line with a base station via a channel allocated by the base station. The communication unit46can perform telephone communication and/or information communication with the base station, among other functions and/or devices that are possible and contemplated herein.

For example, multiple display units can be arranged in a manner that allows images to be displayed on the multiple display units when the multiple display units lined up one above the other (see e.g.,FIG. 6). For instance, the lower display unit can set as the first display unit11and the upper display unit can set as the second display unit21. In this case, when a screen object is moved from the first display unit11to the second display unit21and/or when the screen object is moved from the second display unit21to the first display unit11, the control unit40can control the movement of the screen object(s) between the upper and lower display units (hereinafter called, “image display control processing”).

Screen objects can be objects including, for example, icons, windows, and/or the like objects, among other types of objects that are movable in the display area of each display unit. In one embodiment, a screen object can include a window being moved between screens.

In one embodiment, a description is provided by exemplifying the case in which the multiple display units are arranged as illustrated inFIG. 6. That is, the multiple display units can be arranged in a manner in which the images displayed on the display units are lined up one above the other, but the various embodiments are not limited thereto. That is, other embodiments can include any other case and/or configuration in which the display units are lined up and the adjacency of the screens can be detected. For example, some embodiments can include a case in which images displayed on the multiple display units are arranged side by side. In this case, the up and down operations may be read as right and left operations.

FIG. 5is a functional block diagram related to one embodiment of image display control processing. Specifically, a control unit40can include, among other components, an orientation determination unit50, a movement determination unit51, an image control unit52, a selection unit53, and a determination unit54. In some embodiments, each of these constituent units can be implemented by a computer-useable program.

An orientation determination unit50can determines the open/closed state of a portable information processing device1A and/or an orientation angle, which can be the angle between the first chassis10and the second chassis20. In some embodiments, an orientation determination unit50can determine the direction of the first display unit11based on the acceleration values Ax1(t), Ay1(t), and Az1(t) of the X1, Y1, and Z1directions output from the first acceleration sensor42, and determines the direction of the second display unit21based on the acceleration values Ax2(t), Ay2(t), and Az2(t) of the X2, Y2, and Z2directions output from the second acceleration sensor43. In other words, an orientation determination unit50can determine a clamshell state, a tent state, a tablet state, or a book state based on the direction of the first display unit11and/or the second display unit21. Further, the orientation determination unit50can determine the closed state based on the detection result of the magnetic field from the Hall effect sensor41.

An orientation determination unit50can further determine the orientation angle from the direction of the first display unit11and/or the second display unit21. In determining the closed state based on the detection result of the Hall effect sensor41, the orientation determination unit50can set the orientation angle to 0 degrees. A selection unit53can select an adjoining side of the first display unit11and/or the second display unit21based on the orientation determined by the orientation determination unit50.

A movement determination unit51can determine whether part of the window is moved by dragging and/or comes close to a predetermined region provided on near a side of the display unit having the window displayed thereon and to which the other display unit adjoins. Here, when multiple chassis are opened in the up and down direction in a manner that displays images on the display units with one lined up above the other, a predetermined region can be provided near a side of the lower display unit with which the upper display unit adjoins. Further, when multiple chassis are opened in the up and down direction in a manner in which the display units are lined up one above the other, the predetermined region may be provided near the side of the upper display unit on which the lower display unit adjoins. Since the predetermined region can be the boundary to jump a window from one display unit to the other display unit, the predetermined region may be referred to as a “boundary region.” When multiple display units are placed in such a manner that the images displayed on the display units are positioned from side to side, the predetermined region may be provided near a side of the left display unit to which the right display unit adjoins or near a side of the right display unit to which the left display unit adjoins.

A predetermined region can be set appropriately in the display unit provided in the upper chassis and/or in the display unit provided in the lower chassis. The width of a predetermined region (e.g., a region width in a direction parallel to the side) and/or a shape of the predetermined region may include any suitable dimension(s) and/or shape that is known or developed in the future and are not particularly limited to the illustrated embodiments. That is, the predetermined regions on the upper and lower sides may be the same or different widths and/or the same or different shapes.

The following description is provided based on a predetermined region that is set, for example, by presetting, in the storage unit45or the like, a value set by the user. Other embodiments may be preset using various other setting techniques. Further, a movement determination unit51can determine whether a touch and/or move operation is carried out by a predetermined amount of movement, which can determine whether a flick operation is performed to move the window on the display unit.

A determination unit54can detect a vector direction in which the window is moved. In additional or alternative embodiments, a determination unit54can determine whether there is another display unit adjoining the display unit that is currently displaying the window in the vector direction of the moving window. When determining that there is the other display unit adjoining the display unit currently displaying the window, the determination unit54can move the window. Further, when determining that no other display unit is adjoining the display unit currently displaying the window, the determination unit54may not move the window beyond the predetermined region of the display unit having the window being currently displayed.

Based on the determination result of the movement determination unit51and/or the detection result of each sensor (e.g., the determination result of the orientation determination unit50), the image control unit52can control the image display of the first display unit11and/or the second display unit21. Specifically, the image control unit52can display, on the other display unit, part of the window being displayed on one display unit in a state (e.g., the clamshell state, the book state, or the tent state, depending on the orientation angle). Further, when the movement determination unit51determines that part of the window is moved to the predetermined region in the display unit currently displaying the window, the image control unit52can display, on the other display unit, at least part of the window.

A display method of displaying, on the other display unit, at least part of the window currently displayed on the display unit displaying the window is not limited to the illustrated embodiment. That is, a window may be displayed across the display unit and the other display unit, or the whole window may be cleared from the display unit and displayed on the other display unit. In one embodiment, the description is given by taking, as an example, a case in which the window is displayed across the display unit displaying the window and the other display unit.

FIG. 6Ais an image diagram illustrating one embodiment of a state of displaying a window on the first display unit11,FIG. 6Bis an image diagram illustrating a state of using a pointing input mechanism P to hold the window displayed on the first display unit11, andFIG. 6Cis an image diagram illustrating a state of moving the pointing input mechanism P holding the window to a predetermined region Y near a side X and making the window jump onto the second display unit21.FIG. 6Dis an image diagram illustrating a state in which part of the window displayed on the second display unit21inFIG. 6Cis slid and moved to make the whole window displayed on the second display unit21.

In some embodiments, the first display unit11and the second display unit21may be virtually combined to form a large virtual display with adjacent sides of the adjacent display units set as a shared side. For example, when the window is held with the pointing input mechanism P and moved to the predetermined region Y provided near the side X on which the display unit and the other display unit adjoin each other, the window can jump onto the other adjoining display unit and be displayed on the other display unit. Thus, when part of the window displayed on the display unit is moved to the predetermined region Y provided near the side X to which the other display unit adjoins and determined to reach the predetermined region Y, the window can be displayed across the display unit currently displaying the window to the other adjoining display unit.

In the case of touch panel display, the display unit can be directly touched using the pointing input mechanism P to operate the window. Using the touch panel display, if the window is moved across multiple display units, it can be difficult to move the window in conventional touch screens because one display unit and the other display unit are physically spaced apart. According to various embodiments disclosed herein, when part of the window reaches the predetermined region Y near the side X to which the other display unit adjoins, the part of window jumps onto the adjoining (or destination) display unit. As such, a window can be displayed across the display unit with which the window was originally displayed and also to the destination display unit, which allows the window to be moved to the window on the portable information processing device1A including multiple display units with relative ease.

Further embodiments may correspond to a flick operation of the window over display units using the pointing input mechanism P. One example includes a user performing a flick operation to flick the window on a display unit with the window displayed (see e.g.,FIG. 7A). In this case, when part of the window reaches the predetermined region Y near the adjoining side X, the window is moved from the display unit having the window displayed thereon to the other display unit (seeFIG. 7B). Since the window that reaches the predetermined region Y near the side X of the adjacent display units is moved by the flick operation to a predetermined position of the other display unit in which the window is not displayed, the window can be moved relatively easily.

To determine whether the flick operation is performed, the movement determination unit51can observe the touch operation to determine whether the amount of movement exceeds a predetermined amount. That is, when the amount of movement exceeds the predetermined amount, the movement determination unit51can determine that a flick operation has been performed.

Further, as the destination of the window, the vector direction at the time of the flick operation can be detected. Further, when there is a display unit adjoining the original display unit in a direction in which the largest vector component is detected, the window is moved to the adjoining display unit. Such an image display is provided in the clamshell state and the book state. Thus, the window can be moved in the direction of the side acceptable depending on the predetermined orientation states, such as the clamshell state and/or the book state.

Subsequently, a case of a tent mode (e.g., a tent state) as an orientation in which the back faces of respective chassis with no display unit provided face each other will be described. In the tent mode of the first chassis10and the second chassis20, as illustrated inFIG. 3A, the selection unit53can select a side on which the display units adjoin each other. In this case, when the window of one display unit is made to appear from the side of the other display unit, the window is displayed on the side of the other display unit to come down from the top of the screen and the window is displayed upside down.

As such, in the tent mode, the side may be provided so that a side to which the other display unit adjoins may be set as the top of the screen on the side of the other display unit, a side opposite to the side is set as the bottom of the screen, and the bottom of the screen is set as the side to which the one display unit adjoins. For example, when a part of window or the pointing input mechanism used to select the window is moved to the predetermined region on the display unit having the window displayed thereon, the window is moved onto the other display unit, from the opposite side of the side on which the display unit and the other display unit adjoin each other, and at least part of the window is displayed on the other display unit. Specifically, when part of the window enters the predetermined region on the display unit having the window displayed thereon, the coordinates of the other adjoining display unit may be transformed based on the assumption that the adjoining side is the bottom of the screen to move the window from the bottom of the screen and display the window on the other display unit. Thus, in the tent mode, the way to select the side can be made different from that in the clamshell state to prevent the window from being displayed upside down on the other display unit.

In a further example, in an orientation in which the back sides of the first chassis10and the second chassis20face each other in the tent mode, even when part of the window is moved to enter the predetermined region on the display unit with the window displayed, the window may be set not to be moved to the other display unit.

FIG. 8is a flowchart illustrating a flow of one embodiment of the image display control processing. An orientation angle can be determined from the directions of the first display unit11and the second display unit21and a window can be operated on the display unit having the window displayed thereon to move the window, as illustrated inFIG. 6A(block SA1inFIG. 8). The display unit may be touched, as illustrated inFIG. 6B, to move the window in the touch position along with the touch and move operation. In response thereto, is determined whether a drag operation has been performed to drag part of the window into the predetermined region Y near the side X on which the display unit having the window displayed thereon and the other adjoining display unit adjoin each other (block SA2inFIG. 8). In response to determining that part of the window does not reach (enter) the predetermined region Y near the selected side X, the flow returns to block SA1. In response to determining that part of the window reaches the predetermined region Y, it is determined whether there is an adjoining display unit at the destination of the window (block SA3inFIG. 8).

In response to determining that there is no display unit adjoining in the vector direction, the flow returns to block SA1. In response to determining that there is an adjoining display unit at the destination of the window, the window is made to jump by a predetermined amount onto the adjoining display unit (seeFIG. 6C).

The window jumps in this manner to display the moved window across the display unit displaying the window before the movement, and the display unit as the destination of the window (block SA4inFIG. 8). Processing may then end. Since part of the window is displayed on the display unit as the destination, the user can touch and move the window on the display unit as the display unit to display the whole window (seeFIG. 6D).

FIG. 9is a flowchart illustrating a flow of another embodiment of an image display control processing. An orientation angle is determined from the directions of the first display unit11and the second display unit21, a display unit is touched, and a window in the touch position is moved along with the touch and the movement. The amount of touch movement is monitored on the display unit with the window displayed (block SB1inFIG. 9). It is determined whether touch movement greater than or equal to a predetermined amount of movement as a threshold value is used to determine and/or detect a flick operation on the display unit (block SB2inFIG. 9). In response to the touch movement greater than or equal to the predetermined amount of movement not being detected (e.g., a “NO” in block SB2), the flow returns to block SB1. When the touch movement is greater than or equal to the predetermined amount of movement is detected (e.g., a “YES” in block SB2), a vector direction in which the window is moved is detected (block SB3inFIG. 9).

It is then determined whether there is an adjoining display unit at a destination of the vector direction (block SB4inFIG. 9). In response to determining that there is no adjoining display unit in the vector direction (e.g., a “NO” in block SB4), block SB1is repeated. In response to determining that there is an adjoining display unit in the vector direction (e.g., a “YES” in block SB4), a side X near the adjoining display unit in the vector direction is selected. It is then determined whether part of the window enters a predetermined region Y provided near the selected side X, and the determination as to whether part of the window enters the predetermined region Y is repeated until the part of the window enters the predetermined region Y. When part of the window enters the predetermined region Y, the whole window is moved to the adjoining display unit in the vector direction (seeFIG. 6C).

When this is done, the window is cleared from the display unit with the window originally displayed, and the whole window after being subjected to the flick operation is displayed on the display unit as the destination (block SB5inFIG. 9).

In the embodiments illustrated inFIG. 8andFIG. 9, the description is provided by dividing the display method into a method of making the window jump to display the window across the multiple display units, and a method of performing the flick operation to flick and display the window, but both the display with the jumping operation and the display with the flick operation may also be enabled at the same time, or enabling/disenabling of respective functions may be set on a setting screen (not illustrated).

As described above, the portable information processing device1A, the image display method, and the image display program according to various embodiments includes the first chassis10and the second chassis20, where the first chassis10and the second chassis20can be foldable by the hinges30that couple the chassis together. When part of a window of the display unit having the window displayed thereon is moved to enter a predetermined region provided near the side to which another display unit adjoins, the window is displayed across the display unit to the other display unit. Then, a portable information processing device1A can identify a side of adjoining display units according to the orientation of the first chassis10and the second chassis20, and handle the adjoining display units virtually as one display unit. That is, the portable information processing device1A can move the window across the side boundary from one display unit to the other display unit to provide an image display.

In a touch panel display environment, each display unit can be directly touched with the pointing input mechanism to operate the window. In the touch panel display, if the window is operated across multiple display units, it can be difficult to move the window because one display unit and the other display unit are physically spaced apart. According to various embodiments discussed herein, a window can be relatively easily moved between multiple display units, even in a touch panel display environment.

Further, since it can be determined that part of the window (or the pointing input mechanism used to hold the window) reaches a predetermined region near the side of the display unit having the window displayed thereon, part of the window can be made to jump onto another display unit and displayed thereon, which can display the window across the side from the display unit originally displaying the window to the destination display unit as the destination. This can enable the window to be moved in a user-friendly manner.

Further, when displays are arranged one above the other, there is a portable information processing device including, for example, a function of the OS to maximize a window on a lower display unit when the window is moved from the lower display unit to an upper display unit in a state of holding the window with a pointing input mechanism. Such a function can maximize the window on the lower display unit despite a user's intention to move the window from the lower display unit to the upper display unit, which can make it difficult to perform an intended operation. According to various embodiments presented herein, since the display unit to display the window is switched from the display unit having the window displayed thereon to the other display unit at the stage of reaching the predetermined region near the side on which the multiple display units adjoin each other, the window can be moved quickly between multiple display units.

In the above-mentioned embodiments, the descriptions are given by taking, as an example, the case in which the window is moved from the lower display unit to the upper display unit that are arranged one above the other, but the scope of the various embodiments is not limited thereto. The scope also includes a case in which the window is moved from the upper display unit to the lower display unit.

Further, in various embodiments, the description is given by taking, as an example, the case where the window is moved between display units, but an icon may also be moved between display units in the same manner.

In some embodiments discussed thus far, a window can be displayed on another display unit when part of the window enters the predetermined region near the side. In other embodiments, a window can be displayed on the other display unit when the pointing input mechanism used to hold the window enters the predetermined region near the side. For an information processing device of these embodiments, the description of points common to those of previous embodiments is omitted and different points will be mainly described with reference toFIG. 1toFIG. 5.

The movement determination unit51can determine whether part of a pointing input mechanism, such as a finger, stylus, or a pen used to hold a window is moved to enter a predetermined region provided near a side of a display unit having the window displayed thereon, to which another display unit adjoins. Specifically, the position of the pointing input mechanism can be determined based on the detection values detected by the touch sensor11aof the first display unit11and the touch sensor21aof the second display unit21.

The image control unit52can control the image display of the first display unit11and the second display unit21based on the determination result of the movement determination unit51and the detection result of each sensor, (e.g., the determination result of the orientation determination unit50). Specifically, in response to the movement determination unit51determining that part of the pointing input mechanism used to hold the window is moved to the predetermined region, the image control unit52moves the window by a predetermined amount to display the window across the display unit and the other display unit.

Thus, the presence of a pointing input mechanism used to hold the window can be detected/determined prior to the window reaching the predetermined region near the side on which display units adjoin each other. When the pointing input mechanism used to hold the window reaches the predetermined region, the window is moved between adjoining display units. Accordingly, even when part of the window does not reach the predetermined region, the window can be made to jump onto the other display unit by monitoring the position of the pointing input mechanism.

As described above, specific embodiments are described, but the technical scope of the various embodiments is not limited to those described. Various changes and/or improvements can be added to each of the aforementioned embodiments without departing from the spirit and/or scope of the various embodiments, and forms to which the changes or improvements are added shall also be included in the technical scope of the various embodiments. Further, the aforementioned embodiments may also be combined.

In the aforementioned embodiments, the coupling parts that couple a pair of chassis are described as the hinges30, but the various embodiments are not limited to hinges. Any other coupling mechanism and/or device can be adopted provided the coupling mechanism can rotatably couple the pair of chassis.

Further, in the aforementioned embodiments, the information processing device includes two chassis, but the various embodiments are not limited thereto. Other embodiments may include three or more chassis arranged on an information processing device.

In addition, the flow of image display control processing described in each of the aforementioned embodiments is just an example, and it is possible to delete an unnecessary block, add a new block, or replace the processing order without departing from the spirit and/or scope of the various embodiments.