Display apparatus and non-transitory computer readable medium

A display apparatus includes an image display that displays a display screen that is transformable in shape at an arbitrary location, a detecting unit that detects an overlap region where one region of the display screen, when transformed, overlaps another region of the display screen, and an executing unit that performs a predetermined process if the detecting unit has detected the overlap region between the one region and the other region of the display screen.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is based on and claims priority under 35 USC 119 from Japanese Patent Application No. 2016-217502 filed Nov. 7, 2016.

BACKGROUND

(i) Technical Field

The present invention relates to a display apparatus and a non-transitory computer readable medium.

(ii) Related Art

An image display screen that is transformable in shape at an arbitrary location may be presented in an image display unit of a display that displays an image. Even if the display screen is transformed, a predetermined process may not be performed on the display, and transformation of the display screen has not been utilized.

SUMMARY

According to an aspect of the invention, there is provided a display apparatus. The display apparatus includes an image display that displays a display screen that is transformable in shape at an arbitrary location, a detecting unit that detects an overlap region where one region of the display screen, when transformed, overlaps another region of the display screen, and an executing unit that performs a predetermined process if the detecting unit has detected the overlap region between the one region and the other region of the display screen.

DETAILED DESCRIPTION

An exemplary embodiment of the present invention is described in detail with reference to the attached drawings.

FIG. 1generally illustrates a terminal apparatus1of the exemplary embodiment.FIG. 2AthroughFIG. 2DandFIG. 3AthroughFIG. 3Dillustrate forms into which the terminal apparatus1is transformed in shape.

Referring toFIG. 1, the terminal apparatus1as an example of a display apparatus includes an image display2that displays an image, and a controller3that generally controls the terminal apparatus1.

In accordance with the exemplary embodiment, the longitudinal direction of the terminal apparatus1ofFIG. 1represents a vertical direction V, and the direction perpendicular to the longitudinal direction of the terminal apparatus1represents a horizontal direction H.

The image display2includes a display screen21that displays an image and operation units22that acts on the display screen21.

The display screen21functions as a touchpanel. An organic electroluminescent (EL) display may work as the display screen21.

The display screen21of the exemplary embodiment is bendable and foldable.

Referring toFIG. 2AthroughFIG. 2C, the display screen21may be bent into half along a border line L1serving as a fold line extending in the horizontal direction H at an arbitrary location perpendicular to the vertical direction V of the display screen21(vertically bent along a horizontal fold line). In accordance with the exemplary embodiment, the display screen21may be bent along the border line L1serving as a horizontal fold line at an arbitrary location perpendicular to the vertical direction V of the display screen21. The display screen21that is bent along the horizontal fold line may be folded as illustrated inFIG. 2D.

Referring toFIG. 3AthroughFIG. 3C, the display screen21may be bent into half along a border line L2extending in the vertical direction V (horizontally bent along a vertical fold line) at an arbitrary location perpendicular the horizontal direction H of the display screen21. In the same way as the vertical folding, the display screen21may be bent along the border line L2serving as a vertical fold line at any location perpendicular to the horizontal direction H of the display screen21. The display screen21that is bent along the vertical fold line may be folded as illustrated inFIG. 3D.

The operation unit22ofFIG. 1is manufactured of an electrically conductive resin. Four operation units22are respectively arranged at four locations. More specifically, each operation unit22is arranged at each of the four corners of the display screen21.

Each operation unit22is slightly projected from the display screen21. When the display screen21is folded, the operation unit22contacts part of the display screen21. Specific structure and location of the operation unit22are described in detail below.

In accordance with the exemplary embodiment, when the display screen21is folded, the operation unit22is pressed into contact with part of the display screen21, and the location where the operation unit22pressed into contact with the display screen21is detected. When the display screen21is folded, part or whole of the region of the display screen21overlaps each other (seeFIG. 2DandFIG. 3D). In accordance with the exemplary embodiment, an overlap region of the display screen21is calculated in accordance with the location where the operation unit22is pressed into contact with the display screen21.

In accordance with the exemplary embodiment, if one region of the display screen21overlapping another region of the display screen21is detected, the terminal apparatus1performs a predetermined process. More specifically, the terminal apparatus1performs the predetermined process (hereinafter referred to as a process-at-folding) when the display screen21is folded. The specific contents of the process-at-folding are described in detail below.

FIG. 4is a functional block diagram illustrating the controller3that performs the process-at-folding.

The controller3includes a detecting unit31that detects a location where the operation unit22is pressed into contact with the display screen21, and a region calculating unit32that calculates a region where the display screen21overlaps each other. The controller3further includes a display information calculating unit33that acquires information related to an image displayed on the overlap region of the display screen21, a instruction unit34that indicates contents of the process-at-folding, and a drawing unit35that controls an image displayed on the display screen21. The controller3further includes a power source controller36that controls the power source of the terminal apparatus1, and a process execution unit37that performs a variety of operations in the process-at-folding.

The detecting unit31detects the location where the operation unit22is pressed into contact with the display screen21in accordance with a location where a voltage or an electrostatic capacitance of the display screen21changes when the operation unit22is pressed in contact with the display screen21.

The region calculating unit32calculates the region where portions of the display screen21overlap each other (hereinafter referred to as an overlap region) in accordance with the location where the operation unit22is pressed in contact with the display screen21.

The display information calculating unit33acquires information related to an image displayed on each of the overlap regions of the display screen21. The acquired information includes information related to a displayed image and displayed data (a document file, for example), and information related to displayed application software. The acquired information is transmitted together with identification information of each region to the instruction unit34.

In accordance with the exemplary embodiment, if an icon representing a storage unit that stores data is displayed on the display screen21, the data stored on the storage unit is acquired as information displayed on the display screen21.

The instruction unit34determines contents of the process-at-folding to be performed, in accordance with the size of each overlap region and contents of information displayed on each overlap region of the display screen21. The instruction unit34transmits an instruction for the process-at-folding to each of the drawing unit35, the power source controller36, and the process execution unit37.

The drawing unit35causes an image to be displayed on a specific region of the display screen21in response to the instruction from the instruction unit34.

The power source controller36switches on or off the terminal apparatus1in response to the instruction from the instruction unit34.

The process execution unit37moves data, outputs a print command of an image, or processes data using the application software in response to the instruction from the instruction unit34.

The contents of the processes to be performed by the drawing unit35, the power source controller36, and the process execution unit37are described in detail below. Each of the instruction unit34, the drawing unit35, the power source controller36, and the process execution unit37are an example of an executing unit.

The operation unit22is described in detail below.

FIG. 5illustrates a positional relationship of four operation units22in the terminal apparatus1. In the discussion that follows, the four operation units22are respectively identified as a first operation unit22a, a second operation unit22b, a third operation unit22c, and a fourth operation unit22d.

The operation unit22has a circular shape and the surface area thereof is R.

The first operation unit22aand the second operation unit22bare arranged in a side portion along the side perpendicular to the vertical direction V of the display screen21(on the right short side of the display screen21inFIG. 5). The first operation unit22aand the second operation unit22bare not positionally aligned in terms of the vertical direction V. More specifically, the second operation unit22bis arranged to be more outside in the vertical direction V of the display screen21than the first operation unit22a.

The first operation unit22aand the third operation unit22care arranged in a side portion along the side perpendicular to the horizontal direction H of the display screen21(on the left long side of the display screen21inFIG. 5). The first operation unit22aand the third operation unit22care not positionally aligned in terms of the horizontal direction H. More specifically, the first operation unit22ais arranged to be more outside in the horizontal direction H of the display screen21than the third operation unit22c.

The second operation unit22band the fourth operation unit22dare arranged in a side portion along the side perpendicular to the horizontal direction H of the display screen21(on the right long side of the display screen21inFIG. 5). The second operation unit22band the fourth operation unit22dare not positionally aligned in terms of the horizontal direction H. More specifically, the fourth operation unit22dis arranged to be more outside in the horizontal direction H of the display screen21than the second operation unit22b.

The third operation unit22cand the fourth operation unit22dare arranged in a side portion along the side perpendicular to the vertical direction V of the display screen21(on the left short side of the display screen21inFIG. 5). The third operation unit22cand the fourth operation unit22dare not positionally aligned in terms of the vertical direction V. More specifically, the third operation unit22cis arranged to be more outside in the vertical direction V of the display screen21than the fourth operation unit22d.

Each of the distance between the first operation unit22aand the second operation unit22band the distance between the third operation unit22cand the fourth operation unit22dis a distance X. Each of the distance between the first operation unit22aand the third operation unit22cand the distance between the second operation unit22band the fourth operation unit22dis a distance Y. The distances X and Y has a relationship of the distance X<the distance Y.

A detection process of the overlap region of the display screen21is described below.

FIG. 6AandFIG. 6Billustrate regions that are to be detected as an overlap region of the display screen21when the display screen21is vertically folded.

Referring toFIG. 6A, if the display screen21is folded along the border line L1serving a fold line that is more rightward than a center line21M of the display screen21perpendicular to the vertical direction V thereof, the first operation unit22aand the second operation unit22bare pressed into contact with the display screen21. The detecting unit31detects a first press-contact location21ewhere the first operation unit22ais pressed into contact with the display screen21and a second press-contact location21fwhere the second operation unit22bis pressed into contact with the display screen21. The third operation unit22cand the fourth operation unit22dremain out of contact with the display screen21.

The detecting unit31determines whether any of the four operation units22is pressed into contact with the display screen21. If the display screen21is vertically folded such that the third operation unit22cand the fourth operation unit22dare pressed into contact with the display screen21, a third press-contact location21gof the third operation unit22cis shifted rightward in the horizontal direction H from the first press-contact location21eof the first operation unit22a. A fourth press-contact location21hof the fourth operation unit22dis shifted rightward in the horizontal direction H from the second press-contact location21fof the second operation unit22b.

Based on the press-contact location of the operation unit22, the detecting unit31thus determines which of the operation units22is pressed into contact with the display screen21. In the example ofFIG. 6A, based on the first press-contact location21eand the second press-contact location21fas the press-contact locations, the detecting unit31determines the first operation unit22aand the second operation unit22bof the operation units22are pressed into contact with the display screen21.

The region calculating unit32calculates the overlap region of the display screen21. More specifically, the region calculating unit32calculates, as the location of the border line L1, an intermediate location between the first operation unit22aand the first press-contact location21eand an intermediate location between the second operation unit22band the second press-contact location21f.

The region calculating unit32calculates as an overlap region21aexpanding on the display screen21from the border line L1to the edge of the side portion including the first operation unit22aand the second operation unit22b. The region calculating unit32calculates as an overlap region21ba region expanding on the display screen21from the border line L1and facing the overlap region21a. The overlap region21aequals the overlap region21bin area. The region calculating unit32also detects a non-overlap region21cof the display screen21in accordance with the overlap region21aand the overlap region21b.

If the display screen21is folded along the border line L1as a fold line in a center line21M perpendicular to the vertical direction V of the display screen21as illustrated inFIG. 6B, the first operation unit22a, the second operation unit22b, the third operation unit22c, and the fourth operation unit22dare pressed into contact with the display screen21. The detecting unit31then detects the first press-contact location21e, the second press-contact location21f, the third press-contact location21g, and the fourth press-contact location21h.

The region calculating unit32calculates the location of the border line L1in accordance with the first press-contact location21e, the second press-contact location21f, the third press-contact location21g, and the fourth press-contact location21h. The region calculating unit32calculates as the overlap region21athe region of the display screen21expanding from the border line L1to the edge of the side portion including the first operation unit22aand the second operation unit22b. The region calculating unit32calculates as the overlap region21bthe region of the display screen21expanding from the border line L1and facing the overlap region21a. Referring toFIG. 6B, there is no non-overlap portion in the display screen21.

In the examples ofFIG. 6AandFIG. 6B, the display screen21is vertically folded along the border line L1serving as a fold line in parallel with the horizontal direction H. More specifically, when the display screen21is vertically folded, one end of the fold line is not shifted from the other end of the fold line of the display screen21in the horizontal direction H. Based on the press-contact location of the operation unit22, the detecting unit31identifies which of the operation units22is pressed into contact with the display screen21.

The display screen21may be folded along a border line as a fold line that extending in a slant angle with reference to the horizontal direction H. More specifically, when the display screen21is folded, one end and the other end of the fold line may not be aligned in the horizontal direction H. When the terminal apparatus1that is folded in this way is used, the terminal apparatus1may have a distance X1between the first operation unit22aand the second operation unit22band a distance X2between the third operation unit22cand the fourth operation unit22d. The distance X1and the distance X2may have a relationship of X1≠X2.

When the display screen21is vertically folded in this manner, the detecting unit31may identify which of the operation units22is pressed into contact with the display screen21, in accordance with the distance between the press-contact locations.

In the examples ofFIG. 6AandFIG. 6B, the overlap region that occurs when the display screen21is folded is described. Even if the display screen21is horizontally folded, the detecting unit31may detect the overlap region in a similar way.

The detection process when the display screen21is folded is described below.

FIG. 7is a flowchart illustrating the detection process performed when the display screen21is folded.

When the display screen21is folded, the detecting unit31detects a portion that is in contact with the display screen21(step S101).

The detecting unit31determines whether the locations that are pressed into contact with the display screen21are 2 to 4 (step S102). If the locations that are pressed into contact with the display screen21is 1 or 5 or more (no branch from step S102), a user may directly press the display screen21rather than via the operation unit22. In such a case, the detecting unit31does not determine that the operation unit22is pressed into contact with the display screen21.

If the number of locations that are pressed into contact with the display screen21are 2 to 4 (yes branch from step S102), the detecting unit31determines whether the area of the press-contact region with the display screen21is equal to or below an area R (step S103). If there is a press-contact region larger than the area R (no branch in step S103), something other than the operation unit22(the user's finger, for example) may be pressed into contact with the display screen21. In this case, as well, the detecting unit31does not determine that the operation unit22is pressed into contact with the display screen21.

If the area of the press-contact portion of the display screen21is smaller than the area R (yes branch from step S103), processing proceeds to step S104. More specifically, the detecting unit31determines whether there is any spacing between the press-contact locations with the display screen21shorter than the distance X (step S104). If there is a spacing shorter than the distance X (yes branch from S104), something other than the operation unit22may be likely to be pressed into contact with the display screen21. In such a case, as well, the detecting unit31does not determine that the operation unit22is pressed into contact with the display screen21.

If there is no spacing shorter than the distance X (no branch from S104), the detecting unit31determines that the operation unit22is pressed into contact with the display screen21.

The region calculating unit32then calculates the overlap region of the display screen21. The region calculating unit32then performs the process-at-folding (step S105).

The process-at-folding is described below.

In the process-at-folding of the exemplary embodiment, each of an operation related to the image displaying on the display screen21, an operation related to the power source of the terminal apparatus1, an operation to move data, and an operation to run the application software is ready to be performed. The four operations may be performed concurrently or with one operation at a time.

FIG. 8AandFIG. 8Billustrate the operation that is related to the image displaying on the display screen21in the process-at-folding. In the examples ofFIG. 8AandFIG. 8B, the operation related to the image displaying includes displaying an image on a non-overlap region of the display screen21. On the other hand, the drawing unit35does not display any image on the overlap region of the display screen21.

As illustrated inFIG. 8A, the display screen21is folded along the border line L1as a fold line located more rightward than the center line21M perpendicular to the vertical direction V of the display screen21. The detecting unit31then detects the first press-contact location21eand the second press-contact location21f.

The region calculating unit32calculates the overlap region21aand the overlap region21bof the display screen21while also calculating the non-overlap region21cof the display screen21. The region calculating unit32then sends information related to the calculated regions to the instruction unit34.

In response to the information acquired from the region calculating unit32, the instruction unit34indicates to the drawing unit35the region of the display screen21where an image is to be displayed.

The drawing unit35displays an image G1on the non-overlap region21cof the display screen21. On the other hand, the drawing unit35does not display any image on the overlap region21aand the overlap region21bof the display screen21.

Referring toFIG. 8B, the display screen21is folded along the border line L1as a fold line aligned with the center line21M extending perpendicular to the vertical direction V of the display screen21. The detecting unit31then detects the first press-contact location21e, the second press-contact location21f, the third press-contact location21g, and the fourth press-contact location21h.

The region calculating unit32calculates the overlap region21aand the overlap region21bof the display screen21. As a result of the calculation, the region calculating unit32identifies that the display screen21does not have any non-overlap region. The region calculating unit32sends information related to the calculated regions to the instruction unit34.

In response to the information acquired from the region calculating unit32, the instruction unit34instructs the drawing unit35to display no image on the whole region of the display screen21.

As a result, the drawing unit35does not display any image on the whole region of the display screen21.

In accordance with the exemplary embodiment, in the process-at-folding, an image is displayed on the non-overlap region of the display screen21while no image is displayed on the overlap regions of the display screen21. In other words, when the operation unit22acts on the display screen21, the drawing unit35may or may not perform a display operation to display an image. More specifically, no image is displayed on the overlap regions of the surface of the display screen21. In this way, the power consumption of the terminal apparatus1is reduced.

When the display screen21is folded, the user is unable to view the overlap regions of the display screen21. If an image is displayed on the overlap region, the terminal apparatus1may consume more power.

In accordance with the exemplary embodiment in contrast, if no image is displayed on the overlap region of the display screen21, power consumed to display the image on the overlap region is reduced.

The process-at-folding discussed with reference toFIG. 8AandFIG. 8Bmay be understood as the operation to move image data displayed on the overlap region21aand the overlap region21b.

FIG. 9illustrates an operation that is related to image displaying on the display screen21in the process-at-folding. In the example ofFIG. 9, in the operation related to the image displaying, the whole region of the display screen21does not display any image when one end portion of the display screen21overlaps on the other end portion of the display screen21.

Referring toFIG. 9, the display screen21is folded along the border line L2as a fold line slightly more leftward than a center line21N of the display screen21perpendicular to the horizontal direction H. The detecting unit31then detects the first press-contact location21e, the second press-contact location21f, the third press-contact location21g, and the fourth press-contact location21h.

The region calculating unit32calculates the overlap region21aand the overlap region21bof the display screen21while also calculating the non-overlap region21cof the display screen21. The region calculating unit32then sends information related to the calculated regions to the instruction unit34.

In response to the information acquired from the region calculating unit32, the instruction unit34instructs the drawing unit35to display no image on the whole region of the display screen21.

As a result, the drawing unit35does not display any image on the whole region of the display screen21.

In accordance with the exemplary embodiment, if the detecting unit31detects all the operation units22(the first operation unit22a, the second operation unit22b, the third operation unit22c, and the fourth operation unit22d) that are in contact with the display screen21, no image is displayed on the whole region of the display screen21. In other words, if one end portion overlapping the other end portion of the display screen21is detected, no image is displayed on the whole region of the display screen21.

This arrangement restricts the displaying of an image on the display screen21the user has difficulty in viewing.

If there is a non-overlap region present on the display screen21with all the operation units22pressed into contact with the display screen21, the area of that non-overlap region is small. If an image is displayed on that non-overlap region, the user may have difficulty in viewing the image. If an image is displayed on that non-overlap region, the power consumption of the terminal apparatus1may increase.

In accordance with the exemplary embodiment, if all the operation units22are pressed into contact with the operation unit22, no image is displayed on the display screen21. This arrangement thus restricts the displaying of an image on the display screen21the user has difficulty in viewing. The terminal apparatus1thus consumes less power.

In accordance with the exemplary embodiment, no image is displayed on the whole region of the display screen21when the one region of the display screen21overlaps the other region as illustrated inFIG. 8Bor when all the operation units22are pressed into contact with the display screen21as illustrated inFIG. 9. In such a case, the power source controller36may switch off the terminal apparatus1. In this way, the power-off of the terminal apparatus1is triggered if the terminal apparatus1is not viewed by the user.

FIG. 10AandFIG. 10Billustrate an operation that is related to image displaying on the display screen21in the process-at-folding. In the examples ofFIG. 10AandFIG. 10B, when the display screen21is folded, the operation related to the image displaying switches between an image displayed on one region of the display screen21and an image displayed on the other region of the display screen21. More specifically, a first overlap region of the display screen21having a first image displayed thereon may be folded over a second overlap region of the display screen21having a second image displayed thereon. In this case, the second image is displayed on the first overlap region of the display screen21, and the first image is displayed on the second overlap region of the display screen21.

As illustrated inFIG. 10A, an image G2is displayed on the far side in the vertical direction V of the display screen21. An image G3is displayed on the near side of the display screen21.

When the display screen21is folded, the detecting unit31detects the press-contact locations of the operation units22. The region calculating unit32then calculates the overlap region21aand the overlap region21bof the display screen21. The region calculating unit32sends information related to the calculated overlap region21aand overlap region21bto the display information calculating unit33.

The display information calculating unit33acquires information concerning the images displayed on the overlap region21aand the overlap region21bof the display screen21. More specifically, the display information calculating unit33acquires information that the image G2is displayed on the overlap region21a. The display information calculating unit33also acquires information that the image G3is displayed on the overlap region21b. The display information calculating unit33sends to the instruction unit34the acquired information together with identification information of the overlap region21aand the overlap region21b.

In response to the information acquired from the display information calculating unit33, the instruction unit34instructs the drawing unit35to display the images on the overlap region21aand the overlap region21b.

In response to the instruction from the instruction unit34, the drawing unit35displays the image G3on the overlap region21aas illustrated inFIG. 10B. The drawing unit35also displays the image G2on the overlap region21b.

In accordance with the exemplary embodiment, before the display screen21is folded, the process-at-folding switches between the image displayed on the overlap region21aand the image displayed on the overlap region21b. In this way, the switching between the image G2and the image G3is performed by a user's intuitive operation (an operation to cause the region of the display screen21having the image G2displayed thereon to be in contact with the region having the image G3displayed thereon).

In the examples ofFIG. 10AandFIG. 10B, the process-at-folding may be to print the image G2displayed on the overlap region21aof the display screen21and the image G3displayed on the overlap region21b. In this case, in response to the information acquired from the display information calculating unit33, the instruction unit34instructs the process execution unit37to print the image G2displayed on the overlap region21aand the image G3displayed on the overlap region21b.

In response to the instruction from the instruction unit34, the process execution unit37outputs a print command to an image forming apparatus (not illustrated) connected to the terminal apparatus1via a network. In this way, printing is performed by running the application software related to the image forming. The image displayed on the overlap region21aand the image displayed on the overlap region21bmay be printed page by page, or collectively on a single page.

This arrangement frees the user from the operation to print the two images.

FIG. 11AandFIG. 11Billustrate an operation related to the movement of data in the process-at-folding. In the examples ofFIG. 11AandFIG. 11B, the operation related to the movement of data switches storage units storing data. More specifically, if a first overlap region of the display screen21that displays a first storage unit overlaps a second overlap region of the display screen21that displays a second storage unit, the data stored on the second storage unit is stored onto the first storage unit.

Referring toFIG. 11A, an icon G4representing a storage unit storing data (such as a document file) is displayed on a far side of the display screen21in the vertical direction V. The storage unit represented by the icon G4stores the document file.

On the other side, an icon G5representing a storage unit is displayed on a near side of the display screen21in the vertical direction V. The storage unit represented by the icon G5stores no data.

When the display screen21is folded, the detecting unit31detects the press-contact locations of the operation units22, and the region calculating unit32then calculates the overlap region21aand the overlap region21bof the display screen21. The region calculating unit32then sends information concerning the calculated overlap region21aand overlap region21bto the display information calculating unit33.

The display information calculating unit33acquires information related to an image displayed on each of the overlap region21aand the overlap region21bof the display screen21. More specifically, the display information calculating unit33acquires information that the icon G4is displayed on the overlap region21a. The display information calculating unit33also acquires information that the storage unit represented by the icon G4stores the document file. The display information calculating unit33further acquires information that the icon G5is displayed on the overlap region21b. The display information calculating unit33sends to the instruction unit34the acquired information together with the identification information of the overlap region21aand the overlap region21b.

The instruction unit34instructs the process execution unit37to switch between the storage units as targets storing the document files in response to the information acquired from the display information calculating unit33.

In response to the instruction from the instruction unit34, the process execution unit37moves the document file to the storage unit represented by the icon G5as illustrated inFIG. 11B. As a result, the storage unit represented by the icon G4stores no longer that file.

In accordance with the exemplary embodiment, the process-at-folding exchanges targets storing data (hereinafter referred to as target storage units), namely, switches between the storage unit displayed on the overlap region21aand the storage unit displayed on the overlap region21b. This arrangement reduces the number of operations the user performs to exchange the target storage units.

In order to exchange the target storage units, the user displays data (the icon representing the data) by opening the storage unit that stores the data, and then by exchanging the target storage units storing the data.

In accordance with the exemplary embodiment, the target storage units are exchanged by folding the display screen21, and this helps the user skip an operation to open the storage unit that stores the data. The number of operations to be performed by the user to exchange the target storage units is thus reduced.

In the process-at-folding described with reference toFIG. 11AandFIG. 11B, the one storage unit displayed on the display screen21stores the data but the other storage unit does not store any data. If the two storage units store different data, the process-at-folding may cause the data on the one storage unit to be stored onto the other storage unit. In this case, the user specifies the target storage unit for the data in advance in the process-at-folding. Through the process-at-folding, the data stored on the one storage unit is stored onto the other storage unit specified by the user.

In the process-at-folding, a document file may be stored on the storage unit represented by the icon G5and also a document file may be stored on the storage unit specified by the icon G4. Even if the storage unit represented by the icon G4and/or the storage unit represented by the icon G5is opened when the display screen21is folded, the document file may be moved. Even if the document file is opened when the display screen21is folded, the document file may be moved.

FIG. 12AandFIG. 12Billustrate an operation related to the movement of data in the process-at-folding. In the operation related to the movement data illustrated inFIG. 12AandFIG. 12B, data displayed on one overlap region of the display screen21is stored onto a storage unit displayed on the other overlap region. More specifically, if a first overlap region of the display screen21having the storage unit displayed thereon and storing the data is overlapped on a second overlap region of the display screen21having the data displayed thereon, the data displayed on the second overlap region is stored onto the storage unit.

Referring toFIG. 12A, an icon G6representing a document file is displayed on a far side of the display screen21. An icon G7representing a storage unit is displayed on a near side of the display screen21.

When the display screen21is vertically folded, the detecting unit31detects the press-contact locations of the operation units22, and the region calculating unit32then calculates the overlap region21aand the overlap region21bof the display screen21. The region calculating unit32sends to the display information calculating unit33information concerning the calculated overlap region21aand overlap region21b.

The display information calculating unit33acquires information concerning an image displayed on each of the overlap region21aand the overlap region21bof the display screen21. More specifically, the display information calculating unit33acquires information that the icon G6is displayed on the overlap region21a. The display information calculating unit33also acquires information that the icon G7is displayed on the overlap region21b. The display information calculating unit33sends to the instruction unit34the acquired information together the identification information of the overlap region21aand the overlap region21b.

The instruction unit34instructs the process execution unit37to store the document file onto the storage unit in response to the information acquired from the display information calculating unit33.

The process execution unit37moves the document file to the storage unit represented by the icon G7in response to the instruction from the instruction unit34as illustrated inFIG. 12B. As a result, the icon G6is no longer displayed on the overlap region21a.

In accordance with the exemplary embodiment, in the process-at-folding, the data stored on the one overlap region is stored onto the other overlap region. In this way, the data is stored onto the storage unit in response to the user's intuitive operation (the operation to cause the region of the display screen21where the data is displayed to be in contact with the region where the storage unit is displayed).

When the display screen21is folded, the document file may be stored onto the storage unit even if the document is open on the overlap region21awith the icon G6not displayed.

FIG. 13AandFIG. 13Billustrate an operation to run application software in the process-at-folding. In the examples ofFIG. 13AandFIG. 13B, the operation to run the application software includes processing data displayed on the one region, using the application software displayed on the other region of the display screen21. More specifically, if a first overlap region of the display screen21having data displayed thereon is overlapped on a second overlap region having a display concerning the application software, the data displayed on the first overlap region is processed using the application software.

Referring toFIG. 13A, an image G8of an open file is displayed on a far side of the display screen21in the vertical direction V. More specifically, the image G8of an English sentence reading “I'm a human” is displayed. An image G9in which the application software that translates English is open is displayed on a near side of the display screen21. More specifically, the image G9indicating the translation enabled state of the application software is displayed.

When the display screen21is folded, the detecting unit31detects the press-contact locations of the operation units22, and then the region calculating unit32calculates the overlapping region21aand the overlapping region21bof the display screen21. The region calculating unit32transmits information concerning the calculated overlapping region21aand overlapping region21bto the display information calculating unit33.

The display information calculating unit33acquires information related to an image displayed on each of the overlap region21aand the overlap region21bof the display screen21. More specifically, the display information calculating unit33acquires information that the image G8of the open document file is displayed on the overlap region21a. The display information calculating unit33further acquires information that the image G9of the open application software is displayed on the overlap region21b. The display information calculating unit33transmits to the instruction unit34the acquired information together with the identification information of the overlap region21aand the overlap region21b.

In response to the information acquired from the display information calculating unit33, the instruction unit34instructs the process execution unit37to process the document file using the application software.

In response to the instruction from the instruction unit34, the process execution unit37translates the English document included in the document file using the application software. As a result, the image G10of a translated document is displayed on the overlap region21bas illustrated inFIG. 13B. More specifically, the image G10on the overlap region21bindicates that the English sentence “I am a human” in Japanese is “”.

In accordance with the exemplary embodiment, using the application software displayed on the one region of the display screen21, the data displayed on the other region is processed in the process-at-folding. The data is thus processed in response to the user's intuitive operation (the operation to cause the region of the display screen21where the application software is displayed to be in contact with the region where the data to be processed is displayed).

If an icon representing an open document file is displayed on the overlap region21awith the image of the open document file not displayed, an operation to translate a document included in the document file may be performed in the process-at-folding. Furthermore, if an icon representing the application software is displayed on the overlap region21bwith the application software unopened, the data may be processed using the application software.

Referring toFIG. 10AthroughFIG. 13B, the process-at-folding with the display screen21vertically folded has been described. The process-at-folding may be similarly performed even with the display screen21horizontally folded.

The process-at-folding ofFIG. 10AthroughFIG. 13Bmay be performed when no image is displayed on the overlap region with the display screen21folded.

In accordance with the exemplary embodiment, the predetermined process is performed with the surfaces of the screen overlap each other with the display screen21as the single screen folded. The display screen21may include two or more screens. For example, another screen may be formed and expand from a center line perpendicular to the vertical direction V of the display screen21between the one screen and the other screen. The display screen21may be then folded along any line perpendicular to the vertical direction V of the display screen21.

In accordance with the exemplary embodiment, the display screen21is folded. Alternatively, the display screen21may be curved rather than folded. In such a case, as well, the process-at-folding may be performed if a press-contact of the operation unit22with the display screen21is detected.

In accordance with the exemplary embodiment, the four operation units22are arranged on the display screen21. Alternatively, five or more operation units22may be arranged on the display screen21.

Thee more operation units22may be arranged in an edge portion of the display screen21in addition to the four operation units22respectively arranged at the four corners of the display screen21. The edge portion of the display screen21may overlap part of the display screen21, and the three operation units22arranged in the edge portion are pressed into contact with the part of the region of the display screen21. When the press-contact of the three operation units22is detected, the process-at-folding is performed. As a result, this arrangement may control a detection error that the display screen21is erroneously determined to be folded when the user touches the display screen21with two fingers.

As illustrated inFIG. 7, in accordance with the exemplary embodiment, one of the conditions that are to be satisfied to perform the process-at-folding is that two or more locations are pressed into contact with the display screen21. Even if the number of locations that are pressed into contact with the display screen21is one, the process-at-folding may be performed.

In such a case, the surface areas of the first operation unit22a, the second operation unit22b, the third operation unit22c, and the fourth operation unit22dmay be set to be different from each other.

In this arrangement, when the display screen21is folded, the detecting unit31determines which of the four operation units22is pressed into contact with the display screen21, based on the surface area of the press-contact area with the display screen21. The region calculating unit32calculates an overlap region of the display screen21, based on the press-contact location of the identified operation unit22.

In accordance with the exemplary embodiment, the process-at-folding is performed when the operation unit22is pressed into contact with the display screen21. The operation unit22may not necessarily have to be arranged on the display screen21. In such a case, for example, a photoreceptor that receives light may be mounted on the rear surface of the display screen21. With this arrangement, when the display screen21is folded, light may be emitted from one region of the display screen21, and the photoreceptor mounted on the other overlap region receives light. If an amount of light received by the photoreceptor is equal to or above a predetermined magnitude, the folding of the display screen21is detected, and then the process-at-folding is performed.

FIG. 14illustrates a hardware configuration of the terminal apparatus1. The terminal apparatus1includes a central processing unit (CPU)91, a memory92, and a hard disk drive (HDD)93. The CPU91executes a variety of programs including an operating system (OS), and application software. The memory92stores the variety of programs and data that is used to perform the programs. The HDD93stores data input to the programs or data output from the programs. The terminal apparatus1further includes a communication interface94for communication with the outside.

The process performed by the terminal apparatus1of the exemplary embodiment may be prepared as a program of application software.

The program implementing the exemplary embodiment may be supplied in a recorded state on a recording medium, such as a compact disk read-only memory (CD-ROM).