Patent Description:
<CIT> describes a configuration in which based on operation information on a thumbnail image of a user on a screen in which an image based on document data and the thumbnail image are displayed, a display magnification in a case of enlarging and displaying the image is determined, and a menu is provided at an upper portion of the enlarged and displayed image according to the determined display magnification. <CIT> discloses an electronic device and a display method. When a pointer is pointed onto an icon of a file, a tool chip including file information, such as an update date and a size of an object file, and a preview representing contents of the object file is displayed.

In an aspect, in a case where an instruction image of a document on the screen is selected, a document image related to the selected document is displayed. In this aspect, a menu image for accepting an operation or editing on the document is fixedly displayed on, for example, one side or the like of an upper portion of an area of the document image. Meanwhile, in a case where a display position of the instruction image of the document is within a lower portion of the screen, a distance from the instruction image of the document in this lower portion area to the menu image in the upper portion area becomes longer, and operability of the user is reduced.

An object of the present invention is to improve operability of a user as compared with a case where a display position of an instruction image of a document displayed on a screen is not considered in a case of displaying a menu image for accepting an operation or editing of the document.

The present invention is provided in the appended claims. The following disclosure serves a better understanding of the present invention. According to a first aspect of the present disclosure, there is provided an information processing apparatus including: a processor configured to: display an instruction image for accepting an instruction of a user on a document on an operation screen for accepting an operation by the user; display a document image related to the document according to the instruction of the user on the instruction image; and display a menu image for accepting the operation of the user on the document image at a position determined by a display position of the instruction image on the operation screen.

According to a second aspect of the present disclosure, in the information processing apparatus according to the first aspect, the processor may be configured to: in a case where a cursor is located over the instruction image, start displaying the document image.

According to a third aspect of the present disclosure, in the information processing apparatus according to the first or second aspect, the processor may be configured to: display the menu image in an area for displaying the document image.

According to a fourth aspect of the present disclosure, in the information processing apparatus according to the third aspect, the processor may be configured to: display the document image at a center portion in the area for displaying the document image, and display the menu image in an end area of the area for displaying the document image.

According to a fifth aspect of the present disclosure, in the information processing apparatus according to the third aspect, the processor may be configured to: in a case where the display position of the instruction image is located above the area for displaying the document image, display the menu image on an upper side in the area for displaying the document image; and in a case where the display position of the instruction image is below the area for displaying the document image, display the menu image on a lower side in the area the document image is displayed.

According to a sixth aspect of the present disclosure, in the information processing apparatus according to the third aspect, the processor may be configured to: in a case where the display position of the instruction image is on the left of the area for displaying the document image, display the menu image on a left side in the area for displaying the document image; and in a case where the display position of the instruction image is on the right of the area for displaying the document image, display the menu image on a right side in the area the document image is displayed.

According to a seventh aspect of the present disclosure, in the information processing apparatus according to any one of the third to sixth aspects, the processor may be configured to: display the menu image at a position close to the instruction image.

According to an eighth aspect of the present disclosure, in the information processing apparatus according to the first or second aspect, the processor may be configured to: change the display of the menu image based on a position of a cursor operated by the user.

According to a ninth aspect of the present disclosure, in the information processing apparatus according to the eighth aspect, the processor may be configured to: display the menu image in the area for displaying the document image; and in a case where the position of the cursor is not in the area for displaying the document image, not display the menu image.

According to a tenth aspect of the present disclosure, in the information processing apparatus according to the eighth aspect, the processor may be configured to: display the menu image in the area for displaying the document image; and change a transparency of the menu image based on whether or not the position of the cursor is over the menu image.

According to an eleventh aspect of the present disclosure, in the information processing apparatus according to the tenth aspect, the processor may be configured to: in a case where the position of the cursor is not over the menu image, transparently display the menu image.

According to a twelfth aspect of the present disclosure, in the information processing apparatus according to the tenth aspect, the processor may be configured to: in a case where the position of the cursor is over the menu image, display the menu image by lowering a transparency than the transparency of the menu image in a case where the position of the cursor is not over the menu image.

According to a thirteenth aspect of the present disclosure, in the information processing apparatus according to the first or second aspect, the processor may be configured to: change the display of the menu image based on a size of the operation screen.

According to a fourteenth aspect of the present disclosure, in the information processing apparatus according to the thirteenth aspect, the processor may be configured to: in a case where the operation screen is smaller than a predetermined value, change a shape of the menu image and display the menu image.

According to a fifteenth aspect of the present disclosure, in the information processing apparatus according to the thirteenth aspect, the processor may be configured to: in a case where the operation screen is smaller than a predetermined value and a partial area of the menu image is displayed, shift the area to be displayed of the menu image.

According to a sixteenth aspect of the present disclosure, in the information processing apparatus according to the first or second aspect, the processor may be configured to: in a case where the document has a plurality of pages, not change the display position of the menu image even in a case where the page to be displayed in the document image is changed.

According to a seventeenth aspect of the present disclosure, in the information processing apparatus according to the sixteenth aspect, the processor may be configured to: display a change button image that is an image to be displayed in an area of the menu image and accepts an operation of changing the page to be displayed in the document image from the user.

According to an eighteenth aspect of the present disclosure, there is provided a program causing a computer to realize: a function of displaying an instruction image for accepting an instruction of a user on a document on an operation screen for accepting an operation by the user; a function of displaying a document image related to the document according to the instruction of the user on the instruction image; and a function of displaying a menu image for accepting the operation of the user on the document image at a position determined by a display position of the instruction image on the operation screen.

According to a nineteenth aspect of the present disclosure, there is provided an information processing method including: displaying an instruction image for accepting an instruction of a user on a document on an operation screen for accepting an operation by the user; displaying a document image related to the document according to the instruction of the user on the instruction image; and displaying a menu image for accepting the operation of the user on the document image at a position determined by a display position of the instruction image on the operation screen.

According to the first aspect of the present disclosure, the eighteenth aspect of the present disclosure, and the nineteenth aspect of the present disclosure, it is possible to improve operability of the user, as compared with a case where the display position of the instruction image of the document displayed on the screen is not considered in a case of displaying the menu image for accepting an operation or editing of the document.

According to the second aspect of the present disclosure, it is possible to improve the operability of the user, as compared with a case where the document image is not displayed even in a case where the cursor is located over the instruction image.

According to the third aspect of the present disclosure, it is possible to reduce a space on the operation screen, as compared with a case where the menu image is displayed in an area different from the area in which the image of the document is displayed.

According to the fourth aspect of the present disclosure, it is possible to reduce an area in which the image and the menu image are superimposed.

According to the fifth aspect of the present disclosure and the sixth aspect of the present disclosure, it is possible to reduce a moving distance of the cursor.

According to the seventh aspect of the present disclosure, it is possible to reduce the moving distance of the cursor, as compared with a case where a distance from the display position of the instruction image of the document displayed on the screen is not taken into consideration in a case where displaying the menu image.

According to the eighth aspect of the present disclosure, it is possible to improve the operability of the user, as compared with a case where a uniform display mode is used without considering an intention of the user.

According to the ninth aspect of the present disclosure, it is possible to improve the operability of the user, as compared with a case where an image predicted not to be needed by the user is displayed.

According to the tenth aspect of the present disclosure, it is possible to visually recognize the menu image and the document image superimposed on the menu image.

According to the eleventh aspect of the present disclosure, it is possible to obtain information displayed in an area which is superimposed on the menu image.

According to the twelfth aspect of the present disclosure, it is possible for the user to easily operate the menu image.

According to the thirteenth aspect of the present disclosure, it is possible to improve the operability of the user, as compared with a case where the uniform display mode is used without considering a size of the operation screen.

According to the fourteenth aspect of the present disclosure, it is possible to easily secure an area for displaying the menu image, as compared with a case where the operation screen is displayed in a uniform shape even though the operation screen is small.

According to the fifteenth aspect of the present disclosure, it is possible for the user to easily operate the menu image, as compared with a case where an area in which the menu image is displayed is not shifted.

According to the sixteenth aspect of the present disclosure, it is possible to reduce a time and effort for the user to search for the menu image, as compared with a case where the display position of the menu image is changed depending on a change of the page.

According to the seventeenth aspect of the present disclosure, it is possible to improve the operability of the user in a case where the page is changed, as compared with a case where the display position of the menu image is changed depending on the change of the page.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to drawings.

<FIG> is a block diagram illustrating an example of a hardware configuration of an image display apparatus <NUM> according to the present exemplary embodiment.

As illustrated in <FIG>, the image display apparatus <NUM> according to the present exemplary embodiment functions as an example of an information processing apparatus, and includes an arithmetic processing unit <NUM> that executes a digital arithmetic process according to a predetermined processing program in a case of displaying a screen, an input unit <NUM> that accepts an input operation from a user, a secondary storage unit <NUM> that is realized by a hard disk drive (HDD), a display unit <NUM> that consists of a liquid crystal display panel, an organic electro luminescence (EL) display panel, or the like which displays an image, text information, or the like to the user, and a communication unit <NUM> which transmits and accepts data via a network.

The arithmetic processing unit <NUM> includes a central processing unit (CPU) <NUM> that controls the entire apparatus, as an example of a processor, a random access memory (RAM) <NUM> to be used as a working memory of the CPU <NUM>, a read only memory (ROM) <NUM> that stores an image display processing program or the like executed by the CPU <NUM>, a non-volatile memory <NUM> such as a static RAM (SRAM), a flash memory, or the like backed up by battery, that is rewritable and can hold data even in a case where power supply is interrupted, and an interface unit <NUM> that controls each unit such as the input unit <NUM> connected to the arithmetic processing unit <NUM>. Image information such as thumbnail images (described below) displayed on the display unit <NUM> is stored in the non-volatile memory <NUM>.

In addition to storing image data and the like, the secondary storage unit <NUM> also stores an image display processing program to be executed by the arithmetic processing unit <NUM>, and the arithmetic processing unit <NUM> reads the image display processing program to execute each process of the image display apparatus <NUM> according to the present exemplary embodiment.

Here, the program executed by the CPU <NUM>, as an example of a processor, is provided to the arithmetic processing unit <NUM> in a state of being stored in a computer-readable recording medium such as a magnetic recording medium (a magnetic tape, a magnetic disk, or the like), an optical recording medium (an optical disk, or the like), an optical magnetic recording medium, a semiconductor memory, or the like. Further, the program executed by the CPU <NUM> may be downloaded to the image display apparatus <NUM> by using a communication section such as the Internet.

The input unit <NUM> is an apparatus such as a pointing device by which the user inputs an operation.

For example, in a case where the input unit <NUM> is a mouse or the like, the user can designate a position on a screen of the display unit <NUM>, a displayed image, or the like by performing a cursor movement operation or a click operation.

Further, in a case where the input unit <NUM> is a touch panel or the like, the user can designate a position on a screen or a displayed image by performing an operation of touching the touch panel with a finger or the like or an operation of maintaining the touched state of the finger or the like for a longer time than a predetermined time. In this case, the input unit <NUM> is provided integrally with the display unit <NUM>.

In addition to the apparatus such as the pointing device described above, a keyboard or the like for performing a key input operation may be provided as the input unit <NUM>.

<FIG> is a diagram illustrating an example of an operation screen to which the present exemplary embodiment is applied.

The display unit <NUM> displays an operation screen <NUM>, which is a screen for accepting an operation by the user, as illustrated in <FIG>. In other words, the operation screen <NUM> is an area in which an instruction image and the like for accepting an instruction of the user on a document are arranged. The document may include an image in addition to a text, or may include only an image without including the text.

In addition to a document icon <NUM>, the operation screen <NUM> displays an enlargement instruction image <NUM>, an enlarged thumbnail image <NUM>, a menu image <NUM>, a toolbar <NUM>, and the like. The document icon <NUM> is an example of an instruction image for accepting an instruction of the user on the document. Further, the enlargement instruction image <NUM> is an image for giving an instruction related to display of the enlarged thumbnail image <NUM>. The enlarged thumbnail image <NUM> is a document image related to the document displayed by the instruction of the user with respect to the document icon <NUM>. The menu image <NUM> is an image for accepting an operation of the user on the document image related to the document. The toolbar <NUM> is an aggregation of instruction units prepared to simplify operations on electronic documents by the user. Examples of the operation for this electronic document include operations of saving, printing, rotating, searching for, and encrypting the electronic document, an operation of bundling two or more electronic documents, and the like.

The document icon <NUM> represents various types of functions such as a program function with pictograms, and is an instruction image for accepting an instruction of the user on the document. The document icon <NUM> may be a thumbnail image for confirming at least a part of a content of the document. This thumbnail image is simply displayed as a reduced image of the original image, for example, in a case where the corresponding file is image data. In a case where the corresponding file is document data having a plurality of pages, a representative page such as the first page is displayed as the reduced image. The document icon <NUM> displayed as a thumbnail image functions as an icon for opening the corresponding file.

In a case where a document displayed as a thumbnail image consists of a plurality of pages, an image (not illustrated) for accepting a change of the display page from the user may be displayed in a state of being associated with the document icon <NUM>.

In the present exemplary embodiment, the "page" is a set of pieces of data displayed as one surface on the operation screen <NUM> at a time.

The document icon <NUM> may be a tray used for the user to deliver an electronic document to a third party, a folder used for storing the electronic document, an electronic document, or the like represented by a pictogram.

The enlargement instruction image <NUM> is an image for accepting an operation of the user and giving an instruction related to the display of the enlarged thumbnail image <NUM>, and is displayed in a state of being associated with the document icon <NUM>. Instead of the enlargement instruction image <NUM> illustrated in <FIG>, a maintenance instruction image <NUM> (to be described below in <FIG>) corresponding to a content of the instruction may be displayed.

In the present exemplary embodiment, the enlargement instruction image <NUM> and the maintenance instruction image <NUM> are displayed so as to be superimposed on an upper right corner portion of the document icon <NUM>. In this case, it is preferable that the enlargement instruction image <NUM> and the maintenance instruction image <NUM> are displayed so as not to reduce visibility of the document icon <NUM>, for example. For example, the enlargement instruction image <NUM> is displayed to be smaller than the document icon <NUM>. Further, the enlargement instruction image <NUM> is displayed semi-transparently so that a superimposed portion on the document icon <NUM> can be seen through.

The enlarged thumbnail image <NUM> is an example of the document image related to the document and an enlarged image of a thumbnail image related to the document icon <NUM>, instructed to be enlarged by the user, and is displayed without starting a new program. Here, it is assumed that the enlarged thumbnail image <NUM> is enlarged and displayed in a size that allows the user to understand contents of the document corresponding to the document icon <NUM>. The enlarged thumbnail image <NUM> is generally displayed larger than the corresponding document icon <NUM>. Further, a resolution of the enlarged thumbnail image <NUM> may be higher than a resolution of a thumbnail image displayed as the document icon <NUM>.

The menu image <NUM> is an image for accepting an operation of the user on the document or a document image related to the document, and is displayed at a position determined by a display position of the document icon <NUM>, instructed by the user on the operation screen <NUM>. This determined position is a position that does not interfere with the display of a document image such as the enlarged thumbnail image <NUM>. The menu image <NUM> is displayed at a position close to the document icon <NUM> instructed by the user, which is an end area of an area for displaying the enlarged thumbnail image <NUM>, for example. In a case where the display position of the document icon <NUM> instructed by the user is located above the operation screen <NUM>, the upper end area of the area for displaying the enlarged thumbnail image <NUM> is closer to the display position of the document icon <NUM> instructed by the user, than a lower end area of the area. Further, in a case where the display position of the document icon <NUM> instructed by the user is on the left side of the area for displaying the enlarged thumbnail image <NUM>, an end area on the left side of the area for displaying the enlarged thumbnail image <NUM> is closer to the display position of the document icon <NUM> instructed by the user, than an end area on the right side of the area.

In addition to the number of pages of the document, the menu image <NUM> displays button images <NUM> related to various types of menus. Examples of the button image <NUM> include a change button image 431a, which is a button image for accepting a change in a display page, and an edit button image 431b, which is a button image for accepting execution of editing a document, for example. The editing of the document includes inputting a text, adding a sticky note image or a stamp image, and the like. Further, for example, there are a history button image 431c which is a button image for accepting display of an editing history of the document, and an omission button image 431d which is a button image for accepting display of a screen related to a process in which the display as various button images is omitted. In addition to these, a button for accepting other operations (not illustrated) may be displayed. An example of the other operation is transmitting the document to another user or the like.

In addition, as illustrated in <FIG>, a text <NUM> such as a name of a file or a function corresponding to the document icon <NUM> may be displayed in association with each image, on the operation screen <NUM>. Further, the text <NUM> may be displayed in association with the enlarged thumbnail image <NUM>.

Next, a functional configuration of the image display apparatus <NUM> will be described.

<FIG> is a block diagram illustrating an example of the functional configuration of the image display apparatus <NUM>. As illustrated in <FIG>, the image display apparatus <NUM> includes an operation determination unit <NUM>, a display control unit <NUM>, an instruction image output unit <NUM>, an enlarged image output unit <NUM>, a menu image output unit <NUM>, a thumbnail image generation unit <NUM>, and a thumbnail image storage unit <NUM>, which are realized by the arithmetic processing unit <NUM> (see <FIG>).

The operation determination unit <NUM> determines whether or not a user operation is performed via the input unit <NUM> on the operation screen <NUM> (see <FIG>). The user operation is, for example, an operation of designating an image, various icons, a position, or the like on the operation screen <NUM>, a scroll operation, a key input operation, or the like.

The display control unit <NUM> controls a display mode or a position of the document icon <NUM>, the enlarged thumbnail image <NUM>, the menu image <NUM>, the toolbar <NUM> (see <FIG>), and the like based on a content determined by the operation determination unit <NUM>. Further, a thumbnail image is received from the thumbnail image storage unit <NUM>, which will be described below, and controlled to be displayed as the document icon <NUM> for opening the corresponding file.

The instruction image output unit <NUM> outputs an instruction image such as the enlargement instruction image <NUM> for assisting the operation of the user to the display unit <NUM> in a case of an enlargement instruction from the user or an instruction to maintain the enlargement. This instruction image is displayed in a state of being associated with the document icon <NUM>.

The enlarged image output unit <NUM> brings out the thumbnail image from the thumbnail image storage unit <NUM>, based on determination that the enlargement instruction image <NUM> is designated, by the operation determination unit <NUM>. The enlarged image output unit <NUM> outputs the enlarged thumbnail image <NUM>, which is enlarged from a thumbnail image corresponding to the document icon <NUM> instructed by the user, to the display unit <NUM> without starting a new program.

The menu image output unit <NUM> outputs the menu image <NUM> to the display unit <NUM>, based on determination that the enlarged thumbnail image <NUM> is designated, by the operation determination unit <NUM>. The menu image <NUM> is displayed at a position determined by the display position of the document icon <NUM> instructed by the user. Preferably, in order to secure the area for displaying the enlarged thumbnail image <NUM>, the menu image <NUM> is displayed in the area for displaying the enlarged thumbnail image <NUM>, for example. More preferably, in the area for displaying the enlarged thumbnail image <NUM>, the menu image <NUM> is displayed at a position close to the document icon <NUM> instructed by the user, for example. In the area for displaying the enlarged thumbnail image <NUM>, the position close to the document icon <NUM> instructed by the user is a position is closer to the document icon <NUM> than a distance between a center of the area for displaying the enlarged thumbnail image <NUM> and the document icon <NUM>.

The thumbnail image generation unit <NUM> generates a thumbnail image to be displayed on the operation screen <NUM>, based on a file such as image data stored in the secondary storage unit <NUM>.

The thumbnail image storage unit <NUM> acquires and stores the thumbnail image generated by the thumbnail image generation unit <NUM>. The thumbnail image storage unit <NUM> is realized by the non-volatile memory <NUM>.

Next, a user operation and a display process in a case where the menu image <NUM> is displayed will be described with reference to <FIG>. Here, a case where the user uses the input unit <NUM> such as a mouse is taken as an example.

<FIG> is a flowchart illustrating a processing procedure for displaying the menu image <NUM>.

<FIG> are diagrams illustrating an example of displaying the operation screen <NUM>. <FIG> illustrates a state before the document icon 410a is designated, and <FIG> illustrates a state in which the enlarged thumbnail image 420a is displayed. <FIG> illustrates a state in which the enlarged thumbnail image 420a is designated and the menu image <NUM> is transparently displayed, and <FIG> illustrates a state in which the menu image <NUM> is designated and the menu image <NUM> is displayed.

<FIG> are diagrams illustrating an example of a display position on the operation screen <NUM>. <FIG> illustrates a state in which a display position of a document icon <NUM> is located above a display area <NUM> of the enlarged thumbnail image, and <FIG> illustrates a state in which the display position of the document icon <NUM> is below the display area <NUM> of the enlarged thumbnail image. <FIG> illustrates a state in which the display position of the document icon <NUM> is on a left side of the display area <NUM> of the enlarged thumbnail image, and <FIG> illustrates a state in which the display position of the document icon <NUM> is on a right side of the display area <NUM> of the enlarged thumbnail image.

As illustrated in <FIG>, the display unit <NUM> according to the present exemplary embodiment displays a cursor <NUM> which indicates a position on the screen, an image, or the like, on the operation screen <NUM>. The cursor <NUM> is moved by an operation of the user input via the input unit <NUM>, and is displayed so as to point to the position, the image, or the like on the screen designated by the user.

The document icons <NUM> (410a, 410b, and 410c) and the toolbar <NUM> are displayed on the operation screen <NUM>.

The enlargement instruction image 411a illustrated in <FIG> is an image for accepting an instruction of the user who displays the enlarged thumbnail image 420a.

The maintenance instruction image 412a illustrated in <FIG> is an image for accepting an instruction of the user who maintains the display of the enlarged thumbnail image 420a. In a case where the enlargement instruction image 411a is designated and the enlarged thumbnail image 420a is displayed, the maintenance instruction image 412a is displayed at a position at which the enlargement instruction image 411a is displayed, for example.

In the menu image <NUM> illustrated in <FIG>, the display of the menu image <NUM> changes depending on a position of the cursor <NUM> operated by the user.

As illustrated in <FIG>, the menu image <NUM> is displayed at a position determined by the display position of the document icon <NUM> designated by the user, on the operation screen <NUM>.

The display areas <NUM> (421a and 421b) illustrated in <FIG> are areas for displaying the enlarged thumbnail image <NUM>, and are distinguished by a direction of the document image such as the enlarged thumbnail image <NUM>. For example, in the display area 421a, the vertically long enlarged thumbnail image <NUM> having a length in an up-down direction longer than a length in a right-left direction is displayed, and in the display area 421b, the horizontally long enlarged thumbnail image <NUM> having a length in the horizontal direction longer than a length in the vertical direction is displayed. The display area <NUM> is an area of the operation screen <NUM>, and is provided in an area that is not superimposed on at least a part of the designated document icon <NUM>.

Next, the description is continued with reference to the flowchart illustrated in <FIG>.

First, the operation determination unit <NUM> illustrated in <FIG> determines whether or not any of the document icons <NUM> is designated based on an operation via the input unit <NUM> (step S501). In the present exemplary embodiment, the operation determination unit <NUM> determines the operation of moving the cursor <NUM> so as to indicate any of the document icons <NUM>, as designation of the document icon <NUM>. For example, a mouse over operation or the like of locating the cursor <NUM> over the document icon <NUM> is determined as the designation of the document icon <NUM>. In the example in <FIG>, since the cursor <NUM> is not located over any of the document icons <NUM>, it is determined that the document icon <NUM> is not designated.

In a case where the document icon <NUM> is not designated in step S501 (NO in step S501), the process waits until the document icon is designated. In a case where the document icon <NUM> is designated (YES in step S501), the instruction image output unit <NUM> outputs and displays the enlargement instruction image <NUM> (step S502). For example, in a case where a mouse over operation of locating the cursor <NUM> over the document icon 410a illustrated in <FIG> is performed, the enlargement instruction image 411a is displayed as illustrated in <FIG>.

Next, the operation determination unit <NUM> determines whether or not the enlargement instruction image <NUM> is designated based on an operation via the input unit <NUM> (step S503). The operation determination unit <NUM> according to the present exemplary embodiment determines, for example, that a mouse over operation on the enlargement instruction image <NUM> is designation on the enlargement instruction image <NUM>.

In a case where the enlargement instruction image 411a is not designated in step S503 (NO in step S503), the process waits until the enlargement instruction image 411a is designated. In a case where the enlargement instruction image <NUM> is designated (YES in step S503), the enlarged image output unit <NUM> brings out a thumbnail image from the thumbnail image storage unit <NUM>, and outputs and displays the enlarged thumbnail image <NUM> enlarged from the thumbnail image corresponding to the designated document icon <NUM> to the display unit <NUM> (step S504). In the example in <FIG>, the enlargement instruction image 411a on the document icon 410a is designated by a mouse over operation of the cursor <NUM>, and the enlarged thumbnail image 420a enlarged from the thumbnail image corresponding to the document icon 410a is displayed.

The instruction image output unit <NUM> outputs and displays the maintenance instruction image <NUM> to the display unit <NUM> (step S505). The maintenance instruction image <NUM> accepts that the display of the enlarged thumbnail image <NUM> is maintained. For example, in a case where the enlargement instruction image 411a illustrated in <FIG> is designated and the enlarged thumbnail image 420a is displayed, the enlargement instruction image 411a is changed to the maintenance instruction image 412a illustrated in <FIG> and displayed.

Subsequently, the operation determination unit <NUM> determines whether or not the maintenance instruction image <NUM> is designated (step S506). In the present exemplary embodiment, the operation determination unit <NUM> determines, for example, a click operation on the maintenance instruction image <NUM> as designation on the maintenance instruction image <NUM>. In the example illustrated in <FIG>, after the maintenance instruction image 412a is designated by the click operation, the display of the enlarged thumbnail image 420a is maintained.

In a case where the maintenance instruction image <NUM> is not designated in this step S506 (NO in step S506), the process waits until the maintenance instruction image <NUM> is designated. In a case where the maintenance instruction image <NUM> is designated (YES in step S506), the operation determination unit <NUM> determines whether or not the cursor <NUM> is over the enlarged thumbnail image <NUM> of which display is maintained (step S507).

In a case where the cursor <NUM> is not over the enlarged thumbnail image <NUM> in step S507 (NO in step S507), the process waits until the cursor <NUM> moves to the enlarged thumbnail image <NUM>, and the menu image <NUM> is not displayed. In a case where the cursor <NUM> does not exist over the enlarged thumbnail image <NUM>, it is predicted that the user does not need the menu image <NUM>.

In step S507, in a case where the cursor <NUM> is over the enlarged thumbnail image <NUM> (YES in step S507), the display control unit <NUM> determines a display position of the menu image <NUM> according to a display position of the designated document icon <NUM> (step S508). The display position of the menu image <NUM> is determined at a position close to the designated document icon <NUM>. As this distance, a distance between a center point of the designated document icon <NUM> and a center point of the menu image <NUM>, a distance between a predetermined point of the designated document icon <NUM> and a predetermined point of the menu image <NUM>, a distance of the closest point between the designated document icon <NUM> and the menu image <NUM>, and the like may be used.

Here, a specific example of the display position of the menu image <NUM> determined by the display position of the document icon <NUM> will be given.

In the example in <FIG>, since the display position of the document icon <NUM> is located above the operation screen <NUM> and on an upper side of the display area <NUM> for displaying the enlarged thumbnail image <NUM>, the display position of the menu image <NUM> is on an upper side in the display area <NUM>. In the example in <FIG>, since the display position of the document icon <NUM> is lower than the display area <NUM>, the display position of the menu image <NUM> is on a lower side in the display area <NUM>.

In the example in <FIG>, since the display position of the document icon <NUM> is located above the operation screen <NUM> and on a left side of the display areas 421a and 421b, the display position of the menu image <NUM> is on an upper side and a left side in the display areas 421a and 421b. In the example in <FIG>, since the display position of the document icon <NUM> is below the operation screen <NUM> and on a right side of the display areas 421a and 421b, the display position of the menu image <NUM> is on a lower side and a right side in the display areas 421a and 421b.

Next, the menu image output unit <NUM> outputs and transparently displays the menu image <NUM> to the display unit <NUM> at a position determined by the display position of the designated document icon <NUM> (step S509). In the example in <FIG>, although the cursor <NUM> is over the enlarged thumbnail image 420a, the cursor <NUM> does not exist at a position of an area for displaying the menu image <NUM>. Therefore, the menu image <NUM> is made semi-transparent by increasing a transparency, and a superimposed portion on the enlarged thumbnail image 420a is displayed so as to be seen through.

The operation determination unit <NUM> determines whether or not the cursor <NUM> is over the menu image <NUM> (step S510). In a case where the cursor <NUM> is not over the menu image <NUM> (NO in step S510), the process waits until the cursor <NUM> moves over the menu image <NUM>. In a case where the cursor <NUM> is over the menu image <NUM> (YES in step S510) , the menu image output unit <NUM> outputs the menu image <NUM> to the display unit <NUM>, and the transparency is lowered and displayed as compared with a case where the cursor <NUM> is not over the menu image <NUM> (step S511). The menu image may be displayed without being transparent. In the example in <FIG>, since the cursor <NUM> is over the menu image <NUM>, the transparency of the menu image <NUM> is lowered so that the button image <NUM> related to the menu is displayed more clearly.

The operation determination unit <NUM> determines whether or not the button image <NUM> related to one menu is selected, among the button images <NUM> related to menus included in the menu image <NUM> (step S512). In a case where the button image <NUM> related to one menu is not selected (NO in step S512), the process waits until the button image <NUM> related to one menu is selected. In a case where the button image <NUM> related to one menu is selected (YES in step S512), the display control unit <NUM> performs control so that the enlarged thumbnail image <NUM> obtained by reflecting a process of the menu corresponding to the selected button image <NUM> in the document is displayed (step S513). Here, even in a case where the page in which the process of the selected menu is reflected and which is displayed is changed, the display position or a size of the menu image <NUM> is not changed.

Next, the operation determination unit <NUM> determines whether or not an operation of canceling the maintenance of the display of the enlarged thumbnail image <NUM> is performed (step S514). The operation determination unit <NUM> according to the present exemplary embodiment determines, for example, performing a click operation at a position other than the display area <NUM> or a click operation again on the maintenance instruction image <NUM>, as an operation of canceling the maintenance of the display of the enlarged thumbnail image <NUM>. In a case where the canceling operation is not performed in step S514 (NO in step S514), the display of the enlarged thumbnail image <NUM> is continued to be maintained. In a case where the canceling operation is performed (YES in step S514), the display control unit <NUM> cancels the maintenance of the display of the enlarged thumbnail image <NUM> (step S515). In a case where the canceling operation is performed, the menu image <NUM> is not displayed since the cursor <NUM> is located at a position other than the display area <NUM> for displaying the enlarged thumbnail image <NUM> as illustrated in <FIG>.

The process of displaying the menu image <NUM> is completed according to the above processing procedure.

In the above example, the display position of the menu image <NUM> is determined after the enlarged thumbnail image <NUM> is displayed, and the exemplary embodiment is not limited thereto. In a case where any of the document icons <NUM> is designated, the display position of the menu image <NUM> may be determined by a distance from the designated document icon <NUM> without waiting for the display of the enlarged thumbnail image <NUM>.

Further, although the enlarged thumbnail image <NUM> is displayed and the display of the enlarged thumbnail image <NUM> is maintained by the operation of designating the enlargement instruction image <NUM> or the maintenance instruction image <NUM>, the enlarged thumbnail image <NUM> may be displayed and the display of the enlarged thumbnail image <NUM> may be maintained by a predetermined operation so that the cursor <NUM> is located over the document icon <NUM> without displaying the enlargement instruction image <NUM> or the maintenance instruction image <NUM>. Further, the operation for displaying the enlarged thumbnail image <NUM> and maintaining the display of the enlarged thumbnail image <NUM> may be performed by a predetermined operation such as a key operation, for example.

In a case where the display of the enlarged thumbnail image <NUM> is maintained, the maintenance instruction image <NUM> may be not displayed, or the enlargement instruction image <NUM> and the maintenance instruction image <NUM> may be independently displayed at positions different from each other. With the present exemplary embodiment, by changing and displaying the enlargement instruction image <NUM> to the maintenance instruction image <NUM>, it is not necessary to move the cursor, for an operation of the user from displaying the enlarged thumbnail image <NUM> to maintaining the display of the enlarged thumbnail image <NUM>.

Further, the enlarged thumbnail image <NUM> or the menu image <NUM> is displayed in a state in which the cursor <NUM> is located over the document icon <NUM> based on the operation of the input unit <NUM> such as a mouse of the user, and the exemplary embodiment is not limited thereto. In a case of a touch panel or the like, the input unit <NUM> is provided integrally with the display unit <NUM>. In this aspect, the user may perform an operation of touching the display position of the document icon <NUM> or the like on the display unit <NUM> which is a touch panel with a finger or the like, or an operation of maintaining the contact state of the finger or the like for a longer time than a predetermined time so as to display the enlarged thumbnail image <NUM> or the menu image <NUM>.

In the above example, the enlarged thumbnail image <NUM> is displayed by using the entire area of the display area <NUM>, and the exemplary embodiment is not limited thereto. The enlarged thumbnail image <NUM> may not be displayed by using the entire area of the display area <NUM>.

An example in which the menu image <NUM> is displayed so that at least a part of the area of the menu image <NUM> is not superimposed on the enlarged thumbnail image <NUM> will be described with reference to <FIG>.

<FIG> are diagrams illustrating an example of a display position on an operation screen.

For convenience, in the document icon <NUM> illustrated in <FIG>, an area for displaying a thumbnail image is represented by a solid line, and a shape of the displayed thumbnail image is represented by a dotted line.

As illustrated in <FIG>, in a case where a width of the enlarged thumbnail image <NUM> in a right-left direction is narrower than a width of the display area <NUM> in the left-right direction, the display control unit <NUM> displays the enlarged thumbnail image <NUM> at a center portion in the display area <NUM> in the right-left direction, and displays the menu image <NUM> in an end area of the display area <NUM>.

As illustrated in <FIG>, in a case where a width of the enlarged thumbnail image <NUM> in an up-down direction is narrower than a width of the display area <NUM> in the up-down direction, the display control unit <NUM> displays the enlarged thumbnail image <NUM> at a center portion in the display area <NUM> in the up-down direction, and displays the menu image <NUM> in the end area of the display area <NUM>.

Further, in a case where a document corresponding to the document icon <NUM> has a plurality of pages, the display position or the size of the menu image <NUM> is not changed even in a case where a size or a direction of the enlarged thumbnail image <NUM> is changed with a change of the page to be displayed on the enlarged thumbnail image <NUM>.

In the above example, the enlarged thumbnail image <NUM> is displayed at the center portion of the display area <NUM> in the right-left direction or the up-down direction, and the enlarged thumbnail image <NUM> may be displayed in the center portion of the display area <NUM>, and the menu image <NUM> may be displayed in the end area of the display area <NUM>. As a result, the area superimposed on the enlarged thumbnail image <NUM> and the menu image <NUM> can be reduced while handling the enlarged thumbnail image <NUM> having various shapes.

Further, in the example described above, the menu image <NUM> is displayed in a uniform shape based on the user operation, and the display mode of the menu image <NUM> may be based on a size of the operation screen <NUM>.

As an example, a case where the size of the operation screen <NUM> is smaller than a predetermined value will be described with reference to <FIG> and, <FIG>.

<FIG> are diagrams illustrating an example of displaying the menu image <NUM>.

As illustrated in <FIG>, in a case where the size of the operation screen <NUM> is equal to or larger than a predetermined value, the button image <NUM> related to a menu is displayed in one stage in the menu image <NUM>. The entire area of the menu image <NUM> is displayed at once on the operation screen <NUM>. A size of the button image <NUM> related to the menu is a size that is easy for the user to operate. Here, the predetermined value is the minimum value of the size of the operation screen <NUM> on which the entire area of the menu image <NUM> having the button image <NUM> related to the menu having a size that is easy for the user to operate at one time is displayed. Further, the predetermined value may be the minimum value of the size of the operation screen <NUM> so that the menu image <NUM> does not interfere with the display of a document image such as the enlarged thumbnail image <NUM> in the display area <NUM> of which size is changed with the size of the operation screen <NUM>.

On the other hand, in a case where the size of the operation screen <NUM> is smaller than the predetermined value, in the example in <FIG>, the size of the button image <NUM> related to the menu is not changed, and the menu image <NUM> is displayed in the display area <NUM> in a two-stage display mode. The button image <NUM> related to the menu is displayed in two stages, and the number of stages is not limited to this. Meanwhile, in a case where the display mode has three or more stages, an area in which the enlarged thumbnail image <NUM> can be visually recognized may be small in a case where the menu image <NUM> is designated, and the menu image <NUM> in two stages is adopted here.

Further, in the example in <FIG>, in a case where the size of the operation screen <NUM> is smaller than the predetermined value, a partial area of the menu image <NUM> is displayed in the display area <NUM> without changing a shape of the menu image <NUM>. In this exemplary embodiment, the scroll image <NUM> that accepts the operation of shifting the display area of the menu image <NUM> from the user is displayed, and the present exemplary embodiment is not limited to this configuration. The operation of shifting the display area of the menu image <NUM> may be accepted from the user without displaying the scroll image <NUM>. For example, the operation of shifting the display area of the menu image <NUM> includes a scroll operation via an input unit <NUM> such as a mouse or an operation of sliding the display unit <NUM> such as a touch panel with a finger or the like in contact with the display unit <NUM>. Further, the scroll image <NUM> may be temporarily displayed as an auxiliary image indicating which area of the menu image <NUM> is displayed.

In the above example, in a case where the size of the operation screen <NUM> is smaller than the predetermined value, the number of button images <NUM> related to the displayed menu is not changed, and the number of button images <NUM> to be displayed may be reduced. The process in which the display as the button image <NUM> is omitted is displayed on a screen corresponding to the omission button image 431d.

Further, the size of the button image <NUM> related to the menu may be reduced and displayed in one stage. The size of the button image <NUM> related to the reduced menu is set to such a size that the user can visually select each of the button images <NUM>.

Further, although the button images <NUM> related to the menu are arranged in the right-left direction, the menu image <NUM> may be displayed by arranging the button images <NUM> in the up-down direction. In a case where the enlarged thumbnail image <NUM> is displayed as illustrated in <FIG>, an area in which the enlarged thumbnail image <NUM> and the menu image <NUM> are superimposed can be reduced as compared with the multi-stage arranged in the right-left direction in a case where the button images <NUM> related to the menu are arranged in the up-down direction.

In the above example, the display of the menu image <NUM> is changed in a case where the size of the operation screen <NUM> is smaller than the predetermined value, and the display of the menu image <NUM> may be also changed in a case where the size of the operation screen <NUM> is larger than the predetermined value. As illustrated in <FIG>, in a case where the size of the menu image <NUM> with respect to the size of the display area <NUM> is smaller than a predetermined value, the process displayed on the screen corresponding to the omission button image 431d is additionally displayed as the button image <NUM>, for example. As a result, an operation of selecting the omission button image 431d and then selecting the process again on the screen is omitted.

The process performed by the image display apparatus <NUM> according to the present exemplary embodiment is prepared, for example, as a program such as application software. The program can be provided by a communication section as well as provided by being stored in a recording medium such as a CD-ROM or the like.

Claim 1:
An information processing apparatus (<NUM>) comprising:
a processor (<NUM>) configured to:
display an instruction image (<NUM>) for accepting an instruction of a user on a document (<NUM>) on an operation screen (<NUM>) for accepting an operation by the user;
display a document image (<NUM>) related to the document according to the operation of the user on a display position of the instruction image, wherein the document includes an image in addition to a text, or includes only the image without including the text;
display a menu image (<NUM>) for accepting the operation of the user on the document image at a position determined by the display position of the instruction image on the operation screen (<NUM>) ; and
display the menu image in an area for displaying the document image,
the information processing apparatus (<NUM>) being characterized in that the processor (<NUM>) is further configured to:
in a case where the display position of the instruction image is located above the area for displaying the document image, display the menu image on an upper side in the area for displaying the document image;
in a case where the display position of the instruction image is below the area for displaying the document image, display the menu image on a lower side in the area the document image is displayed;
in a case where the display position of the instruction image is on the left of the area for displaying the document image, display the menu image on a left side in the area for displaying the document image; and
in a case where the display position of the instruction image is on the right of the area for displaying the document image, display the menu image on a right side in the area the document image is displayed.