Medical image display apparatus

Provided is an image display apparatus which includes a display unit that displays a series of images obtained by imaging an inside of a subject in time sequence, and displays a specific area with a predetermined size; and an input unit having an input button group for performing a display operation of the images. The apparatus also includes a control unit that performs a control so that an operation mode is set to a button operation mode for performing the display operation of the images with a button operation of the input unit when a cursor on a display screen is in the specific area, and the operation mode is set to a cursor operation mode for performing the display operation of the images corresponding to at least a position on the display screen and a position of the cursor when the cursor is out of the specific area.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to an image display apparatus that displays a series of images obtained by imaging a subject in time sequence.

2. Description of the Related Art

Recently, a swallowable capsule endoscope provided with an imaging function and a radio communication function has been proposed in an endoscope field, and a capsule endoscope system for acquiring an image in a subject with the use of the capsule endoscope has been developed. The capsule endoscope moves in a body cavity, for example, inside of internal organs such as stomach, small intestine, etc., due to peristaltic movement, and functions to capture an image inside the subject at an interval of 0.5 second, during the period from when it is swallowed from a mouth of the subject for observation (examination) to when it is naturally discharged.

While the capsule endoscope moves in the subject, the image captured by the capsule endoscope is transmitted sequentially to an external receiving apparatus via radio communication. The receiving apparatus has a radio communication function and a memory function. It sequentially stores the image of the inside of the subject received from the capsule endoscope into a memory. By carrying the receiving apparatus, the subject can freely move during the period from when he/she swallows the capsule endoscope to when it is naturally discharged. After the capsule endoscope is naturally discharged from the subject, a doctor or nurse causes an image display apparatus to read the image accumulated in the memory for displaying the image of the internal organs in the subject by the image display apparatus, whereby the doctor or nurse can perform diagnosis of the subject (for example, see Japanese Patent Application Laid-Open No. 2003-19111).

The image display apparatus described above generally displays each image contained in a series of images of the inside of the subject as a still image, or displays each image consecutively to display a pseudo-moving image of the inside of the subject. There is one of such image display apparatuses having a moving image display function described above in which, in order to perform a display operation of a moving image on a screen, a slider that is a rectangle display area and a knob moving in the slider are displayed on a screen, and the knob is moved by a drag operation with the use of a mouse to carry out a display operation of a moving image (see, for example, Japanese Patent Application Laid-Open No. 11-32304). In the image display apparatus disclosed in Japanese Patent Application Laid-Open No. 11-32304, an origin is provided in the vicinity of the center of the slider on the screen, and when the knob is moved so as to be apart from the origin, the moving image is displayed with a reproduction speed according to the position of the knob. On the other hand, there is an image display apparatus that displays icon formed with plural button sections for operating a moving direction and moving speed of an image, and has a function of moving the image on a screen in a desired direction by selecting any one of button sections of the icon with the movement of the mouse and performing a click operation (see, for example, Japanese Patent Application Laid-Open No. 2003-346172).

However, whenever a desired image group, e.g., a series of images in the subject, is displayed with its play speed and play direction (specifically, forward direction or reverse direction in the time sequence) changed to the desired play speed and play direction, a display operation for moving the mouse should be performed, i.e., a cursor on the screen should be moved to the icon, etc., to perform a click operation or drag operation in the conventional image display apparatus. Therefore, there has been a problem that it is in many cases difficult to perform the display operation of the image while observing a series of images in the subject.

SUMMARY OF THE INVENTION

An image display apparatus according to an aspect of the present invention includes a display unit that displays a series of images obtained by imaging an inside of a subject in time sequence, and displays a specific area with a predetermined size; an input unit having an input button group for performing a display operation of the images; and a control unit that performs a control so that an operation mode is set to a button operation mode for performing the display operation of the images with a button operation of the input unit when a cursor on a display screen is in the specific area, and the operation mode is set to a cursor operation mode for performing the display operation of the images corresponding to at least a position on the display screen and a position of the cursor when the cursor is out of the specific area.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

Hereinafter, a preferred embodiment of an image display apparatus of the present invention is described in detail. Although, in the following, an image display apparatus used in a capsule endoscope system is exemplified as an example of the image display apparatus of the present invention, this does not limit the scope of the present invention.

FIG. 1is a schematic view schematically illustrating one structural example of a capsule endoscope system provided with an image display apparatus according to an embodiment of the present invention. As shown inFIG. 1, this capsule endoscope system has a capsule endoscope2that moves along a moving path in a subject1so as to captures an image in the subject1, a receiving apparatus3that receives the image radio-transmitted from the capsule endoscope2and accumulates the image, an image display apparatus4that displays the image obtained by imaging the subject1by the capsule endoscope2in time sequence, and a portable recording medium5that receives and transmits information between the receiving apparatus3and the image display apparatus4.

The capsule endoscope2has a imaging function for imaging the inside of the subject1and a radio communication function for transmitting the image of the inside of the subject1to the receiving apparatus3. The capsule endoscope2is swallowed by the subject1, so that it passes an esophagus in the subject1, and advances in a body cavity due to peristalsis of a cavity of an alimentary tract. Simultaneously, the capsule endoscope2sequentially captures an image in the subject1at a predetermined interval, for example, at an interval of 0.5 second, and sequentially transmits the obtained image in the subject1to the receiving apparatus3.

The receiving apparatus3has connected thereto receiving antennas3ato3hso as to perform radio communication with the capsule endoscope2with the use of the receiving antennas3ato3h. Specifically, the receiving apparatus3receives a radio signal from the capsule endoscope2via any one of the receiving antennas3ato3h, and acquires the image in the subject1on the basis of the received radio signal. Further, the portable recording medium5is detachably mounted to the receiving apparatus3, wherein the image in the subject1sequentially acquired from the capsule endoscope2is sequentially stored in the portable recording medium5.

The receiving antennas3ato3hare realized by using, for example, a loop antenna, and receive radio signals transmitted from the capsule endoscope2. The receiving antennas3ato3hare arranged at a predetermined position on the body surface of the subject1, e.g., the position corresponding to the moving path of the capsule endoscope2, as shown inFIG. 1. The receiving antennas3ato3hmay be arranged at the predetermined position on a jacket put on the subject1. In this case, since the subject1wears this jacket, the receiving antennas3ato3hare arranged at the predetermined position on the body surface of the subject1corresponding to the moving path of the capsule endoscope2. It may suffice that plural receiving antennas are arranged on the subject1. In this case, the number of the arranged antennas is not particularly limited to eight.

The portable recording medium5is a portable recording media such as CompactFlash®, etc. The portable recording medium5is attachable to and detachable from the receiving apparatus3and the image display apparatus4, and has a structure capable of outputting and recording information upon being attached to both apparatuses. Specifically, when the portable recording medium5is attached to the receiving apparatus3, the receiving apparatus3sequentially stores data such as the image, etc. obtained from the capsule endoscope2. When the portable recording medium5is attached to the image display apparatus4, the stored data such as the image etc. is taken into the image display apparatus4, or information relating to the subject1is written by the image display apparatus4.

The image display apparatus4displays the image, etc. captured by the capsule endoscope2. The image display apparatus4has a configuration like a workstation, or the like, so as to display the image in the subject1obtained through the portable recording medium5. In this case, the image display apparatus4has a processing function by which an examiner such as a doctor or a nurse observes the image of the inside of the subject1and diagnoses the subject1. The examiner causes the image display apparatus4to sequentially display the image in the subject1for observing (examining) the sites in the subject1, such as an esophagus, stomach, small intestine, large intestine, etc., whereby the examiner can diagnose the subject1.

FIG. 2is a block diagram schematically showing one structural example of the image display apparatus4. As shown inFIG. 2, the image display apparatus4has an input unit11that inputs various information so as to display and observe the image in the subject1, a display unit12that displays on a screen various information pieces for observing (examining) the inside of the subject1such as the image of the inside of the subject1for diagnosis, and a reader/writer13that takes data such as an image or the like accumulated in the portable recording medium5. Further, the image display apparatus4has a storage unit14that accumulates various data pieces necessary for the observation and diagnosis of the inside of the subject1such as the image of the inside of the subject1, and a control unit15that drives and controls various units in the image display apparatus4.

The input unit11is realized by using a ten-key, keyboard, mouse, and the like. The input unit11inputs information giving an instruction to the control unit15or information relating to the subject1to the control unit15through the input operation by the examiner. Further, the input unit11has an input button group for performing a display operation for displaying a desired image group, e.g., a series of images in the subject1, on the display unit12with a desired play speed (i.e., display frame rate) along the forward direction or reverse direction of the time sequence. In this case, the input unit11inputs to the control unit15instruction information for displaying the image in the subject1on the display unit12and information relating to the subject1, such as a name of the subject1(patient name), sex, birth date, and patient ID.

The display unit12is realized by using a display such as a CRT display or liquid crystal display, and displays various information pieces instructed to display by the control unit15. In this case, the display unit12displays, for example, a series of images in the subject1captured by the capsule endoscope2with the desired play speed along the forward direction or reverse direction of the time sequence. The specific example of the display screen by the display unit12will be described later.

The above-mentioned portable recording medium5is detachably mounted to the reader/writer13. The reader/writer13takes the data, e.g., a series of images in the subject1, accumulated in the mounted portable recording medium5, and transfers the obtained data to the control unit15. Further, the reader/writer13writes the information instructed to be written by the control unit15, e.g., the information relating to the subject1, to the mounted portable recording medium5.

The storage unit14accumulates the information instructed to be written by the control unit15, e.g., a series of images in the subject1and the information relating to the subject1. Further, the storage unit14reads the accumulated information, which is instructed by the control unit15to be read, and transfers the same to the control unit15. It is to be noted that the storage unit14may be configured to accumulate various information pieces into the storage unit14itself by using information recording means capable of accumulating and reading the information, such as RAM, EEPROM, hard disk, or the like, or alternatively, the storage unit14may be configured such that a portable recording medium such as CD or DVD is detachably mounted thereto and information is accumulated into the mounted CD or DVD.

The control unit15drives and controls each unit of the image display apparatus4, such as the input unit11, display unit12, reader/writer13, and storage unit14, as described above, and performs input/output control of the information to each unit and information processing for inputting and outputting various information pieces between each unit. When the control unit15takes, for example, a series of images in the subject1through the portable recording medium5, the control unit15associates and stores each image of the series of images and time information relating to each image into the storage unit14.

The control unit15further has a mode switching controller15aand a display controller15b. The mode switching controller15aperforms a control so as to change a display operation mode for displaying the series of images in the subject1on the display unit12. In this case, the mode switching controller15achanges the display operation mode to either one of a button operation mode and cursor operation mode according to the position of the cursor on the display screen of the display unit12. The mode switching controller15aperforms a control to change a display operation state of the image displayed on the display unit12, corresponding to the display operation using the input unit11. In this case, the mode switching controller15amode-shifts the display operation state of the image to the next display operation state for every display operation using the input unit11.

The cursor operation mode performs the display operation of the image corresponding at least to the position on the display screen and the position of the cursor, e.g., the cursor operation mode is the display operation mode for changing the display operation state of the image according to any one of the display operation icon groups formed on the display screen and the position of the cursor (specifically, the cursor is moved to any one of the display operation icon groups). On the other hand, the button operation mode performs the display operation of the image by the button operation of the input unit11. For example, the button operation mode is the display operation mode for changing the display operation state of the image by the button operation of, for example, the mouse or keyboard, without moving the cursor to any one of the display operation icon groups.

The above-mentioned image display operation state is the state of the image on the display screen classified depending upon the play speed and play direction (i.e., in the forward direction or reverse direction of the time sequence). Examples of the image display state include a state in which the image display is temporarily stopped (pause state), a state in which an image is displayed with a reference play speed in the forward direction of the time sequence (play state), a state in which an image is displayed with a play speed, which is higher than the reference play speed, in the forward direction of the time sequence (fast play state), and a state in which an image is displayed with frame feeding along the forward direction of the time sequence (frame play state). Further, examples of the image display operation state includes a state in which an image is displayed with the play direction of the play state changed to the reverse direction of the time sequence (reverse play state), a state in which an image is displayed with the play direction of the fast play state changed to the reverse direction of the time sequence (reverse fast play state), and a state in which an image is displayed with the play direction of the frame play state changed to the reverse direction of the time sequence (reverse frame play state).

On the other hand, the display controller15bperforms a control to display various information pieces to the display unit12. In this case, the display controller15bcauses the display unit12to display the information for observing and diagnosing the inside of the subject1, such as the series of the image of the inside of the subject1. Further, the display controller15bperforms a control to display on the display unit12a guidance image that explains for the examiner the button operation for changing the above-mentioned image display operation state (specifically, for mode-shifting to the next display operation state) in the button operation mode. The detail of the guidance image will be described later.

Subsequently, the display screen displayed by the display unit12will be specifically explained.FIG. 3is a schematic view schematically showing one specific example of the display screen of the display unit12. As shown inFIG. 3, formed on the display screen of the display unit12are a main-image display area100that displays an observation image by which an examiner observes (examines) the inside of the subject, a subimage display area110that additionally displays a desired image selected from the images displayed on the main-image display area100as a thumbnail, and display operation icons121to127for performing the image display operation displayed on the main-image display area100in the above-mentioned cursor operation mode. Further, formed on the display screen of the display unit12are a cursor K that moves on the display screen by the operation of the input unit11, a specific area130that is formed into a size by which the cursor K can go in or out, and a setting icon140that performs a user setting to select the input unit11used for the image display operation.

As shown inFIG. 3, an observation image101for observing (examining) the inside of the subject1is displayed on the main-image display area100. The observation image101is included in the series of images in the subject1captured by the capsule endoscope2, and is displayed with the display operation state designated by the display operation of the input unit11.

Every time the examiner operates the input unit11to select the desired image in the main-image display area100, the thumbnail corresponding to the selected desired image is additionally displayed on the subimage display area110. When the observation image101in the main-image display area100is selected, for example, the thumbnail corresponding to the observation image101is additionally displayed on the subimage display area110.

The display operation icons121to127are for performing the display operation of the image displayed in the main-image display area100in the aforesaid cursor operation mode. Specifically, in the cursor operation mode, the cursor K is moved to any one of the display operation icons121to127, and the display operation icon at the position of the cursor K is selected by the operation of the input unit11, whereby the display operation state of the observation image displayed in the main-image display area100is designated. In this case, the observation image is displayed in the main-image display area100with the display operation state corresponding to the display operation icon thus designated.

The display operation icon121designates the pause state of the observation image in the cursor operation mode, and the display operation icons122to124respectively designate the frame play state, play state, and fast play state of the observation image in the cursor operation mode. Further, the display operation icons125to127respectively designate the reverse frame play state, reverse play state, and reverse fast play state in the cursor operation mode.

The specific area130is the area formed into the size by which the cursor K can go in the frame or out of the frame as shown inFIG. 3. The specific area130is formed, for example, in the vicinity of the main-image display area100. Further, a state image131and a guidance image132are displayed in the specific area130. The state image131is for showing the display operation state of the image, which is being displayed in the main-image display area100, to the examiner. Specifically, the state image131is displayed so as to indicate the mark of the display operation icon (for example, any one of the display operation icons121to127) designating the display operation state same as the present display operation state, in order to show the display operation state of the image that is being displayed in the main-image display area100. In this case, when the image now being displayed, for example, the observation image101is in the pause state, the state image131is displayed so as to indicate the mark “| |” of the display operation icon121designating the pause state.

The guidance image132is, as described above, for explaining to the examiner the button operation of the input unit11in order to change the image display operation state (i.e., to mode-shift to the next display operation state) in the button operation mode. When a user setting for selecting the mouse as the input unit11used for the image display operation is performed beforehand, for example, the guidance image132explains the button operation of the mouse for mode-shifting the current display operation state (e.g., pause state) to the next display operation state as shown inFIG. 3.

FIG. 4is a schematic view schematically showing one specific example of the guidance image132.FIG. 5is a schematic view schematically illustrating the mouse constituting the input unit11. Notably,FIG. 4illustrates the guidance image displayed in the pause state. As shown inFIG. 4, the guidance image132explains the button operation of the input unit11for changing the image display operation state in the button operation mode. Specifically, when the mouse is selected by the above-mentioned user setting, the guidance image132explains the button operation of the mouse16illustrated inFIG. 5.

Specifically, as shown inFIGS. 4 and 5, the guidance image132indicates that, if a button operation (right click operation) in which the right button16aof the mouse16is depressed once is performed in the pause state, the mode is shifted from the pause state to the play state, and if a button operation (right double-click operation) in which the right button16ais depressed twice in quick succession, the mode is shifted from the pause state to the fast play state. Further, the guidance image132indicates that, if a button operation (left click operation) in which the left button16bof the mouse16is depressed once is performed in the current pause state, the mode is shifted from the pause state to the reverse fast play state, and if a button operation (left double-click operation) in which the left button16bis depressed twice in quick succession, the mode is shifted from the pause state to the reverse fast play state. Moreover, the guidance image132indicates that, if a button operation (simultaneous click operation) in which the right button16aand the left button16bof the mouse16are both depressed is performed in the current pause state, the thumbnail corresponding to the observation image now being displayed in the main-image display area100is additionally displayed in the subimage display area110. In the guidance image132, “Capture”, for example, is displayed as a text or mark indicating that the process for additionally displaying the thumbnail is performed.

Next, the operation of the control unit15for changing the image display operation mode according to the position of the cursor K will be explained in detail.FIG. 6is a flowchart for explaining a procedure of changing the image display operation mode according to the position of the cursor K. InFIG. 6, the control unit15firstly detects the position of the cursor K formed on the display screen of the display unit12, and determines which position, at the inside of the frame of the specific area130or outside of the frame of the specific area130, the cursor K is located (step S101).

When the control unit15determines that the position of the cursor K is at the inside of the frame of the specific area130at step S101(in the area at step S101), the control unit15sets, for example, the above-mentioned button operation mode as the display operation mode for displaying the observation image of the inside of the subject1on the display unit12(step S102). In this case, if the display operation mode is set to the cursor operation mode before step S102, the mode switching controller15achanges this cursor operation mode to the button operation mode with the movement of the cursor K to the inside of the frame of the specific area130defined as a trigger.

Next, the control unit15determines whether the cursor K is positioned in the frame of the specific area130or not (step S103). When the control unit15determines that the cursor K is positioned in the frame of the specific area130(Yes at step S103), the control unit15keeps the display operation mode to the button operation mode, and repeats this step S103.

On the other hand, when the control unit15determines at step S103that the position of the cursor K is out of the frame of the specific area130(No at step S103), the control unit15cancels the button operation mode set at step S102(step S104), and then, sets the cursor operation mode as the display operation mode (step S105). In this case, the mode switching controller15achanges the display operation mode to the cursor operation mode from the button operation mode with the movement of the cursor K to the outside of the frame of the specific area130defined as a trigger.

Then, the control unit15determines whether the cursor K is positioned out of the frame of the specific area130or not (step S106). When the control unit15determines that the position of the cursor K is out of the frame of the specific area130(Yes at step S106), the control unit15maintains the display operation mode to the cursor operation mode, and repeats the step S106.

Thereafter, when the control unit15determines at the step S106that the position of the cursor K is in the frame of the specific area130(No at step S106), the control unit15cancels the cursor operation mode set at the step S105(step S107), and repeats the procedure after the step S102. In this case, the mode switching controller15achanges the display operation mode from the cursor operation mode to the button operation mode with the movement of the cursor K to the inside of the frame of the specific area130defined as a trigger.

On the other hand, when the control unit15determines that the position of the cursor K is out of the frame of the specific area130at the aforesaid step S101(out of area at step S101), the control unit15repeats the procedure after the step S105. In this case, the mode switching controller15achanges the button operation mode to the cursor operation mode with the movement of the cursor K to the outside of the frame of the specific area130defined as a trigger, if the display operation mode is set to the button operation mode before the step S105.

As described above, when the position of the cursor K is in the frame of the specific area130, the control unit15changes the display operation mode to the button operation mode and maintains this mode. When the position of the cursor K is out of the frame of the specific area130, the control unit15changes the display operation mode to the cursor operation mode and maintains this mode. Accordingly, the examiner can designate any one of the display operation icons121to127so as to perform the display operation of the observation image by operating the input unit11to move the cursor K to the outside of the frame of the specific area130, e.g., to the display operation icons121to127. Further, if the examiner operates the input unit11to move the cursor K to the inside of the frame of the specific area130, the examiner can carry out the button operation of the input unit11, e.g., of the mouse16so as to perform the display operation of the observation image without moving the cursor K to the display operation icons121to127.

Since the specific area130is formed sufficiently larger than the cursor K as shown inFIG. 3, go-in and go-out of the cursor K to the specific area130is easy, and further, an allowable range of the movement of the cursor K in the frame is large. Therefore, the examiner can easily move the cursor K to the inside of the frame of the specific area130by operating the input unit11, e.g., the mouse16, and even if the mouse16is shifted slightly, the examiner can keep the cursor K in the frame of the specific area130. If the cursor K is positioned in the frame of the specific area130, the control unit15maintains the aforesaid button operation mode regardless of the movement of the cursor K in the frame. Accordingly, the troublesome operation of moving the cursor K to the position of the display operation icon can be eliminated when performing the aforesaid display operation of the observation image, and further, the display operation in the button operation mode can easily be performed.

Next, the operation in which the control unit15sets the display operation state in the button operation mode and the observation image is displayed on the display unit12with this display operation mode will be explained in detail.FIG. 7is a flowchart for explaining the procedure for displaying the observation image as the display operation state is changed in the button operation mode. InFIG. 7, when the control unit15sets the button operation mode as the display operation mode, the control unit15firstly determines whether or not any one of the display operation icons121to127has already been designated (step S201).

If none of the display operation icons121to127is designated by the operation of the input unit11, the control unit15determines at step S201that the display operation icons are not in their designated state (No at step S201), so that the control unit15initializes the display operation state of the observation image (step S202). In this case, the mode switching controller15asets, for example, the above-mentioned pause state as the initial setting of the display operation state. According to the initial setting of the mode switching controller15a, the display controller15bperforms to the display unit12a control for displaying the observation image in the main-image display area100with the pause state.

Subsequently, the control unit15causes the display unit12to display the guidance image and the state image with the display operation state in the initial setting, e.g., with the pause state (step S204). In this case, the display controller15bperforms a control to display the state image131indicating the pause state and the guidance image132in the pause state in the specific area130as shown inFIG. 3.

Thereafter, the control unit15causes the display unit12to highlight the display operation icon, which designates the display operation state same as the state image displayed at the step S204(step S205). In this case, the display controller15bperforms to the display unit12a control to highlight the display operation icon that designates the display operation state indicated by the state image. For example, when the display controller15bperforms a control to display the state image131in the specific area130at the step S204, for example, the display controller15bperforms a control to highlight the display operation icon121that designates the display operation state (i.e., pause state) same as the state image131as shown inFIG. 3.

On the other hand, if any one of the display operation icons121to127is designated by moving the cursor K and performing the click operation at the step S201, the control unit15determines that the display operation icon has already been designated (Yes at step S201), and maintains the display operation state corresponding to the designated display operation icon (step S203). In this case, the mode switching controller15asets the display operation state corresponding to the designated display operation icon of the display operation icons121to127. The display controller15bperforms to the display unit12a control to display the observation image in the main-image display area100with the display operation state maintained at the step S203.

For example, if the display operation icon121has been designated, the mode switching controller15asets the pause state corresponding to this display operation icon121. In this case, the display controller15bperforms a control to display the observation image in the main-image display area100with the set pause state. Further, if the display operation icon123has been designated, the mode switching controller15asets the play state corresponding to this display operation icon123. In this case, the display controller15bperforms a control to display the observation image in the main-image display area100with the play state. Even if any one of the display operation icons121to127has been already designated, the mode switching controller15aand the display controller15bexecute the process described above in the generally same manner as described above.

On the other hand, when the procedure up to the step S205is executed, the control unit15detects the button operation of the input unit11, e.g., the button operation of the mouse16(step S206). Specifically, when the button operation of the mouse16is performed with the position of the cursor K maintained in the frame of the specific area130at step S206, the control unit15detects the button operation of the mouse16(Yes at step S206), so that the control unit15mode-shifts the display operation state so as to correspond to the detected button operation (step S207). In this case, the mode switching controller15achanges the display operation state (e.g., display operation state of the initial setting) maintained by the execution of this step S206to the next display operation state corresponding to the button operation. With this operation, the mode switching controller15amode-shifts the display operation state to the next display operation state.

Next, the control unit15causes the display unit12to display the observation image with the next display operation mode that is shifted at step S207(step S208). In this case, the display controller15bperforms to the display unit12a control to display the observation image in the main-image display area100with the next display operation state. By virtue of this operation, the display unit12displays the observation image in the display operation state before the mode-shift (e.g., the pause state) in the next display operation state (e.g., play state). Specifically, by this mode-shift, the display unit12sequentially plays the observation image that has been paused.

Thereafter, the control unit15updates the guidance image and the state image displayed on the display unit12to the guidance image and the state image in the next display operation state (step S209). In this case, the display controller15bperforms a control to update the state image indicating the display operation state before the mode-shift maintained at the step S206to the state image indicating the next display operation state for display after the mode-shift at the step S207. At the same time, the display controller15bperforms a control to update the guidance image in the display operation state before the mode-shift to the guidance image in the next display operation state for display.

Then, the control unit15updates the highlighted display of the display operation icon so as to highlight the display operation icon designating the display operation state same as that of the state image updated at the step S209(step S210). In this case, the display controller15bperforms to the display unit12a control to highlight the display operation icon designating the display operation state (i.e., the display operation state after the mode-shift at the step S207) indicated by the state image updated at the step S209, instead of highlighting the display operation icon corresponding to the display operation state before the mode-shift. Thereafter, the control unit15repeats the procedure after the step S206.

On the other hand, when the control unit15does not detect the button operation of the mouse16at the step S206(No at step S206), the control unit15determines whether the button operation mode is canceled or not (step S211). When the control unit15determines that the position of the cursor K is out of the frame of the specific area130as described above, the control unit15cancels the button operation mode. When the control unit15determines that the position of the cursor K is out of the frame of the specific area130, the control unit15maintains this button operation mode. When the control unit15determines that the button operation mode is not canceled at step S211(i.e., that the button operation mode is maintained) (No at step S211), the control unit15repeats the procedure after this step S206.

When the control unit15determines that the button operation mode is canceled at step S211(Yes at step S211), the control unit15deletes the state image and guidance image displayed in the specific area130(step S212), so as to complete the operation for displaying the observation image in this button operation mode. In this case, the display controller15bperforms to the display unit12a control to delete the state image and the guidance image now being displayed in the specific area130.

Next, the operation of the mode-shift of the display operation state of the observation image in the aforesaid button operation mode will be explained in detail.FIG. 8is a state transition diagram for explaining the operation of the mode-shift of the display operation state of the observation image according to the button operation of the mouse16. The control unit15repeatedly executes the procedure after the step S201to perform a mode-shift of the display operation state of the observation image every button operation of the mouse16, and causes the display unit12to display the observation image in the display operation state set by the above-mentioned operation. In this case, the mode switching controller15ashifts the display operation state before the mode-shift to the next display operation state every button operation of the mouse16.

Specifically, inFIG. 8, when the display operation state before the mode-shift is, for example, the pause state, the mode switching controller15amode-shifts the pause state to the next display operation state, i.e., to the play state, if the mode switching controller15adetects the right click operation of the mouse16. If detecting the right double-click operation of the mouse16in the pause state, the mode switching controller15amode-shifts this pause state to the fast play state. If detecting the left click operation of the mouse16in the pause state, the mode switching controller15amode-shifts the pause state to the reverse play state. If detecting the left double-click operation of the mouse16in the pause state, the mode switching controller15amode-shifts the pause state to the reverse fast play state.

Similarly, if detecting the right click operation or right double-click operation of the mouse16in the play state, the mode switching controller15amode-shifts this play state to the fast play state or pause state, respectively. If detecting the left click operation or left double-click operation of the mouse16in the play state, the mode switching controller15amode-shifts this play state to the pause state or reverse play state, respectively. If detecting the right click operation or right double-click operation of the mouse16in the fast play state, the mode switching controller15amode-shifts this fast play state to the pause state or play state, respectively. If detecting the left click operation or left double-click operation of the mouse16in the fast play state, the mode switching controller15amode-shifts this fast play state to the play state or pause state, respectively.

Further, if detecting the right click operation or right double-click operation of the mouse16in the reverse play state, the mode switching controller15amode-shifts this reverse play state to the pause state or play state, respectively. If detecting the left click operation or left double-click operation of the mouse16in the reverse play state, the mode switching controller15amode-shifts this reverse play state to the reverse fast play state or pause state, respectively. Further, if detecting the right click operation or right double-click operation of the mouse16in the reverse fast play state, the mode switching controller15amode-shifts this reverse fast play state to the reverse play state or pause state, respectively. If detecting the left click operation or left double-click operation of the mouse16in the reverse fast play state, the mode switching controller15amode-shifts this reverse fast play state to the pause state or reverse play state, respectively.

If the control unit15detects the simultaneous click operation of the mouse16even in any one of the above-mentioned display operation states, the control unit15causes the display unit12to additionally display the thumbnail corresponding to the observation image being displayed on the main-image display area100. In this case, the display controller15bperforms to the display unit12a control to additionally display the thumbnail in the subimage display area110.

When the examiner performs a frame play or reverse frame play of the observation image, the examiner may operate the input unit11so as to make the display operation state in the pause state, and may operate the input unit11to select the display operation icon122or the display operation icon125. In this case, each time the display controller15bdetects the button operation of the input unit11for selecting the display operation icon122, the display controller15bsequentially performs to the display unit12a control to display the observation image in the frame play state. Each time the display controller15bdetects the button operation of the input unit11for selecting the display operation icon125, the display controller15bsequentially performs to the display unit12a control to display the observation image in the reverse frame play state.

In order to execute the mode-shift process of the display operation state described above, the control unit15allocates each of the display operation states described below to the input unit11, e.g., each button operation of the mouse16, for every display operation state. In this case, the control unit15preferentially allocates the display operation state having high priority (e.g., the display operation state that has higher setting frequency compared to the other display operation states) as the next display operation state set by the mode-shift of the display operation state. Specifically, the control unit15preferentially allocates the play state and reverse play state, which are more frequently set compared to the other ones, to the right click operation and left click operation as the display operation state set next to the pause state, and preferentially allocates the fast play state and the reverse fast play state, which has the second highest setting frequency, to the right double-click operation and left double-click, operation by the mouse16. In this case, since the right click operation and left click operation of the mouse16are easier button operation than the right double-click operation and the left double-click operation, the button operation for mode-shifting the pause state to the play state or reverse play state, which has high priority, is facilitated by allocating the display operation state to the button operation of the mouse16.

Similarly to the above-mentioned case, the control unit15preferentially allocates the fast play state and pause state to the right click operation and left click operation of the mouse16respectively in the play state, and allocates the pause state and reverse play state to the right double-click operation and left double-click operation of the mouse16respectively in the play state. Further, the control unit15preferentially allocates the pause state and play state to the right click operation and left click operation of the mouse16respectively in the fast play state, and allocates the play state and pause state to the right double-click operation and left double-click operation of the mouse16respectively in the fast play state.

Further, the control unit15preferentially allocates the pause state and reverse fast play state to the right click operation and left click operation of the mouse16respectively in the reverse play state, and allocates the play state and pause state to the right double-click operation and left double-click operation of the mouse16respectively in the reverse play state. Further, the control unit15preferentially allocates the reverse play state and pause state to the right click operation and left click operation of the mouse16respectively in the reverse fast play state, and allocates the pause state and reverse play state to the right double-click operation and left double-click operation of the mouse16respectively in the reverse fast play state.

Every time the mode-shift of the display operation state is performed for every button operation of the mouse16, for example, the control unit15updates the next display operation state, which is allocated to each button operation of the mouse16, such that the button operation agrees with the allocation result of the next display operation state. Specifically, when the mode-shift is executed from the pause state to the play state, for example, the control unit15updates the play state that is allocated to the right click operation of the mouse16in the pause state to the fast play state, updates the reverse play state that is allocated to the left click operation to the pause state, updates the fast play state that is allocated to the right double-click operation to the pause state, and updates the reverse fast play state that is allocated to the left double-click operation to the reverse play state.

Subsequently, the operation for updating the guidance image for every mode-shift of the display operation state will be explained in detail.FIG. 9is a schematic view for explaining one example of the operation for updating the guidance image. Every time the control unit15performs the mode-shift of the display operation state as described above, it updates the guidance image that is being displayed on the display unit12. In this case, the display controller15bperforms a control to update the guidance image that explains the button operation of the input unit11for shifting the mode of the display operation state to the next mode of the display operation state.

When the control unit performs a mode-shift of the display operation state to the play state from the pause state, for example, the display controller15bperforms a control to update the guidance image132in the above-mentioned pause state to a guidance image132ain the play state as shown inFIG. 9. This guidance image132ais for explaining each button operation of the mouse16in order to mode-shift the play state to the next display operation state. It indicates that the mode is shifted to the fast play state by the right click operation, the mode is shifted to the pause state by the left click operation or right double-click operation, and the mode is shifted to the reverse play state by the left double-click operation. Further, the guidance image132aindicates that the thumbnail corresponding to the observation image is additionally displayed on the subimage display area110by the simultaneous click operation of the mouse16.

The guidance image132explains each of the button operations of the mouse16, which is allocated by the control unit15to each button so as to shift the mode of the display operation state in the pause state. The guidance image132aexplains each of the button operations of the mouse16, which is allocated by the control unit15to each button so as to shift the mode of the display operation state in the play state. Specifically, the display controller15bperforms a control to update the guidance image so as to agree with the result of the allocation of the next display operation state to the aforesaid each button operation. Specifically, when the mode is shifted to the pause state, the display controller15bperforms a control to update the guidance image to the guidance image132in the form that agrees with the result of the allocation of each display operation state in the pause state. On the other hand, when the mode is shifted to the play state, the display controller15bperforms a control to update the guidance image to the guidance image132ain the form that agrees with the result of the allocation of each display operation state in the play state. Further, when the mode is shifted to the fast play state, the display controller15bperforms a control to update the guidance image to a guidance image in the form that agrees with the result of the allocation of each display operation state in the fast play state. When the mode is shifted to the reverse play state, the display controller15bperforms a control to update the guidance image to a guidance image that agrees with the result of the allocation of each display operation state in the reverse play state, while when the mode is shifted to the reverse fast play state, the display controller15bperforms a control to update the guidance image to a guidance image in the form that agrees with the result of the allocation of each display operation state in the reverse fast play state.

Further, the guidance image132explains each button operation for performing the mode-shift to the play state having higher setting frequency, reverse play state, fast play state, and reverse fast play state, as the display operation state subsequent to the pause state. The guidance image132aexplains each button operation for performing the mode-shift to the fast play state having higher frequency, pause state, and reverse play state, as the display operation state subsequent to the play state. Specifically, as illustrated in the guidance images132and132a, the guidance image for every display operation state preferentially explains the button operation for shifting the display operation state to the mode having higher priority (e.g., having higher setting frequency), as the display operation state subsequent to the display operation state.

Next, the user setting for selecting the input unit11in order to perform the display operation of the observation image will be explained.FIG. 10is a schematic view schematically showing one specific example of the display screen in the event that the user setting for selecting the input unit11is performed. When the examiner operates the input unit11to perform a click operation with the cursor K positioned on the setting icon140so as to designate the setting icon140, a select window141is opened as shown inFIG. 10. The select window141displays a device of the input unit11, which is the subject to be selected, for performing the display operation of the observation image, such as a mouse, keyboard, and ten-key (10-key). If the examiner moves the cursor K to designate a desired device among the devices, which are the subjects to be selected, displayed on the select window141, the examiner can select the device of the input unit11for performing the display operation of the observation image. In this case, the control unit15allocates each of the display operation states to the selected device.

For example, when the mouse is selected from the select window141, the control unit15allocates each of the display operation states to the button operation of the mouse16as described above. In this case, the display controller15bcauses the display unit12to display the guidance image (e.g., guidance image132) for explaining each of the button operations of the mouse16in order to perform the mode-shift of the display operation state as described above.

On the other hand, when the ten-key is selected from the select window141, the control unit15allocates each of the display operation states to each of the input buttons of the ten-key constituting the input unit11. In this case, the control unit15allocates the desired display operation state and the next display operation state to the adjacent input buttons in the input button group provided to the ten-key of the input unit11. Accordingly, the mode switching controller15aperforms a control to perform the mode-shift to the display operation state corresponding to the operated input button of the ten-key. The next display operation state described above is desirably the display operation state having higher priority (having higher setting frequency) than the other display operation states, as the display operation state shifted from the display operation state allocated to the adjacent input button.

Further, the display controller15bdisplays on the display unit12the guidance image for explaining each of the button operations of the ten-key in order to perform the mode-shift of the display operation state, instead of the guidance image corresponding to the mouse16.FIG. 11is a schematic view schematically showing one example of the guidance image for explaining the button operation of the ten-key in order to perform the mode-shift of the display operation state. The display controller15bperforms a control to display the guidance image133shown inFIG. 11, for example, instead of the guidance image132.

The guidance image133explains the button operation of the ten-key for performing the mode-shift of the display operation state as shown inFIG. 11. In this case, the correspondence between each input button and each display operation state shown in the guidance image133agrees with the result of the allocation of each display operation state to each input button by the control unit15. For example, in the guidance image133, the input button for shifting the mode to the pause state and the input button for shifting the mode to the mode having higher priority (e.g., play state “>”, fast play state “>>”, reverse play state “<”, reverse fast play state “<<”, frame play state “>|”, and reverse frame play state “|<”) as the next display operation state are displayed adjacently to each other. Further, the guidance image133indicates that the thumbnail corresponding to the observation image is additionally displayed in the subimage display area110by the button operation of depressing once the remaining input buttons of the ten-key (“2” key and “0” key inFIG. 11).

When the ten-key is selected from the select window141, each of the display operation states may be allocated to each input button of the ten-key unit provided at the keyboard constituting the input unit11, like the aforesaid ten-key. In this case, the guidance image133explains the button operation of each button of the ten-key unit of the keyboard.

On the other hand, when the keyboard is selected from the select window141, the control unit15allocates each display operation state to each input button of the keyboard constituting the input unit11. In this case, the control unit15allocates a desired display operation state and the next display operation state to the input buttons, which are adjacent to each other, of the input button group provided to the keyboard of the input unit11. Accordingly, the mode switching controller15aperforms a control to perform the mode-shift of the display operation state corresponding to the operated input button of the ten-key. It is desirable that the next display operation state is the display operation state that is shifted from the display operation state allocated to the adjacent input button and has higher priority (e.g., higher setting frequency) than the other states.

The display controller15bcauses the display unit12to display a guidance image for explaining the button operation of each button of the keyboard in order to perform the mode-shift of the display operation state, instead of the guidance image corresponding to the mouse16.FIG. 12is a schematic view for schematically showing one example of the guidance image for explaining the button operation of the keyboard to perform the mode-shift of the display operation state. The display controller15bperforms a control to display a guidance image134shown inFIG. 12, instead of the guidance image132.

The guidance image134explains the button operation of each button of the keyboard so as to perform the mode-shift of the display operation state as shown inFIG. 12. In this case, the correspondence between each input button and each display operation state shown in the guidance image134agrees with the result of the allocation of each display operation state to each button by the control unit15. For example, in the guidance image134, with respect to the input button for shifting the mode to the frame play state (upward arrow key) and the input button for shifting the mode to the reverse frame play mode (downward arrow key), the input buttons (specifically, rightward arrow key and leftward arrow key) for shifting the mode to the mode having higher priority (e.g., play state “>”, fast play state “>>”, reverse play state “<”, reverse fast play state “<<”) are displayed adjacently to each other as the next display operation states. Moreover, the guidance image134indicates that the mode is shifted to the play state or reverse play state by the button operation of depressing once the rightward arrow key or by the button operation of depressing once the leftward arrow key, and the mode is shifted to the fast play state or reverse fast play state by the button operation of depressing the rightward arrow key continuously twice or by the button operation of depressing the leftward arrow key continuously twice. Further, the guidance image134indicates that the thumbnail corresponding to the observation image is additionally displayed in the subimage display area110by the button operation of depressing once a space key.

When the display operation state is mode-shifted for every button operation of the mouse of the input unit11, the mode is shifted to the display operation state having higher priority as the display operation state subsequent to the display operation state before the mode-shift in the embodiment of the present invention. However, the present invention is not limited thereto. It may be configured such that the mode is shifted to the desired display operation state from the display operation state before the mode-shift for every button operation of the mouse at the input unit11. As one example of this configuration, the apparatus may be configured such that the mode is shifted along the arrangement of the display operation icons121to127, for example, for every button operation of the mouse. In this case, each of the display operation states may be allocated to the button operation of each button of the mouse in such a manner that the mode-shift is performed in a manner in which the frame play state is added between the pause state and the play state and the reverse frame play state is added between the pause state and the reverse play state in the state transition diagram shown inFIG. 8.

In the embodiment of the present invention, when the display operation state is mode-shifted for every button operation of the mouse16, the mode is shifted to the frame play state or reverse frame play state by moving the cursor K to the display operation icons122and125in the pause state. However, the invention is not limited thereto. The apparatus may be configured such that the frame play state and reverse frame play state are allocated to the button operation of the mouse16, and the mode is shifted to the frame play state or reverse frame play state by the button operation of the mouse16. In this case, for example, it may be configured such that the mode is shifted to the frame play state by the right double-click operation of the mouse16, and the mode is shifted to the reverse frame play state by the left double-click operation of the mouse16in the desired display operation state or all display operation states. Alternatively, it may be configured such that the mode is shifted to the frame play state by the button operation of depressing the right button16awith the left button16bdepressed, and the mode is shifted to the reverse frame play state by the button operation of depressing the left button16bwith the right button16adepressed.

Although the aforesaid state image and the guidance image are displayed in the frame of the specific area130in the embodiment of the present invention, the invention is not limited thereto. The state image and the guidance image may be displayed out of the frame of the specific area130.

In the embodiment of the present invention, the state image is displayed, and the display operation icon corresponding to the display operation state indicated by the state image is highlighted. However, the invention is not limited thereto. At least either one of the display of the state image and the highlighted display of the display operation icon may be performed.

In the embodiment of the present invention, the state image indicating the mark of the display operation icon is displayed. However, the invention is not limited thereto. A text indicating the display operation state or the state image indicating a desired mark may be displayed. Alternatively, a state image in which the mark of the display operation icon and the text indicating the display operation state are combined may be displayed.

In the embodiment of the present invention, the mouse16is employed as a pointing device constituting the input unit11. However, the invention is not limited thereto. Pointing devices of various forms, such as a mouse, trackball, touch pad, etc., may be employed. In this case, a mouse17provided with a scroll dial may be used instead of the mouse16.FIG. 13is a schematic view schematically showing one example of a guidance image corresponding to the mouse provided with the scroll dial.FIG. 14is a schematic view schematically illustrating the mouse provided with the scroll dial. It is to be noted thatFIG. 13illustrates the guidance image displayed in the pause state.

As shown inFIGS. 13 and 14, the mouse17has a configuration in which the scroll dial17ais further provided to the mouse16. The guidance image132bexplains the mode-shift operation of the display operation state using the mouse17. In this case, the guidance image132bexplains the button operation same as that of the aforesaid guidance image132, i.e., the button operation of each button for shifting the mode from the pause state to the play state, reverse play state, fast play state, or reverse fast play state, and further explains the scroll dial operation for shifting the mode to the frame play state or reverse frame play state. Specifically, the guidance image132bindicates that the mode is shifted to the frame play state when the scroll dial17ais turned in the upward direction inFIG. 14, and indicates that the mode is shifted to the reverse frame play state when the scroll dial17ais turned in the downward direction inFIG. 14. When the mouse17described above is used instead of the mouse16, the control unit15allocates the frame play state and the reverse frame play state to each scroll dial operation of the mouse17respectively, and the display controller15bmay perform a control to display the guidance image132bin the pause state instead of the guidance image132.

As explained above, in the embodiment of the present invention, when a specific area formed to have a predetermined size is displayed, and a cursor on a display screen is within this specific area, a button operation mode for performing an image display operation with the button operation of the input unit such as a mouse or keyboard is set. When the cursor on the display screen is out of the specific area, a cursor operation mode for performing the image display operation corresponding to the position on the display screen (e.g., display operation icon) and the position of the cursor is set. Therefore, if the cursor is positioned within the specific area, the image display operation can be performed by the button operation of the input unit, regardless of the position of the cursor, whereby the invention provides an effect of realizing an image display apparatus that can easily perform the image display operation while observing a series of images of the inside of a subject on the display screen.

By using the image display apparatus according to the present invention, an examiner such as a doctor or nurse can easily perform the image display operation, while observing the series of images of the inside of the subject displayed on the display screen. Therefore, the oversight of the image, which is to be observed, displayed on the display screen can be prevented, and further, the display operation state of the image, such as the pause state, play state, etc., can easily be switched.