Patent Description:
In the related art, an apparatus relevant to medical care (hereinafter, referred to as a medical apparatus) that acquires an image (hereinafter, referred to as a medical image) of a subject presents the acquired medical image to a doctor. Then, the doctor uses the medical image obtained from the medical apparatus as one of determination materials and performs diagnosis and the like. Needless to say, discrimination of a state of the subject or the like that is performed by using the medical image at the time of diagnosis is based on skill, experience, and the like of the doctor.

In recent years, since image analysis technology has advanced, various types of objective information can be acquired from the medical image by analyzing the medical image. For this reason, the medical apparatus that supports discrimination, diagnosis, and the like by presenting an analysis result of the medical image to a doctor or the like has been on the increase. For example, by analyzing the medical image, it is possible to obtain information on medicine and a treatment tool used in endoscopy (<CIT>). In addition, by analyzing the medical image, it is possible to automatically select a medical image showing a polyp from a series of medical images (<CIT>).

In accordance with the preamble of claim <NUM>, <CIT> discloses a medical image processing apparatus. A medical image processing apparatus according to the preamble of claim <NUM> is disclosed by <CIT>. According to US '<NUM> a machine acquired analysis or a manual analysis can be obtained. The endoscopist may manually identify the lesion type. That is to say, the machine acquired analysis is overwritten by manual operation.

EP '<NUM> discloses a medical image processing apparatus in which the display unit can further display a score used for obtaining the analysis result.

As described above, the medical apparatus or the like that not only simply obtains the medical image but also supports discrimination, diagnosis, and the like by providing the analysis result of the medical image or a function that uses the analysis result of the medical image has been on the increase. However, the analysis result of the medical images is only one of determination materials for discrimination and diagnosis unless approved by a doctor.

An object of the present invention is to provide a medical image processing apparatus, an endoscope apparatus, a diagnostic support apparatus, a medical service support apparatus, and a report creation support apparatus that can obtain an active and explicit approval for an analysis result of a medical image from a doctor.

A medical image processing apparatus according to the present invention comprises the features of claim <NUM>.

The medical image processing apparatus, the diagnostic support apparatus, the medical service support apparatus, and the report creation support apparatus of the present invention can obtain an active and explicit approval for the analysis result of the medical image from a doctor.

As shown in <FIG>, a medical image processing apparatus <NUM> comprises a medical image acquisition unit <NUM>, a medical image analysis result acquisition unit <NUM>, a display unit <NUM>, an input receiving unit <NUM>, a storage unit <NUM>, and an overall control unit <NUM>.

The medical image acquisition unit <NUM> acquires a medical image <NUM> including a subject image, for example, directly from a modality, such as an endoscope apparatus <NUM> that is a medical apparatus, or through a management system, such as a picture archiving and communication system (PACS) <NUM> in which the medical images <NUM> (refer to <FIG> or the like) acquired by various modalities are stored, or other information systems. The medical image <NUM> acquired by the medical image acquisition unit <NUM> depends on a modality that obtains the medical image <NUM>. That is, the medical image <NUM> acquired from the endoscope apparatus <NUM> is a so-called endoscopic image. The medical image <NUM> acquired from an ultrasound examination apparatus (not shown) is a so-called ultrasound image. In a case of acquiring a medical image from an X-ray imaging apparatus (not shown), the acquired medical image <NUM> is a so-called X-ray image. In a case of acquiring the medical image <NUM> from a computed tomography (CT) scanner or a magnetic resonance imaging (MRI) examination apparatus (neither are shown), a reconstructed image is the medical image <NUM>. The same applies to a case of acquiring the medical image <NUM> from other modalities. In addition, the same applies to a case of acquiring the medical image <NUM> through a management system such as the PACS <NUM>, or other information systems. Further, the medical image <NUM> is a still image or a motion picture. In a case where the medical image <NUM> is a motion picture, display of the medical image <NUM> includes not only displaying a still image of one representative frame forming the motion picture but also reproducing the motion picture once or multiple times.

In a case where there are a plurality of the medical images <NUM> in the endoscope apparatus <NUM>, the PACS <NUM>, or the like, the medical image acquisition unit <NUM> can select and acquire all or a part of a plurality of the medical images <NUM>. In a case of selecting and acquiring a part of medical images <NUM> from a plurality of the medical images <NUM> in the endoscope apparatus <NUM>, the PACS <NUM>, or the like, it is possible to manually select the medical images <NUM> in accordance with a user operation of a doctor or the like. In addition, the medical image acquisition unit <NUM> can automatically select the medical images <NUM> to be acquired according to the imaging date and time, an imaging part, or other conditions set in advance.

The medical image analysis result acquisition unit <NUM> acquires a result of analysis (hereinafter, referred to as an analysis result) of the medical image <NUM> including a subject image, for example, directly from a modality, such as the endoscope apparatus <NUM> that is a medical apparatus, or through a management system, such as the PACS <NUM> in which the medical images <NUM> acquired by various modalities are stored, or other information systems. The medical image analysis result acquisition unit <NUM> can acquire any analysis result of the medical image <NUM> from the endoscope apparatus <NUM>, the PACS <NUM>, or the like. However, in a case where there is an analysis result of the medical image <NUM> acquired by the medical image acquisition unit <NUM>, the medical image analysis result acquisition unit <NUM> acquires the analysis result of at least the medical image <NUM> acquired by the medical image acquisition unit <NUM>.

The analysis result of the medical image is a result obtained by image analysis of the medical image <NUM>. More specifically, the medical image analysis result includes, for example, one or a plurality of pieces of information on presence or absence of a lesion (including presence or absence of a portion that may be a lesion and a case of information of a position, a size, a range, or the like of a lesion or a portion that may be a lesion), a type of a lesion (including the properties of a subject in a case where there is no lesion; for example, neoplasm, non-neoplasm, normal, unknown, and the like), presence or absence of a treatment mark (for example, a trace of surgical treatment or a trace of treatment using a drug, radiation, or the like), a type of treatment mark, drug (for example, fluorescent drug) administered (including administration by spraying, injection, application, and the like) to the subject, presence or absence of reflection of an instrument such as a treatment instrument, and a type of an instrument such as a reflected treatment instrument.

In the present embodiment, as shown in <FIG>, the endoscope apparatus <NUM> has an endoscope <NUM> that emits at least one of light in a white wavelength band or light in a specific wavelength band to acquire an image, a light source device <NUM> that emits illumination light to the inside of the subject through the endoscope <NUM>, a processor device <NUM>, and a monitor <NUM> for displaying the medical image <NUM> (endoscopic image) or the like captured by using the endoscope <NUM>. Then, the processor device <NUM> comprises an image generation unit <NUM> that generates the medical image <NUM> (endoscopic image) and a medical image analysis processing unit <NUM> that analyzes the medical image <NUM> (endoscopic image) and obtains the analysis result.

In the present embodiment, the medical image processing apparatus <NUM> is connected to the endoscope apparatus <NUM> to acquire the medical image <NUM> (endoscopic image), and an analysis result of the medical image <NUM> (endoscopic image) from the endoscope apparatus <NUM>. Specifically, the medical image processing apparatus <NUM> is connected to the processor device <NUM>. Then, the medical image acquisition unit <NUM> acquires the medical image <NUM> (endoscopic image) from the image generation unit <NUM>, and the medical image analysis result acquisition unit <NUM> receives the analysis result of the medical image <NUM> (endoscopic image) from the medical image analysis processing unit <NUM>. As described above, the medical image acquired by the medical image acquisition unit <NUM> is specifically an endoscopic image. However, unless otherwise required to distinguish therebetween particularly, for the sake of simplicity, in the following, all of the medical images <NUM> acquired by the medical image acquisition unit <NUM> are referred to as the medical image <NUM>. In addition, in the present embodiment, the medical image analysis processing unit <NUM> obtains at least information on presence or absence of a lesion or a type of a lesion, as the analysis result of the medical image <NUM>. For this reason, the medical image analysis result acquisition unit <NUM> can acquire, from the medical image analysis processing unit <NUM>, at least information on presence or absence of a lesion or a type of a lesion with respect to the medical image <NUM> acquired by the medical image acquisition unit <NUM>, as the analysis result.

The display unit <NUM> displays at least one medical image <NUM> and at least information on presence or absence of a lesion or a type of a lesion among the analysis results acquired by the medical image analysis result acquisition unit <NUM>. As shown in <FIG>, the display unit <NUM> comprises a display <NUM> and a display control section <NUM> that controls a display aspect on the display screen <NUM> of the display <NUM>. Then, the display control section <NUM> comprises a medical image display control section <NUM>, an analysis result display control section <NUM>, and an operation display control section <NUM>.

The display <NUM> includes a display screen <NUM> (refer to <FIG> or the like) on which the medical image <NUM> acquired by the medical image acquisition unit <NUM> and the analysis result of the medical image <NUM> acquired by the medical image analysis result acquisition unit <NUM> are displayed. As shown in <FIG> or the like, by displaying the medical image <NUM> and the analysis result of the medical image <NUM> collectively, a user can check the medical image <NUM> and approve and correct the analysis result of the medical image <NUM>. In the present embodiment, the display <NUM> is provided in the medical image processing apparatus <NUM> and is different from the monitor <NUM> of the endoscope apparatus <NUM> to which the medical image processing apparatus <NUM> is connected. Here, the display <NUM> can be commonly used as a monitor or display of a device or a system such as the endoscope apparatus <NUM> to which the medical image processing apparatus <NUM> is connected.

The medical image display control section <NUM> controls a position, a size, and the like for displaying the medical image <NUM> acquired by the medical image acquisition unit <NUM>. In addition, in a case where the medical image acquisition unit <NUM> acquires a plurality of medical images <NUM>, the medical image display control section <NUM> can display one or a plurality of medical images <NUM> among a plurality of the medical images <NUM> on the display screen <NUM>. In a case where a plurality of medical images are displayed on the display screen <NUM>, the medical image display control section <NUM> also controls the display order (array) of a plurality of the medical images <NUM>. In addition, in a case where the medical image <NUM> displayed on the display screen <NUM> is subjected to a click operation or the like, the medical image display control section <NUM> may enlarge the medical image <NUM> to be displayed, for example. In this case, the medical image display control section <NUM> controls generation of a window (display region) for displaying the medical image <NUM> to be enlarged and control of an enlargement ratio.

In a case where there is an analysis result acquired by the medical image analysis result acquisition unit <NUM> for the medical image <NUM> to be displayed on the display screen <NUM>, the analysis result display control section <NUM> controls a display position or the like of the analysis result relating to the medical image <NUM> to be displayed on the display screen <NUM> in accordance with a display position of the medical image <NUM>. In addition, in a case where there are a plurality of analysis results relating to one medical image <NUM> displayed on the display screen <NUM>, the analysis result display control section <NUM> can select one or a plurality of analysis results for one medical image <NUM>, or display all of the analysis results on the display screen <NUM>. In a case where a part of a plurality of the analysis results is displayed on the display screen <NUM>, the analysis result display control section <NUM> selects one or a plurality of analysis results to be displayed on the display screen <NUM> in accordance with display setting of the analysis results. According to the invention, information on presence or absence of a lesion or a type of a lesion among the analysis results acquired by the medical image analysis result acquisition unit <NUM> is displayed. The "information on presence or absence of a lesion or a type of a lesion" to be displayed in the present embodiment is "neoplasm", "non-neoplasm", "normal", or "unknown".

The operation display control section <NUM> provides an operation display such as a button, a switch, a check box, or a scroll bar on the display screen <NUM>. In addition, the operation display control section <NUM> controls a pointer, a cursor, or the like relating to an operation of a pointing device such as a mouse.

In the present embodiment, the operation display control section <NUM> provides a pull-down menu display button <NUM> in the analysis result display field <NUM> for displaying the analysis result. The pull-down menu display button <NUM> is operated in a case where it cannot be said that "information on presence or absence of a lesion or a type of a lesion", which is the analysis result displayed in the analysis result display field <NUM>, is correct from a medical viewpoint (it cannot be approved as at least correct information). Accordingly, it is possible to correct the analysis result displayed in the analysis result display field <NUM> to the information that is correct (at least not erroneous) from a medical viewpoint using a pull-down menu <NUM> (refer to see <FIG>) optionally. The correction operation using the pull-down menu <NUM> is an input of correction information for correcting information on presence or absence of a lesion or a type of a lesion included in the analysis result.

In addition, in the present embodiment, the operation display control section <NUM> provides an approval button <NUM> (refer to <FIG> and the like) on the display screen <NUM>. The approval button <NUM> actively and explicitly gives an approval to the analysis result displayed in the analysis result display field <NUM>. Therefore, the approval button <NUM> is operated in a case where the analysis result displayed in the analysis result display field <NUM> (or contents input using the pull-down menu <NUM>) is actively and explicitly approved as being correct. In addition to this, in the present embodiment, the operation display control section <NUM> displays a pointer <NUM> relating to an operation of a pointing device (not shown) on the display screen <NUM>.

As described above, the medical image <NUM> and the analysis result of the medical image <NUM> are displayed on the display screen <NUM>, and in addition to this, the display control section <NUM> can display information on a patient such as a name and other information on the medical image <NUM> such as an identification (ID) number for identifying the medical image <NUM>, a name of an observation site, or imaging date and time on the display screen <NUM> appropriately according to display setting.

The input receiving unit <NUM> receives an input from a mouse, a keyboard, and other operation devices for performing operation input using various displays for an operation to be displayed on the display screen <NUM> by the operation display control section <NUM>. The operation for receiving an input by the input receiving unit <NUM> includes operations of the pull-down menu display button <NUM>, the pull-down menu <NUM>, and the approval button <NUM> in the analysis result display field <NUM>. The operations of the pull-down menu display button <NUM>, the pull-down menu <NUM>, and the approval button <NUM> are operations to perform an input regarding whether or not "information on presence or absence of a lesion or a type of a lesion" displayed in the analysis result display field <NUM> among information pieces included in the analysis result is correct. Therefore, in the present embodiment, the input receiving unit <NUM> receives an input regarding whether or not at least the information on presence or absence of a lesion or a type of a lesion included in the analysis result is correct. In addition, a reception of the correction operation using the pull-down menu <NUM> is a reception of an input of correction information for correcting information on presence or absence of a lesion or a type of a lesion included in the analysis result. That is, in the present embodiment, the input receiving unit <NUM> receives an input of correction information for correcting at least the information on presence or absence of a lesion or a type of a lesion included in the analysis result.

In a case where the approval button <NUM> is operated, the storage unit <NUM> stores the medical image <NUM> displayed on the display screen <NUM> and the analysis result displayed in the analysis result display field <NUM> (including a case where the contents are corrected using the pull-down menu <NUM>) in association with each other. In the present embodiment, the storage unit <NUM> stores the information on presence or absence of a lesion or a type of a lesion, for which the input regarding whether or not the information is correct is received by the input receiving unit <NUM>, and the medical image <NUM> relating to "the information on presence or absence of a lesion or a type of a lesion", for which the input regarding whether or not the information is correct is received by the input receiving unit, in association with each other. In addition, in the present embodiment, the storage unit <NUM> includes a memory, a hard disk, and other storages, for example. For this reason, the storage unit <NUM> stores an approved combination of the medical image <NUM> and the analysis result in the storage unit <NUM> itself in association with each other. Here, the storage unit <NUM> can store the approved combination of the medical image <NUM> and the analysis result in a storage (not shown) provided in a management system such as the PACS <NUM>, other information systems, the endoscope apparatus <NUM> or the like, or other external storages such as a network attached storage (NAS) in association with each other.

The overall control unit <NUM> controls an overall operation of each unit of the medical image processing apparatus <NUM>. For example, the overall control unit <NUM> realizes the operation of the medical image processing apparatus <NUM> corresponding to various operations of the pull-down menu display button <NUM>, the pull-down menu <NUM>, the approval button <NUM>, or the like displayed on the display screen <NUM>.

Hereinafter, an operation flow of the medical image processing apparatus <NUM> configured as the above will be described. As shown in <FIG>, the medical image acquisition unit <NUM> acquires one or a plurality of medical images <NUM> from the endoscope apparatus <NUM> or the like automatically or by manual selection (step S11). In addition, the medical image analysis result acquisition unit <NUM> acquires analysis results relating to one or a plurality of medical images <NUM> from the endoscope apparatus <NUM> or the like automatically or by manual selection (step S12).

In a case where the medical image <NUM> and the analysis result are acquired, as shown in <FIG>, the display unit <NUM> displays the medical image <NUM> on the display screen <NUM> and displays an analysis result relating to the medical images <NUM> ("neoplasm" in <FIG>) displayed on the display screen <NUM> in the analysis result display field <NUM> (step S13). At this time, the operation display control section <NUM> displays the pull-down menu display button <NUM> in the analysis result display field <NUM> and allows the analysis result displayed in the analysis result display field <NUM> to be corrected. In addition, the operation display control section <NUM> displays an approval button <NUM> on the display screen <NUM>, and allows the analysis result displayed in the analysis result display field <NUM> or the analysis result corrected using the pull-down menu <NUM> to be approved. These operations of the approval button <NUM> and the like can be performed using a pointer <NUM>, for example.

In a case where the medical image <NUM> and the analysis result are displayed on the display screen <NUM>, the input receiving unit <NUM> waits for a reception of an input (step S14). At this time, the doctor refers to the medical image <NUM> displayed on the display screen <NUM>, the analysis result ("neoplasm") displayed in the analysis result display field <NUM>, and the like to discriminate or diagnose the subject.

In a case where the analysis result displayed in the analysis result display field <NUM> is correct and can be approved as it is, the doctor operates a pointing device, for example, and as a result, clicks the approval button <NUM> with the pointer <NUM>. In a case where the approval button <NUM> is clicked, the input receiving unit <NUM> receives a click on the approval button <NUM>. Accordingly, the doctor actively and explicitly gives an approval to the analysis result displayed in the analysis result display field <NUM> (step S15: YES).

Then, in a case where the input receiving unit <NUM> receives a click on the approval button <NUM>, the storage unit <NUM> stores the medical image <NUM> displayed on the display screen <NUM> and the analysis result displayed in the analysis result display field <NUM> in association with each other (step S16). In a case where the storage unit <NUM> stores the medical image <NUM> and the analysis result in association with each other, the display unit <NUM> displays the medical image <NUM> to be displayed next, the analysis result, and the like on the display screen <NUM>. Accordingly, the medical image processing apparatus <NUM> sequentially displays one or more medical images <NUM> and the like on the display screen <NUM>.

On the other hand, in a case where the analysis result displayed in the analysis result display field <NUM> is not correct and the analysis result displayed in the analysis result display field <NUM> is not approved (step S15: NO), as shown in <FIG>, the doctor clicks the pull-down menu display button <NUM> with the pointer <NUM>. Then, the operation display control section <NUM> displays the pull-down menu <NUM> in the analysis result display field <NUM>. According to the invention, the analysis result to be displayed in the analysis result display field <NUM> is "the information on presence or absence of a lesion or a type of a lesion", specifically "neoplasm", "non-neoplasm", "normal", or "unknown". For this reason, the operation display control section <NUM> displays a list of items of "neoplasm", "non-neoplasm", "normal", and "unknown" in the pull-down menu <NUM>. In addition, the operation display control section <NUM> attaches a selection mark <NUM> to an item (item "non-neoplasm" in <FIG>) on which the pointer <NUM> is superimposed.

In a case where the input receiving unit <NUM> receives a click on an item in the pull-down menu <NUM>, the analysis result display control section <NUM> corrects the item to be displayed in the analysis result display field <NUM> to the item selected by clicking in the pull-down menu <NUM>. Thereafter, the approval button <NUM> is clicked, and as a result, an approval is actively and explicitly given to the corrected analysis result (step S15: YES). In a case where the corrected analysis result is approved in this way, the storage unit <NUM> stores the medical image <NUM> displayed on the display screen <NUM> and the analysis result displayed in the analysis result display field <NUM> in association with each other (step S16).

As described above, the medical image processing apparatus <NUM> can obtain an active and explicit approval from the doctor for the analysis result of the medical image <NUM>. In particular, in the present embodiment, an active and explicit approval can be obtained for at least information on presence or absence of a lesion or a type of a lesion among the analysis results relating to the medical image <NUM>. Since the information on presence or absence of a lesion or a type of a lesion is medically valid only after the approval of a doctor, it is particularly necessary to obtain an approval.

In addition, in a case where the doctor does not approve the analysis result as it is in a case where the analysis result of the medical image <NUM> is not correct, or the like, the medical image processing apparatus <NUM> gives an opportunity to input the correction information for correcting the analysis result of the medical image <NUM>, as an aspect of an approval operation. For this reason, the doctor does not have to necessarily receive the analysis result of the medical image <NUM>, and can correct the analysis result optionally and easily (including leaving one to be corrected as a log) according to a determination based on his/her medical viewpoint.

Further, in the first embodiment, the pull-down menu display button <NUM> is displayed in the analysis result display field <NUM>, and the correction information of the analysis result is input using the pull-down menu display button <NUM> and the pull-down menu <NUM>. However, it is possible to receive an input of the correction information in other forms. For example, as shown in <FIG>, the analysis result display field <NUM> itself is used as a correction item display button for displaying items (correction items) representing the correction information. That is, the analysis result display field <NUM> is used as the correction item display button. Then, as shown in <FIG>, in a case where the analysis result display field <NUM> is clicked with the pointer <NUM>, for example, around the analysis result display field <NUM>, correction items 59a to 59d of "neoplasm", "non-neoplasm", "normal", and "unknown" are displayed, and one of these is selected by clicking with the pointer <NUM> or the like. Accordingly, it is possible to input the correction item of the analysis result. In addition this, for example, in a case where the analysis result display field <NUM> is set as a region in which an input can be performed, it is possible to input the correction information with any word using a character input device such as a keyboard instead of selecting a correction item. In the following, the same applies to a case where correction information is input using the pull-down menu display button <NUM> and the pull-down menu <NUM>.

In the first embodiment, the approval button <NUM> is displayed on the display screen <NUM>. However, instead of the operation of the approval button <NUM>, it may be possible to perform the approval operation by a gesture input for performing an input using a movement trajectory of the pointer <NUM>. In addition, it may be possible to perform the approval operation using not only the pointing device but also other devices (such as a physical button or a switch provided in the medical image processing apparatus <NUM>).

In the first embodiment, as an example, one medical image <NUM> is displayed on the display screen <NUM>. However, it is possible to display a plurality of the medical images <NUM> collectively on the display screen <NUM>. In the second embodiment, an example in which a plurality of the medical images <NUM> are displayed on the display screen <NUM> is described, but a configuration of the medical image processing apparatus <NUM> is the same as that of the first embodiment.

As shown in <FIG>, in a case where a plurality of the medical images <NUM> are displayed on the display screen <NUM>, the approval button <NUM> can be provided for each medical image <NUM>, for example. In addition, since the analysis result is different for each medical image <NUM>, the analysis result display field <NUM> and the pull-down menu display button <NUM> are provided for each medical image <NUM> to display the analysis result. In this case, it is possible to obtain an active and explicit approval for the analysis result for each medical image <NUM>.

As shown in <FIG>, in a case where a plurality of the medical images <NUM> are displayed on the display screen <NUM> and the approval button <NUM> is provided for each medical image <NUM> respectively, it is preferable that each approval button <NUM> shows whether or not the approval operation has been performed. In <FIG>, "unapproved" is displayed in the approval button <NUM> for the medical image <NUM> for which the approval operation has not been completed, and "approved" is displayed in the approval button <NUM> for the medical image <NUM> for which the approval operation has been completed. In this way, even in a case where a plurality of the medical images <NUM> and approval buttons <NUM> are displayed on the display screen <NUM>, it is clear whether the approval operation has been completed for each medical image <NUM>, and the approval operation is not forgotten.

In <FIG> and <FIG>, the approval button <NUM> is displayed for each medical image <NUM> respectively, but instead of displaying the approval button <NUM> for each medical image <NUM> respectively, as shown in <FIG>, it is possible to display a representative approval button <NUM> for giving an approval to a combination of all of the medical images <NUM> and the analysis results simultaneously. In this case, it is not necessary to perform an approval operation for each of a plurality of the medical images <NUM> and the analysis results respectively, and thus, the approval operation can be performed more easily.

In <FIG> and <FIG>, a plurality of the medical images <NUM> to be displayed are all contained in the display screen <NUM>, but depending on a size of the medical image <NUM> and the display screen <NUM>, all of the medical images <NUM> may not be contained on the display screen <NUM>. In this case, as shown in <FIG> and <FIG>, the operation display control section <NUM> displays a scroll bar <NUM> for scrolling display contents of the display screen <NUM>. Accordingly, it is possible to display the medical images <NUM> that do not fit at a time on the display screen <NUM>. In a case where it is possible to display a plurality of the medical images <NUM> using the scroll bar <NUM> and the approval operation is performed using the representative approval button <NUM> for giving the approval to the combination of all of the medical images <NUM> and the analysis results simultaneously, the representative approval button <NUM> is preferably displayed on the display screen <NUM> after scrolling (refer to <FIG>) (in particular, a lower end of the display screen <NUM> after scrolling). Accordingly, in a case where the representative approval button <NUM> is provided on the display screen <NUM> after scrolling, it is possible to prevent the approval operation from being performed without checking the medical image <NUM> to be displayed on the display screen <NUM>, that is the medical image <NUM> not yet displayed on the display screen <NUM>.

In addition, in a case where the representative approval button <NUM> is displayed at a display position other than a display position shown in <FIG> and <FIG>, it is preferable that the operation display control section <NUM> validates the representative approval button <NUM> after displaying all of the medical images <NUM> to be displayed at least once. For example, as shown in <FIG> and <FIG>, a constant display field <NUM> that is constantly displayed on the display screen <NUM> without depending on a position (operation state) of the scroll bar <NUM> is provided, and the representative approval button <NUM> is displayed in the constant display field <NUM>. In this case, the operation display control section <NUM> invalidates the approval operation on the display screen <NUM> before scrolling (refer to <FIG>). The invalidation of the approval operation means that the input receiving unit <NUM> does not receive the approval operation by clicking the approval button <NUM> and the like. The invalidation of the approval operation includes that the operation display control section <NUM> does not display the approval button <NUM> (display is hidden) even in a case where the input receiving unit <NUM> can receive the input of the click operation of the approval button <NUM>, so as to be a state where the approval operation cannot be performed.

Then, the operation display control section <NUM> validates the approval operation in a case where the display screen <NUM> after scrolling (refer to <FIG>) is displayed at least once and, as a result, it is confirmed that all of the medical images <NUM> to be displayed are displayed at least once. The validation of the approval operation means a state where the input receiving unit <NUM> can receive the approval operation by clicking the approval button <NUM> and the like, and, in addition to this, a state where the approval operation can be performed without lacking the display necessary for the approval operation.

As described above, in a case where the approval operation is invalidated or validated, it is possible to prevent the approval operation from being performed without checking the medical image <NUM> to be displayed on the display screen <NUM>, that is the medical image <NUM> not yet displayed on the display screen <NUM>. The same applies to a case where the representative approval button <NUM> is displayed in a pop-up manner or the like instead of providing the constant display field <NUM>.

Further, in <FIG> in which the scroll bar <NUM> is displayed, the representative approval button <NUM> for giving the approval to the combination of all of the medical images <NUM> and the analysis results simultaneously is provided. However, even in a case where the scroll bar <NUM> is displayed, the separate approval button <NUM> can be provided for each of a plurality of medical images <NUM>.

In the second embodiment, the approval operation can be performed for all of a plurality of medical images <NUM> and the display of the analysis results displayed on the display screen <NUM>. However, it is preferable to allow the combination of the medical images <NUM> and the analysis results for which the approval operation can be performed, to be selected optionally. In this case, the operation display control section <NUM> provides the display screen <NUM> with a selection unit <NUM> (refer to <FIG>) for selecting one or more medical images <NUM> or one or more analysis results relating to the medical images <NUM>. Then, the input receiving unit <NUM> receives an input regarding whether or not the analysis results relating to the medical images <NUM> selected by the selection unit <NUM> (in the present embodiment, "information on presence or absence of a lesion or a type of a lesion") or the analysis results selected by the selection unit <NUM> (in the present embodiment, at least "information on presence or absence of a lesion or a type of a lesion" among the selected analysis results) are correct. In addition, the input receiving unit <NUM> receives an input of the correction information for the analysis results relating to the medical images <NUM> selected by the selection unit <NUM> or the analysis results selected by the selection unit <NUM>.

For example, as shown in <FIG>, a check box is provided as the selection unit <NUM> for each medical image <NUM> displayed on the display screen <NUM>. Then, the pull-down menu display button <NUM> and the approval button <NUM> are validated only for the medical image <NUM> and the analysis result that are checked in the check box which is the selection unit <NUM> with a mark ("V" mark in <FIG>), and an input of the correction information and an approval operation are received only for the checked medical image and the analysis result. In this way, even in a case where a plurality of medical images <NUM> are displayed on the display screen <NUM>, an input of an approval operation or correction information can be performed for each medical image <NUM>.

In <FIG>, the selection unit <NUM> is provided for each medical image <NUM>, but the selection unit <NUM> can be provided for each analysis result. In this case, correction information can be input for each analysis result. In particular, in a case where there are a plurality of analysis results for one medical image <NUM> and a plurality of analysis results for one medical image <NUM> are displayed on the display screen <NUM>, in a case where the selection unit <NUM> is provided for each of a plurality of displayed analysis results, it is possible to selectively input correction information for any analysis result among a plurality of analysis results to be displayed.

Further, the selection unit <NUM> can be provided for each medical image <NUM> and for each analysis information. In addition, in <FIG>, an approval button <NUM> is provided for each medical image <NUM>, but, as shown in the second embodiment, instead of providing an approval button <NUM> for each medical image <NUM>, a representative approval button <NUM> can be provided. By doing so, it is possible to perform the approval operation for the medical images <NUM> selected by the selection unit <NUM> simultaneously.

In the above first embodiment, second embodiment, and third embodiment, although the medical image <NUM> to be displayed on the display screen <NUM> is displayed on the display screen <NUM>, but, in the display screen <NUM> in which an approval operation is performed, a minified image (so-called thumbnail image) <NUM> of the medical image <NUM> may be displayed. In this case, for example, as shown in <FIG>, a listing performance on the display screen <NUM> is improved. For this reason, in addition to the analysis result shown in the analysis result display field <NUM>, a score 72a, a score 72b, and the like of an index used for obtaining the analysis result can be further displayed on the display screen <NUM>. The score 72a and the score 72b are indices representing a probability of the analysis result output from the medical image analysis processing unit <NUM>, a likelihood of a lesion, or the like, for example. In addition, in a case where the input receiving unit <NUM> receives an operation input by clicking on the minified image <NUM>, the operation display control section <NUM> displays a medical image <NUM> that is an original image of the minified image <NUM> on which a click operation has been performed, on a pop-up window <NUM>, for example (refer to <FIG>). For this reason, even in a case where in the display screen <NUM> in which the approval operation is performed, the medical image <NUM> is displayed using the minified image <NUM>, the doctor can make discrimination or diagnosis using the medical image <NUM> optionally and easily.

A check box <NUM> is a check box for showing that the medical image <NUM> and the analysis result have been checked. Then, in a case where all of the check boxes <NUM> are in a checked state ("V" mark in <FIG>), the input receiving unit <NUM> or the operation display control section <NUM> validates a diagnosis completion button <NUM> in the display screen <NUM> after scrolling (refer to <FIG>). The diagnosis completion button <NUM> is a button for completing diagnosis and switching the display screen <NUM> to another screen, but is substantially used for an approval operation. That is, the diagnosis completion button <NUM> corresponds to the representative approval button <NUM> in the second embodiment or the third embodiment.

A reflection button <NUM> is a button used for the approval operation. Specifically, for at least one of the minified images <NUM> to be displayed on the display screen <NUM>, in a case where the analysis result displayed in the analysis result display field <NUM> is corrected, in a case where the medical image <NUM> is displayed in the pop-up window <NUM>, or in a case where a state of the check box <NUM> is changed, the operation display control section <NUM> validates the reflection button <NUM>. The operation of the medical image processing apparatus <NUM> performed in a case where the reflection button <NUM> is clicked is the same as that in the first embodiment, the second embodiment, or the third embodiment.

In addition, a star <NUM> is an identification flag attached to the minified image <NUM> of the medical image <NUM> useful for creating a report. In a default state, for example, the star is white blank, and for the minified image <NUM> of the medical image <NUM> that is useful for creating a report, the star is shown in black. The determination regarding whether or not it is the minified image <NUM> of the medical image <NUM> useful for creating a report can be made automatically by the medical image processing apparatus <NUM> or manually by a doctor. In a case where the medical image processing apparatus <NUM> determines automatically, for example, a usefulness determination unit (not shown) is provided in the overall control unit <NUM>. Then, the usefulness determination unit determines whether or not the medical image <NUM> is useful for creating a report using analysis results such as an index value (score 72b or the like), for example. In a case where the analysis results include a determination result regarding whether or not the medical image is useful for creating the report, the medical image processing apparatus <NUM> uses the determination result of the usefulness among the determination results to determine a display form of the star <NUM>. In a case of manually correcting the display form of the star <NUM> according to the determination of the doctor, for example, the star <NUM> is clicked with the pointer <NUM>.

A return button <NUM> is a button for returning to a previous screen such as a menu screen. A screen displayed in a case where the return button <NUM> is clicked has, for example, an examination target list <NUM>, a folder addition button <NUM>, a diagnosis processing start button <NUM>, and the like on the display screen <NUM>, as shown in <FIG>. The examination target list <NUM> includes a folder field 81a, a diagnosis support field 81b, a status display field 81c, and another display field 81d. The status display field 81c is a field for displaying a status relating to diagnosis processing or the like for each folder, for example, "in correction", "in correction (with biopsy)", "completed", or the like. The examination target list <NUM> can be sorted by using "in correction", "in correction (with biopsy)", "completed", or a blank status of the status display field 81c. In a case where the diagnosis processing start button <NUM> is clicked, the display screen <NUM> is switched to the state of <FIG>. In addition, any folder can be added to the examination target list <NUM> by clicking the folder addition button <NUM>.

In the first embodiment, the second embodiment, the third embodiment, and the fourth embodiment, as shown in <FIG>, in a case where there is an approval operation with respect to the combination of the medical image <NUM> and the analysis result <NUM>, the storage unit <NUM> stores a set <NUM> of the medical image <NUM> and the analysis result <NUM>, with the medical image <NUM> and the analysis result <NUM> being in association with each other. In addition, in a case where the analysis result <NUM> needs to be corrected, as shown in <FIG>, the storage unit <NUM> stores a set <NUM> of a medical image <NUM> and a correction analysis result <NUM> obtained by correcting a part or all of the analysis result <NUM> relating to the medical image <NUM>, with the medical image <NUM> and the correction analysis result <NUM> being in association with each other.

However, the storage form of the medical image <NUM> and the analysis result <NUM> or the correction analysis result <NUM> by the storage unit <NUM> is not limited to this. For example, as shown in <FIG>, in a case where the analysis result <NUM> relating to the medical image <NUM> is corrected, the storage unit <NUM> can store a set <NUM> of a medical image <NUM>, an analysis result <NUM> before correction, and a correction analysis result <NUM> obtained by replacing a part or all of the analysis result <NUM> with contents of correction information, with the medical image, the analysis result, and the correction analysis result being in association with one another. Furthermore, in the first embodiment, the second embodiment, the third embodiment, the fourth embodiment, or each example shown in <FIG>, the storage unit <NUM> may store a flag (data for identification) indicating that approval has been performed in association with one or a plurality of the medical image <NUM>, the analysis result <NUM> before correction, or the correction analysis result <NUM>. In addition, at this time, identification information such as a name or ID of the user who has performed the approval operation may be stored in association with each other.

In the first embodiment, the second embodiment, the third embodiment, and the fourth embodiment, the medical images <NUM> acquired by the medical image acquisition unit <NUM> are basically all displayed on the display screen <NUM>, but the display unit <NUM> can select a part of a plurality of medical images <NUM> acquired by the medical image acquisition unit <NUM> to display the selected medical images on the display screen <NUM>. In this case, for example, as shown in <FIG>, the medical image acquisition unit <NUM> acquires a plurality of medical images <NUM> from the endoscope apparatus <NUM> or the like automatically or by manual selection (step S501). In addition, the medical image analysis result acquisition unit <NUM> acquires analysis results relating to a plurality of medical images <NUM> from the endoscope apparatus <NUM> or the like automatically or by manual selection (step S502).

Thereafter, the medical image display control section <NUM> groups a plurality of medical images <NUM> acquired by the medical image acquisition unit <NUM> (step S503). The medical image display control section <NUM> groups plurality of medical images <NUM> using, for example, each analysis result relating to a plurality of medical images <NUM>, a score of a feature amount, similarity, or the like calculated uniquely by the medical image display control section <NUM>, or other information such as an imaging time or an imaging part. As a result, a plurality of medical images <NUM> belong to any group of a group of "neoplasm", a group of "non-neoplasm", a group of "normal", or a group of "unknown", for example. In addition, the medical image display control section <NUM> selects a representative image for each group (S504). The representative image of each group is selected according to a preset rule using, for example, a brightness of the medical image <NUM> or a type or a color of a neoplasm in the case of a neoplasm group.

As described above, in a case where the medical image display control section <NUM> selects the representative image of each group, the display unit <NUM> displays the representative image (or the minified image of the representative image) of each group on the display screen <NUM>. As described above, in a case where the medical image acquisition unit <NUM> acquires a plurality of medical images <NUM>, a plurality of medical images <NUM> acquired by the medical image acquisition unit <NUM> are grouped and the representative image of each group is displayed on the display screen <NUM>. In this case, it is possible to observe a small number of characteristic medical images <NUM> such as the representative image of each group and to approximately complete discrimination or diagnosis. Therefore, the doctor can easily make discrimination or diagnosis.

Further, a display aspect such as the representative image of each group and an operation aspect (steps S506 to S508) such as the approval operation after displaying the representative image of each group on the display screen <NUM> are the same as those in the first embodiment.

In the first embodiment, the second embodiment, the third embodiment, the fourth embodiment, and other modification examples, the medical image analysis processing unit <NUM> is provided in the processor device <NUM> of the endoscope apparatus <NUM>. However, as shown in <FIG>, the medical image analysis processing unit <NUM> can be provided in the medical image processing apparatus <NUM>. In this case, the medical image analysis result acquisition unit <NUM> can acquire the analysis result from the medical image analysis processing unit <NUM> provided in the medical image processing apparatus <NUM>.

In addition, the endoscope apparatus <NUM> can include the medical image processing apparatus <NUM>. In this case, as shown in <FIG>, each unit <NUM> forming the medical image processing apparatus <NUM> is provided in the processor device <NUM>. Here, since the display <NUM> of the display unit <NUM> can be commonly used as the monitor <NUM> of the endoscope apparatus <NUM>, it is sufficient to provide the processor device <NUM> with the display control section <NUM> that is a part of the display unit <NUM>, instead of the display unit <NUM>. In addition, a new endoscope apparatus can be configured by all of the medical image processing apparatus <NUM> of each of the first embodiment, the second embodiment, the third embodiment, the fourth embodiment, and other modification examples, and the endoscope apparatus <NUM> shown in <FIG>.

In addition, as shown in <FIG>, a diagnostic support apparatus <NUM> used in combination with other modalities such as the endoscope apparatus <NUM> can include the medical image processing apparatus <NUM> of each of the first embodiment, the second embodiment, the third embodiment, the fourth embodiment, and other modification examples. In addition, as shown in <FIG>, for example, a medical service support apparatus <NUM> connected to various examination apparatuses including the endoscope apparatus <NUM>, such as a first examination apparatus <NUM>, a second examination apparatus <NUM>,. , and an N-th examination apparatus <NUM>, through a certain network <NUM> can include the medical image processing apparatus <NUM> of each of the first embodiment, the second embodiment, the third embodiment, the fourth embodiment, and other modification examples.

In addition, as shown in <FIG>, a report creation support apparatus <NUM> that supports a doctor in creating a report, is configured to comprise a report creating unit <NUM> that creates a report using the analysis result, and the medical image processing apparatus <NUM> of each of the first embodiment, the second embodiment, the third embodiment, the fourth embodiment, and other modifications. As shown in <FIG>, a report <NUM> that is created by the report creating unit <NUM> has, for example, a display field for the medical image <NUM>, a basic input field <NUM> for inputting information such as a patient or an examination, and an opinion input field <NUM> for inputting an opinion of a doctor. The report creating unit <NUM> or the medical image processing apparatus <NUM> can automatically insert the medical image <NUM> approved by the doctor in the medical image processing apparatus <NUM> into the report <NUM>. In addition, the report creating unit <NUM> or the medical image processing apparatus <NUM> can automatically insert the analysis result (including the correction analysis result <NUM> or the combination of the analysis result <NUM> and the correction analysis result <NUM>) approved by the doctor in the medical image processing apparatus <NUM> into the basic input field <NUM>, the opinion input field <NUM>, or both of these fields. As described above, in a case where the medical image <NUM>, the information of the analysis result, or the like approved by the doctor in the medical image processing apparatus <NUM> is automatically inserted, it is possible to easily create a report.

In addition to this, the medical image processing apparatus <NUM>, various apparatuses including the medical image processing apparatus <NUM>, and various apparatuses or systems having a function of the medical image processing apparatus <NUM> can be used by making the following various changes or the like.

The medical image analysis processing unit <NUM> can detect a region of interest that is a region to be observed, based on the feature amount of a pixel of the medical image <NUM>, and obtain at least information on presence or absence of a lesion or a type of a lesion for the region of interest. In a case where the endoscope apparatus <NUM> or the like comprises the medical image analysis processing unit <NUM>, the medical image analysis result acquisition unit <NUM> can acquire the analysis result from the medical image analysis processing unit <NUM>.

The medical image analysis result acquisition unit <NUM> can acquire the analysis result from a recording apparatus that records the analysis result relating to the medical image <NUM>. A storage (not shown) provided in a management system such as the PACS <NUM>, other information systems, the endoscope apparatus <NUM>, or the like, or other external storages such as a network attached storage (NAS) are examples of the recording apparatus.

As a medical image <NUM>, it is possible to use a normal light image obtained by emitting light in a white band or light in a plurality of wavelength bands as the light in the white band.

In a case where an image obtained by emitting light in a specific wavelength band is used as a medical image <NUM>, a band narrower than the white wavelength band can be used as the specific wavelength band.

The specific wavelength band is, for example, a blue band or a green band of a visible range.

In a case where the specific wavelength band is the blue band or the green band of a visible range, it is preferable that the specific wavelength band includes a wavelength band of <NUM> to <NUM> or a wavelength band of <NUM> to <NUM> and that light in the specific wavelength band has a peak wavelength within the wavelength band of <NUM> to <NUM> or the wavelength band of <NUM> to <NUM>.

The specific wavelength band is, for example, a red band of a visible range.

In a case where the specific wavelength band is the red band of a visible range, it is preferable that the specific wavelength band includes a wavelength band of <NUM> to <NUM> or a wavelength band of <NUM> to <NUM> and that light in the specific wavelength band has a peak wavelength within the wavelength band of <NUM> to <NUM> or the wavelength band of <NUM> to <NUM>.

The specific wavelength band can include, for example, a wavelength band in which light absorption coefficients of oxygenated hemoglobin and reduced hemoglobin are different, and light in the specific wavelength band can have a peak wavelength in the wavelength band in which light absorption coefficients of oxygenated hemoglobin and reduced hemoglobin are different.

In a case where the specific wavelength band includes a wavelength band in which the light absorption coefficients of oxygenated hemoglobin and reduced hemoglobin are different and the light in the specific wavelength band has a peak wavelength in the wavelength band in which the light absorption coefficients of oxygenated hemoglobin and reduced hemoglobin are different, it is preferable that the specific wavelength band includes a wavelength band of <NUM> ± <NUM>, <NUM> ± <NUM>, <NUM> ± <NUM>, or <NUM> to <NUM> and that light in the specific wavelength band has a peak wavelength within the wavelength band of <NUM> ± <NUM>, <NUM> ± <NUM>, <NUM> ± <NUM>, or <NUM> to <NUM>.

In a case where the medical image <NUM> is an in-vivo image of the living body, the in-vivo image can have information on fluorescence emitted from the fluorescent material in the living body.

In addition, as the fluorescence, fluorescence obtained by emitting excitation light having a peak wavelength of <NUM> to <NUM> to the inside of the living body can be used.

In a case where the medical image <NUM> is an in-vivo image of the living body, the wavelength band of infrared light can be used as the specific wavelength band described above.

In a case where the medical image <NUM> is an in-vivo image of the living body and the wavelength band of infrared light is used as the specific wavelength band described above, it is preferable that the specific wavelength band includes a wavelength band of <NUM> to <NUM> or <NUM> to <NUM> and that light in the specific wavelength band has a peak wavelength within the wavelength band of <NUM> to <NUM> or <NUM> to <NUM>.

The medical image acquisition unit <NUM> can have a special light image acquisition section that acquires a special light image having a signal in a specific wavelength band on the basis of a normal light image obtained by emitting light in a white band or light in a plurality of wavelength bands as the light in the white band. In this case, the special light image can be used as a medical image <NUM>.

The signal in a specific wavelength band can be obtained by calculation based on the color information of RGB or CMY included in the normal light image.

It is possible to comprise a feature amount image generation unit that generates a feature amount image by calculation based on at least one of the normal light image obtained by emitting light in a white band or light in a plurality of wavelength bands as the light in the white band or the special light image obtained by emitting light in a specific wavelength band. In this case, the feature amount image can be used as a medical image <NUM>.

In the endoscope apparatus <NUM>, a capsule endoscope can be used as the endoscope <NUM>. In this case, the light source device <NUM> and a part of the processor device <NUM> can be mounted in the capsule endoscope.

In the embodiment described above, the hardware structures of processing units for executing various kinds of processing, such as the medical image acquisition unit <NUM>, the medical image analysis result acquisition unit <NUM>, the input receiving unit <NUM>, the storage unit <NUM>, the overall control unit <NUM>, and the image generation unit <NUM>, the medical image analysis processing unit <NUM>, the display control section <NUM>, the medical image display control section <NUM>, the analysis result display control section <NUM>, the operation display control section <NUM>, and the report creating unit <NUM> are various processors shown below. The various processors include a central processing unit (CPU) that is a general-purpose processor that functions as various processing units by executing software (program), a programmable logic device (PLD) that is a processor whose circuit configuration can be changed after manufacture, such as field programmable gate array (FPGA), a dedicated electrical circuit that is a processor having a dedicated circuit configuration for executing various types of processing, and the like.

One processing unit may be configured by one of various processors, or may be a combination of two or more processors of the same type or different types (for example, a combination of a plurality of FPGAs or a combination of a CPU and an FPGA). In addition, a plurality of processing units may be configured by one processor. As an example of configuring a plurality of processing units by one processor, first, as represented by a computer, such as a client or a server, there is a form in which one processor is configured by a combination of one or more CPUs and software and this processor functions as a plurality of processing units. Second, as represented by a system on chip (SoC) or the like, there is a form of using a processor for realizing the function of the entire system including a plurality of processing units with one integrated circuit (IC) chip. Thus, various processing units are configured by using one or more of the above-described various processors as a hardware structure.

Claim 1:
A medical image processing apparatus (<NUM>) comprising:
a medical image acquisition unit (<NUM>) adapted to acquire a medical image including a subject image;
a medical image analysis result acquisition unit (<NUM>) adapted to acquire an analysis result obtained by analyzing the medical image;
a medical image analysis processing unit (<NUM>) adapted to detect a region of interest, which is a region to be observed, based on a feature amount of pixels of the medical image and to obtain at least information on presence or absence of a lesion or a type of lesion in the region of interest,
wherein the medical image analysis result acquisition unit (<NUM>) is adapted to acquire the analysis result from the medical image analysis processing unit (<NUM>);
characterized by
a display unit (<NUM>) adapted to display at least one medical image and at least information of items of "neoplasm", "non-neoplasm", "normal", and "unknown", as information on presence or absence of a lesion or a type of a lesion, in the analysis result acquired by the medical image analysis result acquisition unit (<NUM>),
an input receiving unit (<NUM>) adapted to receive an input of correction information for correcting the information on presence or absence of a lesion or a type of a lesion included in the analysis result, and receive an operation of selection and approval of one of the items of "neoplasm", "non-neoplasm", "normal", and "unknown",
a storage unit (<NUM>) adapted to store both the analysis result and the correction information in association with the medical image relating to the analysis result and the correction information in a case where the input receiving unit receives an input of the correction information.