Patent ID: 12256889

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

Embodiments of the present invention are explained below with reference to the drawings.

First Embodiment

FIG.1toFIG.6relate to a first embodiment of the present invention.

An endoscope system1includes, as shown inFIG.1, an endoscope11, a main body apparatus12, an endoscopic imam processing apparatus13, and a display apparatus14.FIG.1is a diagram showing a configuration of a main part of an endoscope system including an endoscopic image processing apparatus according to the first embodiment.

The endoscope11includes, for example, an elongated insertion section (not illustrated) insertable into a subject and an operation section (not illustrated) provided at a proximal end portion of the insertion section. For example, the endoscope11is detachably connected to the main body apparatus12via a universal cable (not illustrated) extending from the operation section. A light guide member (not illustrated) such as an optical fiber for guiding illumination light supplied from the main body apparatus12and emitting the illumination light from a distal end portion of the insertion section is provided on an inside of the endoscope11. The endoscope11includes an image pickup section111provided at the distal end portion of the insertion section and an operation switch section112provided in the operation section.

The image pickup section111includes, for example, a CCD image sensor or a CMOS image sensor. The image pickup section111is configured to pick up an image of return light from an object illuminated by the illumination light emitted through the distal end portion of the insertion section, generate an image pickup signal corresponding to the return light, the image of which is picked up, and output the image pickup signal to the main body apparatus12.

The operation switch section112includes one or more switches capable of giving instructions corresponding to operation by a user to the main body apparatus12. More specifically, for example, switches for giving instructions relating to setting of observation magnification of the endoscope11(the image pickup section111) are provided in the operation switch section112. In other words, one or more switches capable of giving instructions for setting operation states of one or more functions included in the endoscope11are provided in the operation switch section112.

The main body apparatus12is detachably connected to each of the endoscope11and the endoscopic image processing apparatus13. The main body apparatus12includes, for example, as shown inFIG.1, a light source section121, an image generating section122, a control section123, and a storage medium124.

The light source section121includes one or more light emitting elements such as LEDs. More specifically, the light source section121includes, for example, a blue LED that generates blue light (hereinafter referred to as B light as well), a green LED that generates green light (hereinafter referred to as G light as well), and a red LED that generates red light (hereinafter referred to as R light as well). The light source section121is configured to be able to generate illumination light corresponding to control by the control section123and supply the illumination light to the endoscope11.

The image generating section122is configured to be able to generate an endoscopic image based on an image pickup signal outputted from the endoscope11and sequentially output the generated endoscopic image to the endoscopic image processing apparatus13frame by frame.

The control section123is configured to perform, based on an instruction or the like given by the operation switch section112, control relating to operation of sections of the endoscope11and the main body apparatus12.

In the present embodiment, the image generating section122and the control section123of the main body apparatus12may be configured as individual electronic circuits or may be configured as circuit blocks in an integrated circuit such as an FPGA (field programmable gate array). In the present embodiment, for example, the main body apparatus12may include one or more CPUs. By modifying the configuration according to the present embodiment as appropriate, for example, the main body apparatus12may read, from the storage medium124such as a memory, a program for executing functions of the image generating section122and the control section123, and may perform operation corresponding to the read program.

The endoscopic image processing apparatus13is a processor detachably connected to each of the main body apparatus12and the display apparatus14. The endoscopic image processing apparatus13includes a lesion-candidate-region detecting section131, a lesion-candidate-region evaluating section132, a display control section133, and a storage medium134. The lesion-candidate-region detecting section131, the lesion-candidate-region evaluating section132, and the display control section133are circuits that perform control of the sections in the endoscopic image processing apparatus13. Note that functions of these circuits may be realized by software. In this case, the endoscopic image processing apparatus13includes a central processing unit (CPU), ROM, and RAM and the like, and executes programs of the functions, whereby functions of the lesion-candidate-region detecting section131, the lesion-candidate-region evaluating section132, and the display control section133are realized. Note that when the functions of the sections are realized by software, a part of the sections may be realized by integral hardware. As the processor, besides the CPU (central processing unit), various processors such as a DSP (digital signal processor) can be used. The processor may be a hardware circuit by an ASIC (application specific integrated circuit) or an FPGA (field programmable gate array).

The lesion-candidate-region detecting section131is configured to perform processing for detecting a lesion candidate region L included in endoscopic images sequentially outputted from the main body apparatus12and perform processing for acquiring lesion candidate information IL, which is information indicating the detected lesion candidate region L. In other words, endoscopic images obtained by picking up an image of an object in a subject with an endoscope are sequentially inputted to the lesion-candidate-region detecting section131. The lesion-candidate-region detecting section131is configured to perform processing for detecting one or a plurality of lesion candidate regions L included in the endoscopic images.

Note that, in the present embodiment, the lesion candidate region L is detected as, for example, a region including a polyp. In the present embodiment, the lesion candidate information IL is acquired as, for example, information including position information indicating a position (a pixel position) of the lesion candidate region L included in an endoscopic image outputted from the main body apparatus12and size information indicating a size (the number of pixels) of the lesion candidate region L included in the endoscopic image.

In the present embodiment, for example, the lesion-candidate-region detecting section131may be configured to detect the lesion candidate region L based on a predetermined feature value obtained from an endoscopic image obtained by picking up an image of an object in a subject with an endoscope or may be configured to detect the lesion candidate region L using a discriminator that has acquired, in advance, with a learning method such as deep learning, a function capable of discriminating an abnormal finding included in the endoscopic image.

The lesion-candidate-region evaluating section132is configured to perform processing for evaluating a state of the lesion candidate region L detected by the lesion-candidate-region detecting section131. Note that a specific example of the processing performed in the lesion-candidate-region evaluating section132is explained below.

The display control section133is configured to perform processing for generating, based on the endoscopic images sequentially outputted from the main body apparatus12and display setting information (explained below) read from the storage medium134, a display image including the endoscopic images in each of one main screen (explained below) and one or more sub-screens (explained below) and processing for causing the display apparatus14to display the generated display image. The display control section133includes a highlighting processing section133A that performs highlighting processing for highlighting a position of the lesion candidate region L detected from the endoscopic image by the processing of the lesion-candidate-region detecting section131. The display control section133is configured to perform processing relating to setting of a marker image M (explained below) added by the highlighting processing of the highlighting processing section133A.

The highlighting processing section133A is configured to generate, based on the legion candidate information IL acquired by the lesion-candidate-region detecting section131, the marker image M for highlighting the position of the lesion candidate region L detected from the endoscopic image by the processing of the lesion-candidate-region detecting section131and perform, as the highlighting processing, processing for adding the generated marker image M to the endoscopic image. Note that, as long as the highlighting processing section133A generates the marker image M for highlighting the position of the lesion candidate region L, the highlighting processing section133A may perform the highlighting processing using only the position information included in the lesion candidate information IL or may perform the highlighting processing using both of the position information and the size information included in the lesion candidate information IL.

In the storage medium134, display setting information including one or more setting values relating to the display image generated by the display control section133is stored.

More specifically, the display setting information stored in the storage medium134includes, for example, information indicating a setting value of brightness of an entire display image including a main screen and sub-screens generated by the display control section133, information indicating a setting value of a screen size of the main screen, and information indicating a setting value of a screen size of the sub-screens.

Note that the setting values stored in the storage medium134may be preset fixed values or may be variable values changeable by the user.

In the present embodiment, the sections of the endoscopic image processing apparatus13may be configured as individual electronic circuits or may be configured as circuit blocks in an integrated circuit such as an FPGA (field programmable gate array). In the present embodiment, for example, the endoscopic image processing apparatus13may include one or more CPUs. By modifying the configuration according to the present embodiment as appropriate, for example, the endoscopic image processing apparatus13may read, from the storage medium134such as a memory, a program for executing functions of the lesion-candidate-region detecting section131, the lesion-candidate-region evaluating section132, and the display control section133, and may perform operation corresponding to the read program. By modifying the configuration according to the present embodiment as appropriate, for example, the functions of the sections of the endoscopic image processing apparatus13may be incorporated as functions of the main body apparatus12.

The display apparatus14includes a monitor or the like and is configured to be able to display a display image outputted through the endoscopic image processing apparatus13.

Next, action of the present embodiment is explained. Note that, in the following explanation, unless particularly referred to, a case is explained, as an example, in which B light, G light, and R light are sequentially or simultaneously emitted from the light source section121as illumination light corresponding to the control by the control section123, that is, an endoscopic image including color components of blue, green, and red is generated by the image generating section122.

After connecting the sections of the endoscope system1and turning on a power supply, the user such as a surgeon inserts the insertion section of the endoscope11into an inside of a subject and arranges the distal end portion of the insertion section in a position where an image of a desired object on the inside of the subject can be picked up. According to such operation by the user, illumination light is supplied from the light source section121to the endoscope11. An image of return light from the object illuminated by the illumination light is picked up in the image pickup section111. An endoscopic image corresponding to an image pickup signal outputted from the image pickup section111is generated in the image generating section122and is outputted to the endoscopic image processing apparatus13.

The display control section133generates a main screen MG by processing the endoscopic image based on the endoscopic image outputted from the main body apparatus12and the display setting information read from the storage medium134to match a setting value SL of a screen size of the main screen included in the display setting information and generates a sub-screen SG by processing the endoscopic image to match a setting value SS (<SL) of a screen size of a sub-screen included in the display setting information. Thereafter, the display control section133performs processing for generating a display image including the main screen MG and the sub-screen SG for simultaneously displaying the endoscopic image obtained by picking up the image of the object in the subject with the endoscope11and performs processing for causing the display apparatus14to display the generated display image. With such processing, for example, when the lesion candidate region L is not included in the endoscopic image outputted from the main body apparatus12, a display image shown inFIG.2is displayed on the display apparatus14. Note that, in the present embodiment, a display image different from the display image illustrated inFIG.2may be generated as long as one main screen MG and one or more sub-screens SG are included in the display image.FIG.2is a diagram showing an example of a display image including a main screen and a sub-screen.

Specific examples of processing performed in the sections of the endoscopic image processing apparatus13in the present embodiment are explained with reference toFIG.3and the like. Note that, in the present embodiment, a case is explained, as an example, in which one lesion candidate region L is included in the endoscopic image outputted from the main body apparatus12.FIG.3is a flowchart for explaining a specific example of processing performed in the endoscopic image processing apparatus according to the first embodiment.

The lesion-candidate-region detecting section131performs processing for detecting the lesion candidate region L included in the endoscopic image outputted from the main body apparatus12and performs processing for acquiring the lesion candidate information IL, which is information indicating the detected lesion candidate region L (step S11inFIG.3).

More specifically, for example, the lesion-candidate-region detecting section131performs the processing in step S11inFIG.3to thereby detect a lesion candidate region L11included in the endoscopic image outputted from the main body apparatus12and acquires lesion candidate information IL11, which is information indicating the detected lesion candidate region L11.

The lesion-candidate-region evaluating section132performs processing for evaluating difficulty in finding the lesion candidate region L based on at least one of the endoscopic image in which the lesion candidate region L is detected by the processing in step S11inFIG.3or the legion candidate information IL corresponding to the lesion candidate region L (step S12inFIG.3).

A specific example of the processing performed in step S12inFIG.3is explained.

For example, the lesion-candidate-region evaluating section132respectively detects a texture and a shape of the lesion candidate region L11based on the endoscopic image in which the lesion candidate region L11is detected by the processing in step S11inFIG.3and position information included in lesion candidate information IL1corresponding to the lesion candidate region L11. When determining based on a detection result of the texture and the shape of the lesion candidate region L11that, for example, a flat polyp is included in the lesion candidate region L11, the lesion-candidate-region evaluating section132acquires an evaluation result indicating that the difficulty in finding the lesion candidate region L11is high.

For example, the lesion-candidate-region evaluating section132detects strength of an edge in a boundary portion of the legion candidate region L11based on the endoscopic image in which the lesion candidate region L11is detected by the processing in step S11inFIG.3and the position information included in the lesion candidate information IL11corresponding to the lesion candidate region L11. For example, when detecting that the strength of the edge in the boundary portion of the lesion candidate region L11is low, the lesion-candidate-region evaluating section132determines that a light-colored polyp is included in the lesion candidate region L11and acquires an evaluation result indicating that the difficulty in finding the lesion candidate region L11is high.

When determining that both of a flat polyp and a light-colored polyp are not included in the lesion candidate region L11, the lesion-candidate-region evaluating section132acquires an evaluation result indicating that the difficulty in finding the lesion candidate region L11is low.

For example, the lesion-candidate-region evaluating section132acquires, based on size information included in the lesion candidate information IL11acquired by the processing in step S11inFIG.3, a size in the endoscopic image of the lesion candidate region L11detected by the processing in step S11inFIG.3. For example, when detecting that the size of the lesion candidate region L11is equal to or smaller than a predetermined size, the lesion-candidate-region evaluating section132acquires an evaluation result indicating that the difficulty in finding the lesion candidate region L11is high. For example, when detecting that the size of the lesion candidate region L11is larger than the predetermined size, the lesion-candidate-region evaluating section132acquires an evaluation result indicating that the difficulty in finding the lesion candidate region L11is low.

For example, the lesion-candidate-region evaluating section132acquires, based on the position information included in the lesion candidate information IL11acquired by the processing in step S11inFIG.3, a position in the endoscopic image of the lesion candidate region L11detected by the processing in step S11inFIG.3. For example, when detecting that at least a part of the lesion candidate region L11is present on the outer side of the endoscopic image, the lesion-candidate-region evaluating section132acquires an evaluation result indicating that the difficulty in finding the lesion candidate region L11is high. For example, when detecting that the entire lesion candidate region L11is present in the endoscopic image, the lesion-candidate-region evaluating section132acquires an evaluation result indicating that the difficulty in finding the lesion candidate region L11is low.

Note that, in the present embodiment, the difficulty in finding the lesion candidate region L may be evaluated by combining, as appropriate, a plurality of approaches among the specific examples explained above. More specifically, when a flat polyp or a light-colored polyp is included in the lesion candidate region L11detected from the endoscopic image, when the size of the lesion candidate region L11is equal to or smaller than the predetermined size, or when at least a part of the lesion candidate region L11is present on the outer side of the endoscopic image, the lesion-candidate-region evaluating section132may acquire an evaluation result indicating that the difficulty in finding the lesion candidate region L11is high. For example, when both of a flat polyp or a light-colored polyp are not included in the lesion candidate region L11detected from the endoscopic image, the size of the lesion candidate region L11is larger than the predetermined size, and when the entire lesion candidate region L11is present in the endoscopic image, the lesion-candidate-region evaluating section132may acquire an evaluation result indicating that the difficulty in finding the lesion candidate region L11is low.

In other words, according to the specific example explained above, the lesion-candidate-region evaluating section132performs the processing for evaluating the difficulty in finding the lesion candidate region L11based on at least one of a type of a lesion included in the lesion candidate region L11detected from the endoscopic image, the size in the endoscopic image of the lesion candidate region L11, or the position in the endoscopic image of the lesion candidate region L11.

The display control section133performs processing for respectively setting a marker image MM1for highlighting, on the main screen MG, the position of the lesion candidate region L11detected by the processing in step S11inFIG.3and a marker image MS1for highlighting, on the sub-screen SG, the position of the lesion candidate region L11. The display control section133performs processing for respectively setting, according to the evaluation result of the difficulty in finding the lesion candidate region L acquired by the processing in step S12inFIG.3, a highlighting level EM1of the marker image MM1added to the main screen MG and a highlighting level ES1of the marker image MS1added to the sub-screen SG (steps S13to S15inFIG.3).

When detecting that the evaluation result indicating that the difficulty in finding the lesion candidate region L is high is obtained (S13: YES), for example, the display control section133performs setting the highlighting level EM1of the marker image MM1to a predetermined highlighting level and performs setting the highlighting level ES1of the marker image MS1higher than the predetermined highlighting level (step S14inFIG.3).

When detecting that the evaluation result indicating that the difficulty in finding the lesion candidate region L is low is obtained (S13: NO), for example, the display control section133performs setting the highlighting level EM1of the marker image. MM1to the predetermined highlighting level and performs setting the highlighting level ES1of the marker image MS1equal to the predetermined highlighting level (step S15inFIG.3).

In other words, the display control section133performs processing for setting, based on the evaluation result of the difficulty in finding the lesion candidate region L11obtained by the processing of the lesion-candidate-region evaluating section132in step S13to step S15inFIG.3, a highlighting method in highlighting positions of the lesion candidate region L11included in the main screen MG and the sub-screen SG with processing of a highlighting processing section133A.

The highlighting processing section133A performs processing for generating, based on the lesion candidate information IL acquired by the processing in step S11inFIG.3, the marker images MM1and MS1set through the processing in step S14or step S15inFIG.3, adding the generated marker image MM1to the main screen MG, and adding the generated marker image MS1to the sub-screen SG (step S16inFIG.3).

More specifically, for example, the highlighting processing section133A performs processing for generating, based on the lesion candidate information IL11, the marker image MS1having the highlighting level EM1set by the processing in step S14inFIG.3and adding the generated marker image MM1to a periphery of the lesion candidate region L11on the main screen MG. For example, the highlighting processing section133A performs processing for generating, based on the lesion candidate information IL11, the marker image MS1having the highlighting level ES1set to be higher than the highlighting level EM1by the processing in step S14inFIG.3and adding the generated marker image MS1to the periphery of the lesion candidate region L11on a sub-screen MS1.

When the processing in step S16is performed through the processing in step S14inFIG.3, for example, the display image shown inFIG.4orFIG.5is generated and the generated display image is displayed on the display apparatus14.FIG.4andFIG.5are diagrams showing examples of display images displayed according to the processing of the endoscopic image processing apparatus according to the first embodiment.

In the display image illustrated inFIG.4, the periphery of the lesion candidate region L11included in the endoscopic image on the main screen MG is surrounded by the marker image MM1, which is a rectangular frame, and the periphery of the lesion candidate region L11included in the endoscopic image on the sub-screen SG is surrounded by the marker image MS1, which is a rectangular frame. In the display image illustrated inFIG.4, a frame line of the marker image MS1is displayed at a line width larger than a line width of a frame line of the marker image MM1. Note that when the display image illustrated inFIG.4is displayed on the display apparatus14, in step S14inFIG.3, the display control section133only has to perform processing for setting the line width of the frame line of the marker image MS1corresponding to the highlighting level ES1to a line width larger than the line width of the frame line of the marker image MM1corresponding to the highlighting level EM1.

In the display image illustrated inFIG.5, the periphery of the lesion candidate region L11included in the endoscopic image on the main screen MG is surrounded by the marker image MM1which is a rectangular frame, and the periphery of the lesion candidate region L11included in the endoscopic image on the sub-screen SG is surrounded by the marker image MS1, which is a rectangular frame. In the display image illustrated inFIG.5, a frame line of the marker image MS1is displayed brighter than a frame line of the marker image MM1. Note that when the display image illustrated inFIG.5is displayed on the display apparatus14, in step S14inFIG.3, the display control section133only has to perform processing for setting a brightness level of the frame line of the marker image MS1corresponding to the highlighting level ES1to a brightness level higher than a brightness level of the frame line of the marker image MM1corresponding to the highlighting level EM1.

When the processing in S16is performed through the processing in step S15inFIG.3, for example, the display image shown inFIG.6is generated and the generated display image is displayed on the display apparatus14.FIG.6is a diagram showing an example of a display image displayed according to the processing of the endoscopic image processing apparatus according to the first embodiment.

In the display image illustrated inFIG.6, the periphery of the lesion candidate region L11included in the endoscopic image on the main screen MG is surrounded by the marker image MM1, which is a rectangular frame, and the periphery of the lesion candidate region L11included in the endoscopic image on the sub-screen SG is surrounded by the marker image MS1, which is a rectangular frame. In the display image illustrated inFIG.6, the marker images MM1and MS1are displayed in the same highlighted state.

As explained above, according to a series of processing shown inFIG.3, a highlighted state of the marker image M added to the main screen MG is maintained irrespective of the difficulty in finding the lesion candidate region L included in endoscopic images simultaneously displayed on the main screen MG and the sub-screen SG. As explained above, according to the series of processing shown inFIG.3, the highlighted state of the marker image M added to the sub-screen SG changes according to the difficulty in finding the lesion candidate region L included in the endoscopic images simultaneously displayed on the main screen MG and the sub-screen SG. Therefore, according to the present embodiment, it is possible to make it easy to confirm, on the sub-screen SG, a position of the lesion candidate region L having high difficulty of finding. Therefore it is possible to reduce a burden on a user who views endoscopic images simultaneously displayed on a plurality of screens and performs work.

Note that, according to the present embodiment, as long as processing for changing the highlighted state of the marker image MS1added to the lesion candidate region L11of the sub-screen SG according to the difficulty in finding the lesion candidate region L11is performed, processing different from the processing explained above may be performed. More specifically, for example, when the evaluation result indicating that the difficulty in finding the lesion candidate region L11is high is obtained, in step S14inFIG.3, processing relating to setting for flashing the marker image MS1added to the lesion candidate region may be performed.

Second Embodiment

FIG.7toFIG.10relate to a second embodiment of the present invention.

Note that, in the present embodiment, detailed explanation concerning portions having the same components and the like as the components and the like in the first embodiment is omitted. Portions having components and the like different from the components and the like in the first embodiment are mainly explained.

The endoscopic image processing apparatus13in the present embodiment is configured to perform processing different from the processing explained in the first embodiment.

Specific examples of processing performed in sections of the endoscopic image processing apparatus13in the present embodiment are explained with reference toFIG.7and the like.FIG.7is a flowchart for explaining a specific example of processing performed in an endoscopic image processing apparatus according to the second embodiment.

The lesion-candidate-region detecting section131performs processing for detecting the lesion candidate region L included in an endoscopic image outputted from the main body apparatus12and performs processing for acquiring the lesion candidate information IL, which is information indicating the detected lesion candidate region L (step S21inFIG.7).

The lesion-candidate-region evaluating section132performs processing for determining Whether or not a plurality of lesion candidate regions L are detected by the processing in step S21inFIG.7(step S22inFIG.7).

When obtaining a determination result indicating that a plurality of lesion candidate regions L are detected by the processing in step S21inFIG.7(S22: YES), the lesion-candidate-region evaluating section132performs processing for evaluating the plurality of lesion candidate regions L (step S23inFIG.7).

Concerning a specific example of the processing performed in step S23inFIG.7, a case is explained, as an example, in which a lesion candidate region L21and a lesion candidate region L22are detected, lesion candidate information IL21corresponding to the lesion candidate region L21is acquired, and lesion candidate information IL22corresponding to the lesion candidate region L22is acquired by the processing in step S21inFIG.7.

For example, the lesion-candidate-region evaluating section132calculates a relative distance DA equivalent to a distance between centers of the lesion candidate regions L21and L22based on the lesion candidate information IL21corresponding to the lesion candidate region L21detected by the processing in step S21inFIG.7and the lesion candidate information IL22corresponding to the lesion candidate region L22detected by the processing in step S21inFIG.7.

For example, the lesion-candidate-region evaluating section132compares the relative distance DA and a predetermined threshold THA to thereby evaluate a positional relation between the lesion candidate regions L21and L22. For example, when obtaining a comparison result indicating DA≤THA, the lesion-candidate-region evaluating section132obtains an evaluation result indicating that the lesion candidate regions L21and L22are present in positions close to each other. For example, when obtaining a comparison result indicating DA>THA, the lesion-candidate-region evaluating section132obtains an evaluation result indicating that the lesion candidate regions L21and L22are present in positions far apart from each other.

In other words, according to the specific example explained above, the lesion-candidate-region evaluating section132performs processing for evaluating, based on a relative distance between the plurality of lesion candidate regions L (the lesion candidate regions L21and L22) detected by the processing of the lesion-candidate-region detecting section131, a positional relation between the plurality of lesion candidate regions L.

The lesion-candidate-region evaluating section132performs the same processing as the processing in step S12inFIG.3based on at least one of the endoscopic image in which the lesion candidate region L21is detected by the processing in step S21inFIG.7or the lesion candidate information IL21corresponding to the lesion candidate region L21to thereby evaluate difficulty in finding the lesion candidate region L21. The lesion-candidate-region evaluating section132performs the same processing as the processing in step S12inFIG.3based on at least one of the endoscopic image in which the lesion candidate region L22is detected by the processing in step S21inFIG.7or the lesion candidate information IL22corresponding to the lesion candidate region L22to thereby evaluate difficulty in finding the lesion candidate region L22. The lesion-candidate-region evaluating section132respectively acquires an evaluation result relating to the difficulty in finding the lesion candidate region L21and an evaluation result relating to the difficulty in finding the lesion candidate region L22.

In other words, according to the specific example explained above, the lesion-candidate-region evaluating section132performs processing for evaluating the difficulty in finding each of the plurality of lesion candidate regions L (the lesion candidate regions L21and L22) detected by the processing of the lesion-candidate-region detecting section131.

When obtaining a determination result indicating that the plurality of lesion candidate regions L are detected by the processing in step S21inFIG.7(S22: YES), the display control section133performs processing for setting, according to the evaluation result obtained by the processing in step S23inFIG.7, the marker image M added by highlighting processing of the highlighting processing section133A (step S24inFIG.7).

A specific example of the processing performed in step S24inFIG.7is explained.

For example, when an evaluation result indicating that the lesion candidate regions L21and L22are present in positions close to each other is obtained, the display control section133sets a marker image MM2for collectively highlighting the positions of the lesion candidate regions L21and L22on the main screen MG and sets marker images MS21and MS22for individually highlighting the positions of the lesion candidate regions L21and L22on the sub-screen SG. For example, when an evaluation result indicating that the lesion candidate regions L21and L22are present in positions far apart from each other is obtained, the display control section133sets marker images MM21and MM22for individually highlighting the positions of the lesion candidate regions L21and L22on the main screen MG and sets the marker images MS21and MS22for individually highlighting the positions of the lesion candidate regions L21and L22on the sub-screen SG.

In other words, according to the specific example explained above, the display control section133sets, based on an evaluation result of a positional relation between the plurality of lesion candidate regions L (the lesion candidate regions L21and L22) obtained by the processing of the lesion-candidate-region evaluating section132, a highlighting method in highlighting, with the processing of the highlighting processing section133A, positions of the plurality of lesion candidate regions L included in the main screen MG and the sub-screen SG. According to the specific example explained above, the display control section133performs setting for collectively highlighting, on the main screen MG, and individually highlighting, on the sub-screen SG, of the plurality of lesion candidate regions L (the lesion candidate regions L21and L22) detected by the processing in the lesion-candidate-region detecting section131, positions of the lesion candidate regions L where an evaluation result indicating that the lesion candidate regions L are present in positions close to each other is obtained by the processing of the lesion-candidate-region evaluating section132. According to the specific example explained above, the display control section133performs setting for individually highlighting, on both of the main screen MG and the sub-screen SG, of the plurality of lesion candidate regions L (the lesion candidate regions L21and L22) detected by the processing in the lesion-candidate-region detecting section131, positions of the lesion candidate regions L where an evaluation result indicating that the lesion candidate regions L are present in positions farther apart from each other is obtained by the processing of the lesion-candidate-region evaluating section132.

For example, when an evaluation result indicating that the difficulty in finding the lesion candidate region L21is high is obtained, the display control section133respectively sets the marker image MM21for highlighting the position of the lesion candidate region L21on the main screen MG and the marker image MS21for highlighting the position of the lesion candidate region L21on the sub-screen SG. For example, when an evaluation result indicating that the difficulty in finding the lesion candidate region L21is low is obtained, the display control section133sets the marker image MS21for highlighting the position of the lesion candidate region L21on the sub-screen SG.

For example, when an evaluation result indicating that the difficulty in finding the lesion candidate region L22is high is obtained, the display control section133respectively sets the marker image MM22for highlighting the position of the lesion candidate region L22on the main screen MG and the marker image MS22for highlighting the position of the lesion candidate region L22on the sub-screen SG. For example, when an evaluation result indicating that the difficulty in finding the lesion candidate region L22is low is obtained, the display control section133sets the marker image MS22for highlighting the position of the lesion candidate region L22on the sub-screen SG.

In other words, according to the specific example explained above, the display control section133performs setting for highlighting, on the main screen MG and the sub-screen SG, of the plurality of lesion candidate regions L (the lesion candidate regions L21and L22) detected by the processing of the lesion-candidate-region detecting section131, the position of the lesion candidate region L where an evaluation result indicating that the difficulty in finding the lesion candidate region L is high is obtained by the processing of the lesion-candidate-region evaluating section132. According to the specific example explained above, the display control section133performs setting for highlighting, on the sub-screen SG, of the plurality of lesion candidate regions L (the lesion candidate regions L21and L22) detected by the processing of the lesion-candidate-region detecting section131, the position of the lesion candidate region L where an evaluation result indicating that the difficulty in finding the lesion candidate region L is low is obtained by the processing of the lesion-candidate-region evaluating section132.

When obtaining a determination result indicating that one lesion candidate region L is detected by the processing in step S21inFIG.7(S22: NO), the display control section133performs processing for setting the marker image M for highlighting a position of the one lesion candidate region L on each of the main screen MG and the sub-screen SG (step S25inFIG.7).

More specifically, for example, the display control section133respectively sets a marker image MM23for highlighting, on the main screen MG, a position of a lesion candidate region L23detected by the processing in step S21inFIG.7and a marker image MS23for highlighting the position of the lesion candidate region L23on the sub-screen SG.

The highlighting processing section133A performs processing for adding, based on the lesion candidate information IL acquired by the processing in step S21inFIG.7, the marker image M set through the processing in step S24or step S25inFIG.7(step S26inFIG.7).

When the processing in step S26is performed through the processing in step S24inFIG.7, for example, a display image shown inFIG.8orFIG.9is generated and the generated display image is displayed on the display apparatus14.FIG.8andFIG.9are diagrams showing examples of display images displayed according to processing of the endoscopic image processing apparatus according to the second embodiment.

In the display image illustrated inFIG.8, peripheries of the lesion candidate regions L21and L22included in the endoscopic image on the main screen MG are surrounded by the marker image MM2, which is a rectangular frame, a periphery of the lesion candidate region L21included in the endoscopic image on the sub-screen SG is surrounded by the marker image MS21, which is a rectangular frame, and a periphery of the lesion candidate region L22included in the endoscopic image on the sub-screen SG is surrounded by the marker image MS22, which is a rectangular frame. In other words, in a series of processing shown inFIG.7, when an evaluation result indicating that the lesion candidate regions L21and L22are present in positions close to each other is obtained, the display image shown inFIG.8is displayed on the display apparatus14.

In the display image illustrated inFIG.9, the periphery of the lesion candidate region L22included in the endoscopic image on the main screen MG is surrounded by the marker image MM22, which is a rectangular frame, the periphery of the lesion candidate region L21included in the endoscopic image on the sub-screen SG is surrounded by the marker image MS21, which is a rectangular frame, and the periphery of the lesion candidate region L22included in the endoscopic image on sub-screen SG is surrounded by the marker image MS22, which is a rectangular frame. In other words, in the series of processing shown inFIG.7, when an evaluation result indicating that the difficulty in finding the lesion candidate region L21is low is obtained because a size of the lesion candidate region L21is larger than a predetermined size and an evaluation result indicating that the difficulty in finding the lesion candidate region L22is high is obtained because a size of the lesion candidate region L22is equal to or smaller than the predetermined size, the display image shown inFIG.9is displayed on the display apparatus14.

When the processing in step S26is performed through the processing in step S25inFIG.7, for example, a display image shown inFIG.10is generated and the generated display image is displayed on the display apparatus14.FIG.10is a diagram showing an example of a display image displayed according to the processing of the endoscopic image processing apparatus according to the second embodiment.

In the display image illustrated inFIG.10, a periphery of the lesion candidate region L23included in the endoscopic image on the main screen MG is surrounded by a marker image MM23, which is a rectangular frame, and a periphery of the lesion candidate region L23included in the endoscopic image on the sub-screen SG is surrounded by a marker image MS23, which is a rectangular frame.

As explained above, according to the series of processing shown inFIG.7, irrespective of the number of lesion candidate regions L included in endoscopic images simultaneously displayed on the main screen MG and the sub-screen SG, the marker image M is added to all the lesion candidate regions L included in the endoscopic image on the sub-screen SG. As explained above, according to the series of processing shown inFIG.7, when one lesion candidate region L is included in the endoscopic images simultaneously displayed on the main screen MG and the sub-screen SG, the marker image M for highlighting a position of the one lesion candidate region L is added to the main screen. As explained above, according to the series of processing shown inFIG.7, when a plurality of lesion candidate regions are included in the endoscopic images simultaneously displayed on the main screen MG and the sub-screen SG, a total number of marker images M simultaneously added to the main screen MG can be set to less than a total number of lesion candidate regions L detected from the endoscopic image. Therefore, according to the present embodiment, the marker image M can be added to the main screen MG not to hinder, as much as possible, work performed by viewing the main screen MG. Therefore, it is possible to reduce a burden on a user who views endoscopic images simultaneously displayed on a plurality of screens and performs work.

Third Embodiment

FIG.11toFIG.14relate to a third embodiment of the present invention.

Note that, in the present embodiment, detailed explanation concerning portions having the same components and the like as the components and the like in at least one of the first or second embodiment is omitted. Portions having components and the like different from the components and the like in both of the first and second embodiments are mainly explained.

As shown inFIG.11, an endoscope system1A is configured by providing an endoscopic image processing apparatus13A instead of the endoscopic image processing apparatus13explained in the first embodiment. As shown inFIG.11, the endoscopic image processing apparatus13A is configured by providing a work-state estimating section132A instead of the lesion-candidate-region evaluating section132explained in the first embodiment.FIG.11is a diagram showing a configuration of a main part of an endoscope system including an endoscopic image processing apparatus according to the third embodiment.

For example, the work-state estimating section132A is configured to be able to detect an instruction given by the operation switch section112of the endoscope11by monitoring operation of the control section123of the main body apparatus12. The work-state estimating section132A is configured to perform processing for estimating, based on at least one of an endoscopic image outputted from the main body apparatus12or a detection result of the instruction given by the operation switch section112, a work state of a user at the time when the lesion candidate region L is detected by the lesion-candidate-region detecting section131. In other words, the work-state estimating section132A is configured to perform processing for estimating, based on at least one of the endoscopic image outputted from the main body apparatus12or a detection result of an instruction given to set operation states of one or more functions of the endoscope11, a work state of the user at the time when the lesion candidate region L is detected by the lesion-candidate-region detecting section131.

Specific examples of processing performed in sections of the endoscopic image processing apparatus13A in the present embodiment are explained with reference toFIG.12and the like. Note that, in the present embodiment, a case is explained, as an example, in which one lesion candidate region L is included in the endoscopic image outputted from the main body apparatus12.FIG.12is a flowchart for explaining a specific example of processing performed in the endoscopic image processing apparatus according to the third embodiment.

The lesion-candidate-region detecting section131performs processing for detecting the lesion candidate region L included in the endoscopic image outputted from the main body apparatus12and performs processing for acquiring the lesion candidate information IL, which is information indicating the detected lesion candidate region L (step S31inFIG.12).

More specifically, for example, the lesion-candidate-region detecting section131performs the processing in step S31inFIG.12to thereby detect a lesion candidate region L31included in the endoscopic image outputted from the main body apparatus12and acquire lesion candidate information IL31, which is information indicating the detected lesion candidate region L31.

The work-state estimating section132A performs processing for estimating, based on at least one of the endoscopic image outputted from the main body apparatus12or a detection result of the instruction given by the operation switch section112, a work state of the user at the time when the lesion candidate region L is detected by the processing in step S31inFIG.12(step S32inFIG.12).

A specific example of the processing performed in step S32inFIG.12is explained.

The work-state estimating section132A performs processing for calculating a motion vector of endoscopic images of a plurality of frames sequentially outputted from the main body apparatus12. For example, when a motion vector calculated when the lesion candidate region L31is detected by the processing in step S31inFIG.12is directed to a dark side (a depth side) of the endoscopic image and the work-state estimating section132A detects that a size of the motion vector is equal to or larger than a predetermined threshold THV, the work-state estimating section132A obtains an estimation result indicating that work relating to insertion of (the insertion section of) the endoscope11is performed. For example, when detecting that the motion vector calculated when the lesion candidate region L31is detected by the processing in step S31inFIG.12is not directed to the dark side (the depth side) of the endoscopic image or when detecting that the size of the motion vector is smaller than the predetermined threshold THV, the work-state estimating section132A determines that work different from the work relating to the insertion of (the insertion section of) the endoscope11is performed.

For example, the work-state estimating section132A performs image recognition processing on the endoscopic images sequentially outputted from the main body apparatus12to thereby obtain a processing result relating to which part in a large intestine of a human body a part, an image of which is picked up by the endoscope11, corresponds and perform, according to the processing result, setting of a flag FC indicating whether the endoscope11has reached an appendix. For example, the flag FC is set to off when a power supply of the endoscopic image processing apparatus13A is turned on and is set to on when a processing result indicating that the part, the image of which is picked up by the endoscope11, is the appendix is obtained first after the power supply of the endoscopic image processing apparatus13A is turned on. When the flag FC at the time when the lesion candidate region L31is detected by the processing in step S31inFIG.12is off, the work-state estimating section132A obtains an estimation result indicating that the work relating to the insertion of (the insertion section of) the endoscope11is performed. When the flag FC at the time when the lesion candidate region L31is detected by the processing in step S31inFIG.12is on, the work-state estimating section132A determines that work different from the work relating to the insertion of (the insertion section of) the endoscope11is performed.

When determining that work different from the work relating to the insertion of (the insertion section of) the endoscope11is performed, for example, the work-state estimating section132A specifies, based on a detection result of the instruction given by the operation switch section112, observation magnification of the endoscope11(the image pickup section111) at the time when the lesion candidate region L31is detected by the processing in step S31inFIG.12. When the observation magnification of the endoscope11(the image pickup section111) at the time when the lesion candidate region L31is detected by the processing in step S31inFIG.12is equal to or larger than a predetermined threshold THM, the work-state estimating section132A obtains an estimation result indicating that work relating to a diagnosis of the lesion candidate region L is performed.

When determining that work different from the work relating to the insertion of (the insertion section of) the endoscope11is performed, for example, the work-state estimating section132A specifies, based on the endoscopic image outputted from the main body apparatus12, whether a distal end portion of a treatment instrument used for treatment for the lesion candidate region L31detected by the processing in step S31inFIG.12is included in the endoscopic image. When the distal end portion of the treatment instrument used for the treatment for the lesion candidate region L31detected by the processing in step S31inFIG.12is included in the endoscopic image, the work-state estimating section132A obtains an estimation result indicating that work relating to the treatment of the lesion candidate region L is performed.

When determining that the work does not correspond to none of the work relating to the insertion of (the insertion section of) the endoscope11, work relating to a diagnosis of the lesion candidate region L31detected by the processing in step S31inFIG.12, and work relating to the treatment for the lesion candidate region L31, the work-state estimating section132A obtains an estimation result indicating that work relating to a search for the lesion candidate region L31is performed.

The display control section133performs processing for setting, based on the estimation result obtained by the processing in step S32inFIG.12, whether addition of the marker image M on the main screen MG is restricted (step S33inFIG.12). In other words, in step S33inFIG.12, the display control section133performs processing for setting, based on the estimation result of the work state of the user obtained by the processing of the work-state estimating section132A, a highlighting method in highlighting, with the processing of the highlighting processing section133A, positions of the lesion candidate region L included in the main screen MG and the sub-screen SG.

More specifically, for example, when any one of the estimation result indicating that the work relating to the insertion of (the insertion section of) the endoscope11is performed, the estimation result indicating that the work relating to the diagnosis of the lesion candidate region L31detected by the processing in step S31inFIG.12is performed, or the estimation result indicating that the work relating to the treatment for the lesion candidate region L31is performed is obtained by the processing in step S32inFIG.12, the display control section133performs setting for restricting the addition of the marker image M on the main screen MG. For example, when the estimation result indicating that the work relating to the search for the lesion candidate region L31detected by the processing in step S31inFIG.12is performed is obtained by the processing in step S32inFIG.12, the display control section133performs setting for not restricting the addition of the marker image M on the main screen MG.

In other words, according to the specific example explained above, when any one of the estimation result indicating that the work relating to the insertion of the endoscope11is performed, the estimation result indicating that the work relating to the diagnosis of the lesion candidate region L detected by the lesion-candidate-region detecting section131is performed, or the estimation result indicating that the work relating to the treatment of the lesion candidate region L detected by the lesion-candidate-region detecting section131is performed is obtained by the processing of the work-state estimating section132A, the display control section133performs setting for restricting the processing of the highlighting processing section133A for the main screen MG.

The highlighting processing section133A performs processing for suppressing addition of the marker image M on an inside of the main screen MG and adding the marker image M to an inside of the sub-screen SG based on the lesion candidate information IL31acquired by the processing in step S31inFIG.12and a setting content set by the processing in step S33inFIG.12(step S34inFIG.12).

When the processing in step S34inFIG.12is performed, for example, a display image shown inFIG.13orFIG.14is generated and the generated display image is displayed on the display apparatus14.FIG.13andFIG.14are diagrams showing examples of display images displayed according to processing of the endoscopic image processing apparatus according to the third embodiment.

In the display image illustrated inFIG.13, a periphery of the lesion candidate region L31included in an endoscopic image on the sub-screen SG is surrounded by a marker image MS3which is a rectangular frame, and, on the other hand, the marker image M is not added to a periphery of the lesion candidate region L31included in an endoscopic image on the main screen MG. In other words, when the processing for not adding the marker image M to the main screen MG and for adding the marker image M to the inside of the sub-screen SG is performed in step S34inFIG.12, the display image illustrated inFIG.13is displayed on the display apparatus14. Further, in other words, when processing for not highlighting a position of the legion candidate region L included in the main screen MG and for highlighting a position of the lesion candidate region L included in the sub-screen SG is performed by the highlighting processing section133A based on the setting content set by the processing of the display control section133in step S34inFIG.12, the display image illustrate inFIG.13is displayed on the display apparatus14.

In the display image illustrated inFIG.14, the periphery of the lesion candidate region L31included in the endoscopic image on the sub-screen SG is surrounded by the marker image MS3, which is a rectangular frame, and one marker image MM3, which is a triangular mark for pointing a position of the lesion candidate region L31included in the endoscopic image on the main screen MG, is added to each of a top, a bottom, left, and right on an outside of the main screen MG. In other words, when processing for adding the marker image M to the outside of the main screen MG is performed and processing for adding the marker image M to the inside of the sub-screen SG is performed in step S34inFIG.12, the display image illustrated inFIG.14is displayed on the display apparatus14. Further, in other words, when processing for highlighting, on the outside of the main screen MG, the position of the lesion candidate region L included in the main screen MG is performed and processing for highlighting, on the inside of the sub-screen SG, the position of the lesion candidate region L included in the sub-screen SG is performed by the highlighting processing section133A based on the setting content set by the processing of the display control section133in step S34inFIG.12, the display image illustrated inFIG.14is displayed on the display apparatus14.

The highlighting processing section133A performs processing for adding the marker images M respectively to the inside of the main screen MG and the inside of the sub-screen SG based on the lesion candidate information IL acquired by the processing in step S31inFIG.12and the setting content set by the processing in step S33inFIG.12(step S35inFIG.12).

When the processing in step S35inFIG.12is performed, for example, a display image substantially the same as the display image shown inFIG.6is displayed on the display apparatus14.

As explained above, according to a series of processing shown inFIG.12, for example, when endoscopic images are simultaneously displayed on the main screen MG and the sub-screen SG and, at the same time, work in which a time period for gazing the main screen MG is sufficiently longer than a time period for gazing the sub-screen SG is performed, it is possible to restrict addition of the marker image M to the lesion candidate region L included in the main screen MG not to hinder the work. Therefore, according to the present embodiment, it is possible to reduce a burden on a user who views endoscopic images simultaneously displayed on a plurality of screens and performs work.

Note that, in the present embodiment, for example, when an LED that generates NB light, which is blue narrow-band light, a center wavelength of which is set to near 415 nm, and an LED that generates NG light, which is green narrow-band light, a center wavelength of which is set to near 540 nm, are further provided in the light source section121, in step S32inFIG.12, processing for estimating a work state of the user may be performed based on the detection result of the instruction relating to the setting of an observation mode given by the operation switch section112. More specifically, when detecting that an instruction for setting the observation mode to a white light observation mode, which is a mode for irradiating the B light, the G light, and the R light on an object and performing observation, is given, the work-state estimating section132A may obtain an estimation result indicating that the work relating to the search for the lesion candidate region L is performed. For example, when detecting that an instruction for setting the observation mode to a narrow-band light observation mode, which is a mode for irradiating the NB light and the NG light on the object and performing observation, is given, the work-state estimating section132A may obtain an estimation result indicating that the work relating to the diagnosis of the lesion candidate region L is performed.

Fourth Embodiment

FIG.15toFIG.18relate to a fourth embodiment of the present invention.

Note that, in the present embodiment, detailed explanation concerning portions having the same components and the like as the components and the like in at least any one of the first to third embodiments is omitted. Portions having components and the like different from the components and the like in all of the first to third embodiments are mainly explained.

As shown inFIG.15, an endoscope system1B is configured by providing an endoscopic image processing apparatus13B instead of the endoscopic image processing apparatus13explained in the first embodiment. As shown inFIG.15, the endoscopic image processing apparatus13B is configured by providing an information acquiring section132B instead of the lesion-candidate-region evaluating section132explained in the first embodiment.FIG.15is a diagram showing a configuration of a main part of an endoscope system including an endoscopic image processing apparatus according to the fourth embodiment.

The information acquiring section132B is configured to, when the lesion candidate region L is detected by the lesion-candidate-region detecting section131, perform processing for reading display setting information stored in the storage medium134and acquiring a setting value included in the read display setting information. In other words, the information acquiring section132B is configured to acquire information relating to a display state at the time when a display image including the main screen MG and the sub-screen SG is displayed on the display apparatus14.

Specific examples of processing performed in sections of the endoscopic image processing apparatus13B in the present embodiment are explained with reference toFIG.16and the like. Note that, in the present embodiment, a case is explained, as an example, in which one lesion candidate region L is included in an endoscopic image outputted from the main body apparatus12. In the present embodiment, explanation is made assuming that it is possible to give, with operation of the operation switch section112, an instruction for changing the setting value SS of a screen size of the sub-screen SG to a desired setting value within a range of a lower limit value Smin or more and an upper limit value Smax or less. In the present embodiment, explanation is made assuming that it is possible to give, with operation of the operation switch section112, an instruction for changing the setting value BS of brightness of the entire display image including the main screen MG and the sub-screen SG to a desired setting value within a range of a lower limit value Bmin or more and an upper limit value Bmax or less.FIG.16is a flowchart for explaining a specific example of processing performed in the endoscopic image processing apparatus according to the fourth embodiment.

The lesion-candidate-region detecting section131performs processing for detecting the lesion candidate region L included in an endoscopic image outputted from the main body apparatus12and performs processing for acquiring the lesion candidate information IL, which is information indicating the detected lesion candidate region L (step S41inFIG.16).

More specifically, for example, the lesion-candidate-region detecting section131performs the processing in step S41inFIG.16to thereby detect a lesion candidate region L41included in the endoscopic image outputted from the main body apparatus12and acquire lesion candidate information IL41, which is information indicating the detected lesion candidate region L41.

When the lesion candidate region L is detected by the processing in step S41inFIG.16, the information acquiring section132B performs processing for reading display setting information stored in the storage medium134and acquiring a setting value included in the read display setting information (step S42inFIG.16).

The display control section133performs processing for setting a highlighting level EM4of a marker image MM4added to the main screen MG to a predetermined highlighting level. The display control section133performs processing for setting, according to the setting value included in the display setting information acquired by the processing in step S42inFIG.16, a highlighting level ES4of a marker image MS4added to the sub-screen SG (step S43inFIG.16). In other words, the display control section133performs processing for setting a highlighting level in highlighting a position of the lesion candidate region L included in the main screen MG to a predetermined highlighting level and performs processing for changing, according to information acquired by the information acquiring section132B, a highlighting level in highlighting a position of the lesion candidate region L included in the sub-screen SG.

A specific example of the processing performed in step S43inFIG.16is explained.

For example, the display control section133performs setting for increasing the highlighting level ES4of the marker image MS4added to the sub-screen SG as the setting value SS of the screen size of the sub-screen SG included in the display setting information acquired by the processing in step S42inFIG.16becomes closer to the lower limit value Smin. For example, the display control section133performs setting for reducing the highlighting level ES4of the marker image MS4added to the sub-screen SG as the setting value SS of the screen size of the sub-screen SG included in the display setting information acquired by the processing in step S42inFIG.16becomes closer to the upper limit value Smax. In other words, in such a case, the display control section133performs setting for increasing the highlighting level ES4of the marker image MS4added to the sub-screen SG as the setting value SS of the screen size of the sub-screen SG decreases and reducing the highlighting level ES4as the setting value SS increases.

For example, the display control section133performs setting for increasing the highlighting level ES4of the marker image MS4added to the sub-screen SG as the setting value BS of the brightness of the entire display image included in the display setting information acquired by the processing in step S42inFIG.16becomes closer to the lower limit value Bmin. For example, the display control section133performs setting for reducing the highlighting level ES4of the marker image MS4added to the sub-screen SG as the setting value BS of the brightness of the entire display image included in the display setting information acquired by the processing in step S42inFIG.16becomes closer to the upper limit value Bmax. In other words, in such a case, the display control section133performs setting for increasing the highlighting level ES4of the marker image MS4added to the sub-screen SG as the setting value BS of the brightness of the entire display image decreases and reducing the highlighting level ES4as the setting value BS increases.

The highlighting processing section133A performs processing for adding the marker image M to the main screen MG and the sub-screen SG based on the lesion candidate information IL41acquired by the processing in step S41inFIG.16and a setting content set by the processing in step S43inFIG.16(step S44inFIG.16).

According to the processing in step S44inFIG.16, for example, a display image shown inFIG.17orFIG.18is generated and the generated display image is displayed on the display apparatus14.FIG.17andFIG.18are diagrams showing an example of a display image displayed according to processing of the endoscopic image processing apparatus according to the fourth embodiment.

In the display image illustrated inFIG.17, a periphery of the lesion candidate region L41included in an endoscopic image on the main screen MG is surrounded by the marker image MM4, which is a rectangular frame, and a periphery of the lesion candidate region L41included in an endoscopic image on the sub-screen SG is surrounded by the marker image MS4, which is a rectangular frame. In the display image illustrated inFIG.17, the setting value SS of the screen size of the sub-screen SG is set to the upper limit value Smax (or a value close to the upper limit value Smax) and a frame line of the marker image MS4is displayed as a line having small width equivalent to line width corresponding to the highlighting level ES4.

In the display image illustrated inFIG.18, the periphery of the lesion candidate region L41included in the endoscopic image on the main screen MG is surrounded by the marker image MM4, which is a rectangular frame, and the periphery of the lesion candidate region L41included in the endoscopic image on the sub-screen SG is surrounded by the marker image MS4, which is a rectangular frame. In the display image illustrated inFIG.18, the setting value SS of the screen size of the sub-screen SG is set to the lower limit value Smin (or a value close to the lower limit value Smin) and the frame line of the marker image MS4is displayed as a line having large width equivalent to the line width corresponding to the highlighting level ES4.

As explained above, according to a series of processing shown inFIG.16, for example, when endoscopic images are simultaneously displayed on the main screen MG and the sub-screen SG and, at the same time, the sub-screen SG is viewed and work relating to a diagnosis of the lesion candidate region L is performed, it is possible to change a highlighted state of the marker image M added to the sub-screen SG not to hinder the work. As explained above, according to the series of processing shown inFIG.16, for example, when endoscopic images are simultaneously displayed on the main screen MG and the sub-screen SG and, at the same time, the main screen MG is viewed and work relating to a search for the lesion candidate region L is performed, even if a display state of the sub-screen SG is a state unsuitable for the work, it is possible to add the marker image M capable of supporting the work to the sub-screen SG. Therefore, according to the present embodiment, it is possible to reduce a burden on a user who views endoscopic images simultaneously displayed on a plurality of screens and performs work.

Note that, according to the present embodiment, for example, in step S43inFIG.16, processing for changing the highlighting level ES4of the marker image MS4added to the sub-screen SG may be performed according to a detection result of brightness of the endoscopic image outputted from the main body apparatus12. More specifically, for example, in step S43inFIG.16, brightness of the endoscopic image outputted from the main body apparatus12may be detected and setting for increasing the highlighting level ES4of the marker image MS4added to the sub-screen SG as the detected brightness decreases and reducing the highlighting level ES4as the detected brightness increases may be performed.

In the embodiments explained above, for example, a marker image MM added to the main screen MG and a marker image MS added to the sub-screen SG may be individually set to display or non-display according to an instruction given by an input apparatus such as the operation switch section112. Note that, as the input apparatus, besides the operation switch section112, for example, a footswitch, a keyboard, a tablet terminal, and a microphone and the like can be used.

The present invention is not limited to the embodiments explained above. It goes without saying that various changes and applications are possible within a range not departing from the gist of the invention.