Patent Description:
There is known an AI (Artificial Intelligence) technique of automatically detecting or automatically discriminating a lesion in an endoscopic image using a computer to make a diagnosis. In particular, the use of a learning algorithm such as a neural network enables a highly accurate diagnosis. On the other hand, collecting training images is necessary for development of a learning algorithm.

In addition, in terms of the endoscopic diagnosis, there are observation under special light such as NBI (Narrow Band Imaging, registered trademark) and BLI (Blue Laser Imaging, registered trademark) as well as observation under white light that is commonly performed.

To collect these training images, images of a single lesion need to be captured in a plurality of light source modes. Therefore, a doctor repeats a light-source switching operation and an image capturing operation every time the doctor finds a lesion. As a result, there are problems that a load of the doctor increases and time taken for examination increases.

To cope with such problems, <CIT> discloses fluorescent light observation apparatus including a reflected light imaging unit that captures an image of reflected light rays of band light rays emitted from a light source unit at a photographic subject, and a fluorescent light imaging unit that captures images of a plurality of fluorescent light rays of different bands generated by two or more of band light rays. The fluorescent light observation apparatus simultaneously captures images of the reflected light rays and the fluorescent light rays.

<CIT> discloses an electronic endoscope system comprising a display control circuit configured to selectively display oxygen saturation level images of blood vessel in different layers based on input of an image selector switch.

The fluorescent light observation apparatus of <CIT> causes a display unit to display, for each frame, a fluorescence image of a different band. However, there is a problem that a frequent change in display color makes it difficult for a doctor to observe images.

The present invention is made in view of such a circumstance and it is an object of the present invention to provide endoscopic image acquisition system and method that make observation of images easier when images are collected.

In one aspect of the present invention, there is provided an endoscopic image acquisition system according to claim <NUM>.

According to this aspect, images of an observation wavelength pattern are captured at a certain frame rate. In response to acceptance of an acquisition instruction, images of a plurality of wavelength patterns are sequentially captured. At that time, the images of the plurality of wavelength patterns are stored in a storage unit, and an image of a wavelength pattern different from the observation wavelength pattern is set not to be displayed. Thus, images of a plurality of wavelength patterns can be collected, and observation of the images can be made easier.

Preferably, the display control unit displays a latest image among already captured images of the observation wavelength pattern or an image captured before the latest image by a certain number of images, instead of displaying the image of the wavelength pattern different from the observation wavelength pattern. Since only images of the observation wavelength pattern are displayed in this manner, observation of the images can be made easier.

Preferably, the endoscopic image acquisition system further includes an interpolation image creation unit that creates an interpolation image from a plurality of images including a latest image among captured images of the observation wavelength pattern or an image captured before the latest image by a certain number of images, wherein the display control unit displays the interpolation image instead of displaying the image of the wavelength pattern different from the observation wavelength pattern. Since only images of the observation wavelength pattern are displayed in this manner, observation of the images can be made easier.

Preferably, the irradiation unit includes a plurality of light sources, and the wavelength pattern changing unit selects a light source to be turned on from among the plurality of light sources to change the wavelength pattern of the irradiation light. In this manner, the wavelength pattern of the irradiation light can be appropriately changed.

Preferably, the irradiation unit includes a plurality of light sources, and the wavelength pattern changing unit changes a ratio between light quantities of the plurality of light sources to change the wavelength pattern of the irradiation light. In this manner, the wavelength pattern of the irradiation light can be appropriately changed.

Preferably, the image capturing unit includes a filter that limits a wavelength range of light transmitting through the filter, and the wavelength pattern changing unit controls the filter to change the wavelength pattern of the returning light. In this manner, the wavelength pattern of the returning light can be appropriately changed.

Preferably, the storage control unit causes the image of the observation wavelength pattern to be stored in a first storage area of the storage unit, and causes the image of the wavelength pattern different from the observation wavelength pattern to be stored in a second storage area of the storage unit, the second storage area being different from the first storage area. In this manner, a diagnosis image and a training image can be stored in different areas of a storage unit. Note that storing a diagnosis image and a training image in different areas of a storage unit also encompasses the case where a plurality of storage units are included and a diagnosis image and a training image are stored in different storage units.

Preferably, the storage control unit causes the image to be stored in the storage unit in association with information on the wavelength pattern used in capturing of the image. In this manner, a training image associated with information on a wavelength pattern can be collected.

Preferably, the endoscopic image acquisition system further includes a wavelength pattern selection unit that allows a user to select the observation wavelength pattern, wherein the image capturing control unit causes the images to be continuously captured with the selected wavelength pattern at the certain frame rate. In this manner, images can be observed with a desired wavelength pattern.

Preferably, the endoscopic image acquisition system further includes an order selection unit that allows a user to select an order of the plurality of wavelength patterns used in sequential capturing of the images of the plurality of wavelength patterns, wherein the image capturing control unit causes the images of the plurality of wavelength patterns to be sequentially captured in the selected order. In this manner, images can be captured sequentially from a desired image.

Preferably, the endoscopic image acquisition system further includes a to-be-stored image selection unit that allows a user to select an image to be stored in the storage unit from among the images of the plurality of wavelength patterns, wherein the storage control unit causes the selected image to be stored in the storage unit. In this manner, only necessary images can be stored in the storage unit.

Preferably, the endoscopic image acquisition system further includes an automatic selection unit that automatically selects an image to be stored in the storage unit from among the images of the plurality of wavelength patterns, wherein the storage control unit causes the automatically selected image to be stored in the storage unit. In this manner, only desired images can be stored in the storage unit.

Preferably, the endoscopic image acquisition system further includes a determining unit that determines an image captured at the time of transition of the wavelength pattern when the images of the plurality of wavelength patterns are sequentially captured, wherein the automatic selection unit automatically selects the image based on a result of the determination. In this manner, an image captured at the time of transition of the wavelength pattern can be excluded from training images.

Preferably, the endoscopic image acquisition system further includes an acquisition instruction input unit with which a user inputs the acquisition instruction, wherein the accepting unit accepts the acquisition instruction from the acquisition instruction input unit. In this manner, a desired image can be acquired.

Preferably, the endoscopic image acquisition system further includes a recognition unit that recognizes a scene of interest from among the captured images; and an acquisition instruction output unit that outputs the acquisition instruction in response to the recognition unit recognizing the scene of interest, wherein the accepting unit accepts the acquisition instruction from the acquisition instruction output unit. In this manner, an image of a scene of interest can be automatically acquired.

[According to the present invention, observation of images can be made easier when images are collected.

Preferred embodiments of the present invention will be described in detail below in accordance with the accompanying drawings.

<FIG> is an external view of an endoscope system <NUM> (an example of an endoscopic image acquisition system) according to a first embodiment. As illustrated in <FIG>, the endoscope system <NUM> includes an endoscope <NUM>, a light source device <NUM>, a processor device <NUM>, a display unit <NUM>, and an input unit <NUM>.

The endoscope <NUM> is optically connected to the light source device <NUM>. The endoscope <NUM> is also electrically connected to the processor device <NUM>.

The endoscope <NUM> has an insertion part 12A to be inserted into a body cavity of a patient, an operation unit 12B provided at a proximal end portion of the insertion part 12A, and a bending part 12C and a tip part 12D that are provided on the distal end side of the insertion part 12A.

The operation unit 12B is provided with an angle knob 12E and a mode switch 13A. The operation unit 12B is also provided with an acquisition instruction input unit 13B (see <FIG>).

An operation on the angle knob 12E causes a bending action of the bending part 12C. Through this bending action, the tip part 12D is directed toward a desired direction.

The mode switch 13A is used for an observation mode switching operation. The endoscope system <NUM> has a plurality of observation modes for which wavelength patterns of irradiation light are different from one another. A doctor can set a desired observation mode by operating the mode switch 13A. The endoscope system <NUM> generates an image according to the set observation mode using a combination of the wavelength pattern and image processing and displays the image on the display unit <NUM>.

The endoscope system <NUM> is capable of acquiring a still image of a desired position. In the present embodiment, the endoscope system <NUM> is capable of acquiring a diagnosis image for used in creation of a diagnosis report and a training image for use in learning of a learning algorithm. The acquisition instruction input unit 13B (an example of an accepting unit) is an interface used by a doctor to input a still image acquisition instruction. The acquisition instruction input unit 13B accepts the still image acquisition instruction. The still image acquisition instruction accepted by the acquisition instruction input unit 13B is input to the processor device <NUM>.

The processor device <NUM> is electrically connected to the display unit <NUM> and the input unit <NUM>. The display unit <NUM> is a display device that outputs or displays an image to be observed, information relating to the image to be observed, and so on. The input unit <NUM> functions as a user interface that accepts input operations of function settings, various instructions, and so on of the endoscope system <NUM>.

<FIG> is a block diagram illustrating functions of the endoscope system <NUM>. As illustrated in <FIG>, the light source device <NUM> includes a first laser light source 22A, a second laser light source 22B, and a light source control unit <NUM>.

The first laser light source 22A is a blue laser light source having a center wavelength of <NUM>. The second laser light source 22B is a violet laser light source having a center wavelength of <NUM>. Laser diodes can be used as the first laser light source 22A and the second laser light source 22B. Light emission of the first laser light source 22A and light emission of the second laser light source 22B are separately controlled by the light source control unit <NUM>. A ratio between intensity of light emitted by the first laser light source 22A and intensity of light emitted by the second laser light source 22B is changeable in any manner.

In addition, as illustrated in <FIG>, the endoscope <NUM> includes an optical fiber 28A, an optical fiber 28B, a fluorescent body <NUM>, a diffusion member <NUM>, an imaging lens <NUM>, an imaging element <NUM>, and an analog-to-digital converter <NUM>.

The first laser light source 22A, the second laser light source 22B, the optical fiber 28A, the optical fiber 28B, the fluorescent body <NUM>, and the diffusion member <NUM> constitute an irradiation unit.

The fluorescent body <NUM> disposed at the tip part 12D of the endoscope <NUM> is irradiated with laser light emitted from the first laser light source 22A through the optical fiber 28A. The fluorescent body <NUM> includes a plurality of kinds of fluorescent bodies that absorb part of blue laser light emitted from the first laser light source 22A to be excited and emit green to yellow light. Accordingly, green to yellow excitation light L<NUM> for which blue laser light emitted from the first laser light source 22A has served as excitation light and blue laser light L<NUM> that has transmitted through the fluorescent body <NUM> without being absorbed are combined. Consequently, the light outgoing from the fluorescent body <NUM> is white (pseudo-white) light L<NUM>.

Note that white light used herein is not limited light strictly including all the wavelength components of visible light. For example, white light may be light including light of particular wavelength ranges such as light of R (red), G (green), and B (blue). It is assumed that white light includes in a broad sense light including wavelength components of green to red, light including wavelength components of blue to green, and so on.

On the other hand, the diffusion member <NUM> disposed at the tip part 12D of the endoscope <NUM> is irradiated with laser light emitted from the second laser light source 22B through the optical fiber 28B. A resin material having a light-transmitting property or the like can be used as the diffusion member <NUM>. Light outgoing from the diffusion member <NUM> is light L<NUM> of a narrow wavelength range having a homogeneous quantity of light in an irradiation region.

<FIG> is a graph illustrating a light intensity distribution of the light L<NUM> and the light L<NUM>. The light source control unit <NUM> (an example of a wavelength pattern changing unit) changes a light-quantity ratio between the first laser light source 22A and the second laser light source 22B. In this manner, the light-quantity ratio between the light L<NUM> and the light L<NUM> is changed, so that a wavelength pattern of irradiation light L<NUM> which is the combined light of the light L<NUM> and the light L<NUM> is changed. Thus, a part to be observed can be irradiated with the irradiation light L<NUM> having characteristics that are different from one another.

As described above, the endoscope system <NUM> has a plurality of observation modes. It is assumed herein that the endoscope system <NUM> has three observation modes, that is, a mode MA, a mode MB, and a mode MC. Note that the number of observation modes is not limited to three.

The light-quantity ratio between light emitted from the first laser light source 22A and light emitted from the second laser light source 22B in the mode MA is <NUM>:<NUM>. A wavelength pattern of the irradiation light L<NUM> generated based on this light-quantity ratio is referred to as a wavelength pattern PA. In the mode MA, a white light image can be acquired.

The light-quantity ratio between light emitted from the first laser light source 22A and light emitted from the second laser light source 22B in the mode MB is <NUM>:<NUM>. A wavelength pattern of the irradiation light L<NUM> generated based on this light-quantity ratio is referred to as a wavelength pattern PB. In the mode MB, an image in which blood vessels and structures of a skin layer of a biological tissue are emphasized can be acquired.

The light-quantity ratio between light emitted from the first laser light source 22A and light emitted from the second laser light source 22B in the mode MC is <NUM>: <NUM>. A wavelength pattern of the irradiation light L<NUM> generated based on this light-quantity ratio is referred to as a wavelength pattern PC. In the mode MC, an image in which blood vessels and surface structures in an intermediate to distant range are emphasized can be acquired.

Note that the quantity of the irradiation light La in each of the wavelength patterns PA, PB, and PC is appropriately adjusted.

The description now returns to <FIG>. The imaging lens <NUM>, the imaging element <NUM>, and the analog-to-digital converter <NUM> constitute an image capturing unit. The image capturing unit is disposed in the tip part 12D of the endoscope <NUM>.

Returning light including reflected light of the irradiation light L<NUM> from a part to be observed and/or self-fluorescence from the part to be observed is incident to the imaging lens <NUM>. The imaging lens <NUM> forms an image of the incident light onto the imaging element <NUM>. The imaging element <NUM> generates an analog signal based on the received light. A CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor is used as the imaging element <NUM>. The analog signal output from the imaging element <NUM> is converted into a digital signal by the analog-to-digital converter <NUM>, and the digital signal is input to the processor device <NUM>.

In addition, as illustrated in <FIG>, the processor device <NUM> includes an image capturing control unit <NUM>, an image processing unit <NUM>, a display control unit <NUM>, a storage control unit <NUM>, and a storage unit <NUM>.

The still image acquisition instruction accepted by the acquisition instruction input unit 13B is input to the image capturing control unit <NUM>. The image capturing control unit <NUM> controls the light source control unit <NUM> of the light source device <NUM>, the imaging element <NUM> and the analog-to-digital converter <NUM> of the endoscope <NUM>, and the image processing unit <NUM> of the processor device <NUM>. The image capturing control unit <NUM> centrally controls capturing of moving images and still images performed by the endoscope system <NUM>.

The image processing unit <NUM> performs image processing on the digital signal input from the analog-to-digital converter <NUM> of the endoscope <NUM> to generate image data (hereinafter, referred to as an image) representing an image. The image processing unit <NUM> performs image processing according to a wavelength pattern of irradiation light L<NUM> used at the time of image capturing.

The display control unit <NUM> causes the display unit <NUM> to sequentially display images generated by the image processing unit <NUM>.

In addition, the storage control unit <NUM> causes the storage unit <NUM> to store an image captured in accordance with a still image acquisition instruction, information relating to the image, and so on. The storage unit <NUM> is, for example, a storage device such as a hard disk. Note that the storage unit <NUM> is not limited to a storage device built in the processor device <NUM>. For example, the storage unit <NUM> may be an external storage device (not illustrated) that is connected to the processor device <NUM>. The external storage device may be connected via a network.

The endoscope system <NUM> thus configured usually captures a moving image at a certain frame rate and displays the captured moving image on the display unit <NUM>. In addition, when a still image acquisition instruction is input from the acquisition instruction input unit 13B, the endoscope system <NUM> captures a still image and stores the still image in the storage unit <NUM>.

A training image collection method according to the first embodiment performed by the endoscope system <NUM> will be described. Here, still images are acquired which are captured by radiating the irradiation light L<NUM> of each of the three wavelength patterns PA, PB, and PC in response to a still image acquisition instruction. In addition, an image of a wavelength pattern that is the same as the wavelength pattern of the irradiation light L<NUM> of the observation mode is stored as a diagnosis image. An image of a wavelength pattern that is different from the wavelength pattern of the irradiation light L<NUM> of the observation mode is stored as a training image.

<FIG> is a flowchart illustrating a process of the training image collection method (an example of an endoscopic image acquisition method) in moving image observation. In addition, <FIG> is a timing chart describing the process of the training image collection method. In <FIG>, a period from time TN to time TN+<NUM> (where N = <NUM> to <NUM>) indicates a frame rate of image capturing and each is <NUM>/<NUM> seconds.

To start moving image observation, a doctor selects an observation mode for capturing a moving image (an observation wavelength pattern) from among the modes MA, MB, and MC by using the input unit <NUM> (an example of a wavelength pattern selection unit) in step S1. Here, the doctor selects the mode MA, for example. Note that the observation mode for capturing a moving image can be appropriately changed even during capturing of a moving image. In addition, the observation mode for capturing a moving image may be determined in advance.

Then, the doctor inserts the insertion part 12A of the endoscope <NUM> into a body cavity of a patient. The observation mode for capturing a moving image may be selected after the insertion of the endoscope <NUM>.

Subsequently, in step S2, a moving image is captured in the observation mode selected in step S1 and the resulting moving image is displayed. Specifically, the light source control unit <NUM> sets the light emitted from the first laser light source 22A and the light emitted from the second laser light source 22B to have a light-quantity ratio corresponding to the observation mode selected in step S1. Consequently, a part to be observed in the body cavity of the patient is irradiated with the irradiation light L<NUM> of the desired wavelength pattern (an example of an irradiation step, and an example of a wavelength pattern changing step).

In addition, the image capturing control unit <NUM> controls the imaging element <NUM>, the analog-to-digital converter <NUM>, and the image processing unit <NUM> to acquire an image of the part to be observed based on received light returning from the part to be observed (an example of an image capturing step). Further, the display control unit <NUM> causes the display unit <NUM> to display the image generated by the image processing unit <NUM> (an example of a display control step).

In an example illustrated in <FIG>, an image VA<NUM> is captured in a period from time T<NUM> to time T<NUM>. In addition, the image VA<NUM> is displayed and a following image VA<NUM> is captured in a subsequent period from time T<NUM> to time T<NUM>. Further, the image VA<NUM> is displayed and a following image VA<NUM> is captured in a subsequent period from time T<NUM> to time T<NUM>.

In this manner, images are captured at a certain frame rate. In addition, the captured images are displayed on the display unit <NUM> at a timing that is delayed by one frame.

Processing of steps S3 to S13 described below is performed as an interrupt process of moving-image capturing performed in step S2.

In step S3, it is determined whether or not an instruction to end the moving image observation is input. The doctor can input the instruction to end the moving image observation by using the input unit <NUM>. If the instruction to end is input, the process illustrated in this flowchart ends.

If the instruction to end moving image observation is not input, the process proceeds to step S4. In step S4, the image capturing control unit <NUM> determines whether or not a still image acquisition instruction is input. As described before, the doctor can input the still image acquisition instruction from the acquisition instruction input unit 13B. If the acquisition instruction is not input, the process returns to step S2, and the similar processing is repeated. That is, capturing of the moving image is continued. If it is determined that the still image acquisition instruction is input (an example of an accepting step), the process proceeds to step S5.

In step S5 and subsequent steps, acquisition of still images is performed. Herein, description will be given of a case where nine still images in total are acquired by repeatedly performing three times a process of capturing of one still image with the wavelength pattern PA, capturing of one still image with the wavelength pattern PB, and capturing one still image with the wavelength pattern PC.

In the example illustrated in <FIG>, a still image acquisition instruction is input in the period from time T<NUM> to time T<NUM>. In this period from time T<NUM> to time T<NUM>, the image VA<NUM> is captured under the control of the image capturing control unit <NUM>. Thus, a still image acquisition process is started from time T<NUM> which is the next image capturing start timing.

First in step S5, the light source control unit <NUM> sets the wavelength pattern. Here, the first still image is a still image of the wavelength pattern PA. Therefore, the light source control unit <NUM> sets the light emitted from the first laser light source 22A and the light emitted from the second laser light source 22B to have a light-quantity ratio of the wavelength pattern PA. Consequently, a part to be observed is irradiated with the irradiation light L<NUM> of the wavelength pattern PA.

Next in step S6, capturing of still images is performed. Specifically, the image capturing control unit <NUM> controls the imaging element <NUM>, the analog-to-digital converter <NUM>, and the image processing unit <NUM> to capture an image SA<NUM> of the part to be observed (an example of an image capturing step). In addition, the display control unit <NUM> displays on the display unit <NUM> the image VA<NUM> which is the latest captured image at this time point.

Subsequently in step S7, the display control unit <NUM> determines whether or not the image SA<NUM> captured in step S6 is an image of the same wavelength pattern as the wavelength pattern of the observation mode selected in step S1, that is, whether or not the wavelength pattern of the irradiation light L<NUM> for the image SA<NUM> is the same as the wavelength pattern of the irradiation light L<NUM> of the observation mode selected in step S1. Here, the image SA<NUM> is an image of the wavelength pattern PA. In addition, the observation mode selected in step S1 is the mode MA, and the wavelength pattern in the mode MA is the wavelength pattern PA. Since the wavelength patterns are the same in this manner, YES is determined and the process proceeds to step S8.

In step S8, the display control unit <NUM> sets the image SA<NUM> captured in step S6 as a to-be-displayed image. In addition, in subsequent step S9, the storage control unit <NUM> stores the image SA<NUM> in a first storage area of the storage unit <NUM> in association with information on the wavelength pattern PA of the irradiation light L<NUM> used in capturing of the image SA<NUM> (an example of a storage control step). The first storage area is an area for storing a diagnosis image. The first storage area is, for example, one drive among a plurality of drives of the storage unit <NUM> or one folder among a plurality of folders.

Next in step S12, it is determined whether or not acquisition of still images is finished. Here, since acquisition of still images is not finished, the process returns to step S5.

Here, a second still image (a first still image in the mode MB) is captured from time T<NUM>. Specifically, in step S5, the light emitted from the first laser light source 22A and the light emitted from the second laser light source 22B are set to have a light-quantity ratio of the wavelength pattern PB. Then in step S6, an image SB<NUM> is captured. In addition, since the image SA<NUM> is set as a to-be-displayed image in previous step S8, the display control unit <NUM> causes the display unit <NUM> to display the image SA<NUM> from time T<NUM>.

Subsequently in step S7, the display control unit <NUM> determines whether or not the image SB<NUM> captured in step S6 is an image of the same wavelength pattern as the wavelength pattern of the observation mode selected in step S1, that is, whether or not the wavelength pattern of the irradiation light L<NUM> for the image SB<NUM> is the same as the wavelength pattern of the irradiation light L<NUM> of the observation mode selected in step S1. Here, the image SB<NUM> is an image of the wavelength pattern PB. In addition, the observation mode selected in step S1 is the mode MA, and the wavelength pattern in the mode MA is the wavelength pattern PA. Since the wavelength patterns are different in this manner, NO is determined and the process proceeds to step S10.

In step S10, the display control unit <NUM> sets the image SB<NUM> captured in step S6 not to be displayed. In addition, in subsequent step S11, the storage control unit <NUM> stores the image SB<NUM> in a second storage area of the storage unit <NUM> in association with information on the wavelength pattern PB of the irradiation light L<NUM> used in capturing of the image SB<NUM> (an example of the storage control step). The second storage area is an area for storing training images. The second storage area is, for example, one drive among a plurality of drives of the storage unit <NUM> or one folder among a plurality of folders and is an area different from the first storage area. The storage unit <NUM> may be used as the first storage area, and a storage device different from the storage unit <NUM> may be used as the second storage area.

Here, a third still image (a first still image in the mode MC) is captured from time T<NUM>. Specifically, in step S5, the light emitted from the first laser light source 22A and the light emitted from the second laser light source 22B are set to have a light-quantity ratio of the wavelength pattern PC. Then in step S6, an image SC<NUM> is captured.

Note that since the image SB<NUM> is set not to be displayed in previous step S10, the display control unit <NUM> does not display the image SB<NUM> on the display unit <NUM>. Here, instead of the image SB<NUM>, the image SA<NUM> that is displayed from time T<NUM> is continuously displayed on the display unit <NUM>.

Subsequently in step S7, the display control unit <NUM> determines whether or not the image SC<NUM> captured in step S6 is an image of the same wavelength pattern as the wavelength pattern of the observation mode selected in step S1, that is, whether or not the wavelength pattern of the irradiation light L<NUM> for the image SC<NUM> is the same as the wavelength pattern of the irradiation light L<NUM> of the observation mode selected in step S1. Here, the image SC<NUM> is an image of the wavelength pattern PC. In addition, the observation mode selected in step S1 is the mode MA, and the wavelength pattern in the mode MA is the wavelength pattern PA. Since the wavelength patterns are different in this manner, NO is determined and the process proceeds to step S10.

In step S10, the display control unit <NUM> sets the image SC<NUM> not to be displayed. In addition, in subsequent step S11, the storage control unit <NUM> stores the image SC<NUM> in the second storage area of the storage unit <NUM> in association with information on the wavelength pattern PC of the irradiation light L<NUM> used in capturing of the image SC<NUM>.

Next in step S12, it is determined whether or not acquisition of still images is finished. Here, since acquisition of still images is not finished yet, the process returns to step S5.

Likewise, an image SA<NUM> which is a fourth still image (a second still image in the mode MA) is captured with the irradiation light L<NUM> of the wavelength pattern PA from time T<NUM> (steps S5 and S6). In addition, since the image SC<NUM> is set not to be displayed in previous step S10, the display control unit <NUM> does not display the image SC<NUM> on the display unit <NUM>. Here, instead of the image SC<NUM>, the image SA<NUM> that is displayed from time T<NUM> is continuously displayed on the display unit <NUM>.

Here, the image SA<NUM> is an image of the same wavelength pattern as the wavelength pattern of the observation mode selected in step S1. Thus, YES is determined in step S7, and the process proceeds to step S8.

In step S8, the image SA<NUM> is set as a to-be-displayed image. In addition, in step S9, the image SA<NUM> is stored in the first storage area of the storage unit <NUM> in association with information on the wavelength pattern PA of the irradiation light L<NUM> used in capturing of the image SA<NUM>.

Likewise, an image SB<NUM> which is a fifth still image (a second still image in the mode MB) is captured with the irradiation light L<NUM> of the wavelength pattern PB from time T<NUM> (steps S5 and S6). In addition, since the image SA<NUM> is set as a to-be-displayed image in previous step S8, the display control unit <NUM> causes the display unit <NUM> to display the image SA<NUM>.

Here, the image SB<NUM> is not an image of the same wavelength pattern as the wavelength pattern of the observation mode selected in step S1. Thus, NO is determined in step S7, and the process proceeds to step S10.

In step S10, the display control unit <NUM> sets the image SB<NUM> not to be displayed. In addition, in subsequent step S11, the storage control unit <NUM> stores the image SB<NUM> in the second storage area of the storage unit <NUM> in association with information on the wavelength pattern PB of the irradiation light L<NUM> used in capturing of the image SB<NUM>.

Thereafter, sixth to ninth still images, that is, an image SC<NUM> which is a second still image captured with the wavelength pattern PC, an image SA<NUM> which is a third still image captured with the wavelength pattern PA, an image SB<NUM> which is a third still image captured with the wavelength pattern PB, and an image SC<NUM> which is a third still image captured with the wavelength pattern PC, are sequentially captured.

After capturing of all the still images is finished, it is determined in step S12 that acquisition of still images is finished. The process proceeds to step S13.

In step S13, the wavelength pattern of the irradiation light L<NUM> is returned to the wavelength pattern of the observation mode selected in step S1. Here, the wavelength pattern of the irradiation light L<NUM> is returned to the wavelength pattern PA. The process then returns to step S2, and the similar processing is repeated.

Note that the image SC<NUM> captured lastly is set not to be displayed in step S10. Thus, when capturing of a moving image is restarted after the process returns to step S2, the image SC<NUM> is not displayed on the display unit <NUM>. Here, instead of the image SC<NUM>, the image SA<NUM> that is displayed from time T<NUM> is continuously displayed on the display unit <NUM>.

Note that an image captured in the previous frame is displayed on the display unit <NUM> from time T<NUM>.

By performing collection of training images in the above-described manner, training still images are successfully captured and stored. In addition, at a display timing of a still image of the wavelength pattern that is different from the wavelength pattern of the irradiation light L<NUM> of the selected observation mode (an example of a display timing of an image of a wavelength pattern other than an observation wavelength pattern), the latest image among images of the same wavelength patterns as the wavelength pattern of the irradiation light L<NUM> of the selected observation mode (an example of a latest image among already captured images of the observation wavelength pattern) is displayed. This makes the display color during acquisition of still images be the same color as the display color during acquisition of a moving image, making observation using the display unit <NUM> easier.

The order in which still images are acquired and the number of still images to be acquired are not limited to the examples described in the first embodiment.

For example, a doctor may designate the number of still images to be acquired by using the input unit <NUM>. In the first embodiment, three still images are acquired with each of the wavelength patterns. Alternatively, two or four or more still images may be acquired with each of the wavelength patterns. As described above, as many still images as required can be captured.

In addition, the doctor may select the acquisition order by using the input unit <NUM> (an example of an order selection unit). In the first embodiment, still images are acquired in an order of the wavelength pattern PA, the wavelength pattern PB, and the wavelength pattern PC. Alternatively, still images can be acquired in a desired order, for example, in an order of the wavelength pattern PB, the wavelength pattern PC, and the wavelength pattern PA, in an order of the wavelength pattern PC, the wavelength pattern PA, and the wavelength pattern PB, or in an order of the wavelength pattern PC, the wavelength pattern PB, and the wavelength pattern PA.

In addition, a plurality of images of the same wavelength pattern may be acquired continuously. For example, in an example of a timing chart illustrated in <FIG>, nine still images in total are acquired by continuously capturing three still images with the wavelength pattern PA, continuously capturing three still images with the wavelength pattern PB, and continuously capturing three still images with the wavelength pattern PC. Note that in this example the latest image SA<NUM> captured with the wavelength pattern PA is displayed in a period from time T<NUM> to time T<NUM>.

Further, a continuous image capturing process may be repeatedly performed a plurality of times. For example, the order may be set such that <NUM> still images in total are acquired by performing twice a process of continuously capturing three still images with the wavelength pattern PA, continuously capturing three still images with the wavelength pattern PB, and continuously capturing three still images with the wavelength pattern PC.

It is anticipated that adhesion of dust onto the imaging lens <NUM>, a difficulty in maintaining an imaging angle, and the like make it difficult to acquire a desired image in capturing of endoscopic images if elapsed time from input of an image capturing instruction increases. Thus, it is preferable to allow for designation of an order of wavelength patterns used for image capturing in order to capture an image of a waveform pattern considered to be important first.

In addition, a doctor may select a wavelength pattern with which still images are to be acquired, by using the input unit <NUM>. For example, if still images of the wavelength pattern PB are not necessary, only still images of the wavelength pattern PA and still images of the wavelength pattern PC can be captured.

At a display timing of a still image of a wavelength pattern that is different from the wavelength pattern of the irradiation light L<NUM> of the selected observation mode, an image captured before the latest image by a certain number of images may be displayed.

<FIG> is a timing chart describing a process of a training image collection method according to the third embodiment performed by the endoscope system <NUM>.

Here, instead of an image SA<NUM> which is the latest image captured with the irradiation light L<NUM> of the waveform pattern PA, an image VA<NUM> which is an image captured with the irradiation light L<NUM> of the wavelength pattern PA before the latest image SA<NUM> by one image is displayed in a period from time T<NUM> to time T<NUM>.

In addition, instead of an image SA<NUM> which is the latest image captured with the irradiation light L<NUM> of the wavelength pattern PA, the image SA<NUM> which is an image captured with the irradiation light L<NUM> of the wavelength pattern PA before the latest image SA<NUM> by one image is displayed in a period from time T<NUM> to time T<NUM>.

Likewise, an image SA<NUM> which is an image captured before the latest image SA<NUM> by one image is displayed in a period from time T<NUM> to time T<NUM>.

Here, an image captured before the latest image by one image is displayed. Alternatively, an image captured further before may be displayed. As described above, even when an image captured before the latest image by a certain number of images (an example of an image captured before a latest image by a certain number of images among already captured images of an observation wavelength pattern) is displayed, only the images of the same wavelength pattern of the irradiation light L<NUM> as the wavelength pattern of the irradiation light L<NUM> of the selected observation mode are displayed. This thus makes observation using the display unit <NUM> easier.

In the endoscope system <NUM>, the latest image among images of the same wavelength pattern as the wavelength pattern of the irradiation light L<NUM> of the selected observation mode, or an image captured before the latest image by a certain number of images is displayed at a display timing of a still image of a wavelength pattern that is different from the wavelength pattern of the irradiation light L<NUM> of the selected observation mode. Alternatively, an interpolation image may be displayed instead of the captured image.

<FIG> is a block diagram illustrating functions of an endoscope system <NUM>. Note that parts that are common to the block diagram illustrated in <FIG> are assigned the same reference signs, and detailed description thereof is omitted.

The endoscope system <NUM> includes an interpolation image creation unit <NUM> in the image processing unit <NUM>. The interpolation image creation unit <NUM> includes a memory not illustrated, and creates an interpolation image from a plurality of images stored in the memory.

<FIG> is a flowchart illustrating a process of a training image collection method performed by the endoscope system <NUM>. In addition, <FIG> is a timing chart describing the process of the training image collection method performed by the endoscope system <NUM>. Note that parts that are common to the flowchart illustrated in <FIG> and to the timing chart illustrated in <FIG> are assigned the same reference signs, and detailed description thereof is omitted.

As in the first embodiment, a doctor selects the mode MA as an observation mode (step S1). The endoscope system <NUM> performs capturing of a moving image in the mode MA (step S2).

Note that it is assumed that nine still images are acquired by repeatedly performing three sets of processes, each set being a process of capturing one still image in the mode MA, capturing one still image in the mode MB, and capturing one still image in the mode MC, at the time of acquisition of still images.

If it is determined that a still image acquisition instruction is input in a period from time T<NUM> to time T<NUM> (step S4), a still image acquisition process is started from time T<NUM>. First, an image SA<NUM> is captured with the wavelength pattern PA in a period from time T<NUM> to time T<NUM>. In addition, the image VA<NUM> is displayed on the display unit <NUM> (steps S5 and S6).

Since the image SA<NUM> captured at this time is an image of the same wavelength pattern as the wavelength pattern of the mode MA which is the selected observation mode, the image SA<NUM> is set as a to-be-displayed image (step S8).

An image SB<NUM> is captured with the wavelength pattern PB in a period from time T<NUM> to time T<NUM> which is the next image capturing timing.

Since the image SB<NUM> captured at this time is an image of the wavelength pattern that is different from the wavelength pattern of the mode MA, the image SB<NUM> is set not to be displayed (step S10).

In subsequent step S21, the interpolation image creation unit <NUM> creates an interpolation image interpolated between the latest image and an image captured before the latest image by a certain number of images, among images captured with the wavelength pattern of the irradiation light L<NUM> of the selected observation mode. Here, the interpolation image creation unit <NUM> creates an interpolation image IA<NUM> interpolated between the image SA<NUM> which is the latest image and an image VA<NUM> which is an image captured before the latest image SA<NUM> by one image. Note that the image SA<NUM> and the image VA<NUM> are stored in a memory (not illustrated) of the interpolation image creation unit <NUM>.

The interpolation image IA<NUM> may be created by determining an average of each pixel of the image SA<NUM> and a corresponding pixel of the image VA<NUM> or by determining a weighted-average of each corresponding pair of pixels. In addition, the weight may be increased for a new image. Here, two images, i.e., the image SA<NUM> and the image VA<NUM>, are used. An image captured before the image SA<NUM> by a certain number of images may further be used.

After the interpolation image IA<NUM> is created, the process proceeds to step S11. In step S <NUM>, the storage control unit <NUM> stores the image SB<NUM> in the second storage area of the storage unit <NUM> in association with information on the wavelength pattern PB of the irradiation light L<NUM> used in capturing of the image SB<NUM>. The interpolation image IA<NUM> may be stored.

Subsequently, an image SC<NUM> is captured with the wavelength pattern PC in a period from time T<NUM> to time T<NUM>. In addition, since the image SB<NUM> is set not to be displayed in previous step S10, the display control unit <NUM> does not display the image SB<NUM> on the display unit <NUM>. Instead, the display control unit <NUM> displays the interpolation image IA<NUM> created in previous step S21 on the display unit <NUM> from time T<NUM> (steps S5 and S6).

Then the display control unit <NUM> sets the image SC<NUM> not to be displayed (step S10). Further, the interpolation image creation unit <NUM> creates an interpolation image IA<NUM> interpolated between the image SA<NUM> which is the latest image among images captured with the wavelength pattern of the irradiation light L<NUM> of the selected observation mode and the image VA<NUM> which is an image captured before the latest image by one image (step S21). Here, since the same interpolation image IA<NUM> has been created in previous step S21, the interpolation image IA<NUM> stored in the memory (not illustrated) of the interpolation image creation unit <NUM> can be used without performing any processing. Note that a new interpolation image may be created by changing the weight ratio used in weighted-averaging of the image SA<NUM> and the image VA<NUM>.

An image SA<NUM> is captured with the wavelength pattern PA in a period from time T<NUM> to time T<NUM> which is the next image capturing timing. In addition, the display control unit <NUM> displays the interpolation image IA<NUM> created in previous step S21 on the display unit <NUM> (steps S5 and S6). This image SA<NUM> is set as a to-be-displayed image (step S8).

Further, an image SB<NUM> is captured with the wavelength pattern PB in a period from time T<NUM> to time T<NUM> which is the next image capturing timing. In addition, the display control unit <NUM> displays the image SA<NUM> captured the last time on the display unit <NUM> (steps S5 and S6).

Thereafter, in the similar manner, an interpolation image IA<NUM> created from the image SA<NUM> and the image SA<NUM> is displayed on the display unit <NUM> at display timings of the images SB<NUM> and SC<NUM> (from time Tsto time T<NUM>), and an interpolation image IA<NUM> created from the image SA<NUM> and the image SA<NUM> is displayed on the display unit <NUM> at display timings of the image SB<NUM> and the image SC<NUM> (from time T<NUM> to time T<NUM>).

Here, an interpolation image is created from the latest image and an image captured before the latest image by a certain number of images. It is sufficient that an interpolation image is created from a plurality of images including the latest image among a plurality of images of the wavelength pattern of the selected observation mode or an image captured before the latest image by a certain number of images.

Such a display allows only images of the same wavelength pattern of the irradiation light L<NUM> as the wavelength pattern of the irradiation light L<NUM> of the selected observation mode to be displayed. This thus makes observation using the display unit <NUM> easier.

Acquisition of still images may be automatically performed independently of a still image acquisition instruction given by a doctor through the acquisition instruction input unit 13B.

The processor device <NUM> of the endoscope system <NUM> includes an acquisition instruction output unit <NUM>. The acquisition instruction output unit <NUM> automatically outputs a still image acquisition instruction. The still image acquisition instruction output by the acquisition instruction output unit <NUM> is input to the image capturing control unit <NUM>.

The acquisition instruction output unit <NUM> includes a recognition unit <NUM>. The recognition unit <NUM> detects a scene of interest from an input image. Here, the recognition unit <NUM> particularly detects a lesion region. Note that the scene of interest is not limited to a lesion region.

The recognition unit <NUM> can use a learning algorithm such as a neural network. In response to the recognition unit <NUM> detecting a lesion region, the acquisition instruction output unit <NUM> outputs a still image acquisition instruction.

Collection of training images performed by the endoscope system <NUM> will be described using a flowchart illustrated in <FIG>.

First, a doctor selects an observation mode for capturing a moving image by using the input unit <NUM> (step S1). Subsequently, the endoscope system <NUM> captures a moving image in the selected observation mode (step S2).

The captured image is input to the acquisition instruction output unit <NUM> from the image processing unit <NUM>. The recognition unit <NUM> of the acquisition instruction output unit <NUM> recognizes a lesion region from the input image. In response to the recognition unit <NUM> detecting a lesion region from the image, the acquisition instruction output unit <NUM> outputs a still image acquisition instruction. Consequently, YES is determined in step S4, and the process proceeds to step S5. The following processing is substantially the same as that described above.

The endoscope system <NUM> can automatically collect training images. In addition, only images of the wavelength pattern of the irradiation light L<NUM> that is the same as the wavelength pattern of the irradiation light L<NUM> of the selected observation mode are displayed. This thus makes observation using the display unit <NUM> easier.

Here, the recognition unit <NUM> detects a lesion region. In response to the recognition unit <NUM> detecting a lesion region, the acquisition instruction output unit <NUM> outputs a still image acquisition instruction. Alternatively, the acquisition instruction may be output in response to a trigger other than detection of a scene of interest, such as a lesion region. For example, a still image acquisition instruction may be output every certain period.

The endoscope system <NUM> stores all the captured still images in the storage unit <NUM>. Alternatively, only images suitable for learning may be stored.

The processor device <NUM> of the endoscope system <NUM> includes an automatic selection unit <NUM>. The automatic selection unit <NUM> automatically selects an image to be stored in a storage unit from among still images input thereto. The storage control unit <NUM> causes the still image selected by the automatic selection unit <NUM> to be stored in the storage unit <NUM>.

The automatic selection unit <NUM> includes a determining unit <NUM>. The determining unit <NUM> determines whether or not the input still image is suitable as a training image. Here, it is particularly determined whether or not the irradiation light L<NUM> used when the still image is captured has a desired wavelength pattern.

<FIG> is a flowchart illustrating a process of a training image collection method performed by the endoscope system <NUM>. Note that parts that are common to the flowchart illustrated in <FIG> are assigned the same reference signs, and detailed description thereof is omitted.

In response to a still image acquisition instruction (step S4), the endoscope system <NUM> captures a still image (step S6). Subsequently, it is determined whether or not the image captured in step S6 is an image of the same wavelength pattern as the wavelength pattern of the selected observation mode (step S7).

If the image captured in step S6 is an image of the same wavelength pattern, the process proceeds to step S8. Then, the captured image is set as a to-be-displayed image (step S8).

In subsequent step S31, the determining unit <NUM> of the automatic selection unit <NUM> determines whether or not the captured image is suitable as a training image. Here, it is particularly determined whether or not the irradiation light L<NUM> used when the still image is captured has a desired wavelength pattern.

The determining unit <NUM> analyzes the color of the image to estimate the wavelength pattern of the irradiation light L<NUM> used in capturing of the image, and determines whether or not the estimated wavelength pattern is a desired wavelength pattern. If the determining unit <NUM> determines that the estimated wavelength pattern is a desired wavelength pattern, the automatic selection unit <NUM> selects the image as a training image. The process then proceeds to step S9.

In step S9, the image is stored in the first storage area of the storage unit <NUM> in association with information on the wavelength pattern.

In addition, if the determining unit <NUM> determines that the estimated wavelength pattern is not a desired wavelength pattern, the automatic selection unit <NUM> does not select the image as a training image and does not store the image. The process then proceeds to step S12.

On the other hand, if it is determined in step S7 that the captured image is not an image of the same wavelength pattern, the process proceeds to step S10. Then, the captured image is set not to be displayed (step S10).

In subsequent step S32, the determining unit <NUM> of the automatic selection unit <NUM> determines whether or not the captured image is suitable as a training image. As in step S31, it is particularly determined whether or not the irradiation light L<NUM> used in capturing of the still image has a desired wavelength pattern.

For example, in the case of the timing chart illustrated in <FIG>, the irradiation light L<NUM> is changed from the wavelength pattern PA to the wavelength pattern PB at time T<NUM>, and three images SB<NUM> to SB<NUM> are captured. Thus, the first image SB<NUM> is captured in a wavelength pattern transition state (an example of at the time of transition of the wavelength pattern), and the wavelength pattern of the irradiation light L<NUM> may not be a desired wavelength pattern.

The determining unit <NUM> analyzes the color of the image to estimate the wavelength pattern of the irradiation light L<NUM> used in capturing of the image, and determines whether or not the estimated wavelength pattern is a desired wavelength pattern. If the determining unit <NUM> determines that the estimated wavelength pattern is a desired wavelength pattern (an example of a result of determination), the automatic selection unit <NUM> selects the image as a training image. The process then proceeds to step S11.

In step S11, the image is stored in the second storage area of the storage unit <NUM> in association with information on the wavelength pattern.

In addition, if the determining unit <NUM> determines that the estimated wavelength pattern is not a desired wavelength pattern (an example of a result of determination), the automatic selection unit <NUM> does not select the image as a training image and does not store the image. The process then proceeds to step S12.

Note that the image that is displayed on the display unit <NUM> is similar to that described above.

The endoscope system <NUM> determines whether or not a captured still image is suitable as a training image and stores the suitable image. In this manner, the endoscope system <NUM> can collect preferable training images.

In addition, as in the case described above, since only images of the same wavelength pattern of the irradiation light L<NUM> as the wavelength pattern of the irradiation light L<NUM> of the selected observation mode are displayed, the display color during acquisition of still images is the same display color during capturing of a moving image, that is, becomes constant. This thus makes observation using the display unit <NUM> easier.

Here, it is determined that an image for which the irradiation light L<NUM> used in capturing of the still image does not have a desired wavelength pattern is not suitable as a training image. However, the determination criterion is not limited to this. For example, it may be determined that an image in which blurring has occurred, an out-of-focus image, an captured with a lens having a spray of water or dust thereon, or the like is not suitable as a training image. In addition, the most suitable image may be determined from among images that are suitable as training images, and only the determined image may be stored.

In addition, the acquired still images may be displayed on the display unit <NUM>, and a doctor may select an image to be stored in the storage unit <NUM> as a training image from among the displayed images by using the input unit <NUM> (an example of a to-be-storage image selection unit). In addition, instead of displaying all the acquired still images on the display unit <NUM>, only still images determined to be suitable as training images by the determining unit <NUM> may be displayed on the display unit <NUM>.

The endoscope system <NUM> changes a light-quantity ratio between a plurality of light sources to change the wavelength pattern of the irradiation light L<NUM>. Alternatively, a light source to be turned on among the plurality of light sources may be selected to change the wavelength pattern of the irradiation light.

The light source device <NUM> of the endoscope system <NUM> includes a first light source 24A, a second light source 24B, and a third light source 24C.

The light source control unit <NUM> selects one light source from among the first light source 24A, the second light source 24B, and the third light source 24C, and turns on the selected light source and turns off the other light sources. The diffusion member <NUM> is irradiated with light emitted from the light source that is turned on through the optical fiber 28B. The light outgoing from the diffusion member <NUM> serves as the irradiation light L<NUM> of the endoscope system <NUM>.

Here, using the first light source 24A as a light source having a wavelength pattern of the wavelength pattern PA, the second light source 24B as a light source having a wavelength pattern of the wavelength pattern PBand the third light source 24C as a light source having a wavelength pattern of the wavelength pattern PC still images irradiated with the irradiation light L<NUM> of the respective wavelength patterns can be acquired.

As the first light source 24A, the second light source 24B, and the third light source 24C, semiconductor light sources such as LEDs (Light Emitting Diodes) as well as combinations of a laser diode and a fluorescent body can be used.

The example of changing the wavelength pattern of the irradiation light L<NUM> with which a part to be observed is irradiated has been described above. Alternatively, the wavelength pattern of the irradiation light L<NUM> may be kept constant and a wavelength pattern of returning light received by the imaging element <NUM> may be changed.

The endoscope <NUM> of the endoscope system <NUM> includes a filter group <NUM> (an example of a wavelength pattern changing unit) having a plurality of filters. Different filters of the plurality of filters limit different wavelength ranges of light transmitting therethrough. The filter group <NUM> is disposed between the imaging lens <NUM> and the imaging element <NUM> in the optical path of the returning light. For example, the filter group <NUM> can be configured as a rotational filter turret.

The light source control unit <NUM> sets a light-quantity ratio between the light emitted from the first laser light source 22A and the light emitted from the second laser light source 22B to be constant. In addition, the image capturing control unit <NUM> (an example of a wavelength pattern changing unit) controls the filter group <NUM> to insert a necessary filter to or evacuate a necessary filter from the optical path. In this manner, the image capturing control unit <NUM> changes the wavelength pattern of the returning light received by the imaging element <NUM>.

For example, the filter group <NUM> includes three filters, that is, a filter that makes transmitting light have a wavelength pattern of the wavelength pattern PA, a filter that makes transmitting light have a wavelength pattern of the wavelength pattern PB, and a filter that makes transmitting light have a wavelength pattern of the wavelength pattern PC. One filter among the three filters is inserted to the optical path. In this manner, images of the respective wavelength patterns can be captured.

The endoscope system <NUM> sequentially captures images of a plurality of wavelength patterns different from one another. In this manner, the endoscope system <NUM> can appropriately collect training images.

In the endoscope systems <NUM>, <NUM>, <NUM>, <NUM>, <NUM>, and <NUM>, a still image captured with the same wavelength pattern as that of the observation mode is stored in the first storage area as a diagnosis image. Alternatively, the diagnosis image may be stored in the second storage area. In this manner, still images captured with the same wavelength pattern as that of the observation mode can be collected as training images.

In addition to the embodiments and examples described above, configurations described below are also within the scope of the present invention.

As the wavelength pattern, white light, BLI, BLI-bright (registered trademark), a particular single wavelength, any combination of a plurality of wavelengths, or the like can be used.

Collection of training images has been described herein, images to be collected are not limited to training images of a learning algorithm. For example, images to be collected may be test images for use in evaluation of the performance of an endoscope system, images for use in a study of how differently a part to be observed is viewed depending on the wavelength of the irradiation light, or the like.

The recognition method described above may be configured as a program causing a computer to implement individual steps, and may be configured as a non-transitory recording medium such as a CD-ROM (Compact Disk-Read Only Memory) storing this program.

In the embodiments described above, for example, a hardware structure of a processing unit that executes various processes of the processor device <NUM> is, for example, various processors cited below. The various processors include a CPU (Central Processing Unit) which is a general-purpose processor that executes software (program) to function as various processing units, a GPU (Graphics Processing Unit) which is a processor specialized for image processing, a PLD (Programmable Logic Device), such as an FPGA (Field Programmable Gate Array), which is a processor whose circuitry is changeable after production, a dedicated electric circuit, such as an ASIC (Application Specific Integrated Circuit), which is a processor having circuitry designed specifically for executing specific processing, and the like.

One processing unit may be constituted by one of these various processors, or by two or more processors of the same kind or different kinds (for example, a plurality of FPGAs, a combination of a CPU and an FPGA, or a combination of a CPU and a GPU). In addition, a plurality of processing units may be constituted by one processor. Examples in which a plurality of processing unit are constituted by one processor include a first configuration, as exemplified by computers such as a server and a client, in which a combination of one or more CPUs and software constitutes one processor and this processor functions as a plurality of processing units. The examples also include a second configuration, as exemplified by a SoC (System On Chip) or the like, in which a processor that implements functions of the entire system including a plurality of processing units on a single IC (Integrated Circuit) chip is used. As described above, the various processing units are configured using one or more of the various processors in terms of hardware structure.

Further, the hardware structure of these various processors is, more specifically, electric circuitry in which circuit elements such as semiconductor elements are combined.

Claim 1:
An endoscopic image acquisition system (<NUM>) comprising:
an irradiation unit that irradiates a part to be observed in a body cavity of a patient with irradiation light;
an image capturing unit that receives returning light from the part to be observed and captures images of the part to be observed;
a display control unit (<NUM>) that causes the captured images to be sequentially displayed on a display unit (<NUM>);
a wavelength pattern changing unit that changes a wavelength pattern of the irradiation light or the returning light;
an accepting unit that accepts an acquisition instruction to acquire images;
an image capturing control unit (<NUM>) that causes images of an observation wavelength pattern to be continuously captured at a certain frame rate and that causes images of a plurality of wavelength patterns to be sequentially captured in response to acceptance of the acquisition instruction, the plurality of wavelength patterns including the observation wavelength pattern and a wavelength pattern different from the observation wavelength pattern; and
a storage control unit (<NUM>) that causes the sequentially captured images of the plurality of wavelength patterns to be stored in a storage unit (<NUM>), wherein:
the display control unit (<NUM>) causes the images of the observation wavelength pattern continuously captured at the certain frame rate to be displayed on the display unit (<NUM>); and
in response to the acceptance of the acquisition instruction, the display control unit (<NUM>) causes, among the sequentially captured images of the plurality of wavelength patterns, the image of the observation wavelength pattern to be displayed on the display unit (<NUM>), and the image of the wavelength pattern different from the observation wavelength pattern not to be displayed.