Source: https://patents.google.com/patent/JP5360464B2/en
Timestamp: 2020-01-19 21:29:53
Document Index: 780180527

Matched Legal Cases: ['art 122', 'art 124', 'art 124', 'art 128', 'art 120', 'art 128', 'art 122', 'art 160', 'art 120', 'art 140', 'art. 1', 'art 105', 'art 110', 'art 112', 'art 122', 'art 124', 'art 126', 'art 129', 'art 150', 'art 196', 'art 200', 'art 210', 'art 360']

JP5360464B2 - Imaging device, imaging device operating method, and program - Google Patents
Imaging device, imaging device operating method, and program Download PDF
JP5360464B2
JP5360464B2 JP2008154516A JP2008154516A JP5360464B2 JP 5360464 B2 JP5360464 B2 JP 5360464B2 JP 2008154516 A JP2008154516 A JP 2008154516A JP 2008154516 A JP2008154516 A JP 2008154516A JP 5360464 B2 JP5360464 B2 JP 5360464B2
JP2008154516A
JP2009297237A (en
博司 山口
2008-06-12 Application filed by 富士フイルム株式会社 filed Critical 富士フイルム株式会社
2008-06-12 Priority to JP2008154516A priority Critical patent/JP5360464B2/en
2009-04-01 Priority claimed from US12/385,219 external-priority patent/US8593513B2/en
2009-12-24 Publication of JP2009297237A publication Critical patent/JP2009297237A/en
2013-12-04 Publication of JP5360464B2 publication Critical patent/JP5360464B2/en
<P>PROBLEM TO BE SOLVED: To provide an imager which can cast irradiation light in a desirable spectrum corresponding to the purpose of observation with a desirable timing. <P>SOLUTION: The imager includes: a light irradiation section which irradiates a subject with a plurality of beams of irradiation light in which beams of light different in spectral shape are superposed one on top of one another in different combinations with different timings; an imaging section for imaging a plurality of images of the subject irradiated with the beams of irradiation light with different timings; and an image processing section for generating an image in a prescribed spectrum from the plurality of images. <P>COPYRIGHT: (C)2010,JPO&amp;INPIT
The present invention relates to an imaging apparatus, an imaging method, and a program. The present invention particularly relates to an imaging apparatus and an imaging method for imaging an image, and a program for the imaging apparatus.
The output light from the light source is emitted by switching to a broadband light and a narrowband light with a narrow wavelength band sequentially using a rotary filter, and the image signal obtained when radiating the broadband light and the narrowband light are emitted. There is known an electronic endoscope apparatus that synthesizes an image signal obtained at this time (see, for example, Patent Document 1).
JP 2007-202589 A
However, in the technique described in the above-mentioned patent document, the wavelength band of the irradiated light is sequentially switched by the rotary filter. For this reason, the light of the desired spectrum according to the observation purpose cannot be irradiated at a desired timing.
In order to solve the above-described problem, according to a first embodiment of the present invention, an imaging apparatus is configured to irradiate a subject with a plurality of irradiation lights in which light having different spectral shapes are superimposed in different combinations, respectively, at different timings A light irradiating unit, an imaging unit that captures a plurality of images of the subject irradiated with the plurality of irradiation lights at different timings, and an image processing unit that generates an image of a predetermined spectrum from the plurality of images. .
According to the second aspect of the present invention, a light irradiation stage for irradiating a subject with a plurality of irradiation lights superposed in different combinations of light having different spectral shapes and a plurality of irradiation lights respectively. An imaging stage for capturing a plurality of images of the subject at different timings, and an image processing stage for generating an image of a predetermined spectrum from the plurality of images.
According to the third aspect of the present invention, there is provided a program for an imaging apparatus, wherein the computer irradiates a subject with a plurality of irradiation lights that are superposed with different combinations of light having different spectral shapes at different timings. An irradiation unit, an imaging unit that captures a plurality of images of a subject irradiated with a plurality of irradiation lights, and an image processing unit that generates an image of a predetermined spectrum from the plurality of images, respectively.
The above summary of the invention does not enumerate all necessary features of the present invention. In addition, a sub-combination of these feature groups can also be an invention.
Hereinafter, although this invention is demonstrated through embodiment of invention, the following embodiment does not limit the invention concerning a claim. In addition, not all the combinations of features described in the embodiments are essential for the solving means of the invention.
FIG. 1 shows an example of the configuration of an endoscope system 10 according to an embodiment, together with a living body 190. The endoscope system 10 irradiates a living body 190 with an irradiation light having a desired spectral shape according to an observation purpose, an observation target, and the like, and images it.
The endoscope system 10 includes a scope 100 as a part of an endoscope, forceps 135, an image processing unit 140, a control unit 105, a light irradiation unit 120, an operation unit 160, an output unit 150, and an ICG injection unit 170. . In FIG. 1, an A portion shows an enlarged view of the distal end portion 102 of the scope 100.
Note that the endoscope system 10 can function as an imaging system or an image processing system, as will be described later using this embodiment. Further, the endoscope can function as an imaging device. For example, the imaging unit 110, the light irradiation unit 120, and the image processing unit 140 can function as an imaging device. The living body 190 may be an example of a subject in the present invention.
A scope 100 as an example of an insertion unit includes an imaging unit 110 and a forceps port 130. The scope 100 includes an optical fiber 126 and a light emitting unit 128 as part of the light irradiation unit 120. The scope 100 has at least the distal end portion 102 inserted in a narrow space. For example, the scope 100 is inserted into an esophagus or intestinal tract of a living organism.
The distal end portion 102 of the scope 100 includes a nozzle 138, a lens 112 as a part of the imaging unit 110, and an emission port 129. Note that the optical fiber 126 and the light emitting unit 128 built in the scope 100 function as the light irradiation unit 120 together with the excitation unit 124 and the irradiation control unit 122 provided outside the scope 100 as an example. Note that the scope 100 can also incorporate the excitation unit 124.
A forceps 135 is inserted into the forceps port 130, and the forceps port 130 guides the forceps 135 to the distal end portion 102. Note that the forceps 135 may have various tip shapes. In addition to the forceps, various treatment tools for treating the living body 190 may be inserted into the forceps port 130. The nozzle 138 sends water or air to the living body 190.
The light emitting unit 128 includes a light emitter that emits luminescence light by excitation light. The excitation unit 124 emits excitation light that causes the light emitter to emit luminescence light. The optical fiber 126 guides the excitation light emitted from the excitation unit 124 to the light emitting unit 128. Excitation light emitted from the excitation unit 124 is incident on the light emitting unit 128 via the optical fiber 126.
The light emitter is excited by excitation light incident through the optical fiber 126 and emits luminescence light. The luminescence light emitted from the light emitting unit 128 passes through the emission port 129 and is irradiated to the living body 190 as irradiation light. Note that the luminescence light emitted from the light emitter may include light in the visible light region. Further, the irradiation light can function as illumination light that illuminates the living body 190 when the imaging unit 110 images the living body 190.
Note that the luminescence light is applied to the living body 190 as one component of the irradiation light. For example, the excitation light emitted by the excitation unit 124 may be superimposed on the luminescence light and irradiated on the living body 190 as irradiation light. In addition, the light emitter may emit luminescence light from excitation light in other wavelength regions. In this case, when the excitation unit 124 emits excitation light in another wavelength region, the excitation light in the other wavelength region is superimposed on the luminescence light and irradiated onto the living body 190 as irradiation light.
As described above, the irradiation control unit 122 controls the wavelength range of the excitation light emitted from the excitation unit 124 to irradiate the irradiation light with different spectrum shapes from the emission port 129. Moreover, the irradiation control part 122 can irradiate the irradiation light of a different spectrum shape from the output port 129 at different timings by controlling the emission timing of the excitation light emitted by the excitation part 124.
In addition, the excitation part 124 and the light emission part 128 can function as a light generation part which generate | occur | produces the light from which a spectrum shape differs. And the light irradiation part 120 can irradiate the biological body 190 with the irradiation light from which the spectrum shape from which the light from which a spectrum shape differs differs by the different combination was superimposed, respectively. In addition, it is desirable that the light irradiation unit 120 irradiates irradiation light whose spectral shapes are at least different within a wavelength range in which the imaging unit 110 has spectral sensitivity.
The imaging unit 110 images the living body 190 inside the living organism irradiated with the irradiation light. The living body 190 can be exemplified by the digestive mucous membrane of a living organism such as the mucous membrane of the stomach and the intestinal mucosa.
The imaging unit 110 captures a plurality of images of the living body 190 irradiated with a plurality of irradiation lights having different spectral shapes at different timings. Specifically, the imaging unit 110 captures a plurality of images at different timings using light from the living body 190 when a plurality of irradiation lights having different spectral shapes including luminescence light are respectively irradiated.
Note that the imaging unit 110 can capture an image of the living body 190 using reflected light of the luminescence light reflected from the surface 192 or the inside of the living body 190. Alternatively, the imaging unit 110 can capture an image of the living body 190 using scattered light obtained by scattering luminescence light from the living body 190.
The image processing unit 140 processes the image obtained by the imaging unit 110. Specifically, the image processing unit 140 generates an image having a predetermined spectrum from a plurality of images captured by the imaging unit 110.
Here, it is assumed that the luminescence light is a wide wavelength band light, and both the excitation lights are narrow wavelength band light having a narrower wavelength band than the luminescence light. For example, the excitation unit 124 emits excitation light having a narrower wavelength width than a predetermined value. For example, the excitation unit 124 may emit excitation light having a wavelength width of about 10 to 20 nm. Further, it is assumed that one wavelength region of the excitation light is a wavelength region outside the spectral sensitivity of the imaging unit 110. In this case, an image captured when luminescence light generated by excitation light in a wavelength region outside the spectral sensitivity is irradiated as irradiation light represents an image corresponding to the spectrum of the luminescence light.
In this case, the image processing unit 140 uses the excitation light in the wavelength region within the spectral sensitivity by the imaging unit 110 and the luminescence light generated by the excitation light as the irradiation light, and the image processing unit 140 The image corresponding to the spectrum is subtracted. Thereby, the image processing unit 140 can generate an image corresponding to the spectrum of the excitation light within the spectral sensitivity by the imaging unit 110 as an image of a predetermined spectrum. In this way, the image processing unit 140 can generate a wide wavelength region image and a narrow wavelength region image as an image of a predetermined spectrum.
In addition, when the illuminant can emit luminescence light having different spectral shapes by excitation light in different wavelength regions, the light irradiation unit 120 controls the wavelength region and intensity of the excitation light so that the light emitting unit The spectrum of the light emitted by 128 can be controlled. In addition, the light emitting unit 128 can irradiate the living body 190 with the irradiation light in the narrow wavelength region as described above because the light emitting unit 128 passes a part of the excitation light in the narrow wavelength region.
The image generated by the image processing unit 140 is output to the output unit 150. The output unit 150 may be a display device that displays the image generated by the image processing unit 140. In this case, the output unit 150 may superimpose and display the image in which the narrow wavelength region image generated by the image processing unit 140 is emphasized and the wide wavelength region image. Further, the output unit 150 may switch and display an image in which an image in a narrow wavelength region is emphasized and an image in a wide wavelength region at a display rate higher than a predetermined value.
The light irradiation unit 120 may sequentially switch the spectrum shape of the irradiation light. Then, the imaging unit 110 may continuously image the living body 190 in synchronization with the switching. Thereby, the image processing unit 140 can generate a moving image of the living body 190.
The output unit 150 may be a recording device that records the image generated by the image processing unit 140 on a recording medium. For example, the output unit 150 may record an image obtained by superimposing an image in which a narrow wavelength region is emphasized and an image in a wide wavelength region on a recording medium. The output unit 150 may record a moving image in which an image in which an image in a narrow wavelength region is emphasized and an image in a wide wavelength region are switched and displayed at a display rate higher than a predetermined value on a recording medium. . The recording medium may be a non-volatile recording medium. Examples of the recording medium include a magnetic recording medium such as a hard disk, a semiconductor memory, and the like.
As described above, according to the endoscope system 10, it is possible to generate an image of the living body 190 using light of a predetermined spectrum from the living body 190. Here, as will be described later, the wavelength range of light of a predetermined spectrum is a wavelength range in the vicinity of 450 nm, in the vicinity of 500 nm, in the vicinity of 550 nm, or in the vicinity of 830 nm, or a combination of these wavelength ranges. It can be illustrated. Moreover, the wavelength range of the light of a predetermined spectrum may be a narrow wavelength range with a wavelength width of 10 to 20 nm.
When the wavelength region in the vicinity of 450 nm is set as the wavelength region of light having a predetermined spectrum, the image processing unit 140 can generate an image in which images of surface blood vessels of the living body 190, pits on the intestinal tract surface, and the like are emphasized. In addition, when the wavelength region in the vicinity of 500 nm is set as the wavelength region of light having a predetermined spectrum, the image processing unit 140 can generate an image in which the depression and protrusion are emphasized. For example, the image processing unit 140 can generate an image in which the concave portion 196 or the convex portion 194 is emphasized.
When the wavelength region near 550 nm is set as the wavelength region of light having a predetermined spectrum, the image processing unit 140 can generate an image in which the hemoglobin concentration is emphasized. For example, the image processing unit 140 can generate an image in which redness and fine blood vessels in the living body 190 are emphasized.
Further, when the wavelength region in the vicinity of 600 nm is set as the wavelength region of light having a predetermined spectrum, the image processing unit 140 can generate an image in which the thickening of the living body 190 based on the autofluorescence of the living body 190 is emphasized. In addition, when the wavelength region near 830 nm is set as the wavelength region of light having a predetermined spectrum, the image processing unit 140 can generate an image in which blood vessels deep in the living body 190 are emphasized.
Note that an image in which a deep blood vessel is emphasized can be obtained by injecting a luminescent substance such as indocyanine green (ICG) into the living body 190. For example, the ICG injection unit 170 injects indocyanine green (ICG), which is a luminescent substance, into the living body 190 by injecting ICG into the blood vessel of the living body by intravenous injection. The ICG is excited by excitation light in a wavelength region near 780 nm, for example, and emits fluorescence in a wavelength region near 830 nm. The imaging unit 110 can image blood vessels in the living body 190 with luminescence light from the ICG. In addition, although ICG is illustrated as a luminescent substance in this embodiment, fluorescent substances other than ICG can be used as a luminescent substance.
Note that examples of luminescence light emitted from at least one of a luminescent material included in the light emitting unit 128 or a luminescent material injected into the living body 190 include fluorescence and phosphorescence. Further, as the luminescence light emitted by the light emitter included in the light emitting unit 128, in addition to the luminescence light by the above-described photoluminescence, electroluminescence, cathode luminescence by electron beam, triboluminescence, thermoluminescence by heat, sonoluminescence by acoustic wave, The luminescence light by at least any one, such as triboluminescence by a physical force, can be illustrated. The excitation unit 124 supplies energy corresponding to the excitation process of the illuminant such as electric energy, friction energy, and thermal energy in addition to light energy as excitation energy for exciting the illuminant. Can emit light.
Further, the operation unit 160 acquires an instruction from the user. As an instruction from the user, an instruction for specifying an observation target or an observation purpose may be acquired. Examples of the instruction include an instruction for emphasizing the above-described pits, surface blood vessels, depressions, deep blood vessels, and the like.
When the operation unit 160 obtains an instruction from the user, the control unit 105 instructs the irradiation control unit 122 to irradiate the light irradiation unit 120 with irradiation light having a spectrum shape corresponding to the instruction. The irradiation control unit 122 controls the spectrum of the excitation light emitted by the excitation unit 124, the time width for emitting the excitation light, and the like according to the instruction. In addition, the control unit 105 controls the imaging operation in the imaging unit 110 or the image processing in the image processing unit 140 in accordance with an instruction from the user.
In addition, the operation unit 160 obtains an instruction including control content for controlling the scope 100 from the user. For example, the operation unit 160 acquires an instruction including a driving amount for driving the distal end portion 102 of the scope 100 from the user. As an example, the operation unit 160 has an angle control knob that is rotated by the user when the angle of the distal end portion 102 of the scope 100 is changed, and an instruction including the amount of rotation that the angle control knob is rotated by the user. Alternatively, an instruction including a drive amount for driving the distal end portion 102 of the scope 100 may be acquired from the user.
The control unit 105 controls the scope 100 based on an instruction acquired by the operation unit 160 from the user. For example, the control unit 105 may drive the scope 100 based on the instruction. For example, the control unit 105 may change the angle of the distal end portion 102 of the scope 100 by an amount corresponding to the rotation amount acquired by the operation unit 160.
FIG. 2 schematically shows an example of the internal structure of the scope 100. The imaging unit 110 includes a lens 112, a filter unit 210, and a light receiving unit 200. The imaging unit 110 and the light emitting unit 128 are provided at the distal end portion 102 of the scope 100.
The light emitting unit 128 includes a light emitter. Specifically, the light emitting unit 128 includes a light emitter that emits luminescence light. As described above, the light emitter emits luminescence light by excitation light.
The excitation unit 124 makes excitation light incident on the optical fiber 126. The optical fiber 126 functions as a light guide for guiding incident excitation light to the light emitting unit 128. As described above, the excitation unit 124 emits excitation light that is incident on the light emitter and causes the light emitter to emit luminescence light.
In addition, the light emission part 128 passes a part of excitation light. Part of the excitation light that has passed through the light emitting unit 128 is applied to the living body 190. The excitation light in the narrow wavelength region that is emitted from the excitation unit 124 and passes through the light emitting unit 128 can be used as light for generating an image of a predetermined spectrum by light in the narrow wavelength region, as will be described later.
As an example, the light emitter included in the light emitting unit 128 emits luminescence light using first excitation light and second excitation light having a spectrum shape different from that of the first excitation light. For example, the light emitter included in the light emitting unit 128 emits luminescence light having substantially the same spectrum shape by the first excitation light and the second excitation light having a spectrum shape different from that of the first excitation light.
The excitation unit 124 can emit the first excitation light and the second excitation light incident on the light emitting unit 128, respectively. For example, the irradiation control unit 122 causes the excitation unit 124 to emit the first excitation light and the second excitation light at different timings. The first excitation light and the second excitation light emitted from the excitation unit 124 are guided to the light emitting unit 128 by the optical fiber 126.
Here, the light emitting unit 128 passes a part of the first excitation light and a part of the second excitation light. For this reason, at the timing when the excitation unit 124 emits the first excitation light, the luminescence light emitted from the light emitter by the first excitation light and the first excitation light emitted from the excitation unit 124 and passed through the light emission unit 128 are included. The living body 190 is irradiated with the first irradiation light. Then, at the timing when the excitation unit 124 emits the second excitation light, the luminescence light emitted from the light emitter by the second excitation light and the second excitation light emitted from the excitation unit 124 and passed through the light emission unit 128 are included. 2 irradiation light is irradiated to the living body 190. In this way, the irradiation control unit 122 can irradiate the living body 190 with the first irradiation light and the second irradiation light having different spectral shapes at different timings.
As described above, the irradiation control unit 122 can irradiate the living body 190 with irradiation light obtained by superimposing light having different spectral shapes in different combinations. Specifically, the irradiation control unit 122 can irradiate the living body 190 with first irradiation light and second irradiation light having different spectrum shapes at different timings.
Thus, the irradiation control unit 122 includes the first irradiation light including the luminescence light emitted from the light emitter and the excitation light emitted from the excitation unit 124, and the second irradiation light having a spectrum shape different from that of the first irradiation light. Can be irradiated to the living body 190 at different timings. In the example described above, the first irradiation light and the second irradiation light include luminescence light emitted from the light emitter, but at least one of the first irradiation light and the second irradiation light may include luminescence light. For example, the first irradiation light includes the luminescence light emitted from the light emitter and the excitation light emitted from the excitation unit 124, and the second irradiation light may not include the luminescence light.
The light emitter may emit luminescence light having a spectrum shape different from the spectrum shape of the luminescence light emitted by the first excitation light by the second excitation light having a wavelength range different from that of the first excitation light. The irradiation control unit 122 can irradiate the living body 190 with irradiation light having different spectral shapes at different timings by controlling the emission timing of the first excitation light and the second excitation light in the excitation unit 124.
The excitation unit 124 may include a laser diode, and may emit laser light as excitation light and enter the optical fiber 126. The light emitter may be a phosphor that emits luminescence light when excited by the laser light emitted by the excitation unit 124 as described above. The laser beam may be an example of coherent light. The excitation unit 124 can emit first excitation light and second excitation light, which are coherent light, respectively.
In addition, the light emitting unit 128 may include a light emitting diode as an example of a light emitter. For example, the light emitting unit 128 may include a plurality of light emitting diodes that emit light having different spectral shapes. The irradiation control unit 122 can irradiate the living body 190 with the irradiation light obtained by superimposing the light having different spectral shapes by controlling the light emission timings of the plurality of light emitting diodes. In this case, the excitation unit 124 may supply electric energy to the light emitting unit 128. Even in this configuration, the scope diameter of the scope 100 can be reduced.
Note that the light emitting unit 128 may include a plurality of light emitters that can emit light having different spectral shapes. And the irradiation control part 122 can irradiate the biological body 190 with the irradiation light from which a spectrum shape differs by respectively different timing by light-emitting a several light-emitting body by a different combination in a different timing.
For example, the light emitting unit 128 may include a plurality of light emitters that emit luminescence light having different spectral shapes. The plurality of light emitters may emit luminescence light having different spectrum shapes by excitation light having different wavelength ranges. The excitation unit 124 may emit excitation light that excites a plurality of light emitters and has different wavelength ranges. In this case, the irradiation control unit 122 causes the excitation unit 124 to emit light with different combinations at different timings to emit excitation light with different wavelength ranges, thereby superimposing the luminescence light emitted by a plurality of light emitters with different combinations. Are irradiated to the living body 190 at different timings. In this manner, the irradiation control unit 122 can irradiate the living body 190 with irradiation light obtained by superimposing luminescence light emitted from a plurality of light emitters in different combinations.
Note that, as described above, when the imaging unit 110 images the living body 190 with the luminescence light from the ICG, the excitation unit 124 may emit excitation light in a wavelength region that can excite the ICG. For example, the excitation unit 124 emits excitation light in a wavelength region near 780 nm. Excitation light in the wavelength region near 780 nm emitted from the excitation unit 124 passes through the light emission unit 128 and is irradiated on the living body 190.
As described above, the light irradiation unit 120 may include various light sources such as a laser diode, a light emitting diode, and a phosphor. The light irradiation unit 120 can independently generate irradiation light having different spectral shapes by superimposing light emitted independently by these light sources in various combinations.
The lens 112 causes the light from the living body 190 to form an image on the light receiving unit 200. The filter unit 210 is a color filter, and a plurality of color filter elements that selectively transmit light in different wavelength regions may be arranged in a matrix on substantially the same surface. The configuration of the filter unit 210 will be described later with reference to FIG.
As will be described later with reference to FIG. 3, an electrical signal indicating the amount of light received by the image sensor included in the light receiving unit 200 is supplied to the image processing unit 140. As described above, the imaging unit 110 includes a plurality of imaging elements that receive light from the living body 190, and can generate an image signal corresponding to the intensity of light received by each imaging element. Note that the imaging unit 110 has a period during which the living body 190 is irradiated with the first irradiation light from the light irradiation unit 120 and a period during which the living body 190 is irradiated with the second irradiation light from the light irradiation unit 120. By exposing the image sensor to an image signal, an image signal indicating an image captured at each timing can be generated.
FIG. 3 shows an example of the filter array in the filter unit 210 and the image sensor array in the light receiving unit 200. The filter unit 210 selectively transmits B-filter 360-1 and B-filter 360-2 that selectively transmit blue component light, G-filter 370 that receives green component light, and red component light. And an R filter 380. In the following description, the B filter 360-1 and the B filter 360-2 may be collectively referred to as a B filter 360.
A filter unit 350 is formed by the B filter 360, the G filter 370, and the R filter 380. The filter unit 210 is formed by two-dimensionally arranging filter units in which filters similar to the filter unit 350 are arranged.
The light receiving unit 200 includes a B imaging element 310-1 and a B imaging element 310-2 that receive blue component light, a G imaging element 320 that receives green component light, and an R imaging element that receives red component light. 330. In the following description, the B image sensor 310-1 and the B image sensor 310-2 may be collectively referred to as the B image sensor 310.
An image sensor unit 300 is formed by the B image sensor 310, the G image sensor 320, and the R image sensor 330. The light receiving unit 200 is formed by two-dimensionally arranging image pickup element units in which the image pickup element units 300 are arranged in the same manner as the image pickup element unit 300.
Here, the B imaging element 310-1, the B imaging element 310-2, the G imaging element 320, and the R imaging element 330 are respectively a B filter 360-1, a B filter 360-2, a G filter 370, and an R filter 380. Aligned and arranged. Thereby, the B imaging element 310-1, the B imaging element 310-2, the G imaging element 320, and the R imaging element 330 are respectively transmitted through the B filter 360-1, the light that has passed through the B filter 360-2, Light that has passed through the G filter 370 and light that has passed through the R filter 380 can be received.
As shown in the figure, the B image sensor 310 is arranged with a higher surface density than the G image sensor 320 and the R image sensor 330. Therefore, the imaging unit 110 can image the living body 190 imaged with light in a shorter wavelength range with higher resolution. For this reason, the imaging unit 110 may be able to capture the fine structure of the surface layer of the living body 190 with a relatively high resolution.
As described above, the light receiving unit 200 is provided with a plurality of imaging elements corresponding to a plurality of filters that pass through different wavelength ranges. The plurality of imaging elements receive light that has selectively passed through the corresponding plurality of filters. As described above, the imaging unit 110 includes a plurality of imaging elements that have different light receiving wavelength ranges that can receive light.
Note that the filter unit 210 passes reflected light reflected by the living body 190 from the irradiation light irradiated from the light irradiation unit 120 and scattered light scattered by the living body 190. Further, it is desirable that the filter unit 210 passes the luminescence light emitted from the ICG and does not pass the excitation light that excites the ICG.
FIG. 4 shows an example of spectral sensitivity characteristics in the imaging unit 110. The spectral sensitivity characteristic of each color component in the imaging unit 110 is determined by the spectral transmittance of each filter included in the filter unit 210 and the spectral sensitivity of each imaging element included in the light receiving unit 200. The spectral sensitivity characteristic in the blue wavelength region by the B image sensor 310 is indicated by a line 410, and the spectral sensitivity characteristic in the green wavelength region by the G image sensor 320 is indicated by a line 420, and the red wavelength region by the R image sensor 330. The spectral sensitivity characteristic is shown by line 430.
As illustrated, in the short wavelength range in the visible light range, the imaging unit 110 has spectral sensitivity to light in the wavelength range from about 400 nm to about 510 nm by the B filter 360 and the B imaging device 310. Since the B image sensor 310 can receive light in the wavelength range, the wavelength range is referred to as a light reception wavelength range of the B image sensor 310.
Further, the imaging unit 110 has spectral sensitivity to light in the wavelength range from about 470 nm to about 620 nm by the G filter 370 and the G imaging device 320 in the middle wavelength range in the visible light range. Since the G imaging element 320 can receive light in the wavelength range, the wavelength range is referred to as a light receiving wavelength range of the G imaging element 320.
Further, in the long wavelength range in the visible light range, the imaging unit 110 has spectral sensitivity to light in the wavelength range from about 580 nm to about 740 nm and from about 810 nm to 840 nm by the R filter 380 and the R imaging device 330. . Since the R imaging element 330 can receive light in these wavelength ranges, these wavelength ranges are referred to as the light receiving wavelength range of the R imaging element 330.
The R filter 380 cuts light in a wavelength region near 780 nm. Thereby, it is possible to prevent excitation light in a wavelength region near 780 nm that excites ICG from entering the R imaging element 330. On the other hand, the R filter 380 passes light in a wavelength region near 830 nm. Thereby, the imaging unit 110 can appropriately image the living body 190 with the luminescence light from the ICG.
FIG. 5 shows an example of the wavelength pattern of the irradiation light together with the spectral sensitivity characteristics in the imaging unit 110. The light irradiation unit 120 differs between the irradiation light obtained by superimposing the light having different spectral shapes with the superposition pattern 500a and the irradiation light obtained by superimposing the light having different spectral shapes with the superposition pattern 500b. Irradiate at the timing.
When irradiating the living body 190 with the irradiation light from the superimposed pattern 500 a, the excitation unit 124 emits excitation light in the wavelength region 510 that is light in the light reception wavelength region of the B imaging element 310. Here, the wavelength range 510 is a wavelength range in the vicinity of 450 nm, and is a wavelength range that is not included in any of the light receiving wavelength range of the G imaging element 320 and the light receiving wavelength range of the R imaging element 330. The excitation light in the wavelength band 510 may be an example of the first excitation light in the present invention. The B imaging device 310 includes a wavelength region of luminescence light emitted by excitation light in the wavelength region 510 and a wavelength region 510 as a light receiving wavelength region.
Here, the illuminant emits luminescence light in a wavelength region 520 that spans the light receiving wavelength region of the B image sensor 310, the light receiving wavelength region of the G image sensor 320, and the light receiving wavelength region of the R image sensor 330 by excitation light in the wavelength region 510. Is emitted. In this way, the light emitter is configured to emit at least a part of the light receiving wavelength range of the B imaging element 310, the light receiving wavelength range of the G imaging element 320, and the light receiving wavelength range of each of the R imaging element 330 by excitation light in the wavelength range 510. It emits luminescence light in the wavelength range including it. Thereby, the light irradiation unit 120 can irradiate the living body 190 with irradiation light in which excitation light in the wavelength region 510 and luminescence light in the wavelength region 520 are superimposed.
When irradiating the living body 190 with the irradiation light from the overlapping pattern 500b, the excitation unit 124 emits excitation light in the wavelength region 530, excitation light in the wavelength region 550, and excitation light in the wavelength region 570 at substantially the same timing. Here, it is assumed that the wavelength region 530 is a wavelength region near 390 nm, and the wavelength region 550 is a wavelength region near 370 nm. Further, both the wavelength range 530 and the wavelength range 550 are not included in any of the light reception wavelength range of the B imaging element 310, the light reception wavelength range of the G imaging element 320, and the light reception wavelength range of the R imaging element 330.
Further, it is assumed that the wavelength region 570 is a wavelength region near 780 nm. The excitation light in this wavelength region 570 becomes excitation light for exciting the ICG as described above. The light in the wavelength range is not included in any of the light receiving wavelength ranges of the B image sensor 310, the G image sensor 320, and the R image sensor 330.
In addition, the light emitter emits luminescence light in a wavelength region 540 that covers the light receiving wavelength region of the B image sensor 310, the light receiving wavelength region of the G image sensor 320, and the light receiving wavelength region of the R image sensor 330 by excitation light near 390 nm. Shall. Here, the wavelength region 520 and the wavelength region 540 may be substantially the same wavelength region. Moreover, the spectral shape of the luminescence light by the excitation light near 390 nm may be substantially the same as the spectral shape of the luminescence light by the excitation light near 450 nm. The intensity of the luminescence light by the excitation light near 390 nm may be different from the intensity of the luminescence light by the excitation light near 450 nm. As will be described later, the image processing unit 140 can process a signal from each imaging device in accordance with the spectrum of the luminescence light.
The illuminator emits luminescence light in a wavelength region of 560 included in the light receiving wavelength region of the G imaging element 320 by excitation light in the vicinity of 370 nm. Here, the wavelength range 560 is not included in any of the light reception wavelength regions of the B image sensor 310 and the R image sensor 330.
The excitation light in the wavelength region 530 may be an example of the second excitation light in the present invention. The excitation unit 124 emits excitation light in the wavelength region 530 that is light in a wavelength region other than the light reception wavelength region of the B imaging element 310 at a timing different from that of the excitation light in the wavelength region 510. As described above, the light irradiation unit 120 can irradiate the living body 190 with irradiation light having different spectral shapes in the light receiving wavelength region that can be received by the image sensor at different timings. For example, the light irradiation unit 120 irradiates the living body 190 with irradiation light having different spectral shapes at least in the light receiving wavelength region of the B imaging element 310 at different timings.
In the light receiving wavelength range of the B image sensor 310, the wavelength range of the second irradiation light is a partial wavelength range of the first irradiation light. In this case, the image processing unit 140 uses the second irradiation light in the wavelength range of the first irradiation light based on the image of the living body 190 irradiated with the first irradiation light and the image of the living body 190 irradiated with the second irradiation light. An image in a wavelength region other than the wavelength region of can be generated as an image of a predetermined spectrum.
For example, the image processing unit 140 converts the image of the living body 190 irradiated with the second irradiation light from the image of the living body 190 irradiated with the first irradiation light according to the spectrum of the first irradiation light and the spectrum of the second irradiation light. An image having a predetermined spectrum can be generated by performing the subtraction process with the weighting.
In the example of this figure, the image processing unit 140 can generate an image in the wavelength band 510 and an image in the wavelength band near 500 nm. Here, the image in the wavelength region near 500 nm is an image corresponding to the light intensity in the narrow wavelength region having a wavelength width of about 20 nm in the vicinity of 500 nm. As described above, there are cases where the image processing unit 140 can generate an image of a predetermined spectrum with a narrow wavelength width by performing spectral imaging using imaging elements having spectral sensitivities in different wavelength ranges. As described above, the image processing unit 140 can generate an image having a predetermined spectrum based on the plurality of images captured by the imaging unit 110 and the respective spectra of the first irradiation light and the second irradiation light.
Further, the image processing unit 140 can also generate an image having a wavelength range wider than the wavelength range of any irradiation light in the light reception wavelength range based on a plurality of images captured by the imaging unit 110 as an image of a predetermined spectrum. A specific example of image processing by the image processing unit 140 will be described in more detail with reference to FIG.
FIG. 6 shows an example of image processing in the image processing unit 140. An image 600a shows an image obtained by the imaging unit 110 imaging the living body 190 irradiated with the irradiation light from the overlapping pattern 500a. Further, it is assumed that the image 600b shows an image obtained by the imaging unit 110 imaging the living body 190 irradiated with the irradiation light by the overlapping pattern 500b.
In the following description, the light intensity is denoted by I, and the wavelength region of the light is distinguished by a subscript. For example, the intensity of light in the wavelength region 510 among the light traveling from the living body 190 toward the imaging unit 110 is represented as I510.
In addition, the sensitivity intensity by each image sensor is represented by a subscript corresponding to the color component. For example, the sensitivity intensity by the R imaging element 330 is represented as Ir. If the spectral sensitivity of the R filter 380 and the R imaging device 330 is Sr, Ir is an integrated value obtained by integrating a value obtained by multiplying the wavelength-dependent light intensity I from the living body 190 by Sr with respect to the wavelength. However, in the following description, for the sake of simplicity, the integral symbol is omitted, and it is simply expressed by multiplication.
When the irradiation light from the overlay pattern 500a is irradiated, Ir = I520 × Sr. Then, the luminance signal of the R component of the image 600a has a value corresponding to Ir. Note that although the luminance signal of the R component changes according to the exposure period in the imaging unit 110, for the sake of simplicity, the description will be made assuming that the luminance signal is a value normalized by the exposure period.
Similarly, assuming that the spectral sensitivity of the G filter 370 and the G image sensor 320 is Sg, the luminance signal of the G component of the image 600a has a value corresponding to Ig (= I520 × Sg). Similarly, assuming that the spectral sensitivity of the B filter 360 and the B image sensor 310 is Sb, the luminance signal of the B component of the image 600a has a value corresponding to Ib (= (I520 + I510) × Sb)).
Similarly, the luminance signal of the R component of the image 600b has a value corresponding to Ir (= (I540 + I580) × Sr). The luminance signal of the G component of the image 600b has a value corresponding to Ig (= (I540 + I560) × Sg). The luminance signal of the B component of the image 600b has a value corresponding to Ib (= I540 × Sb).
The image processing unit 140 generates a surface layer emphasized image 610, an unevenness emphasized image 620, a hemoglobin emphasized image 630, and a deep blood vessel emphasized image 640 based on the image signals of the respective colors in the images 600a and 600b. The surface layer enhanced image 610, the unevenness enhanced image 620, the hemoglobin enhanced image 630, and the deep blood vessel enhanced image 640 may be an example of an image having a predetermined spectrum.
Specifically, the image processing unit 140 can generate a surface layer enhanced image 610 having a luminance signal corresponding to the sensitivity intensity I510 in the wavelength region 510 near 450 nm. As an example, the image processing unit 140 can generate the surface layer enhanced image 610 based on the B signal of the captured image 600a, the B signal of the captured image 600b, I520, and I540. Note that I520 and I540 can be specified based on the spectrum emitted by the light emitter according to the wavelength range of the excitation light and the intensity of the excitation light, and the wavelength range and intensity of the excitation light emitted by the excitation unit 124.
Similarly, the image processing unit 140 performs unevenness emphasis having a luminance signal corresponding to the sensitivity intensity I520 in the wavelength region where the wavelength region 520 and the light receiving wavelength region of the B imaging element 310 overlap from the B signal of the images 600a and 600b. An image 620 can be generated. Further, the image processing unit 140 can generate a hemoglobin-weighted image 630 having a luminance signal corresponding to the sensitivity intensity I560 in the wavelength region 560 near 550 nm from the G signals of the images 600a and 600b. Further, the image processing unit 140 can generate a deep blood vessel enhancement image 640 having a luminance signal corresponding to the sensitivity intensity I580 in the wavelength region 580 near 830 nm from the R signals of the images 600a and 600b.
In addition, the image processing unit 140 generates an image having a luminance signal corresponding to the sensitivity intensity I520 in the wavelength region where the wavelength region 520 and the light receiving wavelength region of the G imaging element 320 overlap from the G signal of the image 600a and the image 600b. It can also be generated. Further, the image processing unit 140 generates an image having a luminance signal corresponding to the light intensity I520 in the wavelength region where the wavelength region 520 and the light receiving wavelength region of the R imaging element 330 overlap from the R signals of the images 600a and 600b. You can also.
Then, the image processing unit 140 can generate an image according to the observation purpose by combining the luminance signals of the respective colors in the generated plurality of images with a predetermined weight. As an example, the image processing unit 140 generates a white light image expected to be obtained when the living body 190 is irradiated with substantially white light by the luminance signal of each color in the plurality of images and the light emitter or the living body 190. And can be generated based on the spectrum of the luminescence light.
Note that the image processing unit 140 can also generate an image captured by the imaging unit 110 while the excitation unit 124 emits only excitation light in the wavelength region 530 as a white light image. At this time, the image processing unit 140 may correct the image picked up by the image pickup unit 110 according to the spectrum of the luminescence light by the excitation light in the wavelength region 530.
Further, the image processing unit 140 combines an image obtained by combining at least one of the surface layer enhanced image 610, the unevenness enhanced image 620, the hemoglobin enhanced image 630, and the deep blood vessel enhanced image 640 with the white light image as an image of a predetermined spectrum. It can also be generated. For this reason, the image processing unit 140 can generate an image suitable for the purpose of observation.
FIG. 7 shows an example of an image generated by the image processing unit 140. The image processing unit 140 generates a white light image 700 and supplies the white light image 700 to the output unit 150 by the method described with reference to FIG. The output unit 150 displays the white light image 700 generated by the image processing unit 140. Note that a region 720 in the white light image 700 includes a concavo-convex image 710 that indicates the concavo-convex surface of the living body 190. Further, the region 720 in the white light image 700 does not substantially include a deep blood vessel image.
Here, the operation unit 160 acquires operation information based on an operation in which the user designates the area 720 using, for example, a pointing device. Then, the operation unit 160 generates region information indicating the region 720 on the white light image 700 on which an image having a predetermined spectrum is to be displayed according to the acquired operation information.
In addition, the operation unit 160 acquires operation information based on an operation in which a user designates an image type with a button or the like. And the operation part 160 produces | generates the kind information which shows the kind of image of the predetermined spectrum which should be displayed according to the acquired operation information. Examples of the types of images having the predetermined spectrum include the above-described surface layer enhanced image 610, unevenness enhanced image 620, hemoglobin enhanced image 630, deep blood vessel enhanced image 640, and the like.
The operation unit 160 supplies region information and type information to the control unit 105. The control unit 105 controls the imaging unit 110, the image processing unit 140, and the light irradiation unit 120 according to the region information and type information.
Specifically, the irradiation control unit 122 controls the wavelength and light emission period of the light emitted by the excitation unit 124 according to the type information. For example, when the type information indicates the deep blood vessel enhancement image 640 and the unevenness enhancement image 620, the irradiation control unit 122 causes the excitation unit 124 to emit excitation light in the wavelength region 510 in the first period, and causes the excitation unit 124 to emit light. The excitation light in the wavelength region 530 and the excitation light in the wavelength region 570 are emitted during the second period. The irradiation control unit 122 causes the excitation unit 124 to emit light by sequentially switching between emission of excitation light in the wavelength region 510 and excitation light in the wavelength region 570 and emission of excitation light in the wavelength region 530.
The image processing unit 140 converts the unevenness-enhanced image 620, the deep blood vessel-enhanced image 640, and the white light image from the images captured by the imaging unit 110 in the first period and the second period by the process described above with reference to FIG. Can be generated. The image processing unit 140 generates a composite image 750 by superimposing the white light image with the image of the region 720 in the generated unevenness emphasis image 620 and deep blood vessel emphasis image 640, and supplies it to the output unit 150. The output unit 150 displays the composite image 750. As a result, in the region 720 of the composite image 750, it is possible to obtain a concavo-convex image 760 in which concavo-convex is emphasized and a deep blood vessel image 770 in which deep blood vessels are emphasized.
The irradiation control unit 122 may control the irradiation range irradiated from the light irradiation unit 120 according to the region information. For example, the irradiation control unit 122 may irradiate the range in real space corresponding to the region information with the luminescence light emitted from the light emitter by the excitation light in the wavelength region 530 and the excitation light in the wavelength region 570. Accordingly, the image processing unit 140 can generate an image similar to the composite image 750 in the area 720 and can generate an image similar to the white light image 700 in an area other than the area 720.
As described above, the irradiation control unit 122 may irradiate the different ranges with the irradiation light obtained by combining the light having different spectral shapes in different combinations. The image processing unit 140 can generate images having different spectra in different image regions.
FIG. 8 shows an example of an emission sequence of excitation light by the excitation unit 124. The light irradiation unit 120 is excitation light that is light in the wavelength region 510 when type information indicating a white light image is supplied to the control unit 105 or when specific type information is not supplied to the control unit 105. B1 and excitation light B2, which is light in the wavelength region 530, are alternately generated in the excitation unit 124. For example, as illustrated, the irradiation control unit 122 causes the excitation unit 124 to alternately generate the excitation light B1 and the excitation light B2 between the time t800-1 and the time t800-3.
When the type information corresponding to the image in which the deep blood vessel is emphasized is supplied from the operation unit 160 to the control unit 105, the irradiation control unit 122 includes the excitation light Ir and the excitation light B2 in the wavelength region 570, and the excitation light B1. Are alternately generated in the excitation unit 124. For example, as illustrated, the irradiation control unit 122 generates the excitation light B2 and the excitation light Ir at time t800-4 corresponding to the next imaging timing, and is excited at time t800-5 corresponding to the next imaging timing. Light B1 is generated.
Here, it is assumed that the intensity of the luminescence light emitted from the light emitter by the excitation light B2 is weaker than the intensity of the luminescence light emitted from the light emitter by the excitation light B1. Further, it is assumed that the intensity of the luminescence light emitted from the ICG in the living body 190 is weaker than the intensity of the reflected light reflected by the living body 190 from the luminescent light emitted from the light emitter by the excitation light B1. In such a case, if the time length of the exposure period of the light receiving unit 200 is fixed in time, the luminance resolution of the image may be lowered.
Therefore, the control unit 105 causes the imaging unit 110 to capture images at time t800-4 and time t800-6 at an imaging interval longer than the imaging intervals at time t800-5 and time t800-7. The irradiation control unit 122 causes the excitation unit 124 to emit excitation light at time t800-4 and time t800-6 for a period longer than the emission period of excitation light at time t800-5 and time t800-7. Specifically, the irradiation control unit 122 causes the excitation unit 124 to generate excitation light for a period corresponding to the imaging interval in the imaging unit 110.
As described above, the irradiation control unit 122 determines the intensity and spectral shape of the excitation light generated by the excitation unit 124 according to the type information. Thereby, the spectrum of irradiation light is decided. The control unit 105 determines the exposure period of the light receiving unit 200 according to the spectrum of the irradiation light emitted from the light irradiation unit 120, and exposes the light receiving unit 200 for the exposure period. In addition, the irradiation control unit 122 controls a period for causing the excitation unit 124 to emit excitation light so that irradiation light is irradiated for at least the exposure period.
When the excitation unit 124 emits excitation light in the illustrated light emission sequence, the image processing unit 140 generates a white light image and a deep blood vessel emphasized image 640 from images captured at time t800-3 and time t800-4. can do. In addition, the image processing unit 140 can generate a white light image at the next timing from the images captured at time t800-4 and time t800-5. Thus, according to the endoscope system 10, an image corresponding to the observation purpose can be generated at high speed.
Note that the irradiation control unit 122 can also irradiate light during one exposure period by changing the length of time during one exposure period during which light having a different spectral shape is irradiated onto the living body 190 between a plurality of exposure periods. The effective spectrum of can be varied between exposure periods. For example, the irradiation control unit 122 may vary the length of time during which the excitation unit 124 emits excitation light during one exposure period among a plurality of exposure periods. Thereby, the light irradiation part 120 can irradiate the biological body 190 with irradiation light of an effectively different spectrum at each different timing. The image processing unit 140 can generate various images by correcting the images captured by the imaging unit 110 according to the effective spectrum based on the time width.
As described above, the light having different spectral shapes combined as the irradiation light may be light having a different wavelength range. Further, the irradiation light having a different spectrum may be irradiation light having a different wavelength range. In this case, the imaging unit 110 may capture a plurality of images of the subject irradiated with irradiation light having different wavelength ranges, at different timings. Then, the image processing unit 140 may generate an image in a specific wavelength region as an image of a predetermined spectrum from a plurality of images captured by the imaging unit 110.
In the present embodiment, an example of the operation of each component of the endoscope system 10 has been described using the living body 190 as an example of a subject. As the subject, in addition to the living body 190, an article such as an industrially manufactured product or a natural object other than the living body can be exemplified.
FIG. 9 shows an example of a hardware configuration of the endoscope system 10. The endoscope system 10 can be constructed using a computer 1500 such as a personal computer.
The computer 1500 includes a CPU peripheral part, an input / output part, and a legacy input / output part. The CPU peripheral section includes a CPU 1505, a RAM 1520, a graphic controller 1575, and a display device 1580 that are connected to each other by a host controller 1582. The input / output unit includes a communication interface 1530, a hard disk drive 1540, and a CD-ROM drive 1560 that are connected to the host controller 1582 by the input / output controller 1584. The legacy input / output unit includes a ROM 1510, a flexible disk drive 1550, and an input / output chip 1570 connected to the input / output controller 1584.
The host controller 1582 connects the RAM 1520, the CPU 1505 that accesses the RAM 1520 at a higher transfer rate, and the graphic controller 1575. The CPU 1505 operates according to the contents of the programs stored in the ROM 1510 and the RAM 1520 and controls each unit. The graphic controller 1575 acquires image data generated by the CPU 1505 or the like on a frame buffer provided in the RAM 1520 and displays the image data on the display device 1580. Alternatively, the graphic controller 1575 may include a frame buffer that stores image data generated by the CPU 1505 or the like.
The input / output controller 1584 connects the host controller 1582 to the hard disk drive 1540, the communication interface 1530, and the CD-ROM drive 1560, which are relatively high-speed input / output devices. The hard disk drive 1540 stores programs and data used by the CPU 1505. The communication interface 1530 is connected to the network communication device 1598 to transmit / receive programs or data. The CD-ROM drive 1560 reads a program or data from the CD-ROM 1595 and provides it to the hard disk drive 1540 and the communication interface 1530 via the RAM 1520.
The input / output controller 1584 is connected to the ROM 1510, the flexible disk drive 1550, and the relatively low-speed input / output device of the input / output chip 1570. The ROM 1510 stores a boot program that is executed when the computer 1500 starts up, a program that depends on the hardware of the computer 1500, and the like. The flexible disk drive 1550 reads a program or data from the flexible disk 1590 and provides it to the hard disk drive 1540 and the communication interface 1530 via the RAM 1520. The input / output chip 1570 connects various input / output devices via the flexible disk drive 1550 or a parallel port, serial port, keyboard port, mouse port, and the like.
A program executed by the CPU 1505 is stored in a recording medium such as the flexible disk 1590, the CD-ROM 1595, or an IC card and provided by the user. The program stored in the recording medium may be compressed or uncompressed. The program is installed in the hard disk drive 1540 from the recording medium, read into the RAM 1520, and executed by the CPU 1505. The program executed by the CPU 1505 includes a computer 1500 that includes the components included in the endoscope system 10 described with reference to FIGS. 1 to 8, such as the light irradiation unit 120, the control unit 105, the image processing unit 140, and an output. Unit 150, ICG injection unit 170, imaging unit 110, and the like.
The program shown above may be stored in an external storage medium. As the storage medium, in addition to the flexible disk 1590 and the CD-ROM 1595, an optical recording medium such as a DVD or PD, a magneto-optical recording medium such as an MD, a tape medium, a semiconductor memory such as an IC card, or the like can be used. Further, a storage device such as a hard disk or a RAM provided in a server system connected to a dedicated communication network or the Internet may be used as a recording medium and provided to the computer 1500 as a program via the network.
Although the present invention has been described using the embodiment, the technical scope of the present invention is not limited to the scope described in the embodiment. It will be apparent to those skilled in the art that various modifications or improvements can be added to the above-described embodiment. It is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.
1 is a diagram illustrating an example of a configuration of an endoscope system 10 together with a living body 190. FIG. 2 is a diagram schematically showing an example of an internal structure of a scope 100. FIG. 3 is a diagram illustrating an example of the configuration of a filter unit 210 and a light receiving unit 200. FIG. 6 is a diagram illustrating an example of spectral sensitivity characteristics in the imaging unit 110. FIG. It is a figure which shows an example of the wavelength pattern of irradiation light. It is a figure which shows an example of the image process in the image process part. It is a figure which shows an example of the image which the image process part 140 produced | generated. It is a figure which shows an example of the light emission sequence of the excitation light by the excitation part. 1 is a diagram illustrating an example of a hardware configuration of an endoscope system 10. FIG.
DESCRIPTION OF SYMBOLS 10 Endoscope system 100 Scope 102 Tip part 105 Control part 110 Imaging part 112 Lens 120 Light irradiation part 122 Irradiation control part 124 Excitation part 126 Optical fiber 128 Light emission part 129 Output port 130 Forceps port 135 Forceps 138 Nozzle 140 Image processing part 150 Output unit 160 Operation unit 170 ICG injection unit 190 Living body 192 Surface 194 Convex part 196 Concave part 200 Light receiving part 210 Filter part 360 B filter 370 G filter 380 R filter 300 Image sensor unit 310 B image sensor 320 G image sensor 330 R image sensor 350 Filter unit 410 Line 420 Line 430 Line 500 Superposition pattern 510 Wavelength range 520 Wavelength range 530 Wavelength range 540 Wavelength range 550 Wavelength range 560 Wavelength range 570 Wavelength range 580 Wavelength range 600 Image 610 Surface-enhanced image 20 irregularities enhanced image 630 hemoglobin enhancement image 640 deep vascular enhancement image 700 white light image 710 topographic image 720 region 750 composite image 760 topographic image 770 deep vascular image 1500 computer 1505 CPU
1510 ROM
1520 RAM
1530 Communication interface 1540 Hard disk drive 1550 Flexible disk drive 1560 CD-ROM drive 1570 Input / output chip 1575 Graphic controller 1580 Display device 1582 Host controller 1584 Input / output controller 1590 Flexible disk 1595 CD-ROM
1598 Network communication device
A light generator that generates light having different spectral shapes;
An irradiation control unit configured to irradiate a subject with a plurality of irradiation lights obtained by superimposing light having different spectral shapes generated by the light generation unit in different combinations, respectively,
An imaging unit that captures a plurality of images of the subject irradiated with each of the plurality of irradiation lights at different timings;
An image processing unit that generates an image of a predetermined spectrum from the plurality of images,
The light generator is
A light emitting unit provided with a light emitter that emits luminescence light by the first excitation light;
An excitation unit that emits the first excitation light incident on the light emitter,
The imaging unit includes a plurality of imaging elements that receive light from a subject, captures the plurality of images based on the intensity of light received by the plurality of imaging elements,
The plurality of image sensors have different light receiving wavelength ranges,
The luminous body emits luminescence light by the first excitation light and the second excitation light having a spectrum shape different from that of the first excitation light,
The excitation unit emits the first excitation light and the second excitation light respectively incident on the light emitting unit,
The irradiation control unit includes: luminescence light emitted from the light emitter by the first excitation light emitted from the excitation unit; and a part of the first excitation light emitted from the excitation unit and passed through the light emission unit. One of the superimposed first irradiation light, luminescence light emitted from the light emitter by the second excitation light emitted by the excitation unit, and one of the second excitation light emitted from the excitation unit and passed through the light emission unit. The second irradiation light having a spectrum shape different from that of the first irradiation light , which is overlapped with the first portion, is irradiated to the subject at different timings ,
The imaging apparatus according to claim 1, wherein the plurality of irradiation lights have different spectral shapes in at least one of the plurality of light receiving wavelength ranges that can be received by the plurality of imaging elements .
The light emitter, by the second excitation light of a different spectrum than the first excitation light, according to claim 1 which emits luminescent light of the spectral shape and substantially the same spectral shape of the luminescence light emitted by the first excitation light The imaging device described in 1.
The imaging device includes a wavelength range of luminescence light emitted by the first excitation light and a wavelength range of the first excitation light as the light reception wavelength range,
The imaging apparatus according to claim 2 , wherein the excitation unit emits the second excitation light that is light in a wavelength region other than the light reception wavelength region of the imaging element.
The imaging unit includes a plurality of imaging elements having different light receiving wavelength ranges,
The imaging device according to claim 2 or 3 , wherein the light emitter emits luminescence light in a wavelength region including at least a part of the light reception wavelength region in each of the plurality of imaging elements by the first excitation light.
The imaging device according to any one of claims 1 to 4 , wherein the excitation unit emits the first excitation light and the second excitation light, each of which is coherent light.
At least a distal end portion is inserted in a narrow space, and the excitation portion further includes an insertion portion having an optical fiber for guiding the first excitation light and the second excitation light to the light emitting portion,
The imaging device according to claim 5 , wherein the light emitting unit is provided at a distal end of the insertion unit.
The imaging device according to claim 6 , wherein the imaging element is provided at a distal end portion of the insertion portion.
The light generator further includes one or more light emitters,
The plurality of light emitters included in the light generation unit emit light having different spectral shapes,
The irradiation control unit, the plurality of light emitters and an imaging apparatus according to any one of claims 1 to 7 emit light with different combinations at different timings.
The plurality of light emitters emit luminescence light having different spectral shapes,
The imaging apparatus according to claim 8 , wherein the irradiation control unit irradiates a subject with the plurality of irradiation lights including light obtained by superimposing luminescence lights emitted from the plurality of light emitters in different combinations. .
The plurality of light emitters emit luminescence light having different spectral shapes, respectively, by excitation light having different wavelength ranges,
The excitation unit emits the excitation light having different spectral shapes, respectively exciting the plurality of light emitters,
The irradiation control unit causes the excitation unit having different wavelength ranges to emit light to the excitation unit with different combinations at different timings, thereby superimposing the luminescence light emitted by the plurality of light emitters in different combinations. The imaging device according to claim 9 , wherein the subject is irradiated with the plurality of irradiation lights including the respective irradiation timings.
The plurality of irradiation light includes partial wavelength band light in which the wavelength band in the light receiving wavelength band is a partial wavelength band of the wavelength band of at least one other irradiation light,
The image processing unit includes a wavelength range of the at least one other irradiation light based on the image of the subject irradiated with the other at least one irradiation light and the image of the subject irradiated with the partial wavelength band light. The imaging device according to any one of claims 1 to 10 , wherein an image in a wavelength region other than the wavelength region of the partial wavelength region light is generated as the image of the predetermined spectrum.
The plurality of irradiation lights each include a first partial wavelength band light and a second partial wavelength band light whose wavelength range in the received wavelength range is a partial wavelength range of the received wavelength range,
The image processing unit includes the first partial wavelength in the light receiving wavelength range based on an image of a subject irradiated with the first partial wavelength band light and an image of a subject irradiated with the second partial wavelength band light. The imaging device according to any one of claims 1 to 10 , wherein an image in a wavelength range wider than any wavelength range of the range light and the second partial wavelength range light is generated as the image of the predetermined spectrum.
The imaging device according to any one of claims 1 to 10 , wherein the image processing unit generates an image of the predetermined spectrum based on the plurality of images and a spectrum of each of the plurality of irradiation lights.
Wherein the plurality of imaging devices according to any one of the irradiation light from claim 1 wavelength regions are different from each other 13.
An operation method of an imaging apparatus having a light generation unit that generates light having different spectral shapes for imaging a subject,
The control unit provided in the imaging device causes the generating unit to generate a plurality of lights obtained by superimposing light having different spectral shapes generated by the light generating unit from each other in different combinations, respectively,
An imaging unit included in the imaging device, which captures a plurality of images of a subject at different timings;
An image processing unit included in the imaging device includes a step of generating an image of a predetermined spectrum from the plurality of images,
The imaging unit includes a plurality of imaging elements that receive light from a subject,
In the imaging step, the imaging unit captures the plurality of images based on the intensity of light received by the plurality of imaging elements,
The plurality of lights include luminescence light emitted from the light emitter by the first excitation light emitted from the excitation unit and a part of the first excitation light emitted from the excitation unit and passed through the light emission unit. One of the superimposed first light, the luminescence light emitted from the light emitter by the second excitation light emitted from the excitation unit , and the second excitation light emitted from the excitation unit and passed through the light emission unit. parts and are superposed, see contains a second light spectral shape is different from the first light,
The operating method according to claim 1, wherein the plurality of lights have different spectral shapes in at least one of the plurality of light receiving wavelength regions that can be received by the plurality of imaging elements .
The program for making the said imaging device perform the operating method of Claim 15 .
JP2008154516A 2008-06-12 2008-06-12 Imaging device, imaging device operating method, and program Active JP5360464B2 (en)
JP2008154516A JP5360464B2 (en) 2008-06-12 2008-06-12 Imaging device, imaging device operating method, and program
US12/385,219 US8593513B2 (en) 2008-04-02 2009-04-01 Image capturing apparatus having first and second light reception sections, image capturing method, and computer-readable medium
EP09251040A EP2106736A3 (en) 2008-04-02 2009-04-02 Image capturing apparatus, image capturing method, and computer-readable medium
JP2009297237A JP2009297237A (en) 2009-12-24
JP5360464B2 true JP5360464B2 (en) 2013-12-04
ID=41544765
JP2008154516A Active JP5360464B2 (en) 2008-06-12 2008-06-12 Imaging device, imaging device operating method, and program
JP (1) JP5360464B2 (en)
JP5611891B2 (en) * 2011-05-24 2014-10-22 富士フイルム株式会社 Endoscope system and method for operating endoscope system
JP5611892B2 (en) * 2011-05-24 2014-10-22 富士フイルム株式会社 Endoscope system and method for operating endoscope system
JP5829472B2 (en) * 2011-10-12 2015-12-09 富士フイルム株式会社 Endoscope system and operating method thereof
JP2015202213A (en) * 2014-04-14 2015-11-16 オリンパス株式会社 Image forming device
JP2005304599A (en) * 2004-04-19 2005-11-04 Morita Mfg Co Ltd Head-worn light emitting device for diagnosis
JP4925618B2 (en) * 2004-07-28 2012-05-09 京セラ株式会社 Light source device and endoscope provided with the light source device
2008-06-12 JP JP2008154516A patent/JP5360464B2/en active Active
JP2009297237A (en) 2009-12-24
JP4954573B2 (en) 2012-06-20 Endoscope system
EP2932892A1 (en) 2015-10-21 Imaging system and method for fluorescence optical visualization of an object
US8260016B2 (en) 2012-09-04 Image processing system, image processing method, and computer readable medium
US8834359B2 (en) 2014-09-16 Method of controlling endoscope and endoscope
JP2009279168A (en) 2009-12-03 Fluorescence endoscope apparatus and excitation light unit
Ref document number: 5360464