Source: http://www.google.com/patents/US20060020169?dq=patent:5992892
Timestamp: 2014-03-08 13:18:25
Document Index: 631560410

Matched Legal Cases: ['art 10', 'art 10', 'art 10', 'art 10', 'art 10', 'art 10', 'art 10', 'art 10', 'art 10', 'art 10', 'art 10', 'art 10', 'art 10', 'art 10']

Patent US20060020169 - Electronic endoscope system for fluorescence observation - Google PatentsSearch Images Maps Play YouTube News Gmail Drive More »Sign inAdvanced Patent SearchPatentsAn electronic endoscope system, which is adapted to observe a fluorescence image of autofluorescence emitted from a body cavity wall irradiated with excitation light as well as a normal image of the body cavity wall illuminated with white light on a display device, includes a brightness control system...http://www.google.com/patents/US20060020169?utm_source=gb-gplus-sharePatent US20060020169 - Electronic endoscope system for fluorescence observationAdvanced Patent SearchPublication numberUS20060020169 A1Publication typeApplicationApplication numberUS 11/186,905Publication dateJan 26, 2006Filing dateJul 22, 2005Priority dateJul 23, 2004Also published asDE102005034658A1, US7907169Publication number11186905, 186905, US 2006/0020169 A1, US 2006/020169 A1, US 20060020169 A1, US 20060020169A1, US 2006020169 A1, US 2006020169A1, US-A1-20060020169, US-A1-2006020169, US2006/0020169A1, US2006/020169A1, US20060020169 A1, US20060020169A1, US2006020169 A1, US2006020169A1InventorsHideo SugimotoOriginal AssigneePentax CorporationExport CitationBiBTeX, EndNote, RefManReferenced by (15), Classifications (19), Legal Events (2) External Links: USPTO, USPTO Assignment, EspacenetElectronic endoscope system for fluorescence observationUS 20060020169 A1Abstract An electronic endoscope system, which is adapted to observe a fluorescence image of autofluorescence emitted from a body cavity wall irradiated with excitation light as well as a normal image of the body cavity wall illuminated with white light on a display device, includes a brightness control system configured to adjust brightness of at least one of the normal image and the fluorescence image to reduce brightness difference between the normal image and the fluorescence image to be displayed. Images(8) Claims(16)
DETAILED DESCRIPTION OF THE EMBODIMENTS Hereinafter, an electronic endoscope system according to two embodiments of the present invention will be described with reference to the accompanying drawings. The electronic endoscope system of the embodiment is directed to a system that is adapted to observe a fluorescence image of autofluorescence emitted from a body cavity wall irradiated with excitation light on a display device such as a monitor, as well as a normal image of the body cavity wall illuminated with white light. FIG. 1 schematically shows an external view of an electronic endoscope system 1 according to a first embodiment of the invention, and FIG. 2 shows a block diagram illustrating an internal constitution of the electronic endoscope system 1. As shown in FIG. 1, the electronic endoscope system is provided with a fluorescence observation endoscope 10, a light source apparatus 20, and a monitor 60. The fluorescence observation endoscope 10, which is adapted to fluorescence observation by modifying a usual electronic endoscope, is provided with an insertion part 10 a that is formed long and slender so as to be inserted into the body cavity and has a flexible bendable part at the tip thereof, an operating part 10 b that includes an angle knob and the like to operate the bendable part of the insertion part 10 a, a flexible light guide tube 10 c that connects the operating part 10 b with a light source apparatus 20, and a connector 10 d that is provided at the rear anchor of the flexible light guide tube 10 c. The light source apparatus 20 supplies illuminating light and excitation light to the fluorescence observation endoscope 10, and, as described in detail below, has a function as an image signal generator that generates image signals from signals taken by the fluorescence observation endoscope 10 and a function as a brightness changing means for changing the brightness of at least one image to reduce brightness difference between the normal image and the fluorescence image on the monitor 60 when the fluorescence image and the normal images which have been taken are displayed simultaneously. On the front surface of the light source apparatus 20, there are provided a key switch 22 for ON/OFF operation of a main power supply thereof, and a switch panel 23 on which various kinds of operation switches are arranged. Hereinafter, according to FIG. 2, the constitutions of the fluorescence observation endoscope 10 and the light source apparatus 20 are explained in sequence. On the distal end surface of the insertion part 10 a of the fluorescence observation endoscope 10, there are provided a light distribution lens 11 and an objective lens 12. Inside the tip portion of the insertion part 10 a, there are incorporated an imaging device 13 such as a CCD color imaging sensor that takes an object's color image formed by the objective lens 12, an excitation light cut filter 14 that is provided between the imaging device 13 and the objective lens 12 to eliminate the wavelength components equivalent to the excitation light for fluorescence excitation from the wavelength components of light directed to the imaging device 13 from the objective lens 12, and a cable driver 15 that amplifies image signals outputted from the imaging device 13. It is noted that the excitation light cut filter 14 may be arranged closer to an object to be observed than the objective lens 12. As shown in FIG. 3, the excitation light cut filter 14 has characteristics that cut off the excitation light and transmit light with wavelengths longer than the excitation light. Therefore, it is possible to prevent the excitation light, which is reflected by the wall of the body cavity subject to the observation, from being introduced into the imaging device 13 and to take only the fluorescence images during fluorescence observation. In addition, since near-ultraviolet light that excites autofluorescence of a living organism is applied as excitation light, even if the wavelength components of the excitation light is cut off by the excitation light cut filter 14, there is no trouble in taking a blue component, which is also generally used as excitation light, while taking normal color images. A signal cable 18 that transmits the image signals amplified by the cable driver 15 runs through the insertion part 10 a, the operation part 10 b, and the flexible light guide tube 10 c, and is connected to a signal processing circuit of the light source apparatus 20 that is connected to the fluorescence observation endoscope 10. In parallel with the signal cable 18, a light guide 16 that is constituted by bundling plurality of optical fibers runs through the insertion part 10 a, the operation part 10 b, and the flexible light guide tube 10 c. The tip end face of the light guide 16 faces the light distribution lens 11 within the tip portion of the insertion part 10 a, and the rear anchor of the light guide 16 is fixed in the state to be inserted into the light source apparatus 20. In addition, a connection part 10 d of the fluorescence observation endoscope 10 has a built-in ROM 17 for reading identification data when attached to the light source apparatus 20. The light source apparatus 20 selectively introduces either white light for observation of the body cavity wall or the excitation light that excites the living tissues of the body cavity wall so that the living tissues emits autofluorescence into the end face of the rear anchor of the light guide 16. The light source apparatus 20 further processes the image signals received from the cable driver 15 to generate video signals, and then outputs the video signals to the monitor 60. An optical system of the light source apparatus 20 is provided with a white light source (discharge tube lamp) 30 that emits substantially parallel white light (white light), a light control aperture 31 that controls the beam diameter of the white light emitted from the white light source 30, a condenser lens 32 that converges the white light which is transmitted through the light control aperture 31 on the end face of the rear anchor of the light guide 16, an excitation light source 33 that emits the excitation light, an optical waveguide (single mode fiber) 34 that guides the excitation light emitted from the excitation light source 33, a collimating lens 35 that collimates the excitation light, which is diverging light emitted from the optical waveguide 34, and a dichroic mirror 36 that combines both light paths of the white light and the excitation light. The light control aperture 31 is driven by an aperture driving motor 31 a, and functions to control the intensity of the white light according to the reflectance of an object. The white light path that extends straight from the white light source 30 to the light guide 16 and the excitation light path that intersects perpendicularly therewith are combined by the light path combining device, that is, the dichroic mirror 36. Since the dichroic mirror 36 transmits the white light and reflects the near-ultraviolet light with wavelengths shorter than the white light, the dichroic mirror 36 transmits major part of the white light and reflects the excitation light, introducing both kinds of light into a single light path that extends to the end face of the rear anchor of the light guide 16. Between the white light source 30 and the dichroic mirror 36, there is arranged a rotary shutter 37 that enables the intermittent ON/OFF operation of the white light (that is, intermittently transmits or blocks the white light). The rotary shutter 37, as a front view thereof is shown in FIG. 4, has a fan-shaped window 37 a with a center angle of 180 degrees, and the size of the window 37 a is configured to be larger than the diameter of the beam of the white light. The rotary shutter 37 is allowed to rotate and intermittently transmit the white light as a shutter driving motor 38 is driven. The light source apparatus 20 is provided with a lamp driving power supply 51 that supplies current to the white light source 30, a laser driver 52 that drives and switches the excitation light source 33, a first motor driver 53 that drives the aperture driving motor 31 a, a second motor driver 54 that drives the shutter driving motor 38, and a CCD driver 56 that drives the imaging device 13. The light source apparatus 20 further includes a pre-signal-processing circuit 57 that processes image signals received from the cable driver 15, first and second memories 58 a and 58 b that temporarily store digital image signals outputted from the pre-signal-processing circuit 57, a post-signal-processing circuit 59 that transforms the digital image signals outputted from the image memories into standardized video signals which are allowed to be displayed on a television monitor and outputs the standardized video signals, and a system controller 70 and a timing controller 71 that control all of the above components. The system controller 70 is connected with a fluorescence mode switch 73 provided at the operation part 10 b, and is further connected electrically with various switches that are arranged on the switch panel 23. Based on the setting of each switches, the system controller 70 controls the lamp driving power supply 51 and the laser driver 52 so that the white light and the excitation light are emitted consecutively or stopped, and further switches a display on the monitor 60. On the switch panel 23, as shown in FIG. 5, there are provided a fluorescence mode display button 23 a for selecting images to be displayed in the fluorescence mode�only the fluorescence image or both the fluorescence image and the normal image that are simultaneously displayed side by side, and a pair of brightness setting buttons 23 b and 23 c for down/up, respectively. In addition, the switch panel 23 is provided with a two-image-indicator 23 d which lights up when both the fluorescence image and the normal image that are simultaneously displayed side by side are selected in the fluorescence mode and a setting level indicator 23 e which visually indicates a target value for the brightness of the fluorescence image and the normal image set by operating the brightness setting buttons 23 b and 23 c. When the fluorescence observation endoscope 10 is connected to the light source apparatus 20, the built-in ROM 17 inside the fluorescence observation endoscope 10 is also connected to the system controller 70, which identifies that what is connected to the light source apparatus 20 is the fluorescence observation endoscope 10 by reading the identification data stored in the ROM 17. Based on a command from the system controller 70, the timing controller 71 controls the laser driver 52 to carry out the intermittent ON/OFF operation of the excitation light at predetermined timing, and further controls the second motor driver 54 that drives the shutter driving motor 38 to carry out the intermittent ON/OFF operation of the white light at predetermined timing. The timing controller 71 also controls the timing when the imaging device 13 takes an image through the CCD driver 56, and further controls the data read/write operation of each of the image memories 58 a and 58 b (the address data controls), indicating the respective timings of the image signal processing for the pre-signal-processing circuit 57 and the post-signal-processing circuit 59. Next, the internal constitution of the system controller 70 and the pre-signal-processing circuit 57 that are configured to change the brightness of the images will be described with reference to a block diagram shown in FIG. 6. The system controller 70 is provided with a setting table 70 a that defines a target value for the brightness of the normal image and the fluorescence image set by operating the brightness setting buttons 23 b and 23 c on the switch panel 23 and first and second comparators 70 b and 70 c that compare the brightness of each of the normal image and the fluorescence image with the target value. Furthermore, the pre-signal-processing circuit 57 is provided with a A/D converter 57 a that converts analog fluorescence image signals YUV outputted from the imaging device 13 while taking the fluorescence image and analog normal image signals R, G, B outputted from the imaging device 13 while taking the normal image to corresponding digital signals, a first brightness converting circuit 57 b that converts digitally-converted color signals of the normal image to brightness signals, a first detector 57 c that detects the brightness of the images by analyzing the histogram of the brightness signals, a second brightness converting circuit 57 d that converts digitally-converted signals of the fluorescence image to brightness signals, a second detector 57 e that detects the brightness of the fluorescence image by analyzing the histogram of the brightness signals, and a multiplier 57 f that amplifies or attenuates digitally-converted image signals. Next, the operation of the endoscope system of the first embodiment constituted as mentioned above is explained. The endoscope system of the embodiment operates in any one of the following three modes as moving image modes: a normal image display mode in which the normal (color) image taken with the white light applied continuously is displayed as a moving image; a fluorescence image display mode in which the fluorescence image taken with the excitation light applied continuously is displayed as a moving image; and a simultaneous display mode in which the normal image and the fluorescence image taken with the white light and the excitation light alternately applied are displayed as moving images. When a fluorescence mode switch 73 provided at the operation part 10 b of the fluorescence observation endoscope 10 is OFF, the system is set up in the normal image display mode. If the fluorescence mode switch is turned ON, the system will be set up in either the fluorescence image display mode or the simultaneous display mode. It can be previously defined by operating the fluorescence mode display button 23 a that are provided on the switch panel 23 which mode will be selected. Hereinafter, each mode is explained. When the fluorescence mode switch 73 is OFF, the system is set up in the normal image display mode, as described above. In the normal image display mode for the normal observation, the system controller 70 controls the lamp driving power supply 51 to let the white light source 30 emit the white light continuously. At this time, the shutter driving motor 38 and the excitation light source 33 are not driven, but still OFF. The rotary shutter 37 stops with the window 37 a located on the path of the white light such that the white light is transmitted through the shutter 37. Thereby, the white light emitted from the white light source 30 is continuously introduced into the light guide 16. The imaging device 13 provided at the tip of the fluorescence observation endoscope captures the image of the inside of the body cavity illuminated with the white light. The normal image signals outputted from the imaging device 13 are inputted into the pre-signal-processing circuit 57 through the cable driver 15 and the signal cable 18. The pre-signal-processing circuit 57, based on the signals from the timing controller 71, allows the first image memory 58 a and the second image memory 58 b to store the normal image signals. The post-signal processing circuit 59, based on the signals from the timing controller 71, reads out the image signals from the first image memory 58 a and the second image memory 58 b, and converts the image signals into the video signals, displaying a single moving normal image in full screen on the monitor 60. FIG. 7 shows an example of a screen displayed on the monitor 60 in a normal image display mode. In the normal image display mode, the first comparator 70 b of the system controller 70 compares the target value defined in the setting table 70 a with the brightness of the normal image outputted from the first detector 57 c of the pre-signal-processing circuit 57 to adjust the intensity of the white light by controlling the first motor driver 53 that drives the aperture driving motor 31 a on the basis of the comparison result. As shown in FIG. 6, moreover, the first comparator 57 b is connected with an aperture opening detector 31 b that detects the opening level of the light control aperture 31, and receives a detection result from the aperture opening detector to drive the first motor driver 53 under closed-loop control. If the fluorescence mode switch 73 is turned ON in the normal image display mode, the system will be set up in either mode between the fluorescence image display mode and the simultaneous display mode, the mode which is previously defined by the fluorescence mode display button 23 a on the switch panel 23. When the system is set up in the fluorescence image display mode by the fluorescence mode display button 23 a on the switch panel 23, the system controller 70 controls the lamp driving power supply 51 to turn OFF the white light source 30, and further controls the laser driver 52 to let the excitation light source 33 emit the excitation light continuously. The shutter driving motor 38 is still OFF. Thereby, the excitation light emitted from the excitation light source 33 is continuously introduced into the light guide 16. The imaging device 13 provided at the tip of fluorescence observation endoscope captures the image of fluorescence emitted from the body cavity excited by the excitation light. The fluorescence image signals outputted from the imaging device 13 are inputted into the pre-signal-processing circuit 57 through the cable driver 15 and the signal cable 18. The pre-signal-processing circuit 57 allows the first and second memories 58 a, 58 b to store the fluorescence signals, based on the signals from the timing controller 71. The post-signal-processing circuit 59, based on the signals from the timing controller 71, reads out the image signals from the first and second memories 58 a, 58 b to convert the image signals into the video signals, displaying a single fluorescence image as a moving image on the monitor 60 in a full screen view coinciding with the display area of the monitor 60. The second comparator 70 c of the system controller 70 compares the target value defined in the setting table 70 a with the brightness of the fluorescence image outputted from the second detector 57 e of the pre-signal-processing circuit 57, and based on the comparison result, controls the laser driver 52 for driving the excitation light source 33 to adjust the emission amount of the excitation light source 33 in the first stage, and further controls the multiplier 57 f to change the gain of the fluorescence image signals in the case where the only controlling of the emission amount is not enough to attain the target value in the second stage. Since the fluorescence image generally tends to be obscure, the fluorescence emission amount is increased by increasing the emission amount of the excitation light source 33 in the first stage, and if necessary, the fluorescence image signals are amplified. Since it is needed to judge the brightness of the fluorescence image in consideration of the gain changed by the multiplier 70 f, the multiplier 70 f is arranged in the preceding step of the second brightness conversion circuit 57 d. When the fluorescence mode switch 73 is turned ON and the simultaneous display mode is applied by the fluorescence mode display button 23 a, the system controller 70 controls the lamp driving power supply 51 to let the white light source emit continuously. The timing controller 71 controls the second motor driver 54 to rotate the shutter driving motor 38, and further controls the laser driver 52 to turn OFF the excitation light source 33 while the window 37 a of the rotary shutter 37 is located on the white light path (while the white light is introduced into the light guide) and generate the excitation light while the shielding part of the rotary shutter 37 is located on the white light path (while the white light is not introduced into the light guide). Thereby, an object is irradiated alternately with the white light and the excitation light. The imaging device 13 provided at the tip of the fluorescence observation endoscope alternately takes the normal image of the body cavity wall illuminated with the white light and the fluorescence image of the body cavity wall excited by the excitation light. The image signals outputted from the imaging device 13 is inputted into the pre-signal-processing circuit 57 through the cable driver 15 and the signal cable 18. FIG. 8 is a chart pattern showing the respective irradiation timings of the white light and the excitation light in the simultaneous display mode and the timing when image data is outputted from the imaging device 13. As shown in FIG. 8, the normal color image is taken while the white light is applied and the excitation light is not applied, and the fluorescence image is taken while the white light is not applied and the excitation light is applied. Based on the signals from the timing controller 71, the pre-signal-processing circuit 57 allows the first image memory 58 a to store the normal image signals and the second memories to store the fluorescence image signals. Based on the signals from the timing controller 71, the post-signal-processing circuit 59 reads out the respective image signals from the first and second memories, and performs scan conversion for the respective image signals, which are then displayed as a moving normal image and a moving fluorescence image on the monitor 60, respectively. FIG. 9 shows an example of a screen displayed on the monitor 60 in the simultaneous display mode. In the simultaneous display mode, the first comparator 70 b of the system controller 70 does not receive the target value from the setting table 70 a, and instead compares the brightness of the normal image outputted from the first detector 57 c with the brightness of the fluorescence image outputted from the second detector 57 e, and based on the comparison result, the first motor driver 53 is controlled to adjust the intensity of the white light such that the brightness of the normal images is substantially equal to the brightness of the fluorescence image. According to the above-mentioned first embodiment, when the normal image and the fluorescence image are displayed side by side on the single monitor 60, by narrowing down the light control aperture 31 in conformity with the brightness of the fluorescence image to reduce the intensity of the white light, it is possible to set the brightness of the normal image substantially equal to the brightness of the fluorescence image and prevent observer's fatigue caused by the brightness difference. However, it is noted that since too obscure normal image poses a problem for observation, the brightness of the normal image needs not to be completely the same as the brightness of the fluorescence image unless the brightness difference between both kinds of images causes observer's fatigue. FIG. 10 is a block diagram illustrating internal constitution of an electronic endoscope system according to a second embodiment of the invention. The constitution of the system has the difference with the first embodiment shown in FIG. 2 in being provided with two monitors 60 and 61 and corresponding post-signal-processing circuits 59 a and 59 b for the monitors 60 and 61. The constitution other than the above features is the same as the first embodiment. In the system of the first embodiment, when the normal image and the fluorescence image are displayed simultaneously in the simultaneous display mode, both kinds of images are displayed side by side on the single monitor 60. Therefore, a displaying area for each image is small, and it is more difficult to confirm details than a case of full-screen display of a single image. To solve this problem, in the system of the second embodiment, the normal image and the fluorescence image are displayed in full-screen on the first and second monitors 60 and 61, respectively, in the simultaneous display mode. In addition, a system controller 70 and a pre-signal-processing circuit 57 are configured to be the same as the constitution of the first embodiment shown in FIG. 6, and controls the brightness of the normal image displayed on the monitor 60 to be substantially equal to the brightness of the fluorescence image displayed on the monitor 61. Thereby, it is possible to reduce observer's fatigue owing to no brightness difference while watching both monitors. When two monitors are used as described in the second embodiment 60, an identical effect can be obtained by adjusting the brightness of each monitor. However, it is noted that in the normal image display mode or the fluorescence image display mode, assumed is a case where for example, a doctor providing medical treatment and a nurse supporting the doctor observe the same image on different monitors, respectively. Accordingly, it is not possible to completely define which image is displayed on which monitor, and it is troublesome to manually adjust the brightness of the monitor every time a mode is changed. Since the constitution of the second embodiment enables to previously set the brightness of one of the two monitors the same as the brightness of the other and automatically adjust the brightness of each image at the side of the light source apparatus 20, it is possible to observe the images with appropriate brightness without troublesome operation. The present disclosure relates to the subject matter contained in Japanese Patent Application No. P2004-215597, filed on Jul. 23, 2004, which is expressly incorporated herein by reference in its entirely. Referenced byCiting PatentFiling datePublication dateApplicantTitleUS7539335Jan 11, 2006May 26, 2009Hoya CorporationImage data processor, computer program product, and electronic endoscope systemUS7625336Dec 30, 2005Dec 1, 2009Hoya CorporationElectronic endoscope system with functionally alterable operable membersUS7632227Dec 29, 2005Dec 15, 2009Hoya CorporationElectronic endoscope systemUS7725013 *Dec 26, 2006May 25, 2010Hoya CorporationElectronic endoscope with brightness adjustment functionUS7877135Feb 13, 2006Jan 25, 2011Hoya CorporationImage data processor, computer program product, and electronic endoscope systemUS8167793 *Jun 30, 2008May 1, 2012Intuitive Surgical Operations, Inc.Augmented stereoscopic visualization for a surgical robot using time duplexingUS8169468Jun 30, 2008May 1, 2012Intuitive Surgical Operations, Inc.Augmented stereoscopic visualization for a surgical robotUS8228368Jun 30, 2008Jul 24, 2012Intuitive Surgical Operations, Inc.Augmented stereoscopic visualization for a surgical robot using a captured fluorescence image and captured stereoscopic visible imagesUS8313426 *Nov 26, 2007Nov 20, 2012Olympus CorporationEndoscope systemUS8617057 *May 16, 2007Dec 31, 2013Olympus CorporationEndoscope systemUS20100094136 *Nov 26, 2007Apr 15, 2010Olympus CorporationEndoscope systemUS20110015528 *Jul 12, 2010Jan 20, 2011Hoya CorporationMedical observation system and processorUS20110071353 *Sep 24, 2010Mar 24, 2011Fujifilm CorporationMethod of controlling endoscope and endoscopeEP2384689A1 *Sep 14, 2010Nov 9, 2011Olympus Medical Systems Corp.Fluorescence observation deviceEP2401958A1 *Jun 24, 2011Jan 4, 2012Inspektor Research Systems B.V.Intraoral observation equipment* Cited by examinerClassifications U.S. Classification600/180, 600/160, 600/476, 600/921International ClassificationA61B6/00, A61B1/06Cooperative ClassificationA61B1/00039, A61B1/0638, A61B1/00186, A61B1/0646, A61B1/043, A61B1/00009, A61B5/0071, A61B5/0084European ClassificationA61B1/00C1D, A61B1/04F, A61B5/00P12B, A61B5/00P5, A61B1/06Legal EventsDateCodeEventDescriptionFeb 9, 2011ASAssignmentFree format text: MERGER;ASSIGNOR:PENTAX CORPORATION;REEL/FRAME:025778/0202Owner name: HOYA CORPORATION, JAPANEffective date: 20080331Jul 22, 2005ASAssignmentOwner name: PENTAX CORPORATION, JAPANFree format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:SUGIMOTO, HIDEO;REEL/FRAME:016806/0482Effective date: 20050722RotateOriginal ImageGoogle Home - Sitemap - USPTO Bulk Downloads - Privacy Policy - Terms of Service - About Google Patents - Send FeedbackData provided by IFI CLAIMS Patent Services©2012 Google