Source: https://patents.google.com/patent/JP2008264213A/en
Timestamp: 2020-01-22 19:27:45
Document Index: 240939279

Matched Legal Cases: ['art 308', 'art 314', 'art 315', 'art 316', 'art, 310', 'art, 315']

JP2008264213A - Endoscope image filing system - Google Patents
JP2008264213A
JP2008264213A JP2007111485A JP2007111485A JP2008264213A JP 2008264213 A JP2008264213 A JP 2008264213A JP 2007111485 A JP2007111485 A JP 2007111485A JP 2007111485 A JP2007111485 A JP 2007111485A JP 2008264213 A JP2008264213 A JP 2008264213A
JP2007111485A
2007-04-20 Application filed by Olympus Corp, オリンパス株式会社 filed Critical Olympus Corp
2007-04-20 Priority to JP2007111485A priority Critical patent/JP2008264213A/en
2008-11-06 Publication of JP2008264213A publication Critical patent/JP2008264213A/en
<P>PROBLEM TO BE SOLVED: To provide an endoscope image filing system capable of acquiring an image having an image quality equal to that of an image photographed by a specific model even when the image is photographed by a model different from the specific model. <P>SOLUTION: A original image file part 308 stores a digital image which is outputted by an electronic scope 302 provided with an imaging device 301 and is equal to a digital image inputted to an image processing circuit 306. A library part 314 stores a plurality of image processing software. A selecting part 315 selects one from among the plurality of image processing software components stored in the library part. An image reproduction part 316 processes the digital image according to the selected image processing software component so that the digital image can be displayed. <P>COPYRIGHT: (C)2009,JPO&INPIT
The present invention relates to an endoscope image filing system that stores a digital image captured by an electronic endoscope provided with an image sensor.
In recent years, electronic endoscopes have been widely used in the medical field. An image captured by an electronic endoscope is stored in an external recording medium such as photographic paper, magnetic tape, or magnetic disk, and is referred to when necessary by a doctor. When observing the time course of an affected area of a patient, the images acquired in the past are compared with the current image. At the time of this comparison, the type of endoscope used to acquire the images If they are different, accurate comparison cannot be performed. This is because a slight difference in color tone between models may hinder a doctor's diagnosis.
The visceral color observed with an endoscope is mostly red, but doctors can empirically recognize subtle differences in the color of the lesion from the observation images with the same color. Become. Therefore, when a new model is used, there is an undeniable possibility that a slight difference in color tone from the model used so far has some influence on the diagnosis.
In addition, when remote diagnosis using an endoscope is put into practical use in the future, it may be necessary to perform diagnosis using an image taken with a model different from the endoscope that is normally used. Naturally, even in such a case, an accurate diagnosis must be made.
Therefore, a device that absorbs and displays differences between images taken by different models is required. As such an apparatus, there is a medical image display apparatus and a medical image filing system disclosed in Patent Document 1.
The configuration of the medical image display device and the medical image filing system described in Patent Document 1 is shown in FIG. A medical image display device 600 including a computing device 601, a display 602, an input device 603, and an interface 604 is connected to a network 610. The network 610 includes endoscopes 660a and 660b and various examination devices (X-ray CT). An apparatus 630, an X-ray imaging apparatus 640, an ultrasonic diagnostic apparatus 650) and a file server 620 for a medical image database. The medical image obtained by each inspection apparatus is stored in the file server 620 as a medical image file.
When the medical image display device 600 reads and displays a medical image file, the medical image display device 600 performs color adjustment with reference to a preset display palette table stored in the file device 621 and displays the medical image file. This pallet table is made up of, for example, a red level, a green level, a blue level, and a contrast. Note that this display palette table is set for each inspection device by attribute data such as the inspection device number, and can be arbitrarily set by the user. Thereby, since a user can set a favorite color tone for every model, the image which absorbed the difference in the color tone for every model can be displayed.
JP-A-8-238223
In the prior art, correction processing is performed on the final image output of the endoscope. However, the image processing is not limited to the endoscope, and the information originally included in the original image is not a little damaged due to the quantization error of the calculation in the process. For this reason, there is a limit to the effect of correction processing on image data that has been subjected to various image processing. Furthermore, the image processing of the endoscope is specialized for subtle tone expression of red and yellow, which are the main colors of the internal organs. If such an image is processed to such an extent that the levels of red, green and blue are simply adjusted, there is a risk that the subtle color expression of the original image will be impaired. In addition, if the standard of adjustment is ambiguous that the user is “preferred”, it is impossible to place absolute confidence in the adjusted image when making a diagnosis.
The present invention has been made in view of the above-described problems, and an image having an image quality equivalent to that of an image shot with a specific model is obtained even if the image is shot with a model different from the specific model. An object of the present invention is to provide an endoscopic image filing system that can be acquired.
The present invention has been made in order to solve the above-described problem, and is an original image in which a digital image equivalent to a digital image output from an electronic endoscope provided with an image sensor and input to an image processing circuit is stored. A file unit, a library unit that stores a plurality of image processing software, a selection unit that selects any one of the plurality of image processing software stored in the library unit, and a selected unit An endoscope image filing system including an image reproduction unit that processes the digital image stored in the original image file unit in a displayable manner according to the image processing software.
The endoscopic image filing system of the present invention further includes a display unit that displays the digital image processed by the image reproduction unit.
According to the present invention, a digital image that does not depend on the model before image processing is stored in the original image file unit, and the digital image is subjected to image processing software selected by the selection unit. By performing the image processing by the image reproduction unit, an effect is obtained that an image having an image quality equivalent to that of an image shot with the same model can be acquired even if the image is shot with a different model.
First, a first embodiment of the present invention will be described. FIG. 1 shows the configuration of an endoscopic image filing system according to this embodiment. The endoscope image filing system according to the present embodiment includes an endoscope system 310 and an image reproduction device 311.
First, the configuration of the endoscope system 310 will be described. The endoscope system 310 includes an electronic scope 302 (electronic endoscope), an image processing processor 305, and a moving image observation monitor 307. The electronic scope 302 includes an objective optical system 300, a solid-state imaging device 301, a CDS / AGC circuit 303, and an A / D conversion circuit 304. The objective optical system 300 forms a subject image. The solid-state imaging device 301 includes a CCD or the like, photoelectrically converts a subject image formed by the objective optical system 300, and outputs an image signal. The CDS / AGS circuit 303 performs correlated double sampling (CDS) and automatic gain control (AGC) on the image signal output from the solid-state image sensor 301. The A / D conversion circuit 304 converts the analog image signal output from the CDS / AGS circuit 303 into a digital image signal.
The image processor 305 includes an image processing circuit 306 and an original image file unit 308. The image processing circuit 306 performs predetermined image processing on the digital image signal continuously input from the electronic scope 302 in real time and converts the digital image signal into an image suitable for observation. The original image file unit 308 stores the digital image signal from the electronic scope 302 as an original image file 309 having a predetermined format. The moving image output from the image processor 305 is input to the moving image observation monitor 307, and the user operates the electronic scope 302 while viewing the image displayed on the moving image observation monitor 307.
Next, the configuration of the image playback device 311 will be described. The library unit 314 stores a plurality of image processing software 312 and 313 (image processing program). These image processing softwares are software (programs) that perform image processing corresponding to the image processing circuit 306 of the image processing processor 305, but the processing content of each image processing software differs depending on the type of endoscope. .
The selection unit 315 selects one of the image processing software from the above-described image processing software based on a user instruction, reads the selected image processing software from the library unit 314, and loads it into the image reproduction unit 316. . The image reproduction unit 316 performs predetermined image processing on the original image file 309 so that an image can be displayed according to the image processing software selected by the selection unit 315. The processing result of the image reproduction unit 316 is displayed as an image by the display unit 317.
The processed image file unit 318 stores, as the processed image file 319, the result of the image reproduction unit 316 performing image processing on the original image file 309. The operation unit 320 includes a keyboard, a mouse, a switch, or the like that is operated by the user to select desired image processing software. The selection unit 315 selects image processing software based on a signal output from the operation unit 320 and indicating a selection result of the image processing software by the user.
As for the transfer of the original image file 309 between the endoscope system 310 and the image reproduction apparatus 311, the image reproduction apparatus 311 communicates with the endoscope system 310, and the original image file 309 is transmitted from the endoscope system 310. May be received, or the image reproduction device 311 may read the original image file 309 recorded by the endoscope system 310 on an external recording medium such as a memory card.
Next, the format of the original image file 309 will be described. FIG. 2 shows an example of the format of the original image file 309. The original image file 309 includes an image area 309a that stores image data itself and a header area 309b that stores information associated with the image.
The image acquisition method of the electronic scope includes a type using an RGB rotation filter (hereinafter referred to as a rotary type), a type using three image sensors (hereinafter referred to as a three-plate type), a color filter (primary color filter or complementary color filter). There is a type (hereinafter, referred to as a single plate type) that uses one image pickup device to which is attached). Furthermore, the number of pixels of the image sensor, the effective bit length, and the like are various. Therefore, it is necessary to record what kind of data is stored in the file in some form.
Further, white balance may be adjusted by imaging a white object before the start of photographing, but it is desirable to store the white balance coefficient acquired at that time. In view of this, in the header area 309b, the electronic scope type (rotary type, three-plate type, single-plate type), the total number of pixels, the effective bit length, the white balance coefficient, and the like are stored. The model number of the image sensor mounted on the electronic scope may be recorded together.
Next, the operation of the endoscope image filing system according to the present embodiment will be described. The observation image is input to the image processor 305 as a digital image signal through the objective optical system 300, the solid-state imaging device 301, the CDS / AGC circuit 303, and the A / D conversion circuit 304. The input digital image signal is converted into an image suitable for observation by the image processing circuit 306 and output to the moving image observation monitor 307, and the observation image is displayed on the moving image observation monitor 307.
The user operates the electronic scope 302 while viewing the image displayed on the moving image observation monitor 307, and instructs the image processor 305 to capture an image when a lesion site is found. The digital image signal from the electronic scope 302 at this time is stored as an original image file 309 by the original image file unit 308.
When redisplaying the image stored in this way, the user selects which image processing software to use (which image processing processor to reproduce the image processing) by the operation of the operation unit 320. 315 is instructed. The selection unit 315 reads the image processing software designated by the user from the library unit 314 and loads it into the image reproduction unit 316. The image reproduction unit 316 performs predetermined image processing on the data of the original image file 309 according to the image processing software selected by the selection unit 315, and outputs the processing result to the display unit 317. Further, the image processed by the image reproduction unit 316 is saved as a processed image file 319 by the processed image file unit 318 as necessary.
As described above, a digital image that does not depend on the model before being subjected to image processing is stored in the original image file unit 308 as an original image file 309, and the original image file 309 is selected by the selection unit 315. The image reproduction unit 316 performs image processing according to the image processing software, so that even if the image is shot with a model different from the specific model, the image quality is equivalent to the image shot with the specific model. The image which has can be acquired. This makes it possible to create a consistent medical chart regardless of the type of image taken, and also improves the reliability during remote diagnosis. In addition, since the image processed by the image reproduction unit 316 is displayed by the display unit 317, the user can visually check the image processing result by the image reproduction unit 316.
For example, when a chart of a patient is recorded as an image processed by the image processor A, if the image processed by an image processor B different from the image processor A is mixed, the consistency of the chart is lost. It is. However, according to the present embodiment, even when the image processor A cannot be used due to a model change or the like, the original image captured by the image processor B is processed by image processing software that executes processing equivalent to the image processor A. By doing so, an image equivalent to the image processed by the image processor A can be obtained. Therefore, the user can perform continuous diagnosis against the past medical chart images in the same manner as before changing the model.
Further, by saving the original image before image processing as in the present embodiment, the degree of freedom of image processing that can be performed on the image data is expanded. For this reason, it is possible to generate an image as if shooting was performed using a model different from the model that actually performed shooting. Furthermore, the image processing software used at the time of image reproduction closely reproduces the processing performed by the existing image processing processor, and can eliminate ambiguity such as user's subjectivity. Therefore, the reliability at the time of diagnosis is very high.
Although the endoscope system 310 shown in FIG. 1 stores only the original image, the output image of the image processing circuit 306 may be stored like a normal endoscope. For example, only the original image, both the original image and the image after image processing, and only the image after image processing can be switched, so that the user can select an appropriate storage method. Good. In addition, although two types of image processing software are stored in the library unit 314 shown in FIG. 1, the number of types of image processing software may be larger.
Next, a second embodiment of the present invention will be described. FIG. 3 shows the configuration of the endoscope system (endoscopic image filing system) according to the present embodiment. In FIG. 3, the control CPU 402 controls the entire endoscope system 310 in the moving image observation mode, but takes charge of the function of the image reproduction unit in the image reproduction mode. Whether the screen selection unit 400 outputs a moving image from the image processing circuit 306 (moving image observation mode) or an image processed by the control CPU 402 according to the operation mode set by the user's instruction (image) Select (Playback Mode). The display unit 401 displays the image output by the screen selection unit 400.
Next, the operation of the endoscope system 310 according to the present embodiment will be described. Since the acquisition of the original image file is the same as in the first embodiment, the description thereof is omitted. At the time of image reproduction, as in the first embodiment, the selection unit 315 selects image processing software from the library unit 314 based on a signal output from the operation unit 320 and indicating the selection result of the image processing software by the user. The program of the control CPU 402 is loaded into the memory 403 for storing. The control CPU 402 reads the original image file 309 from the original image file unit 308 and performs image processing according to the image processing software loaded in the memory 403.
The image processed by the control CPU 402 is input to the screen selection unit 400. The screen selection unit 400 selects a reproduction image from the control CPU 402 and outputs it to the display unit 401 in the image reproduction mode. Note that the control CPU 402 cannot output image data at a timing that the display unit 401 can display as it is due to the characteristics of software processing. Therefore, the screen selection unit 400 includes a buffer memory that temporarily stores image data, and a mechanism that outputs an image to the display unit 401 at a timing at which the display unit 401 can display an image.
The image processing executed by the image processing circuit 306 is real-time moving image processing, and it is difficult to realize the same processing by software processing using a CPU or the like. However, since still image processing is performed in the image reproduction mode, the system operation does not fail even if the CPU performs computation in this case.
In the endoscope system 310 according to the present embodiment, in the moving image observation mode, it is necessary for the user to check the image on the display unit 401 and determine whether to shoot (store the image) the affected part. However, the image displayed on the display unit 401 in the moving image observation mode is obtained by performing image processing by the image processing circuit 306 mounted on the image processor 305 used for observation. If you are unfamiliar with the later color tone, it is difficult to make subtle judgments. In such a case, the captured image is temporarily stored as an original image file 309, and then converted into a color tone after desired image processing for diagnosis.
In the first embodiment, as shown in FIG. 1, the endoscope system 310 and the image reproducing device 311 are separated, and an image is converted by using an external recording medium or a communication function to convert an original image file 309. It was necessary to transfer to the image playback apparatus 311. Therefore, it is difficult to convert an image while the electronic scope 302 is being operated. On the other hand, in the present embodiment, the image reproduction device is integrated in the endoscope system 310, and there is no need for file transfer. Therefore, even if it is necessary to make a delicate determination as to whether or not to shoot, it is possible to create an observation image equivalent to an observation image obtained by image processing performed by a familiar image processor without interrupting observation. Can reduce the risk of overlooking the lesion.
The endoscope system 310 according to the present embodiment stores only the original image file 309. However, as in the first embodiment, the image processing result by the control CPU 402 is stored in a file as necessary. May be. Further, similarly to the first embodiment, the output image of the image processing circuit 306 may be stored like a normal endoscope. Further, as in the first embodiment, the image processing software stored in the library unit 314 may be more than two types.
Next, a third embodiment of the present invention will be described. FIG. 4 shows the configuration of the endoscope image filing system according to the present embodiment. In the present embodiment, an RGB conversion circuit 500 is provided in front of the image processing circuit 306 and the original image file unit 308. The image signal from the electronic scope 302 is input to the image processor 305 in various formats as described above. Even if the number of pixels is the same, the amount of data differs between an image acquired by the rotary type and the three-plate type and an image acquired by the single-plate type. Furthermore, there is a difference in color filters (primary colors and complementary colors) in an image acquired by a single plate type. Therefore, in the present embodiment, the RGB conversion circuit 500 provided in the preceding stage of the image processing circuit 306 and the original image file unit 308 converts an image from a single-plate electronic scope into the same primary color as that of the rotation type (and the three-plate type). Convert to RGB signal. As a matter of course, nothing is done for the rotary and three-plate images. In addition, you may make it convert into the image signal of a complementary color instead of a primary color.
According to the present embodiment, the format of the original image file 309 stored in the original image file unit 308 is common regardless of the type of the electronic scope, so that the image reproduction unit 316 simply acquires the image of the original image file 309. Become. In FIG. 4, the RGB conversion circuit 500 is provided for the endoscope system 310 illustrated in FIG. 1, but the RGB conversion circuit 500 may be provided for the endoscope system 310 illustrated in FIG. 3. Good.
1 is a block diagram showing a configuration of an endoscope image filing system according to a first embodiment of the present invention. It is a reference figure which shows the format of the original image file in the 1st Embodiment of this invention. It is a block diagram which shows the structure of the endoscope system by the 2nd Embodiment of this invention. It is a block diagram which shows the structure of the endoscopic image filing system by the 3rd Embodiment of this invention. It is a block diagram which shows the structure of the conventional medical image display apparatus and medical image filing system.
DESCRIPTION OF SYMBOLS 300 ... Objective optical system, 301 ... Imaging device, 302 ... Electronic scope, 303 ... CDS / AGC circuit, 304 ... A / D conversion circuit, 305 ... Image processor, 306 ... Image processing circuit, 307 ... Monitor for moving image observation, 308 ... Original image file part, 310 ... Endoscope system, 311 ... Image reproduction device, 314 ... Library part, 315 ... Selection unit, 316 ... Image reproduction unit, 317,401 ... Display unit, 318 ... Processed image file unit, 320 ... Operation unit, 400 ... Screen selection unit, 402 ... .Control CPU, 403... Memory, 500... RGB conversion circuit
An original image file portion in which a digital image equivalent to a digital image output from an electronic endoscope provided with an image sensor and input to an image processing circuit is stored;
A library section storing a plurality of image processing software, and
A selection unit that selects any one of the image processing software from the plurality of image processing software stored in the library unit;
In accordance with the selected image processing software, an image reproduction unit that processes the digital image stored in the original image file unit to be displayable,
An endoscopic image filing system.
The endoscopic image filing system according to claim 1, further comprising a display unit that displays the digital image processed by the image reproduction unit.
JP2007111485A 2007-04-20 2007-04-20 Endoscope image filing system Withdrawn JP2008264213A (en)
JP2007111485A JP2008264213A (en) 2007-04-20 2007-04-20 Endoscope image filing system
EP08007589A EP1982638A1 (en) 2007-04-20 2008-04-18 Endoscope image filing system
US12/105,920 US20080259406A1 (en) 2007-04-20 2008-04-18 Endoscope image filing system
JP2008264213A true JP2008264213A (en) 2008-11-06
ID=39705341
JP2007111485A Withdrawn JP2008264213A (en) 2007-04-20 2007-04-20 Endoscope image filing system
US (1) US20080259406A1 (en)
EP (1) EP1982638A1 (en)
JP (1) JP2008264213A (en)
EP2453376B1 (en) 2010-11-15 2019-02-20 Fujifilm Corporation Medical image recording/reproducing apparatus, medical image recording/reproducing method and program
CN103080972B (en) 2011-03-25 2016-11-23 奥林巴斯株式会社 Image management apparatus
2007-04-20 JP JP2007111485A patent/JP2008264213A/en not_active Withdrawn
2008-04-18 US US12/105,920 patent/US20080259406A1/en not_active Abandoned
2008-04-18 EP EP08007589A patent/EP1982638A1/en not_active Withdrawn
US20080259406A1 (en) 2008-10-23
EP1982638A1 (en) 2008-10-22
JP2009508567A (en) 2009-03-05 System and method for displaying a data stream
JP4569561B2 (en) 2010-10-27 Image file creation device
JPH0681614B2 (en) 1994-10-19 Electronic endoscope apparatus