# Patent

## Title
Automatic alignment of a contrast enhancement system

## Abstract

An apparatus and meted for insuring the proper alignment of a detected vein pattern, and a projected vein pattern are disclosed. The apparatus enhances the visual appearance of veins so that an error that can lead to improper patient bare or injury can be avoided.

## Background
CROSS REFERENCES TO RELATED APPLICATIONS
This application is a continuation of U.S. application Ser. No. 14/196,172, filed Mar. 4, 2014, which is a continuation of U.S. application Ser. No. 12/215,713, filed Jun. 27,2008, now issued as U.S. Pat. No. 8.730,321, which claims priority on U.S. Provisional Application Ser. No. 60/937,618, filed Jun. 28,2007, all disclosures of which are incorporated herein by reference.


SUMMARY OF THE INVENTION
An apparatus and method for insuring the proper alignment of a defected vein pattern and a projected vein pattern in a apparatus that enhances the visual appearance of veins so that an error that can lead to improper patient care or injury can be avoided.
BACKGROUND OF THE INVENTION
It is known in the art to use an apparatus to enhance the visual appearance of the veins and arteries in a patient to facilitate insertion of needles into those veins and arteries as well as other medical practices that require the identification of vein and artery locations. Such a system is described in U.S. Pat. Nos. 5,969,754 and 6,556,858 incorporated herein by reference as well as publication entitled “The Clinical Evaluation of Vein Contrast Enhancement”. Luminetx is currently marketing such a device under the name “Veinviewer Imaging System” and information related thereto is available on their website, which is incorporated herein by reference.
The Luminetx Vein Contrast Enhancer (hereinafter referred to as LVCE) utilizes a light source for flooding the region to be enhanced with near infrared light generated by an array of LEDs. A CCD imager is then used to capture an image of the infrared light reflected off the patient. The resulting captured image is then digitally enhanced and then projected by a visible light projector onto the patient in a position that must be closely aligned with position of the captured image. The practitioner uses this projected image to determine the position in which to insert a needle. Should the image be misaligned, the patient can be injured.



BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 shows an embodiment of a vein contrast enhancer.
FIG. 2 is a representation of a patient's arm.
FIG. 3 shows an embodiment of a laser contrast enhancer.



DETAILED DESCRIPTION OF THE INVENTION
As shown in FIG. 1, a typical embodiment of a vein contrast enhancer (VCE) 100 contains a camera 101 which is used to capture an image of a patient's body 105, a processing system (not shown) that enhances the image captured by the camera to highlight the positions of veins, and a projector 102 that shows an image of the enhanced vein pattern back onto the patient's body 105. Since the camera and projector are physically separate devices they reach the patient's body front different source points along different paths 103, 104. In some embodiments, the paths are made coaxial within the body of the VCE, however at some point the paths are separate since the devices (camera and projector) are physically separate devices. Since the purpose of a VCE is to allow the practitioner to insert a needle into the highlighted vein, it is critically important that the projected image and the actual vein location be aligned. Typically this alignment is done as a separate step in the use of the VCE. A card with a known pattern is placed with the viewing/projecting field of the VCE. This card has a florescent material applied to it so that when it is struck by green light, it emits infrared light that can be seen by the camera. This image is used to align the VCE.
This invention describes methods for achieving this alignment without requiring the operator to take a separate step.
Referring to FIG. 2, a representation of the patient's arm 201 is shown along with several veins. A bounding box is shown around a single vein 200. In FIG. 3, a schematic representation of the bounded area of the single vein is shown 305. Typically, the enhancement image will light up the area around the vein and will be dark on the vein. When properly aligned, the bright part of the image 300 will have edges that property align with the edges of the vein 303, 304. As previously described, the VCE will typically have an alignment mode wherein a known pattern, typically presented on an alignment card, will be placed in front of the VCE and an alignment will be performed. This alignment can either be automatically performed by the VCE or manually performed by the operator. The weakness of this kind of implementation is that it relies on the expectation that the alignment will be maintained over time. If the alignment should shift, patient injury can occur.
In a typical VCE, an infrared light source and a camera that is sensitive only to infrared light is used to detect the vein position. Furthermore, the projected image is often green in color to insure that the light from the projector is ignored since the camera is sensitive only to light near the infrared region. This selectivity can be implemented either with filters or with selectively sensitive camera elements.
Referring back to FIG. 3, in a typical LCE, the camera, by design, is blind to the projected light. In our invention, the camera is by design, able to selectively see the projected light. In a preferred embodiment, a multi-color capable projector is used. As usual, green is used to fill the area outside of the vein 500. That green projection goes to the edges of the vein position 303, 304 and the vein area itself is left dark. A camera that is sensitive to red and infrared light is used in this embodiment. In addition to the green fill, red lines are drawn at the edges of the veins 303, 304. Since the camera can see these red lines, the image enhancement software can look to see if the red lines are at the proper position and if needed automatic alignment can be performed. An alternative embodiment would be to paint a red line 306 down the middle of the vein position. An alternative embodiment would be to paint some pattern of red light over a desired portion of the vein.
Typically the cameras used in an LCE are monochrome and unable to discriminate between light of different wavelengths. Depending on the sensitivity of the camera and the brightness of the projector compared to the infrared flood lighting provided by the LCE, various techniques can be used to aid the camera in the detection of the red lines. One method is to simply look for the brightening caused by the addition of the red lines to the reflected infrared light. A second method is to periodically turn off the infrared lighting such that only ambient infrared and the projected red are seen by the camera. This can make it easier for the system to detect the red lines.
Although, we've described the invention using red and green limits, various combinations of colors can be used. Red and infrared light are known in the art to be useful for vein detection. Any combinations of colors of shorter wavelengths can be used for projection and alignment images as long as the camera selected is properly selected or filtered to achieve the desired discrimination between wavelengths. Furthermore, while discrimination between projection, detection and alignment signals in the preferred embodiment has been described using different wavelengths to separate the signals, in an embodiment with less freedom of projected color, time division can be used where the projected image is shown most of the time and the alignment image is shown interspersed on a lower duty cycle basis. Properly implemented, the alignment image will be quite visible to the VCE's camera, but invisible to the operator of the VCE.
Projectors in VCEs can be either monochrome (e.g., projecting green only) or multicolor (e.g., projecting RGB). The advantage of a monochrome implementation is that since an array of single color LEDs can be used in place of white bulbs and a color wheel typically found in a multicolor projector the system can be Of lower cost, generate less heat and have higher reliability. In such an embodiment, the time division scheme describe above would be appropriate. In this monochrome configuration, an alternative embodiment would be to add a smaller array of a second color of LEDs (i.e., red). This alignment array can be smaller than the projection array in that it doesn't need to be visible to the operator, just to the camera. The projection LEDs and the alignment LEDs could then be time multiplexed as previously described.

## Claims

1. A vein imaging system configured to ensure proper alignment of one or more detected veins and a visible projection of the one or more veins, said vein imaging system comprising:
a light source configured to illuminate a field of view with a first wavelength of light comprising an infrared wavelength, to create an image contrast formed by differential amounts of absorption and reflection of said first wavelength of light by the one or more veins and the surrounding tissue within the field of view;
an alignment card comprising a material formed into a pattern, said material configured to emit a second wavelength of light when positioned in said field of view and exposed to a third wavelength of light comprising a visible wavelength;
a camera configured to capture said image contrast:
a projector configured to project said captured image contrast onto the field of view using said third wavelength of light; wherein said camera is further configured to capture said second wavelength of light emitted by said pattern of material, and to capture said visible light at said third wavelength reflected from said pattern of material, said camera further configured to distinguish said third wavelength reflected by said pattern of material, from said second wavelength of light emitted by said pattern of said material; and
an image processing system configured to utilize said distinction between said captured reflection of said projected alignment card pattern at said third wavelength of light, and said captured second wavelength of emitted light from said alignment card pattern, to align said projected image with said reflected image contrast.

2. The system according to claim I wherein said material formed into said pattern for said alignment card comprises a fluorescent material.

3. The system according to claim 1 wherein said alignment card pattern comprises a known pattern.

4. The system according to claim 1 wherein said third wavelength of light comprises green light.

5. The system according to claim 4 wherein said green light is projected to fill the area in the field of view being outside of the veins of the vein pattern, and wherein said projected green light goes to the edges of the veins.

6. The system according to claim 5 wherein said second wavelength of light comprises a red wavelength of light.

7. The system according to claim 6 further comprising lime division projection of said wavelengths of light, wherein said visible third wavelength of light and said infrared wavelength are alternately projected.

8. The system according to claim 7 wherein said visible third wavelength of light is projected most of the time, and wherein said infrared wavelength is projected to be interspaced therebetween on a lower duly cycle.

9. The system according to claim 1 further comprising time division projection of said wavelengths of light, wherein said visible third wavelength of light and said infrared wavelength are alternately projected.

10. The system according to claim 9 wherein said visible third wavelength of light is projected most of the time, and wherein said infrared wavelength is projected to be interspaced therebetween on a lower duty cycle.

11. The system according to claim I wherein said light source is a light source from the group of light sources consisting of: a laser; and a light emitting diode (LED).

12. The system according to claim 1 wherein said camera and said projector are physically separated.

13. A method of ensuring proper aligning of a projected vein image with a captured vein image, said method comprising:
emitting a first wavelength of infrared light onto a field of view;
using a camera for capturing said first wavelength of infrared light reflected from the field of view as an image contrast formed by differential absorption and reflection by veins and surrounding tissue therein;
forming an alignment card, with a pattern using a selective material, with said selective material configured for emitting a second wavelength of light when exposed to a visible light at a third wavelength;
positioning said alignment card in the field of view;
projecting said captured image contrast onto the field of view using said visible light at said third wavelength;
using said camera for capturing: said second wavelength of light emitted by said pattern, and said pattern of visible light at said third wavelength reflected from the field of view;
comparing a position of said captured reflection of said pattern with said captured emission of said pattern; and
aligning said projection of said captured image contrast according to a positional difference between said compared positions of said reflection of said projected pattern and said emission from said pattern.

14. The method according to claim 13, further comprising projecting said image contrast using green light for said third wavelength, and using said green light for filling areas in the field of view being outside of the veins.

15. A method of ensuring proper aligning of a projected vein image with a captured vein image, said method comprising:
emitting an infrared wavelength of light onto a field of view;
using a camera for capturing said infrared light reflected from the field of view as a vein image contrast formed by differential absorption and reflection by veins and surrounding tissue therein;
projecting said veins in said captured image contrast onto the field of view using a visible wavelength of light:
using said camera for capturing said vein image contrast at said visible wavelength of light reflected from the field of view;
comparing a position of said captured reflection of said vein image contrast at said visible wavelength with said captured vein image contrast of said infrared wavelength; and
aligning said projection of said captured vein image contrast according to a positional difference between said captured reflection of said vein image contrast at said visible wavelength and said captured vein image contrast at said infrared wavelength.

16. The method according to claim 15, further comprising projecting said captured image contrast using green light for said visible wavelength, and using said green light for filling areas in the field of view being outside of the veins.