Fundus image capturing

An example device is configured to capture an image of an eye. The device includes a camera configured to capture the image of the eye. The device also includes: a first base configured to be moved along a first axis to position the camera to capture the image of the eye; a second base configured to be moved along a second axis to position the camera to capture the image of the eye; and a third base configured to be moved along a third axis to position the camera to capture the image of the eye.

This patent application is related to U.S. patent application Ser. No. 15/054,558 filed on Feb. 26, 2016, the entirety of which is hereby incorporated by reference.

INTRODUCTION

Diabetic retinopathy and other similar disease states can be diagnosed by studying an image of the retina. Retinal images can be reviewed manually by a clinician. However, manual review is labor-intensive process and subject to error.

For example, people with type 1 or type 2 diabetes can develop eye disease as a result of having diabetes. One of the most common diabetic eye diseases is diabetic retinopathy, which is damage to the blood vessels of the light-sensitive tissue at the back of the eye, known as the retina. Trained medical professionals use cameras during eye examinations for diabetic retinopathy screening. The cameras can produce images of the back of the eye, and trained medical professionals use those images to diagnose and treat diabetic retinopathy.

SUMMARY

In one aspect, an example device is configured to capture an image of an eye. The device includes a camera configured to capture the image of the eye. The device also includes: a first base configured to be moved along a first axis to position the camera to capture the image of the eye; a second base configured to be moved along a second axis to position the camera to capture the image of the eye; and a third base configured to be moved along a third axis to position the camera to capture the image of the eye.

DETAILED DESCRIPTION

FIG. 1is a schematic block diagram illustrating an example system100for recording and viewing an image of a patient's fundus. In this example, the system100includes a patient P, a fundus imaging system102, a computing device1800including an image processor106, a camera104in communication with the computing device1800, a display108in communication with the computing device1800and used by clinician C, and a network110. An embodiment of the example fundus imaging system102is shown and described in more detail below with reference toFIG. 2-25.

The fundus imaging system102functions to create a set of digital images of a patient's P eye fundus. As used herein, “fundus” refers to the eye fundus and includes the retina, optic nerve, macula, vitreous, choroid and posterior pole.

In this example, one or more images of the eye are desired. For instance, the patient P is being screened for an eye disease, such as diabetic retinopathy. The fundus imaging system102can also be used to provide images of the eye for other purposes, such as to diagnose or monitor the progression of a disease such as diabetic retinopathy.

The fundus imaging system102includes a handheld housing that supports the system's components. The housing supports one or two apertures for imaging one or two eyes at a time. In embodiments, the housing supports positional guides for the patient P, such as an optional adjustable chin rest. The positional guide or guides help to align the patient's P eye or eyes with the one or two apertures. In embodiments, the housing supports means for raising and lowering the one or more apertures to align them with the patient's P eye or eyes. Once the patient's P eyes are aligned, the clinician C then initiates the image captures by the fundus imaging system102.

One technique for fundus imaging requires mydriasis, or the dilation of the patient's pupil, which can be painful and/or inconvenient to the patient P. Example system100does not require a mydriatic drug to be administered to the patient P before imaging, although the system100can image the fundus if a mydriatic drug has been administered.

The system100can be used to assist the clinician C in screening for, monitoring, or diagnosing various eye diseases, such as hypertension, diabetic retinopathy, glaucoma and papilledema. The clinician C that operates the fundus imaging system102can be different from the clinician C evaluating the resulting image.

In the example embodiment100, the fundus imaging system102includes a camera104in communication with an image processor106. In this embodiment, the camera104is a digital camera including a lens, an aperture, and a sensor array. The camera104lens is a variable focus lens, such as a lens moved by a step motor, or a fluid lens, also known as a liquid lens in the art. The camera104is configured to record images of the fundus one eye at a time. In other embodiments, the camera104is configured to record an image of both eyes substantially simultaneously. In those embodiments, the fundus imaging system102can include two separate cameras, one for each eye.

In example system100, the image processor106is operatively coupled to the camera104and configured to communicate with the network110and display108.

The image processor106regulates the operation of the camera104. Components of an example computing device, including an image processor, are shown in more detail inFIG. 25, which is described further below.

The display108is in communication with the image processor106. In the example embodiment, the housing supports the display108. In other embodiments, the display connects to the image processor, such as a smart phone, tablet computer, or external monitor. The display108functions to reproduce the images produced by the fundus imaging system102in a size and format readable by the clinician C. For example, the display108can be a liquid crystal display (LCD) and active matrix organic light emitting diode (AMOLED) display. The display can be touch sensitive.

The example fundus imaging system102is connected to a network110. The network110may include any type of wireless network, a wired network, or any communication network known in the art. For example, wireless connections can include cellular network connections and connections made using protocols such as 802.11a, b, and/or g. In other examples, a wireless connection can be accomplished directly between the fundus imaging system102and an external display using one or more wired or wireless protocols, such as Bluetooth, Wi-Fi Direct, radio-frequency identification (RFID), or Zigbee. Other configurations are possible.

Referring now toFIGS. 2-12, the fundus imaging system102is shown. The fundus imaging system102includes a housing200that supports a display108at a first end and an opposite end204configured to engage one or both eyes of the patient P. As described herein, the fundus imaging system102can be used to implement one or more of the described methods for imaging of the fundus.

The housing200of example fundus imaging system102is sized to be handheld. The display108can display images of the eye and controls for capturing those images. In some embodiment, the display108can be a touchscreen. In embodiments, the housing200additionally supports one or more user input buttons near display108. The display108can be used to initiate the image capture sequence, as described herein. Thus, the fundus imaging system102is capable of being configured such that the clinician C can implement one or more automatic and/or manual workflows for the capture of images of the patient P's eyes.

As shown inFIGS. 4 and 11, the opposite end204of the housing200includes a surface402configured to engage the patient P's head. Specifically, the surface402is configured to be positioned again the patient P's head and to surround both eyes of the patient P. SeeFIG. 12. The camera104of the fundus imaging system102is positioned within a cavity404formed at the end204of the housing200. As described further below, the camera104is configured to be moved in at least three directions to accomplish imaging of the fundus of both eyes of the patient P as the housing200of the fundus imaging system102is held positioned against the patient P's head.

FIGS. 13-22illustrates internal components of the fundus imaging system102. As depicted, the fundus imaging system102includes an optical lens module410that is moved along multiple axes by a base assembly450.

As shown inFIG. 15, the optical lens module410is coupled by a mount422to the camera104to capture images of the fundus of the patient P's eyes. The optical lens module410includes an auto-focus mechanism412, a gear train414, and a motor416. These components are controlled by an autofocus controller418. The controller418is programmed to use the optical lens module410to automatically focus on the fundus of the patient P's eye once the fundus imaging system102is in position. At an opposite end of a barrel424of the optical lens module410is a lens420.

As shown inFIGS. 16-22, the base assembly450allows for movement of the optical lens module410within the housing200along multiple axes to position the optical lens module410for imaging of the fundus. The base assembly450generally includes an x-base452, a z-base470, and a p-base490.

As shown inFIG. 16, the x-base452allows for travel of the optical lens module410on railways454along an x-axis466. This can include travel up to 78 mm on the railways454along the x-axis466from a first end456to a second end458of the x-base452. A static lead screw460allows the z-base470to be driven along the lead screw460by a motor472, as shown inFIGS. 17-18.

Referring now toFIGS. 17-18, the z-base470includes bearings474that ride on the railways454of the x-base452to allow the z-base470to travel along the x-axis466. A traveling nut482engages the lead screw460and is driven by the motor472to allow the z-base470to travel along the railways454.

The z-base470includes a lead screw476that allows for travel of the optical lens module410along a z-axis480from a first end486to an opposite second end488of the lead screw476. This can include travel up to 30 mm on railways478of the z-base470along the z-axis480.

Referring now toFIGS. 19-22, the p-base490includes bearings492that ride on the railways478of the z-base452to allow the p-base490to travel along the z-axis480. A traveling nut498engages the lead screw476and is driven by a motor496to allow the p-base490to travel along the railways476from the first end486to the second end488of the lead screw476.

In this example, the fundus imaging system102also includes a y-pitch base500that allows the optical lens module410to be pitched in a y-pitch504about a bearing510along a y-axis502. In this example, the pitch allows for 10.55 mm of travel, which results in +4.08 degrees (FIG. 21) to −2.88 degrees (FIG. 22) of y-pitch504relative to a base axis of512. Various other travels and pitches can be achieved as desired.

Support arms522,524support the optical lens module410as the y-pitch base500pivots in the y-pitch504. A motor526drives a nut530including a ramped surface along a lead screw528to create the pitch. A spring532biases the y-pitch base500into the level (0 degree) pitch position. An optical sensor534senses a position of the y-pitch base500relative to the p-base490to determine the specific pitch of the y-pitch base500.

By providing movement along the x-axis466and the z-axis480(which is orthogonal to the x-axis466), the optical lens module410can be moved into position within the housing200of the fundus imaging system102to image both eyes while the fundus imaging system102is placed against the head of the patient. Further, the optical lens module410can be pitched about the y-axis502to allow for fine movement of the optical lens module410that more closely tracks the generally movement of the eye. Moving the optical lens module410along three axes (i.e., three-axis actuator) allows for better imaging of the fundus without requiring the caregiver C or the patient P to physically move the fundus imaging system102.

In some examples, the device is programmed to automatically move the camera into position along the three axes to capture the image. In such embodiments, the computing device1800is programmed to control the movement along the axes. Active eye tracking is used to position the camera relative to the eye. The system is programmed to monitor the infrared brightspot associated with a reflection of the cornea and automatically initiate capture of the image when the fundus is in the desired position relative to the camera. One example of such a system is described in U.S. patent application Ser. No. 15/009,988 filed on Jan. 29, 2016, the entirety of which is hereby incorporated by reference.

For example, referring toFIG. 23, a series of images700depict a progression of the fundus imaging system102into position for imaging of the fundus. A brightspot702, which is a reflection of light from a portion of the eye (i.e., the cornea), allows the fundus imaging system102to focus on the fundus for automatic imaging. The image or images are captured once the fundus imaging system102utilizes movement along the plurality of axes (x, y, z) to a position shown in image704for capture.

In manual configurations, the device is programmed to illustrate a target on the display of the device. The caregiver C can use controls on the display to move the camera along the axes to position the reflection from the cornea displayed on the display in the target. At that point, capture of the image can automatically be initiated. One example of such a system is described in U.S. patent application Ser. No. 15/054,558 filed on Feb. 26, 2016.

Referring now toFIG. 24, an example method600for capturing fundus images of the eyes is shown.

At operation602, the handheld device102is placed over the eyes against the head of the patient P by the caregiver C (or the patient P can place the device). Next, at operation604, the capture of the images is initiated. One example of such a workflow is provide in U.S. patent application Ser. No. 15/054,558 filed on Feb. 26, 2016. In one example, the caregiver C uses the display108to initiate the workflow for image capture. Alternatively, the workflow can be automatically initiated when the device102is placed against the patient P's head.

Next, at operation606, the camera104is moved along three axes (x, y, z) to position the camera104to capture images of the first eye. In one example, the device is programmed to automatically move the camera along the axes into position to capture the image(s). In another embodiment, the device is programmed to allow the caregiver C to manually move the camera along the three axes (e.g., using controls shown in the display) to position the camera to capture the image(s).

Once the image(s) of the first eye are complete, control is passed to operation608, and the camera104is moved along the x-axis within the device to be in position to capture images of the second eye. The camera104is thereupon moved along the three axes (x, y, z) to capture image(s) of the second eye. Again, this movement can be automatic or manual.

Finally, at operation610, the images captured by the device102are stored and/or analyzed.

FIG. 25is a block diagram illustrating physical components (i.e., hardware) of a computing device1800with which embodiments of the disclosure may be practiced. The computing device components described below may be suitable to act as the computing devices described above, such as wireless computing device and/or medical device ofFIG. 1. In a basic configuration, the computing device1800may include at least one processing unit1802and a system memory1804. Depending on the configuration and type of computing device, the system memory1804may comprise, but is not limited to, volatile storage (e.g., random access memory), non-volatile storage (e.g., read-only memory), flash memory, or any combination of such memories. The system memory1804may include an operating system1805and one or more program modules1806suitable for running software applications1820. The operating system1805, for example, may be suitable for controlling the operation of the computing device1800. Furthermore, embodiments of the disclosure may be practiced in conjunction with a graphics library, other operating systems, or any other application program and is not limited to any particular application or system. This basic configuration is illustrated inFIG. 25by those components within a dashed line1808. The computing device1800may have additional features or functionality. For example, the computing device1800may also include additional data storage devices (removable and/or non-removable) such as, for example, magnetic disks, optical disks, or tape. Such additional storage is illustrated by a removable storage device1809and a non-removable storage device1810.

As stated above, a number of program modules and data files may be stored in the system memory1804. While executing on the at least one processing unit1802, the program modules1806may perform processes including, but not limited to, generate list of devices, broadcast user-friendly name, broadcast transmitter power, determine proximity of wireless computing device, connect with wireless computing device, transfer vital sign data to a patient's EMR, sort list of wireless computing devices within range, and other processes described with reference to the figures as described herein. Other program modules that may be used in accordance with embodiments of the present disclosure, and in particular to generate screen content, may include electronic mail and contacts applications, word processing applications, spreadsheet applications, database applications, slide presentation applications, drawing or computer-aided application programs, etc.

The computing device1800may also have one or more input device(s)1812, such as a keyboard, a mouse, a pen, a sound or voice input device, a touch or swipe input device, etc. The output device(s)1814such as a display, speakers, a printer, etc. may also be included. The aforementioned devices are examples and others may be used. The computing device1800may include one or more communication connections1816allowing communications with other computing devices. Examples of suitable communication connections1816include, but are not limited to, RF transmitter, receiver, and/or transceiver circuitry; universal serial bus (USB), parallel, and/or serial ports.

Although the example medical devices described herein are devices used to monitor patients, other types of medical devices can also be used. For example, the different components of the CONNEX™ system, such as the intermediary servers that communication with the monitoring devices, can also require maintenance in the form of firmware and software updates. These intermediary servers can be managed by the systems and methods described herein to update the maintenance requirements of the servers.

Embodiments of the present invention may be utilized in various distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network in a distributed computing environment.

The block diagrams depicted herein are just examples. There may be many variations to these diagrams described therein without departing from the spirit of the disclosure. For instance, components may be added, deleted or modified.

While embodiments have been described, it will be understood that those skilled in the art, both now and in the future, may make various improvements and enhancements can be made.

The systems and method described herein result in a significant technical advantage. For example, the computing devices can be programmed to more efficiently capture fundus images. This allows the computing devices to accomplish an analysis of a greater number of images in a smaller amount of time.