Display system

An optical system has an aperture through which virtual and real-world images are viewable along a viewing axis. The optical system may be incorporated into a head-mounted display (HMD). By illuminating a viewing location with an infrared light source, an eye pupil may be illuminated. Infrared light is reflected from the viewing location and is collected with a proximal beam splitter. An image former is configured to reflect at least a portion of the visible light pattern generated by the display panel to form the virtual image and transmit at least a portion of the collected infrared light. The transmitted infrared light may be imaged by a camera. The HMD may use images from the camera to provide, for example, context-sensitive virtual images to a wearer.

BACKGROUND

Wearable systems can integrate various elements, such as miniaturized computers, input devices, sensors, detectors, image displays, wireless communication devices as well as image and audio processors, into a device that can be worn by a user. Such devices provide a mobile and lightweight solution to communicating, computing and interacting with one's environment. With the advance of technologies associated with wearable systems and miniaturized optical elements, it has become possible to consider wearable compact optical displays that augment the wearer's experience of the real world.

By placing an image display element close to the wearer's eye(s), an artificial image can be made to overlay the wearer's view of the real world. Such image display elements are incorporated into systems also referred to as “near-eye displays”, “head-mounted displays” (HMDs) or “heads-up displays” (HUDs). Depending upon the size of the display element and the distance to the wearer's eye, the artificial image may fill or nearly fill the wearer's field of view.

SUMMARY

In a first aspect, an optical system is provided. The optical system includes a display panel configured to generate a visible light pattern, a proximal beam splitter through which a field of view of a real-world environment and a virtual image are viewable from a viewing location, and an infrared light source configured to illuminate the viewing location with infrared light. The infrared light is reflected from the viewing location into the proximal beam splitter as collected infrared light. The optical system further includes an image former optically coupled to the proximal beam splitter, wherein the image former is configured to reflect at least a portion of the visible light pattern from the display panel to form the virtual image and to transmit at least a portion of the collected infrared light. The optical system further includes a camera optically coupled to the image former, wherein the camera is configured to image the viewing location using the collected infrared light transmitted through the image former.

In a second aspect, a head-mounted display is provided. The head-mounted display includes a head-mounted support and an optical system attached to the head-mounted support, wherein the optical system includes a display panel configured to generate a visible light pattern, a proximal beam splitter through which a field of view of a real-world environment and a virtual image are viewable from a viewing location, and an infrared light source configured to illuminate the viewing location with infrared light such that infrared light is reflected from the viewing location into the proximal beam splitter as collected infrared light. The optical system further includes an image former optically coupled to the proximal beam splitter, wherein the image former is configured to reflect at least a portion of the visible light pattern from the display panel to form the virtual image and to transmit at least a portion of the collected infrared light. The optical system further includes a camera optically coupled to the image former, wherein the camera is configured to image the viewing location using the collected infrared light transmitted through the image former. The head-mounted display further includes a computer, wherein the computer is configured to control the display panel and receive images of the viewing location obtained by the camera.

In a third aspect, a method is provided. The method includes generating a visible light pattern using a display panel and forming a virtual image from the visible light pattern using an image former, wherein the virtual image and a field of view of a real-world environment are viewable from a viewing location. The method further includes illuminating the viewing location with infrared light, collecting infrared light reflected from the viewing location, transmitting at least a portion of the collected infrared light through the image former, and imaging the viewing location using the collected infrared light transmitted through the image former.

DETAILED DESCRIPTION

A head-mounted display (HMD) may enable its wearer to observe the wearer's real-world surroundings and also view a displayed image, such as a computer-generated image. In some cases, the displayed image may overlay a portion of the wearer's field of view of the real world. Thus, while the wearer of the HMD is going about his or her daily activities, such as walking, driving, exercising, etc., the wearer may be able to see a displayed image generated by the HMD at the same time that the wearer is looking out at his or her real-world surroundings.

The displayed image might include, for example, graphics, text, and/or video. The content of the displayed image could relate to any number of contexts, including but not limited to the wearer's current environment, an activity in which the wearer is currently engaged, the biometric status of the wearer, and any audio, video, or textual communications that have been directed to the wearer. The images displayed by the HMD may also be part of an interactive user interface. For example, the HMD could be part of a wearable computing device. Thus, the images displayed by the HMD could include menus, selection boxes, navigation icons, or other user interface features that enable the wearer to invoke functions of the wearable computing device or otherwise interact with the wearable computing device.

The images displayed by the HMD could appear anywhere in the wearer's field of view. For example, the displayed image might occur at or near the center of the wearer's field of view, or the displayed image might be confined to the top, bottom, or a corner of the wearer's field of view. Alternatively, the displayed image might be at the periphery of or entirely outside of the wearer's normal field of view. For example, the displayed image might be positioned such that it is not visible when the wearer looks straight ahead but is visible when the wearer looks in a specific direction, such as up, down, or to one side. In addition, the displayed image might overlay only a small portion of the wearer's field of view, or the displayed image might fill most or all of the wearer's field of view. The displayed image could be displayed continuously or only at certain times (e.g., only when the wearer is engaged in certain activities).

The HMD may utilize an optical system to present virtual images overlaid upon a real-world view to a wearer. To display a virtual image to the wearer, the optical system may include a light source, such as a light-emitting diode (LED), that is configured to illuminate a display panel, such as a liquid crystal-on-silicon (LCOS) display. The display panel generates light patterns by spatially modulating the light from the light source, and an image former forms a virtual image from the light pattern.

The HMD may obtain data from the wearer in order to perform certain functions, for instance to provide context-sensitive information to the wearer. In an example embodiment, by using an infrared camera to record a wearer's pupil position and size, the HMD may obtain information regarding the wearer and the wearer's environment and respond accordingly. The HMD may use a pupil position recognition technique, wherein if the HMD recognizes that the wearer's pupil location is higher with respect to a neutral forward viewing axis, the HMD may display virtual images related to objects located above the wearer. Conversely, the HMD may recognize, by a similar pupil position recognition technique, that the wearer is looking downward. Accordingly the HMD may display virtual images related to objects located below the neutral forward viewing axis of the wearer. Further, if the HMD recognizes that the wearer's pupils are dilated, the HMD may reduce the brightness or adjust other aspects of the displayed virtual images.

In order to determine the actual position of a wearer's pupil, the infrared camera may image the pupil while the processor implements an image processing algorithm to find the edges or extents of the imaged pupil. The image processing algorithms may include pattern recognition, Canny edge detection, thresholding, contrast detection, or differential edge detection. Those skilled in the art will understand that many other image processing techniques could be used individually or in combination with others in order to obtain pupil location and size information. After image processing, the processor may act to adjust various components of the displayed virtual image. For instance, if the user is looking upwards into a clear night sky, the wearable computing device may detect the upward gaze due to pupil location, and control the display to show virtual highlights around and virtual information about various stars and nebulae. Furthermore, due to a dark ambient environment, a user's pupils may be dilated. The wearable computing device may detect this and adjust the virtual image contrast and brightness accordingly.

Certain illustrative examples of using an optical system and infrared light to view a viewing position are described below. It is to be understood, however, that other embodiments are possible and are implicitly considered within the context of the following example embodiments.

2. Optical System with Infrared Source, Camera and Image Former

FIG. 1is a functional block diagram100that illustrates a wearable computing device102, head-mounted display (HMD)104and various components that comprise the system. In an example embodiment, HMD104includes a see-through display. Thus, the wearer of wearable computing device102may be able to look through HMD104and observe a portion of the real-world environment of the wearable computing device102, i.e., in a particular field of view provided by HMD104. In addition, HMD104is operable to display images that are superimposed on the field of view, for example, to provide an “augmented reality” experience. Some of the images displayed by HMD104may be superimposed over particular objects in the field of view. However, HMD104may also display images that appear to hover within the field of view instead of being associated with particular objects in the field of view.

The HMD104may further include several components such as an infrared camera106, a user interface108, a processor110, optical system112, sensors114, a global positioning system (GPS)116, data storage118and a wireless communication interface120. These components may further work in an interconnected fashion. For instance, in an example embodiment, the infrared camera106may image one or both of the HMD wearer's eye pupils. The infrared camera106may deliver image information to the processor110, which may make a determination regarding the direction of HMD wearer's gaze. The wearable computing device102may further utilize sensors114and GPS116to gather contextual information based upon the environment and location of the HMD. By detecting the gaze direction of the wearer's eye(s), context-specific information may be presented to the wearer in various formats such as virtual images as well as audio and vibration cues from the user interface108. The individual components of the example embodiment will be described in more detail below.

HMD104could be configured as, for example, eyeglasses, goggles, a helmet, a hat, a visor, a headband, or in some other form that can be supported on or from the wearer's head. Further, HMD104may be configured to display images to both of the wearer's eyes, for example, using two see-through displays. Alternatively, HMD104may include only a single see-through display and may display images to only one of the wearer's eyes, either the left eye or the right eye.

The wearable computing device102may additionally include an infrared camera106that is configured to capture images of a point of view location associated with the HMD104. The infrared camera106may be configured to image the pupil of a HMD wearer that may be located at the point of view location. The images could be either video images or still images. The images obtained by infrared camera106regarding the wearer eye pupil location may help determine where the wearer is looking within the HMD field of view. The image analysis could be performed by processor110. The imaging of the point of view location could occur continuously or at discrete times depending upon, for instance, user interactions with the user interface108. Infrared camera106could be integrated into optical system112. Furthermore, infrared camera106could additionally represent a visible light camera with sensing capabilities in the infrared wavelengths.

The function of wearable computing device102may be controlled by a processor110that executes instructions stored in a non-transitory computer readable medium, such as data storage118. Thus, processor110in combination with instructions stored in data storage118may function as a controller of wearable computing device102. As such, processor110may control HMD104in order to control what images are displayed by HMD104. Processor110may also control wireless communication interface120and other components of the HMD system.

In addition to instructions that may be executed by processor110, data storage118may store data that may include a set of calibrated wearer eye pupil positions and a collection of past eye pupil positions. Thus, data storage118may function as a database of information related to gaze direction. Such information may be used by wearable computing device102to anticipate where the user will look and determine what images are to be displayed to the wearer by HMD104. Calibrated wearer eye pupil positions may include, for instance, information regarding the extents or range of the wearer's eye pupils movement (right/left and upwards/downwards) as well as wearer eye pupil positions that may relate to a neutral forward viewing axis. The neutral forward viewing axis may represent the axis defined wherein the wearer is looking straight ahead and may further represent a reference axis and thus a basis for determining dynamic gaze direction. Furthermore, information may be stored in data storage118regarding possible control instructions that may be enacted using eye movements. For instance, two consecutive wearer eye blinks may represent a control instruction directing a second camera (not depicted) associated with the HMD104to capture an image.

Wearable computing device102may also include a user interface108for displaying information to the wearer or receiving input from the wearer. User interface108could include, for example, the displayed virtual images, a touchpad, a keypad, buttons, a microphone, and/or other input devices. Processor110may control the functioning of wearable computing device102based on input received through user interface108. For example, processor110may utilize user input from the user interface108to control how HMD104displays images or what images HMD104displays.

In one example, the wearable computing device102may include a wireless communication interface120for wirelessly communicating with the internet and/or target objects near the HMD104. Wireless communication interface120could use any form of wireless communication that can support bi-directional data exchange over a packet network (such as the internet). For example, wireless communication interface120could use 3G cellular communication, such as CDMA, EVDO, GSM/GPRS, or 4G cellular communication, such as WiMAX or LTE. Alternatively, wireless communication interface120could communicate with a wireless local area network (WLAN), for example, using WiFi. Alternatively, wireless communication interface120could be established using an infrared link, Bluetooth, or ZigBee. The wireless communications could be uni-directional or bi-directional with respect to the internet or a target object.

Wearable computing device102may further include an optical system112that is configured to display virtual images to a wearer. Optical system112is described in detail below.

AlthoughFIG. 1shows various components of HMD104, i.e., wireless communication interface120, processor110, data storage118, infrared camera106, sensors114, GPS116, and user interface108, as being integrated into HMD104, one or more of these components could be mounted or associated separately from HMD104. For example, infrared camera106could be mounted on the user separate from HMD104. Thus, wearable computing device102could be provided in the form of separate devices that can be worn on or carried by the wearer. The separate components that make up wearable computing device102could be communicatively coupled together in either a wired or wireless fashion.

FIG. 2illustrates a top view of an optical system200that is configured to display a virtual image superimposed upon a real-world scene viewable along a viewing axis204. For clarity, a distal portion232and a proximal portion234represent optically-coupled portions of the optical system200that may or may not be physically separated. An example embodiment includes a display panel206that may be illuminated by a light source208. Light emitted from the light source208is incident upon the distal beam splitter210. The light source208may include one or more light-emitting diodes (LEDs) and/or laser diodes. The light source208may further include a linear polarizer that acts to pass one particular polarization to the rest of the optical system.

In an example embodiment, the distal beam splitter210is a polarizing beam splitter that reflects light depending upon the polarization of light incident upon the beam splitter. To illustrate, s-polarized light from the light source208may be preferentially reflected by a distal beam-splitting interface212towards the display panel206. The display panel206in the example embodiment is a liquid crystal-on-silicon (LCOS) display, but could also be a digital light projector (DLP) micro-mirror display, or other type of reflective display panel. The display panel206acts to spatially-modulate the incident light to generate a light pattern. Alternatively, the display panel206may be an emissive-type display such as an organic light-emitting diode (OLED) display or a transmissive liquid crystal display (LCD) with a backlight; in such cases, distal beam splitter210and light source208may be omitted.

In the example in which the display panel206is a LCOS display panel, the display panel206generates a light pattern with a polarization perpendicular to the polarization of light initially incident upon the panel. In this example embodiment, the display panel206converts incident s-polarized light into a light pattern with p-polarization. The generated light pattern from the display panel206is directed towards the distal beam splitter210. The p-polarized light pattern passes through the distal beam splitter210and is directed along an optical axis214towards the proximal region of the optical system200. In an example embodiment, the proximal beam splitter216is also a polarizing beam splitter. The light pattern is at least partially transmitted through the proximal beam splitter216to the image former218. In an example embodiment, image former218includes a concave mirror230and a proximal quarter-wave plate228. The light pattern passes through the proximal quarter-wave plate228and is reflected by the concave mirror230.

The reflected light pattern passes back through proximal quarter-wave plate228. Through the interactions with the proximal quarter-wave plate228and the concave mirror230, the light patterns are converted to the s-polarization and are formed into a viewable image. This viewable image is incident upon the proximal beam splitter216and the viewable image is reflected from proximal beam splitting interface220towards a viewing location222along a viewing axis204. A real-world scene is viewable through a viewing window224. The viewing window224may include a linear polarizer in order to reduce stray light within the optical system. Light from the viewing window224is at least partially transmitted through the proximal beam splitter216. Thus, both a virtual image and a real-world image are viewable to the viewing location222through the proximal beam splitter216.

AlthoughFIG. 2depicts the distal portion232of the optical system housing as to the left of the proximal portion234of the optical system housing when viewed from above, it is understood that other embodiments are possible to physically realize the optical system200, including the distal portion232being configured to be to the right, below and above with respect to the proximal portion234. Further, although an example embodiment describes an image former218as comprising a concave mirror230, it is understood by those skilled in the art that the image former218may comprise a different optical element, such as an optical lens or a diffractive optic element.

In one embodiment, the proximal beam splitter216, the distal beam splitter210, and other components of optical system200are made of glass. Alternatively, some or all of such optical components may be partially or entirely plastic, which can also function to reduce the weight of optical system200. A suitable plastic material is Zeonex® E48R cyclo olefin optical grade polymer which is available from Zeon Chemicals L.P., Louisville, Ky. Another suitable plastic material is polymethyl methacrylate (PMMA).

An example embodiment may include an infrared light source226that is configured to illuminate the viewing location222. AlthoughFIG. 2depicts the infrared light source226as adjacent to viewing window224, those skilled in the art will understand that the infrared light source226could be located elsewhere, such as on the side of the proximal beam splitter216that is adjacent to the viewing location222or in the distal portion232of the optical system200. The infrared light source226may represent, for example, one or more infrared light-emitting diodes (LEDs). Infrared LEDs with a small size may be implemented, such as the Vishay Technology TSML1000product.FIG. 3is a graph illustrating a variation of relative radiant power of an infrared source with respect to wavelength, in accordance with an example embodiment.

Further, those skilled in the art will understand that, for best eye-tracking accuracy, it may be advantageous to obtain infrared images of the eye pupil using light sources that illuminate the eye from positions off-axis and/or on-axis with respect to the viewing axis204. Therefore, the infrared light source226may include one or more LEDs located at different locations in the optical system200.

Infrared light generated from the infrared light source226is configured to be incident upon the viewing location222. Thus, the wearer's eye pupil may be illuminated with the infrared light. The infrared light may be reflected from the wearer's eye back along the viewing axis204towards the proximal beam splitter216. A portion of the reflected infrared light may be reflected from the beam splitting interface220towards the image former218.

In order to transmit infrared light to an infrared camera202, the image former218may include a dichroic thin film configured to selectively reflect or transmit incident light depending upon the wavelength of the incident light. For instance, the dichroic thin film may be configured to pass infrared light while reflecting visible light. In an example embodiment, the visible light pattern generated by the display panel206may be reflected by the concave mirror230and the visible light pattern may be formed into a viewable image. The infrared light may thus be preferably transmitted through the concave mirror230to infrared camera202. Dichroic thin film coatings are available commercially from companies such as JML Optical Industries and Precision Glass & Optics (PG&O) and comprise multiple layers of dielectric and/or metal films. These dichroic coatings are also called ‘cold mirrors’.FIG. 4is a graph illustrating a variation of percentage reflectance with respect to wavelength, in accordance with an example embodiment. The graph represents example spectral reflectance characteristics for a dichroic thin film that may coat the concave mirror230.

In an example embodiment, a small aperture or apertures may be introduced into the image former218, which may be realized by one or more pinholes (e.g., a central pinhole) in the concave mirror230. In this example embodiment, most of the visible and infrared light is reflected off of and formed by the image former218into an image viewable by the HMD wearer. Some of the visible and infrared light passes through the aperture and is incident upon the infrared camera202. The infrared camera202may selectively filter and detect the infrared light from the combination of visible and infrared light to obtain information regarding the wearer's eye pupil location. Alternatively, the infrared light source226may be modulated to provide a frequency reference for a lock-in amplifier or phase-locked loop in order that the infrared light signal is obtained efficiently. Also, the visible light source208may be modulated and infrared light detection could be performed when the visible light source208is off, for example. Those with skill in the art will understand that there are other variations of transducing an infrared light signal mixed with a visible light signal with an infrared camera and that those variations are included implicitly in this specification.

3. Head-mounted Display with Infrared Eye-Tracking Optical System

FIG. 5Apresents a front view of a head-mounted display (HMD)300in an example embodiment that includes a head-mounted support309.FIGS. 5B and 5Cpresent the top and side views, respectively, of the HMD inFIG. 5A. Although this example embodiment is provided in an eyeglasses format, it will be understood that wearable systems and HMDs may take other forms, such as hats, goggles, masks, headbands and helmets. The head-mounted support309includes lens frames314and316, a center frame support318, lens elements310and312, and extending side-arms320and322. The center frame support318and side-arms320and322are configured to secure the head-mounted support309to the wearer's head via the wearer's nose and ears, respectively. Each of the frame elements314,316, and318and the extending side-arms320and322may be formed of a solid structure of plastic or metal, or may be formed of a hollow structure of similar material so as to allow wiring and component interconnects to be internally routed through the head-mounted support309. Alternatively or additionally, head-mounted support309may support external wiring. Lens elements310and312are at least partially transparent so as to allow the wearer to look through them. In particular, the wearer's left eye308may look through left lens312and the wearer's right eye306may look through right lens310. Optical systems302and304, which may be configured as shown inFIG. 2, may be positioned in front of lenses310and312, respectively, as shown inFIGS. 5A,5B, and5C. Optical systems302and304may be attached to the head-mounted support309using support mounts324and326, respectively. Furthermore, optical systems302and304may be integrated partially or completely into lens elements310and312, respectively.

Although this example includes an optical system for each of the wearer's eyes, it is to be understood that a HMD might include an optical system for only one of the wearer's eyes (either left eye308or right eye306). As described inFIG. 2, the HMD wearer may simultaneously observe from optical systems302and304a real-world image with an overlaid virtual image. The HMD may include various elements such as a HMD computer340, a touchpad342, a microphone344, and a button346. The computer340may use data from, among other sources, various sensors and cameras to determine the virtual image that should be displayed to the user. In an example embodiment, as described earlier, an infrared light source or sources may illuminate the viewing position(s)308and306, i.e. the wearer's eye(s), and the reflected infrared light may be preferentially collected with an infrared camera.

Those skilled in the art would understand that other user input devices, user output devices, wireless communication devices, sensors, and cameras may be reasonably included in such a wearable computing system.

FIG. 6depicts side and front views of an eye as well as schematic drawings of pupil location information. One way to determine gaze direction of a person is to determine the position of the person's pupil with respect to a neutral forward viewing axis. To track eye pupil movements, infrared light is reflected off of a person's eye. The reflected light may be collected and detected with an infrared detector. Image processing can then be conducted with a processor110in order to determine the extents and centroid location of the person's pupil. For instance, in an example embodiment400, a person may be looking directly forward. The eyelid403is open and the pupil404/410is located centrally with respect to a reference axis412. After image processing, which may include edge detection, the position of the pupil may be determined to be at pupil location414. In this embodiment, the determined pupil location414coincides with a neutral forward viewing axis. Virtual image display position and context may be adjusted due to the determined pupil location414.

In an example embodiment401, a person may be looking upwards with respect to a neutral forward viewing axis. In this situation, imaging the person's eye with infrared light may result in a determined pupil position428that is above the neutral forward viewing axis. Virtual images may be displayed above a person's normal field of view and contextual information regarding target objects above a person's normal field of view may be displayed.

In an example embodiment402, a person may be looking downwards with respect to a neutral forward viewing axis. The determined pupil position442may be determined by imaging the person's eye and may be further found to be below a neutral forward viewing axis. Thus, contextual information about target objects including virtual images may be displayed for target objects below the neutral forward viewing axis of the person.

FIG. 7depicts side and front views of an eye as well as schematic drawings of pupil size information. One way to determine the ambient light level of a scene is to determine the diameter of a person's eye pupil who may be looking at the scene. In order to determine the diameter of a pupil, infrared light may be reflected off of a person's eye. The reflected light may be collected and detected with an infrared detector. Image processing can then be conducted with a processor110in order to determine the extents and thus the diameter of the person's pupil. For instance, in an example embodiment500, a person may be looking directly forward and may exhibit a relatively small diameter pupil. The eyelid504is open and the pupil506/512is located centrally with respect to a reference axis514. After image processing, which may include edge detection, the position of the pupil may be determined to be at pupil location516with a given pupil diameter. Due to a relatively small diameter pupil, the brightness or contrast of the virtual image may be adjusted assuming a bright ambient light level.

Similarly, in an example embodiment502, a person may exhibit a relatively large diameter pupil. After imaging and image processing, the size and thus the diameter of the pupil may be determined. Due to a relatively large diameter pupil, the brightness or contrast of the virtual image may be adjusted assuming a dark ambient light level.

Further functions of an infrared eye-tracking system may include the recognition of various blink and eye-movement-based commands or control instructions. For instance, image recognition algorithms could recognize a succession of blinks as a command. In an example embodiment, two successive blinks with one eye within half a second may represent a command to take a picture using a second camera on the HMD.

Additionally, an eye-tracking system may allow enhanced functionality when interacting with a user interface of the HMD or of a target object. For instance, if a HMD wearer is looking at an electronic word processing document and the wearable computing device determines that the person is looking at words near the bottom of the user interface, the wearable computing device may automatically scroll the text upwards within the user interface so the person does not need to physically scroll down the page with a mouse wheel.

4. Method in an Optical System of Collecting and Imaging Infrared Light from a Viewing Location

FIG. 8illustrates an example method600for an optical system to collect and image infrared light from a viewing location. It is to be understood that the steps may appear in different order and steps may be added or subtracted. In a first step602, a visible light pattern is generated using a display panel. The display panel could be a component in an optical system similar to optical systems302and304. In a second step604, a virtual image is formed from the visible light pattern using an image former. The image former could include a quarter wave plate228and concave mirror230that may act together to form the virtual image. The method includes a third step606wherein the viewing location is illuminated with infrared light. The viewing location may coincide with where a HMD wearer's eye is located while wearing the HMD. The infrared light may be emitted from one or more sources, such as one or more infrared LEDs. Furthermore, infrared light may be incident upon the viewing location from multiple locations. That is, infrared light may be incident towards the viewing location along a viewing axis204as well as along other axes.

A fourth step608includes collecting infrared light reflected from the viewing location. As discussed above, infrared light reflected from the wearer's eye may be passed back into the optical system through the proximal beam splitter216. A portion of the infrared light light may be reflected off of the proximal beam splitting interface220and transmitted towards the image former218.

A fifth step610includes transmitting at least a portion of the collected infrared light through the image former. The image former218may comprise a concave mirror230with a dichroic thin film coating to selectively transmit infrared light and selectively reflect visible light. The image former218may alternatively or additionally include an aperture through which visible and infrared light may be transmitted. In both of these situations, infrared light is transmitted through the image former218.

A sixth step612includes imaging the viewing location using the collected infrared light transmitted through the image former. In order to image the viewing location, light may be detected using an infrared camera202sensitive to infrared light. The infrared camera may convey video or still images to the processor110. These images may be used to form the basis of a dynamically updated database of the wearer's eye pupil and its position.

CONCLUSION

The above detailed description describes various features and functions of the disclosed systems, devices, and methods with reference to the accompanying figures. While various aspects and embodiments have been disclosed herein, other aspects and embodiments will be apparent to those skilled in the art. The various aspects and embodiments disclosed herein are for purposes of illustration and are not intended to be limiting, with the true scope and spirit being indicated by the following claims.