ARTIFICIAL EYE SYSTEM

A lens assembly includes an optical element having an outward-facing surface with a cornea-shaped contour. The lens assembly includes a housing that carries an optical element. The housing at least partially houses an image sensor. The image sensor is positioned to receive image light from the optical element. The lens assembly is an artificial eye system that may be used to mimic a human eye while operating or testing a head-mounted display.

TECHNICAL FIELD

This disclosure relates generally to optics and in particular to optical calibration systems for head-mounted displays.

BACKGROUND INFORMATION

Virtual reality (“VR”) and augmented reality (“AR”) systems and applications continue to expand in availability and in use. As these technologies transition from the recreational industry to educational, manufacturing, and other industries, the importance of quality assurance is increasing. Poor visibility or inaccurate sensing can lead to a poor user experience or to operator error, which may be detrimental to user engagement (in education) or may lead to poor yield quality (in manufacturing). Simply placing a camera behind a VR or AR system is an inadequate solution because information displayed in VR/AR can depend on more than just the presence of a user near a system.

DETAILED DESCRIPTION

Embodiments of an optical calibration system and artificial eye system are described herein. In the following description, numerous specific details are set forth to provide a thorough understanding of the embodiments. One skilled in the relevant art will recognize, however, that the techniques described herein can be practiced without one or more of the specific details, or with other methods, components, materials, etc. In other instances, well-known structures, materials, or operations are not shown or described in detail to avoid obscuring certain aspects.

In aspects of this disclosure, visible light may be defined as having a wavelength range of approximately 380 nm-700 nm. Non-visible light may be defined as light having wavelengths that are outside the visible light range, such as ultraviolet light and infrared light. Infrared light having a wavelength range of approximately 700 nm-1 mm includes near-infrared light. In aspects of this disclosure, near-infrared light may be defined as having a wavelength range of approximately 700 nm-1.4 μm.

In aspects of this disclosure, the term “transparent” may be defined as having greater than 90% transmission of light. In some aspects, the term “transparent” may be defined as a material having greater than 90% transmission of visible light.

Virtual reality (“VR”) and augmented reality (“AR”) systems can provide rich, engaging, and realistic user experiences by adapting displayed content to a user's gaze. A user's gaze can be described as the orientation of a user's eye(s). Some eye tracking systems use the cornea, pupil, and/or iris of an eye to track where the eye is oriented. When an eye's orientation changes from being directed at a center of a display to being directed to an upper-left, lower-right, or some other location on a display, an eye tracking system can detect the change in orientation and cause a VR/AR system to update a display accordingly.

With millions of VR/AR headsets being manufactured and sold on a quarterly basis, manual testing of each device is impractical. However, merely replacing a human tester with a static camera is insufficient. To confirm the responsiveness of the VR/AR display and the quality of displayed images, an optical calibration system is needed that enables eye tracking functionality while concurrently capturing user-perspective visual information.

Implementations of the present disclosure include an artificial eye system having a lens that is shaped like the cornea of a human eye. The artificial eye system also includes a housing, a camera system to capture image light from the lens, and an iris structure positioned between the lens and camera system, according to an embodiment. The housing for the lens may include a cornea region (which encloses the lens) and a sclera region. The artificial eye system may be mounted to an orientation stage that repositions the artificial eye system into various orientations. With these features, the artificial eye system simulates human eye properties and behaviors to support eye tracking system operations and VR/AR testing.

In implementations of this disclosure, the lens of the artificial eye system has an outward facing surface that has a cornea-shaped contour. The cornea-shaped contour may be aspherical. The cornea-shaped contour may be spherical and have a radius that is different than a radius of the sclera region of the housing. The lens may be attached to or integrated with the cornea region of the housing. The lens may operate like a human cornea to focus light to the camera system to enable the camera system to capture images in a manner similar to how a human eye might perceive the images. The lens focuses image light through a pupil opening that is formed in the iris structure. The iris structure may include a slightly-reflective matte-finish that mimics properties of an iris of a human eye. The pupil may be an entrance pupil for the camera system.

The camera system may include an image sensor and an optical system. The image sensor is configured to convert received image light into image data. The optical system may include one or more optical elements (e.g., lenses) positioned between the pupil and the image sensor to focus light onto the image sensor. The camera system may be coupled to the housing to rotate in alignment with the lens, pupil, and housing.

In implementations of this disclosure, the artificial eye system is incorporated into an optical calibration system to operate with a head-mounted display (“HMD”). The optical calibration system includes the HMD, the artificial eye system, an orientation controller, and processing logic. The HMD may include a display and an eye tracking system, among other components. The display projects image light of images or information that may be based on an orientation of the artificial eye system. The eye tracking system may be used to determine the orientation of the artificial eye system and provide orientation information to the processing logic. The processing logic may compare a known orientation of the artificial eye system (e.g., set by the orientation controller) against the received orientation that is determined by the eye tracking system. Comparing known orientation against measured orientation may facilitation calibration of the camera system and/or the eye tracking system. The artificial eye system (and camera system) may then be used to execute quality assurance testing on HMDs in a production environment, with image data that may be similar to what a human eye may perceive.

These and other embodiments are described in more detail in connection withFIGS.1-6.

FIG.1illustrates an optical calibration system100that is configured to monitor, calibrate, and test head-mounted display systems, in accordance with embodiments of the disclosure. Optical calibration system100includes an artificial eye system102that is coupled to processing logic104and that is configured to receive image light from a display106, according to an embodiment. The artificial eye system102resolves deficiencies in traditional optical calibration systems by incorporating a lens, pupil, and housing that resemble a human eye.

Artificial eye system102is a lens assembly including a number of components configured to receive image light and convert the image light into image data. Artificial eye system102includes a lens108, a camera system110, and an iris structure112that is positioned between lens108and camera system110. Artificial eye system102also includes a housing114configured to carry lens108, iris structure112, and/or camera system110, according to an embodiment.

Lens108is configured to be shaped like part of a human eye to mimic light transmission properties of a cornea of a human eye. Lens108includes an outward surface116that is shaped like the cornea of a human eye. Outward surface116is an outward facing surface that receives light (e.g., image light) from outside artificial eye system102. Outward surface116is a concave surface. A contour of outward surface116includes a cornea shape that may be aspherical or that may be spherical. Lens108also includes an inward surface118that is configured to transmit image light to camera system110. Inward surface118may be straight, convex, and/or concave to transmit light through iris structure112to camera system110, according to an embodiment.

Camera system110is positioned proximate to lens108to receive image light from lens108. Camera system110is configured to convert the image light into image data120. Camera system110may output image data120to, for example, processing logic104for analysis. Camera system110may be positioned within housing114. Camera system110may be mounted to, carried by, or structurally supported by housing114. Camera system110may be partially enclosed by housing114or may be fully enclosed by housing114.

Camera system110includes an image sensor122and an optical system124for generating image data120from image light received from lens108. Image sensor122may be a complementary metal oxide semiconductor (“CMOS”) image sensor or a charge-coupled device (“CCD”) image sensor. Image sensor122includes an array of pixels that are each responsive to photons received from lens108through iris structure112. In one embodiment, image sensor122has image sensor pixels having a pixel pitch of one micron or less. The pixel resolution of image sensor122may vary depending on the application. In one embodiment, image sensor122is 1920 pixels by 1080 pixels. In one embodiment, image sensor122is a 40 megapixel or greater image sensor. In one embodiment, image sensor122includes processing logic (e.g., a system on a chip (“SOC”) that facilitates communication with processing logic104or other components within optical calibration system100. The processing logic of image sensor122enables image sensor122to receive, capture, and/or convert image light into, for example, image data120.

Optical system124is optically coupled to image sensor122and is positioned between image sensor122and lens108. Optical system124may include one or more lenses aligned and configured to receive image light from lens108and to focus the image light onto image sensor122. In one embodiment, optical system124includes 2, 5, 9, or some other number of lenses or other optical elements that are optically coupled between image sensor122and lens108. Camera system110is coupled to processing logic104via communications channel126A. Camera system110uses communications channel126A to communicate with, transfer image data120to, and/or receive operational commands from processing logic104.

Artificial eye system102includes iris structure112positioned between lens108and camera system110to define a pupil129for image light to pass through, according to an embodiment. Iris structure112is formed at least partially within housing114and is circular or ring-shaped within housing114. Iris structure112mimics an iris of a human eye. Pupil129of iris structure112is an opening or aperture within iris structure112that allows image light to pass from an inward surface118of lens108to camera system110. Pupil129defines an entrance opening or an entrance pupil to camera system110. Iris structure112includes a finish that replicates characteristics of a human eye. The finish of the iris structure112is a semi-reflective matte finish that may have a color of grey, black, brown, blue, green, red, or some other color that mimics or resembles a human eye. By fabricating iris structure112to be semi-reflective and have a color of a human eye, artificial eye system102facilitates testing and calibration of eye tracking systems and other head mounted display features, according to an embodiment.

Artificial eye system102uses housing114to carry, align, and/or orient various components of artificial eye system102. Housing114is fabricated to approximate the size of a human eye, according to one embodiment. Housing114is at least partially fabricated in the shape and dimensions of the human eye to enable artificial eye system102to mimic functions of a human eye interacting with display106and other systems within optical calibration system100.

Housing114includes a cornea region128and a sclera region130. The cornea region128houses and/or carries lens108. Cornea region128of housing114may be coupled to lens108with an adhesive, may be fused to lens108(e.g., with heat), or may be fabricated as a single uninterrupted unit that includes lens108, according to various implementations. Cornea region128of housing114is fabricated in the shape of a cornea and has a contour that is at least partially human-eye cornea-shaped. Cornea region128is aspherical and is fabricated according to the aspherical shape of a human cornea. As the human cornea may individually vary in height and diameter, cornea region128may be manufactured according to different specifications to model various types of eyes (e.g., children, elderly, middle-aged adults, diseased, etc.). Sclera region130may be fabricated to be spherical and may be fabricated with an average human eye diameter. Sclera region130may be fabricated with a diameter of 24 mm or fabricated with a diameter in the range of 22 mm-27 mm. In other implementations, sclera region130is fabricated to a diameter that aligns with the size of the cornea region128. Cornea region128and sclera region130are manufactured to be translucent and are manufactured from optical quality glass, according to an embodiment. In one embodiment, cornea region128is fabricated from optical quality glass, while a portion of sclera region130is fabricated from glass. Part of sclera region130may be manufactured from plastic, may be opaquely colored, or maybe fabricated to facilitate insertion and removal of camera system110.

Housing114includes a transition region132that defines a boundary between cornea region128and sclera region130. Transition region132includes curvature that smoothly transitions from the aspherical shape of cornea region128to the spherical shape of sclera region130. Transition region132is ring-shaped or oval-shaped around cornea region128. The smoothness of transition region132is fabricated to mimic the transition between a cornea region and a sclera region of a human eye, and transition region132facilitates calibration of the eye tracking system of optical calibration system100.

Optical calibration system100may use display106to provide display image light134to artificial eye system102, according to an embodiment. Display106projects virtual reality (“VR”) images, augmented reality (“AR”) images, mixed-reality (“XR”) images, or other optical information through display image light134. Display106may be driven by optical engine136, which may be configured to drive holographic waveguide images onto display106. Display106may be opaque and configured to block outside image light138, according to one embodiment. Display106may be implemented as a transparent display receives and passes outside image light138. Display106may combine outside image light138with display image light134into combined image light140, which is transmitted to artificial eye system102for reception and processing.

Display106may be mounted within and carried by a head-mounted display system142. Head-mounted display (“HMD”) system142may include a frame144that carries display106. Head-mounted display system142may include a lens146that receives outside image light138and transmits outside image light138into or through display106, to, at least partially, generate combined image light140. Head-mounted display system142may include support148, which may be implemented as earpieces of eyeglasses or head straps. Head-mounted display system142may also carry and include an eye tracking system150, which may include cameras, sensors, and/or light sources. Eye tracking system150may be positioned onto frame144, support148, lens146, or other portions of head-mounted display system142. Eye tracking system150may be communicatively coupled and/or optically coupled to display106through a communication channel126B.

Optical calibration system100is configured to position artificial eye system102in a variety of orientations to mimic eye positioning and eye motion of a user interacting with head-mounted display system142, according to an embodiment. Optical calibration system100includes an orientation stage154and an orientation controller156to rotate and orient artificial eye system102. Orientation stage154is mounted to artificial eye system102. Orientation stage154may carry or suspend artificial eye system102. Orientation stage154may be fabricated using transparent or opaque brackets or a structure that is at least partially shaped like sclera region130to mate with at least a portion of housing114. Orientation stage154may be glued, screwed, fused, adhered, or otherwise coupled to housing114. Orientation stage154may include motors, gears, and controllers to rotate artificial eye system102, up, down, left, and right to enable artificial eye system102to receive display image light134or combined image light140from a number of different orientations.

Orientation controller156is physically coupled between orientation stage154and processing logic104, to receive instructions from processing logic104and to position orientation stage154. Orientation controller156is communicatively coupled to orientation stage154through communication channel126C, and orientation controller156is communicatively coupled to processing logic104through communication channel126D, according to an embodiment. Orientation controller156includes logic that enables orientation controller156to translate commands from processing logic104into electric signals (e.g., pulses, voltage levels, and/or digital signals) used by orientation stage154to rotate or orient artificial eye system102, according to an embodiment.

Processing logic104communicates with various components of optical calibration system100to facilitate calibration of camera system110, artificial eye system102, display106, and/or head-mounted display system142. Processing logic104may be communicatively coupled to provide instructions to and receive information from image sensor122, optical engine136, display106, eye tracking system150, and/or orientation controller156through communication channels126A,126E,126F,126G, and126D, respectively. Communication channels126A-G may be collectively referenced as communication channels126. In some implementations, one or more of optical engine136, orientation controller156, or portions of eye tracking system150may be integrated within processing logic104.

FIG.2includes a flow diagram of a process200for operating optical calibration system100, according to an embodiment.

At operation202, processing logic104may be configured to set an orientation of artificial eye system102by positioning orientation stage154. Processing logic104may set an orientation of artificial eye system102by sending one or more commands to orientation controller156. The initial orientation set by processing logic104may be an orientation that is believed to be a ground zero, home, or origin position from which camera system110may receive combined image light140from display106. Operation202proceeds to operation204, according to an embodiment.

At operation204, processing logic104may be configured to set display106to output display data as image light. Initially, display data may generate calibration image light of an image that includes a number of shapes at the origin and/or at the corners of display106. Predetermined shapes, such as diamonds, rectangles, and circles, may be located at specific locations within the image displayed, so that the locations of the shapes being output can be compared to locations of the shapes received by image sensor122. Comparing predetermined data to captured data can be used to facilitate aligning and calibrating camera system110and display106. Operation204proceeds to operation206, according to an embodiment.

At operation206, processing logic104may be configured to receive image light and generate image data120from image light using image sensor122. Operation206proceeds to operation208, according to an embodiment.

At operation208, processing logic104may be configured to compare display data with image data. Processing logic104may compare display data with image data to determine how well aligned camera system110is with display106. Processing logic104may be configured to perform a pixel by pixel comparison of display data with image data. Processing logic104may be configured to perform a relative comparison of the location of objects (e.g., shapes, images, etc.) of the display data with objects captured in the image data. Operation208proceeds to operation210, according to an embodiment.

At operation210, processing logic104may be configured to determine data differences. If differences are detected between display data and image data, operation210may proceed to operation212. If processing logic104does not detect significant differences (e.g., at least 10 pixel difference) between display data and image data, operation210may proceed to operation214, according to an embodiment.

At operation212, processing logic104may be configured to calibrate display106or adjust an orientation of artificial eye system102. Calibrating display106or adjusting the orientation of artificial eye system102may include re-positioning artificial eye system102, up, down, left, or right in order to cause objects in the display data to align with objects in the received image data. After an adjustment to display106or of artificial eye system102, operation212proceeds back to operation206, according to an embodiment.

At operation214, processing logic104may be configured to change orientation of artificial eye system102, change display data displayed by display106, or change both the orientation and the display data. Processing logic104may be configured to adjust the orientation or display data within optical calibration system100to capture additional images from, for example, an upper left-hand corner, an upper right-hand corner, a lower left-hand corner, a lower right-hand corner of display106or of head-mounted display system142, according to various embodiments.

In addition to determining alignment between display106and image sensor122, process200may include operations for testing and/or calibrating eye tracking system150. For example, processing logic104may set an orientation of artificial eye system102, may read an eye orientation from eye tracking system150, and may compare the intended orientation of artificial eye system102with the orientation captured or determined by eye tracking system150.

As discussed in connection withFIG.1andFIG.2, optical calibration system100may employ lens108(having a cornea shape) and artificial eye system102to test and interact with various features of a head-mounted display system142. Once alignment of artificial eye system102(e.g., lens108and/or camera system110) is determined or confirmed, various user interfaces may be displayed and tested on head-mounted display system142. In a production environment, several pre-determined test images, user interfaces, and/or programs may be run on additional head-mounted displays, and artificial eye system102may be used to assure the quality of components such as HMD lenses, displays, and tracking systems.

FIGS.3A,3B,3C, and3Dillustrate various embodiments of artificial eye system102.

FIG.3Aillustrates an artificial eye system300, according to an embodiment. Artificial eye system300is an example implementation of artificial eye system102(shown inFIG.1), according to an embodiment. Artificial eye system300illustrates specific examples of features and dimensions related to cornea region128and to sclera region130. Cornea region128includes a diameter302. Diameter302may differ for different implementations of artificial eye system300. For example, implementations of artificial eye system300that model a child, adult, or a diseased eye can each have a different diameter of a cornea region128. Diameter302is in a range of 11 mm to 16 mm. Diameter302is fabricated to be 15 mm, in an embodiment. Diameter302may be a vertical diameter, and cornea region128may have a horizontal diameter in a range of 11 mm to 16 mm and that may be different than the vertical diameter.

Artificial eye system300includes addition dimensions between pupil129and other surfaces. Artificial eye system300includes a housing-to-pupil distance304, a lens entrance-to-pupil distance306, and a lens exit-to-pupil distance308. Housing-to-pupil distance304is a distance from pupil129(from the plane formed by the outward surface of the iris structure) to the center of the outward facing surface of cornea region128of housing301. Housing-to-pupil distance304may be in a range of 2 mm to 5 mm. Lens entrance-to-pupil distance306is a distance from a center of outward surface116of lens108to the center of pupil129. Lens entrance-to-pupil distance306may be in a range of 1.5 mm to 4.5 mm. Lens exit-to-pupil distance308is a distance from the center of inward surface118of lens108to the center of pupil129. Lens exit-to-pupil distance308may be in a range of 0 mm to 2 mm. In embodiments where lens108is integrated into cornea region128of housing301, housing-to-pupil distance304may be the same length as lens entrance-to-pupil distance306.

Pupil129is fabricated with a diameter310. Various implementations of artificial eye system300may be fabricated with different values for diameter310of pupil129. Diameter310is fabricated to be 5 mm, in one implementation. However, to model an actual human eye, diameter310may be manufactured to be in the range of 2 mm to 8 mm, to simulate capturing image data with a variety of bright and low-light pupil dilation values.

Iris structure312is an example implementation of iris structure112(shown inFIG.1). Iris structure312is fabricated and attached to housing301. Iris structure312is positioned between lens108and camera system110. Iris structure312includes an opening that defines pupil129. Iris structure312includes an iris layer313that is fabricated or disposed onto iris structure312to mimic optical properties of a human iris. Iris layer313may include a matte finish, may be semi-reflective, and may be implemented with one or more eye colors (e.g., grey, brown, black, blue, green, hazel, or some combination thereof). Iris layer313is disposed on iris structure312on a surface of iris structure312that is proximate to and oriented towards lens108. In other words, iris layer313is disposed on an outward facing surface316of iris structure312.

Housing301of artificial eye system300may include cornea region128and a portion of sclera region130. The partially enclosing housing301may partially enclose camera system110but may be physically coupled to orientation stage154with attachments314. Attachments314may include an attachment314A and an attachment314B. Attachment314A may be implemented as a bracket and that physically couples orientation stage154to, for example, sclera region130of housing301. Attachment314B may be implemented as a bracket that physically carries and couples camera system110to orientation stage154. Attachments314may be implemented with opaque and/or translucent materials such as polymer, glass, metal, or the like.

FIG.3Billustrates an artificial eye system320, according to an embodiment. Artificial eye system320may be one implementation of artificial eye system102, according to an embodiment. Artificial eye system320includes a housing322that is fabricated to at least partially enclose camera system110. Artificial eye system320includes attachments324that couple camera system110to housing322. Attachments324include an upper attachment324A coupled between an upper region326of housing322and camera system110. Attachments324may include an attachment324B that is coupled between camera system110and a lower region328of housing322. Cornea region128may define a cavity330between housing322and outward surface316of iris structure312. Cavity330includes lens108to mimic optical properties of the human eye. Cavity330may be at least partially filled with a fluid sac332. Fluid sac332may be filled with water, saline, or another fluid that replicates optical properties of the human eye.

FIG.3Cillustrates an artificial eye system340that is an implementation of artificial eye system102, according to an embodiment. Artificial eye system340includes a housing342that is at least partially rectangular and that is fabricated from planar materials to support portions of artificial eye system340. As illustrated, attachments324(inclusive of324A and324B) are disposed between housing342and camera system110to carry, support, and couple camera system110to housing342, according to an embodiment.

Artificial eye system340includes a hot mirror344disposed over cornea region128of housing342, according to an embodiment. Hot mirror344reflects infrared light and passes visible light. Hot mirror344is a coating that is applied over at least part of cornea region128of housing342. Reflecting infrared light may enable eye tracking systems to externally determine an orientation of artificial eye system340, which may enable alignment and performance verification of eye tracking systems, camera system110, and the orientation controller.

FIG.3Dillustrates a front view of artificial eye system360, which may be an implementation of artificial eye system102, according to an embodiment.

FIGS.4A,4B, and4Cillustrate embodiments of different shapes of cornea regions for an artificial eye system.FIG.4Aillustrates an artificial eye system400having a cornea region402that has a height404that is relatively low. Height404is a distance from the plane of an outward surface406of an iris structure408to outward surface410of cornea region402. Height404may be defined from a center of pupil129to a center of cornea region402. In this low-profile embodiment, height404may be fabricated to be 2 mm. Height404may be fabricated to be in a range of 1.5 mm to 2.5 mm.

FIG.4Billustrates an artificial eye system420having a cornea region422with a height424. In this mid-profile embodiment, height424may be fabricated to be 3 mm. Height424may be fabricated to be in a range of 2.5 mm to 3.5 mm.

FIG.4Cillustrates an artificial eye system440having a cornea region442with a height444. In this high-profile embodiment, height444may be fabricated to be 4 mm. Height444may be fabricated to be in a range of 3.5 mm to 4.5 mm, or greater.

FIG.5Aillustrates an example HMD500that may be used in optical calibration system100(shown inFIG.1), in accordance with an embodiment of the disclosure. HMD500includes frame514coupled to arms511A and511B. Lenses521A and521B are mounted to frame514. Lenses521may be prescription lenses matched to a particular wearer of HMD or non-prescription lenses. The illustrated HMD500is configured to be worn on or about a head of a user of the HMD.

InFIG.5, each lens521includes a waveguide550(individually,550A and550B) to direct image light generated by a display530to an eyebox area for viewing by a wearer of HMD500. Display530may include an LCD, an organic light emitting diode (OLED) display, micro-LED display, quantum dot display, pico-projector, or liquid crystal on silicon (LCOS) display for directing image light to a wearer of HMD500.

The frame514and arms511of the HMD500may include supporting hardware of HMD500. HMD500may include any of processing logic, wired and/or wireless data interface for sending and receiving data, graphic processors, and one or more memories for storing data and computer-executable instructions. In one embodiment, HMD500may be configured to receive wired power. In one embodiment, HMD500is configured to be powered by one or more batteries. In one embodiment, HMD500may be configured to receive wired data including video data via a wired communication channel. In one embodiment, HMD500is configured to receive wireless data including video data via a wireless communication channel.

Lenses521may appear transparent to a user (or to artificial eye system102) to facilitate augmented reality or mixed reality where a user (or to artificial eye system102) can view scene light (or outside image light) from the environment around her while also receiving display image light directed to her eye(s) by waveguide(s)550. Consequently, lenses521may be considered (or include) an optical combiner. In some embodiments, image light is only directed into one eye of the wearer of HMD500. In an embodiment, both displays530A and530B are included to direct image light into waveguides550A and550B, respectively.

The example HMD500ofFIG.5includes an array of infrared emitters (e.g., infrared LEDs)560disposed around a periphery of lens521B in frame514. The infrared emitters emit light in an eyeward direction to illuminate an artificial eye system102A and102B (collectively, artificial eye system102) with infrared light. In one embodiment, the infrared light is centered around850nm. Infrared light from other sources may illuminate the eye as well. The infrared light may reflect off the eye and be received by a Fresnel reflector selectively coated with a hot mirror and configured to direct and focus the reflected infrared light to camera547. Camera547may be mounted on the inside of the temple of HMD500. The images of the artificial eye system102captured by camera547may be used for eye-tracking purposes.

FIG.5Billustrates an example head-mounted display570that may be used in optical calibration system100(shown inFIG.1), in accordance with an embodiment of the disclosure. HMD570includes a viewing structure572. Hardware of viewing structure572may include any of processing logic, wired and/or wireless data interface for sending and receiving data, graphic processors, and one or more memories for storing data and computer-executable instructions. In one embodiment, viewing structure572may be configured to receive wired power. In one embodiment, viewing structure572is configured to be powered by one or more batteries. In one embodiment, viewing structure572may be configured to receive wired data including video data. In one embodiment, viewing structure572is configured to receive wireless data including video data.

HMD570includes a top structure574, a rear securing structure576, and a side structure578attached to viewing structure572. HMD570is configured to be worn on a head of a user of the HMD. In one embodiment, top structure574includes a fabric strap that may include elastic. Side structure578and rear securing structure576may include a fabric as well as rigid structures (e.g., plastics) for securing the HMD to the head of the user. HMD570may optionally include earpiece(s)580configured to deliver audio to the ear(s) of a wearer of HMD570.

Viewing structure572may include an OLED display for directing image light to artificial eye system102(shown inFIG.1). Viewing structure572may also include a GPU and processing logic that includes one or more processors, microprocessors, multi-core processors, Application-specific integrated circuits (ASIC), and/or Field Programmable Gate Arrays (FPGAs) to execute display, VR, AR, or XR operations. In some embodiments, memory may be integrated into the processing logic to store instructions to execute operations and/or store data. Processing logic may also include analog or digital circuitry to perform the operations in accordance with embodiments of the disclosure.

FIG.6illustrates a process for operating an artificial eye system, according to an embodiment of the disclosure. The order in which some or all of the process blocks appear in process600should not be deemed limiting. Rather, one of ordinary skill in the art having the benefit of the present disclosure will understand that some of the process blocks may be executed in a variety of orders not illustrated, or even in parallel.

In block602, process600receives, with an image sensor, image light from an optical element, wherein the optical element includes an outward surface having a cornea-shaped contour that directs image light onto the image sensor, according to an embodiment. Block602proceeds to block604, according to an embodiment.

In block604, process600converts, with the image sensor, the image light to image data, according to an embodiment. Block604proceeds to block606, according to an embodiment.

In block606, process600outputs the image data from the image sensor, according to an embodiment.

The term “processing logic” (e.g., processing logic104) in this disclosure may include one or more processors, microprocessors, multi-core processors, Application-specific integrated circuits (ASIC), and/or Field Programmable Gate Arrays (FPGAs) to execute operations disclosed herein. In some embodiments, memories (not illustrated) are integrated into the processing logic to store instructions to execute operations and/or store data. Processing logic may also include analog or digital circuitry to perform the operations in accordance with embodiments of the disclosure.

A “memory” or “memories” (e.g.,160) described in this disclosure may include one or more volatile or non-volatile memory architectures. The “memory” or “memories” may be removable and non-removable media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules, or other data. Example memory technologies may include RAM, ROM, EEPROM, flash memory, CD-ROM, digital versatile disks (DVD), high-definition multimedia/data storage disks, or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information for access by a computing device.

Communication channels126may include or be routed through one or more wired or wireless communication utilizing IEEE 802.11 protocols, Bluetooth, SPI (Serial Peripheral Interface), I2C (Inter-Integrated Circuit), USB (Universal Serial Port), CAN (Controller Area Network), cellular data protocols (e.g. 3G, 4G, LTE, 5G), optical communication networks, Internet Service Providers (ISPs), a peer-to-peer network, a Local Area Network (LAN), a Wide Area Network (WAN), a public network (e.g. “the Internet”), a private network, a satellite network, or otherwise.

A computing device may include a desktop computer, a laptop computer, a tablet, a phablet, a smartphone, a feature phone, a server computer, or otherwise. A server computer may be located remotely in a data center or be stored locally.