Patent Description:
The present disclosure relates to adaptive illumination using light emitting diodes (LEDs) in combination with a metalens to provide adaptive light sources, for example for camera flash, virtual reality (VR), or augmented reality (AR) systems.

The term "light emitting diode" as used in this description is intended to include laser diodes (e.g., vertical cavity surface emitting lasers, VCSELs) as well as light emitting diodes that are not lasers. The high efficiency of LEDs compared to conventional filament lightbulbs and florescent lights as well as improved manufacturing capability has led to their vastly increased use in a wide range of lighting applications. The compact nature, low power, and controllability of LEDs has likewise led to their use as light sources in a variety of electronic devices such as cameras and smart phones.

<CIT> discloses a prior art adaptive lighting system using metalens collimators.

An adaptive lighting system comprises an array of independently controllable LEDs, and a metalens positioned to collimate, focus, or otherwise redirect light emitted by the array of LEDs. The adaptive lighting system as defined in appended independent claim <NUM> includes a pre-collimator positioned in the optical path between the array of LEDs and the metalens.

These and other embodiments, features and advantages of the present invention will become more apparent to those skilled in the art when taken with reference to the following more detailed description of the invention in conjunction with the accompanying drawings that are first briefly described.

The following detailed description should be read with reference to the drawings, in which identical reference numbers refer to like elements throughout the different figures. The drawings, which are not necessarily to scale, depict selective embodiments and are not intended to limit the scope of the invention.

An array of independently operable LEDs may be used in combination with a lens, lens system, or other optical system to provide adaptive illumination, that is, illumination that may be varied in intensity, color, direction, and/or spatial location depending for example on characteristics of objects or a scene to be illuminated. Such adaptive illumination is increasingly important for automotive, mobile device camera, VR, and AR applications. In these applications the dimensions, especially the height of the light source and associated optics (e.g., lenses), may be an important design parameter.

In mobile devices such as smart phones or tablets, it may be desirable to have cameras provide different fields of view, varying between <NUM>° and <NUM>° for instance for a smart phone. An adaptive illumination unit matching such a field of view should optimize light throughput while fitting into a limited volume. A lens used for such illumination does not need to have perfect imaging properties since resolution specifications are not as high as required for imaging applications. Efficiency is preferred over traditional imaging quality characteristic performance parameters such as those based on a modulation transfer functions.

This disclosure describes adaptive lighting systems comprising an LED array in combination with a metalens. As further described below, a metalens comprises a nanostructured surface (a metasurface) or a nanostructured structure (metastructure) designed to perform a lens-like function (e.g., act as a converging lens). Advantageously, a metalens may have a thin flat geometry, which facilitates a compact device design. The LED array may comprise independently operable discrete LEDs arranged as an array. Alternatively, the LED array may comprise one or more segmented monolithic LEDs in which the segments may be independently operable as LEDs. By "segmented monolithic LED" this disclosure refers to a monolithic semiconductor diode structure in which trenches passing partially but not entirely through the semiconductor diode structure define electrically isolated segments. The electrically isolated segments remain physically connected to each other by portions of the semiconductor structure.

<FIG> shows a cross-sectional view of an example adaptive lighting system <NUM> comprising an LED array <NUM> disposed in a housing <NUM>. In the illustrated example LED array <NUM> is a monolithic LED device comprising independently operable LED segments S11, S12, S13, S14, and S15. A metalens <NUM> attached to housing <NUM> redirects (for example, collimates or focuses) light rays <NUM> emitted by the LED array. Adaptive lighting system <NUM> may provide illumination over a field of view of, for example, about <NUM>° to about <NUM>°, or to about <NUM>°.

<FIG> shows a top view of LED array <NUM>, which in this example comprises <NUM> independently operable LED segments arranged in a square <NUM> x <NUM> array and identified by their location in the array by row and column as S(row, column) running from S11 to S55. More generally, LED array <NUM> may be for example a rectangular array or may approximate a non-rectangular (e.g., circular or oval) shape. Any suitable sized array may be used, for example a <NUM> x <NUM> array, a <NUM> x <NUM> array (as shown), a <NUM> x <NUM> array, or a <NUM> x <NUM> array. The LED segments in the array can be of the same size, or of different sizes. For example, the central segment could be chosen to be larger than peripheral segments. The array may have dimensions in the plane of the array of, for example, about <NUM> x <NUM> to about <NUM> x <NUM>.

The LED segments in array <NUM> may have dimensions in the plane of the array of, for example, about <NUM> microns to about <NUM> microns. The segments may be separated from their closest neighbors by, for example, <NUM> microns or more. The segments may be positioned within a distance of each other sufficient to both present a substantially uniform visual appearance and to provide a substantially uniform light beam. This distance can be selected so that the segments are separated by no more than a Rayleigh limit distance calculated for a user at a normal distance from the light source.

Each segment in LED array <NUM> may be a single color, with different segments emitting different colors (e.g., some segments emitting white light and other segments emitting red light). Different color segments can be interleaved. Segments of the same color may be grouped. Groups of one color of segment may be interleaved with groups of other colors. Independent operation of the segments allows the color of light emitted by the array to be tuned.

Each segment comprises a semiconductor light emitting diode, and optionally a wavelength converting structure that absorbs light emitted by the semiconducting light emitting diode and emits light of a longer wavelength. The semiconductor light emitting diodes maybe formed for example from II-VI, III-V, or other semiconductor material systems and may be configured to emit, for example, ultraviolet, visible, or infrared light, depending on the application.

The wavelength converting structures include one or more wavelength converting materials which may be, for example, conventional phosphors, ceramic phosphors, organic phosphors, quantum dots, organic semiconductors, II-VI or III-V semiconductors, II-VI or III-V semiconductor quantum dots or nanocrystals, dyes, polymers, or other materials that luminesce. Phosphor or other wavelength converting materials may be dispersed as luminescent particles in a binder material such as a silicone, for example, to form a wavelength converting structure. The wavelength converting structure may include light scattering or light diffusing elements, such as for example TiO<NUM>. The wavelength converting structures may be a monolithic element covering multiple or all semiconductor light emitting diodes in an array, or may be structured into separate segments, each attached to a corresponding semiconductor light emitting diode. Gaps between these separate segments of the wavelength conversion structure may be filled with optically reflective material to confine light emission from each segment to this segment only.

In operation of adaptive lighting system <NUM>, individual segments in LED array <NUM> may be operated to provide illumination adapted for a particular purpose. For example, adaptive lighting system <NUM> may provide illumination that varies by color and/or intensity across an illuminated scene or object and/or is aimed in a desired direction. A controller can be configured to receive data indicating locations and color characteristics of objects or persons in a scene and based on that information control LED array <NUM> to provide illumination adapted to the scene. Such data can be provided for example by an image sensor, or optical (e.g. laser scanning) or non-optical (e.g. millimeter radar) sensors.

For an application such as a flash, for example, the total emitted optical power of the LEDs may be, for example, about <NUM> W to about <NUM> W.

Referring again to <FIG>, metalens <NUM> may be planar, as shown, and may have dimensions significantly larger than those of the LED array as measured in a plane parallel to the plane of the LED array. For example, metalens <NUM> may be <NUM> to <NUM> times the size of the LED array. The metalens is designed such that all light emitted from a specific LED segment in the LED array reaches a predefined region in the far field.

The field of view illuminated by adaptive lighting system <NUM> may be controlled by selecting the number and location of LEDs in array <NUM> that are operated to provide the illumination. In case a small field of view is needed, for instance <NUM>°, only the central LED segments might be needed, while for a large field of view (for instance <NUM>°) all LED segments could be switched on.

As noted above, metalens <NUM> is or comprises one or more metasurfaces or metastructures arranged so that metalens <NUM> functions as a lens, e.g., it focuses, collimates, or otherwise redirects rays of light incident on it from the LED array. Metalens <NUM> may function as a converging lens, for example. Metasurfaces are surfaces in which physical structure and/or chemical composition vary on a length scale that is typically less than a micron, i.e., they are nanostructured. Similarly, metastructures are structures in which physical structure and/or chemical composition vary on a length scale typically less than a micron. Metasurfaces and metastructures may be designed to provide particular optical functions and effects.

Metalens <NUM> comprises at least a first array of nano-scale antennas (nanoantennas) arranged, for example, as a metasurface in a plane parallel to the plane of the LED array. Each nanoantenna typically has dimensions in the plane of the array less than or equal to a free space wavelength of light emitted by the LED array. The nanoantennas have structural, chemical, and/or optical properties that vary with the spatial location of the nanoantennas to affect phase and amplitude of light emitted by the LED array through the metalens in a spatially varying manner that focuses, collimates, or otherwise redirects the light emitted by the LED array.

For example, the nanoantennas may be arranged to form nano-gratings in concentric rings about a central optical axis of the metalens. The width of each concentric ring in the plane of the metalens decreases as a function of radial distance from the central optical axis. Towards the outer edge of the metalens, the width of each ring can be for example in the range of <NUM> - <NUM> while towards the center of the metalens the width can be for example <NUM> - <NUM>. The spacing between nanoantennas also changes as a function of the radial position with nanoantennas towards the edges arranged with a pitch of, for example, <NUM> - <NUM> and nanoantennas toward the center arranged with a pitch is closer to <NUM>. That is, the pitch may decrease with increasing radial distance from the central axis.

The nanoantennas may be or comprise structures having pillar (nano-cylinder) shapes, for example. For example, metalens <NUM> may comprise one or more periodic arrays of pillars having diameters between for example about <NUM> and about <NUM> and heights between for example about <NUM> and <NUM> or between about <NUM> and <NUM> micron. The height is chosen as a design parameter to optimize system performance, chromatic aberration and efficiency. The pitch (center to center spacing) between rods may for be for example between <NUM> and <NUM>, which leaves a minimum gap between pillars of <NUM>. Such nanopillars may be arranged to form nano-gratings in concentric rings about a central optical axis of the metalens, as described above, with the long axes of the pillars arranged perpendicularly to the plane of the array.

Alternatively, the nanoantennas may be or comprise structures having fin shapes, for example. Such fin shaped nanoantennas (nanofins) may be for example similar in shape to pillars as described above but have flattened cross-sections perpendicular to their long axes. Such nanofins may be arranged similarly to the arrangements of nanopillars described above. A metalens comprising nanofins may be designed to be polarizing, that is, to preferentially transmit light of a particular linear polarization.

The height of the metalens can be reduced to the height of the nanoantennas (e.g., nanopillars or nanofins). This is substantially thinner than conventional imaging optics which typically have a thickness of <NUM> or more. For an imaging optic, such as a camera-flash lens, the periodic array may be disposed on a substrate that is spaced apart from the LED array. As noted above, for a camera flash lens the modulation transfer function may be less important than the illuminance which makes metalenses a suitable choice. Also, for a camera flash lens the requirement for chromatic aberration will be less stringent than for a true imaging application. The efficiency, however, will be an important parameter leading to large optics with highest possible numerical aperture (NA).

<FIG> shows an example of a possible arrangement of pillars <NUM> in an array of nanoantennas in a metasurface <NUM> in a metalens. Nanofins could be similarly arranged. The metasurface <NUM> is made up of a periodic arrangement of unit cells (e.g., 155A, 155B) with each unit cell comprising one or more pillars. In the simplest case, the unit cell consists of a single individual pillar. However, to improve color uniformity and to correct color aberration, the unit cell can consist of more than one pillar. For example, the unit cell can consist of three nanocylinders placed in a triangular lattice. Pillars within a unit cell can have cross-sections that are, for example, circular, elliptical, square, or rectangular.

Referring again to <FIG>, in the illustrated example metalens <NUM> comprises a transparent substrate <NUM> (sapphire, for example) having a planar top surface 130T facing away from the LED array and a bottom surface 130B facing the LED array. An array of nanoantennas may be arranged as a metasurface on surface 130T, on surface 130B, or on surface 130T and on surface 130B to provide the desired lens function.

The placement of arrays of nanoantennas on both sides of the substrate can help with multiple aspects of the metalens design: <NUM>) improving the efficiency by pre-collimating the incident light thereby increasing efficiency of the system by reducing the NA of the lens, and <NUM>) improve the imaging system performance by offering avenues to correct aberration and color uniformity. Bending a beam at large angles is often less efficient than at lower angles. Having arrays of nanoantennas on both sides of the substrate may improve the efficiency, especially for the edges where large angles of deflection are needed.

In one variation, metalens <NUM> comprises arrays of nanoantennas on both sides 130T and 130B of the substrate near edges of the metalens where large deflection angles are needed, and an array of nanoantennas on only one side of the substrate (130T or 130B) in the central region of the metalens where the beam deflection is moderate.

To maximize efficiency an antireflective coating can be deposited on surfaces of substrate <NUM> on which there are no metastructures. For example, a porous low index layer or a multi-layer stack can be used to improve the incoupling of light. Other potential modifications include the deposition of a low index material in between the pillars to improve the mechanical robustness of the module. For a pure imaging optic, the recirculation of light should be avoided. Some recirculation for a flash lens could however be advantageous to increase efficiency. To this end additional scattering coatings can be applied.

Referring now to example adaptive lighting system <NUM> shown in <FIG>, to further maximize efficiency a pre-collimator <NUM> may be added to the adaptive lighting system shown in <FIG>. Pre-collimator <NUM> narrows down the angular emission of the LED array light source such that metalens <NUM> can be optimized and operate most effectively. This, in turn, should offer improvements in both power efficiency and light steering control, as well as a reduction in area of the lens up to <NUM>%. Pre-collimator <NUM> may, for example, comprise a transparent substrate <NUM> (sapphire, for example) having a planar top surface 160T facing away from the LED array and a bottom surface 160B facing the LED array. An array of nanoantennas (pillars or fins as described above, for example) may be arranged as a metasurface on surface 160T, on surface 160B, or on surface 160T and on surface 130B to provide the desired pre-collimating function. Note that the overall thickness of adaptive lighting system <NUM> need not be greater than that of adaptive lighting system <NUM> of <FIG>, provided that the target focal length distance without collimator is larger than the substrate thickness of the pre-collimator (neglecting metasurface thickness, i.e. <=<NUM>).

An important factor in obtaining high efficiency, low loss metalenses and pre-collimators is the choice of materials for the nanoantennas and the way they are prepared. Using materials that have a high refractive index and low absorptive loss improves performance. The refractive index and absorptive loss can depend on the way the material is prepared. Suitable materials for the nanoantennas may include, but are not limited to, niobium pentoxide, gallium nitride, silicon nitride, titanium dioxide, or hafnium oxide.

Metalenses as described herein are preferably prepared using sputtering (physical vapor deposition) or chemical vapor deposition to form a homogenous layer of the nanoantenna material. Gallium nitride (GaN), niobium pentoxide (Nb<NUM>O<NUM>), and silicon nitride are suitable materials to be used in this approach. For these materials immersion DUV, or alternatively nanoimprinting patterning techniques, can be subsequently used to pattern the layer to form nanoantenna arrays, followed by anisotropic etching in which a hard mask may be used to have a defined etch stop, leading to a well-defined layer thickness (e.g., pillar or fin height).

A less preferable approach is to write a pattern with e-beam lithography into a e-beam resist, and then subsequently fill the pattern with niobium pentoxide using atomic layer deposition (ALD). Due to the nature of the resist, the ALD can only be performed at low temperature and this has consequences for the refractive index of the material. It is known that niobium pentoxide prepared by ALD has a refractive index at <NUM> below <NUM>, while bulk niobium pentoxide has a refractive index of <NUM>. In contrast, niobium pentoxide formed by physical or chemical vapor deposition may have an index of refraction of <NUM> very close to the bulk value. This makes the sputtering approach preferable.

Further, with respect to losses by absorption the low temperature ALD growth approach is not optimal. Titanium Oxide (TiO<NUM>) grown at <NUM> has an absorption (k) of about <NUM> and a refractive index of <NUM>. For sputter-coated niobium pentoxide the refractive index is <NUM> as noted above and the absorption (k) is <NUM>, more than a factor of <NUM> lower than for titanium pentoxide, while the refractive index is similar. In addition, titanium oxide can be photocatalytic and may for that reason be disfavored. Also, for the ALD approach excess material must be etched away, there is no stop layer, and how much is etched just depends on the time, which leads to worse control over nanoantenna (e.g., pillar or fin) height.

<FIG> shows a cross-sectional view of an example adaptive lighting system <NUM> comprising an LED array <NUM>, a pre-collimator <NUM>, and a metalens <NUM>. Metalens <NUM> comprises a metasurface 505T disposed on a top surface of a substrate <NUM> and a metasurface 505B disposed on a bottom surface of substrate <NUM>. LED array <NUM> is disposed on a substrate <NUM> in a cavity <NUM> defined by side reflectors <NUM> and pre-collimator <NUM>. Side reflectors <NUM> may be formed from a volume reflective material such as, for example, titanium oxide particles dispersed in silicone. Side reflectors <NUM> may optionally be replaced by absorptive material if no light recycling is sought. The cavity may be filled with air or another transparent medium as filler material, for example a low index silicone or a nanoporous material. Metalens <NUM> is spaced apart from pre-collimator <NUM> by side walls <NUM>, which may be absorptive.

Metalens metasurfaces 505T and 505B may comprise concentric rings of nanoantennas (e.g., pillars or fins), as described above, with the nanoantennas formed from niobium pentoxide as also described above. The pre-collimator may have a similar structure to the metalens, comprising for example niobium pentoxide pillars of, for example, radius <NUM>, height <NUM>, and period (pitch) <NUM>. The pre-collimator may alternatively be implemented as a multi-layered thin film coating/photonic crystal, or a photonic crystal consisting of nano-rods and nano-cones formed, for example, from niobium pentoxide and/or gallium nitride.

<FIG> and <FIG> show plots of calculated transmission versus angle of incidence, for light having a wavelength of <NUM>, for the metalens in a system as in <FIG> with the metalens formed from niobium pentoxide pillars as described above. <FIG> similarly shows reflectance versus angle of incidence for the metalens, for light having a wavelength of <NUM>.

<FIG> schematically illustrates an example camera flash system <NUM> comprising an LED array and metalens adaptive illumination system <NUM>, which may be similar or identical to the systems described above. Flash system <NUM> also comprises an LED driver <NUM> that is controlled by a controller <NUM>, such as a microprocessor. Controller <NUM> may also be coupled to a camera <NUM> and to sensors <NUM>, and operate in accordance with instructions and profiles stored in memory <NUM>. Camera <NUM> and adaptive illumination system <NUM> may be controlled by controller <NUM> to match their fields of view.

Sensors <NUM> may include, for example, positional sensors (e.g., a gyroscope and/or accelerometer) and/or other sensors that may be used to determine the position, speed, and orientation of system <NUM>. The signals from the sensors <NUM> may be supplied to the controller <NUM> to be used to determine the appropriate course of action of the controller <NUM> (e.g., which LEDs are currently illuminating a target and which LEDs will be illuminating the target a predetermined amount of time later).

In operation, illumination from some or all of the pixels of the LED array in <NUM> may be adjusted - deactivated, operated at full intensity, or operated at an intermediate intensity. As noted above, beam focus or steering of light emitted by the LED array in <NUM> can be performed electronically by activating one or more subsets of the pixels, to permit dynamic adjustment of the beam shape without moving optics or changing the focus of the lens in the lighting apparatus.

Adaptive light emitting matrix pixel arrays and lens systems such as described herein may support various other beam steering or other applications that benefit from fine-grained intensity, spatial, and temporal control of light distribution. These applications may include, but are not limited to, precise spatial patterning of emitted light from pixel blocks or individual pixels. Depending on the application, emitted light may be spectrally distinct, adaptive over time, and/or environmentally responsive. The light emitting pixel arrays may provide pre-programmed light distribution in various intensity, spatial, or temporal patterns. Associated optics may be distinct at a pixel, pixel block, or device level. An example light emitting pixel array may include a device having a commonly controlled central block of high intensity pixels with an associated common optic, whereas edge pixels may have individual optics. In addition to flashlights, common applications supported by light emitting pixel arrays include video lighting, automotive headlights, architectural and area illumination, and street lighting.

Applications supported by the described adaptive light emitting pixel arrays include augmented (AR) or virtual reality (VR) headsets, glasses, or projectors. For example, <FIG> schematically illustrates an example AR/VR system <NUM> that includes an adaptive light emitting array <NUM>, AR or VR display <NUM>, a light emitting array controller <NUM>, sensor system <NUM>, and system controller <NUM>. Control input is provided to the sensor system <NUM>, while power and user data input is provided to the system controller <NUM>. As will be understood, in some embodiments modules included in the AR/VR system <NUM> can be compactly arranged in a single structure, or one or more elements can be separately mounted and connected via wireless or wired communication. For example, the light emitting array <NUM>, AR or VR display <NUM>, and sensor system <NUM> can be mounted on a headset or glasses, with the light emitting controller and/or system controller <NUM> separately mounted.

In one embodiment, the light emitting array <NUM> includes one or more adaptive light emitting arrays, as described above for example, that can be used to project light in graphical or object patterns that can support AR/VR systems. In some embodiments, arrays of microLEDs (µLEDs or uLEDs) can be used. MicroLEDs can support high density pixels having a lateral dimension less than <NUM> by <NUM>. In some embodiments, microLEDs with dimensions of about <NUM> in diameter or width and smaller can be used. Such microLEDs can be used for the manufacture of color displays by aligning in close proximity microLEDs comprising red, blue and green wavelengths. In other embodiments, microLEDs can be defined on a monolithic GaN or other semiconductor substrate, formed on segmented, partially, or fully divided semiconductor substrate, or individually formed or panel assembled as groupings of microLEDs. In some embodiments, the light emitting array <NUM> can include small numbers of microLEDs positioned on substrates that are centimeter scale area or greater. In some embodiments, the light emitting array <NUM> can support microLED pixel arrays with hundreds, thousands, or millions of light emitting LEDs positioned together on centimeter scale area substrates or smaller. In some embodiments, microLEDs can include light emitting diodes sized between <NUM> microns and <NUM> microns. The light emitting array(s) <NUM> can be monochromatic, RGB, or other desired chromaticity. In some embodiments, pixels can be square, rectangular, hexagonal, or have curved perimeter. Pixels can be of the same size, of differing sizes, or similarly sized and grouped to present larger effective pixel size. In some embodiments, separate light emitting arrays can be used to provide display images, with AR features being provided by a distinct and separate micro-LED array. In some embodiments, a selected group of pixels can be used for displaying content to the user while tracking pixels can be used for providing tracking light used in eye tracking. Content display pixels are designed to emit visible light, with at least some portion of the visible band (approximately <NUM> to <NUM>). In contrast, tracking pixels can emit light in visible band or in the IR band (approximately <NUM> to <NUM>,<NUM>), or some combination thereof. As an alternative example, the tracking pixels could operate in the <NUM> to <NUM> nanometer range. In some embodiments, the tracking pixels can emit tracking light during a time period that content pixels are turned off and are not displaying content to the user.

As will be understood, in some embodiments light emitting pixels and circuitry supporting light emitting array <NUM> can be packaged and optionally include a submount or printed circuit board connected for powering and controlling light production by semiconductor LEDs. In certain embodiments, a printed circuit board supporting light emitting array <NUM> can also include electrical vias, heat sinks, ground planes, electrical traces, and flip chip or other mounting systems. The submount or printed circuit board may be formed of any suitable material, such as ceramic, silicon, aluminum, etc. If the submount material is conductive, an insulating layer is formed over the substrate material, and the metal electrode pattern is formed over the insulating layer. The submount can act as a mechanical support, providing an electrical interface between electrodes on the light emitting array <NUM> and a power supply, and also provide heat sink functionality.

The AR/VR system <NUM> can incorporate a wide range of optics in adaptive light emitting array <NUM> and/or AR/VR display <NUM>, for example to couple light emitted by adaptive light emitting array <NUM> into AR/VR display <NUM>. Such optical elements can include for example metalenses and pre-collimators as described above for example. For AR/VR applications the metalenses and pre-collimators may comprise nanofins as described above and be designed to polarize the light they transmit. Optical elements can also or alternatively include apertures, filters, a Fresnel lens, a convex lens, a concave lens, or any other suitable optical element that affects the projected light from the light emitting array <NUM>. Additionally, one or more of the optical elements can have one or more coatings, including UV blocking or anti-reflective coatings. In some embodiments optics can be used to correct or minimize two-or three dimensional optical errors including pincushion distortion, barrel distortion, longitudinal chromatic aberration, spherical aberration, chromatic aberration, field curvature, astigmatism, or any other type of optical error. In some embodiments, optical elements can be used to magnify and/or correct images. Advantageously, in some embodiments magnification of display images allows the light emitting array <NUM> to be physically smaller, of less weight, and require less power than larger displays. Additionally, magnification can increase a field of view of the displayed content allowing display presentation equals a user's normal field of view.

In one embodiment, the light emitting array controller <NUM> can be used to provide power and real time control for the light emitting array <NUM>. For example, the light emitting array controller <NUM> can be able to implement pixel or group pixel level control of amplitude and duty cycle. In some embodiments the light emitting array controller <NUM> further includes a frame buffer for holding generated or processed images that can be supplied to the light emitting array <NUM>. Other supported modules can include digital control interfaces such as Inter-Integrated Circuit (I2C) serial bus, Serial Peripheral Interface (SPI), USB-C, HDMI, Display Port, or other suitable image or control modules that are configured to transmit needed image data, control data or instructions.

In operation, pixels in the images can be used to define response of corresponding light emitting array <NUM>, with intensity and spatial modulation of LED pixels being based on the image(s). To reduce data rate issues, groups of pixels (e.g. 5x5 blocks) can be controlled as single blocks in some embodiments. In some embodiments, high speed and high data rate operation is supported, with pixel values from successive images able to be loaded as successive frames in an image sequence at a rate between <NUM> and <NUM>, with <NUM> being typical. Pulse width modulation can be used to control each pixel to emit light in a pattern and with an intensity at least partially dependent on the image.

In some embodiments, the sensor system <NUM> can include external sensors such as cameras, depth sensors, or audio sensors that monitor the environment, and internal sensors such as accelerometers or two or three axis gyroscopes that monitor AR/VR headset position. Other sensors can include but are not limited to air pressure, stress sensors, temperature sensors, or any other suitable sensors needed for local or remote environmental monitoring. In some embodiments, control input can include detected touch or taps, gestural input, or control based on headset or display position. As another example, based on the one or more measurement signals from one or more gyroscope or position sensors that measure translation or rotational movement, an estimated position of AR/VR system <NUM> relative to an initial position can be determined.

In some embodiments, the system controller <NUM> uses data from the sensor system <NUM> to integrate measurement signals received from the accelerometers over time to estimate a velocity vector and integrate the velocity vector over time to determine an estimated position of a reference point for the AR/VR system <NUM>. In other embodiments, the reference point used to describe the position of the AR/VR system <NUM> can be based on depth sensor, camera positioning views, or optical field flow.

Based on changes in position, orientation, or movement of the AR/VR system1000, the system controller <NUM> can send images or instructions the light emitting array controller <NUM>. Changes or modification the images or instructions can also be made by user data input, or automated data input as needed. User data input can include but is not limited to that provided by audio instructions, haptic feedback, eye or pupil positioning, or connected keyboard, mouse, or game controller.

Claim 1:
An adaptive illumination system comprising:
an array (<NUM>) of independently controllable LEDs;
a pre-collimator (<NUM>) arranged to partially collimate light emitted by the LEDs; and
a metalens (<NUM>) positioned on an opposite side of the pre-collimator from the LEDs and comprising at least a first array of niobium pentoxide nanoantennas arranged to affect phase and amplitude of the light partially collimated by the pre-collimator to further collimate the light,
the metalens being positioned and structurally arranged so that light emitted from different LEDs of the array is directed to corresponding differing predefined far-field regions.