Patent ID: 12206840

DESCRIPTION OF THE PREFERRED EMBODIMENTS

Referring now to the drawings, wherein like reference numerals designate identical or corresponding parts, and more particularly toFIG.1thereof, there is illustrated a laser light source105illuminating a modulator120according to an embodiment of the present invention. The laser light is passed through a spreader110to cause the light to spread (115). The spreading light115then illuminates an area of the modulator120that is larger than the area of light produced by the laser light source and any “native” spreading that might have occurred in the light path between the light source and modulator if the spreader were not present. The increased area of illumination by a single light source allows the use of multiple, and/or multiple overlapping laser light sources to illuminate the entire modulator.

FIG.2is a drawing of a laser light source bundle205illuminating a modulator225according to an embodiment of the present invention. Here, several of the bundled laser light sources205are energized and producing light. The light is spread by a spreader210causing the light to spread (220). The spreading light220then illuminates the modulator225. As illustrated, with additional laser light energizations, the entire modulator225is illuminated. At different energization/brightness levels, illumination of the modulator is locally dimmed.

In one embodiment, two or more of the lights provided by the illustrated light sources may, instead of being separate sources, may be produced by a common light source and a splitter or other separating optical element/elements. In one embodiment, a series of light sources are each split multiple times to provide a full array of light beams. In one embodiment, the light beams provided by a common light source may be individually modulated with the use of liquid crystal panel and energization of specific liquid crystal cells that the individual beams are incident. The modulation of an individual beam may be accomplished by, for example, a combination of the energization level of the light source and the energization level of liquid crystal cells upon which the light or portions thereof are incident.

Turning back the exemplary embodiment ofFIG.2, additional light sources may also be energized. For example, all of the light sources may be simultaneously energized. The bundled laser light sources205may be, for example, any primary color in a projection system. The bundled light sources205may be, for example, a set of single colored laser light sources such as any of red, green, or blue, in an RGB system, or any of yellow, magenta, or cyan or other primary colors.

The bundled light sources may also be a mixed set of primary colors such as a set of red, green, and blue laser light sources. Depending on other factors of projector design, the red, green and blue laser may be programmed to be on simultaneously, or to alternate energization in a time sequence (e.g., T1 energize red laser, T2 energize green laser, and T3 energize blue laser). The time period may be sequential, repeated, or interspersed with other intervals, such as blanking intervals. The time period may be adjusted, such that one of the colors may have a longer time period than others, and the time periods for one, more, or all of the colors may be variable.

In one embodiment, the time periods (or number of time periods) for each color are determined based on image data. For example, in darker scenes, the time periods may be decreased. In scenes with specific color requirements, the predominate colors may be increased (e.g., blue sky scenes may utilize an increased blue time period). In concert with such time period adjustments, flash periods may be correspondingly adjusted.

In another embodiment, the time period may also be adjusted based on characteristics of the projector or light sources themselves. For example, projectors with higher light loss in a specific color may increase the time period for the color. A malfunctioning laser or laser bank may also be compensated for by adjusting the time period or other parameter of laser energization. Timing of energization of individual lasers of the same color may also vary within a corresponding energization time period. Such timing may be for example to match an energization pattern of the modulator(s) or other elements (e.g., filters, shutters, polarizers, etc), including mechanical movement within the image chain.

Any form of Pulse Width Modulation (PWM) may be utilized. However, a frequency at which the PWM occurs must be considered. In the case of a DMD modulator implementation the PWM frequency must not match the DMD modulator frequency, which could cause either no benefit (laser on only when mirror is reflecting into the image chain) or no illumination (laser not on when positioned to reflect into the image chain). In one embodiment, PWM of the lasers is implemented at a frequency much higher than a switching frequency of the modulator(s) in the projector or display (e.g., greater than 400 MHz for DMD, or greater than 60 FPS on a common LCD).

Amplitude modulation of the lasers may also be utilized.

FIG.3is a drawing of a light source bundle305and a redirection block335according to an embodiment of the present invention. As illustrated, the re-direction block335is a multiple re-direction block in that it receives lights from a plurality of light sources (light source bundle305) and re-directs individual beams of the light sources toward a modulator320. The re-direction is provided by optical elements (e.g., optical elements330and332). The optical elements may be, for example, a reflector or a beam splitter (e.g., one portion of the split beam directed towards modulator320, the other portion towards a second modulator) (e.g., a splitter configured to pass one light beam and reflect another into a same or similar optical path). The optical elements may be mirrors or silverized surfaces embedded in the optical block. The optical elements may also be an impression or other permutation in the optical block that causes a total internal reflection. More than one optical element (or reflector) may be utilized in each optical path.

A spreader310is also shown and intended to illustrate the case of a non or low spreading light sources (e.g., laser light sources) which are then spread to illuminate the modulator320. However, as with all such exemplary embodiments described herein, such configurations are not limited to laser light implementations. And, a selection of energized light sources are shown for illustrative purposes. However, as discussed above, all of the light sources may be energized, or a selection may be energized, they may be energized at different times (e.g. Pulse Width Modulation PWM, and/or they may be energized at different energy levels (e.g., amplitude modulation).

In one embodiment, the redirection optics and spreader/spreading function are combined. For example, the reflectors may also include any of lenslets, diffusers (e.g., holographic), or other optics to perform spreading which may be utilized to replace the function of spreader310.

Typically, the selected energized light sources will provide enough coverage for the entire modulating surface of the modulator320if brightness is needed (e.g., for completely dark or black portions of an image, the modulator may not need to be illuminated). Optionally, in cases where a totally dark region of an image or scene is near to one that is partially or fully illuminated (e.g., either spatially or temporally) some illumination may be provided to the dark region (which may take the form of a gradual fade to black). In one embodiment, a fade to black rate is adjusted in areas within the “dark” region based on image data such as temporal image changes, the relative brightnesses of nearby regions, or other factors (including optical performance of one or more components of the imaging system).

In one embodiment, a broken or malfunctioning light source is detected and algorithms recognizing the failure also adjust internal parameters such as fade to black rates or the brightness/modulations of other light sources to compensate for the malfunction. Sensors in the image chain can be placed to provide real-time performance feedback and any necessary adjustments to improve display performance, or compensate for malfunctions, can be made on-the-fly in real-time during image display or projection.

In one embodiment the optical pathlengths of the light sources are matched. For example, when using an optical block such as that illustrated inFIG.3, the light sources may be moved upstream or downstream relative to each other based on the relative distances between the light sources and their corresponding redirection element (e.g., light source for reflector330may be downstream relative to reflector332). The lightpaths may be equalized by adjusting other elements in the optical path as well.

FIG.4is a drawing illustrating a spreader410and an illumination pattern420according to an embodiment of the present invention. The spreader410comprises a series of spreader elements (e.g., spreader element412). The spreader elements are, for example, disposed on or in a substrate416. The spreader elements may be constructed, for example, using layers of lens materials, diffusers,414, and possibly shutters, light guides, and/or optical dividers (not shown). In one embodiment, the spreader element comprises a lens subelement targeted by one or more light sources/beams, followed by a diffuser subelement, and the diffuser subelement including reflective optical walls that direct the spread of the light in a manner that fills a predetermined illumination pattern on a downstream modulator.

In one embodiment, the spreader is constructed using a holographic material. The holographic material diffuses the light at a pre-determined angle or with a predetermined Point Spread Function (PSF). Compared to a typical diffuser, the holographic diffuser emits light at a controlled angle and/or in a limited PSF. In one embodiment, the spreader is a single layer of a holographic diffuser, and in other embodiments, sub-elements of the diffuser comprise holographic material. The holographic diffuser or materials may be used in conjunction with other optical elements.

Typically, the spreader causes the light to spread in an even distribution. However, embodiments include sub-elements that have properties that vary in order to implement an illuminating pattern that is not homogeneous or isotropic.

The illumination pattern420illustrates an exemplary mixing of light from the various light sources which includes an overlap at edges of adjacent light sources' illumination patterns. For example, illumination area422overlaps on its east-side with illumination pattern422-E, on its south-side with illumination pattern422-S, and on its southeast corner with illumination pattern422-SE. Illumination pattern424overlaps with the eight illumination patterns surrounding illumination pattern424. All of the patterns together from the illumination pattern on the modulator.

Preferably, the illumination patterns are proportional to a display or screen size of the device or system by which the desired or resulting images are viewed. In a 16:9 screen, the illustrated illumination areas would themselves be of a shape have a 16:9 ratio. However, other sizes, shapes or relative ratios may be utilized.

FIG.5is a drawing illustrating various example illumination patterns according to the present invention. The illustrated illumination patterns include a black dot that indicates an approximate illumination pattern that would occur without spreading from the light source. The illumination patterns may be produced by natural spreading initiated by a reflector around each light source, natural spreading only, or, and particularly in the case of laser light sources (either individual light sources or split beams), spreading due mainly to a spreader element in the upstream light path. Still, in each case, the black dot is provided for reference.

Illumination pattern532is provided by a circular type of spreading or Point Spread Function (PSF) of the light. Illumination pattern534is provided by a rectangular-like spread function (e.g., spreader and/or PSF of the light). Illumination pattern536illustrates a mixed overlap where illumination areas in an interior of the entire illuminated area are mixed more heavily (more overlap) compared to illumination areas at the edges. The relative mixing between areas may be gradually changed across the entire illuminated area either increasing or decreasing towards a central area. Ultimately, such mixing is produced on a surface of a modulator or other component of an optical, display, or projection system.

Although mainly shown for illustrative purposes as overlapping edges of adjacent light sources/PSFs, the invention includes a wider footprint or PSF of each light source which may, for example, encompass central areas of the illumination pattern of a predetermined number of light sources. For example, a light source may have a PSF that encompasses areas illuminated by 9 or more other light sources (e.g., example PSF533) (e.g., more than just adjacent illuminated areas overlap). For example, the spreading of a first light source fully illuminates an area immediately surrounding a central point of the first light source's illumination pattern, and fully illuminates an area immediately surrounding the central points of illumination by adjacent light sources. Depending on the number of areas or light sources, this may continue for one or more levels. The first light source may then also partially illuminate areas immediately surrounding central points of illumination by light sources adjacent to those whose illumination patterns are fully illuminated by the first light source.

FIG.6is a drawing illustrating a system600and processing associated with various embodiments of the present invention. An array of laser light sources605provides narrowband illumination beams608which are directed at an arrayed spreader which operates to spread the narrowband laser lights. The spread lights615then illuminate modulator620.

Modulator620may be an LCD panel, a Digital Mirror Device (DMD), a liquid Crystal on Silicon (LCOS) chip, or other modulation/light valve devices. The modulator selection may be decided based on other architectural factors of the system being built. The modulator may be transmissive or reflective and may be oriented at an angle such that the post-modulated light is reflected at an angle away from the upstream path and toward downstream portions of the image chain.

Preferably, the illumination of modulator620comprises a locally dimmed illumination comprising an approximation of a desired image to be displayed. The approximation is determined, for example, from an image signal640carrying a representation of the desired image. Processor650receives the image signal and determines the approximation and appropriate energization levels of the array of laser light sources605to produce the approximation on modulator620(e.g., approximation module655-1). The approximation includes calculations based on the amount of light spreading that occurs in the image chain, which will depend on the optical characteristics of the spreader610, and other properties of the system. The energization level of each individually controllable light source (e.g., M light sources) is signaled to the light sources (and may include additional driver hardware (not shown).

In embodiments where the light sources are grouped into colors or another denomination, the approximation signals are calculated for each group. The signals for each group likely contain some similar characteristics, and that commonality may be utilized to increase efficiency of the processing for each group.

Modulation performed by the modulator620is implemented to account for the illumination pattern incident on the modulator including overlapping, if any, of the illuminations originating from adjacent or nearby light sources. The modulations may be calculated by, for example, determining a simulation of the illumination field at the modulator and then energizing the modulator to alter the illumination so as to fully modulate the lights to contain the desired image when projected and/or focused at a viewing location. The modulations may also be calculated based entirely on the image signal by calculating the laser energization levels and then applying a look-up table or other conversion (equation) using both the original image signal and laser energization levels. The modulation signals include energization data for, for example, N pixels of the modulator620.

In one embodiment, L additional “midpoint” modulations are performed. The “midpoint” modulations may be implemented, for example, by a mid-point modulator612. The mid-point modulator may be, for example, a grayscale or color LCD panel, or, an array of optical switches (e.g., the type of switches used for communication over fiber optic cable). The mid-point modulator is a secondary modulator configured to modulate the laser lights prior to illuminating the modulator620.

The mid-point modulator612may be positioned at a point after spreader610but before the lights overlap. In one embodiment, mid-point modulator612is positioned at a point after overlapping has occurred. In one embodiment, the mid-point modulator is placed before the spreader (e.g., an optical switch embodiment would have high efficiency at this position). Energization of mid-point modulator612may include, for example, the use of a Light Field Simulation (LFS) or other algorithm for determining a preferred modulation at the location of mid-point modulator612. The additional modulations provided by the mid-point modulator are taken into account by either LFS or other calculations and used for determining energization of modulator620.

In one embodiment, a mid-point modulator is constructed of optical switches configured to selectively re-direct light from its primary area on the modulator to another area on the modulator. A switch may have 2 or more directions in which the light may be directed, and, in this embodiment, the switch, for example, redirects light from “dark” areas of a modulator corresponding to dark portions of an image being modulated to “bright” areas. Corresponding changes in the LFS (or other methods for determining energization) at the modulator, along with programming of the switches themselves, is implemented, for example, in processor650.

FIG.7is a drawing illustrating a retrofit of a projection device750according to an embodiment of the present invention. The projection device includes a kernel having prisms for separating and recombining colored lights and modulators for modulating the colored lights separately. In one embodiment, separate banks of lasers are provided for each of primary lights. For example, laser bank705R producing modulated (locally dimmed) red light, laser bank705G providing modulated green light, and laser bank705B producing modulated blue light. The modulated lights are then spread (begin spreading) via individual spreaders (e.g.,710R,710B, and710G), combined and input (e.g., via optics720) into the projector kernel, where they are separated, further modulated, re-combined, and then projected by a projection lens onto a viewing screen.

In other embodiment, a single bank of lasers is provided with a set of primary color lights and a common spreader. A common spreader may include separate or shared optics (e.g., an array of lenslets) that cause the lights to spread. The lenslets may be designed to impart a Point Spread Function (PSF) to each light such that the overlapping edges are faded compared to a central area of each individual illumination pattern causing the mixed lights to vary in a predetermined fashion (e.g., vary smoothly from one illumination area to the next). Other PSFs may also be implemented.

Other embodiments include directly illuminating separate red, green, and blue modulators with corresponding red, green, and blue laser banks (bundles) and spreaders.

Although the present invention has been described herein with reference to laser lights providing illumination, the invention may also be practiced using broadband or broaderband light sources (e.g., LEDs, nanotube based light sources, etc). In describing preferred embodiments of the present invention illustrated in the drawings, specific terminology is employed for the sake of clarity. However, the present invention is not intended to be limited to the specific terminology so selected, and it is to be understood that each specific element includes all technical equivalents which operate in a similar manner.

For example, when describing any part of the present invention, any other equivalent device, or other device having an equivalent function or capability, whether or not listed herein, may be substituted therewith. Furthermore, the inventors recognize that newly developed technologies not now known may also be substituted for the described parts and still not depart from the scope of the present invention. All other described items, including, but not limited to light sources, lasers, modulators, panels, processing devices, optical elements, etc should also be considered in light of any and all available equivalents. Portions of the present invention may be conveniently implemented using a conventional general purpose or a specialized digital computer or microprocessor programmed according to the teachings of the present disclosure, as will be apparent to those skilled in the computer art.

Appropriate software coding can readily be prepared by skilled programmers based on the teachings of the present disclosure, as will be apparent to those skilled in the software art. The invention may also be implemented by the preparation of application specific integrated circuits or by interconnecting an appropriate network of conventional component circuits, as will be readily apparent to those skilled in the art based on the present disclosure.

The present invention includes a computer program product which is a storage medium (media) having instructions stored thereon/in which can be used to control, or cause, a computer to perform any of the processes of the present invention. The storage medium can include, but is not limited to, any type of disk including floppy disks, mini disks (MD's), optical discs, DVD, HD-DVD, Blue-ray, CD-ROMS, CD or DVD RW+/−, micro-drive, and magneto-optical disks, ROMs, RAMs, EPROMs, EEPROMs, DRAMs, VRAMs, flash memory devices (including flash cards, memory sticks), magnetic or optical cards, SIM cards, MEMS, nanosystems (including molecular memory ICs), RAID devices, remote data storage/archive/warehousing, or any type of media or device suitable for storing instructions and/or data (including remotely stored or executed programs or data connected via Internet or other networks such as wireless, cellular, satellite, etc., to a device performing or using one or more results of the invention (e.g., computer display, portable devices, HDTV, or cinema theater system, etc)). Such instructions may also be divided between a network server and an end-user device, such as processing performed by a remote server and a digital cinema server to produce signals necessary to drive the light sources and modulators at a cinema theater according to any one or more teachings of the present invention.

Such signals may further include specialized processing and architectures to implement 3D and/or wide color gamut, as described, for example, in issued U.S. Pat. No. 7,784,938 and co-pending U.S. application Ser. Nos.; 11/804,602, 12/530,379 by the same inventor, and “PROJECTOR AND PROJECTION SYSTEMS USING LASER LIGHT SOURCES AND RELATED METHODS FOR 3D PROJECTION AND COLOR GAMUT IMPROVEMENTS,” Ser. No. 61/452,638 filed on Mar. 14, 2011.

Stored on any one of the computer readable medium (media), the present invention includes software for controlling both the hardware of the general purpose/specialized computer or microprocessor, and for enabling the computer or microprocessor to interact with a human user or other mechanism utilizing the results of the present invention. Such software may include, but is not limited to, device drivers, operating systems, and user applications. Ultimately, such computer readable media further includes software for performing the present invention, as described above.

Included in the programming (software) of the general/specialized computer or microprocessor are software modules for implementing the teachings of the present invention, including, but not limited to, calculating laser energization levels and subsequent modulations in a multi-modulation system and the display, storage, or communication of results according to the processes of the present invention.

The present invention may suitably comprise, consist of, or consist essentially of, any of element (the various parts or features of the invention, e.g., light sources, modulators, optics, and processing) and their equivalents. Further, the present invention illustratively disclosed herein may be practiced in the absence of any element, whether or not specifically disclosed herein. Obviously, numerous modifications and variations of the present invention are possible in light of the above teachings. It is therefore to be understood that within the scope of the appended claims, the invention may be practiced otherwise than as specifically described herein.