Abstract:
An optoelectronic device includes a semiconductor substrate, an array of optical emitters arranged on the substrate in a two-dimensional pattern, a projection lens and a diffractive optical element (DOE). The projection lens is mounted on the semiconductor substrate and is configured to collect and focus light emitted by the optical emitters so as to project optical beams containing a light pattern corresponding to the two-dimensional pattern of the optical emitters on the substrate. The DOE is mounted on the substrate and is configured to produce and project multiple overlapping replicas of the pattern.

Description:
FIELD OF THE INVENTION 
       [0001]    The present invention relates generally to optical projection, and particularly to integrated optical projectors. 
       BACKGROUND OF THE INVENTION 
       [0002]    Micro-miniature optical projectors are used in a variety of applications. For example, such projectors may be used to cast a pattern of coded or structured light onto an object for purposes of 3D mapping (also known as depth mapping). In this regard, U.S. Pat. No. 8,150,142, whose disclosure is incorporated herein by reference, describes an apparatus for mapping an object. The apparatus includes an illumination assembly, which includes a single transparency containing a fixed pattern of spots. A light source trans-illuminates the single transparency with optical radiation so as to project the pattern onto the object. An image capture assembly captures an image of the pattern that is projected onto the object, and a processor processes the image so as to reconstruct a three-dimensional (3D) map of the object. 
         [0003]    PCT International Publication WO 2008/120217, whose disclosure is incorporated herein by reference, describes further aspects of the sorts of illumination assemblies that are shown in the above-mentioned U.S. Pat. No. 8,150,142. In one embodiment, the transparency comprises an array of micro-lenses arranged in a non-uniform pattern. The micro-lenses generate a corresponding pattern of focal spots, which is projected onto the object. 
         [0004]    U.S. Pat. No. 8,749,796, whose disclosure is incorporated herein by reference, describes integrated pattern generators in which laser diodes (such as VCSELs) are arranged in a pattern that is not a regular lattice. Optics may be coupled to project the pattern of light emitted by the elements of a laser diode array into space as a pattern of corresponding spots, wherein each spot contains the light emitted by a corresponding laser diode in the array. In some embodiments, a DOE creates multiple replicas of the pattern, fanning out over an expanded angular range. 
       SUMMARY OF THE INVENTION 
       [0005]    An embodiment of the present invention that is described herein provides an optoelectronic device including a semiconductor substrate, an array of optical emitters arranged on the substrate in a two-dimensional pattern, a projection lens and a diffractive optical element (DOE). The projection lens is mounted on the semiconductor substrate and is configured to collect and focus light emitted by the optical emitters so as to project optical beams containing a light pattern corresponding to the two-dimensional pattern of the optical emitters on the substrate. The DOE is mounted on the substrate and is configured to produce and project multiple overlapping replicas of the pattern. 
         [0006]    In some embodiments, the pattern has a given pitch, and the multiple overlapping replicas have a combined pitch that is finer than the given pitch. In an embodiment, the optical emitters include vertical cavity surface emitting laser (VCSEL) devices. In a disclosed embodiment, the DOE is configured to produce the multiple replicas so as to overlap in one dimension. In an alternative embodiment, the DOE is configured to produce the multiple replicas so as to overlap in two dimensions. 
         [0007]    In an embodiment, the two-dimensional pattern of the light-emitting elements does not lie on a regular lattice. In another embodiment, the two-dimensional pattern of the light-emitting elements is an uncorrelated pattern. In yet another embodiment, the two-dimensional pattern of the light-emitting elements is a regular grid pattern. In still another embodiment, the projection lens and the DOE are formed on a single optical substrate. 
         [0008]    In some embodiments, the two-dimensional pattern of the light-emitting elements is divided into two or more subsets that are individually addressable, and the device includes control circuitry that is configured to address combinations of one or more of the subsets so as to control the overlapping replicas for creating multiple different pattern densities. In some embodiments, the DOE is configured to create transversal offsets between duplication in adjacent columns of the projected optical beams, so as to reduce an ambiguity in depth estimation that is based on measuring transversal shifts in the projected optical beams along the columns. 
         [0009]    There is additionally provided, in accordance with an embodiment of the present invention, a method for producing an optoelectronic device. The method includes providing a semiconductor substrate, and forming an array of optical emitters on the substrate in a two-dimensional pattern. A projection lens is mounted on the semiconductor substrate so as to collect and focus light emitted by the optical emitters, thereby projecting optical beams containing a light pattern corresponding to the two-dimensional pattern of the optical emitters on the substrate. A diffractive optical element (DOE) is mounted on the substrate so as to produce and project multiple overlapping replicas of the pattern. 
         [0010]    The present invention will be more fully understood from the following detailed description of the embodiments thereof, taken together with the drawings in which: 
     
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
         [0011]      FIG. 1  is a schematic diagram of an integrated optical projector, in accordance with an embodiment of the present invention; 
           [0012]      FIGS. 2-5  are diagrams that schematically illustrate projected overlapping patterns, in accordance with embodiments of the present invention; 
           [0013]      FIG. 6  is a diagram illustrating dynamic control of projected pattern density, in accordance with an embodiment of the present invention; and 
           [0014]      FIGS. 7 and 8  are diagrams illustrating fanout order patterns having reduced ambiguity, in accordance with embodiments of the present invention. 
       
    
    
     DETAILED DESCRIPTION OF EMBODIMENTS 
     Overview 
       [0015]    Embodiments of the present invention that are described hereinbelow provide optical projectors having improved pattern density, and associated methods. In some embodiments, an optical projector comprises an array of optical emitters, e.g., vertical cavity surface emitting lasers (VCSELs), and a projection lens. The optical emitters in combination with the lens generate a pattern of light spots having a certain pitch or density. This pitch is limited by the physical distances between the emitters in the array, and the focal length of the projection lens. The physical distances between emitters cannot be reduced below some minimal distance due to implementation reasons. Increasing the focal length of the lens, on the other hand, would increase the projector height and reduce its depth of field. In the embodiments described herein, the projector is able to achieve a finer pitch, i.e., high pattern density, by generating multiple replicas of the pattern that overlap one another. 
         [0016]    In some embodiments, the projector further comprises a pattern replication element, e.g., a Fan-Out beam splitter created by diffractive optical element (DOE). The beam splitter produces and projects multiple replicas of the pattern created by the VCSEL array and lens. The multiple replicas overlap one another, such that the resulting combined pattern of separated light spots has a density that is denser than the density achieved by the optical emitter array and lens alone. Several such implementations are described herein. 
         [0017]    In some embodiments, the density of the projected pattern is controlled dynamically by addressable operation of batches of the emitters in the array. Other disclosed embodiments mitigate possible ambiguities in depth estimation, which may be caused by pattern similarity of the replicas. 
         [0018]    The disclosed techniques are highly effective in producing optical spot patterns having high angular density. The angular separation between the spots is no longer constrained by the ratio of the physical distances between the emitters in the array and the focal length of the projection lens. 
       System Description 
       [0019]      FIG. 1  is a schematic diagram of an integrated optical projector  30 , in accordance with an embodiment of the present invention. In a typical application, projector  30  produces and projects a pattern of light spots onto an object or scene, in order to enable an imaging and processing system (not shown) to analyze the projected pattern and estimate a three-dimensional (3-D) map of the object or scene. The 3-D map, also referred to as a depth map, can be used for various purposes, such as for user gesture recognition as part of a Man-Machine Interface (MMI). Projector  30  may be integrated into various host systems, such as mobile communication or computing devices. 
         [0020]    In the example of  FIG. 1 , projector  30  comprises a semiconductor die  120  having an array of optical emitters disposed thereon. In the embodiments described herein the emitters comprise Vertical Cavity Surface Emitting Lasers (VCSELs). In alternative embodiments, however, any other suitable type of laser diodes or other optical emitters can be used. The VCSELs are constructed on die  120  in a certain geometrical layout, e.g., a regular grid or an uncorrelated (e.g., quasi-random) layout. Several examples of such geometrical patterns are discussed further below. 
         [0021]    In the embodiment of  FIG. 1 , die  120  is mounted on a sub-mount substrate  132 , and is electrically connected to substrate  132  using wire bonds  138 . External interconnect terminals, e.g., an anode contact  134  and a cathode contact  136 , are formed on the opposite surface of substrate  132 . A projection lens  146  is mounted on spacers  142 , typically such that die  120  lies on the focal plane of the lens. A Fan-Out Diffractive Optical Element (FO-DOE)  144  is mounted above projection lens  146  using thin spacers  148 . 
         [0022]    Projection lens  146  collects and collimates the light emitted by the individual VCSELs on die  120 . The combination of the VCSELs and the projection lens generates a pattern of light spots (e.g., grid or quasi-random) according to the geometrical layout of the VCSELs on die  120 . In particular, the pitch or density of the projected pattern, i.e., the angular separation between light spots, is determined by the physical distances between the VCSELs on die  120  and the focal length of projection lens  146 . This pattern of light spots is referred to herein as a baseline pattern. 
         [0023]    DOE  144  functions as a beam splitter, which produces and projects multiple replicas of the baseline pattern onto the object or scene. The multiple replicas are angularly-offset relative to one another, and overlap one another. The resulting pattern of light spots, which comprises the superposition of the multiple replicas of the baseline pattern, is referred to herein as a composite pattern. Due to the overlap between the multiple replicas, the pitch or density of the composite pattern is higher than that of the baseline pattern. Moreover, the pitch or density of the composite pattern is no longer limited by the physical distances between VCSELs and by the focal length of the projection lens. 
         [0024]    The top of  FIG. 1  shows an example of three replicas of the baseline pattern, having an overlap of 50% between them, denoted  152 ,  154  and  156 . As can be seen in the figure, the pitch of the composite pattern is two times finer than the pitch of the baseline pattern (the pitch of a single replica). The example of  FIG. 1  is highly simplified for the sake of clarity. Several real-life examples are described in the following figures. For example,  FIG. 1  shows pattern replication in one dimension. In alternative embodiments, DOE  144  may generate replicas that are angularly-offset and overlap in two dimensions. 
         [0025]    The configuration of projector  30  in  FIG. 1  is an example configuration, which is chosen purely for the sake of conceptual clarity. In alternative embodiments, any other suitable projector configuration can be used. FO DOE  144  may comprise, for example, a Damman grating or a similar element, as described in U.S. Patent Application Publication 2009/0185274, whose disclosure is incorporated herein by reference. 
         [0026]    In some embodiments, projection lens  146  and DOE  144  may be fabricated as a single integrative element. Further alternatively, the lens may be constructed from a stack of lenses similar to camera lenses In the context of the present patent application and in the claims, lens  146  and DOE  144  are referred to collectively as “optics” that project the 2-D layout of the emitters array and generate multiple overlapping replicas of the baseline pattern. In alternative embodiments, the optics may be implemented in any other suitable way. 
       Projected Overlapping Pattern Examples 
       [0027]      FIGS. 2-5  are diagrams that schematically illustrate overlapping pattern configurations, in accordance with embodiments of the present invention. In each of the figures, the left hand side shows a single replica  158  of the projection pattern, with the light spots shown as circles, the center of the lens marked with a cross, and the period of pattern (in case of replication without overlap) marked by a rectangular frame. This layout also corresponds to the baseline pattern that is subsequently replicated by FO DOE  144 . 
         [0028]    The middle of each figure shows a replication scheme  160  carried out by FO DOE  144 , with the center position of each replica marked with “x”. The right hand side of each figure shows a corresponding composite pattern  164  that is projected from DOE  144 . In pattern  164 , the light spots are marked with circles, the center position of each replica is marked with “x”, and the lens center is marked with a cross. 
         [0029]    For ease of comparison, the center of composite pattern  164  in each figure (corresponding to the zero-order of DOE  144 ) is marked with a rectangle. As can be seen clearly in the figures, the density of circles in the area of pattern  164  in which the replicas overlap (i.e., the density of the composite pattern) is higher than the density of circles in baseline pattern  158 . 
         [0030]    In the example of  FIG. 2 , VCSEL array  120  has a uncorrelated, quasi-random layout. The array is designed with the physical minimal distance limitations of the array, but also takes into account that 50% overlap in the y-axis will still reserve minimum distance between the spots. FO DOE  144  performs 3×5 replication, i.e., replicates the baseline pattern three times along one axis (referred to arbitrarily as horizontal according to the orientation of the figure), and five times along the orthogonal axis (referred to as vertical). On the horizontal axis, the FO period (distance between “x” markers in configuration  160 ) is identical to the width of baseline pattern  158 . On the vertical axis, the FO period is half the dimension of the baseline pattern. 
         [0031]    In this example, it can be seen that ⅔ of the projected pattern  164  includes a dense pattern, while on both vertical ends the pattern is sparse since it has no overlap. In this simplified example the sparse pattern occupies a relatively large portion of the pattern, because the example has a small number of replicas. In a real-life projector, the number of replicas is larger and therefore the portion of the sparse pattern out of the total Field of View (FOV) is smaller. With a quasi-random layout it is difficult to demonstrate the overlap effect and the potential for increasing the density vs. enlarging the overlap, since it is very much related to the pattern design. Therefore, the next examples refer to the use of a grid pattern. 
         [0032]    In the example of  FIG. 3 , pattern  158  generated from a VCSEL grid array has a 45° regular grid with a minimal distance of d. FO DOE  144  performs 3×5 replication, with the same horizontal and vertical periods as in  FIG. 2 . In the center of the resulting composite pattern  164 , the number of spots per unit area is doubled, and the distance between spots is d/√{square root over (2)}. 
         [0033]    In  FIGS. 2 and 3 , the overlap ratio between adjacent replicas is 50%. The disclosed techniques, however, are not limited to 50% overlap and can be used with any other suitable (typically larger) overlap ratios. 
         [0034]    In  FIG. 4 , pattern  158  generated from the VCSEL array has a hexagonal grid layout with a minimal available distance of d. FO DOE  144  performs 3×9 replication, with a horizontal FO period identical to the width of the baseline pattern and a vertical FO period equal to a ⅓ of the pattern height. In this constellation the overlap ratio is 66.67%. As a result, the center of the resulting composite pattern  164  has three times more spots per unit area, and a distance between spots of d/√{square root over (3)}. 
         [0035]    In the examples of  FIGS. 2-4  above, the FO DOE creates replicas that overlap only in one dimension (the vertical dimension).  FIG. 5  demonstrates the possibility of introducing overlap in both dimensions, in accordance with an embodiment of the present invention. In the example of  FIG. 5 , baseline pattern  158  has a square lattice layout with minimum distance d. FO DOE  144  performs 5×5 replication, with both the horizontal FO period and the vertical FO period equal to half the geometrical pattern angles. In this configuration the overlap ratio is 50% along each axis. The resulting composite pattern is a square lattice with four times more spots per unit area and a distance of d/2. 
         [0036]    The schemes of  FIGS. 2-4  are depicted purely by way of example. In alternative embodiments, projector  30  can be implemented using any other suitable layout of VCSEL array, and any other suitable FO configuration. 
       Dynamic Control of Composite Pattern Density 
       [0037]    In some scenarios, it is desirable to have dynamic control over the density of the spots in the composite pattern. In some embodiments, projector  30  is able to increase and decrease the spot density by dividing the VCSEL array into segments, and activating or deactivating each segment selectively. 
         [0038]      FIG. 6  is a diagram illustrating dynamic control of projected pattern density, in accordance with an embodiment of the present invention. The left hand side of the figure shows VCSEL array  120  that generates the pattern of  FIG. 2  above. In this example, however, the VCSEL array is divided into two segments denoted A and B. The two segments are isolated from one another by a horizontal groove in the middle of the array. 
         [0039]    Projector  30  comprises control circuitry (not shown in the figure) for driving the VCSELs of each segment separately, e.g., by applying or shutting-off electrical power supply to each segment separately. Thus, the control circuitry may drive only segment A (in which case the VCSELs of segment A emit light and the VCSELs of segment B are dark), drive only segment B (in which case the VCSELs of segment B emit light and the VCSELs of segment A are dark), or drive both segments (i.e., VCSELs of both segments emit light). 
         [0040]    The right hand side of  FIG. 6  shows the resulting patterns that are created by replication using a FO DOE as describe for  FIG. 2  (only the area of the center pattern is shown). Since the FO period is half the pattern width, it is identical to the width of the pattern that is generated by operation only half of the array. Therefore, the replication matches half of the array (on have gaps and no overlap between the tile). Three patterns  170 A . . .  170 C are shown, corresponding to the three above-described modes (denoted “A”, “B” and “A+B”), respectively. As can be seen in the figure, the spot density varies from one mode to another. Since the 2-D pattern of each part (A or B) of the VCSEL array is configured with a different density, the projection patterns shown in  170 A,  170 B,  170 C are sparse, medium and dense, respectively. 
         [0041]    The partitioning of VCSELs into segments shown in  FIG. 6  is an example partitioning, which is depicted purely for the sake of conceptual clarity. In alternative embodiments, the VCSELs may be divided into any suitable number of segments in any desired manner. For example, an array that is designed for 50% overlap in both axes may be divided into four quadrants. Different segments need not necessarily comprise the same number of VCSELs or have similar shapes. 
       Reducing Ambiguity in Depth Estimation when Using Overlapping Spot-Pattern Replicas 
       [0042]    As noted above, in some embodiments the composite pattern projected by projector  30  is used for computing a 3-D map (“depth map”) of the scene or object over which the pattern is projected. Depths can be estimated from a captured image of the projected pattern by measuring the local transverse shift of the pattern, relative to a known reference, at each point in the captured image. The depth coordinate of each point can be calculated by triangulation based on the local transverse shifts of the pattern. The transversal shifts are typically estimated along some epipolar line. 
         [0043]    In the embodiments described above, however, the composite pattern is made-up of multiple shifted replicas of some baseline pattern. As a result a “tile” pattern is duplicated across the FOV with a tile period that is identical to the FO period. Although the composite tile pattern itself is internally designed to be uncorrelated, the entire tile will be highly correlated to the neighboring tiles. As a result the transversal shift is no longer singular, and ambiguity will be created in the solution. In such a case, the resulting depth estimation will be erroneous. Such an ambiguity may occur if the required scanning range causes transversal shifts of the same order or larger than the offsets between adjacent replicas in the composite pattern in the direction of the epipolar line between the camera and projector. 
         [0044]    Assume, without loss of generality, that the epipolar line (over which transversal shifts are measured) is the horizontal axis of the figures. When only vertical overlap is used (such as in  FIGS. 2-4 ) the ambiguity range is defined by the FO horizontal period that is identical to the baseline pattern width. The ambiguity range is half of the baseline pattern width when both vertical and horizontal overlap is used (such as in  FIG. 5 ). It is possible in principle to reduce this ambiguity by enlarging the VCSEL array since the unambiguous angle is defined by the dimension of VCSEL array  120  and the focal length of the lens  146 . This solution, however, is costly for the VCSEL array, adds complexity to the optics, and is not always feasible. 
         [0045]    In some embodiments, FO DOE  144  is designed to overcome the above-described ambiguity. Instead of having the FO diffractive orders Nx,Ny, DOE  144  can be designed with the FO diffractive orders Nx,k·Ny, wherein k=2, 3, . . . . This FO has an interleaved design: Each column still includes only Ny orders but it is offset transversely by one order relative to the neighbor column. This design creates a tiled composite pattern, in which each column of tiles is offset transversely (along the vertical axis) relative to the neighboring column of replicas by an offset that is a fraction of the tile height (vertical-axis). As a result of this offset between replicas, the range of unambiguous depth measurement is effectively increased by a factor of k. 
         [0046]      FIGS. 7 and 8  are diagrams showing examples of FO designs having reduced ambiguity, in accordance with embodiments of the present invention. In both figures, crosses mark the positions of active FO orders. Both FO are configured to 9×9 orders (while the remaining orders are zero) for producing 9×9 replication of the baseline pattern. The crosses also represent the centers of the replicas of the baseline pattern. 
         [0047]    In  FIG. 7 , k=2, meaning that two orders represent the angular dimension of the tile along the vertical axis (the baseline pattern for 50% overlap is four times the FO period). The transversal offset between adjacent replicas in this example is one FO order, which is half the vertical offset between tiles. As can be seen in the figure, the repetition period over the horizontal axis is now two horizontal FO orders. In  FIG. 8 , k=3, meaning that three orders represent the angular dimension of the tile along the vertical axis (the baseline pattern for 50% overlap is six times the FO period). In this example the transversal offset between adjacent replicas is one order, which is ⅓ of the vertical offset between tiles. As can be seen in the figure, the repetition period over the horizontal axis is now three horizontal FO orders. 
         [0048]    The interleaved FO designs shown in  FIGS. 7 and 8  are examples of designs that suppress the unwanted FO orders to zero by design. These examples are depicted purely for the sake of conceptual clarity. In alternative embodiments, the FO may include any number of orders with any interleave number in any desired manner. 
         [0049]    It will thus be appreciated that the embodiments described above are cited by way of example, and that the present invention is not limited to what has been particularly shown and described hereinabove. Rather, the scope of the present invention includes both combinations and sub-combinations of the various features described hereinabove, as well as variations and modifications thereof which would occur to persons skilled in the art upon reading the foregoing description and which are not disclosed in the prior art. Documents incorporated by reference in the present patent application are to be considered an integral part of the application except that to the extent any terms are defined in these incorporated documents in a manner that conflicts with the definitions made explicitly or implicitly in the present specification, only the definitions in the present specification should be considered.