Chip scale integrated scanning LiDAR sensor

In one embodiment, a chip-scale LiDAR device can include a chip with three layers. The first layer includes a number of micromechanical system (MEMS) mirrors. The second layer includes a laser source; a beam splitter connected to the laser source; a number of waveguides, each connected to the beam splitter; and a number of beam deflectors, each beam deflector coupled with one of the number of waveguides. The third layer includes a receiving unit for receiving and processing reflected laser signals of one or more laser beams from the laser source. The first layer, the second layer, and the third layer are vertically attached to each other using either wafer bonding and/or solder bonding.

TECHNICAL FIELD

Embodiments of the present invention relate generally to remote sensing, and more particularly relate to chip-scale LiDAR sensor devices and a method of making such sensor devices.

BACKGROUND

A LiDAR device can measure distances to objects in an environment by illuminating the objects with laser pulses and measuring reflected pulses from the objects. LiDAR devices typically utilize high-grade optics and a rotating assembly to create a wide field of view, but such implementation tends to be bulky and costly. Solid-state LiDAR sensors tend to be less costly but still may have large dimensions.

In many systems, such as advanced driver assist systems (ADAS), small-dimension solid state LiDAR sensors would be preferred, since such LiDAR sensors can provide a number of desired advantages, including higher sensor reliability, longer lifetime, smaller dimension, lower weight, and lower cost.

SUMMARY

In one embodiment, a chip-scale LiDAR device can include a chip with three layers. The first layer includes a number of micromechanical system (MEMS) mirrors. The second layer includes a laser source, a beam splitter connected to the laser source, a number of waveguides, each connected to the beam splitter, and a number of beam deflectors, each beam deflector coupled with one of the number of waveguides. The third layer includes a receiving unit for receiving and processing reflected laser signals of one or more laser beams from the laser source. The first layer, the second layer, and the third layer are vertically attached to each other using either wafer bonding and/or solder bonding.

The other functions and advantages of various embodiment of the invention will be apparent from the accompanying drawings and from the detailed description that follows.

DETAILED DESCRIPTION

The following description and drawings are illustrative and are not to be construed as limiting. Numerous specific details are described to provide a thorough understanding of various embodiments. However, in certain instances, well-known or conventional details are not described in order to provide a concise discussion of the embodiments.

Described herein are various embodiments of a chip-scale LiDAR device and a method of making such a LiDAR device. The various embodiments enable high-volume manufacturing of such LiDAR devices for applications where cost, weight, power and form factor are constrained.

According to one aspect of the invention, a chip-scale LiDAR device can include a chip with three layers. The first layer includes a number of micromechanical system (MEMS) mirrors. The second layer includes a laser source, a beam splitter connected to the laser source, a number of waveguides, each connected to the beam splitter, and a number of beam deflectors, each beam deflector coupled with one of the number of waveguides. The third layer includes a receiving unit for receiving and processing reflected laser signals of one or more laser beams from the laser source. The first layer, the second layer, and the third layer are vertically attached to each other using either wafer bonding and/or solder bonding.

In one embodiment, the second layer and the third layer are attached to each other using wafer bonding, and the first layer and the third layers are attached to each other using solder bonding. One or more spacers are used between the first layer and the third layer to create spacing between the first layer and the second layer, such that the laser beams from the laser source in the second layer can be directed to their respective MEMS mirrors on the first layer.

In an alternative embodiment, the first layer and the second layer are directly attached to each other without using any spacers between the first layer and the third layer. In this embodiment, the first layer can be a glass panel with a predetermined thickness; the thickness of the glass panel enables the laser beams from the laser source in the second layer to be directed to their respective MEMS mirrors on the first layer.

In one embodiment, there can be an equal number of MEMS mirrors, waveguides, and beam deflectors. Each waveguide can correspond to a different one of the number of beam deflectors, and each beam deflector can correspond to a different one of the number of MEMS mirrors. Each of the number of beam deflectors is to deflect one or more laser beams from the laser source out of plane from the second layer to a corresponding MEMS mirror on the first layer. The one or more laser beams are guided from the laser source to the beam deflector through a corresponding waveguide. Each of the number of MEMS mirrors is coupled to one or more actuators, which are configured to scan the MEMS mirror in a zigzag or spiral pattern to steer laser beams from the laser source to one or more different directions.

In one embodiment, the receiving unit in the third layer includes a spatial filter, on which an aperture is dynamically created based on one or more directions that each of the MEMS mirrors on the first layer is scanning, the aperture enabling photons reflected from the one or more directions to pass through the spatial filter.

According to another aspect of the invention, a method of making a chip-scale light detection and ranging (LiDAR) device includes fabricating a first wafer with a number of dies, each die with a photonic integrated circuit (PIC) formed thereon. Each PIC includes a laser source, a beam splitter connected to the laser source, and a number of waveguides, each waveguide being connected to the beam splitter. Each PIC also includes a number of beam deflectors, each beam deflector coupled with one of the number of waveguides. The method further includes fabricating a second wafer with the number of dies, each die including a number of single-photon avalanche diodes (SPADs) formed thereon, and each die configured to receive and process reflected laser signals of one or more laser beams from the laser source; attaching the first wafer and the second wafer back to back to create an integrated wafer; and dividing the integrated wafer into a number of integrated dies.

In one embodiment, the method further includes fabricating a third wafer with multiple dies, each die with a micromechanical system (MEMS) mirror formed thereon; and dividing the third wafer into different dies. The method further includes attaching one or more of the multiple dies to a glass panel; and attaching the glass panel to one of the number of integrated dies. In one embodiment, the glass panel and the integrated die are attached to each other using solder bonding.

The above summary does not include an exhaustive list of all aspects of the present invention. It is contemplated that the invention includes all systems and methods that can be practiced from all suitable combinations of the various aspects summarized above, and also those disclosed in the Detailed Description of the disclosure.

Solid State LiDAR Device

FIG.1illustrates an example LiDAR device in which embodiments of the invention can be implemented in accordance with an embodiment.

The example LiDAR device can be a solid state LiDAR device101, which can measure distances to objects in an environment by illuminating the objects with laser pulses. Differences in return times of the reflected laser pulses and wavelengths can be used to create a point cloud of the environment. The point cloud can provide spatial location and depth information, for use in identifying and tracking the objects.

As shown inFIG.1, the LiDAR device101can include a laser pulse emitting unit104, a laser pulse scanner105, a laser pulse receiving unit109, and a controlling unit107. The laser pulse emitting unit104can include one or more laser emitters that emit beams of short pulses of laser light including photons of various frequencies.

For example, inFIG.1, the laser pulse emitting unit104emits a beam of outgoing laser pulses113. The beam of outgoing laser pulses113can be steered or scanned by the laser pulse scanner105in one or more directions using a variety of mechanisms, including microelectromechanical system (MEMS) mirrors, and one or more optical phased arrays (OPA). Each of the one or more directions can be referred to as a steering direction or a scanning direction. A vertical angle and a horizontal angle associated with each steering direction can be referred to as a steering angle or a scanning angle respectively. The laser pulse scanner105can steer one or more beams of laser pulses in a steering direction. Each beam of laser pulses can have a fixed number of pulses.

The controlling unit107can include control logic implemented in hardware, software, firmware, or a combination thereof. The controlling logic107can drive the other units or subsystems104,105and109of the LiDAR device101in a coordinated manner, and can execute one or more data processing algorithms to perform one or more operations for signal filtering and object detection. For example, the controlling unit107can synchronize the laser pulse emitting unit104and the laser pulse scanner105so that the laser pulse scanner105can scan a horizontal field of view in multiple lines.

The laser light receiving unit109can collect one or more beams of laser pulses (e.g., beam of laser pulses112) reflected from a target object103using one or more imaging lens (e.g., imaging lens115), and focus the beams of laser pulses on one or more photodetectors (e.g., photodetector117). Each photodetector can be a high-sensitivity photodiode, for example, a linear mode avalanche-photodiode (APD) or a single-photon avalanche diode (SPAD). The one or more photodetectors can convert photons in the reflected beam of laser pulses into electricity. The laser pulse receiving unit109can send returned signals incident on each photodetector to the controlling unit107for processing.

In one embodiment, laser diodes in the laser pulse emitting unit104can operate in a pulsed mode with a pulse repeating at a fixed interval (e.g., every few micro-seconds). The laser diodes and laser drive circuits for providing appropriate bias and modulation currents for the laser diodes can be chosen according to predetermined performance parameters of the LiDAR device101. Examples of the performance parameters can include a required maximum range of scanned space and resolution.

Dynamic Spatial Filter

In the example LiDAR device illustrated inFIG.1, various types of noises (e.g., ambient light and electronic noises) can negatively impact the SNR of the LiDAR device101. When the laser pulse receiving unit109receives scattered ambient light, the photodetectors (e.g., photodetector117) can be saturated, particularly when the ambient light is sunlight, which tends to have an enormous power on a broad range of wavelengths. The sunlight-induced noises can be orders of magnitude higher than weak LiDAR signals, for example, laser pulses reflected from bright surfaces such as landmass, snow and thick clouds.

To increase the detection range of a LiDAR device, techniques for robust rejection of ambient light and high-speed acquisition of returned signals can be used. However, due to the lack of a mechanical rotating scanner and a mechanical detector scanner in a solid state LiDAR device, some ambient light filtering techniques that are effective in an electromechanical LiDAR device may not be feasible in a solid state LiDAR device.

For example, in an electromechanical LiDAR device, one ambient light filtering technique is to use a single avalanche photodiode (APD) or a small number of APDs as a photodetector, which can effectively function as a natural spatial filter due to its small dimensions because any photons not incident on the photodetector are automatically filtered out. The natural spatial filter would work in an electromechanical LiDAR device due to the presence of a mechanical rotating scanner and a mechanical detector scanner in the electromechanical LiDAR device. The mechanical rotating scanner and a mechanical detector scanner would accurately direct desired signals reflected from a large reflection surface to the photodetector, whose photon multiplication gain can further improve signal-noise ratios (SNR) of the electromechanical LiDAR device, thereby increasing its detection ranges.

In a solid state LiDAR device such as the LiDAR device101, however, it would be difficult to use a single APD or a small number of APDs as a natural spatial filter because a solid state LiDAR device does not have a mechanical rotating scanner or a mechanical detector scanner. Such a solid state LiDAR device therefore would miss signals reflected from a target object with a large reflection surface. Although an APD pixel array (e.g., a 2-D focal plane array) could be used to compensate for the lack of a mechanical laser scanner and a mechanical detector scanner to enable a solid state LiDAR device to receive more reflected signals from a large reflection surface, such a pixel array would lose its natural spatial filtering capability due to its large size. Further, some APD pixel arrays (e.g., a linear mode APD pixel array) would be technically difficult and prohibitively expensive to make.

Therefore, to increase the detection ranges of a solid state LiDAR device such as the LiDAR device101, a 2-D pixel array of Geiger-mode single-photon avalanche diodes (SPADs) would be used as photodetectors, coupled with a separate dynamic spatial filter positioned before the 2-D pixel array. The 2-D pixel array of SPADs can include multiple columns of SPADs, with each column of SPADs connected in parallel in the vertical direction. A simple 2-D SPAD array with a single column of SPAD would be undesirable, because a solid state LiDAR device with such a simple SPAD array as photodetectors would require each vertical steering angle of the laser pulse scanner to correspond to a single SPAD on the simple SPAD array. Such a configuration therefore would have a number of drawbacks. For example, in such a configuration, each SPAD as a photodetector would need a time-to-digital converter (TDC), which reduces the fill factor of the active area on the photodetectors. Further, in such a configuration, each SPAD photodetector, which has a non-negligible dead time, may miss reflected photons due to dark events and/or ambient light.

In a 2-D pixel array as disclosed herein, however, one TDC can be used for a column of SPADs, thereby increasing the fill factor of the active area. Further, using a column of SPADs instead of one SPAD as a photodetector for a vertical steering angle can avoid missing reflected photons due to the dead time associated with each SPAD photodetector.

In one embodiment, the spatial filter can be dynamically turned on and turned off based on the current steering directions or steering angles of the LiDAR device, and therefore can effectively block ambient light and other noises from directions other than the current steering directions. Signals that do pass through the spatial filter are directed to one or more columns of the 2-D pixel array. The combination of the large-dimension 2-D pixel array and the dynamically configured spatial filter can compensate for the lack of mechanical laser scanners and mechanical detector scanners in a solid state LiDAR device. Such a combination can increase the device's SNR without requiring a substantial increase in manufacturing cost.

As used herein, a steering direction refers to a combination of a vertical steering angle and a horizontal steering angle from which reflected pulses are entering the laser receiving unit of a LiDAR system, or in which emitted laser pulses are steered. For example, the combination of a vertical angle of 5 degrees and a horizontal angle of 0 degree is considered as one direction, while the combination of the vertical angle of 5 degrees and a horizontal angle of 5 degrees is considered as another direction. In this disclosure, a scanning angle and a steering angle are used interchangeably, and scanning laser pulses and steering laser pulses are also used interchangeably.

The various aspects, implementations, and embodiments described in this disclosure can also overcome the dead time issue associated with SPADs. By directing beams of incoming laser pulses from different directions to different columns of the 2-D pixel array, a column of SPADs in the pixel array can have sufficient time to recover to its original state after registering a photon, and to become ready to register another photon from a different direction.

FIG.2illustrates an example LiDAR device with a dynamical spatial filter in accordance with an embodiment.

As shown inFIG.2, the laser pulse receiving unit109can include one or more imaging lens (e.g., imaging lens202), a spatial filter201, an optical relay lens (e.g., a cylindrical lens)212, and a 2-D SPAD array213. The spatial filter201can be placed at the image plane of the imaging lens202, and can be implemented using an electrochromic display, an array of micromechanical mirrors, a liquid crystal display (LCD) in combination with a polarizer, and an electro-wetting display. The spatial filter201can include an array of segmented areas, with each segmented area representing an optical transmission area capable of being turned on and turned off.

In one embodiment, when the spatial filter is implemented using a LCD, turning a segmented area on would change the segmented area from a low optical transmission area to a high optical transmission area. Conversely, turning-off a segmented area would change the segmented area from a high optical transmission area to a low optical transmission area. A high optical transmission area would allow signals and noises from one or more known directions to pass through the spatial filter201, whereas a low optical transmission area would substantially block signals and noises reaching the area.

In one embodiment, the spatial filter201can be configured to block only signals and noises with certain wavelengths (e.g., wavelengths in a predetermine range) at a low optical transmission area, or allow signals and noises with certain wavelengths to pass through a high optical transmission area.

Each segmented area can correspond to a particular direction from which signals and noises enter the laser pulse receiving unit109, and can correspond to a pixel of an image to be formed from a target object. Alternatively, multiple segmented areas can correspond to a pixel of the image.

One or more segment areas on the spatial filter201can be dynamically turned on to create an aperture based on the manner the laser pulse scanner105is steering laser pulses.

For example, when the laser pulse scanner105steers laser pulses both horizontally and vertically, a single segmented area can be turned on in response to the laser pulse scanner105steering a beam of outgoing laser pulses in a direction corresponding to the single segmented area. When a beam of outgoing laser pulses (e.g., the beam of outgoing laser pulses203) is steered in a direction of vertical N degrees and horizontal M degrees, a corresponding beam of reflected laser pulses (e.g., the beam of reflected laser pulses205) can enter the laser pulse receiving unit109from that direction. The controlling unit107can operate to turn on a corresponding segmented area on the spatial filter201so that that segmented area would function as an aperture211. The controlling unit107can coordinate the position of the aperture211and the steering directions of the laser pulse scanner105so that the imaging lens202can focus the beam of reflected laser pulses205to the aperture211. After passing through the aperture211, the beam of reflected laser pulses205can be projected by the optical relay lens212as a laser stripe onto a column of the 2-D SPAD array213. The column of the 2-D SPAD array213can be preconfigured to receive reflected signals from a particular horizontal angle. Noises such as ambient light from all other directions other than the direction corresponding to the aperture would be blocked.

As another example, when the laser pulse scanner105steers beams of laser pulses vertically only, multiple segmented areas can be turned on as a single unit to constitute the aperture211. As such, the aperture211would correspond to a vertical angle (e.g., vertical N degrees). The number of segmented areas to be turned on as the aperture211can be determined based on a predetermined resolution of the LiDAR device. The more segmented areas to be turned on for each vertical steering angle, the higher the resolution of the LiDAR device. Each of the number of turned-on segmented areas further corresponds to a horizontal angle (e.g., horizontal M degrees) at that vertical angle.

In this example, the beam of outgoing laser pulses203represents all the outgoing laser pulses emitted at that vertical steering angle. In one implementation, the outgoing laser beam203can be expanded horizontally by a diffractive optical element (e.g., a diffractive diffuser) or a cylindrical lens. Accordingly, the beam of reflected laser pulses205reflected from the horizontally expanded laser beam203can represent all reflected laser pulses from that vertical steering angle. A portion of the reflected laser pulses205can pass through one of the turned-on segmented areas in the aperture211. The portion of the beam of reflected laser pulses205corresponds to a horizontal steering angle at the vertical steering angle, and can be projected as a laser stripe on a column in the 2-D SPAD array213, as configured or programmed by the controlling unit107. Therefore, the beam of reflected laser pulses205at that vertical angle would be projected by the optical relay lens212as multiple laser stripes on multiple columns in the 2-D SPAD array213.

The spatial filter201can dynamically change the location of the aperture211based on the vertical steering angle of an outgoing laser beam or based on a combination of the vertical steering angle and a horizontal steering angle of the laser beam. The capability of the spatial filter201in rejecting noises can be determined by an extinction ratio, defined as a ratio between a number of segmented areas in the aperture211and a total number of segmented areas in the whole spatial filter201.

In one embodiment, the time it takes for a segmented area to be turned on or turned off or vice versa can determine the refresh rate of the LiDAR device101. For example, the LiDAR device101can turn on or turn off a segmented area with a time period ranging from sub-milliseconds to a few milliseconds.

In one embodiment, the 2-D SPAD array213can include SPADs that are connected in parallel in the vertical direction but individually addressable in the horizontal direction. The 2-D SPAD array213can provide a column of SPADs operating in the Geiger mode for each horizontal steering angle at a given vertical steering angle, to reduce detection dead time.

In one embodiment, the controlling unit107can be programmed to schedule vertical scans in such a manner that laser pulse scanner105does not scan laser pulses in a next vertical steering angle before the controlling unit107completes reading out output signals from a current vertical scan and before a predetermined number of SPADS (e.g., all SPADs) in the 2-D SPAD array213passes their dead time.

In one embodiment, the controlling unit107can perform one or more data processing algorithms to process data output from the 2-D SPAD array213. The output intensity of the 2-D SPAD array213is proportional to the number of photons returned to the imaging lens202. The controlling unit107can show multiple photons returned within a particular time frame (e.g., 2-4 ns) as a higher amplitude electrical pulse for an analog detection system, or as a higher count in a system with an integrated time-to-digital converter (TDC), thereby distinguishing one or more events from detector noise of the 2-D SPAD array213and from ambient light, since the detector noise and the ambient light tend to be relatively uniform in terms of the number of photons within a certain frame.

The dynamic spatial filter201described above can work in conjunction with the controlling unit107and one or more other subsystems in the LiDAR device101to reduce noises reaching the photodetectors by rejecting noises from directions other than the one or more directions corresponding to the aperture211in the spatial filter201. Since ambient light and shot noise are positively related, reducing ambient light can also reduce shot noise. The reduction of noises coupled with the relatively unchanged reflected laser signals would increase the SNR of the LiDAR device101.

To further increase the SNR of the LIDAR device101, the controlling unit107can be programmed to reject noises that the spatial filter201is not able to block. Such noises can include ambient light and any other types of noises passing through the aperture211; and residue ambient light reaching the 2-D SPAD array213through the turned-off segmented areas of the spatial filter201, as a turned-off segmented area may not block 100% of lights of all wavelengths.

In one embodiment, the controlling unit107can perform a signal analysis on the output data from the 2-D SPAD array213using a predetermined signal analysis algorithm215. The signal analysis algorithm215can detect a fixed temporal pattern of laser pulses for each range of detection, and use the fixed temporal pattern to identify reflected laser pulse signals from the data output of the 2-D SPAD array213.

As an illustrative example, the laser pulse emitting unit104emits a fixed number of laser pulses for each detection range; and for the given laser pulse emitting unit104, temporal intervals between the laser pulses in a laser beam tend to be relatively fixed. These temporal intervals can form a temporal pattern that does not change from one range detection to another. The controlling unit107can use the temporal pattern to identify reflected laser pulse signals. Photons that do not match the temporal pattern are more likely to be noises and can be discarded.

FIGS.3A and3Billustrate an example embodiment of the LiDAR device101as shown inFIG.2.

As shown inFIGS.3A and3B, the laser pulse scanner105of the LiDAR device101as shown inFIG.2is steering laser pulses both vertically and horizontally. Accordingly, a single segmented area in row X309on a spatial filter301is turned on to operate as aperture A307in response to the laser pulse scanner105steering outgoing laser pulses in the direction of a vertical angle of X degrees and a horizontal angle of A degrees. The aperture A307would allow a beam of reflected pulses305from the direction to pass through the spatial filter301, as shown inFIG.3A.

InFIG.3B, the laser pulse scanner105steers laser pulses at a different horizontal angle (e.g., horizontal angle of B degrees) for the vertical angle of X degrees. In response, a different segmented area is turned on to operate as aperture B321to allow a beam of reflected pulses306from the direction of the vertical angle of X degrees and the horizontal angle of B degrees to pass through the spatial filter301. While the laser pulse scanner105is scanning at this particular direction, the aperture A307corresponding to the previous scan direction can be turned off. Therefore, in this particular embodiment, only one segmented area in the spatial filter301can be in an ON state to function as the aperture at any particular time.

Similarly, a segmented area322immediately next to aperture B321can be turned on to operate as the next aperture to allow reflected laser pulses from a next steering direction to pass through the spatial filter301. The above process can be repeated until the laser pulse scanner105completes scanning at the vertical angle of X degrees. The number of segmented areas in each row of the spatial filter301can be determined based on a predetermined resolution of an image of a target object. Each segmented area can correspond to one pixel in the image of the target object.

Reflected laser pulses passing through each aperture can be projected by the optical relay lens212on different columns317and323as different laser stripes315and325on the 2-D SPAD array213.

The controlling unit107can be programmed to read out data from a column on the 2-D SPAD array213corresponding to a previous steering direction as soon as the laser pulse scanner105starts to scan laser pulses in a next steering direction. Alternatively, the controlling unit107can be programmed to read out data from the whole 2-D SPAD array213after the laser pulse scanner105has completed steering laser pulses at the vertical angle X.

The laser pulse scanner105can scan laser pulses at different vertical angles corresponding to row Y310and row Z311in the same manner that the laser pulse scanner105has scanned laser pulses at the vertical angle X.

The controlling unit107can be programmed to synchronize the position of each aperture on the spatial filter301with each scan direction, and project laser pulses passing through each aperture as different laser stripes on different columns on the 2-D SPAD array213.

FIG.4illustrates another example embodiment of the LiDAR device101shown inFIG.2.

As shown inFIG.4, outgoing beams of laser pulses are steered vertically only, with each outgoing beam of laser pulses (e.g., outgoing laser beam406with a beam height418) at a particular vertical steering angle (e.g., vertical angle X) being horizontally expanded in an angular manner by a diffractive optical element or a cylindrical lens. A divergence angle417of the horizontally expanded laser beam can be determined by a predetermined field of view (FOV) and a predetermined detection range.

For each vertical steering angle, a row of segmented areas (e.g., row X309) on the spatial filter301can be turned on to operate as an aperture for that vertical steering angle. A beam of reflected laser pulses404reaching the spatial filter301from that vertical steering angle can pass through each of the segmented areas401,403and405in the row. The optical relay lens (e.g., a cylindrical lens)212can project the laser pulses that have passed through the spatial filter301onto different columns407,409and411of the 2-D SPAD array213as different laser stripes413,415, and416. A complete 3D point cloud of a target object can be produced with a single scan along a vertical axis in the LiDAR device101.

In one embodiment, a segmented area on the spatial filter301can correspond to a pixel of a LiDAR image of a target object and to a steering direction. The LiDAR device101can steer laser pulses in a range of steering directions (horizontal angles at a particular vertical angle) in parallel, thus increasing the system's data throughput and reducing the refresh rate of the LiDAR device. In comparison, the LiDAR device described inFIGS.3A-3Bcould be limited by the speed of the laser pulse scanner, and/or the speed at which segmented areas on the spatial filter can be turned on and turned off. The LiDAR device inFIGS.3A-3Balso may have a higher refresh rate.

In one embodiment, the LiDAR device101can have a bi-axial LiDAR configuration, and can have the laser pulse scanner105and a detection system placed in a same orientation as the beam expansion direction to reduce blind spots.

FIGS.5A-5Billustrate an example implementation of a spatial filter in accordance with an embodiment. The spatial filter implemented here can be the spatial filter illustrated inFIG.2,FIGS.3A and3B, andFIG.4.

Referring toFIG.5A, a LCD-based spatial filter500includes an aperture layer between two transparent electrode layers503and507. The aperture layer can be a liquid crystal layer505. A first linear polarizer layer501and a second linear polarizer layer509are respectively placed on the top of the first transparent electrode layer503and below the second transparent electrode layer507. In one embodiment, ferroelectric liquid crystal can be used for the liquid crystal layer505due to the fast switching nature of ferroelectric liquid crystal and its natural binary state. In another embodiment, a different type of liquid crystal can be used. Unlike ferroelectric liquid crystals, other types of liquid crystals change the polarization of incoming beams of laser pulses to a degree that is largely proportional to a voltage applied.

The first transparent electrode layer503can be created by attaching multiple transparent horizontal electrode bars to a common physical structure. These horizontal electrode bars can be positioned parallel to each other. In one embodiment, the electrode bars can be parallel to the surface of an integrated circuit on which the laser pulse receiving unit109is implemented. The layer of transparent electrode bars503can face the imaging lens202as shown inFIG.2,FIG.3A,FIG.3BandFIG.4. Horizontal electrode bar513is an example of the multiple transparent electrode bars.

The second transparent electrode layer507can be created by attaching to the common physical structure multiple transparent electrode bars that are vertical to the electrode bars in the first transparent electrode layer503. Vertical electrode bar511is an example of the transparent electrode bars in the second transparent electrode layer507. Each of the vertical electrode bars and the horizontal electrode bars can be made of Indium tin oxide (ITO) or titanium dioxide (TiO2).

Each vertical electrode bar at the layer507can cross each horizontal electrode bar at the layer503. A section where a vertical electrode bar and a horizontal electrode bar cross each other corresponds to a pixel area on the liquid crystal layer505. The pixel area on the liquid crystal layer505is the segmented area on the spatial filter500that can be dynamically turned on and turned off.

FIG.5Bshows such a segmented area515, an area on the liquid crystal layer505that corresponds to the area where the horizontal electrode bar513and the vertical electrode bar511cross each other.

In one embodiment, to turn on the segmented area515, the controlling unit107as shown inFIG.2can apply a first voltage (e.g., 10 V) to the horizontal electrode bar513, and apply a second voltage (e.g., −10 V) to the vertical electrode bar511. The difference between the two voltages would transform the liquid crystal at the segmented area515into a capacitor. Due to the temporary presence of the capacitor, the polarization of laser pulses that pass through the segmented area515can remain unchanged. As a result, the liquid crystal at the segmented area515can function as a high optical transmission area (i.e., an aperture) on the spatial filter500. When the first voltage is applied to the horizontal electrode bar513and the second voltage is applied to each vertical electrode bar in the layer507, a whole row of segmented areas can be turned on to function as an aperture corresponding to a vertical steering angle.

To turn off the segmented area515that has been turned on in the manner described above, the voltages applied to the horizontal electrode bar513and the vertical electrode bar in the layer511can be stopped. Without a voltage applied to the horizontal electrode bar513, the polarization of an incoming beam of laser pulses can be configured to be rotated by 90 degrees by the liquid crystal in the segmented area513after passing the first polarizer layer501. The beam of laser pulses whose polarization has been rotated by 90 degrees would be blocked by the second polarizer layer509.

Similarly, a whole row of segmented areas can be turned off by stopping applying voltages to the electrode bars used to form the row of segmented areas. It would be appreciated by those skilled in the art that a segmented area would be in an off-state in the first place if no voltage is applied to a vertical electrode bar and to a horizontal electrode bar that forms the segmented area.

FIG.6is a block diagram illustrative of a side view of an example chip-scale LiDAR device in accordance with one embodiment.

As shown inFIG.6, a chip-scale LiDAR device601includes a chip602with a MEMS mirror layer611, a photonic integrated circuit (PIC) layer605and a SPAD layer604. The PIC layer605can include a laser source, a beam splitter, and a number of waveguides. Laser beams emitted by the laser source can be directed to a number of MEMS mirrors608and610in the MEMS mirror layer611. The MEMS mirrors608and610can steer the laser beams617and623to a target object. A proportion of each laser beam is reflected from the target object as incoming laser beams619and621into the SPAD layer, which turns the reflected laser beams into electric signals.

The chip-scale LiDAR device601further includes a printed circuit board (PCB)613that supplies power through a number of wires603to the chip602; and controls the motion of the MEMS mirrors608and610using field programmable gate arrays (FPGA).

As further shown, a number of spacers607and612can be provided between the MEMS mirror layer611and the SPAD layer604to create spacing between the MEMS mirror layer611and the SPAD layer604. Since the PIC605and the SPAD layer604are attached to each other via wafer bonding, the spacers607and612also create spacing between the PIC layer605and the MEMS mirror layer611, enabling laser beams from the laser source on the PIC layer605to be directed to a corresponding MEMS mirror on the MEMS mirror layer611. For example, there can be a spacing of 0.5-1 mm between the PIC layer604and the MEMS mirror layer611.

In one embodiment, the SPAD layer604can have larger dimensions than the PIC layer605. The size of the dimensions determines the field of view of the chip-scale LiDAR device601, while the dimensions of the PIC layer605are related to the cost. Typically, the larger the PIC layer605, the more expensive to make the PIC layer. Therefore, to ensure a large field of view and a lower cost, the dimensions of the SPAD layer604are larger than the dimensions of the PIC layer605.

Since the SPAD layer604faces towards a lens615, after the SPAD layer604is bonded back to back to the PIC layer605, there can be spaces on the back of the SPAD layer604that are not covered by the PIC layer605. The uncovered area can be used to support spacers. In one implementation, there can be three or more spacers between the SPAD layer604and the MEMS mirror layer611.

FIG.7is a block diagram illustrative a side view of another example chip-scale LiDAR device in accordance with one embodiment. InFIG.7, instead of using spacing created by spacers for directing laser beams to their respective MEMS mirrors, the MEMS mirror layer611can have a thickness that is approximately equal to the spacing created by the spacers between the PIC layer605and the MEMS mirror layer611. Since the MEMS mirror layer611is a glass or another transparent material, the thickness of the MEMS mirror layer611would enable laser beams from the laser source on the PIC layer605to be directed to a corresponding MEMS mirror on the MEMS mirror layer611.

FIG.8further illustrates the example chip-scale LiDAR device in accordance with one embodiment. The SPAD layer604can be a silicon die fabricated with a plurality of photodetector circuitries. In one embodiment, the SPAD layer604can include a number of SPAD arrays, such as the SAPD array213as described inFIG.2.

The PIC layer605can also be a silicon die that includes a laser source807, a beam splitter809, and a number of waveguides811,812,815, and817. Each waveguide can be a physical structure that guides laser beams with minimal loss of energy by restricting expansion of the laser beams to one dimension or two.

In one embodiment, the laser source is a laser diode that may operate in the pulsed mode with a pulse repeating every few micro-seconds. The characteristics of laser and laser drive circuits used in the example chip-scale LiDAR device may be chosen according to the desired performance parameters of LiDAR device, for example, the required maximum range of scanned space and resolution.

In the embodiment, each waveguide is connected to the beam splitter809on one end and connected to one of multiple beam deflectors819,822,823, and825on the other end. The beam splitter809is an optical device that splits each of the laser beams directly from the laser source807into multiple laser beams. Each of the split laser beams may have less optical power than the original laser beams directly from the laser source807.

Each beam deflector can deflect the laser beams from the corresponding waveguide out-of-plane of the PIC layer605at a predetermined fixed angle towards a corresponding MEMS mirror on the MEMS mirror layer611. Each beam deflector can be a grating, a mirror, a prism, or any combination thereof. In one embodiment, the PIC layer605can include two or more laser sources, with each laser source coupled to a different deflector.

The MEMs mirror layer611, which is transparent, can be made of glass or any other transparent materials, and can include a number of MEMS mirrors826,827,829, and831, and833. Each MEMS mirror can be coupled with one or more two-dimensional actuators that are controlled by a Field Programmable Gate Array (FPGA) subsystem. An example of such a FPGA subsystem can be 12-bit. A different pair of channels of the FPGA system can be used to control X and Y axis of each MEMS mirror. The FPGA subsystem can provide rotations up to a predetermined degree (e.g., up to ±20°) about each axis, and can steer each MEMS mirror in a zigzag or spiral pattern. With the FPGA operating as such, a pair of deflector and a corresponding MEMS mirror can cover azimuthal (i.e., horizontal) and altitudinal (i.e., vertical) optical angles of a variety of sizes. The angles of the MEMS mirror and timing of the corresponding beams of laser pulses can be used by the FPGA subsystem to track azimuthal and altitudinal angles of out-going beams of laser pulses.

In one embodiment, the deflector819and the MEMS mirror826can form a pair, the deflector822and the MEMS mirror827can form a pair, the deflector823and the MEMS mirror829can form a pair, and the deflector825and the MEMS mirror831can form a pair. Each pair of deflector and MEMS mirror cover up to a specific range of angles, e.g., up to 32° of azimuthal and altitudinal optical angles. All the pairs of deflector and MEMS mirror in combination can cover a desirable range of angles.

FIG.8uses the deflector825and the MEMS mirror831to illustrate a typical path of a laser beam. As shown in the figure, a laser beam emitted by the laser source807is split into multiple laser beams, with one of the split laser beams guided by the waveguide817to the deflector825, which directs the laser beam to the MEMS mirror831. The MEMS mirror831is controlled by one or more actuators to steer the outgoing laser beam837at a desired angle. After the outgoing laser beam hits a target object, a proportion of the laser beam839is reflected and received by the SPAD array on the side of the SPAD layer604that is opposite to the side of the PIC layer605.

FIG.9further illustrates another example chip-scale LiDAR device in accordance with an embodiment. As shown, the SPAD layer604includes a spatial filter902and an optical relay lens910as described inFIG.2,FIGS.3A-3BandFIG.4.

As the MEMS mirrors826,827,829and831direct laser beams901,903,905and907to one or more target objects, reflected laser beams may pass through dynamically created apertures on the spatial filter902to be incident on SPAD arrays on the SPAD layer604.

As further shown, a number of spacers (e.g., spacers911,912, and913) can be used to create spacing between the SPAD layer604and the spatial filter902, such that the optical relay lens910can project the reflected laser beams902,904,906, and908that have passed through the spatial filter902onto different columns of the SPADs on the SPAD layer604.

FIGS.10A-10Eillustrate a process of making a chip-scale LiDAR device in accordance with an embodiment.

InFIG.10A, a silicon wafer1001can be fabricated with a number of dies (e.g., die1037) thereon, each die representing the SPAD layer described above. Although the wafer1001shows only 9 dies, the number of dies on the silicon wafer1001can be up to tens of thousands. As further shown, a silicon wafer1005with a number of PIC dies (e.g., die1006) can be also be fabricated, with the number of dies thereon being equal to the number of dies on the silicon wafer1001.FIG.10Aalso shows a silicon wafer1003with a number of dies, each with an MEMS mirror (e.g., MEMS mirror1004) fabricated thereon.

InFIG.10B, the silicon wafer1001can be flipped and aligned with the silicon wafer1005, such that the silicon wafer1001and the silicon wafer1005can be attached to each other back to back using wafer bonding techniques in low temperatures. In one embodiment, bonding bumps in the corresponding bonding pads on the back of the wafer1001(e.g., bonding pad1007) and on the back of the wafer1005can be melted to bond the two wafers together.

InFIG.10C, the two wafers1001and1005, which have been integrated at the wafer level, can be cut into a number of 3D integrated dies1015-1031, with each 3D integrated die including a PIC die and a SPAD die.

InFIG.10D, the silicon wafer1003can be cut into a number of dies, with each die including a MEMS mirror. The number of MEMS mirrors on the wafer1003vary with the size of the silicon wafer1003. In one embodiment, a set of MEMS mirrors can be glued to a glass panel1041using polymer-based adhesives. The number of MEMS mirrors in the set of MEMS mirrors is equal to the number of waveguides in the PIC die.

InFIG.10E, markings can be made on both the silicon glass panel1041with the MEMS mirrors glued thereon, and on the back of the SPAD die of the 3D integrated die1025. The glass panel1041and the 3D integrated die1025can be attached to each other using solder bonding, with a number of spacers at the markings to separate the glass panel1041and the integrated die1025.

In one embodiment, if the glass panel1041is sufficiently thick, no spacers are needed between the glass panel1041and the SPAD die; the glass panel1041can be attached directly to the PIC die using solder bonding.

FIG.11illustrates an example process1100of making a chip-scale LiDAR device in accordance with an embodiment.

In block1101, a first wafer with a number of photonic integrated circuit (PIC) dies thereon, wherein each die includes a laser source; a beam splitter connected to the laser source; a number of waveguides, each waveguide connected to the beam splitter; and a number of beam deflectors, each beam deflector coupled with one of the number of waveguides. In block1102, a second wafer with a number of dies is fabricated, where each die has multiple single-photon avalanche diodes (SPADs) thereon for receiving and processing reflected laser signals of one or more laser beams from the laser source. In block1103, the first wafer and the second wafer are attached back to back to create an integrated wafer. In block1104, the integrated wafer is divided into a number of integrated dies.