Patent Description:
The present application relates to the technical field of acquiring 3D information about an object, and in particular to a 3D information detection device.

With the development of technology, the visual performance of machines is getting better and better. The image acquisition device of a machine is the core component of the machine, which determines the positioning accuracy of the machine. In the field of machine vision, ordinary image acquisition devices can only obtain two-dimensional information about objects, but cannot obtain 3D (<NUM> Dimensions) information about objects, which obviously cannot meet actual requirements.

In order to obtain 3D information about objects, the current image acquisition device used to obtain 3D information about objects includes a projector and a camera, which are used to establish a structured light detection system and thus to obtain 3D information about objects. However, the projector and the camera included in the current image acquisition device are operated independently from each other and can only acquire two-dimensional images of objects. The acquired two-dimensional images need to be processed through a PC (personal computer), and only then the 3D information about objects can be obtained. In this way, the 3D information about objects can only be obtained with the cooperation of PCs, which leads to a problem that the 3D information about objects cannot be directly obtained.

A non-patent document (A real-time 3D IR camera based on hierarchical orthogonal coding, <NPL>ET AL discloses a real-time 3D camera based on IR (infrared) structured light suitable for robots working in home environment. A 3D IR camera with variable structured light is developed to obtain a depth information of spatial object for home service robots. To alleviate the problems associated with visible light, it uses an infrared as light source. An infrared cannot be detected by human eyes and is robust to the illumination change in home environments.

<CIT> discloses a dynamic three dimensional measuring time sequence synchronous system. The system comprises a time sequence control board, a DLP projector, a first CCD camera, a second CCD camera, an image acquisition card, and a data processor. The time sequence control board is respectively connected with the data processor, the first CCD camera, the second CCD camera, and the DLP projector. The DLP projector is connected with the data processor, and the first CCD camera and the second CCD camera are connected with the data processor by the image acquisition card.

<CIT> discloses a three-dimension measuring system for a dynamic object, which comprises a clock synchronous controller, a digital light processing (DLP) projector, two charge coupled device (CCD) cameras, an image acquisition card and a computer, wherein a color wheel for generating colorful images is removed from the DLP projector, included angles between optical mandrels of the CCD cameras and the optical mandrel of the DLP projector are both between <NUM> and <NUM> degrees, and the relative positions of the DLP projector and the CCD cameras are unchanged during measurement; the computer is a graphic card with a calculation-based uniform equipment framework; and the clock synchronous controller is connected with the DLP projector and the CCD cameras respectively, the DLP projector is connected with the computer, and the CCD cameras are connected with the computer through the graphic card respectively.

<CIT> and the non-patent document <NPL>, both describe DLP based optical 3D sensors whereby all elements are integrated in a common housing, with an intelligent camera with computing power.

The present application provides a 3D information detection device to solve the problem that the 3D information about objects cannot be directly obtained in the current manner of obtaining 3D information about objects.

In order to solve the above problem, the present application provides a 3D information detection device as defined in independent claim <NUM>. The dependent claims define preferred and/or advantageous examples of the invention.

In the 3D information detection device as defined by claim <NUM>, the controller can control the operations of the DLP projector and the camera, enabling them to form an associated triggered unit. The camera can capture the structured light projected by the DLP projector in time and the captured images can be processed in time by the image processing module. In this detection process, since the image processing module directly performs 3D analysis and processing on the images acquired by the camera including the projection of the DLP projector to obtain 3D information about an object, the 3D information about the object can be directly obtained without the cooperation of a PC.

The drawings described herein are used to provide a further understanding of the application and constitute a part of the application. The exemplary embodiments of the present application and the description thereof are used to explain the application, and do not constitute an improper limitation on the application. In the figures:.

<NUM>: DLP projector, <NUM>: DLP driving device, <NUM>: optical projector, <NUM>: camera, <NUM>: controller, <NUM>: image processing module, <NUM>: mounting base, <NUM>: housing.

For the clarity of the purpose, technical solutions, and advantages of the present application, the present application will be described clearly and completely in conjunction with the specific embodiments and the corresponding drawings of the present application. It is apparent that the described embodiments are only a part of the embodiments of the present application, rather than all of them. Other embodiments can be considered by those skilled in the art as long as they fall within the scope of protection defined in the appended claims.

The technical solutions provided in various embodiments of the present application will be described below in detail with reference to the accompanying drawings.

Please refers to <FIG>, an embodiment of the present application discloses a 3D information detection device. The 3D information detection device of the present application includes a DLP projector <NUM>, a camera <NUM>, a controller <NUM> and an image processing module <NUM>.

The DLP projector <NUM> is a projection device based on DLP (Digital Light Processing) technology, which can digitally process image signals and then project light. The DLP projector <NUM> is an encoding-enabled projector. The DLP projector <NUM> is configured to project structured light to an object (object under test), wherein the structured light can be encoded structured light. During the specific operation, the DLP projector <NUM> projects a series of encoded patterns, which are formed by structured light. The structured light technology is used to calculate 3D information about the object hereinafter, which can improve the detection accuracy.

The structured light can be analyzed through the structured light technology, which is an active triangulation technology. The basic principle is as follows. A light projecting device projects a controllable light spot, light strip or light plane to the surface of an object to form characteristic points, and then the structured light projected to the surface of the object is modulated by the height of the object. The modulated structured light is acquired as an image and is transmitted to an analysis device for analysis and calculation. Then, the 3D information about the object, that is, the three-dimensional data of the object can be obtained.

The camera <NUM> is configured for acquiring an image of the object to which the structured light has been projected. The image processing module <NUM> is connected to the camera <NUM> and configured for processing the image to obtain the 3D information about the object. As described above, the specific processing process and the calculation of the 3D information are common technology, and will not be repeatedly described here. Specifically, the image processing module <NUM> can be based on x86 system architecture, and uses a GPU to obtain an image from the camera <NUM> and applies a planar structured light algorithm on the image. In one specific implementation, the image processing module <NUM> can be, of course not limited to, a GPU (Graphics Processing Unit).

The controller <NUM> is connected to both the DLP projector <NUM> and the camera <NUM> and controls the operations of them.

In one implementation, the controller <NUM> can control the DLP projector <NUM> to operate first and then control the camera <NUM> to operate after a preset time. It can be understood that the preset time may be <NUM> second, <NUM> seconds, etc., which is not limited in the embodiments of the present application. In this case, each time the DLP projector <NUM> projects one sheet, the camera <NUM> takes one shot after the preset time, and the image processing module <NUM> can process the picture taken by the camera <NUM> and then calculate the 3D information about the object.

In another implementation, the controller <NUM> can control the DLP projector <NUM> and the camera <NUM> to operate synchronously. In this case, each time the DLP projector <NUM> projects one sheet, the camera <NUM> takes one shot at the same time, and the image processing module <NUM> can process the picture taken by the camera <NUM> in real time and then calculate the 3D information about the object. In an optional solution, the controller <NUM> can be act as a synchronization controller that is able to control the synchronization of the DLP projector <NUM> and the camera <NUM>. The controller <NUM> can be controlled by software or by a hardware circuit. In this technical field, the simultaneous operation of two devices can be controlled in many ways, which are not listed here. Specifically, the controller <NUM> can be a FPGA (Field Programmable Gate Array) chip.

In the 3D information detection device disclosed in the embodiments of the present application, the controller <NUM> can control the DLP projector <NUM> and the camera <NUM> to operate synchronously, enabling them to form an associated triggered unit. The camera <NUM> can capture the structured light projected by the DLP projector <NUM> in time, and the captured image can be processed by the image processing module <NUM> in time. In this detection process, since the image processing module directly performs 3D analysis and processing on the image acquired by the camera including the projection of the DLP projector to obtain 3D information about the object, the 3D information about the object can be directly obtained without the cooperation of a PC.

Further, in the embodiment of the present application, the DLP projector <NUM>, the camera <NUM> and the image processing module <NUM> are integrated as one unit, such that the 3D information about the object can be directly provided to users through a 3D algorithm, which greatly facilitates the usage of users, and does not require users to perform any further processing later.

In the detection device disclosed in the embodiment of the present application, the DLP projector <NUM> projects a series of encoded patterns (formed by structured light) to an object using the DLP projecting technology. The camera <NUM> then acquires the image of the object the surface of which was projected with the patterns. Finally, the image processing module <NUM> applies a decoding algorithm on the image taken by the camera <NUM> and then the depth information about the surface of the object can be accurately restored. In addition, the camera <NUM> itself can acquire the two dimensional information about the acquired image, and finally the 3D information about the object is calculated using the structured light technology. The 3D information detection device disclosed in the embodiment of the present application can be widely used in the fields of robot positioning, 3D scanning, 3D measurement and the like.

Using the DLP projecting technology, different patterns can be encoded flexibly, and then planar structured light can be projected with higher precision. The DLP projector <NUM> can encode structured light in a Gray-code encoding format or a sine encoding format. The specific implementation of encoding structured light by using the Gray-code encoding format or the sine encoding format is known to those skilled in the art, and will not be repeatedly described here.

The DLP projector <NUM> includes a DLP driving device <NUM> and an optical projector <NUM>. The DLP driving device <NUM> is connected to the optical projector <NUM> and drives the optical projector <NUM> to project encoded structured light to an object. The DLP driving device <NUM> is connected to the controller <NUM>, which can be integrated on the DLP driving device. In this way, it is possible to save space and it is convenient for the controller to control the synchronization of the camera <NUM> and the DLP driving device <NUM>. The controller <NUM> can control the DLP driving device <NUM> and thus the projection of the optical projector <NUM>. The optical projector <NUM> includes a projection lens, which can be a <NUM> or <NUM> lens. Specifically, the projection lens can focus at a working distance of <NUM>, <NUM>, etc. Of course, the focusing distance is not limited to the above-mentioned distance. The optical projector <NUM> can use a DMD (Digital Micromirror Device) chip produced by TI (Texas Instruments) to carry out the DLP projection.

The optical projector <NUM> can include a LED light source with three colors of red, green and blue, which enables the DLP light source to project structured lights of different colors. In this case, the DLP projector <NUM> can provide patterns of different colors according to different scenes.

In a specific implementation, the DLP driving device <NUM> can include a FPGA module, which controls the generation of the Gray-code encoded patterns. The generated encoded patterns are stored in the memory, and then projected by the optical projector <NUM>.

In the camera <NUM> disclosed in the embodiment of the present application, the camera <NUM> includes a camera body and a camera lens. The camera <NUM> can be a camera using an image sensor of <NUM> million pixels, or <NUM> million pixels, or other number of pixels. The image sensor can be a high-speed area array CCD (Charge-coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor, of course, to which the present application is not limited. In addition, the camera lens can be equipped with a standard FA (Factory Automation) lens. The focal length of the standard FA lens can be <NUM> or <NUM>, of course, to which the present application is not limited.

The DLP projector <NUM> includes a housing <NUM>, within which the controller <NUM>, the DLP driving device <NUM>, the optical projector <NUM> and the image processing module <NUM> are all arranged, to facilitate the on-site mounting of the above-mentioned components. The housing <NUM> is a metal housing, which is able to play a better role in heat dissipation, and thus can dissipate the heat generated by the components arranged in the housing in time.

The 3D information detection device disclosed in the embodiment of the present application can further include a mounting base <NUM>. The camera <NUM> and the DLP projector <NUM> can be both arranged on the mounting base <NUM>, and the camera <NUM> is located on one side of the DLP projector <NUM>, that is to say, the camera <NUM> can be located on either side of the DLP projector <NUM>. During the specific mounting, the mounting base <NUM> can be fixed on the detection site firstly, and then provide mounting positions for the DLP projector <NUM> and the camera <NUM>. Of course, it is possible to mount the DLP projector <NUM> and the camera <NUM> on the mounting base <NUM> firstly and mount the formed assembly on site at last.

In an optional solution, the camera <NUM> is movably arranged on the mounting base <NUM>, and is movable in a direction close to or away from the DLP projector <NUM>, so that the position of the camera <NUM> can be adjusted to achieve the purpose of adjusting the shooting position.

As described above, the camera <NUM> can include a camera body and a camera lens. The camera body can be connected to the mounting base <NUM>, and is movably engaged with the mounting base <NUM>. The camera lens is rotatably engaged with the camera body and thus the shooting angle of the camera <NUM> can be adjusted flexibly.

In the 3D information detection device disclosed in the embodiment of the present application, there can be two cameras <NUM>. The two cameras <NUM> can be symmetrically arranged on two sides of the DLP projector <NUM>. The use of two cameras <NUM> can better remedy the blind area existing in the field of one camera <NUM>, thereby improving the detection accuracy. Of course, when there is one camera <NUM>, the 3D information about an object can also be detected.

When there are two cameras <NUM>, the distance between the two cameras <NUM> can be referred to as a baseline distance. According to the triangulation principle, the greater the baseline distance, the higher the depth resolution that will be obtained during shooting. The above-mentioned cameras <NUM> are movably arranged on the mounting base <NUM>, and thus the baseline distance between the two cameras <NUM> can be adjusted more flexibly to achieve the effect of flexibly adjusting the depth resolution. Users can flexibly adjust the baseline distance between the two cameras <NUM> according to the operating environment.

In order to improve the detection effect, in an optional solution, the end face of the projection lens of the DLP projector <NUM> and the end faces of the camera lenses of the two cameras <NUM> can be located in the same straight line. The projection lens is located in the middle between the camera lenses of the two cameras <NUM>, that is to say, the camera lenses of the two cameras <NUM> are symmetrically arranged on two sides of the projection lens.

In a specific implementation, the angle between the optical axis of the camera lens of the camera <NUM> and the optical axis of the projection lens of the DLP projector <NUM> can range from <NUM>° to <NUM>°. Of course, the above-mentioned structure of the camera <NUM> is able to realize the adjustment of the shooting direction of the camera lens, and can adjust the angle between the optical axis of the camera lens of the camera <NUM> and the optical axis of the projection lens of the DLP projector <NUM> more flexibly.

Since the camera lens of the camera <NUM> can rotate, the 3D scanning can be performed by the 3D information detection device within a large range, and the detection range can thus be broadened.

In the embodiment of the present application, the projection lens of the DLP projector <NUM> can use an off-axis lens. As shown in <FIG>, the projection plane formed by the off-axis lens is located on one side of its optical axis. The use of an off-axis lens can satisfy the compatibility between the edge position of a projected image and the mounting position of the DLP projector <NUM>. However, since the projected image is not on the main axis of the projection lens, the distortion of the projection lens will increase and the image quality will decrease. Based on this, the projection lens of the DLP projector <NUM> is an on-axis lens. As
shown in <FIG>, in this case, the projection plane formed by the on-axis lens is symmetrical with respect to the optical axis of the on-axis lens. The on-axis lens can improve the quality of the projected image, and ultimately improve the detection accuracy of the detection device to obtain more accurate 3D information about an object.

Claim 1:
A 3D information detection device, comprising a digital light processing, DLP, projector (<NUM>), a camera (<NUM>), a controller (<NUM>) and an image processing module (<NUM>), wherein the DLP projector (<NUM>) is configured for projecting structured light to an object, the camera (<NUM>) is configured for acquiring an image of the object to which the structured light has been projected, the image processing module (<NUM>) is connected to the camera (<NUM>) and configured for processing the image to obtain 3D information about the object, and the controller (<NUM>) is connected to both the DLP projector (<NUM>) and the camera (<NUM>) and controls operations of the DLP projector and the camera,
wherein the DLP projector (<NUM>) comprises a DLP driving device (<NUM>) and an optical projector (<NUM>), the DLP driving device (<NUM>) is connected to the optical projector (<NUM>) and drives the optical projector (<NUM>) to project encoded structured light to the object, and the DLP driving device (<NUM>) is connected to the controller (<NUM>),
characterized in that the DLP projector (<NUM>) further comprises a metal housing (<NUM>), within which the controller (<NUM>), the DLP driving device (<NUM>), the optical projector (<NUM>) and the image processing module (<NUM>) are all arranged, wherein the camera (<NUM>) is provided outside the housing (<NUM>);
and in that a projection lens of the DLP projector (<NUM>) is an on-axis lens.