Abstract:
The present invention relates to the technical field of three-dimensional imaging, and provides a human body three-dimensional imaging method and system, and a method for simultaneously calibrating multiple control base stations. According to the present invention, provided that the effective view fields of the various distributed sensors are subjected to no spatial overlap, the structural parameters and the global matching parameters of all the sensors are calibrated; a corresponding point search method utilizing phase shift in combination with the random structured light reduces image collection time for acquiring single view point depth data; by using the concept of time reuse, the overall data collection time is shortened, and meanwhile the design of distributed computation enhances the computing capability of the entire system; automatic matching of the depth data of different sensors is implemented according to the calibrated global matching parameters of the different sensors.

Description:
CROSS-REFERENCE TO RELATED APPLICATIONS 
       [0001]    The present application is a Continuation application of PCT application No. PCT/CN2015/076869 filed on Apr. 17, 2015, which claims the benefit of Chinese Patent Application No. 201410458109.X filed on Sep. 10, 2014, the contents of which are hereby incorporated by reference. 
     
    
     TECHNICAL FIELD 
       [0002]    The present invention relates to the technical field of three-dimensional imaging, and in particular, relates to a human body three-dimensional imaging method and system based on distributed network control, and a method for simultaneously calibrating multiple base stations. 
       BACKGROUND 
       [0003]    The phase-assisted three-dimensional imaging has such advantages as non-contact, high speed, high accuracy, high data density and the like, and has been widely used in the industrial production fields such as reverse engineering, quality control, defect detection and the like. In typical industrial applications, a single three-dimensional sensing system is employed to implement full-range three-dimensional imaging through a moving object or a sensing system. This process is generally hard to be automated, and long time is consumed. This solution is generally not applicable to human body three-dimensional imaging. In one aspect, a human body has large area, thus three-dimensional data needs to be acquired from multiple angles. In another aspect, using a human body as an example, it is difficult for the human body to remain stationary for a duration enough long for quick acquisition of the three-dimensional data. At present, available human body three-dimensional imaging systems mainly include: a laser-based handheld scanning system and a scanning system of a mechanically moving device. The handheld imaging system implements integral data collection through handheld movement at multiple angles, which generally needs several minutes. During this process, it is difficult for the human body to remain stationary. The imaging system based on mechanically moving device generally requires the human body to rotate or needs a large-size mechanical movement control device, which is large and bulky. 
       SUMMARY 
       [0004]    A first technical problem to be solved by the present invention is to provide a human body three-dimensional imaging method so as to quickly and completely acquiring high-precision and high-density three-dimensional data of a human body, and color data of high sense of reality. 
         [0005]    The present invention is implemented by a human body three-dimensional imaging method, which comprises the following steps: 
         [0006]    step A: upon receipt of a collection instruction from a control center, a plurality of control base stations performing coding pattern projection for a human body, and meanwhile collecting human body image information observed from their respective view angles; and the control base stations performing depth computation for their respective human body image information to obtain three-dimensional geometric depth data in their respective local coordinate systems; wherein the control base stations are interconnected, and are deployed surrounding the human body to form a measurement space completely covering the human body, each control base station comprises two longitudinally arranged three-dimensional sensors, wherein the two three-dimensional sensors are respectively configured to acquire three-dimensional geometric depth data and texture data of an upper part and a lower part of the human body from the view angle of the control base station; 
         [0007]    step B: each of the control base stations transforming the three-dimensional geometric depth data from their respective local coordinate systems to a global coordinate system; 
         [0008]    step C: each of the control base stations performing white light projection for the human body, collecting texture data of human body colors observed from their respective view angles, and sending the collected texture data together with the three-dimensional geometric depth data transformed in step B to the control center; and 
         [0009]    step D: the control center receiving the three-dimensional geometric depth data and corresponding surface texture data thereof in the global coordinate system which are transmitted by the control base stations, the control center firstly splicing the three-dimensional geometric depth data collected by the control base stations to obtain a human body three-dimensional model, and then removing redundancy for a human body integral model to obtain a fused human body three-dimensional model; afterwards, the control center performing a weighted operation for texture data of an overlapped portion of all human body colors that is collected by all the control base stations to obtain fused texture data; and finally the control center associating the fused human body three-dimensional model with the fused texture data in one-to-one style. 
         [0010]    A second technical problem to be solved by the present invention is to provide a human body three-dimensional imaging system, which comprises: 
         [0011]    a plurality of control base stations configured to: construct a human body measurement space, upon receipt of a collection instruction from a control center, perform coding pattern projection for a human body in a human body measurement space, and meanwhile collect human body image information observed from their respective view angles, and perform depth computation for their respective human body image information to obtain three-dimensional geometric depth data in their respective local coordinate systems; transform the three-dimensional geometric depth data from their respective local coordinate systems to a global coordinate system; perform white light projection for the human body, collect texture data of human body colors observed from their respective view angles, and send the collected texture data together with the transformed three-dimensional geometric depth data; wherein the control base stations are interconnected, and are deployed surrounding the human body to form a measurement space completely covering the human body, each control base station comprises two longitudinally arranged three-dimensional sensors, wherein the two three-dimensional sensors are respectively configured to acquire human body image information and texture data of an upper part and a lower part of the human body from the view angle of the control base station; and 
         [0012]    a control center configured to: receive the three-dimensional geometric depth data and corresponding surface texture data thereof in the global coordinate system that are transmitted by the control base stations, firstly splice the three-dimensional geometric depth data collected by the control base stations to obtain a human body three-dimensional model, and then remove redundancy for the human body integral model to obtain a fused human body three-dimensional model; afterwards, the control center performs a weighted operation for texture data of an overlapped portion of all human body colors that is collected by the control base stations to obtain fused texture data; and finally the control center associates the fused human body three-dimensional model with the fused texture data in a one-to-one style. 
         [0013]    A third technical problem to be solved by the present invention is to provide a method for simultaneously calibrating multiple control base stations in the three-dimensional imaging system as described above, which comprises the following steps: 
         [0014]    step A01: shooting a three-dimensional target from multiple different view angles by using a high-resolution digital camera to obtain target images; wherein the three-dimensional target is capable of covering the measurement space and is adhered with a plurality of coding mark points on the surface thereof, each mark point has a different coding strip as a unique identifier; 
         [0015]    step A02: performing central positioning and decoding for the mark points in the target image, and acquiring a corresponding relationship between images from different view angles and image coordinates according to different coding values of the coding points; 
         [0016]    Step A03: acquiring image coordinates {circumflex over (m)} ij (K,θ,r i ,t i ;X j ) of the re-projection of the global coordinates X j  of each of the different codes at a shooting view angle i by means of bundle adjustment, and optimizing the error of the re-projection, as represented by the following formula: 
         [0000]    
       
         
           
             
               min 
                
               
                   
               
                
               
                 cost 
                  
                 
                   ( 
                   
                     K 
                     , 
                     θ 
                     , 
                     
                       X 
                       j 
                     
                   
                   ) 
                 
               
             
             = 
             
               
                 ∑ 
                 
                   i 
                   = 
                   1 
                 
                 N 
               
                
               
                 
                   ∑ 
                   
                     j 
                     = 
                     1 
                   
                   M 
                 
                  
                 
                   { 
                   
                     
                        
                       
                         
                           
                             m 
                             ^ 
                           
                           ij 
                         
                         - 
                         
                           
                             
                               m 
                               ⋒ 
                             
                             ij 
                           
                            
                           
                             ( 
                             
                               K 
                               , 
                               θ 
                               , 
                               
                                 r 
                                 i 
                               
                               , 
                               
                                 t 
                                 i 
                               
                               , 
                               
                                 X 
                                 j 
                               
                             
                             ) 
                           
                         
                       
                        
                     
                     2 
                   
                   } 
                 
               
             
           
         
       
     
         [0017]    wherein (K, θ) represents an internal structural parameter of the camera, (r i , t i ) represents a shooting gesture, and {circumflex over (m)} ij  represents the coordinate of the circle center image; as such the global coordinates X j  of different coding points are obtained and the target correct is implemented; 
         [0018]    step A04: placing the corrected three-dimensional target into the measurement space, controlling the three-dimensional target to rotate for multiple times, and collecting an image of the three-dimensional target by the control base station upon each rotation; and with respect to a binocular node i, using a structural parameter of a binocular sensor and an external parameter of the node as parameter vectors to be optimized, and constructing an optimized target function as represented by the following formula: 
         [0000]    
       
         
           
             
               cost 
                
               
                 ( 
                 
                   τ 
                   i 
                 
                 ) 
               
             
             = 
             
               
                 ∑ 
                 
                   i 
                   = 
                   1 
                 
                 N 
               
                
               
                 
                   ∑ 
                   
                     j 
                     = 
                     1 
                   
                   M 
                 
                  
                 
                   { 
                   
                     
                       
                          
                         
                           
                             
                               m 
                               ^ 
                             
                             i 
                             st 
                           
                           - 
                           
                             
                               
                                 m 
                                 ⋒ 
                               
                               i 
                               Si 
                             
                              
                             
                               ( 
                               
                                 
                                   K 
                                   l 
                                   i 
                                 
                                 , 
                                 
                                   θ 
                                   l 
                                   i 
                                 
                                 , 
                                 
                                   r 
                                   s 
                                   i 
                                 
                                 , 
                                 
                                   
                                     t 
                                     s 
                                     i 
                                   
                                   ; 
                                   
                                     X 
                                     w 
                                     t 
                                   
                                 
                               
                               ) 
                             
                           
                         
                          
                       
                       2 
                     
                     + 
                     
                       
                          
                         
                           
                             
                               m 
                               ^ 
                             
                             r 
                             st 
                           
                           - 
                           
                             
                               
                                 m 
                                 ⋒ 
                               
                               r 
                               st 
                             
                              
                             
                               ( 
                               
                                 
                                   K 
                                   r 
                                   i 
                                 
                                 , 
                                 
                                   θ 
                                   r 
                                   i 
                                 
                                 , 
                                 
                                   r 
                                   i 
                                 
                                 , 
                                 
                                   t 
                                   i 
                                 
                                 , 
                                 
                                   r 
                                   s 
                                   i 
                                 
                                 , 
                                 
                                   
                                     t 
                                     s 
                                     i 
                                   
                                   ; 
                                   
                                     X 
                                     w 
                                     t 
                                   
                                 
                               
                               ) 
                             
                           
                         
                          
                       
                       2 
                     
                   
                   } 
                 
               
             
           
         
       
     
         [0019]    wherein the subscript s represents the s-th shooting gesture of the system, t represents the t-th mark point in the target, X w   t  represents the coordinates of the t-th mark point in the global coordinate system, τ i {K l   i ,θ t   i ,θ r   i ,r i ,r s   i ,t s   i } represents a to-be-optimized parameter vector of the sensor node i, {K l   i } and {K l   i ,θ l   i } respectively represent an internal parameter and a distortion of the first and second cameras of the sensor i, m l   st  and {circumflex over (m)} r   st  represent image coordinates of reference points in the first and second cameras, and {circumflex over (m)} l   st (≡) and {circumflex over (m)} r   st (≡) represent coordinates of the re-projected image; and 
         [0020]    step A05: implementing optimization estimation for the system parameters by using a minimum target function to obtain the structural parameter r s   i ,t s   i  and the internal parameters {K i   i ,θ i   l } and of the node for deep reconstruction of the sensor i, wherein r t , t t  represents a transformation relationship between the sensor i and the global coordinate system. 
         [0021]    The present invention provides a large-scale human body three-dimensional scanning system formed of a sensor network of multiple control base stations based on distributed computation. The human body three-dimensional scanning system has the following advantages: firstly, on the prerequisite that the effective view fields of the various distributed sensors are subjected to no spatial overlap, the structural parameters and the global matching parameters of all the sensors are calibrated. Secondly, a corresponding point search method utilizing phase shift in combination with the random structured light reduces image collection time for acquiring single view point depth data. Thirdly, by using the concept of time reuse, the overall data collection time is shortened, and meanwhile the design of distributed computation enhances the computing capability of the entire system, and thus the data acquisition speed is improved. Fourthly, automatic matching of the depth data of different sensors is implemented according to the calibrated global matching parameters of the different sensors. Fifthly, according to the embodiments of the present invention, system debugging and expansion are convenient, the automation degree is high, and the process of three-dimensional scanning is simple. 
     
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
         [0022]      FIG. 1  is a schematic diagram illustrating deployment of multiple control base stations according to the present invention. 
           [0023]      FIG. 2  is a block diagram illustrating principles of a three-dimensional sensor according to the present invention. 
           [0024]      FIG. 3  is a schematic diagram illustrating an internal structure of a control base station according to an embodiment of the present invention. 
           [0025]      FIG. 4  is a schematic diagram illustrating control of a control base station by a control center according to the present invention. 
           [0026]      FIG. 5  is a schematic diagram illustrating time reuse of a control base station according to the present invention. 
           [0027]      FIG. 6  is a schematic diagram illustrating a calibration reference according to the present invention. 
           [0028]      FIG. 7  is a schematic diagram illustrating calibration principles according to the present invention. 
           [0029]      FIG. 8  is a schematic diagram illustrating a projection pattern sequence according to the present invention. 
           [0030]      FIG. 9  is a schematic diagram illustrating in-depth data collected by three-dimensional sensors of various control base stations according to the present invention. 
           [0031]      FIG. 10  is a schematic diagram illustrating in-depth data of texture mapping according to the present invention. 
           [0032]      FIG. 11  is a schematic diagram of a three-dimensional model after matching is performed according to the present invention. 
       
    
    
     DETAILED DESCRIPTION OF THE EMBODIMENTS 
       [0033]    To make the objectives, technical solutions, and advantages of the present invention clearer, the present invention is further described with reference to specific embodiments and attached drawings. It should be understood that the embodiments described here are only exemplary ones for illustrating the present invention, and are not intended to limit the present invention. 
         [0034]    According to an embodiment of the present invention, a host is employed to control two vertically arranged three-dimensional sensors to form a scanning control base station, such that data of upper part and lower part of a human body is acquired from a view angle and three-dimensional reconstruction is achieved. A human body scanning system is formed of five such control base stations so as to acquire relatively complete and fine human body surface three-dimensional data. 
         [0035]    A human body three-dimensional imaging process according to an embodiment of the present invention covers four stages, that is, configuration and space deployment of the control base stations, calibration of multiple control base stations of the scanning system, reconstruction of single view point depth data reconstruction, and automatic matching of depth data from all different view points. The main principles are as follows: 
         [0036]    1. Spatial Deployment and Configuration of the Control Base Station 
         [0037]    1.1 The number of control base stations to be deployed in the entire scanning system is determined according to the fineness and integrity of the human body scanning data. Generally, on the prerequisite that the requirements on fineness and integrity are satisfied, a smallest number of control base stations shall be used. Typically, the number of control base stations is three to six. In this embodiment, five control base stations are used. 
         [0038]    1.2 Considering the imaging lenses and effective view fields of the system structured light projection device and the camera, an imaging working distance of the control base stations and a suitable angle between any two control base stations in the system are commissioned. In this embodiment, the spacing of the control base stations is about 1.2 m. To be specific, the five control base stations are evenly arranged on a circumference with the radius of 1.2 m, wherein the circle center is a measurement space center of the system. 
         [0039]    1.3 The embodiments are applicable to adults, and the scanning height is not more than 2.2 m. Two sets of vertically-arranged three-dimensional depth sensors are configured for each control base station. In a scanning system dedicated to children of no taller than 1.2 m, only one set of depth sensor needs to be configured for each control base station. 
         [0040]    2. Calibration of Multiple Control Base Stations of the Scanning System 
         [0041]    2.1 Preparation of a three-dimensional target. Mark points are adhered on the surface of an object capable of covering the system measurement space. Spatial three-dimensional coordinates of the mark points are reconstructed in combination with close range measurement method, and the reconstructed coordinates are used as a calibrated reference of each three-dimensional sensor. 
         [0042]    2.2 The three-dimensional target is placed into the measurement space, and each time the three-dimensional target is rotated by 45 degrees, the first and second cameras of each three-dimensional sensor in the system are controlled to shoot the target to obtain calibrated images. As a result, each camera sequentially collects eight calibrated images at eight different positions of the target. 
         [0043]    2.3 The mark points of the images acquired by each camera are processed. By means of image processing and automatic recognition technologies, mark point edges are obtained according to the subpixel edge extraction algorithm, and the image coordinates at the center are obtained through fitting. The mark point is uniquely identified by means of the coding information, thus a corresponding relationship between mark points of the first and second cameras of each three-dimensional sensor, and the three-dimensional coordinates of each mark point are acquired. 
         [0044]    2.4 By means of the mark point image coordinates and the corresponding spatial three-dimensional coordinates, the internal parameter and external parameter of each camera are calibrated, and meanwhile the structural parameter of each three-dimensional sensor, a transformation relationship between all the sensors and the global coordinates are calibrated. 
         [0045]    3. Reconstruction of Single View Point Depth Data Reconstruction 
         [0046]    3.1 Image sequences are collected. The host of the control base station sends a serial port signal to the control panel, and the control panel sends a coding pattern to the projection module according to the serial port signal and meanwhile triggers image collection of the first and second cameras. The image sequence collected via projection is formed of a multi-step phase-shift image and a pseudo random coding image, or formed of a multi-step phase-shift image and one grey coding image, or formed of a multi-step phase-shift image and a temporal phase unwrapping image. The more steps in the phase-shift image, the higher the precision is. However, increase of the steps would affect the projection speed. As a preferred embodiment of the present invention, a four-step phase-shift image and a pseudo random coding image are used for implementation of the present invention, and description is given hereinafter using such implementation as an example. 
         [0047]    3.2 The corresponding point search solution integrating phase shift and pseudo random coding is employed to establish a corresponding relationship between points of the first and second cameras. Considering the structural parameter of the three-dimensional sensor, three-dimensional depth data of the sensor is reconstructed. 
         [0048]    4. Automatic Matching of Depth Data from all Different View Points 
         [0049]    4.1 By means of the transformation relationship between different sensors and the global coordinate system that is obtained via calibration, upper and lower geometric depth data obtained in each control base station is transformed to the global coordinate system, and then transmitted to the control center through a Gigabit switch. 
         [0050]    4.2 After receiving the depth data of all the control base stations, the control center refines the matching result according to the closest point iteration method, and obtains integral data of the surface of a human body. 
         [0051]    According to the above described four steps, detail description is given hereinafter with reference to the accompanying drawings of the embodiments. 
         [0052]    Specifically, in the present invention, a plurality of control base stations are configured to: construct a human body measurement space, upon receipt of a collection instruction from a control center, perform coding pattern projection for a human body in a human body measurement space, and meanwhile collect human body image information observed from their respective view angles, and to perform depth computation for their respective human body image information to obtain three-dimensional geometric depth data in their respective local coordinate systems; to transform the three-dimensional geometric depth data from their respective local coordinate systems to a global coordinate system; to perform white light projection for the human body, collect texture data of human body colors observed from their respective view angles, and send the collected texture data together with the three-dimensional geometric depth data transformed in step B to the control center, wherein the control base stations are interconnected, and are deployed surrounding the human body to form a measurement space completely covering the human body, each control base station comprises two longitudinally arranged three-dimensional sensors, wherein the two three-dimensional sensors are respectively configured to acquire human body image information and texture data of an upper part and a lower part of the human body from the view angle of the control base station. 
         [0053]    A control center is configured to: upon receipt of the three-dimensional geometric depth data and corresponding surface texture data thereof in the global coordinate system that are transmitted by the control base stations, firstly splice the three-dimensional geometric depth data collected by the control base stations to obtain a human body three-dimensional model, and then remove redundancy for the human body integral model to obtain a fused human body three-dimensional model; afterwards, perform a weighted operation for texture data of an overlapped portion of all human body colors that is collected by the control base stations to obtain fused texture data; and finally one-to-one associate the fused human body three-dimensional model with the fused texture data. For reduction of cost, the control center may be one of the control base stations. 
         [0054]      FIG. 1  is a schematic diagram illustrating specific spatial positions of five control base stations according to an embodiment of the present invention. The five control base stations are evenly arranged along a circumference with a radius of about 1.2 m, and the imaging directions of the three-dimensional sensors of each control base station all face towards the measurement space at the position of the circle center. It should be understood that during specific implementation, different requirements are imposed on the fineness and integrity of the human body data. The number of control base station is generally 3 to 6 sets, not necessarily 5 sets. The working distance of the control base station needs to accommodate the focal distances of different imaging lenses, which is not limited to about 1.2 m. 
         [0055]      FIG. 3  is a schematic diagram illustrating working of an internal structure of a control base station according to the present invention. Two three-dimensional sensors having a binocular structure are vertically arranged in a column, and one host controls collection of images and completes reconstruction computation of the depth data. In this way, the depth data of the upper and lower parts of a human body may be acquired, and matching of the depth data to the global coordinates is achieved. In  FIG. 3, 101  denotes a CCD video camera,  102  denotes a CCD video camera,  105  denotes a CCD video camera, and  106  denotes a CCD video camera;  103  denotes a CCD projector, and  107  denotes a CCD projector;  104  denotes a control panel, and  108  denotes a control panel;  109  denotes a host; and  110  denotes a human body to be detected.  101 ,  102  and  103  form a three-dimensional sensor  1  at the upper portion, which receives a signal from the control panel  104  and synchronizes the projection collection image sequence. Correspondingly, the working principle of a sensor  2  formed of  105 ,  106  and  107  is the same as that of the sensor  1 . The host  109  is connected to the control panels  104  and  108  through different serial ports, and implements control of projection collection for the sensors  1  and  2  through different COM ports. 
         [0056]    In this embodiment, a three-dimensional target capable of covering the measurement space of the human body is made. The cross section of the three-dimensional target is approximately a cube hexahedron, with the side length being 0.4 m and the height being 2 m, and the surface of the three-dimensional target is adhered with  750  coding mark points, wherein each mark point has a different coding strip as a unique identifier, as illustrated in  FIG. 6( a ) . By means of close range photography measurement, the three-dimensional coordinates at the center of each mark point is corrected to obtain precise spatial three-dimensional coordinates. This embodiment specifically comprises the following steps: 
         [0057]    step 1: shooting a three-dimensional target from 58 different view angles by using a high-resolution digital camera to obtain target images, as illustrated in  FIG. 6( b )  (images shot from partial view angles); 
         [0058]    step 2: performing central positioning and decoding for the mark points in the target image, and acquiring a corresponding relationship between images from different view angles, and image coordinates according to different coding values of the coding points; 
         [0059]    2.1 Gaussian filtering to remove image noise; 
         [0060]    2.2 pixel-level coarse positioning of the ellipse edge by using the edge detection operator (Canny operator) 
         [0061]    2.3 automatic identification of the mark point (a point satisfying the following two conditions is considered as a mark point: the pixels included in the profile of the mark point fluctuate within a specific range, and the profile of the mark point is closed); 
         [0062]    2.4 sub-pixel precise positioning of the ellipse edge (cubic polynomial curve surface fitting is performed for the 5×5 neighborhood of each pixel at the pixel-level edge, and the position of the local extremum of the first-order derivative is acquired, i.e., the sub-pixel position); 
         [0063]    2.5 least squares fitting is carried out for the ellipse edge to obtain subpixel coordinates of the ellipse center, which are considered as the central image coordinates of the mark point. 
         [0064]    step 3: by means of bundle adjustment, acquiring image coordinates of the global coordinates X j  of each of the different codes at a shooting view angle i, and optimizing an error of the re-projection, as represented by formula (1): 
         [0000]    
       
         
           
             
               
                 
                   
                     min 
                      
                     
                         
                     
                      
                     
                       cost 
                        
                       
                         ( 
                         
                           K 
                           , 
                           θ 
                           , 
                           
                             X 
                             j 
                           
                         
                         ) 
                       
                     
                   
                   = 
                   
                     
                       ∑ 
                       
                         i 
                         = 
                         1 
                       
                       N 
                     
                      
                     
                       
                         ∑ 
                         
                           j 
                           = 
                           1 
                         
                         M 
                       
                        
                       
                         { 
                         
                           
                              
                             
                               
                                 
                                   m 
                                   ^ 
                                 
                                 ij 
                               
                               - 
                               
                                 
                                   
                                     m 
                                     ⋒ 
                                   
                                   ij 
                                 
                                  
                                 
                                   ( 
                                   
                                     K 
                                     , 
                                     θ 
                                     , 
                                     
                                       r 
                                       i 
                                     
                                     , 
                                     
                                       t 
                                       i 
                                     
                                     , 
                                     
                                       X 
                                       j 
                                     
                                   
                                   ) 
                                 
                               
                             
                              
                           
                           2 
                         
                         } 
                       
                     
                   
                 
               
               
                 
                   ( 
                   1 
                   ) 
                 
               
             
           
         
       
     
         [0065]    wherein (K, θ) represents an internal structural parameter of the camera, 
         [0066]    wherein 
         [0000]    
       
         
           
             
               K 
               = 
               
                 [ 
                 
                   
                     
                       f 
                     
                     
                       α 
                     
                     
                       
                         u 
                         0 
                       
                     
                   
                   
                     
                       0 
                     
                     
                       f 
                     
                     
                       
                         v 
                         0 
                       
                     
                   
                   
                     
                       0 
                     
                     
                       0 
                     
                     
                       1 
                     
                   
                 
                 ] 
               
             
             , 
           
         
       
     
         [0000]    {f, u 0 ,v 0 ,a} respectively represent a focal distance, a primary point x-coordinate, a primary point y-coordinate and a tilt factor, and θ={k 1 , k 2 , k 3 , p 2 }, (k 1 , k 2 , k 3 ) representing lens radial distortion coefficients, and (p 1 , p 2 ) representing lens tangential distortion coefficients; M represents the number of mark points; N represents the number of images; (r i , t 1 ) represents a shooting gesture; and {circumflex over (m)} u  represents coordinates of a circle center image; as such the global coordinates X j  of different coding points are obtained and target correction is implemented, as illustrated in  FIG. 6( c ) . For detail solution of the non-linear optimization problem, reference may be made to  Calibration Technique for Phase - Aided Optical  3 D Measurement Systems , by Ying Yongkai, 2012, Doctor of Philosophy Dissertation of Tianjin University. 
         [0067]    Upon completion of correction of the three-dimensional target, the corrected three-dimensional target is placed into the measurement space of the system to calibrate the system parameter and matching parameter of the three-dimensional sensor in the system. In the embodiments, five control base stations are used, wherein each control base station has two three-dimensional sensors having a binocular system, and there are totally 10 sets of three-dimensional sensors. These sensors functions the same and play the same role in the system.  FIG. 7  illustrates calibrated model of a three-dimensional sensor, wherein r i , t i  represents a vector of the rotation, translation and transformation of the first and second cameras, which indicates a transformation relationship between the global coordinate system and the local coordinate system of the sensor. Each time the target is rotated by about 45 degrees, each camera in the system is controlled to shoot the target to obtain target images, and totally eight groups of images of different positions of the target are obtained. With respect to a certain node i, the structural parameter of the binocular sensor and the external parameter of the node are used as parameter vectors to be optimized, and an optimization target function is constructed, as represented by formula (2): 
         [0000]    
       
         
           
             
               
                 
                   
                     cost 
                      
                     
                       ( 
                       
                         τ 
                         i 
                       
                       ) 
                     
                   
                   = 
                   
                     
                       ∑ 
                       
                         i 
                         = 
                         1 
                       
                       N 
                     
                      
                     
                       
                         ∑ 
                         
                           j 
                           = 
                           1 
                         
                         M 
                       
                        
                       
                         { 
                         
                           
                             
                                
                               
                                 
                                   
                                     m 
                                     ^ 
                                   
                                   i 
                                   st 
                                 
                                 - 
                                 
                                   
                                     
                                       m 
                                       ⋒ 
                                     
                                     l 
                                     Si 
                                   
                                    
                                   
                                     ( 
                                     
                                       
                                         K 
                                         l 
                                         i 
                                       
                                       , 
                                       
                                         θ 
                                         l 
                                         i 
                                       
                                       , 
                                       
                                         r 
                                         s 
                                         i 
                                       
                                       , 
                                       
                                         
                                           t 
                                           s 
                                           i 
                                         
                                         ; 
                                         
                                           X 
                                           w 
                                           t 
                                         
                                       
                                     
                                     ) 
                                   
                                 
                               
                                
                             
                             2 
                           
                           + 
                           
                             
                                
                               
                                 
                                   
                                     m 
                                     ^ 
                                   
                                   r 
                                   st 
                                 
                                 - 
                                 
                                   
                                     
                                       m 
                                       ⋒ 
                                     
                                     r 
                                     st 
                                   
                                    
                                   
                                     ( 
                                     
                                       
                                         K 
                                         r 
                                         i 
                                       
                                       , 
                                       
                                         θ 
                                         r 
                                         i 
                                       
                                       , 
                                       
                                         r 
                                         i 
                                       
                                       , 
                                       
                                         t 
                                         i 
                                       
                                       , 
                                       
                                         r 
                                         s 
                                         i 
                                       
                                       , 
                                       
                                         
                                           t 
                                           s 
                                           i 
                                         
                                         ; 
                                         
                                           X 
                                           w 
                                           t 
                                         
                                       
                                     
                                     ) 
                                   
                                 
                               
                                
                             
                             2 
                           
                         
                         } 
                       
                     
                   
                 
               
               
                 
                   ( 
                   2 
                   ) 
                 
               
             
           
         
       
     
         [0068]    In the above formula, subscript s represents the s-th shooting gesture of the system, t represents the t-th marker point in the target, X w   t  represents the coordinates of the t-th marker point in the global coordinate system, τ l ={K l   i ,θ l   i ,K r   i ,θ r   i , r j ,t j ,r s   j ,t s   j } represents a to-be-optimized parameter vector of the sensor node i, and respectively represent an internal parameter and a distortion of the first and second cameras of the sensor i, {circumflex over (m)} l   st  and {circumflex over (m)} r   st  represent image coordinates of reference points in the first and second cameras, r t , t t  represents a transformation relationship of the first and second cameras, r s   t , t s   t  represents an external parameter of the s-th shooting gesture, {circumflex over (m)} l   st () and {circumflex over (m)} r   st () represents coordinates of the re-projected image. For details about the specific mathematical model, reference may be made to Computer Vision (by Ma Songde, Zhang Zhengyou, Science Press, 1998). Optimization estimation is implemented for the system parameters by using the minimum target function formula (2) to obtain the structural parameter r s   t , t s   t  and the internal parameters {K l   i ,θ l   j } and {K r   i ,θ r   i } (i=1, 2, 3 . . . 10) of the node for deep reconstruction of the sensor i, wherein represents a transformation relationship between the sensor i and the global coordinate system, and with respect to different sensors, the internal parameter and the structural parameter may be obtained while the matching parameter ri, ti (i=1, 2, 3 . . . 10) may also be obtained by using the same method. 
         [0069]    Upon completion of the system calibration, the key point of reconstruction of the three-dimensional geometric depth data lies in searching of the corresponding points of the first and second cameras in the sensor. A corresponding point search method utilizing phase shift in combination with the random structured light is employed in the present invention to shorten image sequence collection time. According to the method, over 10 image sequences may be shortened to five images, and the image sequences collected via projection are as illustrated in  FIG. 8 . The corresponding point search method may comprise the following steps: 
         [0070]    step 1: performing epipolar rectification for the upper body image and the lower body image according to pre-calibrated parameters of the first and second cameras, such that the same y-coordinates of the upper body image and the lower image are subjected to an epipolar corresponding relationship; 
         [0071]    step 2: according to four-step phase-shifting algorithm, obtaining wrapped phases of the first and second cameras by means of computation with a phase-shift image subjected to epipolar rectification; 
         [0072]    step 3: traversing the j-th row of the second camera, wherein a wrapped phase value at a pixel position p 1 (i, j) in the wrapped phase of the first camera is w(i, j), and a pixel position p r (ir, j) having a minimum phase difference is capable of being found in each wrapping cycle, these pixel positions p r  being corresponding candidate points of the pixel position p 1  of the first camera; 
         [0073]    step 4: using pseudo random coding images of the first and second cameras as a target image and a to-be-matched image respectively, and considering that a size of a matching window with p 1  as a center on the target image is (2w+1)×(2w+1), wherein a grey value of any pixel p 1  in the window is marked as (p 1 (u 1 ,u 1 ) whereas a grey value of the corresponding point of the candidate point p r  on the to-be-matched image is p r  (u r , u r ), and a normalized correlation measurement function N cc  of the two windows is expressed by the following formula: 
         [0000]    
       
         
           
             
               
                 
                   
                     Ncc 
                      
                     
                       ( 
                       
                         
                           I 
                           l 
                         
                         , 
                         
                           I 
                           r 
                         
                       
                       ) 
                     
                   
                   = 
                   
                     
                       F 
                        
                       
                         ( 
                         
                           i 
                           , 
                           j 
                           , 
                           ir 
                           , 
                           j 
                         
                         ) 
                       
                     
                     = 
                     
                       
                         
                           { 
                           
                             
                               ∑ 
                               
                                 
                                   u 
                                   = 
                                   
                                     - 
                                     w 
                                   
                                 
                                 , 
                               
                               w 
                             
                              
                             
                                 
                             
                              
                             
                               
                                 ∑ 
                                 
                                   v 
                                   = 
                                   
                                     - 
                                     w 
                                   
                                 
                                 w 
                               
                                
                               
                                   
                               
                                
                               
                                 
                                   ( 
                                   
                                     
                                       
                                         p 
                                         l 
                                       
                                        
                                       
                                         ( 
                                         
                                           
                                             i 
                                             + 
                                             u 
                                           
                                           , 
                                           
                                             j 
                                             + 
                                             v 
                                           
                                         
                                         ) 
                                       
                                     
                                     - 
                                     
                                       
                                         p 
                                         l 
                                       
                                       _ 
                                     
                                   
                                   ) 
                                 
                                 * 
                                 
                                   ( 
                                   
                                     
                                       
                                         p 
                                         r 
                                       
                                        
                                       
                                         ( 
                                         
                                           
                                             ir 
                                             + 
                                             u 
                                           
                                           , 
                                           
                                             j 
                                             + 
                                             
                                                 
                                             
                                              
                                             v 
                                           
                                         
                                         ) 
                                       
                                     
                                     - 
                                     
                                       
                                         p 
                                         r 
                                       
                                       _ 
                                     
                                   
                                   ) 
                                 
                               
                             
                           
                           } 
                         
                         2 
                       
                       
                         
                           
                             
                               
                                 
                                   { 
                                   
                                     
                                       ∑ 
                                       
                                         
                                           u 
                                           = 
                                           
                                             - 
                                             w 
                                           
                                         
                                         , 
                                       
                                       w 
                                     
                                      
                                     
                                         
                                     
                                      
                                     
                                       
                                         ∑ 
                                         
                                           v 
                                           = 
                                           
                                             - 
                                             w 
                                           
                                         
                                         w 
                                       
                                        
                                       
                                           
                                       
                                        
                                       
                                         ( 
                                         
                                           
                                             
                                               p 
                                               i 
                                             
                                              
                                             
                                               ( 
                                               
                                                 
                                                   i 
                                                   + 
                                                   u 
                                                 
                                                 , 
                                                 
                                                   j 
                                                   + 
                                                   v 
                                                 
                                               
                                               ) 
                                             
                                           
                                           - 
                                           
                                             
                                               p 
                                               l 
                                             
                                             _ 
                                           
                                         
                                         ) 
                                       
                                     
                                   
                                   } 
                                 
                                 2 
                               
                               * 
                             
                           
                         
                         
                           
                             
                               
                                 { 
                                 
                                   
                                     ∑ 
                                     
                                       
                                         u 
                                         = 
                                         
                                           - 
                                           w 
                                         
                                       
                                       , 
                                     
                                     w 
                                   
                                    
                                   
                                       
                                   
                                    
                                   
                                     
                                       ∑ 
                                       
                                         v 
                                         = 
                                         
                                           - 
                                           w 
                                         
                                       
                                       w 
                                     
                                      
                                     
                                         
                                     
                                      
                                     
                                       ( 
                                       
                                         
                                           
                                             p 
                                             r 
                                           
                                            
                                           
                                             ( 
                                             
                                               
                                                 ir 
                                                 + 
                                                 u 
                                               
                                               , 
                                               
                                                 j 
                                                 + 
                                                 v 
                                               
                                             
                                             ) 
                                           
                                         
                                         - 
                                         
                                           
                                             p 
                                             r 
                                           
                                           _ 
                                         
                                       
                                       ) 
                                     
                                   
                                 
                                 } 
                               
                               2 
                             
                           
                         
                       
                     
                   
                 
               
               
                 
                   ( 
                   3 
                   ) 
                 
               
             
           
         
       
     
         [0074]    in the above formula,  p l    and  p r    respectively represent an average image grey, u and v respectively represent coordinates in a selected matching window, p 1 (i+u, j+v) represents a grey value at a pixel position (i+u, j+v) in the window of the first camera, and p r (ir+u, j+v) represents a grey value at a pixel position (ir+u, j+v) in the window of the second camera; upon epipolar rectification, each candidate point has the same y-coordinate j; a correlation measurement function is obtained by traversing all the candidate points (ir, j) of the second camera and the correlated values of a position (i, j) of the first camera, wherein only the corresponding point has a higher correlation value, and pixel-level corresponding points of the first and second cameras are obtained from the candidate points by defining a threshold; and 
         [0075]    step 5: upon obtaining the pixel-level points, obtaining a corresponding relationship of subpixels according to the wrapped phase differences of the first and second cameras, and reconstructing three-dimensional geometric depth data in combination with pre-calibrated internal parameters and structural parameters of the first and second cameras. 
         [0076]    With respect to the sensor i, a depth image of the view point may be obtained, and then the depth image of the view point may be matched to the global coordinate system by means of coordinate transformation as illustrated in formula (4). 
         [0000]    
       
         
           
             
               
                 
                   { 
                   
                     
                       
                         
                           
                             X 
                             
                               w 
                               , 
                               1 
                             
                           
                           = 
                           
                             
                               
                                 R 
                                 1 
                                 
                                   - 
                                   1 
                                 
                               
                               · 
                               
                                 X 
                                 1 
                               
                             
                             - 
                             
                               
                                 R 
                                 1 
                                 
                                   - 
                                   1 
                                 
                               
                               · 
                               
                                 T 
                                 1 
                               
                             
                           
                         
                       
                     
                     
                       
                         … 
                       
                     
                     
                       
                         
                           
                             X 
                             
                               w 
                               , 
                               i 
                             
                           
                           = 
                           
                             
                               
                                 R 
                                 i 
                                 
                                   - 
                                   1 
                                 
                               
                               · 
                               
                                 X 
                                 i 
                               
                             
                             - 
                             
                               
                                 R 
                                 i 
                                 
                                   - 
                                   1 
                                 
                               
                               · 
                               
                                 T 
                                 i 
                               
                             
                           
                         
                       
                     
                     
                       
                         … 
                       
                     
                     
                       
                         
                           
                             X 
                             
                               w 
                               , 
                               10 
                             
                           
                           = 
                           
                             
                               
                                 R 
                                 10 
                                 
                                   - 
                                   1 
                                 
                               
                               · 
                               
                                 X 
                                 10 
                               
                             
                             - 
                             
                               
                                 R 
                                 10 
                                 
                                   - 
                                   1 
                                 
                               
                               · 
                               
                                 T 
                                 10 
                               
                             
                           
                         
                       
                     
                   
                 
               
               
                 
                   ( 
                   4 
                   ) 
                 
               
             
           
         
       
     
         [0077]    In the above formula, X i  represents the coordinates of a three-dimensional point in a local coordinate system of the i-th three-dimensional sensor, R i  and T i  represent a transformation matrix from the local coordinate system of the i-th three-dimensional sensor to a global coordinate system, X wi  represents the coordinates of the point X i  that is transformed to the global coordinate system, which is obtained through transformation of the calibrated result r i , t i  (i=1, 2, 3 . . . 10). 
         [0078]    Upon completion of matching of different view points, each control base station transmits the depth data to the control center over a Gigabit network. Afterwards, the control center inspects the matching precision. If the precision is poor, fine matching may be further carried out. For details about the fine matching, reference may be made to  Key Techniques in Multiple Range Images Modeling  (by Liu Xiaoli, Doctor of Philosophy Dissertation of Tianjin University, 2008). 
         [0079]    Data acquisition process and data acquisition result exhibition are described by using human body scanning as an example. According to the above steps, as illustrated in  FIG. 1 , five control base stations are deployed, wherein each control base station is equipped with two sets of three-dimensional sensors, an upper one and a lower one. The entire system is calibrated by using the three-dimensional reference points as illustrated in  FIG. 6 . According to the control flowchart as illustrated in  FIG. 5 , the upper and lower sets of three-dimensional sensors are triggered to acquire image sequences and reconstruct the three-dimensional depth data of the view point, as illustrated in  FIG. 9 . Color information is mapped to the depth data, as illustrated in  FIG. 10 . Afterwards, the control base stations match the depth data to a uniform coordinate system according to the calibrated parameters, and then transmit the depth data to the control center. Upon receiving the depth data, the control center further carries out fine matching and data fusing.  FIG. 11  illustrates a result output upon depth image fusion. 
         [0080]    The above description is merely preferred embodiments of the present invention, but are not intended to limit the present invention. Any modification, equivalent replacement, or improvement made without departing from the spirit and principle of the present invention should fall within the protection scope of the present invention.