Abstract:
A non-contact 3D measuring system is configured to provide a combined three-dimensional shape of an object to be imaged based on a frame image, which has been captured by a camera while a measuring head is being scanned in an optical axis (Z-axis) direction, and the information on the position at which the image has been acquired. The system includes: a position detector for detecting a scanning position of the measuring head while a plurality of raw images are captured; and a computer for generating an interpolation image by linear interpolation for the captured raw image using the information of the scanning position as well as generating a combined frame image using the interpolation image.

Description:
CROSS-REFERENCE TO RELATED APPLICATION 
       [0001]    The disclosure of Japanese Patent Application No. 2016-095682 filed on May 11, 2016 including specifications, drawings and claims are incorporated herein by reference in its entirety. 
       TECHNICAL FIELD 
       [0002]    The present invention relates to a non-contact 3D measuring system, and particularly, to a non-contact 3D measuring system which is suitable for use in a vision measuring system or a measuring microscope that includes an interlace camera, and which enables a combined frame image to be provided with high accuracy and thus highly accurate shape measurement. 
       BACKGROUND ART 
       [0003]    A non-contact 3D combining method employed for a conventional vision measuring system may be classified into the provision of a combined three-dimensional shape by focal position detection (Point From Focus; hereinafter referred to as PFF) and the provision of a combined three-dimensional shape by white light interference (hereafter referred to as WLI). Both the methods provides a combined three-dimensional shape on the basis of successive images, captured while the measuring head is being scanned in the direction of an optical axis (images referred to here are frame images), and the information on the position at which the images are acquired. 
         [0004]    Here, when an interlace camera is used to capture successive images, as illustrated by way of example in  FIG. 1  STEP ( 1 ), since an image within the range of one field of view is separately captured in two fields, i.e., odd and even fields, the interlace camera mounted on a measuring head  10  to be scanned in the Z axis direction needs to combine the Odd and Even field images into an image of one field of view (frame image) in order to acquire a combined three-dimensional shape. 
         [0005]    As shown in  FIG. 1  STEP ( 1 ), for example, for Odd and Even field images (raw images) captured at positions Z 2  and Z 3 , the frame image combining process produces interpolation images of the Even and Odd fields at the same respective positions Z 2  and Z 3  (interpolation field images) as shown in  FIG. 1  STEP ( 2 ), and then combines the raw images at the positions Z 2  and Z 3  (Odd at Z 2  and Even at Z 3 ) with the respective interpolation field images (Even at Z 2  and Odd at Z 3 ), thereby generating the frame images at the respective positions Z 2  and Z 3  as shown in  FIG. 1  STEP ( 3 ). 
       SUMMARY OF INVENTION 
     Technical Problem 
       [0006]    However, as illustrated by way of example in  FIG. 2 , the conventional frame image combining process is performed assuming that images are captured at constant distance intervals in the scanning direction of the measuring head by capturing the images at constant time intervals and moving the measuring head  10  at constant speeds. That is, as a technique for generating an Even interpolation field image for an Odd field image at a certain position, Even field images before and after the Odd field image (Even raw images  1  and  2  in  FIG. 2 ) are used to employ, as an Even interpolation field image, an image having a brightness value acquired by a simple average of brightness values I1 ij  and I2 ij  of the respective pixels as below: 
         [0000]        I   ij =( I 1 ij   +I 2 ij )/2. 
         [0007]    However, in practice, since the measuring head is not moved at constant speeds due to variations in speed during the acceleration/deceleration of the measuring head or due to speed ripples at the time of a low-speed movement thereof, images are not captured at constant distance intervals. In particular, using a servo motor to move the measuring head may cause the acceleration and deceleration thereof to be gradually performed at the start and end of a movement, thereby making it difficult to acquire images at accurate constant space pitches by the image acquirement at constant time pitches. As a result, properly combined frame images cannot be acquired, with the result of reduced measurement accuracy. 
         [0008]    Note that disclosed in Japanese Patent Application Laid-Open No. 2000-270211 is to combine together images of Odd data and Even data; disclosed in Japanese Patent Application Laid-Open No. 2009-49547 is to weight each of pieces of image data of a plurality of images, followed by combining them; and disclosed in Japanese Patent Application Laid-Open No. Hei. 9-274669 is to produce a combined image without determining in advance the distance to an object of interest. However, any of them did not successfully address the aforementioned problem. 
         [0009]    The present invention has been developed to address the aforementioned conventional problems. An object of the present invention is to provide an improved method for acquiring a combined frame image, thereby improving measurement accuracy. 
       Solution to Problem 
       [0010]    The present invention has solved the aforementioned problems by providing a non-contact 3D measuring system configured to provide a combined three-dimensional shape of an object to be imaged based on a frame image captured by a camera while scanning a measuring head thereof in an optical axis direction and information of a position at which the image is acquired, the non-contact 3D measuring system including: a position detector for detecting scanning positions of the measuring head while a plurality of raw images are captured; and a computer for generating interpolation images by linear interpolation using information of the scanning positions for the captured raw images and for generating a combined frame image using the interpolation images. 
         [0011]    Here, when the camera is an interlace camera, the plurality of raw images are employed as raw images of respective odd and even fields, and interpolation images of even and odd fields at the same respective positions are generated by linear interpolation of the captured raw images using the information of the scanning positions, so that the raw image of the even field and the interpolation image of the odd field at each position, and the raw image of the odd field and the interpolation image of the even field are combined to produce the combined frame image. 
         [0012]    Alternatively, when the camera is a noninterlace camera, it is possible to produce interpolation images between the plurality of raw images. 
         [0013]    Furthermore, the non-contact 3D measuring system can include at least any one of an image optical measuring head that includes an objective lens, a camera, and an illumination unit and is capable of performing the Point From Focus (PFF) measurement, and a White Light Interference (WLI) optical measuring head that includes an interference objective lens, a camera, and an illumination unit. 
         [0014]    Furthermore, the position detector can be a Z-axis scale. 
         [0015]    Furthermore, in performing the Point From Focus (PFF) measurement with a non-contact 3D measuring system using an image optical measuring head that includes an objective lens, a camera, and an illumination unit, it is possible to include the following steps of: 
         [0016]    scanning the objective lens along a Z-axis column in a Z-axis direction over a work; 
         [0017]    acquiring a raw image from the camera mounted on the image optical measuring head and also acquiring a Z coordinate value from a Z-axis scale mounted on the Z-axis column, thereby stacking images and Z coordinate values at a constant pitch; 
         [0018]    generating an interpolation image by linear interpolation using information of the scanning positions for the captured raw images and generating a combined frame image using the interpolation image; 
         [0019]    generating a contrast curve at each pixel position from the stacked images; and 
         [0020]    combining a 3D shape with a contrast peak position of each pixel being employed as a Z position. 
         [0021]    Or alternatively, in performing the WLI measurement with a non-contact 3D measuring system using a White Light Interference (WLI) optical measuring head that includes an interference objective lens, a camera, and an illumination unit, it is possible to include the following steps of: 
         [0022]    scanning the interference objective lens in a Z-axis direction; 
         [0023]    acquiring a raw image from the camera mounted on the WLI optical measuring head and also acquiring a Z coordinate value from a Z-axis scale mounted on a Z-axis column, thereby stacking images and Z coordinate values at a constant pitch; 
         [0024]    generating an interpolation image by linear interpolation using information of the scanning positions for the captured raw images and generating a combined frame image using the interpolation image; 
         [0025]    generating an interference signal of each pixel from interference fringes of the stacked images; and 
         [0026]    combining a 3D shape with the peak position of the interference fringes of each pixel employed as a Z position. 
       Advantageous Effects of Invention 
       [0027]    In the present invention, for example, when the interlace camera is used, as schematically illustrated in  FIG. 3 , for example, in generating an Even interpolation field image, the image is to be generated by the brightness value below: 
         [0000]        I   ij ={( dZ   2   −dZ   1 )* I 1 ij   +dZ   1   *I 2 ij   }/dZ   2 , 
         [0000]    where the brightness value I ij  is acquired by linear interpolation using the position information (Z coordinate values, dZ 1  and dZ 2 ) of the field image captured by the measuring head  10 , the position information being acquired, for example, by the Z-axis scale  12 . 
         [0028]    Thus, greater promise for high precision can be expected as compared with the combined frame image by the conventional simple average. Furthermore, even when there occurs a lack in the field image acquired by the interlace camera, the present invention can be employed so as to produce an interpolation field image accurately from adjacent field images that have no lack. It is thus possible to prevent degradation of precision. 
         [0029]    Note that the applications of the present invention are not limited to those using an interlace camera, but may also be applicable even to the case where interpolation images are generated between a plurality of raw images when a noninterlace progressive camera is used. 
         [0030]    These and other novel features and advantages of the present invention will become apparent from the following detailed description of preferred embodiments. 
     
    
     
       BRIEF DESCRIPTION OF DRAWINGS 
         [0031]    The preferred embodiments will be described with reference to the drawings, wherein like elements have been denoted throughout the figures with like reference numerals, and wherein: 
           [0032]      FIG. 1  is an explanatory view illustrating a method for providing a combined frame image by an interlace camera; 
           [0033]      FIG. 2  is an explanatory view illustrating an interpolation process of a conventional field image; 
           [0034]      FIG. 3  is an explanatory view illustrating the principle of an interpolation process of a field image by linear interpolation according to the present invention when an interlace camera is used; 
           [0035]      FIG. 4  is a perspective view illustrating an entire configuration of an example of a non-contact 3D measuring system to which the present invention is applied; 
           [0036]      FIG. 5  is a block diagram illustrating the system configuration of the same system; 
           [0037]      FIG. 6  is a flowchart indicative of the procedure of the PFF measurement; 
           [0038]      FIGS. 7A and 7B  are explanatory views illustrating the principle of the PFF measurement; 
           [0039]      FIG. 8  is a view illustrating the configuration of a Mirau type optical system for WLI measurement; 
           [0040]      FIG. 9  is also a cross-sectional view illustrating the configuration of a Michelson type optical system; 
           [0041]      FIG. 10  is a flowchart indicative of the procedure of the WLI measurement; 
           [0042]      FIG. 11  is an explanatory view illustrating the principle of the WLI measurement; and 
           [0043]      FIG. 12  is an explanatory view illustrating the principle of an interpolation process for a field image by linear interpolation according to the present invention when a noninterlace camera is used. 
       
    
    
     DESCRIPTION OF EMBODIMENTS 
       [0044]    Embodiments of the present invention will be described below in detail with reference to the drawings. It should be noted that the present invention is not limited to the contents described in the following embodiments and practical examples. The components of the embodiments and practical examples described below may include ones easily conceivable by those skilled in the art, substantially identical ones, and ones within the range of equivalency. The components disclosed in the embodiments and practical examples described below may be combined as appropriate, and may be selected and used as appropriate. 
         [0045]    As illustrated in the entire configuration of  FIG. 4  and in the system configuration of  FIG. 5 , the embodiment of the present invention is a non-contact 3D measuring system  20  with an XY stage  22  and a Z-axis column  24 . The system  20  is provided with both or one of two measuring heads: an image optical measuring head  30  capable of performing the PFF measurement and including an objective lens  32 , a CCD camera  34 , and a illumination unit  38 ; and a WLI optical measuring head  40  including an interference objective lens  42 , a CCD camera  44 , and a illumination unit  48 . 
         [0046]    The Z-axis column  24  is provided with a Z-axis scale (not shown) (symbol  12  in  FIG. 3 ) and capable of measuring fine positions in the Z-axis direction of the measuring heads  30  and  40 . 
         [0047]    As shown in detail in  FIG. 5 , the image optical measuring head  30  includes the CCD camera  34  and a power turret  36  for replacing the objective lens  32 . The illumination unit  38  includes, for example, a white LED transparent illumination device  38   a , a white LED vertical epi-illumination device  38   b , and a white LED program controlled ring illumination device  38   c.    
         [0048]    As also shown in detail in  FIG. 5 , the WLI optical measuring head  40  includes the CCD camera  44  and a microscope unit  46 , and the illumination unit  48  includes, for example, a halogen bulb vertical epi-illumination device. 
         [0049]      FIG. 5  shows a remote box  60  for remote control of the main body; a halogen controller  62 ; an anti-vibration table  64 ; a computer unit  70  including a computer (PC) main body  72 , a mouse  80 , a keyboard  82 , and a monitor  84 . The computer main body  72  includes a frame grabber  74  for an image optical measuring head, a frame grabber  76  for a WLI optical measuring head and a video timing input interface (I/F)  78 .  86  denotes a software  86   
         [0050]    Note that in the case of the 3D measuring system for the PFF measurement, the WLI optical measuring head  40 , the interference objective lens  42 , and the frame grabber  76  for the WLI optical measuring head are eliminated. On the other hand, in the case of the WLI measurement 3D measuring system, the PFF measurement is not performed. 
         [0051]    Now, with reference to  FIGS. 6 and 7A, 7B , the procedure for the PFF measurement will be described. 
         [0052]    First, in step  100 , as shown in  FIG. 7A  STEP ( 1 ), the objective lens  32  is scanned in the Z-axis direction along the Z-axis column  24  across a work  8 . 
         [0053]    Next, in step  110 , as shown in  FIG. 7A  STEP ( 2 ), images and Z coordinate values are stacked at a constant pitch. More specifically, a raw image is acquired from the CCD camera  34  mounted on the image optical measuring head  30  and the Z coordinate value is acquired from the Z-axis scale (not illustrated) mounted on the Z-axis column  24 . 
         [0054]    Next, in step  120 , according to the present invention, by the method as shown in  FIG. 3 , interpolation field images (Even/Odd) are generated for the acquired respective raw images (Odd/Even), and then in step  130 , a combined frame image is generated. 
         [0055]    Next, in step  140 , as shown in  FIG. 7B  STEP ( 3 ), a contrast curve is generated at each pixel position from the stacked images. 
         [0056]    Next, in step  150 , as shown in  FIG. 7B  STEP ( 4 ), the contrast peak position of each pixel is employed as a Z position to provide a combined 3D shape. 
         [0057]    In this manner, it is possible to increase the shape measurement accuracy for the PFF image measurement using an interlace camera. 
         [0058]    Now, the WLI measurement also using an interlace camera will be described. 
         [0059]    In this case, the Mirau type optical system is configured as shown in  FIG. 8 , and the Michelson type optical system is configured as shown in  FIG. 9 . 
         [0060]    In any of the configurations, the illumination beam emitted from a white light source  49  of the illumination unit is split into two beams of light, i.e., one to a reference mirror  50  and the other to the work  8 , by a beam splitter  52  for the interference objective lens  42 . Here, scanning the interference objective lens  42  in the Z-axis direction causes interference fringes to occur about the position at which the optical-path difference between the beam of light reflected on the reference mirror  50  and the beam of light reflected on the surface of the work  8  is zero. In this context, the position of the peak strength of the interference fringes is detected at each pixel position of the CCD camera  44 , thereby making it possible to acquire a three-dimensional shape of the surface of the work  8 . The figure shows a collimator lens  54 , a beam splitter  56 , and a tube lens  58 . 
         [0061]    Now, with reference to  FIG. 10 , the procedure of the WLI measurement will be described. 
         [0062]    First, in step  200 , the interference objective lens  42  is scanned in the Z-axis direction. 
         [0063]    Next, in step  210 , images and Z coordinate values are stacked at a constant pitch. Here, a raw image is acquired from the CCD camera  44  mounted on the WLI optical measuring head  40 , and a Z coordinate value is acquired from the Z-axis scale (not illustrated) mounted on the Z-axis column  24 . 
         [0064]    Next, in step  220 , according to the present invention, by the method as shown in  FIG. 3 , for the acquired raw images (Odd/Even), the respective interpolation field images (Even/Odd) are generated, and then in step  230 , a combined frame image is generated. 
         [0065]    Next, in step  240 , as shown in  FIG. 11 , the interference signal of each pixel is generated from the interference fringes of the stacked images. 
         [0066]    Next, in step  250 , the peak position of the interference fringes of each pixel is employed as a Z position to provide a combined 3D shape. 
         [0067]    It is thus possible to improve the shape measurement accuracy of the WLI image measurement using an interlace camera. 
         [0068]    Note that in any of the embodiments, the present invention is applied to a 3D measuring system using an interlace camera. However, the invention is not limited thereto. As the principle is shown in  FIG. 12 , the invention is also applicable to a 3D measuring system or a measuring microscope using a noninterlace camera. Furthermore, the camera is not limited to a CCD camera. Furthermore, the measurement principle is limited to neither the PFF measurement nor the WLI measurement. 
         [0069]    It should be apparent to those skilled in the art that the above-described embodiments are merely illustrative which represent the application of the principles of the present invention. Numerous and varied other arrangements can be readily devised by those skilled in the art without departing from the spirit and the scope of the present invention.