# Calibration of a Stereo Radiation Detection Camera Using Planar Homography

Authors: Seung-Hae Baek; Pathum Rathnayaka; Soon-Yong Park
Journal: Journal of Sensors
 (2016)

---

## Abstract

This paper proposes a calibration technique of a stereo gamma detection camera. Calibration of the internal and external parameters of a stereo vision camera is a well-known research problem in the computer vision society. However, few or no stereo calibration has been investigated in the radiation measurement research. Since no visual information can be obtained from a stereo radiation camera, it is impossible to use a general stereo calibration algorithm directly. In this paper, we develop a hybrid-type stereo system which is equipped with both radiation and vision cameras. To calibrate the stereo radiation cameras, stereo images of a calibration pattern captured from the vision cameras are transformed in the view of the radiation cameras. The homography transformation is calibrated based on the geometric relationship between visual and radiation camera coordinates. The accuracy of the stereo parameters of the radiation camera is analyzed by distance measurements to both visual light and gamma sources. The experimental results show that the measurement error is about 3%.


---

## Body

## 1. Introduction

Detection of radioactive sources is one of the important topics in many research areas, particularly in nuclear instrumentation, nuclear physics, nuclear medicine, and many nondestructive tests [1]. Radiation detectors, also known as particle detectors, are used to detect, track, and identify the presence of radioactive sources within a given area or environment. As a generic definition, radiation is an energy that comes from a source and travels through some material or space. They can be found in many different formats such as alpha, beta, gamma, and X-ray. The detection of sources that emit radiation plays a very significant role in many areas of science and industry. Mainly, gamma radiation has managed to attract the interest of most of the scientists since the advance of the Anger camera [2].Not only the detection of radioactive sources is crucial, but also the accurate estimation of their three-dimensional (3D) information is important. If the 3D position information of radioactive (such as gamma) sources is available, their activity (strength) can be estimated more precisely. However, detection of gamma sources which are widely distributed in the 3D environment is not an easy task to accomplish as it may seem. Determining or estimating the 3D coordinates of such widely spread gamma sources using a single camera is almost impossible. Therefore, in this paper, we use a stereo gamma detection device instead of using mono devices to estimate their coordinates precisely.When detecting and extracting metric information from two-dimensional (2D) radiation images using a stereo gamma camera (SGC), we must consider the calibration of the camera. Proper calibration methods have to be implemented in order to obtain more accurate 3D coordinate measurement. Since accurate calibration of vision cameras is of interest in computer vision, many related works have been done throughout the last few decades [3–7].Although much work related to the calibration of stereo and mono vision camera has been introduced, a proper calibration method of an SGC has not been introduced yet. Considering it as a fact, we propose a new simplified method to calibrate such SGC devices using planar homography relationships. The experiment system consists of a 1D gamma sensor and a 2D vision sensor, which are mounted on a pan-tilt motion device. Because the gamma sensor is a 1D point sensor, the pan-tilt device scans the sensor in horizontal and vertical directions to acquired 2D gamma images. In addition, the pan-tilt device also rotates both the gamma sensor and vision sensor in a symmetric position so that each sensor can obtain stereo images with the same baseline. Therefore the gamma sensor combined with the pan-tilt device works as a 2D radiation camera and the vision camera is used to acquire the corresponding 2D visual information.To measure 3D information from the stereo gamma images, the stereo gamma camera must be calibrated. However, no visual information can be obtained from the camera, and we transform the visual images obtained from the vision camera to the view of the gamma camera. In this way, we can obtain virtual calibration images of the gamma camera to calibrate the stereo geometry of the gamma camera. Once the devices are fully calibrated, we can measure the parallax in the stereo gamma images and distance to the radioactive sources.The paper is constructed as follows. Section2 introduces the panning and tilting method implemented to generate radiation images. Section 3 describes the method used to calculate the planar homography relationships between gamma camera images and vision camera images. The proposed calibration method is described in Section 4. Section 5 presents the experiments we have performed to measure 3D distance to both visual light and gamma sources. In this section, we evaluate the accuracy of the proposed calibration method by comparing the acquired results with real data. Section 6 consists with the conclusion.


## 2. Obtaining Stereo Gamma Images Using a Gamma Detector

The approach of obtaining gamma images is based on scanning a 1D gamma detector using a pan-tilt motion module. Figure1 shows a simplified diagram of this concept. A 1D gamma detector is mounted on a pan-tilt module which is connected to a general purpose PC. The rotation of the pan-tilt module in panning and tilting directions is controlled by a terminal program of the PC. According to the resolution of a gamma image, the sensing direction of the pan-tilt module is determined. At every sensing direction, the detector obtains the corresponding pixel’s grey value of the image. By obtaining all pixel values, a 2D gamma image is then generated. Therefore, we can consider that there is a virtual 2D gamma camera which can capture a gamma image.Figure 1
Obtaining a gamma image by using a gamma detector and a pan-tile module.As a gamma detector, a SPMT (small photo multiplier tube) is used with a Nal (Tl) type scintillator. The detection sensitivity of the SPMT is the maximum at 420 nm. The output type of the detector is the pulse count of photons, which are generated by the SPMT. For more information, see reference [8]. The pulse counts from the SPMT are recorded and mapped to the grey value of a pixel in the gamma image.A 2D vision camera is also mounted on the opposite side of the gamma detector. The vision camera only captures two ways of visual information, the left and the right images, of the scanning area. The viewing angle of the vision camera is determined by the lens of the camera and it is usually different than the scanning area of the detector. However, it can be transformed to be matched with the scanning area of the detector by using the calibration parameters of the camera.Figure2 shows a CAD model and a real view of the pan-tile module equipped with two enclosures for mounting gamma and vision camera. The pan part of the module rotates the tilt part and two sensing devices more than 180 degrees. In addition, the tilt part rotates the gamma detector and the vision camera more than 180 degrees also. Figure 3 shows diagrams to explain the way of capturing stereo images of two sensing devices. In the beginning, suppose the gamma camera is on the right side of the pan-tile module and the vision camera is on the left side. Therefore, we can obtain the right gamma image (JR) from the virtual gamma camera and the left vision image (IL) from the vision camera. Next, let us rotate the pan and tilt parts 180 degrees, respectively. Then the origin of the sensor coordinate systems is exactly exchanged, while the image planes of the cameras are rotated 180 degrees with respect to the image center. The image rotation can be easily rotated to the right directions; finally, we can obtain the left gamma image (JL) and the right vision image (IR) in the final position.Figure 2
(a) CAD model and (b) real view of the pan-tilt module and two enclosures for mounting gamma and vision cameras.
(a)
(b)Figure 3
Panning and tilting of sensing devices for obtaining stereo gamma and vision images.In order to rotate the pan-tilt module accurately, we control the module using very accurate DC motors and a motion controller. The motors are equipped with encoders with the resolution of 2048 pulses per revolution. In addition the rotation of the pan and tilt module is reduced by 100 : 1 gear ratio. Therefore, the rotation accuracy is very high and we assume the error is less than 0.01 degrees. Table1 shows the specification of some categories of the pan-tile module.Table 1
Specifications of the pan-tilt module.
Category
Specification
Baseline(|OL-OR|)
280 mm
Pan/tilt encoder resolution
2048 pulse/rev
Pan/tilt gear ratio
100 : 1
Rotation accuracy
<0.01°
Mechanical backlash
<0.1°
Dimension
360 × 270 × 200 mm3 (W×H×D)


## 3. Homography Relationship between Gamma and Vision Cameras

The first step of the proposed method is calculating the homography relationship between two different image planes of the gamma and vision cameras. Currently two types of gamma detectors are used: pin-hole and coded aperture types [9]. As described in the previous section, our gamma sensor is a pin-hole detector which consists of a cylindrical collimator and an SPMT. Assuming that the gamma and vision cameras follow the pinhole camera model, the image formation between the gamma and vision cameras is related by a homography. In the previous section, we show that the coordinate origins of the gamma and vision cameras are the same because of the symmetric motion of the pan-tilt module. There are two homography relations between gamma and vision images: one is between left gamma and vision images (JL and IL) and the other is between right gamma and vision images (JR and IR).LetHL and HR be the left and the right homography of the gamma and vision cameras, respectively. As shown in Figure 4, HL is the homography from IL to JL, and HR is the homography from IR to JR. To transform the vision images to gamma images, IL and IR are multiplied by HL and HR, respectively, as follows, and then the results are homogeneously equal to the gamma image: (1)JL≅HLIL,JR≅HRIR.Because two sensor’s images captured from the same capture position, for example, from IL and JL, have the same coordinate origin, 2D homography relation is enough to transform one image plane to the other.Figure 4
Homography relations between gamma and vision images.To calculate the planar homography matrixH, we need at least four corresponding image points between the gamma and vision images. This means that we need to know at least four sets of 2D image coordinates of any object which can be captured in both gamma and vision cameras. Fortunately, the gamma detection sensor is designed to respond to visible light. Thus we can use four-point light sources to find the homography.Figure5 shows an example of capturing four corresponding image points between the gamma and vision cameras. Four LED light sources are fixed in front of the cameras as calibration objects and gamma and vision images of the light sources are obtained. Both in gamma and vision images, the image intensity of the LED sources is higher than those of their neighboring pixels. We apply the Gaussian fitting method [10] to get the exact coordinates of the corresponding points and calculate the homography HL and the homography HR using a linear algebra equation.Figure 5
Gamma and vision images of four LED lights: (a) calibration setup, (b) gamma image (top:JL; bottom: JR), and (c) vision image (top: IL; bottom: IR).
(a)
(b)
(c)H
L and HR are 3 × 3 matrices, but their scale is unknown. Therefore, using four pairs of matching points between gamma and vision images, we can compute eight unknown parameters of the homography. Equation (2) shows homography HL and homography HR computed by the images in Figure 5: (2)HL=0.53197-0.02558-164.897-0.027130.57747-9.0443-1.7225×10-4-1.1717×10-41.0HR=0.52141-0.023501-165.795-0.040640.52391-8.2434-2.0699×10-4-2.3451×10-41.0.Figure6 shows an example of applying the HL and HR to the vision images. In Figure 6(a), left and right vision images IL and IR are captured in 640 × 480 resolution. Using two homography matrices, virtual gamma images JL and JR are obtained in 400 × 400 resolution. Each pair of left and right images shares the same coordinate origin; thus, there are only scale and rotation transformation between the vision and gamma images (ideally speaking, there is no rotation transformation if the coordinate axes of the two sensors are parallel).Figure 6
Example of generating calibration pattern images from the view of the stereo gamma camera: (a) left and right vision images and (b) left and right gamma images.
(a)
(b)In Figure7, more light sources are used to calibrate the homography between the two stereo cameras. Images of eight LED light points are captured in the images from both the vision and gamma cameras. Images in Figure 7(a) show the original captured images of light points from the vision and gamma cameras. Homography relation between the left and right sensors is shown in (3). In Figure 7(c) are virtual gamma images obtained from the homography relation:(3)HL=0.9513680.012253-387.1860.0438550.905885-230.0533.1221×10-44.2492×10-51.0HR=0.8268630.025824-307.1240.0177590.821441-163.5381.9185×10-42.0055×10-51.0.Figure 7
Example of generating calibration pattern images from the view of the stereo gamma camera: (a) left and right vision images and (b) left and right gamma images.
(a)
(b)
(c)


## 4. Stereo Calibration of Vision and Gamma Cameras

In the field of computer vision, calibration of a stereo vision camera is a general but important task. Many calibration algorithms have been introduced; however, currently Zhang’s method is widely used. To use Zhang’s calibration method, it is recommended to capture at least six images of a calibration pattern which usually consists of checkerboard patterns. Zhang’s calibration algorithm is available in several computer vision libraries such as OpenCV and MATLAB. In this paper, we also use the OpenCV computer vision library for calibrating the vision and gamma cameras.Obtaining the images of the calibration pattern from the gamma camera is a main problem of this paper. It is because that the gamma camera cannot capture the images of the printed calibration pattern. To solve this problem we use the homography relationship between the gamma and vision cameras. Once several imagesIL and IR of the calibration board from the vision camera are obtained, these images are transformed by HL and HR to generate virtual calibration images JL and JR from the view of the left and right gamma cameras. Then the transformed images are used as input of Zhang’s algorithm to obtain the stereo calibration parameters of the stereo gamma camera. The whole stereo calibration process is shown in Figure 8. The intrinsic and extrinsic parameters of both left and right radiation detectors are depicted in Tables 2 and 3. Here, Rx, Ry, and Rz represent the rotation matrix, and tx, ty, and tz represent the translation components.Table 2
Intrinsic parameters of the left and right gamma cameras.
Camera
Focal length(fx)
Focal length(fy)
Principal point(Cx)
Principal point (Cy)
Left camera
1048.01
1044.52
302.31
297.64
Right camera
1048.92
1044.95
310.61
302.64Table 3
Extrinsic parameters of the right gamma camera with respect to the left camera.
R
x
R
y
R
z
t
x
t
y
0.00783
−0.04690
0.00209
−51.03
−1.14Figure 8
The complete processes of stereo gamma camera calibration.


## 5. Distance Measurement to Radioactive Sources

In order to evaluate the accuracy of the proposed calibration method, we performed distance measurement experiments using the calibrated stereo gamma camera. The main approach of this is to calculate distances to the previously used bright LED spots which are installed at already known distance. Two kinds of experimental setup “P4” and “P8” are used in distance measurement which are shown already in Figures5 and 7. In the first experimental setup, four LEDs are placed on different positions as shown in Figure 5(a). In the second experimental setup, eight LEDs are placed on different positions as shown in Figure 7(a).The positions of the light spot are measured using a Bosch GLM 250 VF Professional laser rangefinder. After gamma camera calibration, the intrinsic and extrinsic camera parameters can be obtained and they are used to calculate left and right perspective projection matrices (PPM). Figure9 shows left and right stereo gamma images where image processing methods such as adaptive thresholding, contour detection, and ellipse fitting are applied to find the center points ((u,v) and (i,j)) of each LED light spot of the “P4” setup. Essential and fundamental matrices can also be calculated using the camera parameters according to (4) and the epipolar geometry is applied to identify the corresponding matching points of left and right gamma images. These correspondences are represented with identical colors in Figure 9:(4)E=RtxF=K′T-1EK-1.Figure 9
Representing corresponding matching points in left and right gamma images of “P1” setup.
(a)
(b)E and F represent the essential and fundamental matrices of the stereo gamma camera, respectively. Rtx is the cross product of the extrinsic camera parameters whereas K′ and K represent the intrinsic parameters of the left and right cameras, respectively. The 3D coordinates W(X,Y,Z)for each matching point set can be calculated using a linear equation (5):(5)AW=Y.Here Arepresents a 4 × 3 matrix and Y represents a 4 × 1 matrix as below. The inverse of matrix A is calculated using the singular value decomposition (SVD) method:(6)PPML=a1Ta14a2Ta24a3Ta34PPMR=b1Tb14b2Tb24b3Tb34A=a1-ua3Ta2-va3Tb1-ib3Tb2-jb3TY=a14-ua34a24-va34b14-ib34b24-jb34.Figure10 shows “P4” experimental setup. In this setup, we have done two experiments by changing the position of the four light points as shown in the figure. Figure 10(a) is the same one used in the homography calibration. Figure 10(b) shows four LED lights are placed at the same distance to the gamma camera. Using the two kinds of setup, two distance measurement experiments “P4E1” and “P4E2” are done. As shown in Table 4, the distance measurement is very accurate, where the average percentage error is about 1.13% in “P4E1” and 2.41% in “P4E2” experiments. To each point light in Figure 10(a), measurement error is about 1~4 cm from camera distance of 210~270 cm. If the distance to the LED light increases, the measurement error also increases.Table 4
Distance measurement results of “P4” experimental setup.
Experiments
Test point
Avg. error (%)
Std. Dev.
1
2
3
4
P4E1
Distance (cm)
210
230
250
270
1.13
1.13
Measured (cm)
207
228
249
274
P4E2
Distance (cm)
300
300
300
300
2.41
1.59
Measured (cm)
298
305
287
309Figure 10
The first experimental setup of the distance measurement using four LED lights: (a) P4E1 and (b) P4E2.
(a)
(b)We use more LED light points to analyze the accuracy of distance measurement. Figure11 shows the second experimental setup “P8” using eight LED lights which are fixed in the different distances. As shown in the figure, “point1,” “point2,” “point6,” and “point7” are on the same plane. Four other light points are fixed at the different distances. With this setup, we have done two experiments “P8E1” and “P8E2” by placing the gamma camera at the different distance from this setup. The ground truth distance to each LED light is shown in Table 5.Table 5
Distance measurement results of “P8” experimental setup.
Experiments
Test point
Avg. error (%)
Std. Dev.
1
2
3
4
5
6
7
8
P8E1
Distance (cm)
320
320
295
310
330
320
320
345
2.09
1.63
Measured (cm)
315
314
291
324
328
320
312
360
P8E2
Distance (cm)
300
300
310
325
300
300
275
290
7.71
5.83
Measured (cm)
312
291
261
272
300
324
298
308Figure 11
Experimental setup of the distance measurement using 8 LED lights. Two experiments “P8E1” and “P8E2” are done using the same setup.Figure12 shows the left and the right gamma images of the “P8E1” experiments. Stereo correspondences between the left and right images are shown in the same colored ellipse models. The center coordinates of the corresponding ellipse models are used to compute the distance of each LED light point. The calibration parameters of these experiments are also derived by using the same setup as described in Section 3.Figure 12
Corresponding points in left and right gamma images of 8 LED points.
(a)
(b)Table5 shows the results of experiments “P8E1” and “P8E2.” The average percentile distance error is about 2% in “P8E1” and 8% in “P8E2” experiment, respectively. The measurement error is a little higher than that of using four LEDs. This may be caused by using more light points in the computation of the homography relationship. We assume that the centers of the vision and gamma camera are the same, so that light points which are not in the plane can be used for homography computation. However, in reality, the alignment error of the centers of the two cameras can yield higher error not only in the homography computation but also in the distance measurement.As the final experiment, we use a real radioactive source to obtain stereo gamma images and measure the distance to the source. Figure13(a) shows a facility for general purpose experiments using a single radioactive source. In this facility, a radioactive source of Cs-137 exposes gamma radiation of 100 mSv/h at 2 m distance. As shown in the figure, the gamma source is exposed as a point source. We change the position of the stereo gamma camera module from 150 cm to 400 cm and measure the distance to the source using stereo gamma images captured in each distance.Figure 13
Stereo gamma image acquisition using a real radiation source: (a) experimental facility and (b) stereo gamma image at different measurement distances.
(a)
(b)Figure13(b) shows gamma images captured from the stereo gamma camera. The position difference in stereo images becomes smaller when the distance to the radioactive source becomes farther due to the parallel stereo geometry. In each distance, the center coordinates of the gamma source are extracted and the real distances to the source are calculated as in Table 6. Average percentage error is about 3.29% and it is reasonably accurate results.Table 6
Distance measurement results to real gamma.
Distance (cm)
150
200
250
300
350
400
Avg. error (%)
Std. Dev.
Measured (cm)
149.9
194.1
249.8
300.4
352.2
410.9
3.29
3.98


## 6. Conclusion

In this paper, we proposed a new method to calibrate stereo radiation detection devices using planar homography relationship. Because it is impossible to capture the calibration pattern images from a gamma camera, we use the planar homography relationship between gamma vision cameras to generate virtual calibration images. Bright LED point lights are used as calibration objects and a gamma camera is used as a radiation detection device. A set of calibration pattern images captured from a vision camera are converted into gamma images by applying homography relationships. Zhang’s calibration method is applied to calibrate the gamma camera afterwards. We performed distance measurement experiments using the calibrated gamma camera to check the accuracy of the proposed method. The 3D coordinates of LED point lights and a real gamma radiation source are obtained with high accuracy using stereo gamma images.



---

*Source: 8928096-2015-11-22.xml*