# Robust Calibration of Cameras with Telephoto Lens Using Regularized Least Squares

Authors: Mingpei Liang; Xinyu Huang; Chung-Hao Chen; Gaolin Zheng; Alade Tokuta
Journal: Mathematical Problems in Engineering
 (2014)

---

## Abstract

Cameras with telephoto lens are usually used to recover details of an object that is either small or located far away from the cameras. However, the calibration of this kind of cameras is not as accurate as the one of cameras with short focal lengths that are commonly used in many vision applications. This paper has two contributions. First, we present a first-order error analysis that shows the relation between focal length and estimation uncertainties of camera parameters. To our knowledge, this error analysis with respect to focal length has not been studied in the area of camera calibration. Second, we propose a robust algorithm to calibrate the camera with a long focal length without using additional devices. By adding a regularization term, our algorithm makes the estimation of the image of the absolute conic well posed. As a consequence, the covariance of camera parameters can be reduced greatly. We further used simulations and real data to verify our proposed algorithm and obtained very stable results.


---

## Body

## 1. Introduction

In various vision based applications, a camera with a telephoto lens is often useful to acquire detailed information of objects. It could capture high resolution face images for the purpose of recognition and reconstruction even when a user is at a distance [1]. It also could obtain eye images with rich iris textures when a user is several meters away from the camera [2, 3]. In [4], a telephoto lens is used to observe objects under the influence of optical turbulence. By combining with a wide-angle camera, a robotic vision system has been shown in [5], which is suitable for remote surveillance or minimally invasive surgical interventions that could have a higher resolution than typical commercial endoscopes. As the field of view of a telephoto lens could only have a few degrees (e.g., around 8 degrees for a 300 mm telephoto lens), in order to either track objects or reconstruct complete views, an accurate estimation of camera parameters is required.In the photogrammetry community, camera calibration usually is done by computing the projection matrix using accurate 3D points and corresponding 2D observations [6, 7]. However, in practice, it could be difficult or expensive to build an object with accurate coordinates, especially in a large working space. In the area of computer vision, the calibration technique [8] that requires only a planar pattern (e.g., a checkerboard pattern) is widely used. In this technique, a planar pattern is placed with different orientations and at different distances from the camera. Homographies are estimated between the planar pattern and its observations. These homographies could form a homogeneous system that is used to solve the image of the absolute conic. The intrinsic and extrinsic parameters are then computed by using the estimated homographies and the image of the absolute conic. In the final step, the maximum likelihood estimation (MLE) is applied to estimate the radial distortion and refine the intrinsic and extrinsic parameters by minimizing geometric errors. This technique has further been evaluated with respect to image noise level, number of planes, and orientation of the model plane. Various autocalibration techniques [9, 10] are also proposed to estimate fixed or varying intrinsic parameters without predefined calibration patterns. The basic idea is that the absolute conic is fixed when a camera is moving rigidly.Since focal lengths of cameras in many vision applications are relatively short, most of existing algorithms consider image noise as a major source of estimation uncertainties and limited research has been conducted on the uncertainties caused by focal length [11, 12]. In [11], Strobl et al. found that the narrow field of view makes the calibration more difficult due to lack of required evidence on perspectivity. In order to improve the calibration accuracy, the camera with a narrow field of view is mounted on a robotic manipulator from which the rigid motions can be read. These rigid motions could provide more constraints for solving the intrinsic parameters and a relative geometric relation between the camera and the robotic manipulator. Similarly, a pan-tilt unit could be used during the calibration as shown in [12].There are mainly two contributions in this paper. Firstly, we present a first-order error analysis that shows the relation between estimation uncertainties and focal length. Although authors in [11, 12] briefly described the calibration problem caused by long focal length, the error analysis with respect to focal length has not been studied so far. Secondly, we propose a robust algorithm without using additional devices, which is based on the regularization term defined by the prior of the image of the absolute conic.The remaining of this paper is organized as follows. Section2 introduces necessary notations and background of existing algorithm using estimated homographies. Section 3 gives the error propagation from image noise to camera parameters. Our calibration algorithm is proposed in Section 4. Section 5 shows the experiments on simulation and real data. The conclusion is given in Section 6.


## 2. Notation and Background

In this section, we start with the notation and then briefly introduce the calibration technique proposed in [8].The homography between the planar pattern and image plane is denoted byH
=
[
h
1
h
2
h
3
], the intrinsic matrix is given by
(1)
K
=
[
α
x
s
u
0
0
α
y
v
0
0
0
1
]
,
where (
u
0
,
v
0
) is the coordinates of the principal point, α
x
=
m
x
f and α
y
=
m
y
f are scale factors, and m
x and m
y are the number of pixels per unit distance in image along x and y directions. The image of the absolute conic is ω
=
K
-
T
K
-
1.Given an image of a planar pattern, two constraints can be imposed on the intrinsic parameters,h
1
T
ω
h
2
=
0 and h
1
T
ω
h
1
=
h
2
T
ω
h
2. Therefore, a constrained optimization can be formed by
(2)
min
⁡
ω
v
∥
A
ω
v
∥
,
s
.
t
.
∥
ω
v
∥
=
1
,
where ω
v is a 6
×
1 vector extracted from ω and A is a 2
n
×
6 matrix constructed from entries of H. The intrinsic matrix K is computed by the Cholesky factorization. Since the close form solution is obtained through minimizing algebraic errors, the maximum likelihood is further applied to refine the results by minimizing geometric errors.The calibration performance with respect to image noise level, the number of planes, and the orientation of the model plane are also evaluated in [8]. Based on the computer simulations, the errors increase linearly with the image noise level and decrease when more images are used. The best orientation of the model plane is around 45 degrees.


## 3. Covariance of the Estimated Intrinsic Parameters

In order to find out the relation between focal length and uncertainties of camera parameters, it is not sufficient to only have a point estimate of the parameters. In this section, we present a first-order approximation to compute covariance of estimated parameters.Let us consider two cameras with different focal lengthsf
1 and f
2 (assume f
1
>
f
2) and sharing a same image plane. The origin O is located at the center of projection of camera 1. Through a single point (
x
′
,
y
′
) on the sensor, camera 1 observes a 3D point X
1
=
(
X
1
,
Y
1
,
Z
1
)
T and camera 2 observes a 3D point X
2
=
(
X
2
,
Y
2
,
Z
2
)
T, while X
1 and X
2 are located on a same planar pattern. We also define a transformation M that transforms the 3D points X
1 and X
2 to a coordinate system on the planar pattern such that new depths Z
~
1 and Z
~
2 are equal to 0. Let us denote x
~
1
=
M
·
(
X
1
,
Y
1
)
T and x
~
2
=
M
·
(
X
2
,
Y
2
)
T. The configuration is shown in Figure 1.Figure 1
Two cameras with the same image plane and different focal lengths.As this configuration consists of the same image plane, same 2D observations, and same orientations and locations of the planar pattern, the major difference between two cameras is the focal lengths. For simplicity, we assume all the pixels are square, we have(3)
(
x
′
,
y
′
)
T
⟼
f
1
Z
1
(
X
1
,
Y
1
)
T
.
Since the center of projection of camera 2 is at (
f
1
-
f
2
,
0
)
T, through the same point (
x
′
,
y
′
), we have
(4)
(
X
2
,
Y
2
)
T
⟼
(
Z
2
+
f
2
-
f
1
)
f
2
(
x
′
,
y
′
)
T
.
Putting this together with (3) leads to the formula
(5)
x
~
2
=
M
·
(
X
2
,
Y
2
)
T
⟼
f
1
f
2
·
Z
2
+
f
2
-
f
1
Z
1
·
x
~
1
.Letx
=
(
x
,
y
) be the image coordinate of the point (
x
′
,
y
′
) on the sensor. Assuming that two cameras have same image resolution and the principal point, x is same for both cameras. Let us further assume that the noise is limited to the observed image with covariance Σ
x, the covariance of the intrinsic parameters Σ
k is
(6)
Σ
k
=
J
k
J
ω
v
(
J
h
T
Σ
x
-
1
J
h
)
+
J
ω
v
T
J
k
T
,
where J
k, J
ω
v, and J
h are the Jacobian matrices evaluated at k
^, ω
^
v, and h
^, respectively. k, ω
v, and h are the vectors made up of the entries of the intrinsic matrix K, the image of the absolute conic ω, and 2D homography H. As Σ
x, J
k, and J
ω
v only depend on k and ω
v and are same for both cameras, we only need to analyze the relation between J
h of two cameras. The Jacobian matrix J
h
i
=
∂
x
i
/
∂
(
h
) for ith observed point is given by
(7)
J
h
i
=
∂
x
i
∂
h
=
1
w
i
′
[
x
~
i
T
0
T
-
x
i
x
~
i
T
0
T
x
~
i
T
-
y
i
x
~
i
T
]
.
Based on (5) and (7), it is not difficult to find that
(8)
Σ
h
2
=
(
∑
i
‍
J
h
2
,
i
T
Σ
i
-
1
J
h
2
,
i
)
+
=
(
f
2
f
1
)
2
(
∑
i
‍
(
Z
2
,
i
+
f
2
-
f
1
Z
1
,
i
)
2
·
J
h
1
,
i
T
Σ
i
-
1
J
h
1
,
i
)
+
,
where h
1 and h
2 are vectors made up of the entries of homographies between the planar pattern and camera 1 and 2, Z
1
,
i and Z
2
,
i are depths of ith 3D points observed by cameras 1 and 2, respectively. Σ
i is the covariance matrix of the ith measured image point. From this equation, we can find that the covariance of 2D homography is also affected by focal length and orientation and depth of the planar pattern.Notice thatf
2
-
f
1 is usually far less than depths Z
1
,
i and Z
2
,
i; we could approximate (
Z
2
,
i
+
f
2
-
f
1
)
/
Z
1
,
i by Z
2
,
i
/
Z
1
,
i. Since image resolution and focal length are fixed for two cameras, in order to reduce the uncertainties of the estimated homography, one possible direction is to increase the pan and tilt angles of the planar pattern so that Z
2
,
i
/
Z
1
,
i is very close to 0. However, as mentioned in [8], the best orientation is around 45 degrees, which means that this ratio cannot be very small. This direction is also not feasible in practice due to the limited depth of field. When the region of the planar pattern is outside the depth of field, the sharpness of the region decreases and image noise modeled by Σ
x increases. Moreover, as the planar pattern could be considered as being uniformly distributed within the field of view of a camera, expectations of both Z
1
,
i and Z
2
,
i are close to the depth Z
0 shown in Figure 1. Therefore, for simplicity, it is reasonable to approximate Z
2
,
i
/
Z
1
,
i as 1. As a result, (8) could be simplified to Σ
h
2
=
(
f
2
/
f
1
)
2
·
Σ
h
1, and the relation between covariance matrices of intrinsic matrices of two cameras is given by
(9)
Σ
k
1
=
(
f
1
f
2
)
2
·
Σ
k
2
.
Therefore, uncertainties of intrinsic parameters k increase when focal length increases. Since extrinsic parameters for each image can be determined by intrinsic parameters and the corresponding homography, it is easy to find out that the uncertainties of extrinsic parameters also depend on focal length.One might think that it is possible to reduce the uncertainties by choosing the affine camera model. The intrinsic matrix in the affine camera model could contain less parameters (i.e., does not have a principal point), and one way to avoid over-fitting problem is to choose a simpler model. However, the scale factors still exist in the intrinsic matrix of the affine camera model. The similar derivations shown in this section can be easily extended to the affine camera model. Therefore, it can be shown that estimation uncertainties using the affine camera model also increase when focal length increases.


## 4. Calibration Using Regularized Least Squares

When a long focal length is used, the matrixA that is used to estimate ω
v (shown in (2)) is ill conditioned. As a result, large perturbations of the intrinsic parameters can have only small changes in the error sum of squares. Since it is often difficult to obtain other data points outside the scope of the sensor that has a limited physical dimension, in this section, we apply a simple and effective prior of the image of absolute conic to reduce the uncertainties.First, focal length is set as the one provided by the camera. Although this value is different from the focal length in the pin-hole camera model, they are usually in the same order. The number of pixelsm
x and m
y can be computed by using sensor size and image resolution. Skew factor is close to 0. The principal point is located around the middle of an image. This location is a close approximation according to [13], which shows that the principal point varies around the image center with some nonlinear patterns when zoom and focus factors vary. Thus, the prior knowledge of the intrinsic parameters can be denoted as (
x
1
,
x
2
,
x
3
,
x
4
,
x
5
)
T
=
(
m
x
f
,
m
y
f
,
0
,
x
¯
,
y
¯
)
T.One possible solution is to apply this prior directly for the estimation ofK. However, it could require a nonlinear optimization due to the Cholesky decomposition. In order to obtain a close form solution, we transform it to the prior of the image of absolute conic based on ω
=
K
-
T
K
-
1. Hence, the prior used in our algorithm is defined by
(10)
c
=
(
1
-
x
3
x
2
x
1
2
+
x
3
2
x
2
2
-
x
2
x
4
-
x
3
x
5
x
2
-
x
5
x
1
2
+
x
5
x
3
2
-
x
2
x
4
x
3
x
2
2
x
1
2
x
2
2
+
x
1
2
x
5
2
+
x
2
2
x
4
2
-
2
x
2
x
3
x
4
x
5
+
x
3
2
x
5
2
x
2
2
)
.Notice that we normalizec such that the first entry of c is 1. This is different from the original constraint ∥
ω
v
∥
=
1 in (2). The reason is that some entries are very close to 0 when long focal length is used and it could be numerically unstable for solving the intrinsic parameters k. For example, for a 300 mm lens and around 4000
×
3000 image resolution, some entries of ω are in the order of 1
0
-
10 and some entries during the Cholesky factorization could be in the order of 1
0
-
20 when ∥
ω
v
∥
=
1 is applied.The original homogeneous system in (2) is then converted to an inhomogeneous system by applying the prior from (10):
(11)
min
⁡
ω
v
∥
B
ω
~
v
-
b
∥
,
s
.
t
.
∥
ω
~
v
-
c
~
∥
≤
η
for an appropriate value of η, where A
=
[
b
B
] (b is the first column of A) and ω
~
v and c
~ are 2–6 elements of ω
v and c, respectively. The estimate ω
v
λ can be obtained by solving corresponding unconstrained regularized least squares problem
(12)
ω
~
v
λ
=
(
B
T
B
+
λ
I
)
-
1
(
B
T
b
+
λ
c
~
)
for some positive constant λ. The expectation of ω
~
v
λ can be computed by
(13)
E
(
ω
~
v
λ
)
=
ω
~
v
+
λ
(
B
T
B
+
λ
I
)
-
1
(
c
~
-
ω
~
v
)
.
Thus the estimator from (12) is biased after introducing the prior  c
~. The second term of this equation is the bias. As λ increases the bias increases, and expectation of ω
~
v
λ converges to c
~ eventually. In order to evaluate the covariance of ω
~
v, let us define the function:
(14)
Φ
(
h
,
ω
v
)
=
(
B
T
B
+
λ
I
)
ω
~
v
-
B
T
b
-
λ
c
~
=
0
.
Based on the implicit function theorem in [14, 15], the Jacobian J
ω
~
v can be approximated by
(15)
J
ω
~
v
=
-
(
∂
Φ
∂
ω
~
v
)
-
1
∂
Φ
∂
h
,
where (
∂
Φ
/
∂
ω
~
v
)
-
1 and ∂
Φ
/
∂
h can be computed by
(16)
(
∂
Φ
∂
ω
~
v
)
-
1
≈
(
B
T
B
+
λ
I
)
-
1
,
∂
Φ
∂
h
=
C
D
,
C
=
(
ω
~
v
ω
~
v
⋱
)
,
D
=
(
∂
b
1
∂
h
∂
b
2
∂
h
⋮
)
,
where b
i is 5
×
1 vector of the ith row of (
B
T
B
+
λ
I
)
ω
~
v
-
B
T
b. The covariance of ω
~
v is given by
(17)
Σ
ω
v
=
(
B
T
B
+
λ
I
)
-
1
C
D
Σ
h
D
T
C
T
(
B
T
B
+
λ
I
)
-
1
.
Since C and D are independent from λ and only (
B
T
B
+
λ
I
)
-
1 depends on the λ, we can see that the covariance Σ
ω
v decreases as λ increases. The larger the λ, the closer the ω
~
v is to c
~. If we consider the mean squares error,
(18)
MSE
=
Bia
s
2
+
Variance
it is possible to select an optimal value of λ
>
0 at which the mean squared error from testing set is minimized. In practice, we could divide 2D points on a planar pattern into training and testing sets and apply the cross-validation to choose the optimal λ.


## 5. Experiments

We tested our proposed algorithm on simulated data and real data over a large range of settings of focal lengths and image noise.


### 5.1. Simulations

In our simulations, image resolution is set to2048
×
1536. Sensor size is 23.6
×
15.8mm and focal lengths are 50 mm, 100 mm, 200 mm, 300 mm, 400 mm, and 500 mm. Skew factor s is set to 0.009. The principal points (
u
0
,
v
0
) are set to the image center. Table 1 gives focal lengths and corresponding scale factors used in the experiments. Gaussian noise with μ
=
0 and σ
=
(
1,3
) are added to the 2D observations. Since depth of field is limited when a long focal length is used, the observed points could be easily blurred when pan and tilt angles are large. Thus, we use a large standard deviation (σ
=
3) of image noise to further test the robustness of our algorithm. The planar pattern is generated randomly with different pan/tilt angles and at different depths from the camera. Angles are uniformly distributed between -
60 and +
60 degrees. Foreshortening effects are not considered in the simulations. Depths are also uniformly distributed within 6 meters. As the calibration technique in [8] is widely used in the area of computer vision, we implemented this algorithm as a baseline in order to compare calibration performance between existing algorithms and our algorithm. In our simulations, we add 5% offsets to the priors of both the focal length and the principal point. We conducted 20 trials for each configuration.Table 1
Scale factors of the camera used in simulations.
f  (mm)
50
100
200
300
400
500
α
x
4339
8678
17356
26034
34172
43390
α
y
4861
9722
19443
29163
38886
48608Figure2 shows a comparison of uncertainties between the close-form solutions and the solutions from MLE when f
=
300mm is used. Figure 2(c) shows that RMS reprojection errors are reduced by minimizing the geometric errors. However, as the cost function is not a convex function and initial guess from the close-form solution could be far away from the global minimum, the uncertainties of intrinsic parameters cannot be reduced by the nonlinear refinement as shown in Figures 2(a) and 2(b). The results are similar to other settings in Table 1. This experiment shows that the MLE can reduce RMS errors for training data points. However, it cannot reduce the uncertainties of camera parameters.Comparison of uncertainties between the close form solution and the MLE solution [8] (f
=
300 mm, α
x
=
26034, and α
y
=
29163). The image noise is μ
=
0 with σ
=
1. The mean relative errors of α
x are 4.74% and 4.72%, the mean absolute errors of u
0 are 1717 and 1689 pixels, and the RMS reprojection errors are 19.5 and 3.2 pixels, for the close form and the MLE solutions, respectively.
(a)
(b)
(c)Figures3 and 4 show the relation between focal lengths and the uncertainties of intrinsic parameters. It shows that uncertainties increase with the increase of focal length. The absolute errors of the principal point could be very large. It indicates that the estimated principal point could be very far away from the image plane for long focal lengths. Figures 3(c), 3(d), 4(c), and 4(d) show the results by using our algorithm. the uncertainties of both the focal length and the principal point are reduced to few percents. The estimated values by using our algorithm converge to the bias (i.e., 5%), which is consistent with (13). This further means that our algorithm should be mainly used for the camera with a long focal length (e.g., f
≥
200 mm as shown in Figures 3 and 4). When focal length is short, we need to choose either algorithm [8] or a very small λ.Comparison of uncertainties ofα
x between our algorithm and [8].
(a)
(b)
(c)
(d)Comparison of uncertainties ofu
0 between our algorithm and [8].
(a)
(b)
(c)
(d)


### 5.2. Real Data

We also test our algorithm for the real data. The camera to be calibrated is a Canon EOS 450D. The sensor size is22.2
×
14.8 mm. Image resolution used in the experiments is 2256
×
1504. We use a 300 mm telephoto lens in the experiments. The prior of the skew factor is set to 0. The prior of the principal point is set to the image center. The α
x and α
y are computed based on the sensor size, image resolution, and focal length. Table 2 shows the priors for the intrinsic parameters.Table 2
Priors of the intrinsic parameters.
f
Sensor size
α
x
α
y
s
u
0
v
0
300 mm
22.2
×
14.8 mm
30486
30486
0
1128
75218 images of a planar pattern with different orientations and at different depths are captured within 6 meters. 9 images of them are randomly selected every time for calibration and the same calibration procedure is repeated 20 times. Figure5 show the calibration results using Zhang’s algorithm. We can see that the uncertainties of the intrinsic parameters are very large when a 300 mm telephoto lens is used. The estimated principal point could be far away from the image plane, which in practice is not reasonable.Uncertainties ofα
x, α
y, u
0, and v
0 using Zhang’s algorithm [8].
(a)
(b)Figure6 shows our calibration results with different λ. Similar to the results of simulations, the uncertainties are reduced greatly and estimated intrinsic parameters converge to the priors when λ increases.Uncertainties ofα
x, α
y, u
0, and v
0 using our algorithm.
(a)
(b)
(c)
(d)


## 5.1. Simulations

In our simulations, image resolution is set to2048
×
1536. Sensor size is 23.6
×
15.8mm and focal lengths are 50 mm, 100 mm, 200 mm, 300 mm, 400 mm, and 500 mm. Skew factor s is set to 0.009. The principal points (
u
0
,
v
0
) are set to the image center. Table 1 gives focal lengths and corresponding scale factors used in the experiments. Gaussian noise with μ
=
0 and σ
=
(
1,3
) are added to the 2D observations. Since depth of field is limited when a long focal length is used, the observed points could be easily blurred when pan and tilt angles are large. Thus, we use a large standard deviation (σ
=
3) of image noise to further test the robustness of our algorithm. The planar pattern is generated randomly with different pan/tilt angles and at different depths from the camera. Angles are uniformly distributed between -
60 and +
60 degrees. Foreshortening effects are not considered in the simulations. Depths are also uniformly distributed within 6 meters. As the calibration technique in [8] is widely used in the area of computer vision, we implemented this algorithm as a baseline in order to compare calibration performance between existing algorithms and our algorithm. In our simulations, we add 5% offsets to the priors of both the focal length and the principal point. We conducted 20 trials for each configuration.Table 1
Scale factors of the camera used in simulations.
f  (mm)
50
100
200
300
400
500
α
x
4339
8678
17356
26034
34172
43390
α
y
4861
9722
19443
29163
38886
48608Figure2 shows a comparison of uncertainties between the close-form solutions and the solutions from MLE when f
=
300mm is used. Figure 2(c) shows that RMS reprojection errors are reduced by minimizing the geometric errors. However, as the cost function is not a convex function and initial guess from the close-form solution could be far away from the global minimum, the uncertainties of intrinsic parameters cannot be reduced by the nonlinear refinement as shown in Figures 2(a) and 2(b). The results are similar to other settings in Table 1. This experiment shows that the MLE can reduce RMS errors for training data points. However, it cannot reduce the uncertainties of camera parameters.Comparison of uncertainties between the close form solution and the MLE solution [8] (f
=
300 mm, α
x
=
26034, and α
y
=
29163). The image noise is μ
=
0 with σ
=
1. The mean relative errors of α
x are 4.74% and 4.72%, the mean absolute errors of u
0 are 1717 and 1689 pixels, and the RMS reprojection errors are 19.5 and 3.2 pixels, for the close form and the MLE solutions, respectively.
(a)
(b)
(c)Figures3 and 4 show the relation between focal lengths and the uncertainties of intrinsic parameters. It shows that uncertainties increase with the increase of focal length. The absolute errors of the principal point could be very large. It indicates that the estimated principal point could be very far away from the image plane for long focal lengths. Figures 3(c), 3(d), 4(c), and 4(d) show the results by using our algorithm. the uncertainties of both the focal length and the principal point are reduced to few percents. The estimated values by using our algorithm converge to the bias (i.e., 5%), which is consistent with (13). This further means that our algorithm should be mainly used for the camera with a long focal length (e.g., f
≥
200 mm as shown in Figures 3 and 4). When focal length is short, we need to choose either algorithm [8] or a very small λ.Comparison of uncertainties ofα
x between our algorithm and [8].
(a)
(b)
(c)
(d)Comparison of uncertainties ofu
0 between our algorithm and [8].
(a)
(b)
(c)
(d)


## 5.2. Real Data

We also test our algorithm for the real data. The camera to be calibrated is a Canon EOS 450D. The sensor size is22.2
×
14.8 mm. Image resolution used in the experiments is 2256
×
1504. We use a 300 mm telephoto lens in the experiments. The prior of the skew factor is set to 0. The prior of the principal point is set to the image center. The α
x and α
y are computed based on the sensor size, image resolution, and focal length. Table 2 shows the priors for the intrinsic parameters.Table 2
Priors of the intrinsic parameters.
f
Sensor size
α
x
α
y
s
u
0
v
0
300 mm
22.2
×
14.8 mm
30486
30486
0
1128
75218 images of a planar pattern with different orientations and at different depths are captured within 6 meters. 9 images of them are randomly selected every time for calibration and the same calibration procedure is repeated 20 times. Figure5 show the calibration results using Zhang’s algorithm. We can see that the uncertainties of the intrinsic parameters are very large when a 300 mm telephoto lens is used. The estimated principal point could be far away from the image plane, which in practice is not reasonable.Uncertainties ofα
x, α
y, u
0, and v
0 using Zhang’s algorithm [8].
(a)
(b)Figure6 shows our calibration results with different λ. Similar to the results of simulations, the uncertainties are reduced greatly and estimated intrinsic parameters converge to the priors when λ increases.Uncertainties ofα
x, α
y, u
0, and v
0 using our algorithm.
(a)
(b)
(c)
(d)


## 6. Conclusion

As a camera with a telephoto lens could be used in various vision based systems, it is necessary to calibrate the camera accurately. Many existing algorithms that are designed for cameras with relatively short focal lengths could cause large uncertainties of estimated parameters even that the RMS reprojection errors of training data are small after a nonlinear optimization. In this paper, we first give a detailed error analysis that shows the relation between uncertainties and focal length. Then we propose a robust calibration algorithm based on the regularized least squares to reduce the uncertainties. Looking into future, we will apply our approach to the camera network that contains the camera with a telephoto lens in the area of remote surveillance and scene reconstruction.



---

*Source: 689429-2014-02-11.xml*