# Compressive Imaging of Moving Object Based on Linear Array Sensor

Authors: Changjun Zha; Yao Li; Jinyao Gui; Huimin Duan; Tailong Xu
Journal: Journal of Electrical and Computer Engineering
 (2016)

---

## Abstract

Using the characteristics of a moving object, this paper presents a compressive imaging method for moving objects based on a linear array sensor. The method uses a higher sampling frequency and a traditional algorithm to recover the image through a column-by-column process. During the compressive sampling stage, the output values of the linear array sensor are multiplied by a coefficient that is a measurement matrix element, and then the measurement value can be acquired by adding all the multiplication values together. During the reconstruction stage, the orthogonal matching pursuit algorithm is used to recover the original image when all the measurement values are obtained. Numerical simulations and experimental results show that the proposed compressive imaging method not only effectively captures the information required from the moving object for image reconstruction but also achieves direct separation of the moving object from a static scene.


---

## Body

## 1. Introduction

In practical situations, objects that are observed moving across borders or uninhabited regions could be either human or animal, and there are considerable differences between their profiles [1, 2]. Large numbers of research results have indicated that it is feasible to determine which objects are human and which are animal based on these differences, but the current research is generally concerned with the acquisition and recognition of the object profile image [3–8]. For image acquisition, the most common method is the use of a linear array sensor to acquire the moving object image [9–11], but the acquired image is relatively simple and cannot show the object in greater detail, meaning that it is difficult to distinguish between similar actions on different objects. Therefore, how to obtain higher-resolution images when using only a small number of sensors has become a question that is worthy of exploration.As one of the most important research fields in compressive sensing, compressive imaging can capture a small number of measurements to be used for image reconstruction, and the most typical compressive imaging is the single-pixel camera [12–14]. To acquire compressive measurements, the camera uses a single pixel and a spatial light modulator. However, before the single-pixel camera can capture all required measurements, the scene must be in a static state or state of only slight change [15]; otherwise, the original image cannot be reconstructed. In addition, at borders or in uninhabited regions, we only care about the moving object in the monitored region and do not require a static scene. However, the reconstructed image using the single-pixel camera contains both the object and the scene, and elimination of the static scene and realization of moving object compressive sampling are subjects that require further study. To solve this problem using a combination of a linear array sensor and the theory of compressive sensing, this paper proposes a compressive imaging method for moving objects based on compressive sensing. Theoretical analyses and experimental results demonstrate the effectiveness of the proposed method.This paper is organized as follows. Section2 introduces the principle of compressive sensing. Section 3 describes our proposed compressive imaging scheme in detail, and experimental results are provided in Section 4. Section 5 contains a summary of this paper and gives our conclusions.


## 2. Theory of Compressive Sensing

Consider a one-dimensional sparse signalx
∈
R
N, which can be represented as a linear combination of the columns of Ψ
∈
R
N
×
N:(1)
x
=
Ψ
θ
.If only k
k
≪
N values are nonzero in the vector θ
∈
R
N, then θ is the sparse representation of x in the domain Ψ. For the sparse signal reconstruction problem, θ can be estimated by minimizing the l
1-norm with the measurement matrix Φ
∈
R
M
×
N
(
M
≪
N
) and the measurements y
=
Φ
x
∈
R
M:(2)
θ
^
=
a
r
g
min
⁡
θ
1
,
s.t.
y
=
Φ
Ψ
θ
.Finally, the original signalx can be reconstructed using the coefficient vector θ
^, which satisfies l
1-minimization [16, 17]; that is,(3)
x
=
Ψ
θ
^
.In practice, when taking the effects of noise into account, (3) can be rewritten as (4)
θ
^
=
a
r
g
min
⁡
θ
1
,
s.t.
y
-
Φ
Ψ
θ
2
≤
ε
,where ε is the error tolerance [18–20].For static objects, each projection measurement contains the same original information [15], but this does not apply for a moving object. We present a novel compressive imaging method to achieve compressive sampling of moving objects in the next section.


## 3. Compressive Imaging System for Moving Object

Figure1 shows the proposed compressive imaging system for moving objects based on a linear array sensor. Unlike single-pixel cameras, the system captures the moving object image measurements through a column-by-column process. The measurement is based on the inner product of the row vector ϕ
m
=
ϕ
m
1
ϕ
m
2
⋯
ϕ
m
N
∈
R
N
1
≤
m
≤
M of the measurement matrix Φ and the output values of the linear array sensor.Figure 1
Compressive imaging system based on linear array sensor.Assume here that the image of the moving object is expressed asΧ
=
x
1
,
x
2
,
…
,
x
N
∈
R
N
×
N. We use the measurement matrix Φ
∈
R
M
×
N
(
M
≪
N
) to capture compressive measurements of the ith column vector x
i
=
x
1
i
⋯
x
N
i
T
∈
R
N of the image Χ. Based on the theory of compressive sensing, these measurements can be expressed as y
i
=
Φ
x
i; that is,(5)
y
i
=
y
1
i
⋮
y
M
i
=
Φ
x
i
=
ϕ
11
⋯
ϕ
1
N
⋮
⋱
⋮
ϕ
M
1
⋯
ϕ
M
N
x
1
i
⋮
x
N
i
=
ϕ
1
x
i
⋮
ϕ
M
x
i
=
ϕ
1
⋮
ϕ
M
x
i
,where y
i
∈
R
M
(
M
≪
N
) and ϕ
m
=
ϕ
m
1
ϕ
m
2
⋯
ϕ
m
N
∈
R
N
(
1
≤
m
≤
M
). During the compressive sampling stage, each row of the measurement matrix obtains a single measurement. When this measurement is obtained, the next row of the measurement matrix is used as the output coefficient of the sensor group. In this way, M measurements of the ith column vector of the image are obtained.Because the object is in a state of motion, each of the rowsϕ
m
(
1
≤
m
≤
M
) of the measurement matrix samples different columns of the target image, as shown in Figure 2. Therefore, (5) should be rewritten as(6)
y
i
=
y
1
i
⋮
y
M
i
=
ϕ
1
x
i
1
⋮
ϕ
M
x
i
M
.Figure 2
Compressive sampling of static and moving states.
(a)
Original imageX
(b)
Measurement matrixΦ
(c)
Compressive sampling for static object
(d)
Compressive sampling for moving objectIn general, the vectorsx
i
1
,
x
i
2
,
…
,
x
i
M
(
1
≤
m
≤
M
) are not equal, which means that the original image cannot be reconstructed from measurements that do not contain the same information.In a real situation, when a person or an animal passes through the sensors’ field of view, the velocity is always limited. Therefore, we could captureM effective measurements y
i
=
y
1
i
⋯
y
M
i
T of the ith column vector x
i
=
x
1
i
⋯
x
N
i
T by using a higher sampling frequency. If we assume that the object’s average velocity is v and the sensors’ sampling frequency is f, then within a short time Δ
t, the number of measurements M can be expressed as(7)
M
=
f
·
Δ
t
.From (7), we see that when M is fixed, Δ
t becomes smaller and smaller as the sensors’ sampling frequency f increases, and the differences among the M columns x
i
1
,
x
i
2
,
…
,
x
i
M in the range of Δ
t also become smaller, as shown in Figure 3. Assuming that the vector acquired in Δ
t corresponds to the ith column vector x
i of the original image, then the column vectors x
i
1
,
x
i
2
,
…
,
x
i
M that were captured using the higher sampling frequency can be represented as(8)
x
i
1
=
x
i
+
ε
1
,
x
i
2
=
x
i
+
ε
2
,
⋮
x
i
M
=
x
i
+
ε
M
,where ε
1
,
ε
2
,
…
,
ε
M are the error vectors. By combining (6) with (8), we obtain(9)
y
i
=
y
1
i
⋮
y
M
i
=
ϕ
1
x
i
1
⋮
ϕ
M
x
i
M
=
ϕ
1
x
i
+
ε
1
⋮
ϕ
M
x
i
+
ε
M
=
ϕ
1
x
i
⋮
ϕ
M
x
i
+
ϕ
1
ε
1
⋮
ϕ
M
ε
M
=
Φ
x
i
+
ε
,where(10)
ε
=
ϕ
1
ε
1
⋮
ϕ
M
ε
M
.Figure 3
Effect of sampling frequency on the diversity of the samples.At this point, theith column vector x
i of the original image can be reconstructed using (4), which indicates that the entire image of the moving object can be obtained by merging all of the reconstructed columns.For a static scene, the sensors acquire compressive measurements from the same column of the scene image. Thus, all of the columns of the reconstructed image are the same, and the reconstructed scene image is no longer the static scene that we can see.To facilitate a clearer description, we assume that no moving objects are passing through the sensor’s field of view. The reconstructed column is then expressed asx
r
=
x
1
r
x
2
r
⋯
x
N
r
T
∈
R
N, and the reconstructed image can be represented as(11)
Χ
^
=
x
r
x
r
⋯
x
r
=
x
1
r
x
1
r
⋯
x
1
r
x
2
r
x
2
r
⋯
x
2
r
⋮
⋮
⋮
⋮
x
N
r
x
N
r
⋯
x
N
r
,where Χ
^
∈
R
N
×
N. From (11), we can see that the reconstructed scene is a texture image. In other words, the static scene can be eliminated using the proposed compressive imaging method.


## 4. Simulation Experiment and Analysis

To verify the validity of the proposed method, a single column pixel of an industrial camera is used to capture the data from a moving object. The number of single column pixels is 120 and the camera’s frame rate is 150 fps. Some frames of the real video and a portion of the collected data under different motions and different backgrounds are shown in Figure4.Figure 4
Real video and images.
(a)
Some frames in real video
(b)
Part of the data collected by a column of pixels in a cameraAssuming that the sparsity level of each column in the original image isK
=
30, then the numbers of measurements M are 70, 80, 90, and 100, which represent the total numbers of 58.3%, 66.7%, 75%, and 83.3%, respectively; we then adopt the orthogonal matching pursuit algorithm to reconstruct the original image and obtain the results shown in Figure 5.Figure 5
Reconstruction of images.
(a)
M
=
70
(b)
M
=
80
(c)
M
=
90
(d)
M
=
100As shown in Figure5, the proposed compressive imaging system can reconstruct the image of a moving object. Different from Figure 4(a), the reconstructed image contains only the moving object. It is clear that the reconstruction quality improves as the number of measurements increases.


## 5. Conclusions

When a traditional single-pixel camera captures compressive measurements, the scene is required to remain in a state of rest. This paper proposed a compressive imaging method for a moving object, where the method generally adopts a higher sampling frequency to capture the measurements of the moving object through a column-by-column process. The results of simulations and real data experiments show that our method can reconstruct the image of a moving object and can separate the moving object from a static scene. Therefore, the proposed method is of practical significance for application to the monitoring of borders or uninhabited regions.



---

*Source: 4560642-2016-07-14.xml*