# An Image Restoration Method Using Matrix Transform and Gaussian Mixture Model for Radio Tomographic Imaging

Authors: Fei Gao; Cheng Sun; Heng Liu; Jianping An; Shengxin Xu
Journal: Wireless Communications and Mobile Computing
 (2017)

---

## Abstract

Radio Tomographic Imaging (RTI) is an attractive technique for imaging the nonmetallic targets within wireless sensor network. RTI has been used in many challenging environments and situations. Due to the accuracy of Radio Tomographic Imaging system model and the interference between the wireless signals of sensors, the image obtained from the RTI system is a degraded target image, which cannot offer sufficient details to distinguish different targets. In this paper, we treat the RTI system as an image degraded process, and we propose an estimation model based on mixture Gaussian distribution to derive the degradation function from the shadowing-based RTI model. Then we use this degradation function to recover an original image by a method called constrained least squares filtering. So far, many imaging models have been proposed for localization; however, they do not have a satisfied imaging accuracy. Simulated and experimental results show that the imaging accuracy of our proposed method is improved, and the proposed method can be used in the real-time circumstances.


---

## Body

## 1. Introduction

Radio Tomographic Imaging (RTI) is an emerging technology for imaging the attenuation of nonmetallic targets within wireless sensor network area. The presence of targets between the transmitters and receivers leads to changes in the received signal strength (RSS) measurements at the receivers. RTI uses these changes to reconstruct an image of the propagation field. The images can provide the location of targets and their movements [1]. Therefore, RTI has been gaining great interest from a variety of applications, for example, road surveillance [2], health care [3], through-wall tracking [4], and floor plan mapping [5, 6].Shadowing-based RTI (SRTI) was proposed by Wilson and Patwari [7] which was the original imaging approach by using RSS variation obtained from a wireless network. SRTI assumed that the obstructed wireless links suffer from large shadowing loss, and the RSS of the links which were not obstructed by the targets keep stable. The assumption is valid for an open environment, so SRTI is not suitable for the indoor environments where RSS varies easily due to the multipath effect. Wilson and Patwari proposed Variance-Based RTI (VRTI) which introduced the variance of RSS to improve the tracking performance in indoor environments [4]. A fade level-based spatial model for RTI was proposed, which divided the links into two different types: deep fade links and antifade links [8]. Zhao et al. [9] have proposed kernel distance-based RTI (KRTI) which used the kernel distance between short-term and long-term RSS histograms to estimate the image of human presence. Wei et al. [10] have proposed directional RTI (dRTI) which employed electronically switched directional (ESD) antennas to mitigate the multipath effect. However, using directional antennas will increase the sensor size and the cost of radio sensors. Wang et al. [11] proposed enhanced SRTI (ESRTI) which employed the interference link canceling technique to enhance indoor RTI image quality and tracking accuracy.In this paper, we address the target imaging issue in RTI; that is, we focus on getting the “original” undistorted target image rather than improving the locating or tracking performance of targets [12]. Previous researches have paid full attention to locating and tracking targets [13, 14], and these RTI methods have resulted in a dilative imaging area of the targets. The imaging result does not offer sufficient details to recognize the desired targets. The dilation effect is caused by the limited wireless communication links. When the links increase, the more wireless sensor nodes and the longer time of scanning all communication links will be needed. Meanwhile, the interference between the sensor nodes is enhanced which leads to a worse imaging result. Therefore, we propose the image restoration technique to solve the poor imaging problem in RTI. Image restoration is a technology that attempts to recover an “original” image from the “degraded” image by using a priori knowledge of the degradation process [15]. After a priori knowledge of the degradation process is obtained or estimated, the “original” image can be recovered by applying the inverse process. Therefore, we propose a novel technique for getting the undistorted images of targets. Our approach involves applying matrix theory and Gaussian mixture model to estimate the degradation function of RTI system, which describes the degradation phenomenon in RTI system and is outlined in Section 3. Further, we take the simulated objects and active human as the standard targets to analyze the performance of our proposed approach.Our proposed method operates as illustrated in Figure1. In short, the system is divided into two phases. In the offline phase, we calculate the weight matrix W of the wireless network; then we use Gaussian mixture model to estimate the elements of the degradation function hx,y. In the online phase, we first acquire RSS measurement changes r from S radio frequency sensors of the wireless network. The RSS changes and weight matrix are inputted to theSRTI calculating unit to form a discretized propagation image x^ of the monitored area. Then 2-dimensional image gx,y is obtained after the procedure namedvector into matrix. Finally, an image restoration algorithm is used to estimate the original image, and f^x,y is the final output image.Figure 1
System overview of the proposed method.The rest of this paper is organized as follows. In Section2, we introduce some preliminaries about RTI system and image restoration process. Section 3 presents the method of estimating the degradation function of RTI system. Section 4 presents the simulated and experimental results of the proposed image restoration method in RTI system. Section 5 discusses the conclusions.


## 2. Radio Tomographic Imaging and Image Restoration

In this section, we introduce the RTI model which relates radio power attenuation in spatial voxels to the difference of RSS measured on the links of a wireless network. And a model of image degradation/restoration process is also introduced.


### 2.1. Radio Tomographic Imaging

When a wireless sensor network communicates through transmission of wireless signal, the RSS measurements on the receiving node of a link are affected by the targets between the sensors. Figure2 illustrates a simple wireless network and the reconstructed image by using RSS measurements. When there are S radio frequency sensors at the perimeter of the monitored region, the total number of unidirectional links is L=SS-1/2. The variation of RSS in dBm on link l can be written as(1)Δrl,t=rl,0-rl,t,l=1,2,…,L,where rl,0 is the static RSS of link l when there is no target in the monitored region and rl,t is the RSS of link l at time instant t when the targets appear in the monitored region.Figure 2
An illustration of RTI network. (a) shows a target in the propagation field of RF sensors. (b) shows the RTI reconstructed image of scene.
(a)
(b)Assume that the change in RSS is a spatial integral of the attenuation field in the monitored region. When the attenuation field is divided into voxels, the change in RSS of each link can be treated as a linear combination of the change caused by each voxel [16]:(2)Δrl,t=∑j=1NWljΔxj,t+nl,t,where Δxj,t is the RSS attenuation occuring in voxel j at the time instant t, N is the number of voxels in the image, nl,t is the measurement noise of link l at time instant t, and Wlj is the weight of voxel j for link l. We use the normalized ellipse model to obtain Wlj [17]:(3)Wlj=1dl1ifdlj1+dlj2<dl+λ0otherwise,where dl is the distance between two sensors (the transmitter and the receiver) and dlj1 and dlj2 are the distances between voxel j and the two sensors of link l, respectively. λ is the parameter describing the width of the ellipse. If all links in the network are considered, (2) can be rewritten as(4)r=Wx+n,where r and n represent the RSS changes and noises of L wireless links, respectively, and they are column vectors of size L×1. x is an N×1 column vector representing the attenuation image. Wlj=Wlj is an L×N matrix representing the weight matrix. This equation describes the relationship between the image of target presence and the RSS changes of wireless sensor network, which is called shadowing-based RTI.Estimating the imagex from the links measurements r is an ill-posed inverse problem, so regularization is required [18]. We use the Tikhonov regularization method to handle this ill-posedness. We can define the linear transformation matrix Π:(5)Π=WTW+αDXTDX+DYTDY-1WT,where α is the regularization parameter and matrix DX and matrix DY are the difference operator for the horizontal and vertical direction, respectively. Then the solution of (4) is given by(6)x^=Πr.In view of the accuracy of measurement and calculation, the reconstructed image has a peripheral dilation effect within the target area (as shown in Figure2), and it could not show the small edge information of the target. Therefore the dilation effect should be eliminated by using the image restoration method.


### 2.2. Image Restoration

In image restoration, we consider the degradation and restoration process as a linear model, as shown in Figure3. The degradation function and an additive noise term are operated on an input image to produce a degraded image [19]. Now we assume H is a linear, position-invariant blurring process; then the degraded image can be given as(7)gx,y=hx,y∗fx,y+ηx,y,where hx,y is the degradation function in spatial domain and the symbol “∗” indicates a convolution operator.Figure 3
A model of the image degradation/restoration process.As is known, convolution in the spatial domain is analogous to multiplication in the frequency domain, so we can express (7) in the frequency domain:(8)Gu,v=Hu,vFu,v+Nu,v,where the terms in capital letters are the Fourier transforms of the corresponding terms in (7).Since the problem of estimating the input imagefx,y is typically ill-posed [20], in order to get the original input image fx,y, we introduce the method called constrained least squares that minimizes the criterion to smooth the image. The objective function is defined as(9)Cγf,h=∑x,ygx,y-hx,y∗fx,y2+γlx,y∗fx,y2;the second term lx,y∗fx,y is a regularization function embodying the prior information about fx,y [21]. We consider the optimality of restoration as a measure of smoothness, and we expect a high level of local correlation in the image. Therefore we choose a high pass filter (Laplacian filter) to minimize the high-frequency content in the solution. γ is a tunable parameter.The frequency domain solution to this optimization problem is the following expression [15]:(10)F^u,v=H∗u,vHu,v2+γLu,v2Gu,v,where Lu,v is the Fourier transform of lx,y and H∗u,v is the complex conjugate of Hu,v. Then we can obtain the estimated original image by applying inverse Fourier transform on (10):(11)f^x,y=IDFTF^u,v.


## 2.1. Radio Tomographic Imaging

When a wireless sensor network communicates through transmission of wireless signal, the RSS measurements on the receiving node of a link are affected by the targets between the sensors. Figure2 illustrates a simple wireless network and the reconstructed image by using RSS measurements. When there are S radio frequency sensors at the perimeter of the monitored region, the total number of unidirectional links is L=SS-1/2. The variation of RSS in dBm on link l can be written as(1)Δrl,t=rl,0-rl,t,l=1,2,…,L,where rl,0 is the static RSS of link l when there is no target in the monitored region and rl,t is the RSS of link l at time instant t when the targets appear in the monitored region.Figure 2
An illustration of RTI network. (a) shows a target in the propagation field of RF sensors. (b) shows the RTI reconstructed image of scene.
(a)
(b)Assume that the change in RSS is a spatial integral of the attenuation field in the monitored region. When the attenuation field is divided into voxels, the change in RSS of each link can be treated as a linear combination of the change caused by each voxel [16]:(2)Δrl,t=∑j=1NWljΔxj,t+nl,t,where Δxj,t is the RSS attenuation occuring in voxel j at the time instant t, N is the number of voxels in the image, nl,t is the measurement noise of link l at time instant t, and Wlj is the weight of voxel j for link l. We use the normalized ellipse model to obtain Wlj [17]:(3)Wlj=1dl1ifdlj1+dlj2<dl+λ0otherwise,where dl is the distance between two sensors (the transmitter and the receiver) and dlj1 and dlj2 are the distances between voxel j and the two sensors of link l, respectively. λ is the parameter describing the width of the ellipse. If all links in the network are considered, (2) can be rewritten as(4)r=Wx+n,where r and n represent the RSS changes and noises of L wireless links, respectively, and they are column vectors of size L×1. x is an N×1 column vector representing the attenuation image. Wlj=Wlj is an L×N matrix representing the weight matrix. This equation describes the relationship between the image of target presence and the RSS changes of wireless sensor network, which is called shadowing-based RTI.Estimating the imagex from the links measurements r is an ill-posed inverse problem, so regularization is required [18]. We use the Tikhonov regularization method to handle this ill-posedness. We can define the linear transformation matrix Π:(5)Π=WTW+αDXTDX+DYTDY-1WT,where α is the regularization parameter and matrix DX and matrix DY are the difference operator for the horizontal and vertical direction, respectively. Then the solution of (4) is given by(6)x^=Πr.In view of the accuracy of measurement and calculation, the reconstructed image has a peripheral dilation effect within the target area (as shown in Figure2), and it could not show the small edge information of the target. Therefore the dilation effect should be eliminated by using the image restoration method.


## 2.2. Image Restoration

In image restoration, we consider the degradation and restoration process as a linear model, as shown in Figure3. The degradation function and an additive noise term are operated on an input image to produce a degraded image [19]. Now we assume H is a linear, position-invariant blurring process; then the degraded image can be given as(7)gx,y=hx,y∗fx,y+ηx,y,where hx,y is the degradation function in spatial domain and the symbol “∗” indicates a convolution operator.Figure 3
A model of the image degradation/restoration process.As is known, convolution in the spatial domain is analogous to multiplication in the frequency domain, so we can express (7) in the frequency domain:(8)Gu,v=Hu,vFu,v+Nu,v,where the terms in capital letters are the Fourier transforms of the corresponding terms in (7).Since the problem of estimating the input imagefx,y is typically ill-posed [20], in order to get the original input image fx,y, we introduce the method called constrained least squares that minimizes the criterion to smooth the image. The objective function is defined as(9)Cγf,h=∑x,ygx,y-hx,y∗fx,y2+γlx,y∗fx,y2;the second term lx,y∗fx,y is a regularization function embodying the prior information about fx,y [21]. We consider the optimality of restoration as a measure of smoothness, and we expect a high level of local correlation in the image. Therefore we choose a high pass filter (Laplacian filter) to minimize the high-frequency content in the solution. γ is a tunable parameter.The frequency domain solution to this optimization problem is the following expression [15]:(10)F^u,v=H∗u,vHu,v2+γLu,v2Gu,v,where Lu,v is the Fourier transform of lx,y and H∗u,v is the complex conjugate of Hu,v. Then we can obtain the estimated original image by applying inverse Fourier transform on (10):(11)f^x,y=IDFTF^u,v.


## 3. Estimating the Degradation Function of RTI System

From the previous discussion, the degraded imagegx,y of SRTI system can be obtained from (6), but the degradation function is unknown. In this section, we study the relationship between degradation function and linear solution of SRTI system. Then we propose a Gaussian mixture model to estimate the degradation function of SRTI system.


### 3.1. Relationship between Degradation Function and Linear Solution

By using the definition of convolution, we can express the image degradation process (7) in vector-matrix form [15, 22]:(12)g=Hf+η,where f is an XY×1 vector representing an input image fx,y, and we can form the vector by using each column of image fx,y. X and Y are the width and height of the image, respectively. Then vectors g and η are formed in the same way. As a result, H is an XY×XY matrix, and its elements are given by the definition of circular convolution in two dimensions:(13)fx,y∗hx,y=∑m=0X-1∑n=0Y-1fm,nhx-m,y-n.Suppose the degradation functionhx,y has dimensions 2K+1×2K+1, and its elements are shown in the following matrix:(14)h-K,-Kh-K,-K+1⋯h-K,0⋯h-K,Kh-K+1,-Kh-K+1,-K+1⋯h-K+1,0⋯h-K+1,K⋮⋮⋱⋮⋱⋮h0,-Kh0,-K+1⋯h0,0⋯h0,K⋮⋮⋱⋮⋱⋮hK,-KhK,-K+1⋯hK,0⋯hK,K.Then we plug (14) into (13) resulting in(15)H=H0H-1⋯H-K0⋯00H1H0⋯H-K+1H-K⋯00⋮⋮⋱⋮⋱⋮⋮HKHK-1⋯H0H-1⋯000HK⋯H1H0⋯00⋮⋮⋱⋮⋱⋮⋮00⋯00⋯H0H-100⋯00⋯H1H0,where Hi is a block matrix, and it is constructed by the elements of degradation function:(16)Hi=h0,ih-1,i⋯h-K,i0⋯00h1,ih0,i⋯h-K+1,ih-K,i⋯00⋮⋮⋱⋮⋮⋱⋮⋮hK,ihK-1,i⋯h0,ih-1,i⋯000hK,i⋯h1,ih0,i⋯00⋮⋮⋱⋮⋮⋱⋮⋮00⋯00⋯h0,ih-1,i00⋯00⋯h1,ih0,i.As discussed before, the Tikhonov solution of SRTI system is expressed in (6); then we plug (4) into (6) which results in(17)x^=Πr=ΠWx+nt.Comparing two equations (12) and (17), we find that the left sides of two equations describe the same distorted image. Suppose the noise is the same; we can get the following equation:(18)Hf=ΠWx.Becausef and x are the same original image vectors, we can deduce that(19)H=ΠW.Therefore, we obtain the convolution transform matrix of SRTI system from the linear transformation matrix and the weight matrix, and the elements of degradation function are located in certain positions of convolution transform matrix.


### 3.2. Mixture Model of Element Estimation

In the previous subsection, we find that the elements of matrixH derive from the particular elements of degradation function. In order to obtain the degradation function of RTI system, we consider the values of a particular element in the matrix H as a sampling process on the particular element in degradation function hx,y. When we analyze the distribution of the element values in the degradation function hx,y, we find that a single probability distribution cannot fit every elements in hx,y, as illustrated in Figure 4.Figure 4
Fitting results in different probability distributions. (a) GMM with 2 Gaussian distributions inh(5,6). (b) GMM with 3 Gaussian distributions in h(13,9).
(a)
(b)The fitting results show that normal distribution fitting and extreme value fitting could not fit the histogram of the element values, especially the extreme value fitting result in Figure4(b). Gaussian mixture model could fit the histogram of the element values very well (green lines in Figure 4). The reason is that Gaussian mixture model could elect the appropriate value about the parameters of Gaussian distributions and the corresponding weighting factors to fit the histogram of the element values. Therefore we model each element in degradation function as a mixture of Q Gaussian distributions:(20)Phi,j=∑q=1Qωq·ghi,j,μq,σq,where hi,j is the element value in degradation function hx,y at position i,j, Phi,j is the probability density function of hi,j, Q is the number of Gaussian distributions, ωq is the weight of the qth Gaussian distribution, and all is 1. ghi,j,μq,σq stands for the Gaussian possibility density function; μq and σq represent its mean and standard variance, respectively.Because the samples of each element in degradation function are located in many different positions inH, we introduce a learning algorithm [23] to update the model parameters in time.The first thing is assigning the elements inH to the corresponding group hi,j,m1≤m≤M by using the mapping relationship shown in (15) and (16). Then we check each element value in the first data group. If the element value does not match the current Q Gaussian distributions, we use a new Gaussian distribution to replace the least probable distribution. The mean of this new distribution is the current element value, the initial variance is a high value, and the prior weight is a low value.When the element value matches one of theQ distributions, the prior weights of the Q distributions for the nth element are adjusted as follows:(21)ωq,m=1-βωq,m-1+βMq,m,where β is the learning rate which defines the speed of convergence of distribution’s parameters. Mq,m is 1 for the model which is matched and 0 for the remaining models.The parametersμ and σ for unmatched distributions keep unaltered, and the parameters of matched distribution are updated as follows:(22)μm=1-ρμm-1+ρhi,j,m,σm2=1-ρσm-12+ρhi,j,m-μm2,where ρ=βghi,j,m∣μq,σq is another learning rate indicating that only the element value matching the model is included in the estimation. After all the element values in one group are processed, we calculate the corresponding degradation function element hi,j by(23)h^i,j=∑q=1Qωq·μq.As each element inhx,y is processed, the degradation function is obtained. Then we can use (10) to estimate the original RTI image.


## 3.1. Relationship between Degradation Function and Linear Solution

By using the definition of convolution, we can express the image degradation process (7) in vector-matrix form [15, 22]:(12)g=Hf+η,where f is an XY×1 vector representing an input image fx,y, and we can form the vector by using each column of image fx,y. X and Y are the width and height of the image, respectively. Then vectors g and η are formed in the same way. As a result, H is an XY×XY matrix, and its elements are given by the definition of circular convolution in two dimensions:(13)fx,y∗hx,y=∑m=0X-1∑n=0Y-1fm,nhx-m,y-n.Suppose the degradation functionhx,y has dimensions 2K+1×2K+1, and its elements are shown in the following matrix:(14)h-K,-Kh-K,-K+1⋯h-K,0⋯h-K,Kh-K+1,-Kh-K+1,-K+1⋯h-K+1,0⋯h-K+1,K⋮⋮⋱⋮⋱⋮h0,-Kh0,-K+1⋯h0,0⋯h0,K⋮⋮⋱⋮⋱⋮hK,-KhK,-K+1⋯hK,0⋯hK,K.Then we plug (14) into (13) resulting in(15)H=H0H-1⋯H-K0⋯00H1H0⋯H-K+1H-K⋯00⋮⋮⋱⋮⋱⋮⋮HKHK-1⋯H0H-1⋯000HK⋯H1H0⋯00⋮⋮⋱⋮⋱⋮⋮00⋯00⋯H0H-100⋯00⋯H1H0,where Hi is a block matrix, and it is constructed by the elements of degradation function:(16)Hi=h0,ih-1,i⋯h-K,i0⋯00h1,ih0,i⋯h-K+1,ih-K,i⋯00⋮⋮⋱⋮⋮⋱⋮⋮hK,ihK-1,i⋯h0,ih-1,i⋯000hK,i⋯h1,ih0,i⋯00⋮⋮⋱⋮⋮⋱⋮⋮00⋯00⋯h0,ih-1,i00⋯00⋯h1,ih0,i.As discussed before, the Tikhonov solution of SRTI system is expressed in (6); then we plug (4) into (6) which results in(17)x^=Πr=ΠWx+nt.Comparing two equations (12) and (17), we find that the left sides of two equations describe the same distorted image. Suppose the noise is the same; we can get the following equation:(18)Hf=ΠWx.Becausef and x are the same original image vectors, we can deduce that(19)H=ΠW.Therefore, we obtain the convolution transform matrix of SRTI system from the linear transformation matrix and the weight matrix, and the elements of degradation function are located in certain positions of convolution transform matrix.


## 3.2. Mixture Model of Element Estimation

In the previous subsection, we find that the elements of matrixH derive from the particular elements of degradation function. In order to obtain the degradation function of RTI system, we consider the values of a particular element in the matrix H as a sampling process on the particular element in degradation function hx,y. When we analyze the distribution of the element values in the degradation function hx,y, we find that a single probability distribution cannot fit every elements in hx,y, as illustrated in Figure 4.Figure 4
Fitting results in different probability distributions. (a) GMM with 2 Gaussian distributions inh(5,6). (b) GMM with 3 Gaussian distributions in h(13,9).
(a)
(b)The fitting results show that normal distribution fitting and extreme value fitting could not fit the histogram of the element values, especially the extreme value fitting result in Figure4(b). Gaussian mixture model could fit the histogram of the element values very well (green lines in Figure 4). The reason is that Gaussian mixture model could elect the appropriate value about the parameters of Gaussian distributions and the corresponding weighting factors to fit the histogram of the element values. Therefore we model each element in degradation function as a mixture of Q Gaussian distributions:(20)Phi,j=∑q=1Qωq·ghi,j,μq,σq,where hi,j is the element value in degradation function hx,y at position i,j, Phi,j is the probability density function of hi,j, Q is the number of Gaussian distributions, ωq is the weight of the qth Gaussian distribution, and all is 1. ghi,j,μq,σq stands for the Gaussian possibility density function; μq and σq represent its mean and standard variance, respectively.Because the samples of each element in degradation function are located in many different positions inH, we introduce a learning algorithm [23] to update the model parameters in time.The first thing is assigning the elements inH to the corresponding group hi,j,m1≤m≤M by using the mapping relationship shown in (15) and (16). Then we check each element value in the first data group. If the element value does not match the current Q Gaussian distributions, we use a new Gaussian distribution to replace the least probable distribution. The mean of this new distribution is the current element value, the initial variance is a high value, and the prior weight is a low value.When the element value matches one of theQ distributions, the prior weights of the Q distributions for the nth element are adjusted as follows:(21)ωq,m=1-βωq,m-1+βMq,m,where β is the learning rate which defines the speed of convergence of distribution’s parameters. Mq,m is 1 for the model which is matched and 0 for the remaining models.The parametersμ and σ for unmatched distributions keep unaltered, and the parameters of matched distribution are updated as follows:(22)μm=1-ρμm-1+ρhi,j,m,σm2=1-ρσm-12+ρhi,j,m-μm2,where ρ=βghi,j,m∣μq,σq is another learning rate indicating that only the element value matching the model is included in the estimation. After all the element values in one group are processed, we calculate the corresponding degradation function element hi,j by(23)h^i,j=∑q=1Qωq·μq.As each element inhx,y is processed, the degradation function is obtained. Then we can use (10) to estimate the original RTI image.


## 4. Results and Discussion

This section presents images that are restored using the reconstruction and restoration techniques described in Section2. The images contain both simulated and experimental results, and the imaging accuracy of targets is also presented.


### 4.1. Simulated Results

This simulation part is used to evaluate the estimation method and the restoration method at ideal conditions with no noise. The simulated RTI system contains 20 wireless sensor nodes, and each node is placed 1.6 m apart along the perimeter of8×8m2. The simulated targets are three types: rectangle, L-shape, and hollow block, as shown in Figure 5(a). The data of the simulations is obtained by the model described in (4), but without any noise. Then we use the SRTI reconstruction and image restoration techniques to obtain images, and Table 1 lists the SRTI model and image restoration parameters used in simulation phase.Table 1
Parameters setting.
Para.
Value (simulation)
Value (experiment)
Description
α
50
100
Regularization parameter
λ
0.05
0.05
Width of weighting ellipse (m)
β
0.01
0.01
Learning rate
γ
0.05
0.08
Smooth parameter
K
15
17
Degradation function lengthFigure 5
Simulated images with different shape. (a) shows three targets with different shape. (b) shows the images reconstructed by SRTI. (c) shows the images restored by our proposed method.
(a)
(b)
(c)Figure5 shows the images of SRTI reconstructed result and restored result in different target types. We can find that the restored edge of targets is more distinguishable than SRTI reconstruction, and the image area of targets also converges to the middle line of targets. The corners of the L-type and hollow block are restored more accurately than SRTI reconstruction. We introduce Edge Preservation Index (EPI) [24] and Structural SIMilarity (SSIM) [25] to assess the improvement of our proposed method. The EPI and SSIM values of three targets are listed in Table 2.(24)EPI=∑ΔxIcx,y+ΔyIcx,y∑ΔxIox,y+ΔyIox,y,(25)SSIM=1R∑R2μcμo+C12σco+C2μc2+μo2+C1σc2+σo2+C2,where ΔxIx,y=Ix,y-Ix+1,y and ΔyIx,y=Ix,y-Ix,y+1 describe the differences of the image Ix,y on horizontal and vertical directions, respectively. Icx,y is the compared image, and Iox,y is the simulated original image. In (25), μc, μo and σc, σo are the means and standard deviations of the images being compared and σco is the covariance between two images. These quantities are calculated in a local window which is centered on each pixel, and R is the number of local windows in the image. C1 and C2 are constants.Table 2
EPI and SSIM comparison.
EPI
SSIM
Target type
SRTI
Proposed
Improved
SRTI
Proposed
Improved
Rectangle
0.5859
0.6970
19.96%
0.3679
0.4503
22.40%
Hollow block
0.5420
0.6614
22.3%
0.1347
0.2085
54.79%
L-shape
0.6739
0.7345
8.99%
0.4526
0.5433
20.04%From Table2, we note that the EPI and SSIM values from our proposed method of different target types are both larger than SRTI due to the decreased dilation effect in restored images. For “hollow block,” the EPI and SSIM values from SRTI reconstructed image have the minimal values, and our proposed method has 22.3% and 54.79% increase compared to SRTI, respectively. The SSIM values of “hollow block” from both methods are much lower than the other two target types. This is due to the fact that the RSS values from limited wireless links cannot reconstruct the fine structure of the target. Overall, our proposed method restores more convergent and accurate edges of the targets than SRTI.


### 4.2. Experimental Results

The experimental RTI system contains 20 TI CC2530 wireless sensor nodes, and each node is placed1.9m apart along the perimeter of 9.5×9.5m2, as shown in Figure 6. The nodes operate at 2.4 GHz ISM frequency band, and we use the token ring protocol to obtain RSS of the links in the real time [11]. Human target is set in the surveillance area. Then we use the reconstruction and restoration techniques to obtain images, and Table 1 lists the SRTI model and image restoration parameters used in the experimental phase.Figure 6
The experimental environment. (a) The network geometry. (b) Photograph of the deployed network.
(a)
(b)Figure7 shows the images when there are human targets within the surveillance area. Figures 7(a) and 7(b) show the SRTI reconstructed image and the corresponding restored image when there is one person within the surveillance area. Figures 7(c) and 7(d) show the SRTI reconstructed image and the corresponding restored image when there are two persons within the surveillance area. Figure 7(c) illustrates the streaks of two individual targets interweaved with each other, and it is difficult to separate. Our proposed restoration method could isolate the targets easily, as shown in Figure 7(d). Comparing the images, we can conclude that our proposed RTI restoration method improves the quality of imaging in these aspects: the target area is more convergent, the target area is isolated from the streaks, and the edge shape is more distinguishable.Figure 7
Visual comparison. (a) and (b) are the reconstructed and restored images when one person is within network area. (c) and (d) are the corresponding images when two persons are within network area.
(a)
(b)
(c)
(d)We introduce image entropy to provide a quantitative assessment of the imaging performance [26]. This entropy is higher when the image has a poorer resolution.(26)E=-∑n=1Nssxn,ynln⁡ssxn,yn,ssxn,yn=Ixn,yn2∑n=1NIxn,yn2,where Ixn,yn represents the pixel value at position xn,yn and N is the total number of pixels in the image. The image entropy comparisons of different frames are shown in Figure 8. The image entropy from our proposed method has a lower value in each frame than SRTI, so we could get the same conclusions with the previous visual comparisons.Figure 8
The image entropy comparisons of different frames. (a) is the image entropy comparison when only one person is within network area. (b) is the image entropy comparison when two persons are within network area.
(a)
(b)In order to assess the accuracy of SRTI and restored images, the “true” attenuation field should be known or estimated. Since the attenuation of the human body is difficult to model, we employ the simply uniformly attenuating cylinder to model a human body plane [7]. Now we can define the “true” image xo of a human located at the point ch:(27)xon=1ifxn-ch<Rh0otherwise,where xn is the position of the nth voxel in xo and xon is its value.Then we obtain the normalized imagef^N by scaling the estimated image (11), and we can define the mean-squared error (MSE) [27] of the normalized image as(28)MSE=xo-f^N2N,where N is the number of voxels in the image.In this experiment, we select nine different positions within the surveillance area, and a person stands for a few minutes on each position. Then we calculate MSE of the images after the SRTI reconstruction procedure and image restoration procedure, respectively. The cumulative distribution functions (CDFs) of image MSE for the RTI reconstruction and the proposed image restoration method are shown in Figure9. When the radius of human model is set to 0.4 m, the mean of image MSEs in different positions is 0.0135 with the SRTI reconstruction method and 0.0101 with the proposed image restoration method. Therefore, the proposed restoration method exhibits a preferable imaging accuracy.Figure 9
The image MSE comparison of shadowing-based RTI and proposed method.


## 4.1. Simulated Results

This simulation part is used to evaluate the estimation method and the restoration method at ideal conditions with no noise. The simulated RTI system contains 20 wireless sensor nodes, and each node is placed 1.6 m apart along the perimeter of8×8m2. The simulated targets are three types: rectangle, L-shape, and hollow block, as shown in Figure 5(a). The data of the simulations is obtained by the model described in (4), but without any noise. Then we use the SRTI reconstruction and image restoration techniques to obtain images, and Table 1 lists the SRTI model and image restoration parameters used in simulation phase.Table 1
Parameters setting.
Para.
Value (simulation)
Value (experiment)
Description
α
50
100
Regularization parameter
λ
0.05
0.05
Width of weighting ellipse (m)
β
0.01
0.01
Learning rate
γ
0.05
0.08
Smooth parameter
K
15
17
Degradation function lengthFigure 5
Simulated images with different shape. (a) shows three targets with different shape. (b) shows the images reconstructed by SRTI. (c) shows the images restored by our proposed method.
(a)
(b)
(c)Figure5 shows the images of SRTI reconstructed result and restored result in different target types. We can find that the restored edge of targets is more distinguishable than SRTI reconstruction, and the image area of targets also converges to the middle line of targets. The corners of the L-type and hollow block are restored more accurately than SRTI reconstruction. We introduce Edge Preservation Index (EPI) [24] and Structural SIMilarity (SSIM) [25] to assess the improvement of our proposed method. The EPI and SSIM values of three targets are listed in Table 2.(24)EPI=∑ΔxIcx,y+ΔyIcx,y∑ΔxIox,y+ΔyIox,y,(25)SSIM=1R∑R2μcμo+C12σco+C2μc2+μo2+C1σc2+σo2+C2,where ΔxIx,y=Ix,y-Ix+1,y and ΔyIx,y=Ix,y-Ix,y+1 describe the differences of the image Ix,y on horizontal and vertical directions, respectively. Icx,y is the compared image, and Iox,y is the simulated original image. In (25), μc, μo and σc, σo are the means and standard deviations of the images being compared and σco is the covariance between two images. These quantities are calculated in a local window which is centered on each pixel, and R is the number of local windows in the image. C1 and C2 are constants.Table 2
EPI and SSIM comparison.
EPI
SSIM
Target type
SRTI
Proposed
Improved
SRTI
Proposed
Improved
Rectangle
0.5859
0.6970
19.96%
0.3679
0.4503
22.40%
Hollow block
0.5420
0.6614
22.3%
0.1347
0.2085
54.79%
L-shape
0.6739
0.7345
8.99%
0.4526
0.5433
20.04%From Table2, we note that the EPI and SSIM values from our proposed method of different target types are both larger than SRTI due to the decreased dilation effect in restored images. For “hollow block,” the EPI and SSIM values from SRTI reconstructed image have the minimal values, and our proposed method has 22.3% and 54.79% increase compared to SRTI, respectively. The SSIM values of “hollow block” from both methods are much lower than the other two target types. This is due to the fact that the RSS values from limited wireless links cannot reconstruct the fine structure of the target. Overall, our proposed method restores more convergent and accurate edges of the targets than SRTI.


## 4.2. Experimental Results

The experimental RTI system contains 20 TI CC2530 wireless sensor nodes, and each node is placed1.9m apart along the perimeter of 9.5×9.5m2, as shown in Figure 6. The nodes operate at 2.4 GHz ISM frequency band, and we use the token ring protocol to obtain RSS of the links in the real time [11]. Human target is set in the surveillance area. Then we use the reconstruction and restoration techniques to obtain images, and Table 1 lists the SRTI model and image restoration parameters used in the experimental phase.Figure 6
The experimental environment. (a) The network geometry. (b) Photograph of the deployed network.
(a)
(b)Figure7 shows the images when there are human targets within the surveillance area. Figures 7(a) and 7(b) show the SRTI reconstructed image and the corresponding restored image when there is one person within the surveillance area. Figures 7(c) and 7(d) show the SRTI reconstructed image and the corresponding restored image when there are two persons within the surveillance area. Figure 7(c) illustrates the streaks of two individual targets interweaved with each other, and it is difficult to separate. Our proposed restoration method could isolate the targets easily, as shown in Figure 7(d). Comparing the images, we can conclude that our proposed RTI restoration method improves the quality of imaging in these aspects: the target area is more convergent, the target area is isolated from the streaks, and the edge shape is more distinguishable.Figure 7
Visual comparison. (a) and (b) are the reconstructed and restored images when one person is within network area. (c) and (d) are the corresponding images when two persons are within network area.
(a)
(b)
(c)
(d)We introduce image entropy to provide a quantitative assessment of the imaging performance [26]. This entropy is higher when the image has a poorer resolution.(26)E=-∑n=1Nssxn,ynln⁡ssxn,yn,ssxn,yn=Ixn,yn2∑n=1NIxn,yn2,where Ixn,yn represents the pixel value at position xn,yn and N is the total number of pixels in the image. The image entropy comparisons of different frames are shown in Figure 8. The image entropy from our proposed method has a lower value in each frame than SRTI, so we could get the same conclusions with the previous visual comparisons.Figure 8
The image entropy comparisons of different frames. (a) is the image entropy comparison when only one person is within network area. (b) is the image entropy comparison when two persons are within network area.
(a)
(b)In order to assess the accuracy of SRTI and restored images, the “true” attenuation field should be known or estimated. Since the attenuation of the human body is difficult to model, we employ the simply uniformly attenuating cylinder to model a human body plane [7]. Now we can define the “true” image xo of a human located at the point ch:(27)xon=1ifxn-ch<Rh0otherwise,where xn is the position of the nth voxel in xo and xon is its value.Then we obtain the normalized imagef^N by scaling the estimated image (11), and we can define the mean-squared error (MSE) [27] of the normalized image as(28)MSE=xo-f^N2N,where N is the number of voxels in the image.In this experiment, we select nine different positions within the surveillance area, and a person stands for a few minutes on each position. Then we calculate MSE of the images after the SRTI reconstruction procedure and image restoration procedure, respectively. The cumulative distribution functions (CDFs) of image MSE for the RTI reconstruction and the proposed image restoration method are shown in Figure9. When the radius of human model is set to 0.4 m, the mean of image MSEs in different positions is 0.0135 with the SRTI reconstruction method and 0.0101 with the proposed image restoration method. Therefore, the proposed restoration method exhibits a preferable imaging accuracy.Figure 9
The image MSE comparison of shadowing-based RTI and proposed method.


## 5. Conclusions

In this paper, we introduce an image restoration technique to RTI system, and we present a novel model to estimate the degradation function of RTI system. The improvements concern three aspects: modeling the RTI reconstruction as the image degradation procedure, proposing an estimation method of degradation function of RTI system, and taking into consideration the inherent relationship of the linear transformation matrix.The performance of the proposed method is validated in simulations and experiments. The results demonstrate that the proposed image restoration method outperforms the original shadowing-based RTI system. Moreover, the improvements both visually and numerically are positive, and the proposed method provides a novel solution for the accurate imaging of RTI system. The experiment results indicate the proposed method is capable of achieving a higher imaging accuracy.Future research will investigate the other RTI reconstruction model that can reconstruct the fine geometrical shape of the target, and we will take the multipath components and noise interference into consideration.



---

*Source: 5703518-2017-06-20.xml*