# Unbalanced Threshold Based Distributed Data Collection Scheme in Multisink Wireless Sensor Networks

Authors: Guorui Li; Ying Wang; Cong Wang; Yiying Liu
Journal: International Journal of Distributed Sensor Networks
 (2016)

---

## Abstract

In multisink wireless sensor networks, synchronized data collection among multiple sinks is a significant and challenging task. In this paper, we propose an unbalanced threshold based distributed data collection scheme to reconstruct the synchronized sensed data of the whole sensor network in all sinks. The proposed scheme includes the unbalanced threshold based distributed top-K query algorithm and the distributed iterative hard thresholding algorithm. By computing unbalanced thresholds and pruning unnecessary element exchanging, each sink can synchronize the top-K aggregated values efficiently via the unbalanced threshold based distributed top-K query algorithm. After that, the synchronized sensed data of the whole sensor network can be reconstructed through the distributed iterative hard thresholding algorithm in a distributed and cooperative manner. We show through experiments that the proposed scheme can reduce the interaction times and decrease the number of transmitted data and that of computed data compared to the existing schemes while maintaining the similar data reconstruction accuracy. The communication and computational performances of the proposed scheme are also analyzed in detail in the paper.


---

## Body

## 1. Introduction

Wireless sensor network (WSN) is an autonomous wireless network consisting of a large number of tiny, inexpensive, and spatially distributed wireless sensor nodes. It has emerged as one of the most promising technologies for the future [1]. The typical applications of WSN include environment monitoring, industrial process control, intelligent transportation, military surveillance, and health care monitoring [2].However, wireless sensor nodes have severe resource constraints which include limited computational, memory, communication capacities and nonrenewable energy supply. Therefore, data collection schemes in wireless sensor network should be light weight and energy efficient. Two representative types of data collection schemes in wireless sensor networks are spatial-temporal correlation based data predication schemes [3–5] and distributed source coding schemes [6–8]. In the first type of data collection scheme, a series of spatial-temporal correlation based data prediction algorithms are adopted to prolong the system lifetime by enabling the sink to predict the sensed data based on some historical samples. In the second type of data collection scheme, distributed source coding techniques, such as Slepian-Wolf coding and Wyner-Ziv coding, are designed to compress the multiple correlated sensor data without the need of communication among sensor nodes. Nevertheless, the computational and communication cost of the above two types of data collection schemes are still high. Meanwhile, the parameters of predication model and the distributed coded data are still required to be computed and transmitted within the network frequently.Recently, compressive sensing (CS) theory has attracted considerable attention in areas of signal processing, computer science, and applied mathematics [9]. It is based on the principle that a sparse signal can be reconstructed from far fewer samples than that required by the classic Shannon-Nyquist sampling theory. Through nonlinear optimization, we can recover many natural signals which can be represented by a few nonzero coefficients under a suitable basis [10]. The inherent characteristics, such as compressibility, robustness, versatility, and stability, have made compressive sensing theory widely applied to communication [11], photography [12], magnetic resonance imaging [13], astronomy [14], and so forth.As for the data collection problem in wireless sensor networks, a number of compressive sensing based schemes have been proposed in the literature. In 2009, Luo et al. proposed the first complete compressive sensing based data gathering (CDG) scheme for large scale wireless sensor networks [15]. By adapting a weighted sum of all the readings along the routing tree, CDG scheme can achieve substantial communication cost reduction and balanced energy consumption simultaneously. In order to achieve both energy efficiency and recovery fidelity, Xiang et al. proposed the Compressive Data Aggregation (CDA) scheme in WSN [16]. After abstracting the minimum energy compressed data aggregation problem as a NP-completeness problem, they solve it using a mixed integer programming formulation method. Moreover, they also proposed the Dual-lEvel Compressed Aggregation (DECA) framework to recover the in-network aggregated data in the widespread monitoring area by utilizing both the low-rank nature of real-world events and the redundancy in sensed data [17]. By exploiting the spatial and temporal correlation among sensed data, Xu et al. proposed the Spatio-Temporal Hierarchical Data Aggregation Scheme Using Compressive Sensing (ST-HDACS) in [18]. After collecting the sensed data from a subset of randomly selected sensor nodes through a hierarchical routing structure, the fusion center recovers the whole sensed data by solving a matrix completing problem. Furthermore, Tang et al. proposed a robust compressive data gathering scheme to identify outlying sensor readings and derive the corresponding accurate values and further infer broken links in the sensor network [19]. Motivated by the fact that the variance among all the solutions of the blind iterative hard thresholding algorithm with different sparse level can indicate the best sparse level, Xiong and Tang proposed the blind 1-bit compressive sensing reconstruction algorithm for wireless sensor network [20]. Similar research works include the sparse random scheduling based data gathering scheme [21], the Resource Efficient Data Gathering (REDG) scheme [22], the Compressive Sensing Based Data Aggregation Scheme (CSDAS) [23], and the distributed multichain based compressive sensing scheme [24].Although the above schemes can achieve energy-efficient data collection based on compressive sensing theory, they can only be applied to single-sink wireless sensor networks in a centralized manner. In the scenario of multisink wireless sensor networks, compressed data should be transmitted to one specific sink before executing the data reconstruction algorithm. Then, the recovered data should be distributed back to other sinks through unicast or broadcast messages. Obviously, this kind of centralized pattern is less energy efficient and time consuming. In this paper, we focus on designing compressive sensing based distributed data collection scheme for multisink wireless sensor networks. The proposed scheme includes two correlated algorithms: the unbalanced threshold based distributed top-K algorithm and the distributed iterative hard thresholding algorithm. In the first algorithm, the largest K absolute aggregated values of a series of object-value pairs are queried in a distributed and energy efficient way. By computing unbalanced thresholds, a number of unnecessary object-value pairs exchanging are pruned in the query process. In the second algorithm, the iterative hard thresholding algorithm [25] is modified to fit the distributed environment. Meanwhile, the first algorithm is integrated into the second one as a subroutine to realize the HK() operator. Our experiment results indicate that the proposed scheme can reduce the interaction times and decrease the number of transmitted data and that of computed data compared to the existing schemes while maintaining the similar data reconstruction accuracy.The contributions of this paper are threefold.(1) We propose an unbalanced threshold based distributed data collection scheme in multisink wireless sensor networks based on compressive sensing theory. By decomposing the task of sparse data reconstruction into several correlated parts, all sinks can obtain the synchronized sensed data of the whole network in a distributed and cooperative manner.(2) We propose an unbalanced threshold based distributed top-K query algorithm to query the top-K aggregated values required by the iterative hard thresholding algorithm in the distributed environment. By adopting unbalanced thresholds, the algorithm can avoid transmitting unnecessary object-value pairs among sinks. Furthermore, the correctness of the proposed algorithm is also proved in this paper.(3) We analyze the data reconstruction performance, communication complexity, and computational complexity of the proposed scheme through experiments. Furthermore, we also compare the performance of the proposed scheme with existing compressive sensing based data collection schemes.The rest of this paper is organized as follows. Section2 introduces the basic principles of compressive sensing theory and the iterative hard thresholding algorithm. Sections 3 and 4 describe the unbalanced threshold based distributed top-K query algorithm and the distributed iterative hard thresholding algorithm, respectively. Section 5 presents the experimental results and analysis. Finally, Section 6 concludes this paper.


## 2. Preliminaries

Compressive sensing theory asserts that a sparse signal can be recovered from fewer linear and nonadaptive measurements than the number of samples required by Shannon-Nyquist Sampling Theorem. The compressive sampling process can be presented as(1)y=Φf+z,where f∈RN is a K sparse unknown signal; that is, there are at most K nonzero elements in f. Φ∈RM×N is the measurement matrix, z∈RM is the unknown noise, and y∈RM is the measurement signal. Although most natural signals are not sparse directly, they can be transformed into sparse signals. In other words, a signal f can be represented as a sparse signal x∈RN under an orthonormal basis Ψ∈RN×N; that is, f=Ψx. Hence, (1) can be rewritten as(2)y=Φf+z=ΦΨx+zand matrix A=ΦΨ is usually referred to as sensing matrix.One of the most important properties of sensing matrix is the Restrict Isometry Property (RIP). Formally, a matrixA is said to satisfy the RIP of order K with a Restrict Isometry Constant (RIC) δK such that(3)1-δKx22≤Ax22≤1+δKx22holds for all K sparse signal x. Baraniuk et al. have proved that a random matrix A∈RM×N with i.i.d. entries followed by normal distribution N(0,1/M) satisfies the RIP with a high probability when M≥CKlog⁡(N/K) and C is a constant [26].The Basis Pursuit De-Noise (BPDN) [27] and the Least Absolute Shrinkage and Selection Operator (LASSO) [28] are two typical signal recovery frameworks which are wildly used in compressive sensing theory. In BPDN framework, the l1 norm of the unknown signal is minimized under the constraint of limited energy of reconstruction error; that is,(4)minxx1,s.t.Ax-y2≤ε.In contrast, the energy of reconstruction error is minimized in LASSO framework under the constraint of limited l1 norm of the unknown signal x; that is,(5)min⁡xAx-y22,s.t.x1≤η.Essentially, the BPDN framework and LASSO framework can all be transformed into the following unconstraint regularized optimization framework:(6)minx12Ax-y22+τx1.A number of data reconstruction algorithms have been proposed in the literature. In general, they can be classified into two categories: optimization algorithms and greedy algorithms. In the optimization algorithms, a number of convex optimization methods have been adopted to search the optimized solution of (6). Basis Pursuit (BP) algorithm [27], Interior Point (IP) algorithm [29], and homotopy algorithm [30] are representatives of this type of reconstruction algorithm. On the contrary, greedy algorithms iteratively select the support sets or the elements of the reconstructed signal based on certain greedy selection strategy. Orthogonal Matching Pursuit (OMP) algorithm [31], Regularized Orthogonal Matching Pursuit (ROMP) algorithm [32], Compressive Sampling Matching Pursuit (CoSmMP) algorithm [33], Subspace Matching Pursuit (SP) algorithm [34], iterative hard thresholding (IHT) algorithm [25], and Iterative Soft Thresholding (IST) algorithm [35] are representatives of greedy algorithm.Among all proposed data reconstruction algorithms, the iterative hard thresholding algorithm is very easy to implement and can be relatively fast. Meanwhile, it also possesses strong theoretical recovery performance guarantees as convex optimization based algorithms. Essentially, it can be regarded as an iterative method(7)xt+1=HKxt+μATy-Axt,where HK() is the hard thresholding operator that sets all but K largest elements in magnitude to zero and μ is the step size. Formally, we can represent the hard thresholding operator HK() as(8)HKxi=xixi∈xtop-K0xi∉xtop-K,where xtop-|K| represents the largest K elements of signal x in magnitude. We will propose a distributed implementation of hard thresholding operator HK() in next section and integrate it in the distributed iterative hard thresholding algorithm which is described in Section 4.


## 3. The Unbalanced Threshold Based Distributed Top-|K| Query Algorithm

In recent years, top-K query, also known as ranking aware query, has received much attention in the areas of relational database system, content distribution network, multimedia retrieval system, and so forth. However, only monotonic aggregation functions can be applied to the top-K query. The largest K absolute elements query in the hard thresholding operator is nonmonotonic. Therefore, the proposed top-K query algorithms, such as thresholding algorithm (TA) [36] and three-phase uniform threshold (TPUT) algorithm [37], cannot be applied to the distributed IHT algorithm directly. We will describe our proposed unbalanced threshold based distributed top-K query algorithm in detail in Section 3.1 and illustrate it with an example in Section 3.2.


### 3.1. Algorithm Design

We assume there areP nodes in the distributed system and each node is assigned with an ID. The node with the lowest ID is designated as the administrator node and other nodes are designated as the member nodes. Each node i maintains a descending ordered list Li of its object-value pairs (Oj,Vi(j)) where index j ranges from 1 to element number Ni. Note that if an object does not appear in the list, its value is set to zero by default. We will select the largest K sums in magnitude of all the objects in the distributed system.The core idea of the unbalanced threshold based distributed top-K query algorithm is to filter out unnecessary exchanging of elements among distributed nodes by adopting unbalanced thresholds. It includes three phases, that is, the unbalanced threshold computing phase, the candidate set computing phase, and the top-K elements computing phase.In the unbalanced threshold computing phase, each member node sends its firstK positive elements and last K negative elements to the administrator node. Then, the administrator node can compute the partial sum P(j) for every received element j according to (9)Pj=∑i=1PVi′j,Vi′j=VijVijis  known0Vijis  unknownand select the Kth largest positive partial sum τ-1 and the Kth smallest negative partial sum τ_1. The partial sum P(j) is used to estimate the sum of top-K elements approximately. In order to deal with unbalanced value distribution among different nodes and avoid redundant element exchanging between administrator node and member nodes, we compute different thresholds for each node instead of fixing one identical threshold for all nodes. Based on the computed positive weight ω-i and negative weight ω_i, the partial sums τ-1 and τ_1 are divided into P different thresholds T-i and T_i, respectively.In the candidate set computing phase, each member node sends unsent object-value pairs(Oj,Vi(j)) to the administrator node when Vij≥T-i1 or Vij≤T_i1. Then, the administrator node computes the partial sum according to (9) and selects the Kth largest positive partial sum τ-2 and Kth smallest negative partial sum τ_2 once again. Furthermore, it computes the upper bound U(j) and lower bound L(j) of the whole sum for every received object j according to(10)Uj=∑i=1PV-ij,V-ij=VijVijis  knownT-iVijis  unknown,(11)Lj=∑i=1PV_ij,V_ij=VijVijis  knownT_iVijis  unknown,respectively. The upper bound and lower bound are used to estimate the maximal range of each object. If Uj<τ-2 or Lj>τ_2, we can guarantee that the whole sum of object j(12)Wj=∑i=1PVijis not in the set of top-K aggregated sums. Hence, we can exclude object j from the candidate set Swith confidence.In the top-K elements computing phase, each member node sends unsent object-value pairs (Oj,Vi(j)) in candidate set S to the administrator node. Then, the administrator node can compute the whole sum for each object according to (12) and select the top-K aggregated sums.The pseudocode of the unbalanced threshold based distributed top-K query algorithm is presented in Algorithm 1.Algorithm 1:The unbalanced threshold based distributed top-|K| query algorithm.
Input: The descending list Li=(Oj,Vi(j))∣i∈1,…,P,j∈1,…,Ni
Phase I: The unbalanced thresholds computing phase
If node i is administrator node Then
Computes partial sumsP(j) for received elements according to (9);
Letτ-1=min⁡Pjtop-K and τ_1=-min⁡-Pjtop-K;
Computes weightsω-i=∑j=1KVi(j)/K and ω_i=∑j=Ni-K+1NiVi(j)/K;
Sends thresholdsT-i=τ-1ω-i/∑i=1Pω-i and T_i=τ_1ω_i/∑i=1Pω_i to member nodes;
Else
Sends(Oj,Vi(j))∣j∈1,…,K∪Ni-K+1,…,Ni to administrator node;
Phase II: The candidate set computing phase
If node i is administrator node Then
Computes partial sumsP(j) for received elements according to (9);
Letτ-2=min⁡Pjtop-K and τ_2=-min⁡-Pjtop-K;
Computes upper boundsU(j) and lower bounds L(j) of whole sums for received elements according to (10) and (11);
Sends candidate setS=j∣j∈U(j)≥τ-2∪L(j)≤τ_2 to member nodes;
Else
Sends unsent(Oj,Vi(j))∣j∈Vi(j)≥T-i1∪Vi(j)≤T_i1 to administrator node;
Phase III: The top-
|
K
|
elements computing phase
If node i is administrator node Then
Computes whole sumsW(j) for received elements according to (12);
LetStop-|K|=(Oj,V(j))∣j∈Wjtop-K;
Else
Sends unsent(Oj,Vi(j))∣j∈S to administrator node;
Output: The top-|K| element set Stop-|K|Lemma 1.
The unbalanced thresholds computed in phase I can guarantee that the true top-K objects are among the objects in phase II.Proof.
Assume thatOk is an object which is not sent to the administrator node in phase II. Then its value Vi(k) in node i is less than T-i and greater than T_i at the same time; that is, T_i<Vi(k)<T-i. Then the sum of object Ok’s value can be bounded by(13)∑i=1PT_i<∑i=1PVik<∑i=1PT-i.Since ∑i=1PT_i=∑i=1Pτ_1ω_i/∑i=1Pω_i=τ_1 and ∑i=1PT-i=∑i=1Pτ-1ω-i/∑i=1Pω-i=τ-1, (13) can be rewritten as (14)τ_1<∑i=1PVik<τ-1.That is, object Ok cannot be a top-K object. Therefore, true top-K objects must be among the objects in phase II.Lemma 2.
The candidate set computed in phase II can guarantee that the true top-K objects are among the objects in phase III.Proof.
Assume thatOk is an object which is not included in candidate set S in phase II. Then the sum of object Ok’s value satisfies ∑i=1PVi(k)<U(j)<τ-2 and ∑i=1PVi(k)>L(j)<τ_2 at the same time; that is,(15)τ_2<∑i=1PVik<τ-2.Since τ-2 and τ_2 are the Kth largest positive partial sum and the Kth smallest negative partial sum, there are already K objects whose partial sums are greater than τ-2 and lesser than τ_2. That is, object Ok cannot be a top-K object. Therefore, true top-K objects must be among the objects in phase III.Theorem 3.
The unbalanced threshold based distributed top-K query algorithm can obtain the largest K aggregated sums in magnitude of all objects in the distributed system.Proof.
Through Lemmas1 and 2, we can prove that true top-K objects must be among the objects in phase III. Furthermore, the administrator node has obtained all the values for each object in the candidate set. Therefore, the proposed algorithm can obtain the largest K aggregated sums in magnitude of all objects in the distributed system.


### 3.2. Example

We will illustrate the unbalanced threshold based distributed top-K query algorithm with an example in this subsection. There are 3 nodes in the distributed system, one administrator node and two member nodes. The object-value pairs in each node are presented in Table 1.Table 1
An example with 3 nodes.
Administrator node
Member node 1
Member node 2
(O5, 21)
(O4, 34)
(O5, 20)
(O2, 17)
(O5, 28)
(O4, 17)
(O4, 15)
(O2, 22)
(O3, 14)
(O3, 10)
(O3, 18)
(O2, 9)
(O6, 8)
(O7, 11)
(O7, 7)
(O7, 2)
(O6, 5)
(O0, 1)
(O0, −2)
(O0, −1)
(O6, −6)
(O1, −7)
(O9, −10)
(O8, −11)
(O8, −12)
(O1, −14)
(O1, −13)
(O9, −30)
(O8, −18)
(O9, −16)In the unbalanced thresholds computing phase, member node 1 and member node 2 send{(O4,34),(O5,28),(O1,-14),(O8,-18)} and {(O5,20),(O4,17),(O1,-13),(O9,-16)} to administrator node, respectively. The administrator node then computes partial sums for all received elements according to (9). For object 5, partial sum P(5)=69 because V1(5)=21, V2(5)=28, and V3(5)=20 are all known. For object 4, partial sum P(4)=51 because V2(4)=34, V3(4)=17 are known but V1(4) is unknown (V1(4) is located in neither the first 2 nor the last 2 cells in list L1). Similarly, we can get P(2)=17, P(8)=-30, P(9)=-46, and P(1)=-27. Thus, the top-2 positive partial sum τ-1=51 and the top-2 negative partial sum τ_1=-30. According to Algorithm 1, the weights and thresholds for each node are ω-1=19, ω-2=31, ω-3=18.5, ω_1=-21, ω_2=-16, and ω_3=-14.5 and τ-11=14.2, τ-12=23.0, τ-13=13.8, τ_11=-12.2, τ_12=-9.3, and τ_13=-8.5, respectively.In the candidate set computing phase, member node 1 and member node 2 send{(O9,-10)} and {(O3,14),(O8,-11)} to administrator node, respectively. The administrator node then computes partial sums according to (9) and gets P(5)=69, P(4)=66, P(2)=17, P(3)=14, P(8)=-41, P(9)=-56, and P(1)=-27. The top-2 positive partial sum τ-2 and top-2 negative partial sum τ_2 are updated to 66 and −56, respectively. The administrator node then computes upper bounds and lower bounds for each received element and gets U(5)=L(5)=69, U(4)=L(4)=66, U(2)=53.8, L(2)=-0.8, U(3)=51.2, L(3)=-7.5, U(8)=L(8)=-41, U(9)=L(9)=-56, U(1)=-12.8, and L(1)=-39.2. Therefore, the candidate set S={5,4,8,9}.In the top-K elements computing phase, no object-value pair is transmitted because all the object-value pairs in candidate set S are already known. Therefore, the interaction between administrator node and member nodes can be omitted and we can obtain the top-|2| query results {(5,69),(4,66)}.The total number of transmitted object-value pairs in our proposed unbalanced threshold based distributed top-K query algorithm is 11 and twice interactions are required between each member node and administrator node. As for the modified TA based algorithm [38] and the modified TPUT based algorithm [39], the total number of transmitted object-value pairs is 16 and 14, respectively. Meanwhile, the interaction times of these two algorithms are 8 and 3, respectively. We can see that both the interaction times and the number of transmitted data of our proposed scheme are the least among these three algorithms. The performance comparison of these algorithms will be discussed in detail in Section 5.


## 3.1. Algorithm Design

We assume there areP nodes in the distributed system and each node is assigned with an ID. The node with the lowest ID is designated as the administrator node and other nodes are designated as the member nodes. Each node i maintains a descending ordered list Li of its object-value pairs (Oj,Vi(j)) where index j ranges from 1 to element number Ni. Note that if an object does not appear in the list, its value is set to zero by default. We will select the largest K sums in magnitude of all the objects in the distributed system.The core idea of the unbalanced threshold based distributed top-K query algorithm is to filter out unnecessary exchanging of elements among distributed nodes by adopting unbalanced thresholds. It includes three phases, that is, the unbalanced threshold computing phase, the candidate set computing phase, and the top-K elements computing phase.In the unbalanced threshold computing phase, each member node sends its firstK positive elements and last K negative elements to the administrator node. Then, the administrator node can compute the partial sum P(j) for every received element j according to (9)Pj=∑i=1PVi′j,Vi′j=VijVijis  known0Vijis  unknownand select the Kth largest positive partial sum τ-1 and the Kth smallest negative partial sum τ_1. The partial sum P(j) is used to estimate the sum of top-K elements approximately. In order to deal with unbalanced value distribution among different nodes and avoid redundant element exchanging between administrator node and member nodes, we compute different thresholds for each node instead of fixing one identical threshold for all nodes. Based on the computed positive weight ω-i and negative weight ω_i, the partial sums τ-1 and τ_1 are divided into P different thresholds T-i and T_i, respectively.In the candidate set computing phase, each member node sends unsent object-value pairs(Oj,Vi(j)) to the administrator node when Vij≥T-i1 or Vij≤T_i1. Then, the administrator node computes the partial sum according to (9) and selects the Kth largest positive partial sum τ-2 and Kth smallest negative partial sum τ_2 once again. Furthermore, it computes the upper bound U(j) and lower bound L(j) of the whole sum for every received object j according to(10)Uj=∑i=1PV-ij,V-ij=VijVijis  knownT-iVijis  unknown,(11)Lj=∑i=1PV_ij,V_ij=VijVijis  knownT_iVijis  unknown,respectively. The upper bound and lower bound are used to estimate the maximal range of each object. If Uj<τ-2 or Lj>τ_2, we can guarantee that the whole sum of object j(12)Wj=∑i=1PVijis not in the set of top-K aggregated sums. Hence, we can exclude object j from the candidate set Swith confidence.In the top-K elements computing phase, each member node sends unsent object-value pairs (Oj,Vi(j)) in candidate set S to the administrator node. Then, the administrator node can compute the whole sum for each object according to (12) and select the top-K aggregated sums.The pseudocode of the unbalanced threshold based distributed top-K query algorithm is presented in Algorithm 1.Algorithm 1:The unbalanced threshold based distributed top-|K| query algorithm.
Input: The descending list Li=(Oj,Vi(j))∣i∈1,…,P,j∈1,…,Ni
Phase I: The unbalanced thresholds computing phase
If node i is administrator node Then
Computes partial sumsP(j) for received elements according to (9);
Letτ-1=min⁡Pjtop-K and τ_1=-min⁡-Pjtop-K;
Computes weightsω-i=∑j=1KVi(j)/K and ω_i=∑j=Ni-K+1NiVi(j)/K;
Sends thresholdsT-i=τ-1ω-i/∑i=1Pω-i and T_i=τ_1ω_i/∑i=1Pω_i to member nodes;
Else
Sends(Oj,Vi(j))∣j∈1,…,K∪Ni-K+1,…,Ni to administrator node;
Phase II: The candidate set computing phase
If node i is administrator node Then
Computes partial sumsP(j) for received elements according to (9);
Letτ-2=min⁡Pjtop-K and τ_2=-min⁡-Pjtop-K;
Computes upper boundsU(j) and lower bounds L(j) of whole sums for received elements according to (10) and (11);
Sends candidate setS=j∣j∈U(j)≥τ-2∪L(j)≤τ_2 to member nodes;
Else
Sends unsent(Oj,Vi(j))∣j∈Vi(j)≥T-i1∪Vi(j)≤T_i1 to administrator node;
Phase III: The top-
|
K
|
elements computing phase
If node i is administrator node Then
Computes whole sumsW(j) for received elements according to (12);
LetStop-|K|=(Oj,V(j))∣j∈Wjtop-K;
Else
Sends unsent(Oj,Vi(j))∣j∈S to administrator node;
Output: The top-|K| element set Stop-|K|Lemma 1.
The unbalanced thresholds computed in phase I can guarantee that the true top-K objects are among the objects in phase II.Proof.
Assume thatOk is an object which is not sent to the administrator node in phase II. Then its value Vi(k) in node i is less than T-i and greater than T_i at the same time; that is, T_i<Vi(k)<T-i. Then the sum of object Ok’s value can be bounded by(13)∑i=1PT_i<∑i=1PVik<∑i=1PT-i.Since ∑i=1PT_i=∑i=1Pτ_1ω_i/∑i=1Pω_i=τ_1 and ∑i=1PT-i=∑i=1Pτ-1ω-i/∑i=1Pω-i=τ-1, (13) can be rewritten as (14)τ_1<∑i=1PVik<τ-1.That is, object Ok cannot be a top-K object. Therefore, true top-K objects must be among the objects in phase II.Lemma 2.
The candidate set computed in phase II can guarantee that the true top-K objects are among the objects in phase III.Proof.
Assume thatOk is an object which is not included in candidate set S in phase II. Then the sum of object Ok’s value satisfies ∑i=1PVi(k)<U(j)<τ-2 and ∑i=1PVi(k)>L(j)<τ_2 at the same time; that is,(15)τ_2<∑i=1PVik<τ-2.Since τ-2 and τ_2 are the Kth largest positive partial sum and the Kth smallest negative partial sum, there are already K objects whose partial sums are greater than τ-2 and lesser than τ_2. That is, object Ok cannot be a top-K object. Therefore, true top-K objects must be among the objects in phase III.Theorem 3.
The unbalanced threshold based distributed top-K query algorithm can obtain the largest K aggregated sums in magnitude of all objects in the distributed system.Proof.
Through Lemmas1 and 2, we can prove that true top-K objects must be among the objects in phase III. Furthermore, the administrator node has obtained all the values for each object in the candidate set. Therefore, the proposed algorithm can obtain the largest K aggregated sums in magnitude of all objects in the distributed system.


## 3.2. Example

We will illustrate the unbalanced threshold based distributed top-K query algorithm with an example in this subsection. There are 3 nodes in the distributed system, one administrator node and two member nodes. The object-value pairs in each node are presented in Table 1.Table 1
An example with 3 nodes.
Administrator node
Member node 1
Member node 2
(O5, 21)
(O4, 34)
(O5, 20)
(O2, 17)
(O5, 28)
(O4, 17)
(O4, 15)
(O2, 22)
(O3, 14)
(O3, 10)
(O3, 18)
(O2, 9)
(O6, 8)
(O7, 11)
(O7, 7)
(O7, 2)
(O6, 5)
(O0, 1)
(O0, −2)
(O0, −1)
(O6, −6)
(O1, −7)
(O9, −10)
(O8, −11)
(O8, −12)
(O1, −14)
(O1, −13)
(O9, −30)
(O8, −18)
(O9, −16)In the unbalanced thresholds computing phase, member node 1 and member node 2 send{(O4,34),(O5,28),(O1,-14),(O8,-18)} and {(O5,20),(O4,17),(O1,-13),(O9,-16)} to administrator node, respectively. The administrator node then computes partial sums for all received elements according to (9). For object 5, partial sum P(5)=69 because V1(5)=21, V2(5)=28, and V3(5)=20 are all known. For object 4, partial sum P(4)=51 because V2(4)=34, V3(4)=17 are known but V1(4) is unknown (V1(4) is located in neither the first 2 nor the last 2 cells in list L1). Similarly, we can get P(2)=17, P(8)=-30, P(9)=-46, and P(1)=-27. Thus, the top-2 positive partial sum τ-1=51 and the top-2 negative partial sum τ_1=-30. According to Algorithm 1, the weights and thresholds for each node are ω-1=19, ω-2=31, ω-3=18.5, ω_1=-21, ω_2=-16, and ω_3=-14.5 and τ-11=14.2, τ-12=23.0, τ-13=13.8, τ_11=-12.2, τ_12=-9.3, and τ_13=-8.5, respectively.In the candidate set computing phase, member node 1 and member node 2 send{(O9,-10)} and {(O3,14),(O8,-11)} to administrator node, respectively. The administrator node then computes partial sums according to (9) and gets P(5)=69, P(4)=66, P(2)=17, P(3)=14, P(8)=-41, P(9)=-56, and P(1)=-27. The top-2 positive partial sum τ-2 and top-2 negative partial sum τ_2 are updated to 66 and −56, respectively. The administrator node then computes upper bounds and lower bounds for each received element and gets U(5)=L(5)=69, U(4)=L(4)=66, U(2)=53.8, L(2)=-0.8, U(3)=51.2, L(3)=-7.5, U(8)=L(8)=-41, U(9)=L(9)=-56, U(1)=-12.8, and L(1)=-39.2. Therefore, the candidate set S={5,4,8,9}.In the top-K elements computing phase, no object-value pair is transmitted because all the object-value pairs in candidate set S are already known. Therefore, the interaction between administrator node and member nodes can be omitted and we can obtain the top-|2| query results {(5,69),(4,66)}.The total number of transmitted object-value pairs in our proposed unbalanced threshold based distributed top-K query algorithm is 11 and twice interactions are required between each member node and administrator node. As for the modified TA based algorithm [38] and the modified TPUT based algorithm [39], the total number of transmitted object-value pairs is 16 and 14, respectively. Meanwhile, the interaction times of these two algorithms are 8 and 3, respectively. We can see that both the interaction times and the number of transmitted data of our proposed scheme are the least among these three algorithms. The performance comparison of these algorithms will be discussed in detail in Section 5.


## 4. The Distributed Iterative Hard Thresholding Algorithm

### 4.1. Network Model

We assume thatP sinks and N sensor nodes are deployed randomly and uniformly in the surveillance area in the multisink wireless sensor network. Each sink is assigned with an ID ranging from 1 to P and each sensor node is assigned with an ID ranging from 1 to N. The sink with the lowest ID 1 is designated as administrator sink and other sinks are designated as member sinks. We assume that an effective multisink routing protocol, such as the dynamic traffic-aware routing protocol [40] or the scalable gradient-based routing protocol [41], is deployed in the network. Each sensor node can transmit its sensed data to the nearest sink in a multihop manner. The network model is shown in Figure 1.Figure 1
The network model.In wireless sensor networks, the spatial correlation among sensed data in the surveillance area implies that any sensed datax∈RN at a certain time point is of K sparsity. Each sink i takes Mi samples of x using its subsensing matrix Ai∈RMi×N and gets yi∈RMi×1; that is, yi=Aix+zi, where zi∈RMi×1 is noise. Hence, the set of P sinks will obtain M=∑i=1PMi samples y=[y1T,…,yPT]T∈RM×1 using the global sensing matrix A=[A1T,…,APT]T∈RM×N. Therefore, the data collection and synchronization among multiple sinks can be ascribed to the compressive sensing problem (6). We will design a distributed iterative hard thresholding algorithm to recover the sensed data x at all sinks in a cooperative manner.


### 4.2. Algorithm Design

After setting the initial value of the sensed datax(0) and iteration time to n×1 zero vectors 0 and 0, respectively, each sink computes the step size μ by(16)μ=μMN+σMNF-11-α-1/2,where F is the cumulative distribution function of the Tracy-Widom law of order 1, 1-α is the quantile, and parameters μMN and σMN can be computed by(17)μMN=1+N-1M2,σMN=M+N-1M1M+1N-11/3.According to the random matrix theory, the step size μ is tight when the entries of sensing matrix A are drawn from normal distribution N(0,1/M) [39].After that, each sink computes the intermediate resultzi(t) by(18)zit=xt+μAiTyi-Aixti=1μAiTyi-Aixti≠1and executes top-K query by running the unbalanced threshold based distributed top-K query algorithm. The administrator sink will obtain the (t+1)th reconstructed result and distribute it to other sinks. The above iteration continues until the difference between two reconstructed results is less than the error threshold θ.The pseudocode of the distributed iterative hard thresholding algorithm is presented in Algorithm2.Algorithm 2:The distributed iterative hard thresholding algorithm.
Input: Sparsity K, error threshold θ, sub-sensing matrix Ai, samples yi, i∈1,…,P
x
(
0
)
=
0,  t=0;
Computing step sizeμ according to (16);
Do
All sinks computezi(t) according to (18);
All sinks run Algorithm1 and the administrator sink obtains x(t+1);
The administrator sink distributesx(t+1) to other sinks;
While  x(t+1)-x(t)2<θ
Output: sensed data xSince the distributed top-K query(19)HKxt+∑i=1PμAiTyi-Aixt=HKxt+μA1T,…,APTy1⋮yP-A1⋮APxtwe can assure that the iterative computation in the distributed iterative hard thresholding algorithm equals that in the centralized iterative hard thresholding algorithm (7). Therefore, the recovered sensed data of these two algorithms are identical.


## 4.1. Network Model

We assume thatP sinks and N sensor nodes are deployed randomly and uniformly in the surveillance area in the multisink wireless sensor network. Each sink is assigned with an ID ranging from 1 to P and each sensor node is assigned with an ID ranging from 1 to N. The sink with the lowest ID 1 is designated as administrator sink and other sinks are designated as member sinks. We assume that an effective multisink routing protocol, such as the dynamic traffic-aware routing protocol [40] or the scalable gradient-based routing protocol [41], is deployed in the network. Each sensor node can transmit its sensed data to the nearest sink in a multihop manner. The network model is shown in Figure 1.Figure 1
The network model.In wireless sensor networks, the spatial correlation among sensed data in the surveillance area implies that any sensed datax∈RN at a certain time point is of K sparsity. Each sink i takes Mi samples of x using its subsensing matrix Ai∈RMi×N and gets yi∈RMi×1; that is, yi=Aix+zi, where zi∈RMi×1 is noise. Hence, the set of P sinks will obtain M=∑i=1PMi samples y=[y1T,…,yPT]T∈RM×1 using the global sensing matrix A=[A1T,…,APT]T∈RM×N. Therefore, the data collection and synchronization among multiple sinks can be ascribed to the compressive sensing problem (6). We will design a distributed iterative hard thresholding algorithm to recover the sensed data x at all sinks in a cooperative manner.


## 4.2. Algorithm Design

After setting the initial value of the sensed datax(0) and iteration time to n×1 zero vectors 0 and 0, respectively, each sink computes the step size μ by(16)μ=μMN+σMNF-11-α-1/2,where F is the cumulative distribution function of the Tracy-Widom law of order 1, 1-α is the quantile, and parameters μMN and σMN can be computed by(17)μMN=1+N-1M2,σMN=M+N-1M1M+1N-11/3.According to the random matrix theory, the step size μ is tight when the entries of sensing matrix A are drawn from normal distribution N(0,1/M) [39].After that, each sink computes the intermediate resultzi(t) by(18)zit=xt+μAiTyi-Aixti=1μAiTyi-Aixti≠1and executes top-K query by running the unbalanced threshold based distributed top-K query algorithm. The administrator sink will obtain the (t+1)th reconstructed result and distribute it to other sinks. The above iteration continues until the difference between two reconstructed results is less than the error threshold θ.The pseudocode of the distributed iterative hard thresholding algorithm is presented in Algorithm2.Algorithm 2:The distributed iterative hard thresholding algorithm.
Input: Sparsity K, error threshold θ, sub-sensing matrix Ai, samples yi, i∈1,…,P
x
(
0
)
=
0,  t=0;
Computing step sizeμ according to (16);
Do
All sinks computezi(t) according to (18);
All sinks run Algorithm1 and the administrator sink obtains x(t+1);
The administrator sink distributesx(t+1) to other sinks;
While  x(t+1)-x(t)2<θ
Output: sensed data xSince the distributed top-K query(19)HKxt+∑i=1PμAiTyi-Aixt=HKxt+μA1T,…,APTy1⋮yP-A1⋮APxtwe can assure that the iterative computation in the distributed iterative hard thresholding algorithm equals that in the centralized iterative hard thresholding algorithm (7). Therefore, the recovered sensed data of these two algorithms are identical.


## 5. Experiment and Analysis

We evaluate the performance of our proposed unbalanced threshold based distributed data collection scheme in this section. The simulation is carried out using Matlab R2014b and Wislab simulator on a MacBook Pro laptop computer with dual core i7 CPU and 8 G memory. There are 50~200 wireless sensor nodes and 4~6 sinks randomly deployed in a 400 × 400 m2 surveillance area. Multiple uncorrelated two-dimensional Gaussian distributions have been superposed to simulate the spatial correlated data sources. Note that the Gaussian random matrix is used as the measurement matrix.We will investigate the data reconstruction accuracy, communication complexity, and computational complexity of our proposed scheme. The signal-to-noise ratio (SNR)(20)SNR=20log10⁡xx-x~is used to measure the data reconstruction accuracy, where x and x~ are sensed data and reconstructed data, respectively. The number of transmitted data is the number of accumulated data involved in the communication between administrator sink and member sinks. The number of computed data is the number of accumulated data involved in the computation in administrator sink and member sinks. These two indicators are used to measure the communication complexity and computational complexity, respectively.


### 5.1. Performance Analysis

Figures2, 3, and 4 show the SNR of reconstructed data, the number of transmitted data, and the number of computed data, respectively, at different data sampling rates. We can conclude that the data reconstruction performance improves with the increase on the data sampling rate. Meanwhile, the number of transmitted data and that of computed data increase too. The reason behind this rule lies in the fact that the increase on the data sampling rate would cause more data to be transmitted and computed. Therefore, the recovered sensed data will be more accurate.Figure 2
The SNR of reconstructed data at different data sampling rates.Figure 3
The number of transmitted data at different data sampling rates.Figure 4
The number of computed data at different data sampling rates.Figures5, 6, and 7 show the SNR of reconstructed data, the number of transmitted data, and the number of computed data, respectively, in different surveillance scenarios. The number of uncorrelated two-dimensional Gaussian data sources ranges from 2 to 4. We can conclude that the data reconstruction performance degrades with the increase on the number of uncorrelated data sources. Meanwhile, the number of transmitted data and that of computed data increase at the same time. The reason behind this rule lies in the fact that the increase on the number of uncorrelated data sources leads to the increase on the sparsity of sensed data within the network. Therefore, the data reconstruction performance degrades and more data are required to be transmitted and computed.Figure 5
The SNR of reconstructed data at different number of data sources.Figure 6
The number of transmitted data at different number of data sources.Figure 7
The number of computed data at different number of data sources.Figures8, 9, and 10 show the SNR of reconstructed data, the number of transmitted data, and the number of computed data, respectively, at different number of sinks. We can conclude that there are no remarkable differences among the data reconstruction performance with different number of sinks. However, the number of transmitted data and that of computed data increase with the increase of the number of sinks. The reason behind this rule lies in the fact that the increase on the number of sinks has no influence on the data reconstruction performance and only requires more data to be transmitted within the network and computed in the sinks.Figure 8
The SNR of reconstructed data at different number of sinks.Figure 9
The number of transmitted data at different number of sinks.Figure 10
The number of computed data at different number of sinks.


### 5.2. Performance Comparison

We will compare the performance of our proposed scheme with the original iterative hard thresholding algorithm [25], the modified thresholding algorithm base iterative hard thresholding scheme [38], and the modified three-phase uniform threshold based iterative hard thresholding scheme [39] in this subsection. Here, the last two schemes are referred to as the modified TA based DIHT scheme and the modified TPUT based DIHT scheme, respectively.Figure11 shows the comparison of the SNR of these four schemes when the data sampling rate is 50%, the number of data sources is 3, and the number of sinks is 5. We can conclude that there are no remarkable differences among the data reconstruction performance of these schemes. In other words, they can provide the similar data recovery accuracy regardless of the centralized or distributed reconstruction pattern.Figure 11
The SNR of reconstructed data of different schemes.Figures12 and 13 show the number of transmitted data and interaction times of these four schemes in the same experiment settings as in Figure 11. Since the iterative hard thresholding algorithm is a centralized data reconstruction algorithm, all data in the member sinks should be transmitted to the administrator sink for reconstruction and then the recovered data would be resent back to the member sinks for synchronization. Therefore, the number of transmitted data of the IHT algorithm is much higher than that of other three schemes although only one interaction is required.Figure 12
The number of transmitted data of different schemes.Figure 13
The iteration times of different schemes.The interaction times of the modified TA based DIHT scheme dominate that of other three algorithms since only one object-value pair is queried in each interaction during the top-K query process. Meanwhile, the number of transmitted data is relatively high since no efficient data pruning techniques are equipped in this algorithm.Our proposed unbalanced threshold based distributed data collection scheme requires the fewest data transmission among these four schemes. By adopting unbalanced thresholds, it can adjust the query thresholds adaptively and avoid redundant transmissions between administrator sink and member sinks. Sometimes, all elements in the candidate setS can be obtained in advance in phase II instead of in phase III since reasonable thresholds are computed in the unbalanced threshold based distributed top-K query algorithm. The example illustrated in Section 3.2 has shown this property. Therefore, the interaction times of our proposed scheme are slightly less than that of the modified TPUT based DIHT scheme. The price for the decrease in the number of transmitted data and interaction times is only the computation of unbalanced thresholds, which can be ignored by comparing with the communication energy consumption in wireless sensor nodes.


## 5.1. Performance Analysis

Figures2, 3, and 4 show the SNR of reconstructed data, the number of transmitted data, and the number of computed data, respectively, at different data sampling rates. We can conclude that the data reconstruction performance improves with the increase on the data sampling rate. Meanwhile, the number of transmitted data and that of computed data increase too. The reason behind this rule lies in the fact that the increase on the data sampling rate would cause more data to be transmitted and computed. Therefore, the recovered sensed data will be more accurate.Figure 2
The SNR of reconstructed data at different data sampling rates.Figure 3
The number of transmitted data at different data sampling rates.Figure 4
The number of computed data at different data sampling rates.Figures5, 6, and 7 show the SNR of reconstructed data, the number of transmitted data, and the number of computed data, respectively, in different surveillance scenarios. The number of uncorrelated two-dimensional Gaussian data sources ranges from 2 to 4. We can conclude that the data reconstruction performance degrades with the increase on the number of uncorrelated data sources. Meanwhile, the number of transmitted data and that of computed data increase at the same time. The reason behind this rule lies in the fact that the increase on the number of uncorrelated data sources leads to the increase on the sparsity of sensed data within the network. Therefore, the data reconstruction performance degrades and more data are required to be transmitted and computed.Figure 5
The SNR of reconstructed data at different number of data sources.Figure 6
The number of transmitted data at different number of data sources.Figure 7
The number of computed data at different number of data sources.Figures8, 9, and 10 show the SNR of reconstructed data, the number of transmitted data, and the number of computed data, respectively, at different number of sinks. We can conclude that there are no remarkable differences among the data reconstruction performance with different number of sinks. However, the number of transmitted data and that of computed data increase with the increase of the number of sinks. The reason behind this rule lies in the fact that the increase on the number of sinks has no influence on the data reconstruction performance and only requires more data to be transmitted within the network and computed in the sinks.Figure 8
The SNR of reconstructed data at different number of sinks.Figure 9
The number of transmitted data at different number of sinks.Figure 10
The number of computed data at different number of sinks.


## 5.2. Performance Comparison

We will compare the performance of our proposed scheme with the original iterative hard thresholding algorithm [25], the modified thresholding algorithm base iterative hard thresholding scheme [38], and the modified three-phase uniform threshold based iterative hard thresholding scheme [39] in this subsection. Here, the last two schemes are referred to as the modified TA based DIHT scheme and the modified TPUT based DIHT scheme, respectively.Figure11 shows the comparison of the SNR of these four schemes when the data sampling rate is 50%, the number of data sources is 3, and the number of sinks is 5. We can conclude that there are no remarkable differences among the data reconstruction performance of these schemes. In other words, they can provide the similar data recovery accuracy regardless of the centralized or distributed reconstruction pattern.Figure 11
The SNR of reconstructed data of different schemes.Figures12 and 13 show the number of transmitted data and interaction times of these four schemes in the same experiment settings as in Figure 11. Since the iterative hard thresholding algorithm is a centralized data reconstruction algorithm, all data in the member sinks should be transmitted to the administrator sink for reconstruction and then the recovered data would be resent back to the member sinks for synchronization. Therefore, the number of transmitted data of the IHT algorithm is much higher than that of other three schemes although only one interaction is required.Figure 12
The number of transmitted data of different schemes.Figure 13
The iteration times of different schemes.The interaction times of the modified TA based DIHT scheme dominate that of other three algorithms since only one object-value pair is queried in each interaction during the top-K query process. Meanwhile, the number of transmitted data is relatively high since no efficient data pruning techniques are equipped in this algorithm.Our proposed unbalanced threshold based distributed data collection scheme requires the fewest data transmission among these four schemes. By adopting unbalanced thresholds, it can adjust the query thresholds adaptively and avoid redundant transmissions between administrator sink and member sinks. Sometimes, all elements in the candidate setS can be obtained in advance in phase II instead of in phase III since reasonable thresholds are computed in the unbalanced threshold based distributed top-K query algorithm. The example illustrated in Section 3.2 has shown this property. Therefore, the interaction times of our proposed scheme are slightly less than that of the modified TPUT based DIHT scheme. The price for the decrease in the number of transmitted data and interaction times is only the computation of unbalanced thresholds, which can be ignored by comparing with the communication energy consumption in wireless sensor nodes.


## 6. Conclusion

In this paper, we proposed the unbalanced threshold based distributed data collection scheme designed for multisink wireless sensor networks. All sinks can obtain the synchronized sensed data of the whole network through distributed sparse signal reconstruction. Meanwhile, we also designed a distributed top-K query algorithm to reduce the number of transmitted data between administrator sink and member sinks by pruning unnecessary elements exchanging.The data reconstruction accuracy, communication complexity, and computational complexity of the proposed scheme were analyzed in detail through experiments. Furthermore, we also compare the performance of the proposed scheme with existing centralized and distributed data collection schemes in wireless sensor networks. In the future, we would like to design efficient data collection schemes by utilizing the spatial and temporal correlations among sensed data simultaneously.



---

*Source: 8527312-2016-01-04.xml*