# Noisy Control About Discrete Liner Consensus Protocol

Quansheng Dou, Zhongzhi Shi, Yuehao Pan

► To cite this version:

Quansheng Dou, Zhongzhi Shi, Yuehao Pan. Noisy Control About Discrete Liner Consensus Protocol. 9th International Conference on Intelligent Information Processing (IIP), Nov 2016, Melbourne, VIC, Australia. pp.235-244, 10.1007/978-3-319-48390-0_24 . hal-01615001

HAL Id: hal-01615001

https://inria.hal.science/hal-01615001

Submitted on 11 Oct 2017

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>
Noisy Control about Discrete Linear Consensus Protocol

Quansheng Dou¹*, ZhongzhiShi², Yuehao Pan³

¹ School of Computer Science and Technology,
Shandong Institute of Business and Technology, Yantai, China

² Key Laboratory of Intelligent Information Processing,
Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China

³ Beijing 101 Middle School, Beijing, China

douqsh@sdibt.edu.cn
shizz@ics.ict.ac.cn
pan_yhao@yeah.net

**Abstract.** In recent years, more and more researchers in the control community have focused their attention on distributed coordination due to its broad applications in many fields, the consensus problem is well recognized as a fundamental problem in the cooperation control of multi-agent systems. In this paper, we discuss the noise problem of the discrete linear consensus protocol (DLCP) and point out that noise of DLCP is uncontrollable. A protocol using noise suppression function (NS-DLCP) to control the noise is put forward, the theorem about the reasonable range of the noise suppression function is vigorously proved, and sufficient conditions for noise controllable of NS-DLCP are further presented.

**Keywords:** Multi-agent system, Graph theory, Consensus protocol, Noisy control

# 1 Introduction

In recent years, more and more researchers in the control community have focused their attention on distributed coordination of multi-agent systems due to its broad applications in many fields such as sensor networks, e.g. UAV (Unmanned Air Vehicles), MRS (mobilerobots systems), robotic teams.

In the cooperative control, a key problem is to design distributed protocols such that group of agents can achieve consensus through local communications. So far, numerous interesting results for consensus problem have been obtained for both discrete-time and continuous-time multi-agent system in the past decade. Reynoldssystematically studied and simulated the behavior of biological group such as birds and fishes, and proposed Boidmodel[1]which still has a broad impact in the field of Swarm Intelligence. Vicsekmodel[2]is proposed based on statistical mechanics theory in which the movement rate of Agent on two-dimensional plane remains unchanged, and the N agents on the 2-D plane determine their motion direction according to the directions of their neighbor agents. One of the most promising tools are the linear consensus algorithms, which
aresimple distributed algorithms which require only minimal computation, communication and synchronization to compute averages of local quantities that reside in each device. These algorithms have their roots in the analysis of Markov chains [3] and have been deeply studied within the computer science community for load balancing and within the linear algebra community for the asynchronous solution of linear systems [4, 5]. For linear consensus problem, Olfati-Saber et al. established a relatively complete theoretical framework based on graph theory and kinetic theory, and systematically analyzed the different types of consistency issues based on the framework[6-9]. Based on the study of Olfati-Saber, Yu[10-12] et al. discussed three necessary and sufficient conditions for the algorithm to converge to a consistent state when the states of agents has nothing to do with the data transferred, and conducted a meaningful analysis of its correctness, effectiveness and efficiency with the verification in several specific applications. For multi-Agent consensus and synchronization problems of complex networks, Li et al. in their rather deep discussion proposed multi-Agent control architecture based on higher order linear system with a series of fruitful results [13-15]. In [16] average consensus issues are discussed, with the consensus algorithm formulated as matrix factorization problem, machine learning methods are proposed to solve matrix decomposition problem.

For most of consensus results in the literature, it is usually assumed that each agent can obtain its neighbor's information precisely. Since real networks are often in uncertain communication environments, it is necessary to consider consensus problems under measurement noises. Such consensus problems have been studied. Some research[17-19] have addressed the consensus problem of multi-agents system under multiplicative measurement noises, where the noises' intensities are considered proportional to the relative states. In [20,21] the authors studied consensus problems when there exist noisy measurements of the states of neighbors, and a stochastic approximation approach was applied to obtain mean square and almost sure convergence in models with fixed network topologies or with independent communications failures. Necessary and/or sufficient conditions for stochastic consensus of multi-agent systems were established for the case of fixed topology and time varying topologies in [22, 23]. Liu et al. studied signal delay of linear consensus protocol[24], and presented strong consensus and mean square consensus concept under the conditions of the fixed topology and the presence of noise and delay between agents, and gave theoretically necessary and sufficient conditions of strong consensus and mean square under Non_Leader_Follower and Leader_Follower modes. The distributed consensus problem for linear discrete-time multi-agent systems with delays and noises was investigated in [25] by introducing a novel technique to overcome the difficulties induced by the delays and noises. In[26], a novel kind of cluster consensus of multi-agents systems with several different subgroups was considered based on Markov chains and nonnegative matrix analysis.

In this paper, we discussed the noise problem of the linear consensus protocol, and gave a sufficient condition that ensure the noise of linear consensus protocol is controllable. The remainder of this paper is organized as follows. Some preliminaries and definitions are given in Section 2. In Section 3, we pointed out that noise of DLCP is uncontrollable. In Section 4, we proposed the strategy of using noise suppression function to
control noise, and put forward theorem1 about a reasonable range of noisesuppression function ; Section 5 is devoted to show the conclusions ofthis paper.

## 2 Preliminaries

Consider $n$ agents distributed according to a directed graph $\mathcal{G} = (\mathcal{V}, \mathcal{E})$ consisting of a set of nodes $\mathcal{V} = \{1,2,...,n\}$ and a set of edges $\mathcal{E} \in \mathcal{V} \times \mathcal{V}$ . In the digraph, an edge from node $i$ to node $j$ is denoted as an ordered pair $(i, j)$ where $i \neq j$ (so there is no edge between a node and itself). A path (from $i_1$ to $i_l$) consists of a sequence of nodes $i_1, i_2, ..., i_l, l \ge 2$, such that $(i_k, i_{k+1}) \in \mathcal{E}$ for $k = 1, ..., l-1$. We say node $i$ is connected to node $j$ $(i \neq j)$ if there exists a path from $i$ to $j$. For convenience of exposition, the two names, agent and node, will be used alternatively. The agent $A_k$ (resp., node $k$) is a neighbor of $A_i$ (resp., node $i$) if $(k, i) \in \mathcal{E}$ where $k \neq i$. Denote the neighbors of node $i$ by $\mathcal{N}_i = \{k | (k, i) \in \mathcal{E}\}$. For agent $A_i$, we denote its state at time $t$ by $x_i(t) \in \mathbb{R}$, where $t \in \mathbb{Z}_+$, $\mathbb{Z}_+ = \{0,1,2, ...\}$. For each $i \in \mathcal{V}$, agent $A_i$ receives information from its neighbors.

**Definition 1:** (Discrete Linear Consensus Protocol DLCP) The so-called linear consensus protocol is given by the following (1):

$$x_i(t+1) = x_i(t) + \sum_{j \in \mathcal{N}_i(t)} \alpha_{ij}(t) (x_j(t) - x_i(t)) \quad \forall i, j \in \mathcal{V} \quad (1)$$

Where $\alpha_{ij}(t) > 0$ is a real-valued function with variable $t$ and $\sum_{j=1}^{n} \alpha_{ij}(t) \le 1$, it is used to characterize the extent of the impact at time $t$ from agent $j$ to agent $i$.

**Definition 2:** (Weighted Laplacian Matrix) The matrix $\mathcal{L}(t) = [l_{ij}(t)]_{n \times n}$ is called weighted Laplacian matrix of graph $\mathcal{G}$, where

$$l_{ij}(t) = \begin{cases} -\alpha_{ij}(t) & \text{if } j \in \mathcal{N}_i \text{ and } i \neq j \\ \sum_{j=1}^{n} \alpha_{ij}(t) & \text{if } i = j \\ 0 & \text{otherwise} \end{cases}$$

let $\mathbf{X}(k) = [x_1(k),...,x_n(k)]^T$, $\mathcal{I}_n$ denote an $n$ order unit matrix, the matrix form of (1):

$$\mathbf{X}(t+1) = \mathcal{A}(t)\mathbf{X}(t) \quad (2)$$

where $\mathcal{A}(t) = \mathcal{I}_n - \mathcal{L}(t)$.

Suppose $r \sim N(\mu, \sigma^2)$ is a random number that satisfies the normal distribution, let $\text{var}(r)$ represent variance $\sigma^2$ of $r$, if $\mathbf{R} = [r_1,...,r_n]^T$ is a random vector, then $\text{var}(\mathbf{R})$
represent the covariance matrix of $\mathbf{R}$, $[\mathrm{var}(\mathbf{R})]_i$ denotes the variance of the ith components of $\mathbf{R}$, i.e $[\mathrm{var}(\mathbf{R})]_i = \mathrm{var}(r_i)$ is ith element of diagonal of matrix $\mathrm{var}(\mathbf{R})$.

If the received message of Agent i contains a mutually independent and normally distributed noise interference, (1) can be rewritten as:

$$x_i(t+1) = x_i(t) + \sum_{j \in \mathcal{N}_i(t)} \alpha_{ij}(t) ((x_j(t) + r_j(t)) - x_i(t)) \quad \forall i, j \in \mathcal{V} \quad (3)$$

where $r_j(t) \sim N(0, \sigma_j^2)$ is a random number and satisfies normal distribution, which represents the noise carried by the status information $x_j(t)$. Let $\mathbf{R}(t) = [r_1(t), \dots, r_n(t)]^T$, thus (3) can be rewritten in matrix form:

$$\mathbf{X}(t+1) = \mathcal{A}(t)\mathbf{X}(t) + \mathcal{W}(t)\mathbf{R}(t) \quad (4)$$

In the above equation, $\mathcal{W}(t) = -\mathcal{L}(t) - \mathrm{diag}(-\mathcal{L}(t))$, $\mathrm{diag}(-\mathcal{L}(t))$ is the diagonal matrix of $-\mathcal{L}(t)$, so we can further get:

$$\mathbf{X}(t+1) = \prod_{k=0}^{t} \mathcal{A}(k)\mathbf{X}(0) + \sum_{m=1}^{t} \left( \left( \prod_{j=t-m+1}^{t} \mathcal{A}(j) \right) \mathcal{W}(t-m)\mathbf{R}(t-m) \right) + \mathcal{W}(t)\mathbf{R}(t) \quad (5)$$

In order to facilitate the description, let $\left( \prod_{j=t-m+1}^{t} \mathcal{A}(j) \right) = \mathcal{I}_n$ when $m=0$, then (5) can be simplified as:

$$\mathbf{X}(t+1) = \prod_{k=0}^{t} \mathcal{A}(k)\mathbf{X}(0) + \sum_{m=0}^{t} \left( \left( \prod_{j=t-m+1}^{t} \mathcal{A}(j) \right) \mathcal{W}(t-m)\mathbf{R}(t-m) \right)$$

let $\mathcal{R}(t-m) = \mathcal{W}(t-m)\mathbf{R}(t-m)$, $\mathbf{Y}(t) = \sum_{m=0}^{t} \left( \prod_{j=t-m+1}^{t} \mathcal{A}(j) \mathcal{R}(t-m) \right)$, $\mathbf{B}(t) = \prod_{k=0}^{t} \mathcal{A}(k)\mathbf{X}(0)$ thus we get:

$$\mathbf{X}(t+1) = \mathbf{B}(t) + \mathbf{Y}(t) \quad (6)$$

Analyzing the random part $\mathbf{Y}(t)$ of (6), we can find out that it is a linear combination of several random vectors, therefore it is also a random vector satisfying normal distribution.

**Definition 3:** (Noise Controllable) Assuming consensus protocol can converge to a consistent state vectors $\mathbf{X}^* = [x^*, \dots, x^*]^T$ under the noise-free conditions, we call the
consensus protocol described in (6) is noise controllable, if and only if when $t \to \infty$, $\lim_{t \to \infty} \mathbf{B}(t)=\mathbf{X}^*$ for $\forall i, j \in \mathcal{V}$ and there is constant $M$ which will make $\lim_{t \to \infty}[\mathrm{var}(\mathbf{Y}(t))]_i \le M, i=1,...,n$.

### 3 Noise Uncontrollability of Discrete Linear Consistency Protocol

For any initial state $\mathbf{X}(0)$, assuming that the consistency protocol in (2) converge to a consistent state $\mathbf{X}^*$ associated with $\mathbf{X}(0)$, under this condition, we discuss the impact of the noise on the protocol.

**Lemma 1:** Suppose $\mathbf{Y}(t)$ is random part of consensus protocol (6), when $t \to \infty$, $\lim_{t \to \infty}[\mathrm{var}(\mathbf{Y}(t))]_i = \infty$ for any initial state $\mathbf{X}(0), i=1,...,n$.

**Proof:** let $y(t,m) = \prod_{j=t-m+1}^{t} \mathcal{A}(j)\mathcal{R}(t-m)$, then $\mathbf{Y}(t) = \sum_{m=0}^{t} (y(t,m))$ we have:

$$ \begin{aligned} \mathrm{var}(y(t,m)) &= \mathcal{A}(t-m+1)\mathrm{var}\left(\prod_{j=t-m+2}^{t} \mathcal{A}(j)\mathcal{R}(t-m)\right)\mathcal{A}(t-m+1)^T \\ &= \mathcal{A}(t)\dots\mathcal{A}(t-m+1)\mathrm{var}(\mathcal{R}(t-m))\mathcal{A}(t-m+1)^T\dots\mathcal{A}(t)^T \end{aligned} $$

where $\mathrm{var}(\mathcal{R}(t-m)) = \mathcal{W}(t-m)\mathrm{var}(\mathbf{R}(t-m))\mathcal{W}(t-m)^T$, $m=1,...,t$. It is known that when there is no noise, and $t \to \infty$, $\prod_{k=0}^{t} \mathcal{A}(k)\mathbf{X}(0)$ converges, for a determined constant $m$, there always is:

$$ \begin{aligned} \lim_{t \to \infty} \mathrm{var}(y(t,m)) &= \lim_{t \to \infty} \mathcal{A}(t)\dots\mathcal{A}(t-m+1)\mathrm{var}(\mathcal{R}(t-m))\mathcal{A}(t-m+1)^T\dots\mathcal{A}(t)^T \\ &= \lim_{t \to \infty} (\mathbf{V}_1(m), \mathbf{V}_2(m),\dots, \mathbf{V}_n(m))\mathcal{A}(t-m+1)^T\dots\mathcal{A}(t)^T \\ &= \lim_{t \to \infty} \left( \mathcal{A}(t)\dots\mathcal{A}(t-m+1)(\mathbf{V}_1(m), \mathbf{V}_2(m),\dots, \mathbf{V}_n(m))^T \right)^T = (\zeta(m))_{n \times n} \end{aligned} $$

Where, $\mathbf{V}_i(m) = (v_i^1, ..., v_i^T)$ is a constant vector related to $m$, $(\zeta(m))_{n \times n}$ is a constant matrix, and $\zeta(m) > 0$. So that:

$$ \lim_{t \to \infty} [\mathrm{var}(\mathbf{Y}(t))]_i = \lim_{t \to \infty} \left[ \mathrm{var}\left(\sum_{m=0}^{t} (y(t,m))\right) \right]_i = \lim_{t \to \infty} \sum_{m=0}^{t} [\mathrm{var}(y(t,m))]_i = \infty $$

□
In fact, when $t \to \infty$, $\mathbf{B}(t) = \prod_{k=0}^{t} \mathcal{A}(k)\mathbf{X}(0)$ will eventually reach a consistent state. Similarly, for a specific constant $m$, $\text{var}(y(t,m))$ will eventually tend to a stable constant when $t \to \infty$, and $\text{var}(\mathbf{Y}(t))$ just is the infinite series accumulated by $\text{var}(y(t,m))$. So it will not converge, i.e. the consensus protocol (6) is noise uncontrollable.

# 4 Noise Suppression Discrete Linear Consensus Protocol(NS-DLCP)

We reconstruct the state transition matrix $\mathcal{A}(t)$, let $\mathcal{L}_e(t) = \varepsilon(t)\mathcal{L}(t)$, where $\varepsilon(t): \mathbb{R}_+ \to \mathbb{R}_+$ is a function whose independent variable is $t$, $\varepsilon(t) > 0$ and when $t \to \infty$, $\varepsilon(t) \to 0$, we call $\varepsilon(t)$ as noise suppression function, Let $\mathcal{A}_e(t) = \mathcal{I}_n - \varepsilon(t)\mathcal{L}(t)$, replace $\mathcal{A}(t)$ in (2) with $\mathcal{A}_e(t)$, we get:

$$ \mathbf{X}(t+1) = \mathcal{A}_e(t)\mathbf{X}(t) \qquad (7) $$

Here we call (7) as Noise Suppression Consensus Protocol(NS-CP), then we rewrite (7) as the relation between $X(t+1)$ and the initial state $X(0)$, and consider the noise carried by Agent, then (7) is rewritten as:

$$ \mathbf{X}(t+1) = \prod_{k=0}^{t} \mathcal{A}_e(k)\mathbf{X}(0) + \sum_{m=0}^{t} \left( \left( \prod_{j=t-m+1}^{t} \mathcal{A}_e(j) \right) \mathcal{W}_e(t-m)\mathbf{R}(t-m) \right) \quad (8) $$

Similarly, let $\mathcal{R}_e(t-m) = \mathcal{W}_e(t-m)\mathbf{R}(t-m)$, $\mathbf{Y}_e(t) = \sum_{m=0}^{t} \left( \prod_{j=t-m+1}^{t} \mathcal{A}_e(j)\mathcal{R}_e(t-m) \right)$, $\mathbf{B}_e(t) = \prod_{k=0}^{t} \mathcal{A}_e(k)\mathbf{X}(0)$ then (8) is simplified as:

$$ \mathbf{X}(t+1) = \mathbf{B}_e(t) + \mathbf{Y}_e(t) \qquad (9) $$

**Lemma2:** Suppose consensus protocol (2) can converge to a consistent state $\mathbf{X}^*$ under the noise-free conditions, if noise suppression function $\varepsilon(t)$ is the low-order infinitesimal of $t^{-1}$, then $\lim_{t \to \infty} \mathbf{B}_e(t) = \mathbf{X}^*$.

**Proof:** Study formula (10), we have $\mathbf{X}(t+1) = \mathbf{B}_e(t)$ in the case without noise, from the conclusion in [11] we know that $\|\mathbf{X}(t+1) - \mathbf{X}^*\| \le \mu_{\varepsilon2}(t)\|\mathbf{X}(t) - \mathbf{X}^*\|$ for any determined $t$, where $\mu_{\varepsilon2}(t)$ is the second largest eigenvalues of matrix
$\frac{1}{2}(\mathcal{A}_\varepsilon(t) + \mathcal{A}_\varepsilon(t)^T)$, let $\lambda_2(t)$ be the second smallest eigenvalues of $\frac{1}{2}(\mathcal{L}(t) + \mathcal{L}(t)^T)$,
obviously, $\mu_{\varepsilon 2}(t) = 1 - \varepsilon(t)\lambda_2(t)$, thus:

$$ \|\mathbf{B}_\varepsilon(t) - \mathbf{X}^*\| \le \prod_{k=1}^{t} (1 - \varepsilon(k)\lambda_2(k)) \|\mathbf{X}(0) - \mathbf{X}^*\| \quad (10) $$

Let $\lambda_2^*$ be the smallest one in the second smallest eigenvalues of $\frac{1}{2}(\mathcal{L}(t) + \mathcal{L}(t)^T)$, according to the known conditions that $O(\varepsilon(t)) < O(t^{-1})$, then we can deduce that $\lim_{t \to \infty} (1 - \varepsilon(t)\lambda_2^*)^t = 0$, and because $\varepsilon(k) > 0$, thus for $\forall t$, $0 \le \prod_{k=1}^{t} (1 - \varepsilon(k)\lambda_2(k)) \le (1 - \varepsilon(t)\lambda_2^*)^t$, when $t \to \infty$, from squeeze theorem we can obtain: $\lim_{t \to \infty} \prod_{k=1}^{t} (1 - \varepsilon(k)\lambda_2(k)) = 0$, that means:

$$ 0 \le \lim_{t \to \infty} \|\mathbf{B}_\varepsilon(t) - \mathbf{X}^*\| \le \lim_{t \to \infty} \prod_{k=1}^{t} (1 - \varepsilon(k)\lambda_2(k)) \|\mathbf{X}(0) - \mathbf{X}^*\| = 0 $$

Then we have $\lim_{t \to \infty} \|\mathbf{B}_\varepsilon(t) - \mathbf{X}^*\| = 0$, i.e. $\lim_{t \to \infty} \mathbf{B}_\varepsilon(t) = \mathbf{X}^*$.

**Lemma3:** Suppose consensus protocol (2) can converge to a consistent state $\mathbf{X}^*$ under the noise-free conditions, if noise suppression function $\varepsilon(t)$ is the high-order infinitesimal of $t^{-0.5}$, then there is constant $M$ which make $\lim_{t \to \infty} [\mathrm{var}(\mathbf{Y}_\varepsilon(t))]_i \le M$.

**Proof:** let $\|\cdot\|_\infty$ to represent the row sum norm of the matrix, and investigate the row sum norm of the variance matrix of $\mathcal{R}_\varepsilon(t-m)$, then:

$$ \begin{aligned} \|\mathrm{var}(\mathcal{R}_\varepsilon(t-m))\|_{\infty} &= \|\mathcal{W}_\varepsilon(t-m)\mathrm{var}(\mathbf{R}(t-m))\mathcal{W}_\varepsilon(t-m)^T\|_{\infty} \\ &= \varepsilon^2(t-m) \|\mathcal{W}(t-m)\mathrm{var}(\mathbf{R}(t-m))\mathcal{W}(t-m)^T\|_{\infty} \\ &\le \varepsilon^2(t-m) \|\mathcal{W}(t-m)\|_{\infty} \|\mathrm{var}(\mathbf{R}(t-m))\|_{\infty} \|\mathcal{W}(t-m)^T\|_{\infty} \\ &\le \varepsilon^2(t-m) \|\mathrm{var}(\mathbf{R}(t-m))\|_{\infty} \end{aligned} $$

let $y_\varepsilon(t,m) = \prod_{j=t-m+1}^{t} \mathcal{A}_\varepsilon(j) \mathcal{R}_\varepsilon(t-m)$, then $\mathbf{Y}_\varepsilon(t) = \sum_{m=0}^{t} (y_\varepsilon(t,m))$. Study the norm of the variance matrix of $y_\varepsilon(t,m)$, we have:

$$ \begin{aligned} \|\mathrm{var}(y_\varepsilon(t,m))\|_{\infty} &= \|\mathcal{A}_\varepsilon(t) \cdots \mathcal{A}_\varepsilon(t-m+1) \mathrm{var}(\mathcal{R}_\varepsilon(t-m)) \mathcal{A}_\varepsilon(t-m+1)^T \cdots \mathcal{A}_\varepsilon(t)^T\|_{\infty} \\ &\le \|\mathcal{A}_\varepsilon(t)\|_{\infty} \cdots \|\mathcal{A}_\varepsilon(t-m+1)\|_{\infty} \|\mathrm{var}(\mathcal{R}_\varepsilon(t-m))\|_{\infty} \|\mathcal{A}_\varepsilon(t-m+1)^T\|_{\infty} \cdots \|\mathcal{A}_\varepsilon(t-m+1)^T\|_{\infty} \end{aligned} $$
$$ \leq \|\mathrm{var}(\mathcal{R}_{\varepsilon}(t-m))\|_{\infty} \leq \varepsilon^2(t-m)\|\mathrm{var}(\mathbf{R}(t-m))\|_{\infty} $$

In fact, $[\mathrm{var}(y_{\varepsilon}(t,m))]_i$ is exactly the $i$th element of the diagonal of the variance matrix $\mathrm{var}(y_{\varepsilon}(t,m))$, denote $\rho = \max([\mathrm{var}(y_{\varepsilon}(t,m))]_i)$, obviously $[\mathrm{var}(y_{\varepsilon}(t,m))]_i \leq \varepsilon^2(t-m)\rho$, then

$$ [\mathrm{var}(\mathbf{Y}_{\varepsilon}(t))]_i = \sum_{m=0}^{t} [\mathrm{var}(y_{\varepsilon}(t,m))]_i \leq \rho(\varepsilon^2(t) + \dots + \varepsilon^2(0)) = \rho \sum_{m=0}^{t} \varepsilon^2(m) $$

According to the condition that $O(\varepsilon(t)) > O(t^{-0.5})$, therefore series $\rho \sum_{m=0}^{t} \varepsilon^2(m)$ will converge when $t \to \infty$, let $\lim_{t \to \infty} \rho \sum_{m=0}^{t} \varepsilon^2(m) = M$, we can obtain: $\lim_{t \to \infty} [\mathrm{var}(\mathbf{Y}_{\varepsilon}(t))]_i \leq M$

<figure><img src="image_2.png" /></figure>

From Lemma 2-3, it is easy to get:

**Theorem 1:** Suppose consensus protocol (2) can converge to a consistent state $\mathbf{X}^*$ under the noise-free conditions, if order of $\varepsilon(t)$ satisfies $O(t^{-0.5}) < O(\varepsilon(t)) < O(t^{-1})$ then NS-SDLC (9) is noise controllable.

# 5 Conclusion

Bases on the above theoretical results and discussion, table 1 summarized the main conclusions of this paper.

<table><caption>**Table 1.** Main conclusions of this paper</caption><thead><tr><th rowspan="2">No.</th><th rowspan="2">ε(t)</th><th colspan="3">t→∞,i=1,...,n</th></tr><tr><th>limB<sub>ε</sub>(t)</th><th>lim[var(\mathbf{Y}<sub>ε</sub>(t))]<sub>i</sub></th><th>The final state x<sub>i</sub> of Agent i</th></tr></thead><tbody><tr><td>Case.1</td><td>ε(t)=1</td><td>X<sup>*</sup></td><td>∞</td><td>Diverge(Noise uncontrollable)</td></tr><tr><td>Case.2</td><td>O(ε(t))≤O(t<sup>0.5</sup>)</td><td>X<sup>*</sup></td><td>∞</td><td>Diverge(Noise uncontrollable)</td></tr><tr><td>Case.3</td><td>O(t<sup>0.5</sup>)<O(ε(t))<O(t<sup>1</sup>)</td><td>X<sup>*</sup></td><td>Bounded</td><td>Normal distribution with center x<sup>*</sup>(Noise controllable)</td></tr><tr><td>Case.4</td><td>O(ε(t))≥O(t<sup>1</sup>)</td><td>Unconsistent state vectors X<sup>^</sup></td><td>Bounded</td><td>Normal distribution with center x<sup>^</sup>(Noise uncontrollable)</td></tr></tbody></table>

Our main conclusions are:

I. if $ε(t)=1$ (Equivalent to $ε(t)$ is useless) or $O(ε(t))≤O(t-0.5)$, the determined part $\mathbf{B}ε(t)$ of linear consensus protocol (9) can converge to consistent state vectors $\mathbf{X}^*$, but
the variance of its random part $\mathbf{Y}_\varepsilon(t)$ is unbounded. In this case, linear consensus protocol is noise uncontrollable.

II. When $O(\varepsilon(t))\ge O(t-1)$, the variance of its random part $\mathbf{Y}_\varepsilon(t)$ is bounded, but the determined part $\mathbf{B}_\varepsilon(t)$ of linear consensus protocol can't converge to consistent state vectors $\mathbf{X}^*$, under this circumstances, linear consensus protocol is also noise uncontrollable.

III. If $O(t-0.5)<O(\varepsilon(t))<O(t-1)$, $\mathbf{B}_\varepsilon(t)$ will converge to consistent state vectors $\mathbf{X}^*$ and the variance of $\mathbf{Y}_\varepsilon(t)$ is bounded, so linear consensus protocol is noise controllable. At this time, every Agent's state will be a normal distribution with center $\mathbf{x}^*$.

**Acknowledgments.** This work was partially supported by the National Natural Science Foundation of China (No.61272244,61175053,61173173,61035003,61202212), National Key Basic Research Program of China (No. 2013CB329502)

## References

1. Reynolds C W. Flocks, herds, and schools: a distributed behavioral model. In: Proceedings of the 14th Annual Conference on Computer Graphics and Interactive Techniques. New York, USA: ACM, 1987. 25-34ic

2. Vicsek T, Czirok A, Ben-Jacob E, et al. Novel type of phase transition in a system of self-driven particles. Physical Review Letters, 1995, 75(6):1226-1229.

3. E. Seneta. Non-negative Matrices and Markov Chains. John Wiley & Sons, Inc., Springer, 2006.

4. Andreas Frommer and Daniel B. Szyld. On asynchronous iterations. Journal of Computation and Applied Mathematics, 123:201-216, 2000.

5. John C. Strikwerda. A probabilistic analysis of asynchronous iteration. Journal of Linear Algebra and its Applications, 349:125-154, 2002.

6. Olfati-Saber R, Fax J A, Murray R M. Consensus and cooperation in networked multi-agent systems. Proceedings of IEEE, 2007, 95(1): 215-233

7. R. Olfati-Saber. Evolutionary Dynamics of Behavior in Social Networks. Proc. of the 46th IEEE Conference on Decision and Control, December 12-14, 2007 at the Hilton New Orleans Riverside in New Orleans, Louisiana USA.

8. R. Olfati-Saber and P. Jalalkamali. Coupled Distributed Estimation and Control for Mobile Sensor Networks. IEEE Trans. on Automatic Control, vol. 57(9), Sep. 2012.pp.2609-2614.

9. Olfati-Saber R. Flocking for multi-agent dynamic systems: algorithms and theory. IEEE Transactions on Automatic Control, 2006, 51(3): 401-420.

10. Chih-Han Yu and Radhika Nagpal. A Self-Adaptive Framework for Modular Robots in Dynamic Environment: Theory and Applications. The International Journal of Robotics Research, July 2011; vol. 30, 8: pp. 1015-1036.

11. Chih-Han Yu. Biologically-Inspired Control for Self-Adaptive Multiagent Systems. Doctoral Thesis, Harvard University, 2010.

12. Chih-Han Yu, Radhika Nagpal. Biologically-Inspired Control for Multi-Agent Self-Adaptive Tasks. Proc. Of the 24th AAAI Conference on Artificial Intelligence pp.1702-1709 July 11-15, 2010, Atlanta.

13. Li Z K, Duan Z S, Chen G R, Huang L. Consensus of multi-agent systems and synchronization of complex networks: a unified viewpoint. IEEE Transactions on Circuits and Systems I: Regular Papers, 2010, 57(1): 213-224.
14. Z Li, Z Duan, G Chen. Dynamic consensus of linear multi-agent systems. Control Theory & Applications, 2011, IET 5 (1), 19-28.

15. Z Li, X Liu, W Ren, L Xie. Distributed tracking control for linear multiagent systems with a leader of bounded unknown input. Automatic Control, IEEE Transactions on 2013.58 (2), 518-523.

16. Thi Minh Dung Tran, Alain Y. Kibangou. Distributed Design of Finite-time Average Consensus Protocols. 4rd IFAC Workshop on Distributed Estimation and Control in Networked Systems. Vol.4.pp.227-233. Sep, 2013 Rhine Moselle Hall, Koblenz, Germany.

17. Y.H. Ni and X. Li. Consensus seeking in multi-agent systems with multiplicative measurement noises. Systems and Control Letters, vol. 62, no. 5, pp. 430-437, 2013.

18. S. Djaidja and Q. H. Wu. Leaderless consensus seeking in multi-agent systems under multiplicative measurement noises and switching topologies. in Proceedings of the 33rd Chinese Control Conference, Nanjing, China, July 2014.

19. S. Djaidja and Q. H. Wu. Leader-following consensus for single-integrator/multi-agent systems with multiplicative noises in directed topologies. International Journal of Systems Science, 2014.

20. M. Huang and J. H. Manton. Coordination and consensus of networked agents with noisy measurements: stochastic algorithms and asymptotic behavior. SIAM Journal on Control and Optimization, vol.48, no. 1, pp. 134-161, 2009.

21. M. Huang and J. H. Manton. Stochastic consensus seeking with noisy and directed inter-agent communication: fixed and randomly varying topologies. Institute of Electrical and Electronics Engineers. Transactions on Automatic Control, vol. 55, no. 1, pp. 235-241, 2010.

22. T. Li and J.-F. Zhang. Mean square average-consensus under measurement noises and fixed topologies: necessary and sufficient conditions. Automatica, vol. 45, no. 8, pp. 1929-1936, 2009.

23. T. Li and J.-F. Zhang. Consensus conditions of multi-agent systems with time-varying topologies and stochastic communication noises. Institute of Electrical and Electronics Engineers. Transactions on Automatic Control, vol. 55, no. 9, pp. 2043-2057, 2010.

24. G Wen, Z Duan, Z Li, G Chen. Flocking of multi-agent dynamical systems with intermittent nonlinear velocity measurements. International Journal of Robust and Nonlinear Control 2012.22 (16), 1790-1805.

25. S. Liu, L. Xie, and H. Zhang. Distributed consensus for multi-agent systems with delays and noises in transmission channels. Automatica, vol. 47, no. 5, pp. 920-934, 2011.

26. Y. Chen, J. Liu, F. Han, and X. Yu. On the cluster consensus of discrete-time multi-agent systems. Systems & Control Letters, vol. 60, no. 7, pp. 517-523, 2011.