 Research
 Open Access
Consensus for wireless sensor networks with Markovian switching topology and stochastic communication noises
 Wuneng Zhou^{1}Email author,
 Chuan Ji^{1}Email author,
 Jinping Mou^{1},
 Anding Dai^{1} and
 Jian’an Fang^{1}
https://doi.org/10.1186/168718472013346
© Zhou et al.; licensee Springer. 2013
 Received: 6 June 2013
 Accepted: 5 November 2013
 Published: 29 November 2013
Abstract
In this paper, we consider the problem of average consensus for wireless sensor networks (WSNs). By applying the Lyapunov function and the Mmatrix approach, several sufficient conditions to ensure the average consensus in p th moment for WSNs with Markovian switching topology are derived. Also we study the stochastic average consensus in the large for WSNs with Markovian switching topology, whose transition jump rates matrix is not precisely known. We finally show the numerical simulations to illustrate the effectiveness of the results derived in this paper.
Keywords
 wireless sensor networks
 consensus in p th moment
 Markovian switching topology
 stochastic communication noises
 stochastic average consensus in the large
1 Introduction
With the increasing development of microelectronics, wireless communication and computing, wireless sensor networks (WSNs) have been more widely used in such areas as robotics, surveillance, environment monitoring, information collection, and so on.
From a networktheoretic perspective, a WSN can be looked upon as a multiagent system (MAS) with each node representing a sensor and each edge performing information exchange between sensors. In some cases, the agreement is a common value which may be the average of the initial states of the system, and which is often called average consensus and has wide application background in the areas such as formation control [1], distributed filtering [2] and distributed computation [3]. It means to achieve the accordance of the states of MAS. In [4], the authors considered the average consensus control for the directed and undirected networks with fixed and switching topologies. In [5], the authors extended the results of [4] to the discretetime models and weakened the condition of instantaneous strong connectivity. In [6], the authors considered the distributed averaging consensus of the networks with fixed and undirected topologies.
In the real communication surroundings, the topology of the WSN will change among some modes along with the time. Due to the limited energy, the sensor nodes often switch the states between sleep and awake to save energy. So we make use of Markov switching topology to describe this situation. Zhang [7] designed a distributed consensus protocol to analyze the multiagent systems in uncertain communication environments including the communication noises and Markov topology switches. The asymptotic unbiased mean square average consensus and asymptotic unbiased almost sure average consensus were obtained. Also they considered the effect of agent dependent gain functions on the consensus of multiagent systems. Zhou et al. [8] studied the problem of the mode and delaydependent adaptive exponential synchronization in p th moment for stochastic delayed neural networks with Markovian switching. By applying a novel nonnegative function and the Mmatrix approach, several sufficient conditions to ensure the mode and delay dependent adaptive exponential synchronization in p th moment for stochastic delayed neural networks were derived. Zhou et al. [9] considered the problem of target synchronization for the WSNs with multiple timevarying delays, Markov switching topology and the stochastic disturbance. The communication topology graphs they studied in this paper were undirected.
In real networked control systems, the packet dropouts and channel delays usually arise in the communication among the sensor nodes. The situations can be modeled by the Markov chain with the assumption of completely known or incompletely known transition probabilities. Therefore, from control perspectives, it is important and necessary to discuss the systems with partly unknown transition probabilities. Zhang and Boukas [10] studied the stability and stabilization problems of a class of continuoustime and discretetime Markovian jump linear systems with partly unknown transition probabilities. Zhang and Lam [11] considered the Markov jump linear system with incomplete transition descriptions and got the necessary and sufficient criteria in both continuoustime domain and discretetime cases. Zhu et al. [12] discussed the asymptotic stability of nonlinear stochastic differential equations with Markovian switching. The transition jump rates matrix Γ is not precisely known for the equations.
Moreover, to study the average consensus for the WSNs with Markovian switching topology and stochastic noises, we take advantage of the p th moment exponential stability theory [13] which is widely applied to the system stability analysis [14–16]. Specially, the case $p=2$ is the mean square exponential stability which is frequently used in different research works such as [17–19]. In [19], the authors showed that a necessary and sufficient condition for asymptotically unbiased mean square average consensus is that the consensus gains satisfy the step rule similar to that of classical stochastic approximation.
Next, we introduce our main contributions. To the best of our knowledge, the method combining the Lyapunov function and the Mmatrix is rarely used in the researching area of the average consensus in p th moment for WSNs with Markovian switching topology and stochastic noises. Also, the stochastic average consensus in the large for WSNs with Markovian switching topology, whose transition jump rates matrix is not precisely known, is rarely discussed. The present paper considers the consensus in p th moment for WSNs with Markovian switching topology and stochastic noises in communication. Making use of the p th moment exponential stability theory, we propose a sufficient condition of the p th moment exponential consensus for the WSNs. Different from [9], the communication topology graphs discussed are directed. We also consider the stochastic average consensus in the large for the WSN, whose transition jump rates matrix Γ is not precisely known.
The remainder of the paper is organized as follows. In Section 2, some concepts in graph theory are described, and the problem to be investigated is formulated. In Section 3, the main results are presented. In Section 4, two numerical examples show the reliability of the main results. In Section 5, some conclusions are given.
The following notations will be used throughout this paper : $x$ represents the Euclidean norm of a vector x in ${\mathbb{R}}^{n}$, $A:=\sqrt{trace({A}^{T}A)}$, i.e., the trace norm of a matrix A. ‘T’ represents the transpose of a matrix or a vector, I is an $n\times n$ dimensional identity matrix, ${1}_{n}$ is an ndimensional column vector with all ones, $\mathbb{E}$ stands for the mathematical expectation operator. If A is a matrix, ${\lambda}_{min}(A)$ and ${\lambda}_{max}(A)$ denote the smallest and largest eigenvalues of A, respectively.
2 Problem formulation and preliminaries
2.1 Concepts in graph theory
Let $\mathcal{G}=\{\mathcal{V},\mathcal{E},\mathcal{A}\}$ be a weighted digraph, where $\mathcal{V}=\{1,2,\dots ,n\}$ is the set of nodes, node i represents the i th sensor node, ℰ is the set of edges, and an edge in $\mathcal{G}$ is denoted by an ordered pair $(j,i)$. $(j,i)\in \mathcal{E}$ if and only if the j th sensor node can send information to the i th sensor node directly. The neighborhood of the i th sensor node is denoted by ${N}_{i}=\{j\in \mathcal{V}(j,i)\in \mathcal{E}\}$.
$\mathcal{A}=[{a}_{ij}]\in {\mathbb{R}}^{n\times n}$ is called the weighted adjacency matrix of $\mathcal{G}$. For any $i,j\in V$, ${a}_{ij}\ge 0$, and ${a}_{ij}>0\iff j\in {N}_{i}$. ${deg}_{in}(i)={\sum}_{j=1}^{n}{a}_{ij}$ is called the indegree of i; ${deg}_{out}(i)={\sum}_{j=1}^{n}{a}_{ij}$ is called the outdegree of i; $\mathcal{L}=\mathcal{D}\mathcal{A}$ is called the Laplacian matrix of $\mathcal{G}$, where $\mathcal{D}=diag({deg}_{in}(1),\dots ,{deg}_{in}(n))$.
2.2 Average consensus for WSNs
where ${x}_{i}(t)\in \mathbb{R}$ is the state of the i th sensor, and ${u}_{i}(t)\in \mathbb{R}$ is the control input. The initial state ${x}_{i}(0)$ is deterministic.
where ${y}_{ji}(t)$ denotes the measurement of the j th sensor’s state ${x}_{j}(t)$ by the i th sensors, $\{{\omega}_{ji}(t)i,j=1,2,\dots ,n\}$ are the communication noises, ${\sigma}_{ji}({x}_{i}(t),t)$ is the noise intensity function.
Denote $X(t)={({x}_{1}(t),{x}_{2}(t),\dots ,{x}_{n}(t))}^{T}$, $(\mathcal{G},X)$ is called a dynamic network.
where $L(t)$ is the Laplacian matrix of $\mathcal{G}$, $G(X(t),t)$ is the noise intensity matrix, $W(t)={({W}_{1}(t),\dots ,{W}_{n}(t))}^{T}$ is an ndimensional Brownian motion.
In WSNs, each sensor node communicates with other sensor nodes through the unreliable networks. If the communication channel between sensors i and j is $(j,i)\in {\mathcal{E}}_{f}$, ${\mathcal{E}}_{f}$ is the set of the communication channel which probably lost the signal, then the timevarying topologies under link failure or creation can be described by Markov switching topology.
and $r(0)={r}_{0}$.
We denote the directed communication graph by $\mathcal{G}=\{\mathcal{G}(1),\mathcal{G}(2),\dots ,\mathcal{G}(N)\}$, where $\mathcal{G}(k)=\{\mathcal{V},{\mathcal{E}}_{\mathcal{G}(k)},{\mathcal{A}}_{\mathcal{G}(k)}\}$ is the weighted digraph. Denote the topology graph as ${\mathcal{G}}_{t}$ at moment t ($t\ge 0$), so $r(t)=k$ if and only if ${\mathcal{G}}_{t}=\mathcal{G}(k)$.
where $\delta (t)=X(t)JX(t)$, $J=\frac{1}{n}{1}_{n}{1}_{n}^{T}$.
Definition 1 Dynamic system (6) is said to be average consensus in p th moment if error system (7) satisfies that ${lim\hspace{0.17em}sup}_{t\to \mathrm{\infty}}E\delta (t){}^{p}=0$. If $p=2$, we called it reach meansquare average consensus.

(A1) $\mathcal{G}$ is a balanced digraph;

(A2) The union of $\{\mathcal{G}(i)i\in S\}$ contains a spanning tree.

(A3) There exists a positive constant H such that the noise intensity matrix $g(\cdot ,\cdot ,\cdot )$ satisfies$trace({g}^{T}(\delta ,t,i)g(\delta ,t,i))\le H\delta (t){}^{2}.$
To this end, we introduce some concepts and lemmas which will be used in the proofs of our main results.
on $t\in [0,\mathrm{\infty})$ with the initial data $x({t}_{0})={x}_{0}\in {L}_{{\mathcal{L}}_{0}}^{p}(\mathrm{\Omega};{R}^{n})$ and $r({t}_{0})={r}_{0}$.
Lemma 1 [13]
Lemma 2 [20]
where $\tilde{q}=max\{{\gamma}_{ij}:i,j\in S\}$, $\overline{q}=max\{{\gamma}_{ii}:i\in S\}$.
Definition 3 [21]
A square matrix $M={({m}_{ij})}_{n\times n}$ is called a nonsingular Mmatrix if M can be expressed in the form of $M=s{I}_{n}G$ with some $G\ge 0$ (i.e., each element of G is nonnegative) and $s>\rho (G)$, where $\rho (G)$ is the spectral radius of G.
Lemma 3 [13]
 (1)
M is a nonsingular Mmatrix;
 (2)
Every real eigenvalue of M is positive;
 (3)
M is positive stable. That is, ${M}^{1}$ exists and ${M}^{1}>0$ (i.e., ${M}^{1}\ge 0$ and at least one element of ${M}^{1}$ is positive).
Lemma 4 [13] (Young inequality)
Lemma 5 [13] (Gronwall inequality)
3 Main results
In this section, we give criteria of average consensus for system (6).
3.1 Average consensus in p th moment for the WSNs
for all $t\ge 0$. $i\in S$ and $\delta \in {R}^{n}$. Then (7) is exponential stable in pth moment.
Thus (7) is exponential stable in p th moment. This completes the proof. □
Now we give a criterion of average consensus in p th moment for system (6).
for all $(\delta ,t)\in {R}^{n}\times {R}_{+}$, where $p\ge 2$.
where $\overrightarrow{1}={(1,\dots ,1)}^{T}$. Then system (6) reaches average consensus in p th moment.
where $\alpha \in {R}^{+}$ and ${\beta}_{i}=\frac{p1}{2}(IJ){}^{2}H{\lambda}_{min}({L}_{i})$.
Clearly, V obeys Theorem 1 with ${c}_{1}={min}_{i\in S}{q}_{i}$ and ${c}_{2}={max}_{i\in S}{q}_{i}$, and ${c}_{1}\delta {}^{p}\le V(\delta ,t,i)\le {c}_{2}\delta {}^{p}$.
So system (6) reaches the average consensus in p th moment. This completes the proof. □
Remark 1 In Theorem 2, we can easily check the condition obtained by using the new method if the dynamic system is given and the positive constant m is well chosen. To the best of our knowledge, the method combining the Lyapunov function and the Mmatrix in this paper is rarely used in the researching area of the average consensus in p th moment for WSNs with Markovian switching topology and stochastic noises.
Following Theorem 2, system (6) reaches consensus in pth moment.
3.2 The stochastic average consensus in the large for the WSNs under Γ is not precisely known
In the real communication networks, the part of the elements in the desired transition probabilities matrix are difficult to obtain. Therefore, it is important and necessary, from control perspectives, to further study the WSNs with partly unknown transition probabilities.
Consequently, in this part, we consider stochastic average consensus in the large for the system, even though the transition jump rates matrix $\mathrm{\Gamma}={({\gamma}_{ij})}_{N\times N}$ is not precisely known.
 (i)${\alpha}_{1}\delta (t){}^{2}\le V(\delta ,i)\le {\alpha}_{2}\delta (t){}^{2},\phantom{\rule{1em}{0ex}}\mathrm{\forall}i\in S;$(20)
 (ii)$2{\delta}^{T}{P}_{i}f(\delta ,i)+trace({g}^{T}(\delta ,i){P}_{i}g(\delta ,i))\le \lambda \delta {}^{2};$(21)
 (iii)$V(\delta ,i)\le \frac{{\alpha}_{2}}{{\alpha}_{1}}V(\delta ,j),\phantom{\rule{1em}{0ex}}\mathrm{\forall}i,j\in S;$(22)
 (iv)$1<\frac{{\alpha}_{2}}{{\alpha}_{1}}<\frac{\lambda +\tilde{q}}{\overline{q}},$(23)
then the system reaches stochastic average consensus in the large.
Let ${\lambda}_{i}=(2{\lambda}_{min}({L}_{i})+H){\lambda}_{max}({P}_{i})$ and $\lambda =min\{{\lambda}_{i}:i\in S\}$, we have $\tilde{\mathcal{L}}V(\delta ,i)<{\lambda}_{i}V(\delta ,i)<\lambda V(\delta ,i)$.
Obviously, $1<u=\frac{{\alpha}_{2}}{{\alpha}_{1}}=max\{\frac{{\lambda}_{max}({P}_{i})}{{\lambda}_{min}({P}_{j})}:i,j\in S\}<\frac{\lambda +\tilde{q}}{\overline{q}}$.
It means that system (6) reaches stochastic average consensus in the large. This completes the proof. □
Remark 2 In contrast with the case that the transition probabilities of the underlying Markov chain are assumed to be completely known, the circumstance that transition jump rates matrix Γ is not precisely known for the equation (7) is more general in the real control systems.
Remark 3 There are several disadvantages associated with the result derived in Theorem 3. (1) Hypothesis (22), it may reduce the set of systems to which the results in this section can be used. (2) The constructive method for choosing the best Lyapunov functions is currently unknown.
4 Numerical examples
In this section, we give two examples to examine the average consensus of system (6).
We let $p=5$, $\alpha =2.1\delta {}^{2}$, ${\beta}_{i}=1$, $k=\frac{1}{2}$, $g=0.15\delta $, it can be checked that assumptions (A1), (A2), and the conditions of Corollary 1 are satisfied and the matrix M is a nonsingular Mmatrix. So the WSN reaches average consensus by Corollary 1.
where $a,b>0$ denotes the unknown transition jump rates subject to $a\le 2$, $b\le 1$, respectively. We can see that $\tilde{q}=2$, $\overline{q}=1$.
5 Conclusions
In this paper, we have dealt with the problem of average consensus in p th moment of the WSNs. By using the Lyapunov function and the Mmatrix approach, we have obtained several sufficient conditions to ensure the average consensus in p th moment for WSNs with Markovian switching topology. Also, a sufficient condition for the stochastic average consensus in the large for the WSNs with partly known transition jump rates matrix Γ is derived. There are many other topics such as the timedelay cases and the adaptive control of the WSN’s consensus in p th moment, etc. worth investigating.
Declarations
Acknowledgements
This work is supported by the National Natural Science Foundation of China (61075060), the Innovation Program of Shanghai Municipal Education Commission (12zz064,13zz050), the Key Foundation Project of Shanghai (12JC1400400) and the Natural Science Foundation of Shanghai (12ZR1440200).
Authors’ Affiliations
References
 Fax JA, Murry RM: Information flow and cooperative control of vehicle formations. IEEE Trans. Autom. Control 2004, 49: 14651476. 10.1109/TAC.2004.834433View ArticleMathSciNetGoogle Scholar
 OlfatiSaber R: Distributed Kalman filter with embedded consensus filters. Proceedings of the 44th IEEE Conference on Decision and Control, and the European Control Conference, Seville, Spain 2005, 81798184.View ArticleGoogle Scholar
 Lynch N: Distributed Algorithms. Morgan Kaufmann, San Matero; 1996.MATHGoogle Scholar
 OlfatiSaber R, Murray RM: Consensus problem in networks of agents with switching topology and timedelays. IEEE Trans. Autom. Control 2004, 49: 15201533. 10.1109/TAC.2004.834113MathSciNetView ArticleGoogle Scholar
 Kingston DB, Beard RW: Discretetime averageconsensus under switching network topologies. Proceedings of American Control Conference, Minneapolis 2006, 35513556.Google Scholar
 Xiao L, Boyd S: Fast linear iterations for distributed averaging. Syst. Control Lett. 2004, 53: 6578. 10.1016/j.sysconle.2004.02.022MathSciNetView ArticleMATHGoogle Scholar
 Zhang Q, Zhang J: Distributed consensus of continuoustime multiagent systems with Markovian switching topologies and stochastic communication noises. J. Syst. Sci. Math. Sci. 2011, 31: 10971110.MATHMathSciNetGoogle Scholar
 Zhou WN, Tong DB, Gao Y, Ji C, Su HY: Mode and delaydependent adaptive exponential synchronization in p th moment for stochastic delayed neural networks with Markovian switching. IEEE Trans. Neural Netw. Learn. Syst. 2012, 23: 662668.View ArticleGoogle Scholar
 Zhou WN, Mou JP, Wang TB, Ji C, Fang JA: Targetsynchronization of the distributed wireless sensor networks under the same sleepingawaking method. J. Franklin Inst. 2012, 349: 20042018. 10.1016/j.jfranklin.2012.04.002MathSciNetView ArticleMATHGoogle Scholar
 Zhang LX, Boukas EK: Stability and stabilization of Markovian jump linear systems with partly unknown transition probability. Automatica 2009, 45: 463468. 10.1016/j.automatica.2008.08.010MathSciNetView ArticleMATHGoogle Scholar
 Zhang LX, Lam J: Necessary and sufficient conditions for analysis and synthesis of Markov jump linear systems with incomplete transition descriptions. IEEE Trans. Autom. Control 2010, 55: 16951701.MathSciNetView ArticleGoogle Scholar
 Zhu F, Han Z, Zhang J: Stability analysis of stochastic differential equations with Markovian switching. Syst. Control Lett. 2012, 61: 12091214. 10.1016/j.sysconle.2012.08.013MathSciNetView ArticleMATHGoogle Scholar
 Mao X, Yuan C: Stochastic Differential Equations with Markovian Switching. Imperial College Press, London; 2006.View ArticleMATHGoogle Scholar
 Huang C, Cao J: On p th moment exponential stability of stochastic CohenGrossberg neural networks with time varying delays. Neurocomputing 2010, 73: 986990. 10.1016/j.neucom.2009.08.019View ArticleGoogle Scholar
 Wang X, Guo Q, Xu D: Exponential p stability of impulsive stochastic CohenGrossberg neural networks with mixed delays. Math. Comput. Simul. 2009, 79: 16981710. 10.1016/j.matcom.2008.08.008MathSciNetView ArticleMATHGoogle Scholar
 Xu L, Xu D: Exponential p stability of impulsive stochastic neural networks with mixed delays. Chaos Solitons Fractals 2009, 41: 263272. 10.1016/j.chaos.2007.11.031MathSciNetView ArticleMATHGoogle Scholar
 Wang Z, Liu Y, Liu G, Liu X: A note on control of discretetime stochastic systems with distributed delays and nonlinear disturbances. Automatica 2010, 46: 543548. 10.1016/j.automatica.2009.11.020View ArticleMATHMathSciNetGoogle Scholar
 Wang Z, Liu Y, Liu L, Liu X: Exponential stability of delayed recurrent neural networks with Markovian jumping parameters. Phys. Lett. A 2006, 356: 346352. 10.1016/j.physleta.2006.03.078View ArticleMATHGoogle Scholar
 Li T, Zhang JF: Mean square average consensus under measurement noises and fixed topologies: Necessary and sufficient conditions. Automatica 2009, 45: 19291936. 10.1016/j.automatica.2009.04.017View ArticleMATHMathSciNetGoogle Scholar
 Chatterjee D, Liberzon D: On stability of randomly switched nonlinear systems. IEEE Trans. Autom. Control 2007, 52: 23902394.MathSciNetView ArticleGoogle Scholar
 Berman A, Plemmons RJ: Nonnegative Matrices in Mathematical Sciences. SIAM, Philadelphia; 1987.MATHGoogle Scholar
Copyright
This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.