- Research
- Open access
- Published:
Variance-constrained resilient \(H_{\infty }\) state estimation for time-varying neural networks with randomly varying nonlinearities and missing measurements
Advances in Difference Equations volume 2019, Article number: 380 (2019)
Abstract
This paper addresses the resilient \(H_{\infty }\) state estimation problem under variance constraint for discrete uncertain time-varying recurrent neural networks with randomly varying nonlinearities and missing measurements. The phenomena of missing measurements and randomly varying nonlinearities are described by introducing some Bernoulli distributed random variables, in which the occurrence probabilities are known a priori. Besides, the multiplicative noise is employed to characterize the estimator gain perturbation. Our main purpose is to design a time-varying state estimator such that, for all missing measurements, randomly varying nonlinearities and estimator gain perturbation, both the estimation error variance constraint and the prescribed \(H_{\infty }\) performance requirement are met simultaneously by providing some sufficient criteria. Finally, the feasibility of the proposed variance-constrained resilient \(H_{\infty }\) state estimation method is verified by some simulations.
1 Introduction
In the past two decades, the popularization of the Internet has greatly changed our way of life through the rapid communication ways [1,2,3]. Accordingly, many scholars have witnessed successful applications of recurrent neural networks (RNNs) in wide fields including pattern recognition, image processing, associate memory and optimization domains [4,5,6]. Nevertheless, it should be noted that the nonlinearities are commonly inherent characteristics between neurons, which indeed affect the understanding and analysis of the neural networks (NNs). Thus, some efficient methods have been given to analyze different NNs. For example, an effective finite-time synchronization criterion has been proposed in [7] for coupled stochastic NNs, where both the Markovian switching parameters and saturation have been addressed. Moreover, some useful state estimation algorithms have been given in [8] for delayed NNs to guarantee the \(H_{\infty }\) as well as passivity and in [9] for bidirectional associative NNs subject to mixed time-delays. During the analysis and implementation of the methods related to RNNs, it should be noticed that the neuron states may not always available in reality, so there is a need to estimate them by utilizing effective estimation methods [10,11,12]. Until now, many results have been published with respect to the state estimation problem of different types of dynamical networks [13,14,15,16]. Nevertheless, it is worth mentioning that much published literature is only applicable to time-invariant case, which might lead to certain application limitations. Hence, more and more researchers have paid attention on the analysis of the state estimation problem for time-varying system and proposed a variety of methods to analyze the behaviors of dynamics systems, see e.g. [17,18,19,20] and the references therein. To be specific, an event-based joint input and state estimation strategy have been presented in [19] to ensure that the covariance of the estimation error has an upper bound at any time for the addressed linear discrete time-varying systems. Accordingly, there exist the demands on the development of efficient analysis methods for time-varying RNNs.
During the network communications or transmissions, the perfect measurements can not be always available, thus increasing research effort has been made on the state estimation problems against the missing measurements [20,21,22]. The missing measurements are inevitable primarily due to the signal interference during the transmission including limited communication channels, noise interferences and so forth. For example, the study of missing measurements has been conducted in the areas of principal component analysis and partial least squares models [23]. Actually, it is well recognized that the existence of the missing measurements would lead to poor system performance for the addressed NNs [24, 25]. Accordingly, a large number of results have been given to deal with the state estimation problem for dynamics networks subject to missing measurements [26,27,28,29]. For example, in [27, 28], the \(H_{\infty }\) state estimation design strategies have been proposed for discrete delayed neural networks, where the impacts from the multiple missing measurements have been discussed. Nevertheless, few results have been reported to handle the problem of state estimation for time-varying dynamics networks with missing measurements [20, 30]. Recently, a new optimal state estimation algorithm has been developed in [20] for time-varying complex networks, where the impacts from both the stochastic coupling and the missing measurements within the framework of uncertain occurrence probabilities have been addressed. However, it is worthwhile to notice that few scholars have studied the state estimation problem of time-varying neural networks with missing measurements, which constitutes one of research motivations.
Recently, the phenomena of randomly varying nonlinearities have been modeled and discussed in various fields [31, 32]. The existence of randomly varying nonlinearities has brought more influences in physics, engineering, information science and other fields, and hence the dynamics system analysis problems with randomly varying nonlinearities have already received increasing interest [33,34,35]. For example, the state estimation algorithm in distributed way has been established in [33] for a class of discrete systems over sensor networks with incomplete measurements and randomly varying nonlinearities, and the probability-dependent \(H_{\infty }\) synchronization condition has been presented in [35] for dynamics networks by designing new control method. During the implementation process, the presented estimation method would be fragile/non-resilient due to various reasons, such as the numerical rounding error, finite-word length effects and analog-to-digital conversion accuracy [36, 37]. Accordingly, the non-fragile/resilient estimation schemes have wide application fields as in water quality processing [38] and synchronous generators [39]. In [40, 41], the non-fragile \(H_{\infty }\) state estimation algorithms have been given for dynamical systems with Markov switching effects, where the possible estimator parameter variations have been modeled and discussed. The resilient \(H_{\infty }\) filtering methods have been given in [42] for switched delayed neural networks with ensured finite-time criterion and in [43] for time-varying dynamics systems through sensor networks with communication protocols. However, few resilient \(H_{\infty }\) estimation methods can be available for time-varying RNNs. On the other hand, from the engineering-oriented viewpoint on the state estimation problems, it is of great practical significance to ensure the estimation performance has a certain upper bound of related to the estimated error covariance [44]. Unlike to the minimal estimation of error covariance, the variance-constrained state estimation strategy could provide a looser evaluation by introducing a specific upper bound constraint, which can reflect the admissible accuracy of the proposed estimation methods. Very recently, a new variance-constrained filtering algorithm with distributed feature has been established in [45] for time-varying sensor networks subject to deception attacks and state estimation scheme; see [46] for time-varying complex networks to attenuate the impacts induced by randomly varying topologies. As such, we make the first attempt to handle the \(H_{\infty }\) resilient estimation problem under variance constraint for time-varying RNNs with randomly varying nonlinearities and missing measurements.
Inspired by the above discussions, we aim to design the resilient \(H_{\infty }\) state estimation approach for the addressed discrete time-varying RNNs subject to missing measurements and randomly varying nonlinearities under the variance constraint. In particular, the estimator gain perturbation is considered by employing the Gaussian white noise. By resorting to the matrix theory and stochastic analysis technique, a new nonlinear time-varying state estimation method is proposed, which can ensure the error variance boundedness and prescribed \(H_{\infty }\) performance requirements simultaneously. From an engineering viewpoint, the proposed recursive state estimation scheme has a time-varying feature applicable for handling the estimation problems of neural networks, which is suitable for the online estimation applications. Moreover, some sufficient conditions characterized by the matrix inequalities are given to ensure two mixed performance indies, which can better achieve satisfactory disturbance attenuation level and the estimation covariance performance, thus performing wide application domains. The major features of the paper can be summarized as follows: (1) the \(H_{\infty }\) state estimation problem under variance constraint is, for the first time, investigated for a class of discrete time-varying RNNs subject to missing measurements and randomly varying nonlinearities; (2) a new probability-dependent time-varying state estimation algorithm is proposed, which can be implemented in terms of the solutions to certain matrix inequalities; (3) the impacts caused by the missing measurements and randomly varying nonlinearities onto two estimation performance indices are discussed and examined simultaneously; and (4) the proposed estimation algorithm has time-varying characteristic applicable for online applications, which performs new advantages compared with the existing estimation results for time-invariant neural networks.
Notations. The symbols used throughout the paper are fairly standard. \(\mathbb{R}^{r}\) denotes the r dimensional Euclidean space. \(\mathbb{N}^{+}\) stands for the sets of positive integers. For the matrix A and the vector x, \(A^{T}\) and \(x^{T}\) represents the transpose A and x, respectively. The identity matrix is denoted by I and the zero matrix is denoted by 0. \(\mathbb{E}\{x\}\) means the mathematical expectation of x. \(X>0\) means that X is a positive-definite symmetric matrix. In symmetric block matrices, we use an asterisk ∗ to represent a term that is induced by symmetry, and diag{…} stands for a block-diagonal matrix. It is assumed that the matrices have compatible dimensions if it is not explicitly specified.
2 Problem formulation and preliminaries
In this paper, we consider the n-neurons time-varying neural network given by
where \(x_{k}= [ x_{1,k} \ x_{2,k} \ \ldots \ x_{n,k} ] ^{T}\in {\mathbb{R}}^{n}\) represents the state vector of neural network, \(y_{k}\in {\mathbb{R}}^{m}\) denotes the measurement output, \(z_{k}\in {\mathbb{R}^{r}}\) stands for the controlled output, \(A_{k}=\operatorname{diag}\{a_{1,k},a_{2,k},\ldots ,a_{n,k}\}\) is the state coefficient matrix, \(C_{k}\), \(D_{k}\) and \(M_{k}\) are known real matrices with appropriate dimensions, \(v_{1k}\in {\mathbb{R}}^{n_{w}}\) and \(v_{2k}\in {\mathbb{R}}^{m}\) are Gaussian white noises with zero mean values and covariances \(V_{1}>0\) and \(V_{2}>0\), respectively. \(B_{1k}= [ b_{1ij}(k) ] _{n\times n}\) and \(B_{2k}= [ b_{2ij}(k) ] _{n\times n}\) are the connection weight matrices. \(f(x_{k})= [ f_{1}(x_{1,k}) \ \ldots \ f_{n}(x_{n,k}) ] ^{T}\) and \(g(x_{k})= [ g_{1}(x_{1,k}) \ \ldots \ g_{n}(x_{n,k}) ] ^{T}\) are the neuron activation functions. \(\Delta A_{k}\) describes the parameter uncertainty satisfying
where \(H_{k}\) and \(N_{k}\) are appropriately dimensional known matrices, the unknown matrix \(F_{k}\) satisfies
The Bernoulli distributed random variables \(\alpha _{k}\) and \(\lambda _{k}\) are utilized to describe the phenomena of randomly varying nonlinearities and missing measurements, respectively, and satisfy
where \(\bar{\alpha }\in [0,1]\) and \(\bar{\lambda }\in [0,1]\) are known constants.
Assumption 1
For the activation functions \(f(\cdot )\) and \(g(\cdot )\) with \(f(0)=g(0)=0\), there exist four scalars \(\lambda _{i}^{-}\), \(\lambda _{i}^{+}\), \(\sigma _{i}^{-}\) and \(\sigma _{i}^{+}\) satisfying the following conditions:
In order to estimate the states of neurons, the following time-varying nonlinear state estimator is constructed:
where \(\hat{x}_{k}\) is the estimation of neuron state \(x_{k}\), \(\bar{K}_{k}\) is a known real matrix with appropriate dimension, \(\delta _{k}\) is zero mean Gaussian white noise with unity covariance. \(K_{k}\) is the estimator gain matrix to be determined later. In the sequel, suppose that \(\alpha _{k}\), \(\lambda _{k}\), \(v_{1k}\), \(v_{2k}\) and \(\delta _{k}\) are mutually independent.
Remark 1
During the implementation process, the state estimation performance of the neural networks is usually affected by the numerical rounding error, finite-word length effects and analog-to-digital conversion accuracy, which inevitably lead to the possible deviations of the estimation values provided by the state estimator. Thus, the presented estimation method might be a fragile/non-resilient one. Therefore, we aim to take the estimator gain perturbations into account during the estimator design with hope to provide a resilient time-varying state estimator with admissible adjustment ability. Accordingly, the estimator gain perturbations are modeled by a zero mean Gaussian white noise \(\delta _{k}\) and the nominal matrix \(\bar{K}_{k}\), where the changes of the white noise \(\delta _{k}\) are utilized to characterize the admissible errors of the estimator gain. As such, a resilient state estimation scheme under prescribed performance indices is expected to be given later for the addressed time-varying RNNs.
Let the estimation error be \(e_{k}=x_{k}-\hat{x}_{k}\) and the controlled output estimation error be \(\tilde{z}_{k}=z_{k}-\hat{z}_{k}\). Then the estimation error dynamics can be obtained from (1) and (5) as follows:
with \(f(e_{k})=f(x_{k})-f(\hat{x}_{k})\), \(g(e_{k})=g(x_{k})-g(\hat{x} _{k})\), \(\tilde{\alpha }_{k}=\alpha _{k}-\bar{\alpha }\) and \(\tilde{\lambda }_{k}=\lambda _{k}-\bar{\lambda }\).
To simplify the notation, we can define
Considering (1), (6) and the above notations, we can easily derive the following augmented system:
where
Next, we introduce the covariance matrix \(X_{k}\) described by
The main purpose of this paper is to design a time-varying nonlinear state estimator (5) such that the following two requirements are achieved simultaneously.
-
(R1)
Let the scalar \(\gamma >0\), the positive-definite matrices \(W_{\varphi }\) and \(W_{\phi }\) be given. For the initial state \(\eta _{0}\), the estimation error \(\tilde{z}_{k}\) satisfies the following constraint:
$$\begin{aligned} J_{1}: =&\mathbb{E} \Biggl\{ \begin{aligned} \sum_{k=0}^{N-1}\bigl( \Vert \tilde{z}_{k} \Vert ^{2}-\gamma ^{2} \Vert v_{k} \Vert ^{2}_{W _{\varphi }} \bigr) \end{aligned} \Biggr\} -\gamma ^{2}\mathbb{E} \bigl\{ \eta _{0}^{T}W_{\phi }\eta _{0} \bigr\} < 0, \end{aligned}$$(9)where \(\| v_{k}\|^{2}_{W_{\varphi }}=v_{k}^{T}W_{\varphi }v_{k}\).
-
(R2)
The estimation error covariance satisfies the following bounded constraint:
$$\begin{aligned} J_{2}: =&\mathbb{E}\bigl\{ e_{k}e_{k}^{T} \bigr\} \leq \varPsi _{k}, \end{aligned}$$(10)where \(\varPsi _{k}~(0\leq k < N)\) is a set of pre-defined upper matrix, which reflects the admissible estimation precision demand with respect to the specific situation.
Remark 2
In this paper, our main purpose is to design a time-varying state estimator such that, for all missing measurements, randomly varying nonlinearities and estimator gain perturbations, both the estimation error variance constraint and the prescribed \(H_{\infty }\) performance requirement are met simultaneously by providing some sufficient criteria. On the one hand, the \(H_{\infty }\) performance requirement within finite horizon is used to reflect the attenuation capacity of the presented estimation algorithm against the effects from the exogenous disturbances and initial value. On the other hand, the upper bound constraint on the estimation error covariance is also introduced to evaluate the estimation accuracy. Compared with the traditional estimation method in the minimum variance framework, a prescribed upper bound constraint regarding the estimation error covariance is needed to be ensured, which could provide another evaluation way to the characterize the estimation performance.
Remark 3
In the practical circumstances, both the nonlinear effects and random coupling are inevitable [7]. Moreover, there is a common case that the NNs consist of a large number of highly interconnected neurons. Thus, it is generally difficult to obtain all states of the neurons due to the inherent interaction effects. Consequently, it is necessary to propose a proper way estimating the state information of all neurons, which has wide theoretical importance and practical significance. For example, a battery state-of-charge estimator has been designed in [47] to testify the usefulness of the merging fuzzy neural networks with a novel learning structure. As such, the desirable state estimation strategy with resilience ability for time-varying RNNs subject to missing measurements and randomly varying nonlinearities can provide important solvable method, thereby enriching the state estimation techniques for NNs.
At the end of this section, the following lemmas are introduced to facilitate further derivations.
Lemma 1
([26])
Suppose that \(\varGamma =\operatorname{diag}\{\mu _{1},\mu _{2},\ldots ,\mu _{n} \}\) is a diagonal matrix. For \(x=[ x_{1} \ x_{2} \ \ldots \ x_{n}]^{T}\in \mathbb{R}^{n}\), let \(\mathcal{H}(x)=[ h_{1}(x_{1}) \ h_{2}(x_{2}) \ \ldots \ h_{n}(x_{n})]^{T}\) be a continuous nonlinear function satisfying
with \(l_{i}^{+}\) and \(l_{i}^{-}\) being constant scalars. Then
where \(L_{1}=\operatorname{diag}\{l_{1}^{+}l_{1}^{-},l_{2}^{+}l_{2}^{-}, \ldots ,l_{n}^{+}l_{n}^{-}\}\) and \(L_{2}=\operatorname{diag} \{\frac{l _{1}^{+}+l_{1}^{-}}{2},\frac{l_{2}^{+}+l_{2}^{-}}{2},\ldots ,\frac{l _{n}^{+}+l_{n}^{-}}{2} \}\).
Lemma 2
([48])
Let R, F, H and Q be real matrices of appropriate dimensions with Q and F satisfying \(Q=Q^{T}\) and \(FF^{T}\leq I\). Then \(Q+RFH+H^{T}F^{T}R^{T}<0\) holds if and only if there exists \(\epsilon >0\) such that
Lemma 3
If the activation functions \(f(s)\) and \(g(s)\) satisfy the conditions in Assumption 1, then the following inequalities hold:
where
Proof
The proof this lemma can be easily obtained, hence it is omitted for brevity. □
3 Discussions of \(H_{\infty }\) performances and covariance constraint
In this section, both the \(H_{\infty }\) performance requirement and the upper bounded constraint of the estimation error covariance matrix are considered. The sufficient criteria are proposed accordingly based on the recursive matrix inequality technique.
3.1 \(H_{\infty }\) performance requirement
Firstly, a sufficient condition is obtained to ensure that the output estimation error satisfies the specified \(H_{\infty }\) performance index over the finite horizon.
Theorem 1
Consider the time-varying RNNs (1) subject to randomly varying nonlinearities and missing measurements. Suppose that the scalars \(\gamma >0\), \(\bar{\alpha }\in [0,1]\) and \(\bar{\lambda } \in [0,1]\), matrices \(W_{\varphi }>0\) and \(W_{\phi }>0\), state estimator gain matrix \(K_{k}\) in (5) are given. If \(Q_{0} \leq \gamma ^{2}W_{\phi }\) and there exists a series of positive-definite real-value matrices \(\{Q_{k}\}_{1\leq k\leq N+1}\) satisfying the following recursive matrix inequality:
where
then the \(H_{\infty }\) performance constraint defined in (9) can be achieved for all nonzero \(v_{k}\).
Proof
Define
Next, it follows from the augmented system (7) that
Adding the zero term \(\tilde{z}^{T}_{k}\tilde{z}_{k}-\gamma ^{2}v_{k} ^{T}W_{\varphi }v_{k}-\tilde{z}^{T}_{k}\tilde{z}_{k}+\gamma ^{2}v_{k} ^{T}W_{\varphi }v_{k}\) to \(\mathbb{E}\{V_{k}\}\) leads to
where
and \(\varPhi _{23}\) as well as \(\varPhi _{44}\) being defined below (13).
Moreover, based on Assumption 1 and Lemma 1, we have
where \(\varLambda _{2}\) and \(\varSigma _{2}\) are defined in (12), \(\varLambda _{1}\), \(\varSigma _{1}\), \(\varGamma _{1}\), \(\varGamma _{2}\), \(\varGamma _{3}\) and \(\varGamma _{4}\) are defined in (13). From the above inequalities, we can deduce that
where \(\varLambda _{11}\), \(\varLambda _{21}\), \(\varSigma _{12}\), \(\varSigma _{22}\), F̄ and H̄ are mentioned below (13). Then, together with (16)–(17), this yields
Summarizing (18) from 0 to \(N-1\) with respect to k, it is not difficult to see that
where Φ is defined in (13). Therefore, we can derive the following inequality:
According to \(\varPhi <0\), \(Q_{N}>0\) and the initial condition \(Q_{0}\leq \gamma ^{2}W_{\phi }\), it follows that \(J_{1}<0\). The proof in Theorem 1 is now complete. □
So far, we have presented the criterion to guarantee the \(H_{\infty }\) performance within the finite horizon. Next, we are ready to propose the sufficient condition to ensure the upper bound constraint with respect to the covariance matrix \(X_{k}\).
3.2 Variance constraint analysis
In this subsection, the upper bound constraint of the covariance matrix \(X_{k}\) is ensured by providing a sufficient criterion.
Theorem 2
Consider the time-varying RNNs (1) subject to randomly varying nonlinearities and missing measurements. Let the scalars \(\bar{\alpha }\in [0,1]\), \(\bar{\lambda }\in [0,1]\) and the estimator gain matrix \(K_{k}\) in (5) be given. Under the initial condition \(G_{0}=X_{0}\), if there exists a set of positive-definite matrices \(\{G_{k}\}_{1\leq k\leq N+1}\) satisfying
where
then we have \(G_{k}\geq X_{k}\) (\(\forall k\in {1,2,\ldots ,N+1}\)).
Proof
As we know from (8), the equation of state covariance \(X_{k}\) can be calculated by
On the basis of the inequality \(ab^{T}+ba^{T}\leq \zeta aa^{T}+\zeta ^{-1}bb^{T}\) with \(\zeta >0\), we can obtain
where \(\varepsilon _{i}\) (\(i=1,2,3,4\)) are positive scalars. Then it is straightforward to see that
Furthermore, it follows from Lemma 3 that
where \(Y_{1}\) and \(Y_{2}\) are defined in (22). Thus, one has
According to the feature of the trace, we can obtain
Combining (23) with (24) results in
Noting that \(G_{0}\geq X_{0}\) and letting \(G_{k}\geq X_{k}\), we can derive the following inequality:
Then, from (21) and (25), we arrive at
Therefore, the proof is complete. □
Based on the above theorems, a sufficient condition can be presented to guarantee the specified \(H_{\infty }\) performance and estimation error variance constraint by solving the recursive matrix inequalities.
Theorem 3
Consider the time-varying RNNs (1) and suppose that the estimator gain matrix \(K_{k}\) is given. For given scalars \(\gamma >0\), \(\bar{\alpha }\in [0,1]\) and \(\bar{\lambda }\in [0,1]\), positive-definite matrices \(W_{\varphi }>0\) and \(W_{\phi }>0\), under the initial conditions \(Q_{0}\leq \gamma ^{2}W_{\phi }\) and \(G_{0}=X_{0}\), if there are two series of positive-definite real-valued matrices \(\{Q_{k}\}_{1\leq k\leq N+1}\) and \(\{G_{k}\}_{1\leq k\leq N+1}\) satisfying the following matrix inequalities:
where
then both the \(H_{\infty }\) performance requirement and the upper constraints of estimation error covariance can be satisfied simultaneously.
Proof
Under the initial conditions, according to the above analysis of \(H_{\infty }\) performance and estimation error covariance in Theorems 1–2, the inequality (27) implies (13) and (28) yields (22). As such, both the \(H_{\infty }\) performance requirement and variance constraint are guaranteed, which ends the proof. □
Remark 4
So far, some sufficient conditions are given to ensure the desirable performance requirements. To be specific, a sufficient condition is firstly established in Theorem 1 to ensure that the output estimation error satisfies the specified \(H_{\infty }\) performance index over the finite horizon provided that the estimator gain is given. Secondly, the upper bound constraint of the estimation error covariance matrix is guaranteed in Theorem 2. Subsequently, based on the above two theorems, a sufficient condition is presented in Theorem 3 to ensure the specified \(H_{\infty }\) performance and estimation error variance constraint by solving some recursive matrix inequalities. Finally, the design problem of a discrete time-varying state estimator is discussed in the next section, where the estimator gains can be obtained at each sampling step by solving several recursive matrix inequalities.
4 Design of the estimator gain matrix
In this section, a sufficient criterion is proposed to deal with the design problem of discrete time-varying state estimator, which can be solved by several recursive matrix inequalities.
Theorem 4
Given the disturbance attenuation level \(\gamma >0\), the scalars \(\bar{\alpha }\in [0,1]\) and \(\bar{\lambda }\in [0,1]\), the positive-definite matrices \(W_{\varphi }>0\) and and a set of pre-defined variance upper bound matrices \(\{\varPsi _{k}\}_{0\leq k\leq N+1}\), under the initial conditions
if there exist series of positive-definite matrices \(\{L_{k}\}_{1 \leq k\leq N+1}\), \(\{Z_{k}\}_{1\leq k\leq N+1}\), \(\{G_{1k}\}_{1\leq k \leq N+1}\) and \(\{G_{2k}\}_{1\leq k\leq N+1}\), positive scalars \(\{\epsilon _{1,k}\}_{0\leq k\leq N+1}\) and \(\{\epsilon _{2,k}\}_{0 \leq k\leq N+1}\), matrices \(\{K_{k}\}_{0\leq k\leq N+1}\) and \(\{G_{3k}\}_{1\leq k\leq N+1}\) with appropriate dimensions satisfying the following recursive matrix inequalities:
where
then we can conclude that the estimator design problem is solvable.
Proof
Firstly, the matrices \(Q_{k}\) and \(G_{k}\) are decomposed as follows:
Secondly, in order to deal with parameter uncertainty, we rewrite (27) as follows:
where
Subsequently, it follows from Lemma 2 that
Similarly, (28) can be rewritten as
where
Then it follows from Lemma 2 that
Now, it should be noted that (30) implies (27). Similarly, we can see that (31) leads to (28). As such, both the estimation error covariance constraint and \(H_{\infty }\) performance requirement of system (7) are ensured. The proof of Theorem 4 is complete. □
Remark 5
Up to now, we have discussed the variance-constrained resilient \(H_{\infty }\) state estimation problem for a class of time-varying RNNs with randomly varying nonlinearities and missing measurements. By applying the recursive matrix inequality technique, some criteria have been established to guarantee the prescribed \(H_{\infty }\) performance and the estimation error covariance constraints for the addressed estimation problem of time-varying neural networks within the finite-horizon framework. It should be noticed that the proposed estimation approach has the following three advantages: (i) the disturbance effects can be effectively attenuated by the \(H_{\infty }\) performance index over finite horizon; (ii) the prescribed upper bound of the estimation error covariance can be guaranteed by verifying certain matrix inequalities; and (iii) the newly designed state estimation approach can be applied to the online calculations and implementations for solving the estimation problems of time-varying RNNs, which constitutes another appealing feature.
Remark 6
In fact, almost all existing estimation schemes can be applied to time-invariant NNs only, but we have made one of the first attempts to discuss the characteristics of the time-varying RNNs and address two combined performance indices to meet the practical requirements, which are the essential superiority of the proposed result. For example, compared with the non-fragile/resilient state estimation method in [10], our estimation scheme has the advantage to reveal the whole impacts from missing measurements and randomly varying nonlinearities onto the estimation algorithm performance, which can present a new treatment way. In contrast to the results in [11, 12], the superiority dealing with the time-varying characteristics can be observed from our new state estimation scheme.
5 An illustrative example
In this section, we give a simulation to illustrate the feasibility of proposed estimation approach under variance constraint. The parameters of time-varying RNNs (1) are given as follows:
Moreover, the activation functions can be taken as
with \(x_{k}= [ x_{1,k} \ x_{2,k} ] ^{T}\) being the neuron state vector of neural network. It is easy to obtain \(\varLambda _{0}=\operatorname{diag}\{0.1,0.1\}\), \(\varLambda _{1}= \operatorname{diag}\{0.2,0.2\}\), \(\varLambda _{2}=\operatorname{diag}\{0.9,0.9\}\), \(\varSigma _{0}=\operatorname{diag}\{0.2,0.2\}\), \(\varSigma _{1}=\operatorname{diag}\{0.3,0.3 \}\) and \(\varSigma _{2}=\operatorname{diag}\{0.5,0.5\}\). Let the disturbance attenuation level be \(\gamma =0.9\) and \(N=94\), weighted matrices as \(W_{\varphi }(1)=W_{\varphi }(2)=1\), upper bound matrices as \(\{\varPsi _{k}\}_{1\leq k\leq N}=\operatorname{diag}\{0.3,0.3\}\), and covariances as \(V_{1}=V_{2}=1\). Choose the parameters’ initial matrices satisfying (29). Then the matrix inequalities (30)–(32) in Theorem 4 can be solved, and \(K_{k}\) is designed as in Table 1.
Suppose the initial states as \(x_{0}= [ -1.5\ 0.3 ] ^{T}\) and \(\hat{x}_{0}= [ -1.2 \ 0.3 ] ^{T}\). Based on the state estimation method in Theorem 4, the simulation results can be shown in Figs. 1–4. Figures 1–2 plot the output \(z_{k}\) and its estimation \(\hat{z}_{k}\), respectively. Figure 3 depicts the output estimation error \(\tilde{z} _{k}\). The error variance upper bound and actual error variance are plotted in Fig. 4, which indeed illustrates that the actual error variance below the error variance upper bound. From the simulations, we can conclude that the newly presented variance-constrained resilient \(H_{\infty }\) estimation algorithm is efficient.
6 Conclusions
In this paper, we have discussed the variance-constrained resilient \(H_{\infty }\) state estimation problem for a class of time-varying neural networks with randomly varying nonlinearities and missing measurements. Two random variables that obey Bernoulli distribution have been adopted to describe the phenomena of randomly varying nonlinearities and missing measurements. A new variance-constrained \(H_{\infty }\) state estimation method has been designed based on the available information. By applying the recursive matrix inequality technique, some criteria have been established to guarantee the prescribed \(H_{\infty }\) performance and the estimation error covariance constraints for the addressed estimation problem of the time-varying neural networks. In addition, the gain matrix of state estimator has been obtained by testing the feasibility of the concerned recursive matrix inequalities. Finally, the validity of the proposed estimation method has been verified by a simulation example. Our future research topics include the state estimation problems for time-varying RNNs with the finite-time criterion as in [36] and the inaccuracy occurrence probability as mentioned in [49].
References
Zhang, X., Han, Q., Yu, X.: Survey on recent advances in networked control systems. IEEE Trans. Ind. Inform. 12(5), 1740–1752 (2016)
Zhang, H., Hu, J., Liu, H., Yu, X., Liu, F.: Recursive state estimation for time-varying complex networks subject to missing measurements and stochastic inner coupling under random access protocol. Neurocomputing 346, 48–57 (2019)
Selvaraj, P., Sakthivel, R., Ahn, C.K.: Observer-based synchronization of complex dynamical networks under actuator saturation and probabilistic faults. IEEE Trans. Syst. Man Cybern. Syst. 49(7), 1516–1526 (2019)
Zheng, M., Tang, W., Zhao, X.: Hyperparameter optimization of neural network-driven spatial models accelerated using cyber-enabled high-performance computing. Int. J. Geogr. Inf. Sci. 33(2), 314–345 (2019)
Maharajan, C., Raja, R., Cao, J., Ravi, G., Rajchakit, G.: Global exponential stability of Markovian jumping stochastic impulsive uncertain BAM neural networks with leakage, mixed time delays, and alpha-inverse Holder activation functions. Adv. Differ. Equ. 2018, Article ID 113 (2018). https://doi.org/10.1186/s13662-018-1553-7
Manivannan, R., Samidurai, R., Cao, J., Alsaedi, A., Alsaadi, F.E.: Delay-dependent stability criteria for neutral-type neural networks with interval time-varying delay signals under the effects of leakage delay. Adv. Differ. Equ. 2018, Article ID 53 (2018). https://doi.org/10.1186/s13662-018-1509-y
Selvaraj, P., Sakthivel, R., Kwon, O.M.: Finite-time synchronization of stochastic coupled neural networks subject to Markovian switching and input saturation. Neural Netw. 105, 154–165 (2018)
Sakthivel, R., Anbuvithya, R., Mathiyalagan, K., Prakash, P.: Combined \(H_{\infty }\) and passivity state estimation of memristive neural networks with random gain fluctuations. Neurocomputing 168, 1111–1120 (2015)
Sakthivel, R., Vadivel, P., Mathiyalagan, K., Arunkumar, A., Sivachitra, M.: Design of state estimator for bidirectional associative memory neural networks with leakage delays. Inf. Sci. 296, 263–274 (2015)
Li, R., Gao, X., Cao, J.: Non-fragile state estimation for delayed fractional-order memristive neural networks. Appl. Math. Comput. 340, 221–233 (2019)
Guo, R., Zhang, Z., Gao, M.: State estimation for complex-valued memristive neural networks with time-varying delays. Adv. Differ. Equ. 2018, Article ID 118 (2018). https://doi.org/10.1186/s13662-018-1575-1
Liu, Y., Wang, Z., Liu, X.: State estimation for discrete-time neural networks with Markov-mode-dependent lower and upper bounds on the distributed delays. Neural Process. Lett. 36(1), 1–19 (2012)
Hu, J., Wang, Z., Alsaadi, F.E., Hayat, T.: Event-based filtering for time-varying nonlinear systems subject to multiple missing measurements with uncertain missing probabilities. Inf. Fusion 38, 74–83 (2017)
Bao, H., Cao, J., Kurths, J.: State estimation of fractional-order delayed memristive neural networks. Nonlinear Dyn. 94(2), 1215–1225 (2018)
Hu, J., Wang, Z., Gao, H.: Joint state and fault estimation for uncertain time-varying nonlinear systems with randomly occurring faults and sensor saturations. Automatica 97, 150–160 (2018)
Kang, W., Zhong, S., Cheng, J.: \(H_{\infty }\) state estimation for discrete-time neural networks with time-varying and distributed delays. Adv. Differ. Equ. 2015, Article ID 263 (2015). https://doi.org/10.1186/s13662-015-0603-7
Bernat, J.: Multi observer structure for rapid state estimation in linear time varying systems. Int. J. Control. Autom. Syst. 16(4), 1746–1755 (2018)
Dong, H., Bu, X., Hou, N., Liu, Y., Alsaadi, F.E., Hayat, T.: Event-triggered distributed state estimation for a class of time-varying systems over sensor networks with redundant channels. Inf. Fusion 36, 243–250 (2017)
Hu, L., Wang, Z., Han, Q., Liu, X.: Event-based input and state estimation for linear discrete time-varying systems. Int. J. Control 91(1), 101–113 (2018)
Zhang, H., Hu, J., Zou, L., Yu, X., Wu, Z.: Event-based state estimation for time-varying stochastic coupling networks with missing measurements under uncertain occurrence probabilities. Int. J. Gen. Syst. 47(5), 422–437 (2018)
Jia, C., Hu, J.: Variance-constrained filtering for nonlinear systems with randomly occurring quantized measurements: recursive scheme and boundedness analysis. Adv. Differ. Equ. 2019, Article ID 53 (2019). https://doi.org/10.1186/s13662-019-2000-0
Duan, H., Peng, T.: Finite-time reliable filtering for T-S fuzzy stochastic jumping neural networks under unreliable communication links. Adv. Differ. Equ. 2017, Article ID 54 (2017). https://doi.org/10.1186/s13662-017-1108-3
Nelson, P.R.C., MacGregor, J.F., Taylor, P.A.: The impact of missing measurements on PCA and PLS prediction and monitoring applications. Chemom. Intell. Lab. Syst. 80(1), 1–12 (2006)
Che, Y., Shu, H., Liu, Y.: Exponential mean-square \(H_{\infty }\) filtering for arbitrarily switched neural networks with missing measurements. Neurocomputing 193, 227–234 (2016)
Tsai, L.T., Yang, C.-C.: Improving measurement invariance assessments in survey research with missing data by novel artificial neural networks. Expert Syst. Appl. 39(12), 10456–10464 (2012)
Song, Y., Hu, J., Chen, D., Liu, Y., Alsaadi, F.E., Sun, G.: A resilience approach to state estimation for discrete neural networks subject to multiple missing measurements and mixed time-delays. Neurocomputing 272, 74–83 (2018)
Liu, M., Chen, H.: \(H_{\infty }\) state estimation for discrete-time delayed systems of the neural network type with multiple missing measurements. IEEE Trans. Neural Netw. Learn. Syst. 26(12), 2987–2998 (2015)
Rakkiyappan, R., Sasirekha, R., Zhu, Y., Zhang, L.: \(H_{\infty }\) state estimator design for discrete-time switched neural networks with multiple missing measurements and sojourn probabilities. J. Franklin Inst. 353(6), 1358–1385 (2016)
Liang, J., Wang, Z., Liu, X.: State estimation for coupled uncertain stochastic networks with missing measurements and time-varying delays: the discrete-time case. IEEE Trans. Neural Netw. 20(5), 781–793 (2009)
Liu, H., Wang, Z., Shen, B., Liu, X.: Event-triggered \(H_{\infty }\) state estimation for delayed stochastic memristive neural networks with missing measurements: the discrete time case. IEEE Trans. Neural Netw. Learn. Syst. 29(8), 3726–3737 (2018)
Ding, D., Wang, Z., Shen, B., Dong, H.: \(H_{\infty }\) state estimation with fading measurements, randomly varying nonlinearities and probabilistic distributed delays. Int. J. Robust Nonlinear Control 25(13), 2180–2195 (2015)
Zhang, P., Hu, J., Liu, H., Zhang, C.: Sliding mode control for networked systems with randomly varying nonlinearities and stochastic communication delays under uncertain occurrence probabilities. Neurocomputing 320, 1–11 (2018)
Liang, J., Wang, Z., Liu, X.: Distributed state estimation for discrete-time sensor networks with randomly varying nonlinearities and missing measurements. IEEE Trans. Neural Netw. 22(3), 486–496 (2011)
Dong, H., Wang, Z., Gao, H.: Fault detection for Markovian jump systems with sensor saturations and randomly varying nonlinearities. IEEE Trans. Circuits Syst. I, Regul. Pap. 59(10), 2354–2362 (2012)
Wang, L., Wei, G., Li, W.: Probability-dependent \(H_{\infty }\) synchronization control for dynamical networks with randomly varying nonlinearities. Neurocomputing 133, 369–376 (2014)
Sakthivel, R., Sakthivel, R., Kaviarasan, B., Wang, C., Ma, Y.K.: Finite-time nonfragile synchronization of stochastic complex dynamical networks with semi-Markov switching outer coupling. Complexity 2018, Article ID 8546304 (2018). https://doi.org/10.1155/2018/8546304
Sakthivel, R., Nithya, V., Ma, Y.K., Wang, C.: Finite-time nonfragile dissipative filter design for wireless networked systems with sensor failures. Complexity 2018, Article ID 7482015 (2018). https://doi.org/10.1155/2018/7482015
Wang, D., Shi, P., Wang, W., Karimi, H.R.: Non-fragile \(H_{\infty }\) control for switched stochastic delay systems with application to water quality process. Int. J. Robust Nonlinear Control 24(11), 1677–1693 (2014)
Pourgholi, M., Majd, V.J.: A new non-fragile \(H_{\infty }\) proportional-integral filtered-error adaptive observer for a class of non-linear systems and its application to synchronous generators. Proc. Inst. Mech. Eng. 225(1), 99–112 (2011)
Wu, Z., Xu, Z., Shi, P., Chen, M.Z., Su, H.: Nonfragile state estimation of quantized complex networks with switching topologies. IEEE Trans. Neural Netw. Learn. Syst. 29(10), 5111–5121 (2018)
Shen, H., Wang, T., Chen, M., Lu, J.: Nonfragile mixed state estimation for repeated scalar nonlinear systems with Markov jumping parameters and redundant channels. Nonlinear Dyn. 91(1), 641–654 (2018)
Xie, W., Zhu, H., Cheng, J., Zhong, S., Shi, K.: Finite-time asynchronous \(H_{\infty }\) resilient filtering for switched delayed neural networks with memory unideal measurements. Inf. Sci. 487, 156–175 (2019)
Sheng, L., Niu, Y., Gao, M.: Distributed resilient filtering for time-varying systems over sensor networks subject to round-robin/stochastic protocol. ISA Trans. 87, 55–67 (2019)
Dong, H., Wang, Z., Ho, D.W., Gao, H.: Variance-constrained \(H_{\infty }\) filtering for a class of nonlinear time-varying systems with multiple missing measurements: the finite-horizon case. IEEE Trans. Signal Process. 58(5), 2534–2543 (2010)
Ma, L., Wang, Z., Han, Q.L., Lam, H.K.: Variance-constrained distributed filtering for time-varying systems with multiplicative noises and deception attacks over sensor networks. IEEE Sens. J. 17(7), 2279–2288 (2017)
Dong, H., Hou, N., Wang, Z., Ren, W.: Variance-constrained state estimation for complex networks with randomly varying topologies. IEEE Trans. Neural Netw. Learn. Syst. 29(7), 2757–2768 (2018)
Li, I.H., Wang, W.Y., Su, S.F., Lee, Y.S.: A merged fuzzy neural network and its applications in battery state-of-charge estimation. IEEE Trans. Energy Convers. 22(3), 697–708 (2007)
Hu, J., Zhang, H., Yu, X., Liu, H., Chen, D.: Design of sliding-mode-based control for nonlinear systems with mixed-delays and packet losses under uncertain missing probability. IEEE Trans. Syst. Man Cybern. Syst. (2019). https://doi.org/10.1109/TSMC.2019.2919513
Hu, J., Zhang, P., Kao, Y., Liu, H., Chen, D.: Sliding mode control for Markovian jump repeated scalar nonlinear systems with packet dropouts: the uncertain occurrence probabilities case. Appl. Math. Comput. (2019) https://doi.org/10.1016/j.amc.2019.124574
Availability of data and materials
Not applicable.
Funding
This work was supported in part by the Outstanding Youth Science Foundation of Heilongjiang Province of China under grant JC2018001, the National Natural Science Foundation of China under Grant 61673141, the Fok Ying Tung Education Foundation of China under Grant 151004, the Natural Science Foundation of Heilongjiang Province of China under grant A2018007, the Fundamental Research Funds in Heilongjiang Provincial Universities of China under Grant 135209250, the Educational Research Project of Qiqihar University of China under Grant 2017028, and the Alexander von Humboldt Foundation of Germany.
Author information
Authors and Affiliations
Contributions
The authors contributed equally to this paper. The authors read and approved the final version of the submission.
Corresponding author
Ethics declarations
Competing interests
All authors declared that they have no competing interests.
Consent for publication
Both authors read and approved the final version of the paper.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Gao, Y., Hu, J., Chen, D. et al. Variance-constrained resilient \(H_{\infty }\) state estimation for time-varying neural networks with randomly varying nonlinearities and missing measurements. Adv Differ Equ 2019, 380 (2019). https://doi.org/10.1186/s13662-019-2298-7
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s13662-019-2298-7