# Robust exponential stability analysis for delayed neural networks with time-varying delay

- Jing-Chen Xie
^{1, 2}, - Chin-Pin Chen
^{2}, - Pin-Lin Liu
^{3}Email author and - Yoau-Chau Jeng
^{2}

**2014**:131

https://doi.org/10.1186/1687-1847-2014-131

© Xie et al.; licensee Springer. 2014

**Received: **12 December 2013

**Accepted: **31 March 2014

**Published: **7 May 2014

## Abstract

This paper considers the problems of determining the robust exponential stability and estimating the exponential convergence rate for delayed neural networks with parametric uncertainties and time delay. The relationship among the time-varying delay, its upper bound, and their difference is taken into account. Theoretic analysis shows that our result includes a previous result derived in the literature. As illustrations, the results are applied to several concrete models studied in the literature, and a comparison of results is given.

## Keywords

## 1 Introduction

Time delays are often encountered in various practical systems such as chemical processes, neural networks, and long transmission lines in pneumatic systems. It has been shown that the existence of time delays may lead to oscillations, divergences, or instabilities. This motivates the stability analysis problem for linear systems affected by time delays. During the last decade, increasing research interests have been aroused in the stability analysis and control design of time delay systems [1–17]. It is well known that neural networks have been extensively studied over the past few decades and have been successfully applied to many areas, such as signal processing, static processing, pattern recognition, combinatorial optimization, and so on [18]. So, it is important to study the stability of neural networks. In biological and artificial neural networks, time delays often arise in the processing of information storage and transmission.

Recently, a considerable number of sufficient conditions on the existence, uniqueness, and global asymptotic stability of equilibrium point for neural networks with constant delays or time-varying delays were reported under some assumptions; for example, see [3, 4, 6, 8, 9, 11, 15–17] and references therein. In the design of delayed neural networks (DNNs), however, one is interested not only in the global asymptotic stability of the neural network, but also in some other performances. In particular, it is often desirable that the neural network converges fast enough in order to achieve a fast response [15]. It is well known that exponential stability gives a fast convergence rate to the equilibrium point. Therefore, some researchers studied the exponential stability analysis problem for time delay systems with constant delays or time-varying delays, and a great number of results on this topic have been given in the literature; for example, see [3, 7, 9–11, 14–17] and references therein. The exponential stability problems of switched positive continuous time [12] and discrete-time [13, 14] linear systems with time delay were considered. In [16], exponential stability criteria for DNNs with time-varying delay are derived, but the constraint $\dot{h}(t)<1$ on a time-varying delay was imposed. Such a restriction is very conservative and has physical limitations.

In practical implementations, uncertainties are inevitable in neural networks because of the existence of modeling errors and external disturbance. It is important to ensure the neural networks system is stable under these uncertainties. Both time delays and uncertainties can destroy the stability of neural networks in an electronic implementation. Therefore, it is of great theoretical and practical importance to investigate the robust stability for delayed neural networks with uncertainties [11].

Recently, a free-weighting matrix approach [3] has been employed to study the exponential stability problem for neural networks with a time-varying delay [4]. However, as mentioned in [5], some useful terms in the derivative of the Lyapunov functional were ignored in [4, 6, 17]. The derivative of ${\int}_{-h}^{0}{\int}_{t+\theta}^{t}{\dot{x}}^{T}(s)Z\dot{x}(s)\phantom{\rule{0.2em}{0ex}}ds\phantom{\rule{0.2em}{0ex}}d\theta $ with $0\le h(t)\le \overline{h}$ was estimated as ${\dot{x}}^{T}(t)hZ\dot{x}(t)-{\int}_{t-h(t)}^{t}{\dot{x}}^{T}(s)Z\dot{x}(s)\phantom{\rule{0.2em}{0ex}}ds$ and the negative term $-{\int}_{t-h(t)}^{t}{\dot{x}}^{T}(s)Z\dot{x}(s)\phantom{\rule{0.2em}{0ex}}ds$ was ignored in [17], which may lead to considerable conservativeness. Although in [4] and [6] the negative term $-{\int}_{t-h(t)}^{t}{\dot{x}}^{T}(s)Z\dot{x}(s)\phantom{\rule{0.2em}{0ex}}ds$ was retained, the other term, $-{\int}_{t-h}^{t-h(t)}{\dot{x}}^{T}(s)Z\dot{x}(s)\phantom{\rule{0.2em}{0ex}}ds$, was ignored, which may also lead to considerable conservativeness. On the other hand, if the free-weighting method introduces too many free-weighting matrices in the theoretical derivation, some of them sometimes have no effect on reducing the conservatism of the obtained results; on the contrary, they mathematically complicate the system analysis and consequently lead to a significant increase in the computational demand [8]. How to overcome the aforementioned disadvantages of the integral inequality approach (IIA) is an important research topic in the delay-dependent related problem and also motivates the work of this paper on exponential stability analysis. Furthermore, the restriction of $\dot{h}(t)<1$ is released in the proposed scheme.

In this paper, a global robust exponential stability of the delayed neural networks with time-varying delays is proposed. By constructing a suitable augmented Lyapunov functional, a delay-dependent criterion is derived in terms of linear matrix inequalities (LMIs) and the integral inequality approach (IIA), which can be solved efficiently by using the generalized eigenvalue problem (GEVP). Furthermore, examples with simulation are given to show that the proposed stability criteria are less conservative than some recent ones in the literature.

*Notation*: Throughout this paper, ${N}^{T}$ stands for the transpose of the matrix *N*, ${R}^{N}$ denotes the *n*-dimensional Euclidean space, $P>0$ means that the matrix *P* is positive definite, *I* is an appropriately dimensioned identity matrix, and $(diag\dots )$ denotes a block diagonal matrix.

## 2 Problem formulations and preliminaries

*D*, ${E}_{c}$, ${E}_{a}$, and ${E}_{b}$ are known constant real matrices with appropriate dimensions and $F(t)$ is an unknown matrix function with Lebesgue-measurable elements bounded by

where *I* is an appropriately dimensioned identity matrix.

where *h* and ${h}_{d}$ are constants.

**Assumption 1**Throughout this paper, it is assumed that each of the activation functions ${f}_{j}$ ($j=1,2,\dots ,n$) possesses the following condition:

where ${k}_{i}$ ($i=1,2,\dots ,n$) are positive constants.

To obtain the main results, the following lemmas are needed. First, we introduce a technical lemma of the integral inequality approach (IIA), which will be used in the proof of ours.

*For any semi*-

*positive definite matrices*

*the following integral inequality holds*:

Secondarily, we introduce the following Schur complement which is essential in the proofs of our results.

**Lemma 2** [1]

*The following matrix inequality*:

*where*$Q(x)={Q}^{T}(x)$, $R(x)={R}^{T}(x)$

*and*$S(x)$

*depend in an affine way on*

*x*,

*is equivalent to*

*and*

Finally, Lemma 3 will be used to handle the parametrical perturbation.

**Lemma 3** [18]

*Given symmetric matrices*Ω

*and*

*D*,

*E*,

*of appropriate dimensions*,

*we have*

*for all*$F(t)$

*satisfying*${F}^{T}(t)F(t)\le I$,

*if and only if there exists some*$\epsilon >0$

*such that*

For the nominal system (2.18), we will give a stability condition by using an integral inequality approach as follows.

**Theorem 1**

*For given scalars*

*h*,

*α*,

*and*${h}_{d}$,

*system*(2.18)

*is exponentially stable if there exist symmetry positive*-

*definite matrices*$P={P}^{T}>0$, $Q={Q}^{T}>0$, $R={R}^{T}>0$, $U={U}^{T}>0$, $W={W}^{T}>0$,

*diagonal matrices*$S\ge 0$, ${\mathrm{\Lambda}}_{1}\ge 0$, ${\mathrm{\Lambda}}_{2}\ge 0$,

*and*

*and*

*such that the following LMIs hold*:

*where*

*Proof*Choose the following Lyapunov-Kravoskii functional candidate:

*t*along the system (2.18) yields

From (2.32) and the Schur complement, it is easy to see that $\dot{V}({x}_{t})<0$ holds if $R-{X}_{33}\ge 0$, $R-{Y}_{33}\ge 0$. □

## 3 Exponential robust stability analysis

Based on Theorem 1, we have the following result for uncertain neural networks with time-varying delay (2.7).

**Theorem 2**

*For given positive scalars*

*h*,

*α*,

*and*${h}_{d}$,

*the uncertain delayed neural networks with time*-

*varying delay*(2.7)

*is exponentially robust stable if there exist symmetric positive*-

*definite matrices*$P={P}^{T}>0$, $Q={Q}^{T}>0$, $R={R}^{T}>0$, $U={U}^{T}>0$, $W={W}^{T}>0$,

*diagonal matrices*$S\ge 0$, ${\mathrm{\Lambda}}_{1}\ge 0$, ${\mathrm{\Lambda}}_{2}\ge 0$,

*a scalar*$\epsilon >0$

*and*

*such that the following LMIs are true*:

*and*

*where* ${\mathrm{\Omega}}_{ij}$ ($i,j=1,\dots ,6$; $i<j\le 6$) *are defined in* (2.19).

It is, incidentally, worth noting that the uncertain delayed neural networks with time-varying delay (2.7) is exponential stable, that is, the uncertain parts of the nominal system can be tolerated within allowable time delay *h* and exponential convergence rate *α*.

*Proof*Replacing

*A*,

*B*, and

*C*in (2.19) with $A+DF(t){E}_{a}$, $B+DF(t){E}_{b}$, and $C+DF(t){E}_{c}$, respectively, we apply Lemma 2 for system (2.7) and the result is equivalent to the following condition:

where ${\mathrm{\Gamma}}_{d}={[PD\phantom{\rule{0.25em}{0ex}}0\phantom{\rule{0.25em}{0ex}}0\phantom{\rule{0.25em}{0ex}}0\phantom{\rule{0.25em}{0ex}}0\phantom{\rule{0.25em}{0ex}}hRD]}^{T}$ and ${\mathrm{\Gamma}}_{e}=[-{E}_{c}\phantom{\rule{0.25em}{0ex}}{E}_{a}\phantom{\rule{0.25em}{0ex}}{E}_{b}\phantom{\rule{0.25em}{0ex}}0\phantom{\rule{0.25em}{0ex}}0\phantom{\rule{0.25em}{0ex}}0]$.

Applying the Schur complement shows that (3.5) is equivalent to (3.1). This completes the proof. □

If the upper bound of the derivative of time-varying delay ${h}_{d}$ is unknown, Theorem 2 can be reduced to the result with $Q=0$ and $W=0$, we have the following Corollary 1.

**Corollary 1**

*For given positive scalars*

*h*

*and*

*α*,

*the system*(2.7)

*is exponentially robust stable if there exist symmetric positive*-

*definite matrices*$P={P}^{T}>0$, $R={R}^{T}>0$, $U={U}^{T}>0$,

*diagonal matrices*$S\ge 0$, ${\mathrm{\Lambda}}_{1}\ge 0$, ${\mathrm{\Lambda}}_{2}\ge 0$, $\epsilon >0$

*and*

*such that the following LMIs are true*:

*and*

*where*

*Proof* If the matrix $Q=W=0$ is selected in (2.22). This proof can be completed in a formulation similar to Theorem 1 and Theorem 2. □

Based on that, a convex optimization problem is formulated to find the bound on the allowable delay time *h* and exponential convergence rate *α* which maintains the recurrent neural network time delay with parameter uncertainties systems (2.7).

**Remark 1** It is interesting to note that *h* and *α* appear linearly in (2.19), (3.1), and (3.6). Thus a generalized eigenvalue problem (GEVP) as defined in Boyd *et al.* [1] can be formulated to solve the minimum acceptable $1/h$ (or $1/\alpha $) and therefore the maximum *h* (or *α*) to maintain robust stability as judged by these conditions.

The lower bound of exponential convergence rate or the allowable time delay conditions can be determined by solving the following three optimization problems.

*h*.

If the change rate of time delay is equal to 0, *i.e.*, $h(t)=h$, then the system (2.7) reduces to the neural networks with constant delay, and, consequently, Theorem 1 reduces to Corollary 1.

The lower bound of exponential convergence rate or the allowable time delay conditions can be determined by solving the following two optimization problems.

*h*.

**Remark 2** All the above optimization problems (Op1-Op5) can be solved by the MATLAB LMI toolbox. Especially, Op1 and Op4 can estimate the lower bound of the global exponential convergence rate *α*, which means that the exponential convergence rate of any neural network included in (2.7) is at least equal to *α*. It is useful in real-time optimal computation.

## 4 Numerical examples

This section provides four numerical examples to demonstrate the effectiveness of the presented criterion.

**Example 1**Consider the delayed neural network (2.18) as follows:

The neuron activation functions are assumed to satisfy Assumption 1 with $K=diag\{1,1\}$.

*Solution*: It is assumed that the upper bound $\overline{h}$ is fixed as 1. The exponential convergence rates for various ${h}_{d}$’s obtained from Theorem 1 and those in [4, 11, 17] are listed in Table 1. In the following, in Tables 1-2, ‘-’ means that the results are not applicable to the corresponding cases, and ‘unknown ${h}_{d}$’ means that ${h}_{d}$ can have arbitrary values, even ${h}_{d}$ is very large or $h(t)$ is not differentiable.

**Maximum allowable exponential convergence rate (MAECR)**
$\overline{\mathit{\alpha}}$
**for various**
${\mathit{h}}_{\mathit{d}}$
**and**
$\overline{\mathit{h}}\mathbf{=}\mathbf{1}$

On the other hand, if the exponential convergence rate of *α* is fixed as 0.8, the upper bounds of $\overline{h}$ for various ${h}_{d}$’s from Theorem 1 and those in [4, 11, 17] are listed in Table 2.

*i.e.*, ${h}_{d}=0$, the obtained result in Theorem 1 is much better than that in [17]. Furthermore, when the delay is time varying, the theorem in [17] fails to obtain the allowable exponential convergence rate of the exponential stable neural network system, but Theorem 1 in this paper can also obtain significantly better results than that in [4, 11], which guarantees the exponential stability of the neural networks. Moreover, when the exponential convergence rate of

*α*is fixed as 0.8, the upper bounds of $\overline{h}$ for various ${h}_{d}$’s derived by Theorem 1 are also better than those in [4, 11, 17] from Table 2. The reason is that, compared with [4, 11, 17], our results not only do not ignore any useful terms in the derivative of Lyapunov-Krasovskii functional but also consider the relationship among $\overline{h}$, $h(t)$, and $h-h(t)$. Figure 1 shows the state response of Example 1 with time delay $\overline{h}=1.59$, when the initial value is ${[-1\phantom{\rule{0.25em}{0ex}}1]}^{T}$.

**Example 2**Consider the delayed neural network (2.18) as follows:

The neuron activation functions are assumed to satisfy Assumption 1 with $K=diag\{0.4911,0.9218,0.6938\}$.

*Solution*: It is assumed that the exponential convergence rate of

*α*is fixed as zero. The upper bounds of

*h*for various ${h}_{d}$’s from Theorem 1 and those in [4–6, 11] are listed in Table 3. It is also clear that the obtained upper bounds of $\overline{h}$ in this paper are better than those in [4–6, 11], which guarantee the asymptotic stability of neural networks. The reason is that our results do not ignore any useful negative terms in the derivative of Lyapunov-Krasovskii functional compared with [4, 6], and our results also consider the relationship among $\overline{h}$, $h(t)$, and $h-h(t)$ compared with [5, 11].

**Example 3**Consider the following uncertain delayed neural network:

The neuron activation functions are assumed to satisfy Assumption 1 with $K=diag\{1,1\}$.

*Solution*: We let ${h}_{d}=0.1$ and $h=0.5$ as [9] did and, by Theorem 2, we can obtain the maximum allowable exponential convergence rate (MAECR) $\overline{\alpha}$ size to be $\overline{\alpha}=0.4742$. However, applying the criteria in [9], the maximum value of $\overline{\alpha}$ for the above system is 0.1. This example demonstrates that our robust stability condition gives a less conservative result. Hence, it is obvious that the results obtained from our simple method are less conservative than those obtained by existing methods. The maximum allowable exponential convergence rate (MAECR) $\overline{\alpha}$ for various

*h*from Theorem 2 are listed in Table 4.

**Maximum allowable exponential convergence rate (MAECR)**
$\overline{\mathit{\alpha}}$
**for various**
h
**and**
${\mathit{h}}_{\mathit{d}}\mathbf{=}\mathbf{0.1}$

h | 0.1 | 0.2 | 0.5 | 1 | 2 | 5 | 10 |
---|---|---|---|---|---|---|---|

$\overline{\alpha}$ | 2.1155 | 0.9885 | 0.4742 | 0.3069 | 0.2343 | 0.1270 | 0.0805 |

**Example 4**Consider the following delayed neural network:

The neuron activation functions are assumed to satisfy Assumption 1 with $K=diag\{0.31,0.40,0.23\}$.

*Solution*: Let ${h}_{d}\ge 1$ and $\alpha =0.5$. Using the MATLAB LMI toolbox, the conditions of Theorem 2 can be met, and then we get the global robust exponential stability in this example for $h\le 0.3970$ and

For this case, it can be verified that the stability conditions in [10, 13] are not applicable when ${h}_{d}\ge 1$. This implies that for this example the stability condition in Theorem 2 in this paper is less conservative than those in [10, 13].

**Remark 3** In this paper, we are mainly concerned with exponential stability. For this reason another practical background and other definitions have not been introduced. Among them, exponential stability provides a useful measure for the decaying rate, or convergence speed. It is also worth pointing out that the main results in this paper can easily be extended to exponential stability for neural networks with time-varying delays by the same approach used in [8]. Note that we mainly focus on the effects brought about by the maximum allowable delay bound (MADB) $\overline{h}$ and exponential convergence rate (MAECR) $\overline{\alpha}$ in this paper.

**Remark 4** Some comparisons have been made with the same examples that appear in many recent papers. Our results show them to be less conservative than those reports.

## 5 Conclusion

In this paper, we have proposed some new delay dependent sufficient conditions for the global robust exponential stability analysis of a class of delayed neural networks with time-varying delays and parameter uncertainties. We have discussed the advantage of the assumption condition investigated in our paper over those in previous studies in the literature. Some global exponential stability criteria, which depend on time delay, are derived via the approach of the Lyapunov-Krasovskii functional. Four numerical examples are given to show the significant improvement over some existing results in the literature. In addition, the method proposed in this paper can easily be extended to solve the stability or exponential stability problem for delayed neural networks with distributed delay.

## Declarations

## Authors’ Affiliations

## References

- Boyd S, El Ghaoui L, Feron E, Balakrishnan V SIAM Studies in Applied Mathematics. In
*Linear Matrix Inequalities in System and Control Theory*. SIAM, Philadelphia; 1994.View ArticleGoogle Scholar - Gahinet P, Nemirovski A, Laub A, Chilali M:
*LMI Control Toolbox User’s Guide*. The Mathworks, Natick; 1995.Google Scholar - He Y, Wu M, She JH, Liu GP: Parameter-dependent Lyapunov functional for stability of time-delay systems with polytopic-type uncertainties.
*IEEE Trans. Autom. Control*2004, 49: 828–832. 10.1109/TAC.2004.828317MathSciNetView ArticleGoogle Scholar - He Y, Wu M, She JH: Delay-dependent exponential stability of delayed neural networks with time-varying delay.
*IEEE Trans. Circuits Syst. II, Express Briefs*2006, 53: 553–557.View ArticleGoogle Scholar - He Y, Liu GP, Rees D: New delay-dependent stability criteria for neutral networks with time-varying delay.
*IEEE Trans. Neural Netw.*2007, 18: 310–314.View ArticleGoogle Scholar - Hua CC, Long CN, Guan XP: New results on stability analysis of neural networks with time-varying delays.
*Phys. Lett. A*2006, 352: 335–340. 10.1016/j.physleta.2005.12.005View ArticleGoogle Scholar - Liu PL: Robust exponential stability for uncertain time-varying delay systems with delay dependence.
*J. Franklin Inst.*2009, 346: 958–968. 10.1016/j.jfranklin.2009.04.005MathSciNetView ArticleGoogle Scholar - Liu PL: Improved delay-dependent robust stability criteria for recurrent neural networks with time-varying delays.
*ISA Trans.*2013, 52: 30–35. 10.1016/j.isatra.2012.07.007View ArticleGoogle Scholar - Park JH: Further note on global exponential stability of uncertain cellular neural networks with variable delays.
*Appl. Math. Comput.*2007, 188: 850–854. 10.1016/j.amc.2006.10.036MathSciNetView ArticleGoogle Scholar - Song QK: Exponential stability of recurrent neural networks with both time-varying delays and general activation functions via LMI approach.
*Neurocomputing*2008, 71: 2823–2830. 10.1016/j.neucom.2007.08.024View ArticleGoogle Scholar - Xiang M, Xiang ZR:Stability, ${L}_{1}$-gain and control synthesis for positive switched systems with time-varying delay.
*Nonlinear Anal. Hybrid Syst.*2013, 9(1):9–17.MathSciNetView ArticleGoogle Scholar - Xiang ZR, Liu SL, Chen QW: An improved exponential stability criterion for discrete-time switched non-linear systems with time-varying delays.
*Trans. Inst. Meas. Control*2013, 35(3):353–359. 10.1177/0142331212448271View ArticleGoogle Scholar - Xiang M, Xiang ZR: Exponential stability of discrete-time switched linear positive systems with time-delay.
*Appl. Math. Comput.*2014, 230: 193–199.View ArticleGoogle Scholar - Wu X, Wang YN, Huang LH, Zuo Y: Robust exponential stability criterion for uncertain neural networks with discontinuous activation functions and time-varying delays.
*Neurocomputing*2010, 73: 1265–1271. 10.1016/j.neucom.2010.01.002View ArticleGoogle Scholar - Xu SY, Lam J: A new approach to exponential stability analysis of neural networks with time-varying delays.
*Neural Netw.*2006, 19: 76–83. 10.1016/j.neunet.2005.05.005View ArticleGoogle Scholar - Yuan K, Cao J, Deng J: Exponential stability and periodic solutions of fuzzy cellular neural networks with time-varying delays.
*Neurocomputing*2006, 69: 1619–1627. 10.1016/j.neucom.2005.05.011View ArticleGoogle Scholar - Zhang Q, Wei X, Xu J: Delay-dependent exponential stability of cellular neural networks with time-varying delays.
*Chaos Solitons Fractals*2005, 23: 1363–1369. 10.1016/j.chaos.2004.06.036MathSciNetView ArticleGoogle Scholar - Chua L, Yang L: Cellular neural networks: theory.
*IEEE Trans. Circuits Syst.*1988, 35: 1257–1272. 10.1109/31.7600MathSciNetView ArticleGoogle Scholar

## Copyright

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited.