- Research
- Open Access

# Exponential input-to-state stability of composite stochastic systems

- Fakhreddin Abedi
^{1}Email author, - Wah June Leong
^{1}and - Sarkhosh Seddighi Chaharborj
^{1}

**2013**:208

https://doi.org/10.1186/1687-1847-2013-208

© Abedi et al.; licensee Springer 2013

**Received:**13 March 2013**Accepted:**26 June 2013**Published:**11 July 2013

## Abstract

Sufficient conditions for the exponential input-to-state stability in probability in *r* th mean and for the almost sure exponential input-to-state stability in probability of a composite stochastic system are established. Illustrating example is provided to validate our results.

**MSC:**60H10, 93C10, 93D05, 93D15, 93D21, 93E15.

## Keywords

- composite stochastic control system
- control Lyapunov function
- exponential input-to-state stability in probability

## 1 Introduction

The stability of deterministic control systems has been widely developed in the past few decades (see, for instance, Sontag and Wang [1], Grune [2], Karafyllis and Tsinias [3], Ning *et al.* [4]). In these papers, necessary and sufficient conditions for input-to-state stability at the equilibrium state of deterministic control systems were provided. On the other hand, the asymptotic stability, exponential stability and input-to-state stability in probability at the equilibrium state of stochastic control systems (SCS) were established by Mao [5], Liu and Raffool [6], Lan and Dang [7], Abedi *et al.* [8, 9], Abedi and Leong [10], Khasminiskii [11], Kushner [12], Tsinias [13], Ito [14], Liu *et al.* [15], Duan *et al.* [16] and Yu and Xie [17]. Particularly, Ito [14] developed the properties of input-to-state stability and gave the design of controller by using nonlinear small-gain conditions. While Liu *et al.* [15] discussed the property of practical stochastic input-to-state stability and its application to stability of cascaded nonlinear systems. The concept of integral input-to-state stability to the stochastic nonlinear systems was generalized by Yu and Xie [17] and Duan *et al.* [16] and state feedback controller that guarantees that all the signals of the resulting closed-loop system are bounded almost surely was also given.

Michel [18] developed exponential stability in probability of a continuous and discrete parameters composite stochastic system. Later, Boulanger [19] derived sufficient conditions for asymptotic stability in probability and exponential stability in mean square for a special case of our composite stochastic control system (CSCS). The sufficient conditions for exponential stability in probability of nonlinear stochastic systems, which are the special case of our CSCS, were established by Rusinek [20].

The purpose of the paper is to fill the gaps in the literature by studying the exponential input-to-state stability in probability in *r* th mean (REISSP) and the almost sure exponential input-to-state stability in probability (AEISSP) of a CSCS. We take this fact into account to extend the REISSP and AEISSP results established by Spiliotis and Tsinias [21] for SCS to the broader class of CSCS driven by two independent Wiener processes that were considered in Boulanger [19] and Rusinek [20]. The main results of our work enable us to derive sufficient conditions for REISSP and AEISSP of the CSCS. We also establish the existence of an explicit formula for a feedback law exhibiting the REISSP and AEISSP property.

The rest of the paper is organized as follows. In Section 2, we introduce a wider class of CSCS and we also recall some basic definitions and results relating the REISSP and AEISSP property. Finally in Section 3, we use the results of Section 2 and prove that the CSCS satisfies the REISSP and AEISSP property. We also provide a numerical example to illustrate our results.

## 2 Assumptions and preliminaries

The aim of this section is to introduce a class of stochastic differential systems (SDS) and recall some basic definitions and theorems concerning an exponential control Lyapunov function for the exponential stability in probability of this system that we are dealing with in the rest of the paper. We also focus on the properties of the exponential control Lyapunov function, which plays an important role in the exponential stability, in Section 3.

Let $(\mathrm{\Omega},F,P)$ be a complete probability space, and denote by ${({w}_{t})}_{t\ge 0}$ a standard ${\mathbb{R}}^{m}$-valued Wiener process defined on this space.

*f*and

*h*are Lipschitz functionals mapping from ${\mathbb{R}}^{n}$ into ${\mathbb{R}}^{n}$ and ${\mathbb{R}}^{n\times m}$, respectively, vanishing at the origin and there exists a nonnegative constant

*C*such that for any $x\in {\mathbb{R}}^{n}$, the following growth condition holds:

is the infinitesimal generator for the stochastic process solution of SDS (1). Then we can recall the definition of exponential stability in probability in mean square and the stochastic version of the converse Lyapunov theorem established by Khasminskii [11] as follows.

**Definition 2.1**We say that the origin is exponentially stable in probability in mean square with respect to SDS (1) if and only if there exist constants ${c}_{1},{c}_{2}>0$ such that

**Theorem 2.2**

*Suppose that the origin is exponentially stable in probability in mean square with respect to SDS*(1).

*Then there exist a Lyapunov function*$\mathrm{\Phi}:{\mathbb{R}}^{n}\to {\mathbb{R}}^{+}$

*and positive constants*${a}_{i}$, $1\le i\le 5$,

*such that*

*where* ∇ *is the gradient operator and* **D** *is given in* (3).

- (1)
*u*is an ${\mathbb{R}}^{p}$-valued measurable control law, - (2)
*F*and*G*are Lipschitz functionals mapping from ${\mathbb{R}}^{r}\times {\mathbb{R}}^{p}$ into ${\mathbb{R}}^{r}$, and ${\mathbb{R}}^{r}\times {\mathbb{R}}^{q}$, respectively, such that they are vanishing at the origin and there exists constant $C\ge 0$ such that for any $\upsilon \in {\mathbb{R}}^{r}$ and $u\in {\mathbb{R}}^{p}$, the following growth condition holds:$|F(\upsilon ,u)|+|G(\upsilon ,u)|\le C(1+|\upsilon |+|u|).$(8)

Under restriction on growth (8) (see, for instance, Arnold [22]), for every input $u\in {\mathbb{R}}^{p}$, ${\upsilon}_{0}\in {\mathbb{R}}^{r}$ and ${t}_{0}\in \mathbb{R}$, there exists a unique solution $V(t,{t}_{0},{\upsilon}_{0},u)$ of (7) starting from ${\upsilon}_{0}$ at time $t={t}_{0}$ which is defined for all $t\ge {t}_{0}$ and almost all $\beta \in \mathrm{\Omega}$. In the following we assume $V(t)=V(t,{t}_{0},\upsilon ,u)$ and we recall the definition of RESP, AESP and the stochastic version of the converse Lyapunov theorem proved by Spiliotis and Tsinias [21] as follows.

**Definition 2.3**We say that the origin is RESP with respect to SCS (7) for some $r>0$ if and only if there exist constants ${c}_{1},{c}_{2}>0$ such that

**Definition 2.4**SCS (7) is said to satisfy the exponential Lyapunov condition if there exists a Lyapunov function $\mathrm{\Phi}:{\mathbb{R}}^{r}\to {\mathbb{R}}^{+}$ of class ${C}^{2}({\mathbb{R}}^{r}\mathrm{\setminus}\{0\})$ and positive constants ${a}_{i}$, $1\le i\le 5$, such that

where **Y** is the infinitesimal generator for the stochastic process solution of SCS (7).

**Theorem 2.5** *Suppose that the origin is RESP with respect to SCS* (7). *Then there exists a Lyapunov function* $\mathrm{\Phi}:{\mathbb{R}}^{r}\to {\mathbb{R}}^{+}$ *of class* ${C}^{2}({\mathbb{R}}^{r}\mathrm{\setminus}\{0\})$ *which satisfies all conditions* (10)-(12).

**Definition 2.6**We say that the origin is AESP with respect to SCS (7) if and only if there exist a constant $c>0$ and a random variable $0\le {B}_{\upsilon ,u}<\mathrm{\infty}$ such that

Note that Definition 2.3 and Theorem 2.5 in Spiliotis and Tsinias [21] are an extension of Definition 2.1 and Theorem 2.2, respectively, established in Khasminskii [11]. Now, we recall the definition of REISSP and AEISSP exposed in [21] as follows.

**Definition 2.7**We say that the origin is REISSP with respect to SCS (7) if there exist a positive definite function $\gamma :{\mathbb{R}}^{+}\to {\mathbb{R}}^{+}$ and constants ${c}_{1},{c}_{2}>0$ such that (9) holds and

**Definition 2.8** We say that the origin is AEISSP with respect to SCS (7) if, there exist a positive definite function $\gamma :{\mathbb{R}}^{+}\to {\mathbb{R}}^{+}$, constant $c>0$, and a random variable ${B}_{\upsilon ,u}<\mathrm{\infty}$ such that (13) and (14) hold for any $\upsilon \in {\mathbb{R}}^{r}$, and $t\ge {t}_{0}$.

We shall now turn the attention to a broader class of CSCS and provide some results related to the REISSP and AEISSP of this system.

Let us first introduce a general composite stochastic system.

where the following conditions hold:

(H1) $x\in {\mathbb{R}}^{n}$, $\upsilon \in {\mathbb{R}}^{r}$, and *D* is a matrix function with value in ${M}_{r\times r}(\mathbb{R})$,

(H2) *f* and *h* are functionals in ${C}^{2}({\mathbb{R}}^{n},{\mathbb{R}}^{n})$ and ${C}^{2}({\mathbb{R}}^{n},{\mathbb{R}}^{n\times m})$, respectively, such that $f(0)=h(0)=0$,

*υ*such that

(H4) *u* is an ${\mathbb{R}}^{p}$-valued measurable control law,

*C*such that the following growth condition holds:

By considering the results on EISSP exposed in [21], we can establish the following outcome.

**Lemma 2.9**

*CSCS*(17)

*satisfies the REISSP and AEISSP property if and only if*$0\in {\mathbb{R}}^{n}$

*is RESP and AESP*,

*respectively*,

*for the system*

*where* $\theta \in I=\{\theta \in {\mathbb{R}}^{p}:|\theta |\le 1\}$.

*Proof* The proof of this lemma is a direct consequence of Definitions 2.3, 2.6-2.8 and the fact that each solution $(x(t),\upsilon (t))$ of (18) that corresponds to some $u(\cdot )$ coincides with the solution of (17) with the same initial ${x}_{0}$, ${\upsilon}_{0}$ and ${t}_{0}$ and corresponding to $u=\gamma (|\upsilon |)\theta $, namely, satisfying (14). Conversely, each solution $(x(t),\upsilon (t))$ of (17) under restriction (14) is a solution of (18) with input $\theta =u/\gamma (|\upsilon |)$ and the same initial value. □

In the next section we establish the state feedback law that guarantees the satisfaction of the REISSP and AEISSP property for CSCS (17).

## 3 Main stability results

The REISSP and AEISSP results proved in this paper employ the technique which is a combination of those by Sontag and Wang [1, 23], *i.e.*, decomposition for a deterministic control system, and Spiliotis and Tsinias [21], *i.e.*, decomposition in stochastic case for the SCS. We use these decompositions to obtain the existing exponential stability results for the CSCS. In the following theorem, we assume that the functions *g* and *q* are bounded on ${\mathbb{R}}^{n}\times {\mathbb{R}}^{p}$ and *U* is the set of admissible control. To establish sufficient conditions for REISSP and AEISSP of CSCS (17), we use Lemma 2.9 and show that the origin is RESP and AESP for CSCS (18). Theorem 3.1 can be viewed as a stochastic extension of Proposition 4.1 and Theorem 4.1 stated in Spiliotis and Tsinias [21] and Boulanger [19], respectively, to a general composite stochastic system. Both the results and the tools used in this theorem, however, are different from those in [19, 21]. Furthermore, we can consider the exponential stability results of Boulanger [19] as a special case of our REISSP results (Theorem 3.1) where $r=2$.

**Theorem 3.1**

*Consider CSCS*(17).

*Assume that the function*$\gamma :{\mathbb{R}}^{+}\to {\mathbb{R}}^{+}$

*is positive definite with bounded first derivative*${\gamma}^{(1)}$,

*and for all*$|u|\le \gamma (|\upsilon |)$,

*there exists a*${C}^{2}({\mathbb{R}}^{r}\mathrm{\setminus}\{0\})$

*function*Φ

*satisfying the exponential Lyapunov condition*.

*Furthermore*,

*assume that*

*Then the state control law*

*where* ${\mathrm{\Phi}}_{1}$ *is a smooth Lyapunov function corresponding to SDS* (1) *and* ${k}_{1}:{\mathbb{R}}^{r}\to {\mathbb{R}}^{p}$ *is a state control law corresponding to the resulting closed*-*loop system deduced from* (16), *renders CSCS* (17) *satisfying the REISSP and AEISSP property*.

*Proof*For the proof of this theorem, we shall use Lemma 2.9 and show that REISSP and AISSP are satisfied for CSCS (17) if and only if the origin is RESP and AESP for CSCS (18). Assume that the function $\mathrm{\Phi}(V(t))$ satisfies the exponential Lyapunov condition with respect to CSCS (17). Obviously, by our hypothesis, the function $\mathrm{\Phi}(V(t))$ satisfies the exponential Lyapunov condition with respect to CSCS (18). We now show that the origin satisfies RESP and AESP for CSCS (18). First we prove that the equilibrium of CSCS (18) is satisfied in the RESP property. Since the exponential Lyapunov condition is fulfilled for CSCS (18), there exists a Lyapunov function $\mathrm{\Phi}(V(t))$ and positive constants ${a}_{i}$, $1\le i\le 5$, such that (10)-(12) hold. Consider the composite function

Hence, the desired condition (9) is a direct consequence of inequalities (10) and (25). Therefore, CSCS (18) satisfies the RESP property at the origin. It turns out by Lemma 2.9 that CSCS (17) satisfies the REISSP property.

From (28) we have $\mathrm{\Phi}(V(t))\le {K}_{x,\upsilon}<\mathrm{\infty}$ for all $t\ge 0$, almost surely, for some random ${K}_{x,\upsilon}\ge {B}_{x,\upsilon}$. The latter in conjunction with (10), (25) and (26) implies (13). Thus, CSCS (18) satisfies the AESP property at the origin. It turns out by Lemma 2.9 that CSCS (17) will also satisfy the AEISSP property, which completes the proof. □

The following proposition (Proposition 3.2) is a stochastic extension of Proposition 4.2 stated in Spiliotis and Tsinias [21] to a general composite stochastic system.

**Proposition 3.2**

*Consider CSCS*(17).

*Assume that conditions*(H1)-(H5)

*hold and the origin is RESP with zero input*(

*namely*, (9)

*holds with*$u=0$).

*Then REISSP holds for certain linear positive definite function*$\overline{\gamma}$,

*where*,

*for some linear function*$\overline{\gamma}$,

*Proof*Suppose that the origin of CSCS (17) satisfies the RESP property. From (24) it turns out, by the converse Lyapunov theorem (Theorem 2.5), that there exist positive constants ${a}_{i}$, $1\le {a}_{i}\le 5$, and ${a}_{5}^{\prime}$ such that conditions (10)-(11) hold and

**D**, ${\mathbf{Y}}_{2}$, ${\mathbf{D}}_{\upsilon}$ are the infinitesimal generators for the stochastic process solutions of systems (1), (16), (22), respectively, and ${\mathrm{\Phi}}_{1}(x)$, ${\mathrm{\Phi}}_{2}(\upsilon )$, $\mathrm{\Phi}(V(t))$ are the Lyapunov functions corresponding to the systems (1), (16), (22), respectively. It then follows from (29) that

for some positive constant *k* and certain $0<{c}_{5}<{a}_{5}$, $0<{c}_{5}^{\prime}<{a}_{5}^{\prime}$. The rest of the proof is a consequence of Theorem 3.1 and is, therefore, omitted. □

**Remark 3.3**Comparing our main results to the existing ones in [19–21], we can make the following summaries:

- (i)
Theorem 3.1 is the stochastic extension of Proposition 4.1 and Theorem 4.1 stated in Spiliotis and Tsinias [21] and Boulanger [19], respectively, to a general composite stochastic system. Both the results and the tools used in this theorem, however, are different from those in [19, 21]. Furthermore, we can consider the exponential stability results of Boulanger [19] as a special case of our REISSP results (Theorem 3.1) where $r=2$.

- (ii)
Proposition 3.2 is the stochastic extension of Proposition 4.2 stated in Spiliotis and Tsinias [21] to a general composite stochastic system. In addition, the existing exponential stability results established in [19, 20] and [21] do not permit us to make a conclusion about REISSP and AEISSP for the broader class of CSCS (15) at the origin, whereas the results of this paper are still valid.

Finally, we conclude the paper by designing a numerical example to validate our results.

**Example 3.4**Consider the CSCS

*u*is a real-valued measurable control law, $g(x,\upsilon )=q(x,\upsilon )=2$ and $D=I$ is the identity matrix in ${M}_{r\times r}(\mathbb{R})$. Consider the Lyapunov function candidate

*et al.*[8].) Then, according to Theorem 3.1, the state control law

guarantees that CSCS (30) satisfies the REISSP and AEISSP property.

## 4 Conclusions

We have developed the exponential input-to-state stability in probability of a larger class of multi-input composite system (15). We have used the stochastic version of converse Lyapunov theorems derived by Khasminiskii [11] and Spiliotis and Tsinias [21] to the concept of stochastic control Lyapunov function and extended the REISSP and the AEISSP results provided by Spiliotis and Tsinias [21] for a stochastic system to the larger class of composite stochastic systems driven by two independent Wiener processes that were considered in Boulanger [19] and Rusinek [20]. The main results of our work enable us to derive the sufficient conditions for REISSP and AEISSP of a composite stochastic system. We have also established the existence of an explicit formula of a feedback law exhibiting the REISSP and AEISSP property of a composite stochastic system.

## Declarations

### Acknowledgements

The authors thank the referees for valuable comments and suggestions which improved the presentation of this manuscript.

## Authors’ Affiliations

## References

- Sontag DE, Wang Y: Lyapunov characterizations of input to output stability.
*SIAM J. Control Optim.*2000, 39(1):351-359.MathSciNetView ArticleGoogle Scholar - Grune L: Input-to-state dynamical stability and its Lyapunov characterization.
*IEEE Trans. Autom. Control*2002, 47(9):1499-1504. 10.1109/TAC.2002.802761MathSciNetView ArticleGoogle Scholar - Karafyllis I, Tsinias J: A converse Lyapunov theorem for nonuniform in time global asymptotic stability and its application to feedback stabilization.
*SIAM J. Control Optim.*2003, 42: 936-965. 10.1137/S0363012901392967MathSciNetView ArticleGoogle Scholar - Ning C, He Y, Wu M, Liu Q, She J: Input-to-state stability of nonlinear systems based on an indefinite Lyapunov function.
*Syst. Control Lett.*2012, 61: 1254-1259. 10.1016/j.sysconle.2012.08.009MathSciNetView ArticleGoogle Scholar - Mao X:
*Exponential Stability of Stochastic Differential Equations*. Dekker, New York; 1994.Google Scholar - Liu R, Raffoul Y: Boundedness and exponential stability of highly nonlinear stochastic differential equations.
*Electron. J. Differ. Equ.*2009., 2009: Article ID 143Google Scholar - Lan TTT, Dang NH: Exponential stability of nontrivial solutions of stochastic differential equations.
*Scientia, Ser. A, Math. Sci.*2011, 21: 97-106.Google Scholar - Abedi F, Abu Hassan M, Arifin MN: Lyapunov function for nonuniform in time global asymptotic stability in probability with application to feedback stabilization.
*Acta Appl. Math.*2011, 116(1):107-117. 10.1007/s10440-011-9632-8MathSciNetView ArticleGoogle Scholar - Abedi F, Abu Hassan M, Suleiman M: Feedback stabilization and adaptive stabilization of stochastic nonlinear systems by the control Lyapunov function.
*Stoch. Int. J. Probab. Stoch. Process.*2011, 83(2):179-201. 10.1080/17442508.2011.552723View ArticleGoogle Scholar - Abedi F, Leong JW: Dynamic robust stabilization of stochastic differential control systems.
*IMA J. Math. Control Inf.*2013. 10.1093/imamci/dns040Google Scholar - Khasminskii ZR:
*Stochastic Stability of Differential Equation*. Sijthoff & Noordhoff, Alphen aan den Rijn; 1980.View ArticleGoogle Scholar - Kushner JH: On the stability of processes defined by stochastic difference-differential equation.
*J. Differ. Equ.*1968, 4: 424-443. 10.1016/0022-0396(68)90028-4MathSciNetView ArticleGoogle Scholar - Tsinias J: Stochastic input-to-state stability and applications to global feedback stabilization.
*Int. J. Control*1998, 71: 907-931. 10.1080/002071798221632MathSciNetView ArticleGoogle Scholar - Ito H: State-dependent scaling problems and stability of interconnected iISS and ISS systems.
*IEEE Trans. Autom. Control*2006, 51(10):1626-1643. 10.1109/TAC.2006.882930View ArticleGoogle Scholar - Liu SJ, Zhang JF, Jiang ZP: A notion of stochastic input-to-state stability and its application to stability of cascaded stochastic nonlinear systems.
*Acta Math. Appl. Sin.*2008, 24(1):141-156. 10.1007/s10255-007-7005-xMathSciNetView ArticleGoogle Scholar - Duan N, Xie XJ, Yu X: State feedback stabilization of stochastic nonlinear systems with SiISS inverse dynamics.
*Int. J. Robust Nonlinear Control*2011, 21: 1903-1919. 10.1002/rnc.1677MathSciNetView ArticleGoogle Scholar - Yu X, Xie XJ: Output feedback regulation of stochastic nonlinear systems with stochastic iISS inverse dynamics.
*IEEE Trans. Autom. Control*2010, 55(2):304-320.MathSciNetView ArticleGoogle Scholar - Michel NA: Stability analysis of stochastic composite systems.
*IEEE Trans. Autom. Control*1975, 20(2):246-250. 10.1109/TAC.1975.1100903View ArticleGoogle Scholar - Boulanger C: Stabilization of a class of nonlinear composite stochastic systems.
*Stoch. Anal. Appl.*2000, 18(5):723-735. 10.1080/07362990008809694MathSciNetView ArticleGoogle Scholar - Rusinek RL: String stability of singularly perturbed stochastic systems.
*Ann. Math. Sil.*2003, 16: 43-55.Google Scholar - Spiliotis J, Tsinias J: Notions of exponential robust stochastic stability, ISS and their Lyapunov characterizations.
*Int. J. Robust Nonlinear Control*2003, 13: 173-187. 10.1002/rnc.724MathSciNetView ArticleGoogle Scholar - Arnold L:
*Stochastic Differential Equations: Theory and Applications*. Wiley, New York; 1974.Google Scholar - Sontag DE, Wang Y: On characterizations of input-to-state stability properties.
*Syst. Control Lett.*1995, 24: 226-231.MathSciNetView ArticleGoogle Scholar

## Copyright

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.