 Research
 Open Access
 Published:
A notion of stability in probability of stochastic nonlinear systems
Advances in Difference Equations volume 2013, Article number: 363 (2013)
Abstract
The concepts of stability in probability of nontrivial solutions for stochastic nonlinear systems are analyzed in terms of a control Lyapunov function which is smooth except possibly at the origin. We show under certain hypothesis that the neighborhood of the origin is stable in probability. An illustrating example is provided.
MSC:60H10, 93C10, 93D05, 93D15, 93D21, 93E15.
1 Introduction
In recent years, the stability analysis of stochastic nonlinear systems (SNS) has been one of the most active and important areas in control theory. Although there are many research papers (see, for instance, [1–13]) on the stability of trivial solutions of SNS, but there are very few results on the stability of nontrivial solutions of stochastic systems. It is known that there are many types of stochastic systems all of whose solutions tend to each other although they do not have the trivial solution. These systems are worth being interested in since the solutions with different initial value has similar largetime properties. In this paper, we study the stability in probability of a nontrivial solution of the SNS.
The main results of the present paper is to explore further the stabilization in probability problem for a wider class of SNS than that described in [14]. This paper is also intended to fill in the gap of the previous works by establishing necessary and sufficient conditions for stability in probability of nontrivial solution for the SNS. Our main result, Theorem 3.1, which is an extension of Theorem 3.1 established in [2], asserts that the SNS is stable in probability if and only if it admits a control Lyapunov function (CLF). The main tool used in this paper is a stochastic version of the converse Lyapunov theorem established in Kushner [9].
The paper is organized as follows. In Section 2, we introduce a class of stochastic systems, some basic definitions and properties of stochastic CLF which play an important role in the stability theory. In Section 3, we state and prove the main results of the paper on the stability in probability of nontrivial solution of SNS. Finally, in Section 4, we provide a numerical example to validate our results.
2 Stochastic stability
In this section we first introduce a class of stochastic systems and define the stability in probability of nontrivial solutions of this system. We also focus on the properties of CLF which play an important role to the stability in Section 3.
Let $(\mathrm{\Omega},F,P)$ be a complete probability space, and denote by ${({w}_{t})}_{t\ge 0}$ a standard ${\mathbb{R}}^{m}$valued Wiener process defined on this space.
Consider the following SNS
where $x\in {\mathbb{R}}^{n}$ is the system state vector, $f:{\mathbb{R}}^{+}\times {\mathbb{R}}^{n}\to {\mathbb{R}}^{n}$ and $g:{\mathbb{R}}^{+}\times {\mathbb{R}}^{n}\to {\mathbb{R}}^{n\times m}$ are continuous with $f(t,0)\ne 0$, $g(t,0)\ne 0$, and there exist constants ${C}_{1},{C}_{2}\ge 0$ such that the following conditions hold:
We note that SNS (1) satisfies a sufficient condition, under which there is some unique global solution $x(t,{x}_{0})$ to SNS (1) for any given initial value $x(0)={x}_{0}\in {\mathbb{R}}^{n}$ (see, for instance, Khasminskii [8]).
Throughout this paper we adopt the following notations:

For any ${x}_{0}\in {\mathbb{R}}^{n}$, denote by $x(t)=x(t,{x}_{0})$ the solution of SNS (1).

Denote by $\cdot $ the usual Euclidean norm in ${\mathbb{R}}^{n}$.

We use ${\mathrm{\Phi}}_{0}=\mathrm{\Phi}(0,{x}_{0})$ to denote the initial value of a Lyapunov function.

$\mathcal{N}$ denotes the class of nonnegative ${C}^{0}$ functions $\mu :{\mathbb{R}}^{+}\to {\mathbb{R}}^{+}$, for which ${\int}_{0}^{+\mathrm{\infty}}\mu (t)\phantom{\rule{0.2em}{0ex}}dt<+\mathrm{\infty}$ and ${lim}_{t\to +\mathrm{\infty}}\mu (t)=0$ hold.

${S}_{r}=\{x\in {\mathbb{R}}^{n};x\le r,r>0\}$ is a ball.

We define $\tau \wedge t=min\{\tau ,t\}$.
Definition 2.1 A function $\gamma :{\mathbb{R}}^{+}\to {\mathbb{R}}^{+}$ is a

(i)
Kfunction if it is continuous, strictly increasing and $\gamma (0)=0$, and

(ii)
${K}_{\mathrm{\infty}}$function if it is a Kfunction and also $\gamma (r)\to \mathrm{\infty}$ as $r\to \mathrm{\infty}$.
We now give the definition of stability in probability for SNS (1) when the origin is not a trivial solution. In this case we study the stability in probability of solutions with respect to the small neighborhood of the origin.
Definition 2.2 We say that ${S}_{r}$, $r>0$ is stable in probability if for any $c>r$ and any $\u03f5\in (0,1)$, there exists $\delta =\delta (\u03f5,c)$ such that for all $t\ge {t}_{0}\ge 0$ and ${x}_{0}<\delta $, the following condition holds:
In the following we consider the SNS
where $x\in {\mathbb{R}}^{n}$, $u\in {\mathbb{R}}^{p}$, the dynamics $f(t,x)$, $g(t,x)$ and $h:{\mathbb{R}}^{+}\times {\mathbb{R}}^{n}\to {\mathbb{R}}^{n\times p}$, are continuous and Lipschitz functions with $f(t,0)\ne 0$ and $g(t,0)\ne 0$.
Theorem 3.1 of this paper is an extension of Theorem 3.1 provided in [2] that guarantees the existence of a ${C}^{\mathrm{\infty}}$ control law $u=\varphi (t,x)$ in such a way that ${S}_{r}$ satisfy the stability in probability property with respect to the closedloop system
Denote by D the infinitesimal generator of the stochastic process solution of the uncontrolled part of SNS (3), that is, D is the secondorder differential operator defined for any function Φ in ${C}^{2,1}({\mathbb{R}}^{+}\times {\mathbb{R}}^{n},\mathbb{R})$ by
For any $z\in (1,\dots ,p)$, denote by ${\mathbf{D}}_{z}$ the firstorder differential operator defined for any function Φ in ${C}^{1,1}({\mathbb{R}}^{+}\times {\mathbb{R}}^{n},\mathbb{R})$ by
Define Y as the infinitesimal generator for the stochastic process solution of the closedloop system (4), that is, Y is the differential operator defined for any function Φ in ${C}^{2,1}({\mathbb{R}}^{+}\times {\mathbb{R}}^{n},\mathbb{R})$ by
In the following we extend the concept of stochastic Lyapunov condition introduced in Definition 2.4 provided in [2] used for stability in probability of SNS (3) at the neighborhood of the origin.
Definition 2.3 SNS (3) admits a CLF if there exists a ${C}^{2,1}$ function $\mathrm{\Phi}:{\mathbb{R}}^{+}\times {\mathbb{R}}^{n}\to {\mathbb{R}}^{+}$, class ${K}_{\mathrm{\infty}}$ functions ${a}_{1}$, ${a}_{2}$, a ${C}^{0}$ positive definite function $\rho :{\mathbb{R}}^{+}\to {\mathbb{R}}^{+}$, and a nonnegative ${C}^{0}$ function μ of class $\mathcal{N}$ such that for all $(t,x)\in {\mathbb{R}}^{+}\times {\mathbb{R}}^{n}$, the following conditions hold:
Remark 2.4 We note that condition (6) obtained in Definition 2.3 can be replaced with the following condition
In the next section we will turn the attention to the class of SNS (3) and provide some results related to the stability in probability of this system.
3 Main results
In this section, where the dynamics $f(t,0)$ and $g(t,0)$ may be nonvanishing at the origin, we study the stability in probability of nontrivial solutions of SNS (3). In the following theorem that is an extension of Theorem 3.1 established in [2], we derive the necessary and sufficient conditions for stability in probability of nontrivial solutions of SNS (3).
Theorem 3.1 Consider SNS (3). Then the following three statements are equivalent:

(i)
There exists a ${C}^{\mathrm{\infty}}$ control law $u=\varphi :{\mathbb{R}}^{+}\times {\mathbb{R}}^{n}\to {\mathbb{R}}^{m}$ with $\varphi (t,0)=0$ for all $t\ge 0$ such that ${S}_{r}$ satisfy the stability in probability property with respect to closedloop system (4).

(ii)
There exists a ${C}^{0}$ control law $u=\varphi :{\mathbb{R}}^{+}\times {\mathbb{R}}^{n}\to {\mathbb{R}}^{m}$ with $\varphi (t,0)=0$ for all $t\ge 0$, being locally Lipschitz in x, in such a way that ${S}_{r}$ satisfy the stability in probability property with respect to closedloop system (4).

(iii)
There exists a ${C}^{2,1}$ function $\mathrm{\Phi}:{\mathbb{R}}^{+}\times {\mathbb{R}}^{n}\to {\mathbb{R}}^{+}$, class ${K}_{\mathrm{\infty}}$ functions ${a}_{1}$, ${a}_{2}$, a ${C}^{0}$ positive definite function $\rho :{\mathbb{R}}^{+}\to {\mathbb{R}}^{+}$, and a nonnegative ${C}^{0}$ function μ of class $\mathcal{N}$ such that for all $(t,x)\in {\mathbb{R}}^{+}\times {\mathbb{R}}^{n}$, conditions (5) and (6) hold.
Proof The implication (i) → (ii) is obvious.
We should establish the implication (ii) → (iii). Suppose that there exists a ${C}^{0}$ control law $u=\varphi (t,x)$ (as in statement (ii) of the theorem) such that ${S}_{r}$ satisfies the stability in probability with respect to the closedloop system (4). Then, by the converse Lyapunov theorem (Theorem 2) developed by Kushner [9], which proved the existence of a stochastic Lyapunov function in some neighborhood of the origin, there exists a Lyapunov function Φ in ${C}^{2,1}({\mathbb{R}}^{+}\times {\mathbb{R}}^{n},{\mathbb{R}}^{+})$ and a continuous and positive definite function $k(t,x)$ in such a way that (5) holds and
where Y is the infinitesimal generator for the stochastic process solution of closedloop system (4). The latter inequality implies (6) with $\rho (\mathrm{\Phi}(t,x))=k(t,x)$, $\mu (t)=0$ and ${\mathbf{D}}_{z}\mathrm{\Phi}(t,x)=0$. Therefore, Definition 2.3 holds and the Lyapunov function $\mathrm{\Phi}(t,x)$ is a stochastic CLF for SNS (3).
Next, for (iii) → (i), suppose that there exists a ${C}^{2,1}$ function $\mathrm{\Phi}:{\mathbb{R}}^{+}\times {\mathbb{R}}^{n}\to {\mathbb{R}}^{+}$ such that both conditions (5) and (6) are fulfilled with respect to closedloop system (4). Without any loss of generality, assume
Notice, by virtue of (5), that
Then using (5) and (6) and by applying the converse result of Theorem 3.1 established in [2], condition (6) in conjunction with (8) and (9) enables us to build, by the standard partition of unity arguments, a ${C}^{\mathrm{\infty}}$ control law $u=\varphi (t,x)$ with $\varphi (t,0)=0$ such that
From (10) and $\mathrm{\Phi}(t,x)\ge 0$, we have that ${\mathrm{\Phi}}_{t}=\mathrm{\Phi}(t,x)$ is a supermartingale. Let $\tau =inf\{t\ge 0;x(t)\ge c,c>r\}$ and ${\mathrm{\Phi}}_{0}=\mathrm{\Phi}(0,{x}_{0})$. Invoking Ito’s formula for SNS (3), we get
With (10) and (11) we have
From (12) we obtain
Assume that there exists a nonnegative ${C}^{0}$ function μ of class $\mathcal{N}$ such that
for all $K>0$. Taking into account (10) and (13)(14) yields
Let for a given $\u03f5\in \phantom{\rule{0.2em}{0ex}}]0,1[$, there exist $\delta =\delta (\u03f5,c)\in \phantom{\rule{0.2em}{0ex}}]0,c[$, $c>r$, such that for ${x}_{0}\in {S}_{\delta}$ and ${a}_{1}(c)>\frac{K}{\u03f5}$, the following inequality holds
We note that $x(\tau \wedge t)=x(\tau )=c$ if $\tau \le t$. So,
Then, by taking into account (5) and (17), we have
Thus, from (15)(16) and (18), we have
The latter inequality implies that
Letting $t\to +\mathrm{\infty}$, we obtain
This implies that for given $\u03f5,r\ge 0$ and $c>r$, there exists $\delta \in \phantom{\rule{0.2em}{0ex}}]0,c[$ such that
for all $t\ge {t}_{0}\ge 0$ and ${x}_{0}<\delta $. Therefore, from (20) and Definition 2.2, ${S}_{r}$ is stable in probability with respect to closedloop system (4). This completes the proof of Theorem 3.1. □
4 Application
In this section we illustrate our results by designing a numerical example.
Example 4.1 Consider the SNS
where ${({w}_{t})}_{t\ge 0}$ is a standard realvalued Wiener process, u is a realvalued measurable control law, ${f}_{1}(t,{x}_{1},{x}_{2})={x}_{1}+{x}_{2}^{3}$, ${f}_{2}(t,{x}_{1},{x}_{2})=2$, ${h}_{1}(t,{x}_{1},{x}_{2})=0$, ${h}_{2}(t,{x}_{1},{x}_{2})=1$, ${g}_{1}(t,{x}_{1},{x}_{2})={x}_{1}$, and ${g}_{2}(t,{x}_{1},{x}_{2})=\frac{1}{2}$.
Define the Lyapunov function in the form
A simple calculation shows that
From (22) we have $\mathrm{\Phi}(t,{x}_{1},{x}_{2})=2{x}_{1}^{2}exp(2t)$, and so $\frac{\partial \mathrm{\Phi}}{\partial t}=4{x}_{1}^{2}exp(2t)$, $\frac{\partial \mathrm{\Phi}}{\partial {x}_{1}}=4{x}_{1}exp(2t)$, $\frac{{\partial}^{2}\mathrm{\Phi}}{\partial {x}_{1}^{2}}=4exp(2t)$, and $\frac{\partial \mathrm{\Phi}}{\partial {x}_{2}}=\frac{{\partial}^{2}\mathrm{\Phi}}{\partial {x}_{2}^{2}}=\frac{{\partial}^{2}\mathrm{\Phi}}{\partial {x}_{1}\phantom{\rule{0.2em}{0ex}}\partial {x}_{2}}=\frac{{\partial}^{2}\mathrm{\Phi}}{\partial {x}_{2}\phantom{\rule{0.2em}{0ex}}\partial {x}_{1}}=0$.
Thus, we get
and
Therefore,
The latter inequality implies that both (5) and (6) are fulfilled with $\rho (s)=\frac{1}{2}{s}^{2}$, $\mu (t)=5exp(t)$, ${a}_{1}(s)=\frac{1}{2}{s}^{2}$ and ${a}_{2}(s)=6{s}^{2}$, and thus, by Theorem 3.1, there exists a ${C}^{\mathrm{\infty}}$feedback law $\varphi (t,{x}_{1},{x}_{2})$ with $\varphi (t,0,0)=0$ such that ${S}_{r}$ is stable in probability with respect to the resulting closedloop system deduced from (21).
5 Conclusions
Many authors have paid attention to the subject of stability in probability of trivial solutions of stochastic systems in the past years. On the other hand, it is known that there are many types of stochastic systems all of whose solutions tend to each other although they do not have the trivial solution. In this paper, we have established the stability in probability of nontrivial solutions for SNS (3). We have derived a stochastic version of CLF and provided the necessary and sufficient conditions for stability in probability of a nontrivial solution for SNS (3).
References
 1.
Abedi F, Abu Hassan M, Suleiman M: Feedback stabilization and adaptive stabilization of stochastic nonlinear systems by the control Lyapunov function. Stoch. Int. J. Probab. Stoch. Process. 2011, 83(2):179201. 10.1080/17442508.2011.552723
 2.
Abedi F, Abu Hassan M, Arifin MN: Lyapunov function for nonuniform in time global asymptotic stability in probability with application to feedback stabilization. Acta Appl. Math. 2011, 116(1):107117. 10.1007/s1044001196328
 3.
Abedi F, Leong JW: Dynamic robust stabilization of stochastic differential control systems. IMA J. Math. Control Inf. 2013, 30(4):559569. 10.1093/imamci/dns040
 4.
Chen W, Jiao CL: Finitetime stability theorem of stochastic nonlinear systems. Automatica 2010, 46: 21052108. 10.1016/j.automatica.2010.08.009
 5.
Deng H, Krstic M, Williams JR: Stabilization of stochastic nonlinear systems driven by noise of unknown covariance. IEEE Trans. Autom. Control 2001, 46(8):12371253. 10.1109/9.940927
 6.
Florchinger P: Lyapunovlike techniques for stochastic stability. SIAM J. Control Optim. 1995, 33: 11511169. 10.1137/S0363012993252309
 7.
Handel VR: Almost global stochastic stability. SIAM J. Control Optim. 2006, 45: 12971313. 10.1137/040618850
 8.
Khasminskii ZR: Stochastic Stability of Differential Equation. Sijthoff & Noordhoff, Alphen aan den Rijn; 1980.
 9.
Kushner JH: Converse theorems for stochastic Lyapunov functions. SIAM J. Control Optim. 1967, 5: 228233. 10.1137/0305015
 10.
Lin Z, Liu J, Lin Y, Zhang W: Nonlinear stochastic passivity, feedback equivalence and global stabilization. Int. J. Robust Nonlinear Control 2012, 22: 9991018. 10.1002/rnc.1742
 11.
Spiliotis J, Tsinias J: Notions of exponential robust stochastic stability, ISS and their Lyapunov characterizations. Int. J. Robust Nonlinear Control 2003, 13: 173187. 10.1002/rnc.724
 12.
Trinh H, Fernando T: Functional Observers for Dynamical Systems. Springer, Berlin; 2012.
 13.
Xie XJ, Tian J: Statefeedback stabilization for highorder stochastic nonlinear systems with stochastic inverse dynamics. Int. J. Robust Nonlinear Control 2007, 17(14):13431362. 10.1002/rnc.1177
 14.
Lan TTT, Dang HN: Exponential stability of nontrivial solutions of stochastic differential equations. Scientia, Ser. A, Math. Sci. 2011, 21: 97106.
Acknowledgements
The authors thank the referees for valuable comments and suggestions which improved the presentation of this manuscript.
Author information
Affiliations
Corresponding author
Additional information
Competing interests
The authors declare that they have no competing interests.
Authors’ contributions
All authors read and approved the final manuscript.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Abedi, F., Leong, W.J. & Chaharborj, S.S. A notion of stability in probability of stochastic nonlinear systems. Adv Differ Equ 2013, 363 (2013). https://doi.org/10.1186/168718472013363
Received:
Accepted:
Published:
Keywords
 stability in probability
 stochastic nonlinear systems
 Lyapunov technique