Skip to main content

Partial stochastic asymptotic stability of neutral stochastic functional differential equations with Markovian switching by boundary condition

Abstract

The partial stochastic asymptotic stability of neutral stochastic functional differential equations with Markovian switching (NSFDEwMSs) has been investigated, the sufficient conditions for partial stochastic asymptotic stability have been given. We have used the boundary condition and LV0 to replace the condition LV<0 and have generalized some results of Sharov and Ignatyev to cover a class of much more general NSFDEwMSs.

MSC:39A11, 60H10, 37H10.

1 Introduction

In recent years, Lyapunov’s second method has been a very important method to study the stability of a stochastic differential equation, which has attracted much attention since it is not only academically challenging, but also of practical importance, and has played an important role in many fields such as insurance, finance, population dynamic, control (see, e.g., Øsendal [1]). Recently, much work has been done on stochastic differential equations with Markovian switching (see, e.g., Mao and Yuan [2]). In particular, significant work has appeared on the stability of stochastic differential delay equations with Markovian switching (see, e.g., Kolmanovskii et al. [3], Luo [4], Luo et al. [5], Mao et al. [6], Yuan and Mao [7], Yuan et al. [8], Mao et al. [9], Liu [10, 11]).

On the other hand, many dynamical systems depend not only on present and past states, but also involve derivatives with delays. Motivated by chemical engineering systems as well as the theory of aero elasticity, many researchers have been interested in the neutral stochastic functional differential equations, and the neutral part, which has been used in investigating the qualitative properties of derivatives of delays for dynamical systems, has been added to all kinds of equations. In particular, the significant work has been done (see, e.g., Mao [12], Luo et al. [13]).

The global stability of SDEwMSs with respect to sample paths or moments, which is too strong for many cases, appeared in many more papers. So, the notion of the partial stability (see, e.g., Peiffer and Rouche [14], Rouche et al. [15]) has been involved, and the second method of Lyapunov as an indispensable tool has been used to investigate the partial stability (see, e.g., Sontag and Wang [16], Vorotnikov [17], Vorotnikov and Rumyantsev [18], Ignatyev [19, 20]).

However, in the process of investigating the qualitative properties of equilibria and boundedness properties of motions of dynamical systems, the partial stability as a new concept plays the key role, and the systems are often determined by all kinds of equations, including stochastic differential equations, of course. Motivated by the previously mentioned topic, and since the results of the partial stochastic asymptotic stability of neutral stochastic functional differential equations with Markovian switching are very few, we make the attempt to study this topic to fill the gap.

This paper is organized as follows. In Section 2, we present some basic preliminaries and the form of neutral stochastic functional differential equations with Markovian switching. In Section 3, the sufficient conditions for partial stochastic asymptotic stability have been obtained and proofs have been given. In Section 4, some well-known results are generalized in the remarks. In Section 5, there is the discussion about the main results.

2 Preliminaries and definitions

Let {Ω,F, { F } t 0 ,P} be a complete probability space with a filtration satisfying the usual conditions, i.e., the filtration is continuous on the right and F 0 contains all P-zero sets. B(t) is an m-dimensional Brownian motion defined on the probability space. Let C([τ,0]; R n ) denote the family of functions φ from [τ,0] to R n that are right-continuous and have limits on the left. C([τ,0]; R n ) is equipped with the norm φ= sup τ s 0 |φ(s)| and |x|= x T x for any x R n . If A is a vector or matrix, its trace norm is denoted by |A|= trace ( A T A ) , while its operator norm is denoted by A=sup{|Ax|:|x|=1}. Denote C F 0 b ([τ,0]; R n ) to be the family of all F 0 -measurable bounded C([τ,0]; R n )-valued random variables ξ={ξ(θ):τθ0}. Let p>0, t0, L F t p ([τ,0]; R n ) denote the family of all F t measurable, C([τ,0]; R n )-valued random variables φ={φ(θ):τθ0} such that sup τ θ 0 E | φ ( θ ) | p <.

Let {r(t),t R + =[0,+)} be a right-continuous Markov chain on the probability space {Ω,F, { F } t 0 ,P} taking values in a finite state space S={1,2,,N} with a generator Γ= ( γ i j ) N × N given by

P ( r ( t + Δ ) = j | r ( t ) = i ) ={ γ i j Δ + o ( Δ ) , if  i j , 1 + γ i i Δ + o ( Δ ) , if  i = j ,

where Δ>0. Here γ i j 0 is the transition rate from i to j, if ij, while

γ i i = j i γ i j .

We assume that the Markov chain r() is independent of the Brownian motion B(). It is known that almost every sample path of r(t) is a right-continuous step function with a finite number of simple jumps in any finite sub-interval of R + .

Consider the following neutral stochastic functional differential equation with Markovian switching:

d [ x ( t ) G ( x t ) ] =f ( t , x t , r ( t ) ) dt+g ( t , x t , r ( t ) ) dB(t),t>0,
(2.1)

with the initial condition x 0 =ξ= ( ξ 1 , ξ 2 ) T C F 0 b ([τ,0]; R n ), where ξ 1 R k and ξ 2 R p , k+p=n, which is independent of B(), and x t ={x(t+θ):τθ0}. Let x ( t ) ˜ =x(t)G( x t ). Here, we furthermore assume that

f : R + × C ( [ τ , 0 ] ; R n ) × S R n , g : R + × C ( [ τ , 0 ] ; R n ) × S R n × m , G : C ( [ τ , 0 ] ; R n ) R n .

For our purpose, we impose the following assumptions which can ensure the existence and uniqueness of a solution, denoted by x(t) on t>0, for equation (2.1). Let f and g satisfy the local Lipschitz and linear growth condition. That is, for each d>0, there exist constants h>0, C d >0 and κ(0,1) such that

| f ( t , φ 1 , i ) f ( t , φ 2 , i ) | 2 | g ( t , φ 1 , i ) g ( t , φ 2 , i ) | 2 C d φ 1 φ 2 2 , | f ( t , φ , i ) | 2 | g ( t , φ , i ) | 2 h ( 1 + φ 2 ) , | G ( φ ) | κ φ .

Denote x= ( x 1 , x 2 ) T R n , where x 1 R k and x 2 R p , k+p=n, and the definitions of x ˜ = ( x 1 ˜ , x 2 ˜ ) T R n and G( x t )= ( G 1 ( x t ) , G 2 ( x t ) ) T R n are similar to x= ( x 1 , x 2 ) T . The domain B K ={x R n :| x 1 |<K,| x 2 |<}, and the stopping time σ B is the first exit time from the B K of the sample path of the process x(t). Let K, then σ B . Denote the set of functions C:={ϕ: R + R + , continuous, monotonically increasing and ϕ(0)=0}.

Denote by C 1 , 2 ( R + × R n ×S; R + ) the family of all non-negative functions V(t,x,i) on R + × R n ×S, which are twice continuously differential with respect to x and once continuously differential with respect to t. For any (t,x,i) R + × R n ×S, define an operator LV by

L V ( t , x t , i ) = V t ( t , x ( t ) ˜ , i ) + V x ( t , x ( t ) ˜ , i ) f ( t , x t , i ) + 1 2 trace [ g T ( t , x t , i ) V x x ( t , x ( t ) ˜ , i ) g ( t , x t , i ) ] + j = 1 N γ i j V ( t , x ( t ) ˜ , j ) ,

where

V t = V ( t , x , i ) t , V x = ( V ( t , x , i ) x 1 , , V ( t , x , i ) x n ) , V x x = ( 2 V ( t , x , i ) x i x j ) n × n .

Definition 2.1 The trivial solution x(t) of equation (2.1) is said to be partial stochastic stability with respect to x 1 (t) if, for any ϵ>0 and ϵ 1 >0, there exists a δ=δ(ϵ, ϵ 1 )>0 such that

P { sup t 0 | x 1 ( t ) | > ϵ } < ϵ 1 ,
(2.2)

whenever ξ<δ.

Definition 2.2 The trivial solution x(t) of equation (2.1) is said to be partial stochastic asymptotic stability with respect to x 1 (t) if it is the x 1 (t)-stochastic stability and for any ϵ(0,1), there exists a δ 0 = δ 0 (ϵ) such that

P { lim t | x 1 ( t ) | = 0 } 1ϵ,
(2.3)

whenever ξ< δ 0 .

3 Main results

First of all, we should present Sharov’s theorem [21].

Theorem 3.1 (Sharov [21])

If in the domain B K × R + there exists a function V(x,t) which satisfies the following conditions:

  1. (I)

    α(| x 1 |)V(t,x)β(| x 1 |), where α,βC;

  2. (II)

    LVγ(| x 1 |), where γC;

then the trivial solution x(t)0 of system (2.1) is x 1 (t)-stochastic asymptotic stability.

The condition of Theorem 3.1 is more difficult to be satisfied, which is demonstrated by the following example.

Example 3.1 Consider the system of stochastic differential equations

d x 1 = a x 1 3 x 2 2 d t + a x 1 2 x 2 d B 1 ( t ) , d x 2 = b x 1 d t + c x 2 d B 2 ( t ) ,
(3.1)

where a, b, c are constants and abc0. The system has the trivial solution x 1 =0, x 2 =0.

Denote V:= x 1 2 , we have LV=2a x 1 4 x 2 2 +2a x 1 4 x 2 2 =0.

Now, by Theorem 3.1, we cannot give whether the solution of (3.1) is stochastic asymptotic stability or not. So, we present the main results of this paper as follows.

Theorem 3.2 Let there exist a non-negative functional V(t,x,i) C 1 , 2 ( R + × B K ×S; R + ) such that

  1. (I)

    μ 1 (| x 1 |)V(t,x,i) μ 2 (| x 1 |), where μ 1 , μ 2 C;

  2. (II)

    LV0;

  3. (III)

    (Boundary condition) For any sufficiently small η>0, θ>0, any solution x(t) of equation (2.1), beginning in the domain {η<| x 1 (t)|<θ}, is such that

    ρ=inf { t : x 1 ( t ) = η } <,a.s.

Then the trivial solution of equation (2.1) is said to be partial stochastic asymptotic stability with respect to x 1 (t).

Before giving the proof of Theorem 3.1, we should present the following lemma.

Lemma 3.1 Let V(t,x,i) be a function in the class C 1 , 2 ( R + × B K ×S; R + ), bounded in the domain ( R + × B K ×S), and suppose that LV0 in this domain. Then the process V( σ B t, x ( σ B t ) ˜ ,r( σ B t)) is a supermartingale so that EV( σ B t, x ( σ B t ) ˜ ,r( σ B t))V(0, x 0 , i 0 ), for x(t) B K .

Proof As the generalized Itô formula, we have

V ( σ B t , x ( σ B t ) ˜ , r ( σ B t ) ) =V(0, x 0 , i 0 )+ 0 σ B t LV ( s , x s , r ( s ) ) ds+M( σ B t),

where M( σ B t) is the martingale.

For any s 1 , 0 s 1 σ B t and LV0, we derive that

E V ( σ B t , x ( σ B t ) ˜ , r ( σ B t ) | F s 1 ) = V ( 0 , x 0 , i 0 ) + E ( 0 σ B t L V ( s , x s , r ( s ) ) d s | F s 1 ) + E ( M ( σ B t ) | F s 1 ) V ( 0 , x 0 , i 0 ) + E ( 0 s 1 L V ( s , x s , r ( s ) ) d s | F s 1 ) + M ( s 1 ) = V ( 0 , x 0 , i 0 ) + 0 s 1 L V ( s , x s , r ( s ) ) d s + M ( s 1 ) = V ( s 1 , x ( s 1 ) ˜ , r ( s 1 ) ) .

So, V( σ B t, x ( σ B t ) ˜ ,r( σ B t)) is a supermartingale. Moreover, due to LV0 in the domain,

E V ( σ B t , x ( σ B t ) ˜ , r ( σ B t ) ) = V ( 0 , x 0 , i 0 ) + E ( 0 σ B t L V ( s , x s , r ( s ) ) d s ) + E ( M ( σ B t ) ) V ( 0 , x 0 , i 0 ) ,

so the proof is completed. □

Proof of Theorem 3.2 By Lemma 3.1 and Doob’s supermartingale convergence theorem, the process V( σ B t, x ( σ B t ) ˜ ,r(t)) is a supermartingale, and we can get

lim t V ( σ B t , x ( σ B t ) ˜ , r ( t ) ) =c,a.s.
(3.2)

Denote Ω 1 ={ω: σ B =}. Owing to LV0 and the partial stochastic stability theorem (Sharov [21]), the solution of equation (2.1) is the partial stochastic stability with respect to x 1 (t), so we have

lim ξ 0 P( Ω 1 )=1.
(3.3)

Combining this with condition (III) and for all the paths of Ω 1 , then

inf t > 0 | x 1 ( t ) | =0.
(3.4)

By the lemma of Has’minskii [22], that is, the coefficients of equation (2.1) satisfy the local Lipschitz and linear growth condition in every domain bounded, and the process x(t) is regular, then the set {ω: x 1 (t,ω)=0} is inaccessible to any sample path of the process if ξ 1 0, where ξ= ( ξ 1 , ξ 2 ) T , so we get

lim inf t | x 1 ( t ) | =0.
(3.5)

Noting the similar definition of x ( t ) ˜ =x(t)G( x t ), obviously,

| x 1 ( t ) ˜ | ( | x 1 ( t ) | + | G 1 ( x t ) | ) ( | x 1 ( t ) | + κ x t 1 ) ,

and we get that

sup τ t < ( | x 1 ( t ) ˜ | ) sup τ t < [ ( 1 + κ ) | x 1 ( t ) | ] .

Therefore,

inf τ t < | x 1 ( t ) ˜ | inf τ t < (1+κ) | x 1 ( t ) | ,

and (3.4), we have

inf t > 0 | x 1 ( t ) ˜ | =0.
(3.6)

Similar to the proof of (3.5), we get

lim inf t | x 1 ( t ) ˜ | =0.
(3.7)

Combining this with condition (I) (V(t,x,i) μ 2 (| x 1 |)) and (3.7), we obtain

lim inf t V ( t , x ( t ) ˜ , r ( t ) ) =0.
(3.8)

Owing to (3.2), the limit

lim t V ( σ B t , x ( σ B t ) ˜ , r ( t ) ) = lim t V ( t , x ( t ) ˜ , r ( t ) ) =c
(3.9)

exists for almost all paths in Ω 1 . By (3.8) and (3.9), we have the limit of the above equation c=0, a.s., since the condition (I) ( μ 1 (| x 1 |)V(t,x,i)). For all the paths of Ω 1 , we can imply that

lim t | x 1 ( t ) ˜ | =0.
(3.10)

Moreover,

lim sup t | x 1 ( t ) ˜ | =0.
(3.11)

Noting the similar definition of x ( t ) ˜ =x(t)G( x t ), obviously,

| x 1 ( t ) | | x 1 ( t ) ˜ | + | G 1 ( x t ) | | x 1 ( t ) ˜ | +κ x t 1 ,

we get that

sup τ t < (1κ) | x 1 ( t ) | sup τ t < | x 1 ( t ) ˜ | .

By (3.11), then

lim sup t | x 1 ( t ) | =0.
(3.12)

Combining this with conditions (3.5) and (3.12) yields

lim t | x 1 ( t ) | =0.
(3.13)

So, we have obtained that the trivial solution of equation (2.1) is partial stochastic asymptotic stability with respect to x 1 with (3.3) and (3.13). □

4 Remarks

Remark 4.1 When G( x t )0, τ0 and r(t)0, equation (2.1) reduces to

dx(t)=f ( t , x ( t ) ) ds+g ( t , x ( t ) ) dB(t),t>0,
(4.1)

which has recently been studied in Ignatyev [23], that is to say, Theorem 3.1 of Ignatyev [23] has been generalized.

Remark 4.2 The operator LV of equation (4.1) of Theorem 3.1 (Sharov [21]) must be negative, but we can obtain the partial stochastic asymptotic stability of equation (2.1) under LV being non-positive (LV0), which makes the conditions of the solution more feasible to be satisfied.

5 Discussion of main results

Lyapunov methods have been developed to research the conditions of the partial asymptotic stochastic stability of neutral stochastic functional differential equations with Markovian switching. We have the non-positive Lyapunov operator and boundary condition to weaken the conditions of the previous theorems, but there is a small problem that the boundary condition of Theorem 3.2 is a stochastic domain. We will obtain the equivalent and practical results for the boundary condition in the future investigation.

References

  1. 1.

    Øsendal B: Stochastic Differential Equations. 5th edition. Springer, Berlin; 2003.

    Book  Google Scholar 

  2. 2.

    Mao X, Yuan C: Stochastic Differential Equations with Markovian Switching. Imperial College Press, London; 2006.

    Book  Google Scholar 

  3. 3.

    Kolmanovskii V, Koroleva N, Maizenberg T, Mao X, Matasov A: Neutral stochastic differential delay equations with Markovian switching. Stoch. Anal. Appl. 2003, 21: 819–847. 10.1081/SAP-120022865

    MathSciNet  Article  Google Scholar 

  4. 4.

    Luo J: Comparison principle and stability of Itô stochastic differential delay equations with Poisson jump and Markovian switching. Nonlinear Anal. 2006, 64: 253–262. 10.1016/j.na.2005.06.048

    MathSciNet  Article  Google Scholar 

  5. 5.

    Luo J: Second-order quasilinear oscillation with impulses. Comput. Math. Appl. 2003, 46: 279–291. 10.1016/S0898-1221(03)90031-9

    MathSciNet  Article  Google Scholar 

  6. 6.

    Mao X: The Lasalle-type theorems for stochastic differential equations. Nonlinear stud. 2000, 7: 307–328.

    MathSciNet  Google Scholar 

  7. 7.

    Yuan C, Mao X: Robust stability and controllability of stochastic differential delay equations with Markovian switching. Automatica 2004, 40: 343–354. 10.1016/j.automatica.2003.10.012

    MathSciNet  Article  Google Scholar 

  8. 8.

    Yuan C: Stability in terms of two measures for stochastic differential equations. Dyn. Contin. Discrete Impuls. Syst. 2003, 10: 895–910.

    Google Scholar 

  9. 9.

    Mao X: Stabilisation of hybrid stochastic differential equations by delay feedback control. Syst. Control Lett. 2008, 57: 927–935. 10.1016/j.sysconle.2008.05.002

    Article  Google Scholar 

  10. 10.

    Liu D, Yang Y: Doubly perturbed neutral diffusion processes with Markovian switching and Poisson jumps. Appl. Math. Lett. 2010, 23: 1141–1146. 10.1016/j.aml.2009.07.004

    MathSciNet  Article  Google Scholar 

  11. 11.

    Liu D, Yang G, Zhang W: The stability of neutral stochastic delay differential equations with Poisson jumps by fixed points. J. Comput. Appl. Math. 2011, 10: 3115–3120.

    MathSciNet  Article  Google Scholar 

  12. 12.

    Mao X: Stochastic Differential Equations and Their Applications. Horwood, Chichester; 1997.

    Google Scholar 

  13. 13.

    Luo Q, Mao X, Shen Y: New criteria on exponential stability of neutral stochastic differential equations. Syst. Control Lett. 2006, 55: 826–834. 10.1016/j.sysconle.2006.04.005

    MathSciNet  Article  Google Scholar 

  14. 14.

    Peiffer K, Rouche N: Liapunov’s second method applied to partial stability. J. Méc. 1969, 6(2):20–29.

    Google Scholar 

  15. 15.

    Rouche N, Habets P, Laloy M: Stability Theory by Liapunov’s Direct Method. Springer-Verlag, New York; 1977.

    Book  Google Scholar 

  16. 16.

    Sontag ED, Wang Y: Lyapunov characterizations of input to output stability. SIAM J. Control Optim. 2001, 39(1):226–249.

    MathSciNet  Article  Google Scholar 

  17. 17.

    Vorotnikov VI: Partial Stability and Control. Birkhauser, Boston; 1998.

    Google Scholar 

  18. 18.

    Vorotnikov VI, Rumyantsev VV: Stability and Control with Respect to a Part of the Phase Coordinates of Dynamic Systems: Theory, Methods, and Applications. Scientific World, Moscow; 2001. in Russian

    Google Scholar 

  19. 19.

    Ignatyev AO: On the partial equiasymptotic stability in functional differential equations. J. Math. Anal. Appl. 2002, 268: 615–628. 10.1006/jmaa.2001.7835

    MathSciNet  Article  Google Scholar 

  20. 20.

    Ignatyev OA: On the partial asymptotic stability in nonautonomous differential equations. Differ. Integral Equ. 2006, 19(7):831–839.

    MathSciNet  Google Scholar 

  21. 21.

    Sharov VF: Partial stability and stabilization of stochastic systems. Avtom. Telemeh. 1978, 11: 63–71. in Russian

    MathSciNet  Google Scholar 

  22. 22.

    Has’minskii RZ: Stochastic Stability of Differential Equations. Sijthoff & Noordhoff, Rockville; 1980.

    Book  Google Scholar 

  23. 23.

    Ignatyev OA: Partial asymptotic stability in probability of stochastic differential equations. Stat. Probab. Lett. 2009, 79: 597–601. 10.1016/j.spl.2008.10.005

    MathSciNet  Article  Google Scholar 

Download references

Acknowledgements

The authors are very grateful to the anonymous referees for their valuable suggestions. This work was partially supported by HSSF for the Ministry of Education (10YJC630143), NNSF of China (61074006, 71171001), NSSF of China (12BTJ008), PNSF of Anhui (1208085QG131, KJ2011B005, 2011SQRL068).

Author information

Affiliations

Authors

Corresponding author

Correspondence to Dezhi Liu.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

The authors have achieved equal contributions to each part of this paper. All the authors read and approved the final manuscript.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and Permissions

About this article

Cite this article

Liu, D., Wang, W., Ignatyev, O. et al. Partial stochastic asymptotic stability of neutral stochastic functional differential equations with Markovian switching by boundary condition. Adv Differ Equ 2012, 220 (2012). https://doi.org/10.1186/1687-1847-2012-220

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1687-1847-2012-220

Keywords

  • stochastic asymptotic stability
  • partial
  • Markov chain
  • neutral
  • functional differential equation