- Research
- Open access
- Published:
Finite-time control for a class of Markovian jump systems with mode-dependent time-varying delay
Advances in Difference Equations volume 2013, Article number: 214 (2013)
Abstract
This paper is concerned with the problem of finite-time control for a class of Markovian jump system with mode-dependent time-varying delay. By using the new augmented multiple Lyapunov function with more general decomposition approach, a novel sufficient condition for finite-time bounded with an performance index is derived. Based on the derived condition, the reliable control problem is solved, and an explicit expression of the desired controller is also given, the system trajectory stays within a prescribed bound during a specified time interval. Finally, numerical examples are given to demonstrate that the proposed approach is more effective than some existing ones.
1 Introduction
Markovian jump systems were introduced by Krasovskii and Lidskii [1], which can be described by a set of systems with the transitions in a finite mode set. In the last few decades, there has been increasing interest in Markovian jump systems because this class of systems is appropriate to model many physical systems mainly those random failures, repairs and sudden environment disturbance [2–5]. Such class of systems is a special class of stochastic hybrid systems with finite operation modes, which may switch from one to another at different time. As a crucial factor, it is shown that such jumping can be determined by a Markovian chain [6]. For linear Markovian jumping systems, many important issues have been studied extensively such as stability, stabilization, control synthesis and filter design [6–12]. In finite operation modes, Markovian jump systems is a special class of stochastic systems that can switch from one to another at different time. It is worth pointing out that time delay is one of the instability sources for dynamical systems and is a common phenomenon in many industrial and engineering systems [13–18]. Hence, it is not surprising that much effort has been made to investigate of Markovian jump systems with time delay during the last two decades [19–23]. The exponential stabilization of Markovian jump systems with time delay was first studied in [19] where the decay rate was estimated by solving linear matrix inequalities [20]. However, in the aforementioned works, the network-induced delays have been commonly assumed to be deterministic, which is fairly unrealistic since delays resulting from network transmissions are typically time varying.
Generally speaking, the delay-dependent criterions are less conservative than delay-independent ones, especially when the time delay is small enough in Markovian jump systems. Thus, recent efforts were devoted to the delay-dependent Markovian jump systems stability analysis by employing Lyapunov-Krasovskii functionals [24–32]. However, most efforts have been given on how to construct an appropriate Lyapunov functional by dividing the delay interval into N equal length subintervals [22]. It should be pointed out that the delay decomposition method is not effective when the lower bound of time-varying delay is zero. Furthermore, although the decay rate can be computed, it is a fixed value that one cannot adjust to deduce if a larger decay rate is possible. Therefore, how to obtain the improved results without increasing the computational burden has greatly improved the current study.
Over the years, many research efforts have been devoted to the study of finite-time stability of systems. In finite-time interval, finite-time stability is investigated to address these transient performances of control systems. Recently, the concept of finite-time stability has been revisited in the light of linear matrix inequalities (LMIs) and Lyapunov function theory, some results are obtained to ensure that system is finite-time stable or finite-time bounded [33–49]. It is noted that there are still some related issues to be solved, to the best of our knowledge, the finite-time control for a class of Markovian jump systems with time-varying delay has not been fully developed. The analysis method in the existing references seems still conservative to study Markovian jump system. There is room for further investigation.
The main contribution of this paper is as follows: Firstly, we present a new augmented Lyapunov functional by employing the more general decomposition of a delay interval for a class of Markovian jump systems with mode-dependent time-varying delay. Secondly, in order to reduce the possible conservativeness and computational burden, some slack matrices are introduced [18]. Several sufficient conditions are derived to guarantee the finite-time stability and boundedness of the resulting closed-loop system. Last but not the least, it is shown that less conservative and more general results can be derived since the time-varying delays are divided into a more general decomposition. We find that finite-time stability is a concept independent from Lyapunov stability and can always be affected by switching behavior significantly, thus it deserves our investigation. The finite-time boundedness criteria can be tackled in the form of LMIs. Finally, numerical examples illustrate the effectiveness of the developed techniques.
Notations: Throughout this paper, we let (, , ) denote a symmetric positive definite matrix P (positive semi-definite, negative definite and negative semi-definite). For any symmetric matrix P, and denote the maximum and minimum eigenvalues of matrix P, respectively. denotes the n-dimensional Euclidean space and refers to the set of all real matrices and . The identity matrix of order n is denoted as . ∗ represents the elements below the main diagonal of a symmetric matrix. The superscripts ⊺ and −1 stand for matrix transposition and matrix inverse, respectively.
2 Preliminaries
Given a probability space where Ω, F and P respectively represent the sample space, the algebra of events and the probability measure defined on F. In this paper, we consider the following Markov jump system over the space described by
where is the state vector of the system, is the controlled output, is the control input and , and are initial conditions of continuous state and the mode. is the disturbance input satisfying
Let the random form process be the Markov stochastic process taking values on a finite set with the transition rate matrix , , and the transition probabilities described as
where , , for , is the transition rate from mode i at time t to mode j at time and
for each mode , . denotes the mode dependent time-varying state delay in the system and satisfies the following condition:
where and are prescribed integers representing the lower and upper bounds of time-varying delay . Similarly, and are prescribed integers representing the lower and upper bounds of time-varying delay . , , , , , , and are known mode-dependent matrices with appropriate dimension functions of the random jumping process and represent the nominal systems for each . For notation simplicity, when the system operates in the i th mode (), , , , , , , and are denoted as , , , , , , and , respectively.
Remark 1 In this paper, the lower bound of is required in order to implement the proposed delay decomposition method. If , then corresponds to the constant delay.
Moreover, the transient process of a system can be clearly characterized if its decay rate is available. The objective of this study is to develop a new approach to designing a state feedback controller
via a novel Lyapunov functional such that the resulting closed-loop system is finite-time stable, where is the controller gains to be designed.
In this paper, we split the delay interval into two segments: . Moreover, we further subdivide each interval into l, m equal length subsegments and , respectively, where
and l, m are given positive integers.
Remark 2 The delay intervals are divided subsegments dependent on t, thus the proposed delay decomposition method is more general than those in [13–17, 19–24]. The conservatism will be reduced with the partitioning number l and m increase.
In order to more precisely describe the main objective, we introduce the following definitions and lemmas for the underlying system.
Definition 2.1 System (1) is said to be finite-time bounded with respect to if condition (2) and the following inequality hold:
where and .
Definition 2.2 [49]
Consider as the stochastic Lyapunov function of the resulting system (1), its weak infinitesimal operator is defined as
Definition 2.3 Given a constant , for all admissible subject to condition (2), under zero initial conditions, if the closed-loop Markovian jump system (1) is finite-time bounded and the control outputs satisfy condition (5) with attenuation ,
then the controller system (1) is called the finite-time bounded with disturbance attenuation γ.
Remark 3 It should be pointed that the assumption of zero initial condition in system (1) is only for the purpose of technical simplification in the derivation, and it does not lose generality. In fact, if this assumption is lost, the same control result can still be got along the same lines, except adding extra manipulations in the derivation and extra terms in the control presentation. However, in real world applications, the initial condition of the underlying system is generally not zero.
Lemma 2.1 [18]
Let () have positive values in an open subset of . Then the reciprocally convex combination of over satisfies
subject to
Lemma 2.2 For a given function , (), there exist four functions , , and satisfying and , respectively, such that , the following equation holds:
Lemma 2.3 [50]
For matrices A, and , the following matrix inequality
holds if and only if there exists a matrix G of appropriate dimension such that
Lemma 2.4 ([14] Schur complement)
Given constant matrices X, Y, Z, where and , then if and only if
3 Finite-time performance analysis
We first consider the problem of stability analysis for system (1) with . The following results actually present the finite-time stability for the Markov jump system with time-varying delay.
Theorem 3.1 System (1) is finite-time bounded with respect to if there exist matrices , , (), , , , , , scalars , , , , , (), , and , such that for all , , , the following inequalities hold:
where
Proof First, in order to cast our model into the framework of the Markov processes, we define a new process by
Now, we consider the following Lyapunov-Krasovskii functional:
where
Then, let the mode at time t be i, i.e., , we have
Moreover, denote
By using Lemma 2.1, it yields that
It follows from (9) and () that
Similarly, (10) implies
From (12)-(16), we can eventually obtain
where
and
By Lemma 2.2, there exist functions , , and satisfying and , respectively. Using the Schur complement such that
where , , and are defined in Theorem 3.1. Substituting (18) into (17), then (18) can be rewritten as
Therefore, the following relation holds by condition (8) and (19):
Multiplying the aforementioned inequality by , we can get
By integrating the aforementioned inequality between 0 and t, it follows that
Denote , , , , , it yields that
Noting that and , we have
On the other hand, it follows from (12) that
It can be derived from (21)-(22) that
From (11) and (23), we have
Then the system is finite-time bounded with respect to . □
Remark 4 It should be mentioned that novel terms and are continuous at is included in the Lyapunov-Krasovskii functional (12), which plays an important role in reducing conservativeness of the derived result.
Remark 5 In this paper, and may have different upper bounds in various delay intervals satisfying (3) and (4), respectively. While in previous work such as [16, 17], and are enlarged to and , respectively, which may lead to conservativeness inevitably. However, the case above can be taken fully into account by employing the Lyapunov-Krasovskii functional (12).
Remark 6 When dealing with term , the convex combination is not employed, Lemma 2.1 is used in this paper, then the free-weighting matrices-dependent null add items are necessary to be introduced in our proof, which leads to the decrease in the number of LMIs and LMIs scalar decision variables.
Remark 7 The feature of this paper is the way to deal with the integral term. Many researchers have enlarged the derivative of the Lyapunov functional in order to deal with the integral term in mathematical operations. In this paper, we transform different integral intervals with the same integral length into an integral interval. It is worth pointing out that in the proof of the theorem no extra inequality is introduced. We propose a novel delay-dependent sufficient criterion, which ensures that the Markovian jump system with time-varying delays is finite-time stable.
Remark 8 One can clearly see from the proof of Theorem 3.1 that neither free-weighting matrices nor model transformation has been employed to deal with the sum terms, and none of useful items are ignored, resulting in better results with the less number of LMIs scalar decision variables, which deduces some conservatism in some sense.
By using the novel Lyapunov functionals with the more general decomposition of delay interval, a state feedback controller (3) can be designed such that the resulting closed-loop system is finite-time bounded with performance. When , the closed-loop system is expressed by
where
Theorem 3.2 System (25) is finite-time bounded with respect to if there exist matrices , , (), , , , , scalars , , , , , , (), , and , such that for all , , , the following inequalities hold:
where
Proof We now consider the performance of system (25). Select the same Lyapunov-Krasovskii functional as Theorem 3.1 and the Schur complement, it yields that
It follows from (26) that
Multiplying the aforementioned inequality by , one has
Under zero initial condition and , by integrating the aforementioned inequality between 0 and T, we can get
Then it yields
Thus it is concluded by Definition 2.3 that system (25) is finite-time bounded with an performance γ. The proof is completed. □
Remark 9 From the proof process of Theorem 3.1 and Theorem 3.2, it is easy to see that neither bounding technique for cross terms nor model transformation is involved. In other words, the obtained result is expected to be less conservative.
Remark 10 Lyapunov asymptotic stability and finite-time stability of a class of systems are independent concepts. Lyapunov asymptotically stable system may not be finite-time stable. Moreover, finite-time stable system may also not be Lyapunov asymptotically stable. There exist some results on Lyapunov stability, while finite-time stability also needs our full investigation, which was neglected by most previous work.
4 Finite-time control
Theorem 4.1 System (25) is finite-time bounded with respect to if there exist matrices , , (), , , , , scalars , , , , , (), , and , such that for all , , , the following inequalities hold:
where
Moreover, the state feedback gain matrices can be designed as
Proof Consider Theorem 3.2 and the overall closed-loop Markov jump system (25). Pre- and post-multiplying inequality (26) by block-diagonal matrix and its transpose, respectively. Letting
It can be easily obtained that
where
From Lemma 2.3, for any , and , one can obtain , , . Then (33) is equivalent to (39). Therefore, if (33) holds, system (1) is finite-time bounded with a prescribed performance index γ. The proof is completed. □
Remark 11 By solving the Markovian jumping system with finite-time observer-based controller, the mode-dependent positive-definite weighting matrices in inequalities (33)-(37) should be known first. For convenience, we always choose the initial value for .
Remark 12 In many actual applications, the minimum value of is of interest. In Theorem 3.2, with a fixed λ, can be obtained through the following optimization procedure:
In Theorem 4.1, as for finite-time stability and boundedness, once the state bound is not ascertained, the minimum value is of interest. With a fixed λ, and define , , then the following optimization problem can be formulated to get the minimum value
where ς is weighted factor, and .
5 Illustrative example
Example 1 Consider the Markovian jump system (1) with two operation modes and the following data:
and the transition probability matrix is
Under different levels of the upper bound and λ, Table 1 and Table 2 list the results of the maximum allowable upper bound, the decay rate λ for different time delays and maximum values of derived from various methods including the one proposed in this paper, respectively. One can see from Table 1 and Table 2 that the same results are obtained in [21, 22]. It is clear from Table 1 and Table 2 that the performance achieved by our method is much better than those by [21, 22]. Therefore, our results not only are less conservative, but also require the less number of scalar decision variables.
Example 2 Consider a two-mode Markovian jump system (1) with
In addition, the transition rate matrix is given by
Then we choose , , , , through Theorem 4.1, it yields that . Moreover, we also can obtain the following controller gains:
It confirms the effectiveness of Theorem 4.1 for the state feedback controller design to finite-time Markovian jump systems with time-varying delay.
6 Conclusions
In this paper, we have examined the problems of finite-time control for a class of Markovian jump systems with mode-dependent time-varying delay. Based on a novel approach, a sufficient condition is derived such that the closed-loop Markovian jump system is finite-time bounded and satisfies the prescribed level of disturbance attenuation in a finite time interval. The controller and observer gains can be solved directly by using the existing LMIs optimization techniques. Finally, numerical examples are also given to illustrate the effectiveness of the proposed design approach.
References
Krasovskii N, Lidskii E: Analysis and design of controllers in systems with random attributes. Autom. Remote Control 1961, 22: 1021-1025.
Cheng J, Zhu H, Zhong S, Zhang Y: Robust stability of switched delay systems with average dwell time under asynchronous switching. J. Appl. Math. 2012. 10.1155/2012/956370
Wu L, Su X, Shi P:Sliding mode control with bounded gain performance of Markovian jump singular time-delay systems. Automatica 2012, 48(8):1929-1933. 10.1016/j.automatica.2012.05.064
Gao H, Fei Z, Lam J, Du B: Further results on exponential estimates of Markovian jump systems with mode-dependent time-varying delays. IEEE Trans. Autom. Control 2011, 56(1):223-229.
Wu Z, Su H, Chu J: filtering for singular Markovian jump systems with time delay. Int. J. Robust Nonlinear Control 2010, 20(8):939-957.
Tino P, Cernansky M, Beunskova L: Markovian architectural bias of recurrent neural networks. IEEE Trans. Neural Netw. 2004, 15: 6-15. 10.1109/TNN.2003.820839
Dong H, Wang Z, Ho D, Gao H: Robust filtering for Markovian jump systems with randomly occurred nonlinearities and sensor saturation: the finite-horizon case. IEEE Trans. Signal Process. 2011, 59(7):3048-3057.
Yao X, Wu L, Zheng W, Wang C:Robust filtering of Markovian jump stochastic systems with uncertain transition probabilities. Int. J. Syst. Sci. 2011, 42(7):1219-1230. 10.1080/00207720903513350
Wu L, Shi P, Gao H: State estimation and sliding-mode control of Markovian jump singular systems. IEEE Trans. Autom. Control 2010, 55(5):1213-1219.
Wu L, Shi P, Gao H, Wang C: filtering for 2D Markovian jump systems. Automatica 2008, 44(7):1849-1858. 10.1016/j.automatica.2007.10.027
Wu Z, Su H, Chu J: State estimation for discrete Markovian jumping neural networks with time delay. Neurocomputing 2010, 73(10-12):2247-2254. 10.1016/j.neucom.2010.01.010
Zhu Q, Cao J: Robust exponential stability of Markovian jump impulsive stochastic Cohen-Grossberg neural networks with mixed time delays. IEEE Trans. Neural Netw. 2010, 21: 1314-1325.
Mou S, Gao H, Lam J, Qiang W, Chen K: New delay-dependent exponential stability for neural networks with time delay. IEEE Trans. Syst. Man Cybern., Part B, Cybern. 2008, 38: 571-576.
Shao H: Improved delay-dependent globally asymptotic stability criteria for neural networks with a constant delay. IEEE Trans. Circuits Syst. 2008, 55: 1071-1075.
Hu L, Gao H, Zheng W: Novel stability of cellular neural networks with interval time-varying delay. Neural Netw. 2008, 21(10):1458-1463. 10.1016/j.neunet.2008.09.002
Zhang H, Liu Z, Huang G-B, Wang Z: Novel weighting-delay-based stability criteria for recurrent neural networks with time-varying delay. IEEE Trans. Neural Netw. 2010, 21(1):91-106.
Zuo Z, Yang C, Wang Y: A new method for stability analysis of recurrent neural networks with interval time-varying delay. IEEE Trans. Neural Netw. 2010, 21(2):339-344.
Park P, Ko J, Jeong C: Reciprocally convex approach to stability of systems with time-varying delays. Automatica 2011, 47: 235-238. 10.1016/j.automatica.2010.10.014
Shu Z, Lam J, Xu S: Robust stabilization of Markovian delay systems with delay-dependent exponential estimates. Automatica 2006, 42: 2001-2008. 10.1016/j.automatica.2006.06.016
Boyd S, El Ghaoui L, Feron E, Balakrishnan V: Linear Matrix Inequalities in System and Control Theory. SIAM, Philadelphia; 1994.
Huang H, Feng G, Chen X: Stability and stabilization of Markovian jump systems with time delay via new Lyapunov functionals. IEEE Trans. Circuits Syst. 2012, 59(10):2413-2421.
Gao H, Fei Z, Lam J, Du B: Further results on exponential estimates of Markovian jump systems with mode-dependent time-varying delays. IEEE Trans. Autom. Control 2011, 56(1):223-229.
Sun M, Lam J, Xu S, Zou Y: Robust exponential stabilization for Markovian jump systems with mode-dependent input delay. Automatica 2007, 43(10):1799-1807. 10.1016/j.automatica.2007.03.005
Fei Z, Gao H, Shi P: New results on stabilization of Markovian jump systems with time delay. Automatica 2009, 45(10):2300-2306. 10.1016/j.automatica.2009.06.020
Karimi HR: Robust delay-dependent control of uncertain time delay systems with mixed neutral, discrete, and distributed time-delays and Markovian switching parameters. IEEE Trans. Circuits Syst. 2011, 58(8):1910-1923.
Xu S, Lam J, Mao X: Delay-dependent control and filtering for uncertain Markovian jump systems with time-varying delays. IEEE Trans. Circuits Syst. 2007, 54(9):2070-2077.
Liu Y, Wang Z, Liu X: State estimation for discrete-time Markovian jumping neural networks with mixed mode-dependent delays. Phys. Lett. A 2008, 372(48):7147-7155. 10.1016/j.physleta.2008.10.045
Zhang L, Boukas EL: control of a class of extended Markov jump linear systems. IET Control Theory Appl. 2009, 3(7):834-842. 10.1049/iet-cta.2008.0023
Zhang L, Boukas EL, Lam J: Analysis and synthesis of Markov jump linear systems with time-varying delays and partially known transition probabilities. IEEE Trans. Autom. Control 2008, 53(10):2458-2464.
Ma S, Boukas EK:Robust filtering for uncertain discrete Markov jump singular systems with mode-dependent time delay. IET Control Theory Appl. 2009, 3(3):351-361. 10.1049/iet-cta:20080091
Chen Y, Bi W, Li W: Stability analysis for neural networks with time-varying delay: a more general delay decomposition approach. Neurocomputing 2010, 73: 853-857. 10.1016/j.neucom.2009.10.005
Cheng J, Zhu H, Zhong S, Li G: Novel delay-dependent robust stability criteria for neutral systems with mixed time-varying delays and nonlinear perturbations. Appl. Math. Comput. 2013, 219: 7741-7753. 10.1016/j.amc.2013.01.062
Huang X, Lin W, Yang B: Global finite-time stabilization of a class of uncertain nonlinear systems. Automatica 2005, 41(5):881-888. 10.1016/j.automatica.2004.11.036
Qian C, Li J: Global finite-time stabilization by output feedback for planar systems without observable linearization. IEEE Trans. Autom. Control 2005, 50(6):549-564.
Amato F, Ambrosino R, Cosentino C, De Tommasi G: Input-output finite-time stabilization of linear systems. Automatica 2010, 46(9):1558-1562. 10.1016/j.automatica.2010.06.005
Hong Y: Finite-time stabilization and stability of a class of controllable systems. Syst. Control Lett. 2002, 48(4):231-236.
Amato F, Ariola M: Finite-time control of discrete-time linear systems. IEEE Trans. Autom. Control 2005, 50(5):724-729.
Cheng J, Zhu H, Zhong S, Zhang Y:Finite-time boundness of filtering for switched discrete-time systems. Int. J. Control. Autom. Syst. 2012, 10(6):1129-1135. 10.1007/s12555-012-0607-y
Luan X, Liu F, Shi P: Finite-time filtering for non-linear stochastic systems with partially known transition jump rates. IET Control Theory Appl. 2010, 4(5):735-745. 10.1049/iet-cta.2009.0014
Liu H, Zhao X:Asynchronous finite-time control for switched linear systems via mode-dependent dynamic state-feedback. Nonlinear Anal. Hybrid Syst. 2013, 8: 109-120.
Lin X, Du H, Li S:Finite-time boundedness and -gain analysis for switched delay systems with norm-bounded disturbance. Appl. Math. Comput. 2011, 217(12):982-993.
Lin J, Fei S, Gao Z: Stabilization of discrete-time switched singular time-delay systems under asynchronous switching. J. Franklin Inst. 2012. 10.1016/j.jfranklin.2012.02.009
Song H, Yu L, Zhang D, Zhang W:Finite-time control for a class of discrete-time switching time-delay systems with quantized feedback. Commun. Nonlinear Sci. Numer. Simul. 2012, 17(12):4802-4814. 10.1016/j.cnsns.2012.05.002
Zuo Z, Li H, Liu Y, Wang Y: On finite-time stochastic stability and stabilization of Markovian jump systems subject to partial information on transition probabilities. Circuits Syst. Signal Process. 2012. 10.1007/s00034-012-9420-3
Liu H, Shen Y, Zhao X:Delay-dependent observer-based finite-time control for switched systems with time-varying delay. Nonlinear Anal. Hybrid Syst. 2012, 6: 885-898. 10.1016/j.nahs.2012.03.001
Zhang Y, Liu C, Mu X:Robust finite-time control of singular stochastic systems via static output feedback. Appl. Math. Comput. 2012, 218: 5629-5640. 10.1016/j.amc.2011.11.057
Xu J, Sun J: Finite-time filtering for discrete-time linear impulsive systems. Signal Process. 2012, 92: 2718-2722. 10.1016/j.sigpro.2012.04.021
Cheng J, Zhu H, Zhong S, Zhang Y, Li Y:Finite-time control for a class of discrete-time Markov jump systems with partly unknown time-varying transition probabilities subject to average dwell time switching. Int. J. Syst. Sci. 2013. 10.1080/00207721.2013.808716
He S, Liu F:Finite-time fuzzy control of nonlinear jump systems with time delays via dynamic observer-based state feedback. IEEE Trans. Fuzzy Syst. 2012, 20(4):605-614.
Zhang D, Yu L, Zhang W: Delay-dependent fault detection for switched linear systems with time-varying delays - the average dwell time approach. Signal Process. 2011, 91: 832-840. 10.1016/j.sigpro.2010.08.016
Acknowledgements
The authors would like to thank the associate editor and anonymous reviewers for their detailed comments and suggestions. This work was supported by the National Basic Research Program of China (2010CB732501).
Author information
Authors and Affiliations
Corresponding author
Additional information
Competing interests
The authors declare that they have no competing interests.
Authors’ contributions
All authors have equal contributions.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Cheng, J., Li, G., Zhu, H. et al. Finite-time control for a class of Markovian jump systems with mode-dependent time-varying delay. Adv Differ Equ 2013, 214 (2013). https://doi.org/10.1186/1687-1847-2013-214
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/1687-1847-2013-214