- Open Access
Finite-time control for a class of Markovian jump systems with mode-dependent time-varying delay
Advances in Difference Equations volume 2013, Article number: 214 (2013)
This paper is concerned with the problem of finite-time control for a class of Markovian jump system with mode-dependent time-varying delay. By using the new augmented multiple Lyapunov function with more general decomposition approach, a novel sufficient condition for finite-time bounded with an performance index is derived. Based on the derived condition, the reliable control problem is solved, and an explicit expression of the desired controller is also given, the system trajectory stays within a prescribed bound during a specified time interval. Finally, numerical examples are given to demonstrate that the proposed approach is more effective than some existing ones.
Markovian jump systems were introduced by Krasovskii and Lidskii , which can be described by a set of systems with the transitions in a finite mode set. In the last few decades, there has been increasing interest in Markovian jump systems because this class of systems is appropriate to model many physical systems mainly those random failures, repairs and sudden environment disturbance [2–5]. Such class of systems is a special class of stochastic hybrid systems with finite operation modes, which may switch from one to another at different time. As a crucial factor, it is shown that such jumping can be determined by a Markovian chain . For linear Markovian jumping systems, many important issues have been studied extensively such as stability, stabilization, control synthesis and filter design [6–12]. In finite operation modes, Markovian jump systems is a special class of stochastic systems that can switch from one to another at different time. It is worth pointing out that time delay is one of the instability sources for dynamical systems and is a common phenomenon in many industrial and engineering systems [13–18]. Hence, it is not surprising that much effort has been made to investigate of Markovian jump systems with time delay during the last two decades [19–23]. The exponential stabilization of Markovian jump systems with time delay was first studied in  where the decay rate was estimated by solving linear matrix inequalities . However, in the aforementioned works, the network-induced delays have been commonly assumed to be deterministic, which is fairly unrealistic since delays resulting from network transmissions are typically time varying.
Generally speaking, the delay-dependent criterions are less conservative than delay-independent ones, especially when the time delay is small enough in Markovian jump systems. Thus, recent efforts were devoted to the delay-dependent Markovian jump systems stability analysis by employing Lyapunov-Krasovskii functionals [24–32]. However, most efforts have been given on how to construct an appropriate Lyapunov functional by dividing the delay interval into N equal length subintervals . It should be pointed out that the delay decomposition method is not effective when the lower bound of time-varying delay is zero. Furthermore, although the decay rate can be computed, it is a fixed value that one cannot adjust to deduce if a larger decay rate is possible. Therefore, how to obtain the improved results without increasing the computational burden has greatly improved the current study.
Over the years, many research efforts have been devoted to the study of finite-time stability of systems. In finite-time interval, finite-time stability is investigated to address these transient performances of control systems. Recently, the concept of finite-time stability has been revisited in the light of linear matrix inequalities (LMIs) and Lyapunov function theory, some results are obtained to ensure that system is finite-time stable or finite-time bounded [33–49]. It is noted that there are still some related issues to be solved, to the best of our knowledge, the finite-time control for a class of Markovian jump systems with time-varying delay has not been fully developed. The analysis method in the existing references seems still conservative to study Markovian jump system. There is room for further investigation.
The main contribution of this paper is as follows: Firstly, we present a new augmented Lyapunov functional by employing the more general decomposition of a delay interval for a class of Markovian jump systems with mode-dependent time-varying delay. Secondly, in order to reduce the possible conservativeness and computational burden, some slack matrices are introduced . Several sufficient conditions are derived to guarantee the finite-time stability and boundedness of the resulting closed-loop system. Last but not the least, it is shown that less conservative and more general results can be derived since the time-varying delays are divided into a more general decomposition. We find that finite-time stability is a concept independent from Lyapunov stability and can always be affected by switching behavior significantly, thus it deserves our investigation. The finite-time boundedness criteria can be tackled in the form of LMIs. Finally, numerical examples illustrate the effectiveness of the developed techniques.
Notations: Throughout this paper, we let (, , ) denote a symmetric positive definite matrix P (positive semi-definite, negative definite and negative semi-definite). For any symmetric matrix P, and denote the maximum and minimum eigenvalues of matrix P, respectively. denotes the n-dimensional Euclidean space and refers to the set of all real matrices and . The identity matrix of order n is denoted as . ∗ represents the elements below the main diagonal of a symmetric matrix. The superscripts ⊺ and −1 stand for matrix transposition and matrix inverse, respectively.
Given a probability space where Ω, F and P respectively represent the sample space, the algebra of events and the probability measure defined on F. In this paper, we consider the following Markov jump system over the space described by
where is the state vector of the system, is the controlled output, is the control input and , and are initial conditions of continuous state and the mode. is the disturbance input satisfying
Let the random form process be the Markov stochastic process taking values on a finite set with the transition rate matrix , , and the transition probabilities described as
where , , for , is the transition rate from mode i at time t to mode j at time and
for each mode , . denotes the mode dependent time-varying state delay in the system and satisfies the following condition:
where and are prescribed integers representing the lower and upper bounds of time-varying delay . Similarly, and are prescribed integers representing the lower and upper bounds of time-varying delay . , , , , , , and are known mode-dependent matrices with appropriate dimension functions of the random jumping process and represent the nominal systems for each . For notation simplicity, when the system operates in the i th mode (), , , , , , , and are denoted as , , , , , , and , respectively.
Remark 1 In this paper, the lower bound of is required in order to implement the proposed delay decomposition method. If , then corresponds to the constant delay.
Moreover, the transient process of a system can be clearly characterized if its decay rate is available. The objective of this study is to develop a new approach to designing a state feedback controller
via a novel Lyapunov functional such that the resulting closed-loop system is finite-time stable, where is the controller gains to be designed.
In this paper, we split the delay interval into two segments: . Moreover, we further subdivide each interval into l, m equal length subsegments and , respectively, where
and l, m are given positive integers.
Remark 2 The delay intervals are divided subsegments dependent on t, thus the proposed delay decomposition method is more general than those in [13–17, 19–24]. The conservatism will be reduced with the partitioning number l and m increase.
In order to more precisely describe the main objective, we introduce the following definitions and lemmas for the underlying system.
Definition 2.1 System (1) is said to be finite-time bounded with respect to if condition (2) and the following inequality hold:
where and .
Definition 2.2 
Consider as the stochastic Lyapunov function of the resulting system (1), its weak infinitesimal operator is defined as
Definition 2.3 Given a constant , for all admissible subject to condition (2), under zero initial conditions, if the closed-loop Markovian jump system (1) is finite-time bounded and the control outputs satisfy condition (5) with attenuation ,
then the controller system (1) is called the finite-time bounded with disturbance attenuation γ.
Remark 3 It should be pointed that the assumption of zero initial condition in system (1) is only for the purpose of technical simplification in the derivation, and it does not lose generality. In fact, if this assumption is lost, the same control result can still be got along the same lines, except adding extra manipulations in the derivation and extra terms in the control presentation. However, in real world applications, the initial condition of the underlying system is generally not zero.
Lemma 2.1 
Let () have positive values in an open subset of . Then the reciprocally convex combination of over satisfies
Lemma 2.2 For a given function , (), there exist four functions , , and satisfying and , respectively, such that , the following equation holds:
Lemma 2.3 
For matrices A, and , the following matrix inequality
holds if and only if there exists a matrix G of appropriate dimension such that
Lemma 2.4 ( Schur complement)
Given constant matrices X, Y, Z, where and , then if and only if
3 Finite-time performance analysis
We first consider the problem of stability analysis for system (1) with . The following results actually present the finite-time stability for the Markov jump system with time-varying delay.
Theorem 3.1 System (1) is finite-time bounded with respect to if there exist matrices , , (), , , , , , scalars , , , , , (), , and , such that for all , , , the following inequalities hold:
Proof First, in order to cast our model into the framework of the Markov processes, we define a new process by
Now, we consider the following Lyapunov-Krasovskii functional:
Then, let the mode at time t be i, i.e., , we have
By using Lemma 2.1, it yields that
It follows from (9) and () that
Similarly, (10) implies
From (12)-(16), we can eventually obtain
By Lemma 2.2, there exist functions , , and satisfying and , respectively. Using the Schur complement such that
where , , and are defined in Theorem 3.1. Substituting (18) into (17), then (18) can be rewritten as
Therefore, the following relation holds by condition (8) and (19):
Multiplying the aforementioned inequality by , we can get
By integrating the aforementioned inequality between 0 and t, it follows that
Denote , , , , , it yields that
Noting that and , we have
On the other hand, it follows from (12) that
It can be derived from (21)-(22) that
From (11) and (23), we have
Then the system is finite-time bounded with respect to . □
Remark 4 It should be mentioned that novel terms and are continuous at is included in the Lyapunov-Krasovskii functional (12), which plays an important role in reducing conservativeness of the derived result.
Remark 5 In this paper, and may have different upper bounds in various delay intervals satisfying (3) and (4), respectively. While in previous work such as [16, 17], and are enlarged to and , respectively, which may lead to conservativeness inevitably. However, the case above can be taken fully into account by employing the Lyapunov-Krasovskii functional (12).
Remark 6 When dealing with term , the convex combination is not employed, Lemma 2.1 is used in this paper, then the free-weighting matrices-dependent null add items are necessary to be introduced in our proof, which leads to the decrease in the number of LMIs and LMIs scalar decision variables.
Remark 7 The feature of this paper is the way to deal with the integral term. Many researchers have enlarged the derivative of the Lyapunov functional in order to deal with the integral term in mathematical operations. In this paper, we transform different integral intervals with the same integral length into an integral interval. It is worth pointing out that in the proof of the theorem no extra inequality is introduced. We propose a novel delay-dependent sufficient criterion, which ensures that the Markovian jump system with time-varying delays is finite-time stable.
Remark 8 One can clearly see from the proof of Theorem 3.1 that neither free-weighting matrices nor model transformation has been employed to deal with the sum terms, and none of useful items are ignored, resulting in better results with the less number of LMIs scalar decision variables, which deduces some conservatism in some sense.
By using the novel Lyapunov functionals with the more general decomposition of delay interval, a state feedback controller (3) can be designed such that the resulting closed-loop system is finite-time bounded with performance. When , the closed-loop system is expressed by
Theorem 3.2 System (25) is finite-time bounded with respect to if there exist matrices , , (), , , , , scalars , , , , , , (), , and , such that for all , , , the following inequalities hold:
Proof We now consider the performance of system (25). Select the same Lyapunov-Krasovskii functional as Theorem 3.1 and the Schur complement, it yields that
It follows from (26) that
Multiplying the aforementioned inequality by , one has
Under zero initial condition and , by integrating the aforementioned inequality between 0 and T, we can get
Then it yields
Thus it is concluded by Definition 2.3 that system (25) is finite-time bounded with an performance γ. The proof is completed. □
Remark 9 From the proof process of Theorem 3.1 and Theorem 3.2, it is easy to see that neither bounding technique for cross terms nor model transformation is involved. In other words, the obtained result is expected to be less conservative.
Remark 10 Lyapunov asymptotic stability and finite-time stability of a class of systems are independent concepts. Lyapunov asymptotically stable system may not be finite-time stable. Moreover, finite-time stable system may also not be Lyapunov asymptotically stable. There exist some results on Lyapunov stability, while finite-time stability also needs our full investigation, which was neglected by most previous work.
4 Finite-time control
Theorem 4.1 System (25) is finite-time bounded with respect to if there exist matrices , , (), , , , , scalars , , , , , (), , and , such that for all , , , the following inequalities hold: