- Open Access
A new approach to quantized stabilization of a stochastic system with multiplicative noise
Advances in Difference Equations volume 2013, Article number: 20 (2013)
A new quantization-dependent Lyapunov function is proposed to analyze the quantized feedback stabilization problem of systems with multiplicative noise. For convenience of the proof, only a single-input case is considered (which can be generalized to a multi-input channel). Conditions for the systems to be quantized mean-square poly-quadratically stabilized are derived, and the analysis of performance and controller design is conducted for a given logarithmic quantizer. The most significant feature is the utilization of a quantization-dependent Lyapunov function, leading to less conservative results, which is shown both theoretically and through numerical examples.
Rapid advancement of digital networks has witnessed a growing interest in investigating efforts of signal quantization on feedback control systems. The emerging network-based control system where information exchange between the controller and the plant is through a digital channel with limited capacities has further strengthened the importance of the study on quantized feedback control. Different from the classical control theory where data transmission is assumed to have an infinite precision, transmission subject to quantization or limited data capacity in digital networks, the tools in classical control theory may be invalid, so new tools need to be developed for the analysis and design of quantized feedback systems.
The study of quantized feedback control can be traced back to . Most of the early research focuses on the understanding and mitigation of the quantization effects, while the quantization error is considered to impair the performance . In modern control theory where the quantizer is always considered as an information encoder and decoder, one main problem is how much information has to be transmitted in order to make the system achieve a certain objective for the closed-loop system. For a discrete-time system with a single-input channel, when the static quantizer is considered,  shows the minimum data rate for the system to be stabilized is proved to be characterized by the unstable roots of the system matrix, and the coarsest quantizer is logarithmic.  considers the case when the input channel subject to Bernoulli packets dropouts, the minimum data rate is related not only to the unstable roots of the system matrix, but also with the packets dropout probability. As for a discrete-time system with single input subject to multiplicative noises in , the coarsest static quantizer for the system to be quadratically mean-square stabilized is proved to be logarithmic with infinite levels, and the quantization density can be approximated by solving a Riccati equation; comprehensive study on feedback control systems with logarithmic quantizers is not given. A sector bound approach is proposed in  to characterize the quantization error caused by a logarithmic quantizer, by which many quantized problem can be solved by the robust tools. The results are also extended to adaptive control in [7, 8] and the LQR-type problem in . Based on the characterization of the quantized error,  gives less conservative conditions of the quantization density to achieve stability by studying the properties of the logarithmic quantizer further;  use a method based on Tsypkin-type Lyapunov functions to study the absolute stability analysis of quantized feedback control of a discrete-time linear system, less conservative conditions than those in the quadratic framework are derived.  showed that a finite-level logarithmic quantizer suffices to approach the well-known minimum average data rate for stabilizing an unstable linear discrete-time system under two basic network configurations, and explicit finite-level logarithmic quantizers and the corresponding controllers to approach the minimum average data rate are derived. For networked systems,  gives the quantized output-feedback controller for the control with data packets dropout.
In this paper, a new approach to the analysis and synthesis of quantized feedback control for stochastic systems with multiplicative noise is proposed. Using logarithmic quantized state-feedback control, results for mean-square stabilization and performance analysis as well as the controller synthesis are given. Less conservative results are derived by the utilization of a quantization-dependent Lyapunov function, which is shown both theoretically and through a numerical example.
Notations: () means P is a symmetric positive (semi-positive) matrix. stands for the transposition of matrix P. The space of a square summable infinite sequence is denoted by , and for , its norm is given by .
2 Stability and stabilization
2.1 Problem formulation
Consider the following linear discrete-time systems with multiplicative noise:
where is the system state vector with known initial state ; is the control input; is the process noise with , , and is uncorrelated with initial state . As proved in , the coarsest static quantizer for the system (1) to be quadratically mean-square stabilized via quantized state-feedback is proved to be logarithmic. Suppose u is a scalar that has to be quantized, the logarithmic quantizer is in the following form:
with quantization levels as
where ρ is the quantized density of the logarithmic quantizer q, which can be computed using the approach given in , with
For the multi-input case with different quantizers, the state-feedback control without quantization is in the form of
which has to be transmitted through a digital network subject to logarithmic quantizers as given in (2), and denote the quantized control as
where , are quantizers with different quantization density.
Without loss of generality, in this paper only a single-input case with is considered for simplicity, which can be generalized to a multi-input case. For a quantizer as given in the form of (2), as illustrated in , using the sector bound approach, the quantization error can be characterized as
where with δ given by (4), so the closed-loop system with quantized feedback is given by
We mainly focus on the derivation of less conservative sufficient conditions for the system to achieve certain performance. To make the paper self-contained, the definitions for the system (8) to be mean-square stable and mean-square poly-quadratical stable are introduced.
Definition 1 The closed system (8) is called mean-square stable with quantized feedback control in the form of (6) if there exists a control Lyapunov function satisfying
for all and the given quantization.
Definition 2 The closed system (8) is called mean-square poly-quadratically stable with quantized control in the form of (6) if there exists a Lyapunov function
where and are symmetric positive matrices with proper dimensions satisfying
for all and the given quantization.
Remark 1 When setting , the control Lyapunov function proposed in Definition 2 reduces to the one given in Definition 1. We will show that the control Lyapunov function (10) can lead to less conservative conditions for the system (8) to be mean-square poly-quadratical stabilized than those deduced by the control Lyapunov function (10).
Problem formulation For the control Lyapunov function (10), deduce the conditions for the system (1) to be mean-square poly-quadratical stabilized via quantized feedback control in the form of (6).
2.2 Stability analysis
In this part, we give the conditions for the system (8) to achieve quantized mean-square poly-quadratical stability. First, a necessary and sufficient condition is deduced.
Theorem 1 For the discrete-time stochastic system (1) and the quantized state feedback control law in the form of (6), given a logarithmic quantizer as in (2), the closed-loop system (8) is mean-square poly-quadratically stable if and only if there exist matrices , , and satisfying
Proof According to Definition 2, for defined as in (10), the closed-loop system is mean-square poly-quadratically stable if
for all the and . Plugging into (14), and by considering (6), we have
which is equivalent to
In the next part, we will show that the expressions in (10) and (16) hold if and only if (12) and (13) hold.
⇒ (12) and (13): By the Schur complement, (16) is equivalent to(17)
Consider the following four cases:
For cases (a) and (b), from (17) we have
For cases (c) and (d), from (17) we have
By selecting , we can obtain (12) and (13). Therefore, it can be concluded that if (16) holds, there must exist matrices , , and satisfying (12) and (13).
and (13) ⇒ (16): Suppose there exist matrices , , and satisfying (12) and (13). First, as , we have , which implies(21)
From (12) and (21) we have
By multiplying and to the left- and right-hand side of (22) and (23), respectively, we get
and we get
and we get
and we can deduce that
The proof is completed. □
2.3 Controller design
In the above section, the controller is assumed to be known for the stability analysis. In practical situations, however, the controller has to be designed to guarantee the closed-loop system to achieve stability. The following theorem provides a controller design method based on Theorem 1.
Theorem 2 Consider the system (1) and the state feedback control law in (5). Given a logarithmic quantizer as in (2), the closed-loop system (6) is mean-square poly-quadratically stabilized if there exist matrices , , V and K satisfying
In this situation, the controller can be designed as
Proof Suppose that there exist matrices and , V and satisfying (31) and (32). From the block, we know that , which means , so V is nonsingular. Performing and to (31) and (32), respectively, yields
By defining the following matrix variables: , , , if there exist matrices , , and satisfying (12) and (13), and using the controller gain given in (33), the system (8) can achieve mean-square poly-quadratically stability. □
Theorem 2 is based on Theorem 1 by setting , which increases the conservativeness; the following theorem gives a less conservative condition.
Theorem 3 Consider the system in (1) and the state feedback control law in (5). Given a logarithmic quantizer as in (2), the closed-loop system in (8) is mean-square poly-quadratically stable if there exist matrices , , and K satisfying
Proof First, from the block of (36), we can know that is nonsingular. By multiplying and to the left- and right-hand side of (36) and (37), with the Schur complement and the constraint (38), and defining , we can get the theorem. □
Remark 2 It is worth noting that when is known, the conditions in Theorem 1 are linear matrix inequalities over the matrix variables , , and . When Theorem 1 is used to compute the coarsest quantization density such that the closed-loop quantized system is mean-square poly-quadratically stable, that is, (12) and (13) are bilinear matrix inequalities. In this case, a line search (such as the bisection method) has to be performed to the variables δ in (12) and (13), and find iteratively, which can be referred to [13–16].
2.4 Illustrative example
In this part, an example is given to show that the new proposed Lyapunov function can lead to less conservative conditions of the quantization density for the system to achieve stability.
Example 1 For the stochastic discrete-time system (1), consider the scalar case of the following form:
It can be proved that the system without control part is unstable in the mean-square sense. Suppose that the state-feedback in (5) is given by , and the quantizer we use is logarithmic in the form of (2). We want to determine the maximum sector bound below which the stochastic system with quantized state feedback is mean-square asymptotically stable. Table 1 gives the maximum bound of using the Lyapunov function related to the quantization density proposed in this paper and the general control Lyapunov function.
3 Extension to performance analysis
For the system
where the state , the input and the system noise are defined as those of the system (1), is the control output. A, , B, , C, D, G, F are system matrices with proper dimensions. Suppose the quantizer is given to be logarithmic in the form of (24) and the quantization density is known, so the closed-loop system with the quantized state feedback control is given as follows:
where . Defining , the objective of this part is to derive the conditions for the system (42) and (43) to be mean-square asymptotically stable with an disturbance attention level γ, that is, for all the nonzero and for all the under zero conditions.
Theorem 4 For the system (40) and (41), considering the control law as given in (5), given a logarithmic quantizer as in (2), the closed-loop system in (42) and (43) is mean-square stable with an disturbance attention level γ if there exist matrices , , and satisfying
Proof The theorem is proven based on the Lyapunov function defined in (10). First, (44) and (45) imply (12) and (13), which guarantees the closed-loop system in (42) and (43) to be mean-square stable by Theorem 1. To prove the performance, assume zero initial conditions and consider the following index:
Then, along the solutions of (42) and (43), we have
with , , where
On the other hand, by similar reasoning as in the proof of Theorem 1, we can conclude from (42) and (43) that . Then from (48) we know that for all nonzero . The proof is completed. □
The problem of quantized state-feedback control for a stochastic system with multiplicative noises has been investigated through a quantization-dependent approach. Conditions for mean-square poly-quadratical stability are obtained by introducing a new quantization-dependent Lyapunov function approach for linear state feedback with a logarithmic quantizer, which are shown to be less conservative than those derived by a common Lyapunov function. Moreover, performance analysis has also been proposed in the quantization-dependent framework. However, it is worth pointing out that though less conservative conditions are obtained, different from the derivation of the coarsest quantizer, the explicit relation of the system matrices and quantization density is not given. The analysis of relation between the quantization density and the system matrices and the statistical properties of noises in the proposed quantization-dependent framework is a subject worth further researching.
Kalman RE: Nonlinear aspects of sampled-data control systems. In Proc. Symposium on Nonlinear Circuit Theory VII. Polytechnic Press, New York; 1956.
Lewis JB, Tou JT: Optimum sampled-data systems with quantized control signals. IEEE Trans. Appl. Ind. 1963, 82(67):229-233.
Elia N, Mitter S: Stabilization of linear systems with limited information. IEEE Trans. Autom. Control 2001, 46(9):1384-1400. 10.1109/9.948466
Tsumura K, Ishii H, Hoshina H: Tradeoffs between quantization and packet loss in networked control of linear systems. Automatica 2009, 45: 2963-2970. 10.1016/j.automatica.2009.09.030
Wei L, Fu M, Zhang H: Quantized stabilization for stochastic discrete-time systems with multiplicative noises. Int. J. Robust Nonlinear Control 2012. doi:10.1002/rnc.2778
Fu M, Xie L: The sector bound approach to quantized feedback control. IEEE Trans. Autom. Control 2005, 50(11):1698-1711.
Hayakawa T, Ishii H, Tsumura K: Adaptive quantized control for linear uncertain discrete-time systems. Automatica 2009, 45: 692-700. 10.1016/j.automatica.2008.07.005
Hayakawa T, Ishii H, Tsumura K: Adaptive quantized control for nonlinear uncertain systems. Syst. Control Lett. 2009, 58: 625-632. 10.1016/j.sysconle.2008.12.007
Gao H, Chen T: A new approach to quantized feedback control systems. Automatica 2008, 44: 534-542. 10.1016/j.automatica.2007.06.015
Zhou B, Duan G, Lam J: On the absolute stability approach to quantized feedback control. Automatica 2010, 46: 337-346. 10.1016/j.automatica.2009.10.039
You K, Su W, Fu M, Xie L: Attainability of the minimum data rate for stabilization of linear systems via logarithmic quantization. Automatica 2011, 47(1):170-176. 10.1016/j.automatica.2010.10.024
Niu Y, Jia T, Wang X, Yang F: Output-feedback control design for NCSs subject to quantization and dropout. Inf. Sci. 2009, 179(21):3804-3813. 10.1016/j.ins.2009.07.006
Feng G: Controller design and analysis of uncertain piecewise-linear systems. IEEE Trans. Circuits Syst. I 2002, 49(2):224-232. 10.1109/81.983869
Kocvara M, Stingl M: Pennon: a code for convex nonlinear and semidefinite programming. Optim. Methods Softw. 2003, 18(3):317-333. 10.1080/1055678031000098773
Zhu Y, Li DQ, Feng G: controller synthesis of uncertain piecewise continuous-time linear systems. IEE Proc., Control Theory Appl. 2005, 152(5):513-519. 10.1049/ip-cta:20055130
Zhang H, Feng G, Dang C:Stability analysis and control for uncertain stochastic piecewise-linear systems. IET Control Theory Appl. 2009, 3(8):1059-1069. 10.1049/iet-cta.2008.0200
We would like to thank the editor-in-chief, the associate editor and the reviewers for their valuable comments on the paper which have led to significant improvement on the presentation and quality of the paper. This work is supported by the Taishan Scholar Construction Engineering by Shandong Government, the National Natural Science Foundation (No. 61174141), and the Major State Basic Research Development Program of China (973 Program) (No. 2009cb320600), Yangtse Rive Scholar Bonus Schemes (No. 31400080963017), National Natural Science Foundation (No. 61034007).
The authors declare that they have no competing interests.
LW carried out the proof of the main part of this article, YY corrected the manuscript and participated in its design and coordination. All authors have read and approved the final manuscript.
About this article
Cite this article
Wei, L., Yang, Y. A new approach to quantized stabilization of a stochastic system with multiplicative noise. Adv Differ Equ 2013, 20 (2013). https://doi.org/10.1186/1687-1847-2013-20
- multiplicative noise
- discrete-time systems
- mean-square stability
- logarithmic quantizer
- Lyapunov function