# Neural Network Adaptive Control for Discrete-Time Nonlinear Nonnegative Dynamical Systems

- Wassim M. Haddad
^{1}Email author, - VijaySekhar Chellaboina
^{2}, - Qing Hui
^{1}and - Tomohisa Hayakawa
^{3}

**2008**:868425

**DOI: **10.1155/2008/868425

© Wassim M. Haddad et al. 2008

**Received: **27 January 2008

**Accepted: **8 April 2008

**Published: **9 April 2008

## Abstract

Nonnegative and compartmental dynamical system models are derived from mass and energy balance considerations that involve dynamic states whose values are nonnegative. These models are widespread in engineering and life sciences, and they typically involve the exchange of nonnegative quantities between subsystems or compartments, wherein each compartment is assumed to be kinetically homogeneous. In this paper, we develop a neuroadaptive control framework for adaptive set-point regulation of discrete-time nonlinear uncertain nonnegative and compartmental systems. The proposed framework is Lyapunov-based and guarantees ultimate boundedness of the error signals corresponding to the physical system states and the neural network weighting gains. In addition, the neuroadaptive controller guarantees that the physical system states remain in the nonnegative orthant of the state space for nonnegative initial conditions.

## 1. Introduction

Neural networks have provided an ideal framework for online identification and control of many complex uncertain engineering systems because of their great flexibility in approximating a large class of continuous maps and their adaptability due to their inherently parallel architecture. Even though neuroadaptive control has been applied to numerous engineering problems, neuroadaptive methods have not been widely considered for problems involving systems with nonnegative state and control constraints [1, 2]. Such systems are commonly referred to as *nonnegative dynamical systems* in the literature [3–8]. A subclass of nonnegative dynamical systems are *compartmental systems* [8–18]. Compartmental systems involve dynamical models that are characterized by conservation laws (e.g., mass and energy) capturing the exchange of material between coupled macroscopic subsystems known as compartments. The range of applications of nonnegative systems and compartmental systems includes pharmacological systems, queuing systems, stochastic systems (whose state variables represent probabilities), ecological systems, economic systems, demographic systems, telecommunications systems, and transportation systems, to cite but a few examples. Due to the severe complexities, nonlinearities, and uncertainties inherent in these systems, neural networks provide an ideal framework for online adaptive control because of their parallel processing flexibility and adaptability.

In this paper, we extend the results of [2] to develop a neuroadaptive control framework for discrete-time nonlinear uncertain nonnegative and compartmental systems. The proposed framework is Lyapunov-based and guarantees ultimate boundedness of the error signals corresponding to the physical system states as well as the neural network weighting gains. The neuroadaptive controllers are constructed *without* requiring knowledge of the system dynamics while guaranteeing that the physical system states remain in the nonnegative orthant of the state space. The proposed neuro control architecture is modular in the sense that if a nominal linear design model is available, the neuroadaptive controller can be augmented to the nominal design to account for system nonlinearities and system uncertainty. Furthermore, since in certain applications of nonnegative and compartmental systems (e.g., pharmacological systems for active drug administration) control (source) inputs as well as the system states need to be nonnegative, we also develop neuroadaptive controllers that guarantee the control signal as well as the physical system states remain nonnegative for nonnegative initial conditions.

The contents of the paper are as follows. In Section 2, we provide mathematical preliminaries on nonnegative dynamical systems that are necessary for developing the main results of this paper. In Section 3, we develop *new* Lyapunov-like theorems for partial boundedness and partial ultimate boundedness for nonlinear dynamical systems necessary for obtaining less conservative ultimate bounds for neuroadaptive controllers as compared to ultimate bounds derived using classical boundedness and ultimate boundedness notions. In Section 4, we present our main neuroadaptive control framework for adaptive set-point regulation of nonlinear uncertain nonnegative and compartmental systems. In Section 5, we extend the results of Section 4 to the case where control inputs are constrained to be nonnegative. Finally, in Section 6 we draw some conclusions.

## 2. Mathematical Preliminaries

In this section we introduce notation, several definitions, and some key results concerning linear and nonlinear discrete-time nonnegative dynamical systems [19] that are necessary for developing the main results of this paper. Specifically, for
we write
(resp.,
) to indicate that every component of
is nonnegative (resp., positive). In this case, we say that
is *nonnegative* or *positive*, respectively. Likewise,
is *nonnegative* or *positive* if every entry of
is nonnegative or positive, respectively, which is written as
or
, respectively. In this paper it is important to distinguish between a square nonnegative (resp., positive) matrix and a nonnegative-definite (resp., positive-definite) matrix. Let
and
denote the nonnegative and positive orthants of
, that is, if
, then
and
are equivalent, respectively, to
and
. Finally, we write
to denote transpose,
for the trace operator,
(resp.,
) to denote the minimum (resp., maximum) eigenvalue of a Hermitian matrix,
for a vector norm, and
for the set of all nonnegative integers. The following definition introduces the notion of a nonnegative (resp., positive) function.

Definition 2.1.

A real function
is a *nonnegative* (resp., *positive*) *function* if
(resp.,
),
.

where
is nonnegative and
, using *linear* and *quadratic* Lyapunov functions, respectively.

Theorem 2.2 (see [19]).

*diagonal*matrix and an positive-definite matrix such that

where , , , and are nonnegative matrices.

Theorem 2.4.

Consider the discrete-time linear dynamical system given by (2.4), where is nonnegative and partitioned as in (2.6), and is nonnegative and is partitioned as in (2.5) with rank . Then there exists a gain matrix such that is nonnegative and asymptotically stable if and only if is asymptotically stable.

Proof.

Assume that
is nonnegative and asymptotically stable, and suppose that, *ad absurdum*,
is not asymptotically stable. Then, it follows from Theorem 2.2 that there does not exist a positive vector
such that
. Next, since
is nonnegative it follows that
for any positive vector
. Thus, there does not exist a positive vector
such that
, and hence, it follows from Theorem 2.2 that
is not asymptotically stable leading to a contradiction. Hence,
is asymptotically stable. Conversely, suppose that
is asymptotically stable. Then taking
and
, where
is nonnegative and asymptotically stable, it follows that
, and hence,
is nonnegative and asymptotically stable.

where
,
is an open subset of
with
, and
is continuous on
. Recall that the point
is an *equilibrium point* of (2.8) if
. Furthermore, a subset
is an *invariant set* with respect to (2.8) if
contains the orbits of all its points. The following definition introduces the notion of nonnegative vector fields [19].

Definition 2.5.

Let
, where
is an open subset of
that contains
. Then
is *nonnegative with respect to*
,
, if
for all
, and
.
is *nonnegative* if
for all
, and
.

Note that if , where , then is nonnegative if and only if is nonnegative [19].

Proposition 2.6 (see [19]).

Suppose . Then is an invariant set with respect to (2.8) if and only if is nonnegative.

where , , , , is continuous and satisfies , and is continuous.

The following definition and proposition are needed for the main results of the paper.

Definition 2.7.

The discrete-time nonlinear dynamical system given by (2.9) is *nonnegative* if for every
and
,
, the solution
,
, to (2.9) is nonnegative.

Proposition 2.8 (see [19]).

The discrete-time nonlinear dynamical system given by (2.9) is nonnegative if and , .

It follows from Proposition 2.8 that a nonnegative input signal , , is sufficient to guarantee the nonnegativity of the state of (2.9).

where is continuous in and on and , , and is continuous. For the following result, the definition of nonnegativity holds with (2.9) replaced by (2.10).

Proposition 2.9.

Consider the time-varying discrete-time dynamical system (2.10) where is continuous on for all and is continuous on for all . If for every , is nonnegative and is nonnegative, then the solution , , to (2.10) is nonnegative.

Proof.

where . Now, since , , for , and , the result is a direct consequence of Proposition 2.8.

## 3. Partial Boundedness and Partial Ultimate Boundedness

*partial boundedness*and

*partial ultimate boundedness*of discrete-time nonlinear dynamical systems. These notions allow us to develop less conservative ultimate bounds for neuroadaptive controllers as compared to ultimate bounds derived using classical boundedness and ultimate boundedness notions. Specifically, consider the discrete-time nonlinear autonomous interconnected dynamical system

where , is an open set such that , , is such that, for every , and is continuous in , and is continuous. Note that under the above assumptions the solution to (3.1) and (3.2) exists and is unique over .

- (i)
The discrete-time nonlinear dynamical system (3.1) and (3.2) is

*bounded with respect to**uniformly in*if there exists such that, for every , there exists such that implies for all . The discrete-time nonlinear dynamical system (3.1) and (3.2) is*globally bounded with respect to**uniformly in*if, for every , there exists such that implies for all . - (ii)
The discrete-time nonlinear dynamical system (3.1) and (3.2) is

*ultimately bounded with respect to**uniformly in**with ultimate bound*if there exists such that, for every , there exists such that implies , . The discrete-time nonlinear dynamical system (3.1) and (3.2) is*globally ultimately bounded with respect to**uniformly in**with ultimate bound*if, for every , there exists such that implies , .

Note that if a discrete-time nonlinear dynamical system is (globally) bounded with respect to uniformly in , then there exists such that it is (globally) ultimately bounded with respect to uniformly in with an ultimate bound . Conversely, if a discrete-time nonlinear dynamical system is (globally) ultimately bounded with respect to uniformly in with an ultimate bound , then it is (globally) bounded with respect to uniformly in . The following results present Lyapunov-like theorems for boundedness and ultimate boundedness for discrete-time nonlinear systems. For these results define , where and is a given continuous function. Furthermore, let , , , denote the open ball centered at with radius and let denote the closure of , and recall the definitions of class- , class- , and class- functions [20].

Theorem 3.2.

, and . If, in addition, and is a class- function, then the discrete-time nonlinear dynamical system (3.1) and (3.2) is globally bounded with respect to uniformly in and for every , , , where is given by (3.5) with .

Proof.

See [20, page 786].

Theorem 3.3.

where is such that . Finally, assume exists. Then the nonlinear dynamical system (3.1), (3.2) is ultimately bounded with respect to uniformly in with ultimate bound where . Furthermore, . If, in addition, and is a class- function, then the nonlinear dynamical system (3.1) and (3.2) is globally ultimately bounded with respect to uniformly in with ultimate bound .

Proof.

See [20, page 787].

The following result on ultimate boundedness of interconnected systems is needed for the main theorems in this paper. For this result, recall the definition of input-to-state stability given in [21].

Proposition 3.4.

Consider the discrete-time nonlinear interconnected dynamical system (3.1) and (3.2). If (3.2) is input-to-state stable with viewed as the input and (3.1) and (3.2) are ultimately bounded with respect to uniformly in , then the solution , , of the interconnected dynamical system (3.1)-(3.2), is ultimately bounded.

Proof.

which proves that the solution , to (3.1) and (3.2) is ultimately bounded.

## 4. Neuroadaptive Control for Discrete-Time Nonlinear Nonnegative Uncertain Systems

*set-point*regulation in the nonnegative orthant. Specifically, consider the controlled discrete-time nonlinear uncertain dynamical system given by

where
is a positive diagonal matrix and
is a nonnegative matrix function such that
,
. The control input
in (4.1) is restricted to the class of *admissible controls* consisting of measurable functions such that
,
. In this section, we do not place any restriction on the sign of the control signal and design a neuroadaptive controller that guarantees that the system states remain in the nonnegative orthant of the state space for nonnegative initial conditions and are ultimately bounded in the neighborhood of a desired equilibrium point.

where denotes the Euclidean vector norm. Unless otherwise stated, henceforth we use to denote the Euclidean vector norm. Note that is an equilibrium point of (4.1) and (4.2) if and only if there exists such that (4.6) and (4.7) hold.

where
,
, are optimal *unknown* (constant) weights that minimize the approximation error over
,
,
, are a set of basis functions such that each component of
takes values between 0 and 1,
,
, are the modeling errors, and
, where
,
, are bounds for the optimal weights
,
.

Since is continuous, we can choose , , from a linear space of continuous functions that forms an algebra and separates points in . In this case, it follows from the Stone-Weierstrass theorem [22, page 212] that is a dense subset of the set of continuous functions on . Now, as is the case in the standard neuroadaptive control literature [23], we can construct the signal involving the estimates of the optimal weights as our adaptive control signal. However, even though , , provides adaptive cancellation of the system uncertainty, it does not necessarily guarantee that the state trajectory of the closed-loop system remains in the nonnegative orthant of the state space for nonnegative initial conditions.

This upper bound is used in the proof of Theorem 4.1 below.

so that . Now, for a given desired set point and for some , our aim is to design a control input , , such that and for all , where , and and , , for all . However, since in many applications of nonnegative systems and, in particular, compartmental systems, it is often necessary to regulate a subset of the nonnegative state variables which usually include a central compartment, here we only require that , .

Theorem 4.1.

, , , , and and are positive constants satisfying and , respectively. Furthermore, and , , for all .

Proof.

See Appendix A.

*unknown*positive diagonal matrix but , , where is known, we can take the gain matrix to be diagonal so that , where is such that , . In this case, taking in (4.4) to be the identity matrix, is given by which is clearly nonnegative and asymptotically stable, and hence, any positive diagonal matrix satisfies (4.18). Finally, it is important to note that the control input signal , , in Theorem 4.1 can be negative depending on the values of , . However, as is required for nonnegative and compartmental dynamical systems the closed-loop plant states remain nonnegative.

Next, we generalize Theorem 4.1 to the case where the input matrix is not necessarily nonnegative. For this result denotes the th row of .

Theorem 4.2.

where satisfies (4.18), and are positive constants satisfying and , , —guarantees that there exists a positively invariant set such that , where , and the solution , , of the closed-loop system given by (4.1), (4.2), (4.15), and (4.21) is ultimately bounded for all with ultimate bound , , where is given by (4.19) with replaced by in and , . Furthermore, and , , for all .

Proof.

The proof is identical to the proof of Theorem 4.1 with replaced by .

Finally, in the case where
is an *unknown* diagonal matrix but the sign of each diagonal element is known and
,
, where
is known, we can take the gain matrix
to be diagonal so that
, where
is such that
,
. In this case, taking
in (4.4) to be the identity matrix,
is given by
which is nonnegative and asymptotically stable.

Example 4.3.

## 5. Neuroadaptive Control for Discrete-Time Nonlinear Nonnegative Uncertain Systems with Nonnegative Control

where , , and , may not be asymptotically stabilizable with a constant control . Hence, we assume that the set point satisfying is a unique equilibrium point in the nonnegative orthant with and is also asymptotically stable for all . This implies that the equilibrium solution to (5.1) with is asymptotically stable for all .

In this section, we assume that in (4.4) is nonnegative and asymptotically stable, and hence, without loss of generality (see [19, Proposition 3.1]), we can assume that is an asymptotically stable compartmental matrix [19]. Furthermore, we assume that the control inputs are injected directly into separate compartments so that and in (4.14) are such that is a positive diagonal matrix and , where , , is a known positive diagonal matrix function. For compartmental systems, this assumption is not restrictive since control inputs correspond to control inflows to each individual compartment. For the statement of the next theorem, recall the definitions of and , , given in Theorem 4.1.

Theorem 5.1.

, , , , and and are positive constants satisfying and . Furthermore, , , and , , for all .

Proof.

See Appendix B.

## 6. Conclusion

In this paper, we developed a neuroadaptive control framework for adaptive set-point regulation of discrete-time nonlinear uncertain nonnegative and compartmental systems. Using Lyapunov methods, the proposed framework was shown to guarantee ultimate boundedness of the error signals corresponding to the physical system states and the neural network weighting gains while additionally guaranteeing the nonnegativity of the closed-loop system states associated with the plant dynamics.

## Declarations

### Acknowledgments

This research was supported in part by the Air Force Office of Scientific Research under Grant no. FA9550-06-1-0240 and the National Science Foundation under Grant no. ECS-0601311.

## Authors’ Affiliations

## References

- Hayakawa T, Haddad WM, Bailey JM, Hovakimyan N: Passivity-based neural network adaptive output feedback control for nonlinear nonnegative dynamical systems.
*IEEE Transactions on Neural Networks*2005, 16(2):387-398. 10.1109/TNN.2004.841782View ArticleGoogle Scholar - Hayakawa T, Haddad WM, Hovakimyan N, Chellaboina V: Neural network adaptive control for nonlinear nonnegative dynamical systems.
*IEEE Transactions on Neural Networks*2005, 16(2):399-413. 10.1109/TNN.2004.841791View ArticleGoogle Scholar - Berman A, Plemmons RJ:
*Nonnegative Matrices in the Mathematical Sciences*. Academic Press, New York, NY, USA; 1979:xviii+316.MATHGoogle Scholar - Berman A, Neumann M, Stern RJ:
*Nonnegative Matrices in Dynamic Systems, Pure and Applied Mathematics*. John Wiley & Sons, New York, NY, USA; 1989:xxii+167.Google Scholar - Farina L, Rinaldi S:
*Positive Linear Systems: Theory and Application, Pure and Applied Mathematics*. John Wiley & Sons, New York, NY, USA; 2000:x+305.View ArticleGoogle Scholar - Kaszkurewicz E, Bhaya A:
*Matrix Diagonal Stability in Systems and Computation*. Birkhäuser, Boston, Mass, USA; 2000:xiv+267.MATHView ArticleGoogle Scholar - Kaczorek T:
*Positive 1D and 2D Systems*. Springer, London, UK; 2002.MATHView ArticleGoogle Scholar - Haddad WM, Chellaboina V: Stability and dissipativity theory for nonnegative dynamical systems: a unified analysis framework for biological and physiological systems.
*Nonlinear Analysis: Real World Applications*2005, 6(1):35-65. 10.1016/j.nonrwa.2004.01.006MATHMathSciNetView ArticleGoogle Scholar - Mohler RR: Biological modeling with variable compartmental structure.
*IEEE Transactions on Automatic Control*1974, 19(6):922-926. 10.1109/TAC.1974.1100739MathSciNetView ArticleGoogle Scholar - Maeda H, Kodama S, Kajiya F: Compartmental system analysis: realization of a class of linear systems with physical constraints.
*IEEE Transactions on Circuits and Systems*1977, 24(1):8-14. 10.1109/TCS.1977.1084267MATHMathSciNetView ArticleGoogle Scholar - Sandberg IW: On the mathematical foundations of compartmental analysis in biology, medicine, and ecology.
*IEEE Transactions on Circuits and Systems*1978, 25(5):273-279. 10.1109/TCS.1978.1084473MATHMathSciNetView ArticleGoogle Scholar - Maeda H, Kodama S, Ohta Y: Asymptotic behavior of nonlinear compartmental systems: nonoscillation and stability.
*IEEE Transactions on Circuits and Systems*1978, 25(6):372-378. 10.1109/TCS.1978.1084490MATHMathSciNetView ArticleGoogle Scholar - Funderlic RE, Mankin JB: Solution of homogeneous systems of linear equations arising from compartmental models.
*SIAM Journal on Scientific and Statistical Computing*1981, 2(4):375-383. 10.1137/0902030MATHMathSciNetView ArticleGoogle Scholar - Anderson DH:
*Compartmental Modeling and Tracer Kinetics, Lecture Notes in Biomathematics*.*Volume 50*. Springer, Berlin, Germany; 1983:vii+302.View ArticleGoogle Scholar - Godfrey K:
*Compartmental Models and Their Application*. Academic Press, London, UK; 1983:xiv+293.Google Scholar - Jacquez JA:
*Compartmental Analysis in Biology and Medicine*. University of Michigan Press, Ann Arbor, Mich, USA; 1985.Google Scholar - Bernstein DS, Hyland DC: Compartmental modeling and second-moment analysis of state space systems.
*SIAM Journal on Matrix Analysis and Applications*1993, 14(3):880-901. 10.1137/0614060MATHMathSciNetView ArticleGoogle Scholar - Jacquez JA, Simon CP: Qualitative theory of compartmental systems.
*SIAM Review*1993, 35(1):43-79. 10.1137/1035003MATHMathSciNetView ArticleGoogle Scholar - Haddad WM, Chellaboina V, August E: Stability and dissipativity theory for discrete-time non-negative and compartmental dynamical systems.
*International Journal of Control*2003, 76(18):1845-1861. 10.1080/00207170310001635400MATHMathSciNetView ArticleGoogle Scholar - Haddad WM, Chellaboina V:
*Nonlinear Dynamical Systems and Control: A Lyapunov-Based Approach*. Princeton University Press, Princeton, NJ, USA; 2008.Google Scholar - Jiang Z-P, Wang Y: Input-to-state stability for discrete-time nonlinear systems.
*Automatica*2001, 37(6):857-869. 10.1016/S0005-1098(01)00028-0MATHMathSciNetView ArticleGoogle Scholar - Royden HL:
*Real Analysis*. 3rd edition. Macmillan, New York, NY, USA; 1988:xx+444.MATHGoogle Scholar - Lewis FL, Jagannathan S, Yesildirak A:
*Neural Network Control of Robot Manipulators and Nonlinear Systems*. Taylor & Francis, London, UK; 1999.Google Scholar

## Copyright

This article is published under license to BioMed Central Ltd. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.