# Oscillation deduced from the Neimark-Sacker bifurcation in a discrete dual Internet congestion control algorithm

- Yingguo Li
^{1}Email author

**2013**:136

https://doi.org/10.1186/1687-1847-2013-136

© Li; licensee Springer 2013

**Received: **14 February 2013

**Accepted: **24 April 2013

**Published: **13 May 2013

## Abstract

In this paper, we consider a dual Internet congestion control algorithm applied to a nonstandard finite-difference scheme, which responds to congestion signals from the network. By choosing delay as a bifurcation parameter, the local asymptotic stability of the positive equilibrium and the existence of Neimark-Sacker bifurcations are analyzed. Then the explicit algorithm for determining the direction of Neimark-Sacker bifurcations and the stability of invariant closed curves are derived. In addition, we give specific examples to illustrate the phenomenon that coincides with our theoretical results.

**MSC:**34K18, 34K20.

## Keywords

## 1 Introduction

Congestion control algorithms and active queue management (AQM) for Internet have been the focus of intense research since the seminal work of Kelly *et al.* [1]. Congestion control schemes can be divided into three classes: primal algorithms, dual algorithms and primal-dual algorithms [2]. In primal algorithms, the users adapt the source rates dynamically based on the route prices (the congestion signal generated by the link), and the links select a static law to determine the link prices directly from the arrival rates at the links. However, in dual algorithms, the links adapt the link prices dynamically based on the link rates, and the users select a static law to determine the source rates directly from the route prices and the source parameters. Primal-dual algorithms combine these two schemes and dynamically compute both user rates and link prices. In [3], a stability condition was provided for a single proportionally fair congestion controller with delayed feedback. Since then, this result was extended to networks in [4, 5]. In [4], the author studied the case of a network with users having arbitrary propagation delays to and from any links in the network. In [5], the authors studied a more general network with different roundtrip delays amongst different TCP connections.

where $f(\cdot )$ is a non-negative continuous, strictly decreasing demand function and has at least third-order continuous derivatives. The scalar *c* is the capacity of the bottleneck link and the variable *p* is the price at the link. *k* is a positive gain parameter, *τ* is the sum of forward and return delays. A great deal of research has been devoted to the global stability, periodic solutions and other properties of this model, for which we refer to [7, 8].

where $h=\frac{1}{m}$ ($m\in {\mathbb{Z}}_{+}$) stands for stepsize, and ${u}_{k}$ denotes the approximate value to $u(kh)$. This method can be seen as a modified forward Euler method.

The Neimark-Sacker bifurcation is the discrete analogue of the Hopf bifurcation that occurs in continuous systems. The Hopf bifurcation is extremely important in the continuous dual congestion control algorithm [7, 8]. Similarly, the Neimark-Sacker bifurcation is also highly relevant to the discrete dual congestion control algorithm. The purpose of this paper is to discuss this version as a discrete dynamical system by using Neimark-Sacker bifurcation theory of discrete systems.

The paper is organized as follows. In Section 2, we analyze the distribution of the characteristic equation associated with the discrete model and obtain the existence of the local Neimark-Sacker bifurcation. In Section 3, the direction and stability of a closed invariant curve from the Neimark-Sacker bifurcation of the discrete delay model are determined by using the theories of discrete systems in [13]. In Section 4, some computer simulations are performed to illustrate the theoretical results. Conclusions are given in the final section.

## 2 Neimark-Sacker bifurcation analysis

*A*is given by

It is well known that the stability of the zero equilibrium solution of (2.4) depends on the distribution of zeros of the roots of (2.6). In this paper, we employ the results from Zhang *et al.* [9] and He *et al.* [10] to analyze the distribution of zeros of characteristic Eq. (2.6). In order to prove the existence of the local Neimark-Sacker bifurcation at equilibrium, we need some lemmas as follows.

**Lemma 2.1** *There exists a* $\overline{\tau}>0$ *such that for* $0<\tau <\overline{\tau}$ *all roots of* (2.6) *have modulus less than one*.

*Proof*When $\tau =0$, (2.6) becomes

The equation has, at $\tau =0$, an m-fold root $\lambda =0$ and a simple root $\lambda =1$.

*τ*and is a differential function of

*τ*. From (2.6), we have

So, with the increase of $\tau >0$, *λ* cannot cross $\lambda =1$. Consequently, all roots of Eq. (2.6) lie in the unit circle for sufficiently small positive $\tau >0$, and the existence of the $\overline{\tau}$ follows. □

A Neimark-Sacker bifurcation occurs when a complex conjugate pair of eigenvalues of *A* cross the unit circle as *τ* varies. We have to find values of *τ* such that there are roots on the unit circle. Denote the roots on the unit circle by ${e}^{i{\omega}^{\ast}}$, ${\omega}^{\ast}\in (-\pi ,\pi )$. Since we are dealing with complex roots of a real polynomial, we only need to look for ${\omega}^{\ast}\in (0,\pi )$.

**Lemma 2.2**

*There exists an increasing sequence of values of the time delay parameter*$\tau ={\tau}_{j}$, $j=0,1,2,\dots ,[\frac{m-1}{2}]$

*satisfying*

*where* ${\omega}_{j}\in (\frac{2j\pi}{m},\frac{(2j+1)\pi}{m})$, $j=0,1,2,\dots ,[\frac{m-1}{2}]$.

*Proof*Denote the roots of Eq. (2.6) on the unit circle by ${e}^{i{\omega}^{\ast}}$, ${\omega}^{\ast}\in (0,\pi )$. Then

This completes the proof. □

**Lemma 2.3**

*Let*${\lambda}_{j}(\tau )={r}_{j}(\tau ){e}^{i{\omega}_{j}(\tau )}$

*be a root of*(2.6)

*near*$\tau ={\tau}_{j}$

*satisfying*${r}_{j}({\tau}_{j})=1$

*and*${\omega}_{j}({\tau}_{j})={\omega}_{j}$.

*Then*

*Proof*From (2.11) and (2.12), we obtain that

This completes the proof. □

Lemmas 2.1-2.3 immediately lead to the stability of the zero equilibrium of Eq. (2.3), and equivalently, of the positive equilibrium ${u}^{\ast}$ of Eq. (2.2). So, we have the following results on stability and bifurcation in system (2.2).

**Theorem 2.1** *There exists a sequence of values of the time*-*delay parameter* $0<{\tau}_{0}<{\tau}_{1}<\cdots <{\tau}_{[\frac{m-1}{2}]}$ *such that the positive equilibrium* ${u}^{\ast}$ *of Eq*. (2.2) *is asymptotically stable for* $\tau \in [0,{\tau}_{0})$ *and unstable for* $\tau >{\tau}_{0}$. *Equation* (2.2) *undergoes a Neimark*-*Sacker bifurcation at the positive equilibrium* ${u}^{\ast}$ *when* $\tau ={\tau}_{j}$, $j=0,1,2,\dots ,[\frac{m-1}{2}]$, *where* ${\tau}_{j}$ *satisfies* (2.13).

## 3 Direction and stability of the Neimark-Sacker bifurcation

In the previous section, we have obtained the conditions under which a family of invariant closed curves bifurcates from the steady state at the critical value $\tau ={\tau}_{j}$, $j=0,1,2,\dots ,[\frac{m-1}{2}]$. Without loss of generality, denote the critical value $\tau ={\tau}_{j}$ by ${\tau}^{\ast}$. In this section, following the idea of Hassard *et al.* [14], we study the direction and stability of the invariant closed curve when $\tau ={\tau}_{0}$ in the discrete Internet congestion control model. The method we use is based on the theories of a discrete system by Kuznetsov [13].

*A*corresponding to ${e}^{i{\omega}_{0}}$, then

and satisfying the normalization $\u3008{q}^{\ast},q\u3009=1$, where $\u3008{q}^{\ast},q\u3009={\sum}_{i=0}^{m}{\overline{q}}_{i}^{\ast}{q}_{i}$.

**Lemma 3.1** (See [15])

*Define a vector*-

*valued function*$q:\mathbb{C}\to {\mathbb{C}}^{m+1}$

*by*

*If* *ξ* *is an eigenvalue of* *A*, *then* $Ap(\xi )=\xi p(\xi )$.

**Lemma 3.2**

*Suppose*${q}^{\ast}={({q}_{0}^{\ast},{q}_{1}^{\ast},\dots ,{q}_{m}^{\ast})}^{T}$

*is the eigenvector of*${A}^{T}$

*corresponding to the eigenvalue*${e}^{-i{\omega}_{0}}$,

*and*$\u3008{q}^{\ast},q\u3009=1$.

*Then*

*where*$\alpha =(1-{e}^{-\tau kh}){u}^{\ast}{f}^{\prime}({u}^{\ast})$

*and*

*Proof*Assign ${q}^{\ast}$ satisfies ${A}^{T}{q}^{\ast}=\overline{z}{q}^{\ast}$ with $\overline{z}={e}^{-i{\omega}_{0}}$, then the following identities hold:

From normalization $\u3008{q}^{\ast},q\u3009=1$ and computation, Eq. (3.7) holds. □

*A*and ${\lambda}_{0}={e}^{i{\omega}_{0}}$. Following the algorithms in [13] and using a computation process similar to that in [15], we can compute an expression for the critical coefficient ${c}_{1}({\tau}_{0})$,

Substituting these into (3.9), we can obtain ${c}_{1}({\tau}_{0})$.

**Lemma 3.3** (See [6])

*Given the map*(2.4),

*assume*

- (1)
$\lambda (\tau )=r(\tau ){e}^{i\omega (\tau )}$,

*where*$r({\tau}^{\ast})=1$, ${r}^{\prime}({\tau}^{\ast})\ne 0$*and*$\omega ({\tau}^{\ast})={\omega}^{\ast}$; - (2)
${e}^{ik{\omega}^{\ast}}\ne 1$

*for*$k=1,2,3,4$; - (3)
$Re[{e}^{-i{\omega}^{\ast}}{c}_{1}({\tau}^{\ast})]\ne 0$.

*τ*in a one side neighborhood of ${\tau}^{\ast}$. The radius of the invariant curve grows like $O(\sqrt{|\tau -{\tau}^{\ast}|})$. One of the four cases below applies.

- (1)
${r}^{\prime}({\tau}^{\ast})>0$, $Re[{e}^{-i{\omega}^{\ast}}{c}_{1}({\tau}^{\ast})]<0$. The origin is asymptotically stable for $\tau <{\tau}^{\ast}$ and unstable for $\tau >{\tau}^{\ast}$. An attracting invariant closed curve exists for $\tau >{\tau}^{\ast}$.

- (2)
${r}^{\prime}({\tau}^{\ast})>0$, $Re[{e}^{-i{\omega}^{\ast}}{c}_{1}({\tau}^{\ast})]>0$. The origin is asymptotically stable for $\tau <{\tau}^{\ast}$ and unstable for $\tau >{\tau}^{\ast}$. A repelling invariant closed curve exists for $\tau <{\tau}^{\ast}$.

- (3)
${r}^{\prime}({\tau}^{\ast})<0$, $Re[{e}^{-i{\omega}^{\ast}}{c}_{1}({\tau}^{\ast})]<0$. The origin is asymptotically stable for $\tau >{\tau}^{\ast}$ and unstable for $\tau <{\tau}^{\ast}$. An attracting invariant closed curve exists for $\tau <{\tau}^{\ast}$.

- (4)
${r}^{\prime}({\tau}^{\ast})<0$, $Re[{e}^{-i{\omega}^{\ast}}{c}_{1}({\tau}^{\ast})]>0$. The origin is asymptotically stable for $\tau >{\tau}^{\ast}$ and unstable for $\tau <{\tau}^{\ast}$. A repelling invariant closed curve exists for $\tau >{\tau}^{\ast}$.

From the discussion in Section 2, we know that ${r}^{\prime}({\tau}^{\ast})>0$; therefore, by Lemma 3.3, we have the following result.

**Theorem 3.1** *For Eq*. (2.2), *the positive equilibrium* ${u}^{\ast}$ *is asymptotically stable for* $\tau \in [0,{\tau}_{0})$ *and unstable for* $\tau >{\tau}_{0}$. *An attracting* (*repelling*) *invariant closed curve exists for* $\tau >{\tau}_{0}$ *if* $Re[{e}^{-i{\omega}_{0}}{c}_{1}({\tau}_{0})]<0$ (>0).

## 4 Computer simulation

In this section, we confirm our theoretical analysis by numerical simulation. We choose $f(u)=\frac{1}{u}$ as in [8] and set $k=0.01$, $m=20$, $c=50$. Then ${\tau}_{0}=3.0$ is the Neimark-Sacker bifurcation value.

In Figures 1 and 2, we show the waveform plot and phase plot for (2.2) with initial values ${u}_{j}=0.05$ ($j=0,1,\dots ,20$) for $\tau =2.9<{\tau}_{0}=3.0$. The equilibrium ${u}^{\ast}=0.02$ of Eq. (2.2) is asymptotically stable. In Figures 3 and 4 we show the waveform plot and phase plot for (2.2) with initial values ${u}_{j}=0.05$ ($j=0,1,\dots ,20$). The equilibrium ${u}^{\ast}=0.02$ of (2.2) is unstable for $\tau =3.1>{\tau}_{0}=3.0$. When *τ* varies and passes through ${\tau}_{0}=3.0$, the equilibrium loses its stability and an invariant closed curve bifurcates from the equilibrium for $\tau =3.1>{\tau}_{0}=3.0$. That is the delay difference Eq. (2.2) which has a Neimark-Sacker bifurcation at ${\tau}_{0}$.

## 5 Conclusion

In this paper, we focus our study on the Neimark-Sacker bifurcation in a fair dual algorithm of an Internet congestion control system. By using communication delay as a bifurcation parameter, we have shown that when the communication delay of the system passes through a critical value, a family of periodic orbits bifurcates from the equilibrium point. Furthermore, we have analyzed the stability and direction of the bifurcating periodic solutions. The results of numerical simulations agree with the theoretical results very well and verify the theoretical analysis.

## Declarations

### Acknowledgements

The author is grateful to anonymous referees for their excellent suggestions, which greatly improved the paper. Also, this work was supported by the Foundation of Fujian Education Bureau (JB12046).

## Authors’ Affiliations

## References

- Kelly FP, Maulloo A, Tan DK: Rate control in communication networks: shadow prices, proportional fairness, and stability.
*J. Oper. Res. Soc.*1998, 49: 237-252.View ArticleGoogle Scholar - Liu S, Basar T, Srikant R: Exponential-RED: a stabilizing AQM scheme for low-and high-speed TCP protocols.
*IEEE/ACM Trans. Netw.*2005, 13(5):1068-1081.View ArticleGoogle Scholar - Kelly FP: Models for a self-managed Internet.
*Philos. Trans. R. Soc. Lond. A*2000, 358: 2335-2348. 10.1098/rsta.2000.0651View ArticleGoogle Scholar - Massoulie L: Stability of distributed congestion control with heterogeneous feedback delays.
*IEEE Trans. Autom. Control*2002, 47: 895-902. 10.1109/TAC.2002.1008356MathSciNetView ArticleGoogle Scholar - Wang XF, Chen G, Ko KT: A stability theorem for Internet congestion control.
*Syst. Control Lett.*2002, 45: 81-85. 10.1016/S0167-6911(01)00165-7MathSciNetView ArticleGoogle Scholar - Wiggins S:
*Introduction to Applied Nonlinear Dynamical System and Chaos*. Springer, New York; 1990.View ArticleGoogle Scholar - Raina G: Local bifurcation analysis of some dual congestion control algorithms.
*IEEE Trans. Autom. Control*2005, 50(8):1135-1146.MathSciNetView ArticleGoogle Scholar - Ding D, Zhu J, Luo X, Liu Y: Delay induced Hopf bifurcation in a dual model of Internet congestion control algorithm.
*Nonlinear Anal., Real World Appl.*2009, 10: 2873-2883. 10.1016/j.nonrwa.2008.09.007MathSciNetView ArticleGoogle Scholar - Zhang C, Zu Y, Zheng B: Stability and bifurcation of a discrete red blood cell survival model.
*Chaos Solitons Fractals*2006, 28: 386-394. 10.1016/j.chaos.2005.05.042MathSciNetView ArticleGoogle Scholar - He Z, Lai X, Hou A: Stability and Neimark-Sacker bifurcation of numerical discretization of delay differential equations.
*Chaos Solitons Fractals*2009, 41: 2010-2017. 10.1016/j.chaos.2008.08.009MathSciNetView ArticleGoogle Scholar - Mickens RE: A nonstandard finite-difference scheme for the Lotka-Volterra system.
*Appl. Numer. Math.*2003, 45: 309-314. 10.1016/S0168-9274(02)00223-4MathSciNetView ArticleGoogle Scholar - Su H, Ding X: Dynamics of a nonstandard finite-difference scheme for Mackey-Glass system.
*J. Math. Anal. Appl.*2008, 344: 932-941. 10.1016/j.jmaa.2008.03.044MathSciNetView ArticleGoogle Scholar - Kuznetsov YA:
*Elements of Applied Bifurcation Theory*. Springer, New York; 1995.View ArticleGoogle Scholar - Hassard BD, Kazarinoff ND, Wa YH:
*Theory and Applications of Hopf Bifurcation*. Cambridge University Press, Cambridge; 1981.Google Scholar - Wulf V:
*Numerical Analysis of Delay Differential Equations Undergoing a Hopf Bifurcation*. University of Liverpool, Liverpool; 1999.Google Scholar

## Copyright

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.