 Research
 Open Access
 Published:
Stability and Hopf bifurcation analysis of fractionalorder complexvalued neural networks with time delays
Advances in Difference Equations volume 2017, Article number: 225 (2017)
Abstract
This paper considers a class of fractionalorder complexvalued Hopfield neural networks (CVHNNs) with time delay for analyzing the dynamic behaviors such as local asymptotic stability and Hopf bifurcation. In the case of a neural network with hub and ring structure, the stability of the equilibrium state is investigated by analyzing the eigenvalue of the corresponding characteristic matrix for the hub and ring structured fractionalorder time delay models using a Laplace transformation for the Caputofractional derivatives. Some sufficient conditions are established to guarantee the uniqueness of the equilibrium point. In addition, conditions for the occurrence of a Hopf bifurcation are also presented. Finally, numerical examples are given to demonstrate the effectiveness of the derived results.
Introduction
The discipline of neural networks, as other fields of science, has a long history of evolution with lots of ups and downs. In 1943 Warren McCulloch and Walter Pitts presented the first model of artificial neurons, named the Threshold Logic Unit (TLU). In the last few decades, the subjective analysis of neural networks (NNs) has received huge attention because of its strong applications in numerous fields such as signal and image processing, associative memories, combinatorial optimization and many others [1–6]. However, such practical applications of NNs are strongly dependent on the qualitative behaviors of NNs. In both biological and physical models, the occurrence of time delays plays an important role. Time delay, which happens usually due to system process and information flow to a particular part of dynamical systems, is unavoidable. Time delays in NNs may cause unexpected dynamical behaviors, like oscillation and poor performance, in networks; see [7–11]. Thus, the analysis on NNs with the effects of time delays has attracted the attention of many researchers and results have been published [12–17]. The stability of neural networks with both leakage delay and a reactiondiffusion term is discussed, and several sufficient conditions were obtained with the help of analysis technique and Lyapunov theory [16]. The problem of fixedtime synchronization of memristive neural networks was studied in [17].
Fractional calculus was introduced many years ago [8, 9, 18, 19], but in recent years the development of fractional calculus was improved step by step in many fields such as engineering mathematics, applied mathematics, and many fields of physics. Thus, recently researchers were strongly attracted towards fractionalorder systems compared with the integerorder one because of their great advantage of infinite memory and hereditary properties [3, 19–22]. In the field of neural networks, since the importance of the memory term is extremely high, the incorporation of fractional terms into neural networks leads to a new class of networks called fractionalorder NNs [23]. Fractionalorder neural networks with parameters such as state vectors, nonlinear activation functions and weight functions in a complex domain \(\mathbb{C}^{n}\) are called fractionalorder complexvalued neural networks (CVNNs) [3, 7, 24–28]. CVNNs has more remarkable applications in various dynamical systems, such as Lyapunov asymptotic stability, global stability and Hopf bifurcations compared with the realvalued NNs [8, 18, 29–32]. In realvalued NNs, continuously differentiable and bounded sigmoid activation functions are to be chosen, but in the case of a complex domain the activation functions are entire bounded, and they will reduce to a constant in the complex domain according to the Liouville theorem [18]. Therefore in the complex domain choosing the appropriate activation function is a great challenge [7, 33].
NNs contain several types of structures such as hub structure, ring structure and so on. In NNs, for appropriate neuronal wiring, it is necessary to have coordinated activation of neuronal assemblies. Hypothetically a few highly linked neurons with long ranging connectivity, the ‘hub neurons’, would be the most effective manner to organize networkwide synchronicity. Therefore, it is significant to consider the hub structure in neural networks to realize better performance. Moreover, ring architectures can be found in a number of neural structures from neurons in the mind and other sciences. The factual cortical bonding prototype is tremendously sparse. Almost all connections among adjacent cells and long range links became very rare. Thus, ring NNs can be analyzed to gain better understanding of the mechanisms underlying the performance of NNs. Many authors have discussed global stability, Lyapunov stability for the fractionalorder NNs, see [2, 14, 27, 29, 33–37], and for finitetime stability results are discussed in [26] and bifurcation of a delayed fractional systems is considered in [5, 38–40].
Stability theory is one of the most important and rapidly developing fields of applied mathematics and mechanics. In the design of a dynamical neural network it is always of interest to study the stability properties of the network. The stability studies in NNs have been developed finding the conditions which ensure that each trajectory of the network converges to an equilibrium point depending on the initial conditions. These completely stable NNs have been used as computing and cognitive machines. Moreover, it is well known that the dynamic behaviors such as periodic phenomenon, bifurcation and chaos are also of great interest. In general, in a dynamical system, if a parameter is allowed to vary, then the behavior of the whole dynamical system may change. The value of the parameter at which these changes occur is known as the bifurcation value and the parameter that is varied is known as the bifurcation parameter. In delay differential equations, Hopf bifurcation occurs in systems of differential equations consisting of two or more equations. Even though there is an extensive literature on bifurcation analysis of some special NNs, most of them deal only with the twoequation models and there were only few papers on the bifurcations of the highdimensional models [41–46]. However, all above mentioned works are on the bifurcation analysis of integerorder NNs. Nevertheless, most results on the integerorder NNs cannot be simply extended to the case of the fractionalorder one. To the best of our knowledge, no work on the Hopf bifurcation analysis of fractionalorder CVHNNs with hub structure and ring structure has been proposed in the literature. Therefore, this paper aims at fulfilling such a gap by investigating the stability and Hopf bifurcation of a class of delayed fractionalorder CVHNNs with hub structure and ring structure.
Motivated by the above discussion, in this paper we investigate the stability and Hopf bifurcation of the fractionalorder CVHNNs with time delays in two types of structures named ring and hub structures. First we consider the fractionalorder CVHNNs in the hub structure with time delays. Later the sufficient conditions for stability of the fractional system with respect to the equilibrium point of the system are derived by using some inequality techniques. Further, the bifurcation point of the hub structure with the corresponding critical frequency of the system and for the case similar to the ring structured one are derived. By using the bifurcation point and critical frequency the transversality condition is verified for the point of bifurcation occurring.
The rest of the paper is organized as follows. Necessary basic definitions and a problem description are given in Section 2. In Section 3, the two structures of fractionalorder CVHNNs with time delays to investigate the stability and Hopf bifurcation point of the system are presented and two numerical examples are to validate the efficacy of our theoretical findings in Section 4 and lastly a conclusion is discussed in Section 5.
Notations and preliminaries. The authors have derived the results using the following notations in this paper. \(\mathbb{R}^{n}\) and \(\mathbb{C}^{n}\) are ndimensional euclidean space and ndimensional complex domain, respectively. \(z(t)\) is a complex variable and is denoted \(z(t) = x(t) + i y(t)\), which is in the complex domain. \({}_{0}^{C} D_{t}^{\alpha}z(t)\) denotes the Caputofractional derivative of the complex variable \(z(t)\). There are several definitions of fractionalorder derivatives and fractional integrals are extensively used, named the RiemannLiouville derivative and integrals, the Caputo derivative, and GrunwaldLetnikov derivative etc. In this section we give the definitions of the first two.
Definition 1
[6]
The RiemannLiouville fractional derivatives \(D_{a+}^{ \alpha}g\) and \(D_{b}^{\alpha}g \) of order \(\alpha\in C ([R(\alpha)]\geq0)\) are defined by
and
where \([R(\alpha)]\) means that integral part of \(R(\alpha)\).
Definition 2
[13]
The RiemannLiouville fractional integral of order \(\alpha>0 \) for a continuous function \(g:\mathbb{R}^{+}\rightarrow \mathbb{R}\) is defined as
where \(I^{\alpha}\) denotes the RiemannLiouville fractional integral of order α and \(\Gamma(\alpha) \) is the Gamma function.
Definition 3
[47]
The Caputofractional derivative of order \(\alpha>0\) for a function \(g\in\mathbb{C}^{n+1}([0,\infty),\mathbb{R})\) is as follows (the set of all \(n+1 \) order continuous differentiable functions on \([0,\infty) \) is used):
where n is the first integer greater than α, that is, \(n1<\alpha<n\).
Especially, when \(\alpha\in(0,1) \)
Definition 4
[13]
The Gamma function is defined as
where the \(\operatorname {Re}(z)\) is the real part of z.
Model description
In this section we announce the stability analysis of the following fractionalorder CVHNNs system with time delays:
Here, \(\alpha\in(0,1)\), \(z_{r}\) are the complex state variables, \((z(t) = (z_{1}(t),z_{2}(t),z_{3}(t),\ldots,z_{n}(t))^{T})\), \(c_{r} \in\mathbb{R}^{n \times n}\) are the selfregulating parameters of the neurons, \(A=(a_{rm})_{n \times n}\), \(B=(b_{rm})_{n\times n}\) are the complex inter connection matrices without and with time delays t and \(t\gamma_{rm}\). The \(f_{m} : \mathbb{C} \rightarrow \mathbb{C} \) are the complexvalued activation functions for the inputoutput neurons and the system (1) can be written as
where \(Z(t)=(z_{1}(t),z_{2}(t),z_{3}(t),\ldots,z_{n}(t))^{T}\), \(C=\operatorname {diag}(c_{1},c_{2},c_{3},\ldots,c_{n}) \in\mathbb{R}^{n \times n}\) (for each \(c_{r}>0\)), \(A=(a_{rm})_{n \times n} \in\mathbb{C}^{n \times n}\), \(B=(b_{rm})_{n \times n}\in\mathbb{C}^{n \times n} \).
The activation functions are given by \(F(z(t))=(f_{1}(z_{1}(t)),f_{2}(z _{2}(t)),f_{3}(z_{3}(t)),\ldots, f_{n}(z_{n}(t)))^{T}\), \(F(z(t\gamma)) = ( f_{1}(z_{1}(t\gamma_{r1})),f_{2}(z_{2}(t\gamma _{r2})),\ldots,f_{n}(z_{n}(t\gamma_{rn})))^{T}\), \(r=1,2,3,\ldots,n\). We denote \(z(t)=x(t)+i y(t)\), \(z(t_{\gamma})=z(t\gamma) = x(t \gamma) + i y(t\gamma)\), \(A = A^{R}+i A^{I}\), \(B=B^{R}+i B^{I} \) and \(f(z)=f^{R}(x,y)+if^{I}(x,y)\) with \(x,y:\mathbb{R} \rightarrow \mathbb{R}^{n}\), \(A^{R},A^{I},B^{R},B^{I} \in\mathbb{R}^{n \times n}\); the system (2) can be equivalently written as the following realvalued fractionalorder system:
Now, consider \(u(t) = (x(t),y(t))^{T} \in\mathbb{R}^{2n}\),
The system (3) and (4) can be written as
Let us consider \(u^{*} = (x^{*},y^{*})^{T}\) to be an equilibrium state of the system (1). In general, for the linearization of system (5) at the equilibrium point the system can be written as
Here \(C=\operatorname {diag}(c_{1},c_{2},c_{3},\ldots,c_{n})\), \(\bar{A}^{R}=( \bar{a}^{R}_{pq})_{n \times n}\), \(\bar{A}^{I}=(\bar{a}^{I}_{pq})_{n \times n}\), \(\bar{B}^{R}=(\bar{B}^{R}_{pq})_{n \times n}\) and \(\bar{B}^{I}=(\bar{b}^{I}_{pq})_{n \times n}\). Now taking the Laplace transform on both sides of the system (6), we get the Jacobian matrix of the system as
where
and
The characteristic matrix of the system (6) is \(J(s)\) and the characteristic polynomial is obtained by taking the determinant of \(J(s) \). The stability of the equilibrium state \(Z^{*}=(z^{*}_{1},z ^{*}_{2},\ldots,z^{*}_{n})\) in the fractionalorder system is determined by the eigenvalues of \(\operatorname {Det}(J(s))\).
Lemma 1
[3]
If all the roots of the characteristic equation \(\operatorname {Det}(J(s))\) have negative real parts, then the zero equilibrium of system (1) is Lyapunov globally asymptotically stable.
Lemma 2
[3]
If the order of the system (1) lies between 0 and 1 all the characteristic roots of the matrix \(J(s)\) satisfy \(\vert \arg( \lambda) \vert >\frac{\alpha\pi}{2}\) and the characteristic equation \(\operatorname {Det}(J(s))\) has no purely imaginary roots for any \(\gamma_{rm}>0\), \(r=m=1,2,3,\ldots,n\), then the zero equilibrium solution of system (1) is Lyapunov globally asymptotically stable.
To determine our theoretical results we make the following hypothesis:
 \((\mathbb{H}1)\) :

The nonlinear activation functions \(f_{q}\) (\(q=1,2,3,\ldots,n\)) satisfies the Lipschitz condition, that is, there exist constants \(F_{k} > 0 \) such that
$$ \bigl\vert f_{q}(x)f_{q}(y) \bigr\vert \leq F_{k} \vert xy \vert , \quad\mbox{for all } x,y\in \mathbb{R}. $$  \((\mathbb{H}2)\) :

There exist constants \(\zeta_{p}\) (\(p=1,2,3,\ldots,n\)) such that the following inequality holds:
$$ \zeta_{p} c_{p} > \sum_{k=1}^{n} \zeta _{p} \bigl(F_{k} \vert a_{pk} \vert +F_{k} \vert b_{pk} \vert \bigr),\quad p=1,2,3,\ldots, n. $$
Lemma 3
[38]
If hypotheses \((\mathbb{H}1)\) and \((\mathbb{H}2)\) are satisfied then there exists a unique equilibrium point for the system (1).
Remark 1
From Lemma 3, we can conveniently discuss the existence and uniqueness of the equilibrium point for neural networks.
Main results
Fractionalorder CVHNNs with hub structure and time delays
In this section, we consider the fractionalorder CVHNNs for \(n\geq3\) neurons with hub structure and time delays to investigate the stability and Hopf bifurcation phenomenon,
where \(\alpha\in\mathbb{R}\) and \(0< \alpha<1\), \(c_{1},c_{r}>0\) (\(r=2,3,\ldots,n\)). \(z_{r}(t)\) are complex states. Here, the first neuron (named the central neuron) is the center of the hub, and all the other \(r1\) neurons (named the peripheral neurons) are connected directly only to the central neuron and to themselves. The interconnection matrix of this neural network model (7) is,
Let \(Z^{*}=(z_{1}^{*},z_{2}^{*},\ldots,z_{n}^{*})^{T} \) be an equilibrium point of the system (7). The system (7) can be written in the following vector form:
with diagonal matrix \(C=(c_{1},c_{2},c_{3},\ldots,c_{n}) \in \mathbb{R}^{n \times n}\), \(A, B \in\mathbb{C}^{n \times n}\), \(F(z(t))=(f _{1}(z_{1}(t)),f_{2}(z_{2}(t)), f_{3}(z_{3}(t)),\ldots,f_{n}(z_{n}(t)))^{T}\), \(F(z(t_{\gamma}))=(f _{1}(z_{1}(t\gamma_{1})),f_{2}(z_{2}(t\gamma)),f_{3}(z_{3}(t \gamma)),\ldots, f_{n}(z_{n}(t\gamma)))^{T}\) for the linearization of system (8) about the equilibrium point of the system (7) and we assume \(\gamma_{1}=\gamma\). The system (8) is linearized and the vector form of the system is
where \(C= \lceil c_{1},c_{2},c_{3},\ldots,c_{n} \rfloor\),
Taking the Laplace transform on both sides of (9), we have
where \(z_{r}(s) \) is the Laplace transform of \(z_{r}(t) \), that is, \(z_{r}(s) = L(z_{r}(t)) \), \(r=1,2,3,\ldots,n\), \(\psi_{r}(t)\), \(r=1,2,3,\ldots,n \), \(t\in[\gamma,0 )\), is the initial value of (7). Moreover, the above equation can be rewritten as follows:
where \(Z(s)=(z_{1}(s),z_{2}(s),z_{3}(s),\ldots,z_{n}(s))^{T}\), \(G(s)=(g_{1}(s),g_{2}(s),g_{3}(s),\ldots,g_{n}(s))^{T}\), \(g_{1}(s)= s^{\alpha1} \psi_{1}(0)+ \bar{b}_{1} e^{s \gamma} \int _{\gamma}^{0} e^{st} \psi_{1}(t) \,dt, g_{2}(s)=s^{\alpha1} \psi_{2}(0)+\bar{b} e^{s \gamma} \int _{\gamma}^{0} e^{st} \psi_{2}(t) \,dt, g_{3}(s)=s^{\alpha1} \psi_{3}(0)+\bar{b} e^{s \gamma} \int _{\gamma}^{0} e^{st} \psi_{3}(t) \,dt,\ldots, g_{n}(s)=s^{\alpha1} \psi_{n}(0)+\bar{b} e^{s \gamma} \int _{\gamma}^{0} e^{st} \psi_{n}(t) \,dt\).
For convenience, we take
Then the Jacobian matrix of the system (9) is
It follows that \(J(Z^{*}) \) is an \(n\times n \) matrix (\(n\geq3\) in hub structure). Now we find the determinant of \(J(Z^{*})\), that is, \(\operatorname {Det}(J(Z^{*}))=0\). The characteristic equation \(\operatorname {Det}(J(z^{*}))=0\) determines the local stability of the equilibrium solution. The characteristic roots of \(J(Z^{*}) \) satisfy the characteristic equation \(\operatorname {Det}(J(z^{*}))=0\).
If \(n=3\), the characteristic equation \(\operatorname {Det}(J(Z^{*}))=0\) satisfies
If \(n=4\), the characteristic equation \(\operatorname {Det}(J(Z^{*}))=0\) satisfies
If \(n=5\), the characteristic equation \(\operatorname {Det}(J(Z^{*}))=0\) satisfies
where \(P=c_{1}\bar{a}_{11}\bar{b}_{1} e^{s \gamma}\), \(Q=c_{r} \bar{a}_{rr}\bar{b} e^{s \gamma}\), \(H=\sum_{m=2}^{n} a_{1m}a _{m1}\), \(r=2,3,\ldots,n\).
The characteristic equation \(\operatorname {Det}(J(Z^{*}))=0\) satisfies
with \(P,Q,H \in\mathbb{C} \) defined above depending on the equilibrium \(\mathbb{Z}^{*}\) and the system parameters \(c_{1}\), \(c_{r}\), \(a_{rm}\), \(b_{1}\), b. Then the characteristic equation (13) will have the form
If the peripheral neurons are identical, then for convenience we take \(Q =c_{2}\bar{a}_{22}\bar{b} e^{s \gamma} \). Then (14) can be written as
\(s^{2 \alpha} + (c_{1}\bar{a}_{11}\bar{b}_{1} e^{s \gamma}+c _{2}\bar{a}_{22}\bar{b} e^{s \gamma}) s^{\alpha}+ (c_{1}\bar{a} _{11}\bar{b}_{1} e^{s \gamma})(c_{2}\bar{a}_{22}\bar{b} e^{s \gamma}) H=0\), then it can be written in the form of
where \(C_{l}\) (\(l=1,2,\ldots,5\)) are defined by \(C_{1}=((c_{1}+c_{2})( \bar{a}_{11}+\bar{a}_{22}))\), \(C_{2}=(c_{1} c_{2}c_{1} \bar{a}_{22}\bar{a}_{11} c_{2} + \bar{a} _{11}\bar{a}_{22}H)\), \(C_{3}=\bar{a}_{11} \bar{b}+\bar{a}_{22}\bar{b} _{1}\bar{b}_{1} c_{2}\bar{b} c_{1}\), \(C_{4}=(\bar{b}_{1}+\bar{b})\), \(C_{5}=\bar{b}_{1}\bar{b}\). For investigating (15), we obtain the following characteristic polynomial:
where \(E_{1}(s)=s^{2 \alpha}+C_{1} s^{\alpha}+C_{2}\), \(E_{2}(s)=C_{3}+C _{4}s^{\alpha}\), \(E_{3}(s)=C_{5}\).
By multiplying \(e^{s \gamma} \) on both sides of (16), we get
Let \(A_{r}\) and \(B_{r} \) be the real and imaginary parts of \(E_{r}(s)\) (\(r=1,2,3\)) and \(A_{r}\), \(B_{r}\) (\(r=1,2,3\)) are defined as
and
Then by using \(A_{r}\), \(B_{r}\) and substituting (18) in (17) we get
Further, we will analyze stability and bifurcation properties; for this we consider the real number \(\omega> 0\), there exists \(s=\omega i= \omega(\cos \frac{\pi}{2}+i \sin\frac{\pi}{2})\), then we substitute the expression of s into (19), which gives
then separating the real and imaginary parts of (20) and squaring both sides we get
According to \(\sin \omega\gamma=\pm\sqrt{1\cos ^{2} \omega\gamma}\), this leads to following two cases.
Case (a): If \(\sin \omega\gamma= \sqrt{1\cos ^{2} \omega\gamma}\), then it takes the following form:
It can be concluded that
where
As we know quadratic equation (22) has roots. We can obtain the expression of \(\cos\omega\gamma\) can be deduced from (22) and is denoted as \(f_{1}(\omega)\), that is, \(\cos\omega\gamma=f _{1}(\omega)\), Then substituting \(\cos\omega\gamma=f_{1}(\omega ) \) into equation (21) we get the expression of \(\sin\omega \gamma\) and it is represented as \(f_{2}(\omega)\). Both \(f_{1}( \omega) \) and \(f_{2}(\omega)\) are functions with respect to ω and
Moreover, \(f_{1}^{2}(\omega)+f_{2}^{2}(\omega)=1\). We obtain
Case (b): If \(\sin\omega\gamma=  \sqrt{1 \cos^{2} \omega \gamma}\), similar to Case (a), we can obtain \(\cos\omega\gamma= g _{1}(\omega)\) and \(\sin\omega\gamma=g_{2}(\omega)\), where \(g_{1}(\omega) \), \(g_{2}(\omega)\) is a function with respect to ω. Here ω is the root of the equation \(g_{1}^{2}( \omega)+g_{2}^{2}(\omega)=1\). If we take \(g_{1}(\omega)=\cos \omega\gamma\), we have
We will take that \(f_{1}^{2}(\omega)+f_{2}^{2}(\omega)=1\) or \(g_{1}^{2}(\omega)+g_{2}^{2}(\omega)=1\), having at least one positive real root, thus the bifurcation point is defined as
where \(\gamma_{1}^{(k)}\), \(\gamma_{2}^{(k)}\) are defined in (23) and (24).
Now, we examine the stability of system (7) for \(\gamma=0\), the characteristic equation (15) becomes
Equation (26) can be converted to
where
It is defined as
from the above we make the following hypotheses:
 \((\mathbb{H}3)\) :

\(\Psi_{i} > 0\) (\(i=1,2\)).
Lemma 4
If \(\Psi_{1} > 0\) and \(\Psi_{2} > 0 \) holds, then the zero equilibrium point of the fractionalorder system (7) is asymptotically stable when \(\gamma=0 \).
Remark 2
The conditions \(\Psi_{1} > 0\) and \(\Psi_{2} > 0 \) are sufficient condition for Lemma 4. If the conditions are retrieved by another method which entails that all the roots of equation (13) satisfy \(\vert \arg (\lambda) \vert > \frac{\alpha\pi}{2}\) then Lemma 4 may still hold.
In order to achieve the transversality condition for the occurrence for Hopf bifurcation, the following further hypothesis is needed:
 \((\mathbb{H}4)\) :

\(\operatorname {Re}[ \frac{ds}{d \gamma} ]  _{( \gamma= \gamma_{0} , \omega= \omega_{0})} \neq0\), where \(\gamma_{0}\) and \(\omega_{0}\) are bifurcation point and critical frequency, respectively.
Here
It can be deduced from (28) that
then we take
where \(X_{1}\), \(X_{2}\) are the real and imaginary parts of \(X(s)\) and \(Y_{1}\), \(Y_{2}\) are the real and imaginary parts of \(Y(s)\), which are defined as
From the above investigation we can state the following theorem.
Theorem 1
Assume that \((\mathbb{H}1)\)\((\mathbb{H}4)\) are satisfied for system (7), the following results hold:

(1)
The zero equilibrium point is asymptotically stable for \(\gamma\in[0, \gamma_{0} ) \).

(2)
The system (7) exhibits a Hopf bifurcation at the origin when \(\gamma=\gamma_{0} \), that is, the system (7) has a branch of periodic solutions bifurcating from the zero equilibrium point near \(\gamma=\gamma_{0} \).
Remark 3
The results on stability and Hopf bifurcation of fractionalorder CVHNNs with hub structure and time delays have not been attained before. The determined conditions on bifurcation are very straightforward, detailed and impressive and simple to be verified in the present work by applying Hopf bifurcation theory. Our work is to develop the study of the theory of nonlinear dynamics.
Fractionalorder CVHNNs with ring structure and time delays
In this section we consider the fractionalorder CVHNNs with ring structured network and time delay as
where the order \(\alpha\in(0, 1)\), \(z_{p}(t) \) (\(p=1,2\)) are complex states, \(c_{r}> 0\) (\(r = 1 , 2\)) are real values, γ is the time delay, f is the nonlinear activation function. A neural network with the ring connectivity structure is in (30), in which every neuron in the network is connected only to its closest neurons. It is clear that the \(Z^{*}\) is an equilibrium point of (30). We generate the following hypothesis on the nonlinear activation functions to the system in (30):
 \((\mathbb{A}1)\) :

\(f_{p} \in\mathbb{C}^{1}(\mathbb {R}, \mathbb{R})\), \(f_{p}(0)=0\),
Obviously, from \((\mathbb{A}1)\) \(Z^{*}=0\) is a solution of this equation as the trivial solution is a steady state of (30), then
Linearization of the above system with respect to the equilibrium state of the system (30) leads to
Then it can be written in the following form:
where \(\bar{a}_{rm}=a_{rm}f'(0)\) and \(\bar{b}_{rm}=b_{rm}f'(0)\), \(r,m=1,2\).
The system parameters \(a_{rm}\), \(b_{rm}\) (\(r,m =1,2\)) are connection weights of the neural network and we have the complex domain. We take the Laplace transform on both sides of (32) and (33),
where \(Z_{1}(s)\), \(Z_{2}(s)\) are the Laplace transforms of \(z_{1}(t)\), \(z _{2}(t)\), that is, \(L[z_{p}(t)]=Z_{p}(s)\), \(p=1,2\), and \(\psi_{1}(t)\), \(\psi_{2}(t)\), are the initial values of the (30). Then it can be written as
where
We will study the behavior of dynamical system by using two feasible equilibria. The characteristic equation for system (34) is
By (35), we can obtain the characteristic equation
where \(E_{1}(s)=s^{2\alpha}+C_{1}s^{\alpha}+C_{2}\), \(E_{2}(s)=C_{3}s ^{\alpha}+C_{4}\), \(E_{3}(s)=C_{5}\).
The coefficients are defined by \(C_{1}=\bar{a}_{11}\bar{a}_{22}+c _{1}+c_{2}\), \(C_{2}=\bar{a}_{12}\bar{a}_{21}+\bar{a}_{11}\bar{a}_{22} \bar{22}c_{1}\bar{a}_{11}c_{2}+c_{1}c_{2}\), \(C_{3}=\bar{b}_{11} \bar{b}_{22}\), \(C_{4}=\bar{a}_{11}\bar{b}_{22}\bar{b}_{22}c_{1} \bar{b}_{11}c_{2}+\bar{a}_{22}\bar{11}\bar{a}_{21}\bar{b}_{12} \bar{a}_{12}\bar{b}_{21}\), \(C_{5}=\bar{b}_{12}\bar{b}_{21}+\bar{b}_{11} \bar{b}_{22}\) and
The characteristic equation (36) determines the local stability of the equilibrium solution; the system (30) is stable iff all the eigenvalues of (35), having the solutions of
have negative real parts. It is well known that the equilibrium state \(Z^{*}\) is stable if all roots of (36) have negative real parts, and unstable if one root has a positive real part. Multiplying \(e^{s\gamma}\) on both sides of (38), it is obvious that
If \(s=i\omega=\omega ( \cos \frac{\pi}{2}+i \sin \frac{ \pi}{2} ) \), \(\omega>0\) is a root of (39) iff ω satisfies the following equations, we obtain
\(A_{r}\), \(B_{r}\) (\(r=1,2,3\)) are the real and imaginary parts of \(E_{r}(s)\) (\(r=1,2,3\)), respectively. Then (40) can be written as follows:
Separating the real and imaginary parts of the above leads to
where
Accordingly \(\sin^{2}\omega\gamma+\cos^{2} \omega\gamma=1\) leads to the following two cases.
Case (a): If we take \(\sin\omega\gamma= \sqrt{1\cos ^{2} \omega\gamma}\), then we have
It can be concluded from that
where
From this we can obtain the interpretation of the \(\cos\omega \gamma\) and denote \(\cos \omega\gamma=d_{1}(\omega)\). Using the expression of \(\cos \omega\gamma\) in (41) then we get \(\sin\omega\gamma\) and it is denoted \(\sin\omega\gamma=d _{2}(\omega)\), where \(d_{1}(\omega)\) and \(d_{2}(\omega)\) is functions with respect to ω.
We know that \(\sin^{2}\omega\gamma+\cos^{2} \omega\gamma=1\), from this identity we obtain \(d_{1}^{2}(\omega)+d_{2}^{2}(\omega)=1 \).
Hence, we get
Case (b): Now consider \(\sin\omega\gamma=  \sqrt{1 \cos ^{2} \omega\gamma}\), in the same way as Case (a), we can obtain \(\cos\omega\gamma= h_{1}(\omega)\), where \(h_{1}(\omega) \), \(h_{2}(\omega)\) is a function with respect to ω. It is the roots of the polynomial equation \(h_{1}^{2}(\omega)+h_{2}^{2}(\omega )=1\), where \(h_{2}(\omega)= \sin \omega\gamma\). In a similar way to Case (a) we find the value of ω in view of \(h_{1}( \omega)=\cos \omega\gamma\), we have
Here \(d_{1}^{2}(\omega)+d_{2}^{2}(\omega)=1 \), which has at least one positive real root, thus the bifurcation point is defined as
where \(\gamma_{1}^{(j)}\), \(\gamma_{2}^{(j)}\) are defined by (43) and (44).
Now, we analyze the stability of system (30) when \(\gamma=0\), so the characteristic equation (40) becomes
Then (46) can be written as
where
It is defined as
 \((\mathbb{A}2)\) :

\(\chi_{i} > 0\) (\(i=1,2\)).
Lemma 5
If \(\chi_{1} > 0\) and \(\chi_{2} > 0 \), then the equilibrium point of the fractionalorder CVHNNs with ring structured and time delay system (30) is stable when \(\gamma=0 \).
Now, considering the transversality condition of the occurrence for a Hopf bifurcation, it is given by
 \((\mathbb{A}3)\) :

\(\operatorname {Re}[ \frac{ds}{d \gamma} ]  _{( \gamma= \gamma_{0} , \omega= \omega_{0})} \neq0\),
coming by the same procedure as in the hub structure of earlier section, we have the condition for the Hopf bifurcation
where \(N_{1}\), \(N_{2}\) are the real and imaginary parts of \(X(s)\) and \(M_{1}\), \(M_{2}\) are the real and imaginary parts of \(Y(s)\). The terms in \(M_{1}\), \(M_{2}\), \(N_{1}\) and \(N_{2}\) have the same meaning as where we mentioned \(Y_{1}\), \(Y_{2}\), \(X_{1}\) and \(X_{2}\) in Section 3.1. The above analysis leads to the following theorem.
Theorem 2
Assume that \((\mathbb{H}1)\)\((\mathbb{H}2)\) and \((\mathbb{A}1)\)\(( \mathbb{A}3)\) are satisfied for fractionalorder system (30), the following results hold:

(1)
The zero equilibrium point is locally asymptotically stable for \(\gamma\in[0, \gamma_{0} ) \).

(2)
The fractionalorder system (30) exhibits a Hopf bifurcation at the origin when \(\gamma=\gamma_{0} \), that is, the system (30) has a branch of periodic solutions bifurcating from the zero equilibrium point near \(\gamma=\gamma_{0} \).
Numerical examples
In this section, numerical examples are given to verify the effectiveness of the analytical results. The simulation results are based on the AdamsBashforthMoulton predictorcorrector scheme for considered examples. The step length is taken in all the examples as \(h=0.01\).
Example 1
In this example, the occurrence of Hopf bifurcation problem is investigated for the fractionalorder CVHNNs with the hub structure and time delay system (7). Consider the following fractionalorder CVHNNs (for arbitrary order \(\alpha=0.9\)) of four neurons with hub structure and time delay:
Here the activation function is \(f(z)=\tanh(z)\), it is obvious that system (50) admits a zero equilibrium point with the complex derivative \(f'(0)=1\). The considered fractionalorder CVHNNs (50) is compared to (7), we have \(c_{1}=3\), \(c_{2}=c _{3}=c_{4}=2.8\), \(b_{1}=2i\), \(b=22i\), \(a_{11}=1+1.5i\), \(a_{22}=a_{33}=a _{44}=2+0.2i\), \(a_{12}=2.4+3.2i\), \(a_{13}=30.3i\), and \(a_{14}=1.61.5i\), the initial values of the activation function are chosen as \(z_{1}(0)=0.1+0.6i\), \(z_{2}(0)=0.2+0.4i\), \(z_{3}(0)=0.3+0.5i\), \(z_{4}(0)=0.1+0.3i\). We derive the critical frequency \(\omega_{0} =0.42 \) and the bifurcation point \(\gamma_{0} =0.32 \). Figure 1 shows the occurrence of a bifurcation point at \(\gamma_{0}= 0.32\) and the system is unstable when \(\gamma= 0.45 >\gamma_{0}= 0.32\). According to Theorem 1, the zero equilibrium point (0,0,0,0) is asymptotically stable when \(\gamma=0.31 < \gamma_{0}=0.32 \), which is depicted in Figure 2. In Figure 3, we show that the curve for the imaginary parts of \(z_{3}(t)\) and \(z_{4}(t)\) are unstable for \(\gamma= 0.45 >\gamma _{0}= 0.32\) and real parts of \(z_{1}\), \(z_{2}\), \(z_{3}\), \(z_{4}\) are stable for \(\gamma= 0.31 < \gamma_{0} = 0.32\). In Figure 4, we show the curve for the real parts is unstable for the system (50) for \(\gamma= 0.45 >\gamma_{0}= 0.32\) and a stability phase portrait is depicted in Figure 4 and Figure 5, for \(\gamma= 0.31 < \gamma_{0} = 0.32\). Figure 6 illustrates the phase portrait of the instability for (50), when \(\gamma= 0.45 >\gamma_{0}= 0.32\).
Example 2
Consider the following fractionalorder CVHNNs of two neurons with ring structure and time delay:
The values for (51) are chosen as \(c_{1}=0.2\), \(c_{2}=0.3\), \(a _{11}=0.30.4i\), \(a_{22}=0.50.4i\), \(a_{12}=0.6+0.2i\), \(a_{21}=0.50.3i\), and \(b_{11}=11i\), \(b_{22}=0.3+1i\), \(b_{12}=0.1+0.3i\), \(b _{21}=0.50.3i\). The activation functions are defined as \(f_{1}(z_{1}(t))= \tanh(z_{1})\), \(f_{2}(z_{2}(t))=\tanh(z_{2})\) and the initial values are chosen as \(z_{1}(0)=0.4+0.3i\), \(z_{2}(0)=0.2+0.5i\). The critical frequency \(\omega_{0} =1.25 \) and the bifurcation point \(\gamma_{0} =0.3 \) is obtained in Maple by simple calculations. The occurrence of the bifurcation point \(\gamma_{0}= 0.3\) is shown in Figure 7 and also the system (51) is unstable for \(\gamma= 0.45>\gamma_{0}=0.3\). According to Theorem 2, the zero equilibrium point is locally asymptotically stable when \(\gamma= 0.2 < \gamma_{0} =0.3 \), which is illustrated in Figure 8 and Figure 9. The phase portraits of stable and unstable versions of system (51) are represented in Figure 10.
Conclusions
In this paper, the class of fractionalorder CVHNNs with hub and ring structured system is considered in a time delay sense. In this paper we use the Laplace transforms to the system of linearized equation to get the characteristic matrix for further stability analysis of the equilibrium which has been completely characterized. The critical frequency of the fractionalorder α for which the corresponding bifurcation point may occur has been identified and the transversality condition is verified for the corresponding \(\omega_{0}\) and \(\gamma_{0}\). Moreover, the obtained conditions are simple, precise, effective and easy to verify. Numerical examples are given to verify the effectiveness of the theoretical results. Future work will focus on the analysis of stability and Hopf bifurcation of highdimensional fractionalorder ring structure CVHNNs with multiple delays.
References
 1.
Cochocki, A, Unbehauen, R: Neural Networks for Optimization and Signal Processing. Wiley, New York (1993)
 2.
Gopalsamy, K, He, X: Stability in asymmetric Hopfield nets with transmission delays. Phys. D: Nonlinear Phenom. 76, 344358 (1994)
 3.
Huang, C, Cao, J, Xiao, M, Alsaedi, A, Hayat, T: Bifurcations in a delayed fractional complexvalued neural network. Appl. Math. Comput. 292, 210227 (2017)
 4.
Hirose, A: ComplexValued Neural Networks. Springer, Berlin (2006)
 5.
Kim, T, Adali, T: Fully complex multi layer perceptron network for nonlinear signal processing. J. VLSI Signal Process. Syst. Signal Image Video Technol. 32, 2943 (2002)
 6.
Lin, S, Lu, C: Laplace transform for solving some families of fractional differential equations and its applications. Adv. Differ. Equ. 2013, 137 (2013)
 7.
Li, X, Rakkiyappan, R, Velmurugan, G: Dissipativity analysis of memristorbased complexvalued neural networks with timevarying delays. Inf. Sci. 294, 645665 (2015)
 8.
Rakkiyappan, R, Cao, J, Velmurugan, G: Existence and uniform stability analysis of fractionalorder complexvalued neural networks with time delays. IEEE Trans. Neural Netw. Learn. Syst. 26, 8497 (2015)
 9.
Velmurugan, G, Rakkiyappan, R, Vembarasan, V, Cao, J, Alsaedi, A: Dissipativity and stability analysis of fractionalorder complexvalued neural networks with time delay. Neural Netw. 86, 4253 (2016)
 10.
Arik, S: Stability analysis of delayed neural networks. IEEE Trans. Circuits Syst. I 47, 10891092 (2000)
 11.
Wang, H, Yu, Y, Wen, G, Zhang, S: Stability analysis of fractionalorder neural networks with time delay. Neural Process. Lett. 42, 479500 (2015)
 12.
Hopfield, JJ, Tank, DW: Neural computation of decisions in optimization problems. Biol. Cybern. 52, 141152 (1985)
 13.
Ding, Z, Shen, Y: Global dissipativity of fractionalorder neural networks with time delays and discontinuous activations. Neurocomputing 196, 159166 (2016)
 14.
Feng, C, Plamondon, R: On the stability analysis of delayed neural networks systems. Neural Netw. 14, 11811188 (2001)
 15.
Cao, J, Rakkiyappan, R, Maheswari, K, Chandrasekar, A: Exponential \(H_{\infty}\) filtering analysis for discretetime switched neural networks with random delays using sojourn probabilities. Sci. China, Technol. Sci. 59, 387402 (2016)
 16.
Li, R, Cao, J: Stability analysis of reactiondiffusion uncertain memristive neural networks with timevarying delays and leakage term. Appl. Math. Comput. 278, 5469 (2016)
 17.
Cao, J, Li, R: Fixedtime synchronization of delayed memristorbased recurrent neural networks. Sci. China Inf. Sci. 60, 032201 (2017)
 18.
Chen, L, Qu, J, Chai, Y, Wu, R, Qi, G: Synchronization of a class of fractionalorder chaotic neural networks. Entropy 15, 32653276 (2013)
 19.
Kriesel, D: A Brief Introduction on Neural Networks. Citeseer (2007)
 20.
Wang, Y, Li, T: Stability analysis of fractionalorder nonlinear systems with delay. Math. Probl. Eng. 2014, Article ID 301235 (2014)
 21.
Xia, YS, Wang, J: A general projection neural network for solving monotone variational inequalities and related optimization problems. IEEE Trans. Neural Netw. 15, 318328 (2004)
 22.
Huang, C, Cao, J: Active control strategy for synchronization and antisynchronization of a fractional chaotic financial system. Phys. A, Stat. Mech. Appl. 473, 262275 (2017)
 23.
Kaslik, E, Sivasundaram, S: Nonlinear dynamics and chaos in fractionalorder neural networks. Neural Netw. 32, 245256 (2012)
 24.
Huang, C, Cao, J, Xiao, M: Hybrid control on bifurcation for a delayed fractional gene regulatory network. Chaos Solitons Fractals 87, 1929 (2016)
 25.
Nitta, T: Orthogonality of decision boundaries in complexvalued neural networks. Neural Comput. 16, 7397 (2004)
 26.
Rakkiyappan, R, Velmurugan, G, Cao, J: Finitetime stability analysis of fractionalorder complexvalued memristorbased neural networks with time delays. Nonlinear Dyn. 78, 28232836 (2014)
 27.
Rakkiyappan, R, Sivaranjani, K, Velmurugan, G: Passivity and passification of memristorbased complexvalued recurrent neural networks with interval timevarying delays. Neurocomputing 144, 391407 (2014)
 28.
Zhao, H: Global asymptotic stability of Hopfield neural network involving distributed delays. Neural Netw. 17, 4753 (2014)
 29.
O’Kelly, ME: Routing traffic at hub facilities. Netw. Spat. Econ. 10, 173191 (2010)
 30.
Liu, C, Li, C, Huang, T, Li, C: Stability of Hopfield neural networks with time delays and variabletime impulses. Neural Comput. Appl. 22, 195202 (2013)
 31.
Song, C, Cao, J, Liu, Y: Robust consensus of fractionalorder multiagent systems with positive real uncertainty via secondorder neighbors information. Neurocomputing 165, 293299 (2015)
 32.
Song, C, Cao, J: Dynamics in fractionalorder neural networks. Neurocomputing 142, 494498 (2014)
 33.
Velmurugan, G, Rakkiyappan, R, Cao, J: Further analysis of global μstability of complexvalued neural networks with unbounded timevarying delays. Neural Netw. 67, 1427 (2015)
 34.
Chen, T: Global exponential stability of delayed Hopfield neural networks. Neural Netw. 14, 977980 (2001)
 35.
Fang, Y, Kincaid, TG: Stability analysis of dynamical neural networks. IEEE Trans. Neural Netw. 7, 9961006 (1996)
 36.
Liao, XF, Chen, G, Sanchez, EN: LMIbased approach for asymptotically stability analysis of delayed neural networks. IEEE Trans. Circuits Syst. I 49, 10331039 (2002)
 37.
Yu, W, Cao, J: Stability and Hopf bifurcation analysis on a fourneuron BAM neural network with time delays. Phys. Lett. A 351, 6478 (2006)
 38.
Huang, C, Cao, J, Ma, Z: Delayinduced bifurcation in a trineuron fractional neural network. Int. J. Inf. Syst. Sci. 47, 36683677 (2016)
 39.
Xiao, M, Zheng, WX, Jiang, G, Cao, J: Undamped oscillations generated by Hopf bifurcations in fractionalorder recurrent neural networks with Caputo derivative. IEEE Trans. Neural Netw. Learn. Syst. 12, 32013214 (2015)
 40.
Zhang, J, Jin, X: Global stability analysis in delayed Hopfield neural network models. Neural Netw. 13, 745753 (2000)
 41.
Cao, J, Xiao, M: Stability and Hopf bifurcation in a simplified BAM neural network with two time delays. IEEE Trans. Neural Netw. 18, 416430 (2007)
 42.
Hu, H, Huang, L: Stability and Hopf bifurcation analysis on a ring of four neurons with delays. Appl. Math. Comput. 213, 587599 (2009)
 43.
Li, X, Wei, J: On the zeros of a fourth degree exponential polynomial with applications to a neural network model with delays. Chaos Solitons Fractals 26, 519526 (2005)
 44.
Wei, J, Yuan, Y: Synchronized Hopf bifurcation analysis in a neural network model with delays. J. Math. Anal. Appl. 312, 205229 (2005)
 45.
Xu, W, Hayat, T, Cao, J, Xiao, M: Hopf bifurcation control for a fluid flow model of Internet congestion control systems via state feedback. IMA J. Math. Control Inf. 33, 6993 (2016)
 46.
Huang, C, Meng, Y, Cao, J, Alsaedi, A, Alsaadi, FE: New bifurcation results for fractional BAM neural network with leakage delay. Chaos Solitons Fractals 100, 3144 (2017)
 47.
Rakkiyappan, R, Velmurugan, G, Cao, J: Stability analysis of fractionalorder complexvalued neural networks with time delays. Chaos Solitons Fractals 78, 297316 (2015)
Acknowledgements
This work was supported by CSIR research project No.25(0237)/14/EMRII.
Author information
Additional information
Competing interests
The authors declare that they have no competing interests.
Authors’ contributions
All authors contributed equally and significantly in writing this article. All authors read and approved the final manuscript.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Received
Accepted
Published
DOI
Keywords
 Hopfield neural networks
 fractionalorder
 time delays
 hub structure
 ring structure
 stability
 Hopf bifurcation