 Research
 Open Access
 Published:
Meansquare stability of Riemann–Liouville fractional Hopfield’s graded response neural networks with random impulses
Advances in Difference Equations volume 2021, Article number: 98 (2021)
Abstract
In this paper a model of Hopfield’s graded response neural network is investigated. A network whose neurons are subject to a certain impulsive state displacement at random times is considered. The model is set up and studied. The presence of random moments of impulses in the model leads to a change of the solutions to stochastic processes. Also, we use the Riemann–Liouville fractional derivative to model adequately the longterm memory and the nonlocality in the neural networks. We set up in an appropriate way both the initial conditions and the impulsive conditions at random moments. The application of the Riemann–Liouville fractional derivative leads to a new definition of the equilibrium point. We define meansquare MittagLeffler stability in time of the equilibrium point of the model and study this type of stability. Some sufficient conditions for this type of stability are obtained. The general case with time varying selfregulating parameters of all units and time varying functions of the connection between two neurons is studied.
Introduction
The study of the dynamic behavior of neural networks has been investigated in many papers in the literature. Some researchers have found that in contrast to signal processing of integerorder models of neural networks, the application of fractionalorder derivatives has significant advantages in modeling the problem. One of the most popular and influential types of neural networks is the classical firstorder Hopfield neural network [12]. The longterm memory and the nonlocality of fractional derivatives allowed them to be incorporated into neural networks to describe better the behavior of the neurons connected with memory and heredity. Many researchers studied fractional neural networks and obtained many advantages over integerorder neural networks. For instance, Alofi et al. [6] studied the finitetime stability of Caputo fractional neural networks with distributed delay. Kaslik et al. [13] discussed the stability analysis of fractionalorder neural networks of Hopfield type. It is worth mentioning that a novel conceptual framework of the fractionalorder Hopfield neural network has been given in [18]. Several results concerning the implementation of the Caputo fractional derivative in the model have been obtained in the literature. We could mention, for example, the papers in [13, 18, 23, 31] about Caputo fractionalorder Hopfield type neural networks.
Note that the case of fractionalneural networks with Riemann–Liouville (RL) fractional derivatives is not well studied because of this type of derivative and the required initial condition (see, for example, [10, 11, 15, 27, 29]). At the same time, there are some inaccuracies when the RL fractional derivative is applied. For example, in papers [10, 15, 27] the RL fractional integral and the RL fractional derivative, respectively, are not well defined in the initial conditions associated with the RL fractional model with delay. In [30] the equilibrium point is defined by an equation which has only the zero solution (see Remarks 3 and 1).
Sometimes, neural networks are subject to some perturbations acting on a negligible small time. The models in this case are socalled impulsive models. In the case when the time of impulsive perturbations are initially given deterministic points, the impulsive models with ordinary derivatives for neural networks are studied in [9, 19, 22, 25, 26, 33]. Note that impulsive fractional neural networks are studied for Caputo fractional derivative in several papers, such as [17, 20, 24, 32], and for RL fractional derivative, see [28, 29].
The presence of randomness in the neural networks could be incorporated in various ways. One of them is considering stochastic models (see, for example, the review paper [21] and the references cited therein). Another is considering impulsive perturbation in the neural networks occurring at random times (see, for example, [3, 4]).
The main goal of this paper is to define and study for the first time the RL fractional generalization of a Hopfield neural network with impulses occurring at random times. Initially, a brief detailed explanation of the solutions being stochastic processes is provided. Then, the equilibrium, deeply connected with the RL fractional derivative, is defined (it is different than the equilibrium in impulsive Caputo fractional models). Note that the presence of the RL fractional derivative and the type of the initial condition require a new type of stability which excludes an appropriate neighborhood of the initial time point (it is different than in impulsive Caputo fractional models). This stability, called the meansquare MittagLeffler stability in time, is defined and studied in the paper. Some examples are provided to illustrate the introduced equilibrium, the defined fractional Dini derivative of Lyapunov functions as well as the practical application of the obtained sufficient conditions.
The main contributions in this paper could be summarized as follows:

the model of Hopfield’s neural networks with RL fractional derivative and impulses at random times is defined;

the model with all variables in time coefficients is investigated;

both the initial conditions and the impulsive conditions are set up in an appropriate way;

the equilibrium point, deeply connected with the properties of RL fractional derivative, is defined;

appropriate types of stability, called meansquare MittagLeffler stability in time and eventual meansquare MittagLeffler stability in time, are defined and studied.
Preliminary notes on fractional derivatives and equations
Let \(t_{0}\geq 0\) be a given number. In this paper we use the following definitions for fractional derivatives and integrals:

Riemann–Liouville (RL) fractional integral of order \(q\in (0,1)\) (see [7, 8, 16])
$$ {}_{t_{0}}I^{q}_{t}m(t)=\frac{1}{\Gamma ( q)} \int _{t_{0}}^{t} \frac{m(s)}{( ts) ^{1q}}\,ds,\quad t>t_{0}, $$where Γ is the gamma function.

Riemann–Liouville (RL) fractional derivative of order \(q\in (0,1)\) (see [7, 8, 16])
$$ {}_{t_{0}}^{RL}D^{q}_{t}m(t)= \frac{d}{dt} \bigl({}_{t_{0}}I^{1q}_{t}m(t) \bigr)= \frac{1}{\Gamma ( 1q )}\frac{d}{dt} \int _{t_{0}}^{t} ( ts ) ^{q}m(s)\,ds,\quad t>t_{0}. $$We call the point \(t_{0}\) a lower limit of the RL fractional derivative.

Grunwald–Letnikov fractional derivative given by (see [7, 8, 16])
$$ {}_{t_{0}}^{GL}D^{q}m(t)=\lim_{h\to 0} \frac{1}{h^{q}}\sum_{r=0}^{[ \frac{tt_{0}}{h}]} (1)^{r}{}_{q}C_{r}m(trh), \quad t>t_{0}, $$and the Grunwald–Letnikov fractional Dini derivative given by
$$ {}_{t_{0}}^{GL}D^{q}_{+}m(t)= \limsup_{h\to 0+}\frac{1}{h^{q}}\sum_{r=0}^{[ \frac{tt_{0}}{h}]} (1)^{r}{}_{q}C_{r}m(trh), \quad t>t_{0}, $$where \({}_{q}C_{r}=\frac{q(q1)\cdots (qr+1)}{r!}\), \(r\geq 0\), is an integer and \([\frac{tt_{0}}{h}]\) denotes the integer part of the fraction \(\frac{tt_{0} }{h}\).
The definitions of the initial condition for fractional differential equations with RLderivatives are based on the following result.
Lemma 2.1
(Lemma 3.2 [14])
Let \(q\in (0,1)\) and \(t\in J\).

(a)
If there exists a.e. a limit \(\lim_{t\to t_{0}+}[(tt_{0})^{1q}m(t)]=C\), then there also exists a limit
$$ {}_{t_{0}}I^{1q}_{t}m(t)\big _{t=t_{0}}:= \lim _{t\to t_{0}+}{}_{t_{0}}I^{1q}_{t}m(t) =C \Gamma (q). $$ 
(b)
If there exists a.e. a limit \({}_{t_{0}}I^{1q}_{t}m(t) _{t=t_{0}} =B\) and if there exists the limit \(\lim_{t\to t_{0}+}[(tt_{0})^{1q}m(t)] \), then
$$ \lim_{t\to t_{0}+} \bigl[(tt_{0})^{1q}m(t) \bigr] = \frac{B}{\Gamma (q)}. $$
Remark 1
Note that if \(m(t)\equiv C=const\), then
and
Let \(0\leq a< b\leq \infty \) and consider the scalar RL fractional differential equation
where \(f: [a,b]\times \mathbb{R}\to \mathbb{R}\).
Remark 2
Note that according to [14] the initial conditions to (1) could be one of the following forms:

integral form (see (3.1.6) [14])
$$ {}_{a}I^{1q}_{t}x(t)\big _{t=a}=B;$$(2) 
weighted Cauchy type problem (see (3.1.7) [14])
$$ \lim_{t\to a+} \bigl((ta)^{1q}x(t) \bigr)=C.$$(3)
Proposition 1
(Lemma 5.2 [8])
Let the function \(f : [a,b]\times \mathbb{R}\to \mathbb{R}\) be continuous, bounded, and Lipschitz with respect to the second variable.
Then the solution of the Cauchy type problem
satisfies the Volterra integral equation
and vise verse.
Description of the RL fractional model with random impulses
We consider the model proposed by Hopfield [12] and known as Hopfield’s graded response neural network. We generalize it in two ways:

the rate of change of the state variables of neurons will be modeled by an RL fractional derivative;

the neurons are subject to certain impulsive state displacements at random moments.
RL fractional model with fixed points of impulses
Initially, we consider the case of fixed initially given points of impulses \(\{T_{k}\}_{k=1}^{\infty }\) with \(0< T_{k}< T_{k+1}\), \(k=1,2,\ldots\) , and \(\lim_{k\to \infty }T_{k}=\infty \), \(T_{0}=0\).
Consider the general model of RL fractional Hopfield’s graded response neural networks with impulses occurring at fixed initially given times (INN):
where n represents the number of neurons in the network, \(x_{i}(t)\) is the pseudostate variable denoting the average membrane potential of the ith neuron at time t, \(x(t)=(x_{1}(t), x_{2}(t),\ldots, x_{n}(t))\in \mathbb{R}^{n}\), \(c_{i}(t)>0\), \(i=1,2,\ldots,n\), is the selfregulating parameter of the ith unit, \(a_{ij}(t)\), \(i,j=1,2,\ldots,n\), correspond to the synaptic connection strength of the ith neuron to the jth neuron at time t, \(f_{j}(x_{j}(t))\) denotes the activation functions of the neurons at time t and represent the response of the jth neuron to its membrane potential, \(f(x)=(f_{1}(x_{1}), f_{2}(x_{2}),\ldots, f_{n}( x_{n}))\) is the activation function, and \(I(t)=(I_{1}(t), I_{2}(t),\ldots, I_{n}(t))\) is the external bias vector.
The RL fractional derivative leads to a specific type of the initial condition of the model (see Remark 2 and Lemma 2.1):
Let the average membrane potential of each neuron be subject to some instantaneous perturbations at times \(T_{k}\), \(k=1,2,\ldots\) . Then model (4) will have impulses at times \(T_{k}\), \(k=1,2,\ldots\) . Let us recall the meaning of impulses in differential equations. At the time point the state variable has a jump and then this state variable continues to behave according to the previously given dynamic equation. So, the value after the jump/impulse has a meaning of the initial value. In the case of ordinary derivatives and Caputo fractional derivatives, because of the type of the initial condition, the value of the impulse condition could be given in the form \(x(T_{k}+0)=I_{k}(x(T_{k}0))\) with \(x(T_{k}+0)\), \(x(T_{k}0)\) equaling to values of the state variable after the jump and before the jump, respectively, or similar one. In the case of the RL fractional derivative, some authors use this type of impulsive conditions (see, for example, [28]). But because of the type of the initial condition, we think that the above given type of the impulsive condition is not appropriate. Now, following the interpretation of impulses, Remark 2, and Lemma 2.1, we will define the impulsive conditions in the form:
where the functions \(\psi _{i,k}(u)\), \(k=1,2,\ldots\) , are the impulsive functions giving the impulsive perturbation of the ith neuron at time \(T_{k}\), \(k=1,2,\ldots\) .
In our study we apply some results for the initial value problem for the scalar linear RL fractional differential equations with fixed points of impulses
where \(u_{0}\in \mathbb{R}\), \(a<0\).
Lemma 3.1
([5])
IVP (7) has an exact solution \(u\in PC_{1q}([0,\infty ),\mathbb{R})\) such that
holds.
RL fractional model with random impulses
Note that the fractional differential equations with impulses occurring at random times are studied in [1, 3, 5]. Similar to these papers, we will define now the RL fractional model with impulses at random times.
Let the probability space \((\Omega , \mathcal{F}, P)\) be given. Let a sequence of independent exponentially distributed random variables \(\{ \tau _{k} \} _{k=1}^{\infty }\) with the same parameter \(\lambda >0 \) defined on the sample space Ω be given.
Define the sequence of random variables \(\{ \xi _{k} \} _{k=0}^{\infty }\) by
The random variable \(\tau _{k}\) measures the waiting time of the kth impulse after the \((k1)\)th impulse occurs, and the random variable \(\xi _{k}\) denotes the length of time until k impulses occur for \(t\geq 0\).
Let the points \(t_{k} \) be arbitrary values of the corresponding random variables \(\tau _{k}\), \(k=1,2,\ldots\) . Define the increasing sequence of points \(T_{k}=\sum_{i=1}^{k}t_{i}\), \(k=1,2,3,\ldots \) , that are values of the random variables \(\xi _{k} \).
Consider the initial value problem for INN with fixed points of impulses (4)–(6). The solution of the INN with fixed moments of impulses (4) depends not only on the initial value \(x_{0}=(x_{1}^{0},x_{2}^{0},\ldots,x_{n}^{0})\) but also on the moments of impulses \(T_{k}\), \(k=1,2,\ldots\) , i.e., the solution depends on the chosen arbitrary values \(t_{k}\) of the random variables \(\tau _{k}\), \(k=1,2,\ldots\) . We denote the solution of initial value problem (4) by \(x(t;x_{0},\{T_{k}\})\) with \(x=(x_{1},x_{2},\ldots,x_{n})\).
The set of all solutions \(x(t; x_{0},\{T_{k}\})\) of INN (4)–(6) for any values \(t_{k}\) of the random variables \(\tau _{k}\), \(k=1,2,\ldots\) , generates a stochastic process with state space \({\mathbb{R}}^{n}\). We denote it by \(x(t; x_{0},\{ \tau _{k}\}) \), and we say that it is a solution of the general model of Hopfield’s graded response neural networks with impulses occurring at random times (RINN), formally denoted by
Now, similar to the papers [1, 3, 5], we will define the solution of the RL fractional model with impulses at random times.
Definition 1
Suppose that \(t_{k}\) is a value of the random variable \(\tau _{k}\), \(k=1,2,3,\ldots\) , and \(T_{k}= \sum_{i=1}^{k}t_{i}\), \(k =1,2,\ldots\) . Then the solution \(x(t; x_{0},\{T_{k}\})\) of the IVP for INN (4)–(6) is called a sample path solution of the IVP for RINN (9) (here, \(T_{0}=0\)).
Definition 2
A stochastic process \(x(t; x_{0},\{ \tau _{k}\}) \) with an uncountable state space \(\mathbb{R}^{n} \) is said to be a solution of the IVP for RINN (9) if, for any values \(t_{k}\) of the random variable \(\tau _{k}\), \(k=1,2,3,\ldots\) , and \(T_{k}= \sum_{i=1}^{k}t_{i}\), \(k =1,2,\ldots\) , the corresponding function \(x(t; x_{0},\{T_{k}\})\) is a sample path solution of the IVP for INN (4)–(6).
According to Definition 2 any solution of IVP (7) is a sample path solution of the following scalar linear RL fractional differential equation with random moments of impulses:
where \(u_{0}\in {\mathbb{R}}\), \(a<0\).
Lemma 3.2
([5])
For any positive number \(\epsilon >0\), the solution \(u(t;u_{0},\{\tau _{k}\})\) of the scalar linear RL fractional differential equation with random moments of impulses(10) satisfies the inequality
where \(E(\cdot )\) is the expected value of the stochastic process \(\vert u(t; u_{0},\{\tau _{k}\}) \vert \) and it depends on the time t.
Equilibrium of RL fractional model with random impulses
The main problem in the definition for the equilibrium point of RL fractional model is based on the properties \({}_{a}^{RL}D^{q}_{t}C=\frac{C}{(ta)^{q} \Gamma (1q)}\) with a, \(C=const\) and \({}_{a}I^{1q}_{t}C _{t=a}= \frac{C(ta)^{1  q}}{\Gamma (q)} _{t=a}=0\) (see Remark 1). These properties lead to a totally different definition of equilibrium of RL model (9), defined as follows.
Definition 3
A vector \(x^{*}\in \mathbb{R}^{n}\), \(x^{*}=(x_{1}^{*},x_{2}^{*},\ldots,x_{n}^{*})\), is an equilibrium point of RINN (9) iff the equalities
and
hold.
Remark 3
Equality (11) is the main part of the definition for the equality of an equilibrium of any type of a model with RL fractional derivative. If the term \(\frac{1}{t^{q} \Gamma (1q)}x_{i}^{*}\) is missing in the definition for equilibrium, then it is correct only for zero equilibrium (see, for example, where the definition does not contain the mentioned term). In [27] the equilibrium point is defined as a function depending on time.
Remark 4
In the case of zero external bias vector, if zero is a fixed point of the activation function and the impulsive functions, then for any \(c_{i}(t)\) the point 0 is an equilibrium point of RINN (9).
Remark 5
In the special case of the zero external bias vector and \(a_{i,j}(t)=c_{i}(t)+\frac{1}{t^{q} \Gamma (q)}\), \(i,j=1,2,\ldots,n\), any fixed points of the activation functions could form an equilibrium point, i.e., if \(x_{i}^{*}=f_{i}(x_{i}^{*})\), then \(x^{*}=(x_{1}^{*},x_{2}^{*},\ldots,x_{n}^{*})\) could be an equilibrium of RINN (9).
Remark 6
In the case of all constant coefficients in the model, if the external bias vector is zero, then 0 could be an equilibrium point, but if the external bias vector is a nonzero constant vector, then the model has no equilibrium point.
Remark 7
In [28] the RL derivative is used in the model of BAM neural networks with deterministic impulses. The equilibrium point is defined in Definition 7 [28] with missing term \(\frac{1}{t^{q} \Gamma (1q)}x_{i}^{*}\), but in all examples only zero equilibrium and zero bias external vector are considered.
The equilibrium point depends not only on the RL fractional equations but also on the impulsive conditions. We will illustrate it in the following example.
Example 1
Consider the model of a neural network with three neurons with impulses at random times:
and impulsive conditions
Note that the point \(x^{*}=(\pi , 2\pi , 3\pi )\) satisfies the system of RL fractional differential equations (13).
In the case \(\psi _{k,1}(u)=\psi _{k,3}(u)=\sin (k (u\pi ))\), \(\psi _{k,2}(u) = \sin (k u)\), \(k=1,2,\ldots\) , the point \(x^{*}=(\pi , 2\pi , 3\pi )\) is an equilibrium point of RINN (13),(14).
In the case \(\psi _{k,1}(u)=\psi _{k,3}(u)=\sin (k (u\pi ))\), \(\psi _{k,2}(u) =k(u2 \pi )\), \(k=1,2,\ldots\) , the point \(x^{*}=(\pi , 2\pi , 3\pi )\) is an equilibrium point of RINN (13),(14).
In the case \(\psi _{k,1}(u)=\psi _{k,3}(u)=\cos (k (u\pi ))\), \(\psi _{k,2}(u) = \sin (k u)\), \(k=1,2,\ldots\) , the point \(x^{*}=(\pi , 2\pi , 3\pi )\) is not an equilibrium point of RINN (13),(14). The model has no equilibrium point.
We assume the following:
Assumption A1
Let RINN (9) have an equilibrium point \(x^{*}\in \mathbb{R}^{n}\).
If Assumption A1 is satisfied, then we can shift the equilibrium point \(x^{*}\) of system (9) to the origin. The transformation \(y(t) = x(t) x^{*}\) is used to put system (9) in the following form:
where \(F_{j}(u)=f_{j}(u+x_{j}^{*})f_{j}(x_{j}^{*})\), \(j=1,2,\ldots,n\), and \(\Phi _{k,i}( u )=\psi _{k,i}(u+x_{i}^{*} )\psi _{k,i}(x_{i}^{*} )= \psi _{k,i}(u+x_{i}^{*} )\), \(i=1,2,\ldots,n\), \(k=1,2,\ldots\) , \(y_{i}^{0}=x_{i}^{0}\).
Remark 8
RINN (15) has a zero external bias vector, zero is a fixed point of both the activation functions \(F_{j}(u)\), \(j=1,2,\ldots,n\), and the impulsive functions \(\Phi _{k,i}( u)\), \(i=1,2,\ldots,n\), \(k=1,2,\ldots\) , and according to Remark 5 the zero vector is an equilibrium of RINN (15).
Therefore, if we know the equilibrium point \(x^{*}\in \mathbb{R}^{n}\) of (9), then we can construct a model with zero equilibrium point. But oppositely, if the point \(y^{*}=0\) is an equilibrium of RINN (15), then we are not able to obtain the equilibrium point \(x^{*}\in \mathbb{R}^{n}\) of (9).
pmoment MittagLeffler stability in time for RL fractional model with random impulses
We define the meansquare MittagLeffler stability in time of the equilibrium point of RINN (9). This type of stability is deeply connected with the application of MittagLeffler functions with one parameter. Also, the presence of the RL fractional derivative and its singularity at the initial time leads to excluding this point from the interval of stability. This definition is similar to the definition of pmoment MittagLeffler stability in time, introduced for RL fractional delay differential equations by Agarwal et al. [5].
Definition 4
The equilibrium point \(x^{*}\) of RINN (9) is said to be meansquare MittagLeffler stable in time if, for any \(\epsilon >0\) and any initial value \(x_{0}\in {\mathbb{R}}^{n}\), there exists a constant \(\alpha >0 \) such that
where \(x(t; x_{0},\{ \tau _{k}\}) \) is the solution of RINN (9) and \(E[\cdot ]\) is the expected value, and \(E_{q}(z)=\sum_{k=0}^{\infty }\frac{z^{k}}{\Gamma (\alpha k+1)}\) is the MittagLeffler function with one parameter.
Definition 5
The equilibrium point \(x^{*}\) of RINN (9) is said to be eventually meansquare MittagLeffler stable if there exists a number \(T>0\) such that, for any \(\epsilon >0\) and any initial value \(x_{0}\in {\mathbb{R}}^{n}\), there exists a constant \(\alpha >0 \) such that
Remark 9
The above defined types of stability are mainly characterized by the corresponding inequalities, giving bounds that the solutions are satisfied out of an enough small neighborhood of the initial time. Note that it differs from the case of the Caputo fractional derivative and ordinary derivatives. This is because of the type of the initial condition which is deeply connected with the RL fractional derivative.
In the study of the stability properties of RINN(9) we use Lyapunov functions \(V(t,x):[0,\infty )\times \mathbb{R}^{n}\rightarrow \mathbb{R}_{+} \) from the class \(\Lambda ([0,\infty ),\mathbb{R}^{n}) \), i.e., they are continuous on \([0,\infty )\times \mathbb{R}^{n}\) and Lipschitzian with respect to their second vector argument.
We use the Dini fractional derivative of a Lyapunov function \(V(t,x)\), and we define it similarly to [2].
Definition 6
Let \(V\in \Lambda ([0,\infty ),\mathbb{R}^{n})\), \(T\leq \infty \). The fractional Dini derivatives along trajectories of solutions of RINN (9) are defined as follows:
where \(x=(x_{1},x_{2},\ldots,x_{n})\).
Example 2
Let \(V(t,x_{1},x_{2},\ldots,x_{n})=m(t)\sum_{i=1}^{n}x_{i}^{2}\), where \(m\in C^{1}(\mathbb{R}_{+},\mathbb{R}_{+})\). Use (16) to obtain the fractional Dini derivative of V along the trajectories of solutions of RINN (15):
Note that the fractional Dini derivative depends significantly not only on the order q of the fractional differential equation but also on the initial time (0 in our case).
We will introduce the following assumptions:
Assumption A2
The fractional order \(q\in (0,1)\) of the RL fractional derivative is such that, for any \(\epsilon >0\), the equation \(\frac{1}{t^{1q}}=\frac{1}{E_{q}(\epsilon ^{q})\epsilon ^{1q}}E_{q}(t^{q})\) has only one solution for \(t>0\), where \(E_{\alpha }(z)\) is the MittagLeffler function with one parameter.
Assumption A3
The neuron activation functions are Lipschitz, i.e., there exist positive numbers \(L_{i}>0 \), \(i=1,2,\ldots,n\), such that \(\vert f_{i}(u)f_{i}(v) \vert \leq L_{i} \vert uv \vert \), \(i=1,2,\ldots,n\) for \(u,v\in \mathbb{R}\).
Assumption A4
There exist positive numbers \(M_{i,j}\), \(i,j=1,2,\ldots,n\), such that \(\vert a_{i,j}(t) \vert \leq M_{i,j}\) for \(t\geq 0\).
Assumption A5
There exist numbers \(B_{i}>0\), \(i=1,2,\ldots,n\), such that the inequalities \(c_{i}(t)\geq B_{i}>0\), \(t\geq 0\) hold.
Assumption A6
There exist positive constants A, B: \(A< B\) and a positive bounded RL differentiable function \(m(t)\): \(\mathbb{R}_{+}\to [A,B]\): \(A\leq m(t)\leq B\), \(t\geq 0\), such that \(\lim_{t\to 0}[ t^{q1}m(t)]=\alpha <\infty \), and the inequality
holds.
Assumption A7
There exist positive constants T, B and a positive bounded RL differentiable function \(m(t)\): \(\mathbb{R}_{+}\to [0,B]\): \(m(t)\neq0\) for \(t>0\) and \(\lim_{t\to 0}[ t^{q1}m(t)]=\alpha <\infty \), and the inequality
holds.
Remark 10
If Assumption A3 is fulfilled, then the function F in RINN (15) satisfies \(\vert F_{j}(u) \vert \leq L_{j} \vert u \vert \), \(j=1,2,\ldots,n\), for any \(u\in \mathbb{R}\).
Remark 11
The number \(q=0.2\), for example, satisfies condition A2 (see Fig. 1 and Fig. 2 for different values of ϵ), but the number \(q=0.8\) does not satisfy Assumption A2 (see Fig. 3).
Theorem 4.1
Let Assumptions A1–A6be satisfied.
Then the equilibrium point \(x^{*}\) of RINN (9) is meansquare MittagLeffler stable in time.
Proof
According to Remark 8, we study the behavior of the zero equilibrium of RINN(15). Consider the Lyapunov function \(V(t,x)=m(t)\sum_{i=1}^{n} x_{i}^{2}\), \(x=(x_{1},x_{2},\ldots,x_{n})\), where the function \(m(t)\) is defined in Assumption A6.
Choose a positive number C such that
According to Example 2, Remark 10, and Assumption A6, we have, for \(t\geq 0\),
where \(\overline{1,n}=\{1,2,\ldots,n\}\).
Let \(x_{0} \in {\mathbb{R}}^{n}\) be an arbitrary initial value and the stochastic process \(x(t;x_{0},\{ \tau _{k}\}) \) be a solution of the initial value problem for RINN (9). Then the stochastic process \(y(t;x_{0}x^{*},\{ \tau _{k}\}) \) is a solution of the initial value problem for RINN (15).
Let \(\epsilon >0\) be an arbitrary number and \(t_{k} \) be arbitrary values of the random variables \(\tau _{k}\), \(k=1,2,\ldots\) . Then \(T_{k}=\sum_{i=1}^{k}t_{i}\), \(k =1,2,\ldots\) , are values of the random variables \(\xi _{k} \). Thus the corresponding function \(y(t)=y(t;x_{0}x^{*},\{T_{k}\})\) is a sample path solution of the IVP for RINN (9), i.e., \(y(t)=y(t;x_{0}x^{*},\{T_{k}\})\) is a solution of the IVP for the INN with fixed points of impulses
Define the function \(v(t)=V(t, y(t))=m(t)\sum_{i=1}^{n}y_{i}^{2}(t)\). Then, for \(t\in (T_{k},T_{k+1}]\), \(k=0,1,2,\ldots\) , (here \(T_{0}=0\)), from the existence of the RL derivative of \(y(t;x_{0}x^{*},\{ \tau _{k}\}) \) on the whole interval \(t\geq 0\) and the link between RL and Grunwald–Letnikov derivatives (see p. 76 [16]), we obtain
or
with \(\frac{\Lambda _{i} (h^{q})}{h^{q}}\rightarrow 0\) as \(h\rightarrow 0\). Thus, from the definition of the function \(v(t)\) and Eq. (21), we get
where \(\mathcal{A}(t)=m(t)\sum_{i=1}^{n}y_{i}^{2}(t) \sum_{r=1}^{[ \frac{t}{h}]}(1)^{r+1} {}_{q}C_{r} m(trh)\sum_{i=1}^{n} (y_{i}(t)h^{q} (c_{i}(t)y_{i}(t)+ \sum_{j=1}^{n} a_{ij}(t)F_{j}(y_{j}(t)) ) )^{2}\).
Dividing both sides of inequality (22) by \(h^{q}\), taking the limit as \(h\rightarrow 0^{+}\), using (19) and \(\sum_{r=0}^{\infty }{}_{q}C_{r} z^{r}=(1+z)^{q}\) if \(\vert z \vert \leq 1\), we have
From (20) and Lemma 2.1, we have
and
Then, applying Assumption A6, we obtain
and
Therefore, from (23), (24), (25) it follows that the function \(v(t)\) satisfies the linear impulsive fractional differential inequalities with fixed points of impulses
where \(u_{0}=\alpha \Vert x^{0}x^{*} \Vert ^{2}\).
Consider (7) with \(a=C\). According to Lemma 3.1 it has an exact solution \(u\in PC_{1q}([0,\infty ),\mathbb{R})\) and \(v(t)\leq u(t)\). The function \(u(t)\) is a sample path solution of (10) where the solution \(u(t; u_{0},\{\tau _{k}\})\) according to Lemma 3.2 satisfies the inequality
According to Assumption A2 and (27), we get
with \(\xi _{\lambda ,q,\epsilon }= \frac{\lambda \alpha }{E_{q}(\epsilon ^{q})\epsilon ^{1q}\Gamma (q)} \frac{\pi Csc(\pi q)}{\Gamma (1q)} (1+ \frac{\pi Csc(\pi q) }{\Gamma (q)\Gamma (1q)} )\).
Applying
we get
Inequality (30) proves the meansquare MittagLeffler stability in time. □
In the case inequality (17) is not satisfied for all \(t\geq 0\) but inequality (18) is satisfied for enough large t,we could prove the eventually meansquare MittagLeffler stability in time of the equilibrium.
Theorem 4.2
Let Assumptions A1–A5and A7be satisfied.
Then the equilibrium point \(x^{*}\) of RINN (9) is eventually meansquare MittagLeffler stable in time.
Proof
According to Assumption A7, there exist a function \(m(t)\) and a number T such that \(m(t)>0\) for \(t>T\). Choose a constant \(C>0\) such that
Similar to the proof of Theorem 4.1, we consider the Lyapunov function \(V(t,x)=m(t)\sum_{i=1}^{n} x_{i}^{2}\), \(x=(x_{1},x_{2},\ldots,x_{n})\) and prove inequality (19) for \(t>T\). Let \(x_{0} \in {\mathbb{R}}^{n}\) be an arbitrary initial value and the stochastic process \(x(t;x_{0},\{ \tau _{k}\}) \) be a solution of the initial value problem for RINN (9) and \(y(t;x_{0}x^{*},\{ \tau _{k}\}) \) be a solution of (15).
Let \(\epsilon >0\) be an arbitrary number and \(t_{k} \) be arbitrary values of the random variables \(\tau _{k}\), \(k=1,2,\ldots\) . Then \(T_{k}=\sum_{i=1}^{k}t_{i}\), \(k =1,2,\ldots\) , are values of the random variables \(\xi _{k} \). Thus the corresponding function \(y(t)=y(t;x_{0}x^{*},\{T_{k}\})\) is a solution of (20). Define the function \(v(t)=V(t, y(t))\). As in the proof of Theorem 4.1, we prove \({}_{0}^{GL}D_{+}^{q}v(t) \leq C v(t)\) for \(t>T\), \(t\in (T_{k},T_{k+1}]\), \(k=0,1,2,\ldots\) .
Define the function \(\tilde{v}(t):[0,\infty )\to \mathbb{R}_{+}\) such that \(\tilde{v}(t)\equiv v(t)\), \(t>T\), and \(\tilde{v}(t)\) is a solution of (26) for \(t\in [0,T]\).
Then, as in the proof of Theorem 4.1, we obtain for \(t>\max \{\epsilon ,T\}\) the inequality \(E( \vert \tilde{v}(t; u_{0},\{\tau _{k}\}) \vert )=E( \vert v(t; u_{0},\{\tau _{k}\}) \vert ) \leq E( \vert u(t; u_{0},\{\tau _{k}\}) \vert )\), which proves the claim of Theorem 4.2. □
Example 3
Let \(\tau _{k}\in Exp(1)\), \(k=1,2,\ldots\) , and consider the model of RL fractional neural network with impulses at random times (13) with impulsive conditions
and initial conditions
According to Example 1, the point \((\pi ,2\pi ,3\pi )\) is an equilibrium point of RINN (13),(31), i.e., Assumption A1 is satisfied.
According to Remark 11, Assumption A2 is fulfilled.
In this special case \(c_{i}(t)= (\frac{1}{t}\frac{1}{t^{0.2}\Gamma (10.2)}+5 )>4.55\), \(f_{1}(u)=f_{2}(u)=f_{3}(u)=\sin (u)\), and the matrix of coefficients \(A(t)=\{a_{ij}(t)\}\) is given by
Assumption A3 is satisfied with \(L_{i}=1\), \(i=1,2,3\).
Also Assumption A4 is satisfied with the matrix
Assumption A5 is satisfied with \(B_{i}=4.55\), \(i=1,2,3\).
Define the function \(m(t):\mathbb{R}_{+}\to [0,1)\) by \(m(t)=\frac{t^{0.8} }{t^{0.8} + 1}\). It satisfies \(\lim_{t\to 0}[t^{0.21}m(t)]= \alpha = 1\) (see Fig. 4).
Then there exists \(T=0.00006>0\) such that (see Fig. 5)
Therefore, since (31) is not satisfied for all \(t\geq 0\), Assumption A6 is not satisfied, but Assumption A7 is fulfilled.
Thus, according to Theorem 4.2, the equilibrium of RINN (13) is eventually meansquare MittagLeffler stable in time, i.e., in this particular case
for any \(\epsilon >0\) and \(t\geq \max \{0.00006,\epsilon \}\), the inequality
holds.
Conclusions
In this paper the RL fractional generalization of the firstorder Hopfield neural network is studied in the case when some impulses occur at random times. We study the case when the waiting time between two consecutive times of impulses is exponentially distributed. In connection with the application of the RL fractional derivative in the model, we define in an appropriate way both the initial condition and the impulsive conditions. We define meansquare stability in time of the model and obtain some sufficient conditions.
In further work we hope to consider a number of directions:

(i)
Considering both fractional models, i.e., with the Caputo fractional derivative as well as the RL fractional derivative, and generalizing the waiting time between two consecutive impulses is Erlang distributed, is Lognormal distributed, etc.

(ii)
Generalizing the RL fractional model to various other types of delays.
Availability of data and materials
Not applicable.
Abbreviations
 \(\tau _{k}\) and \(\xi _{k}\), \(k=1,2,\ldots\) :

random variables
 \(E(\tau )\) :

the expected value of the random variable τ
 \(Csc(u)\) :

\(\frac{1}{\cos (u)}\)
 \(\Gamma (u)\) :

the gamma function
 RL:

Riemann–Liouville
 IVP:

initial value problem
 INN:

RL fractional Hopfield’s graded response neural networks with impulses occurring at fixed initially given times
 RINN:

RL fractional Hopfield’s graded response neural networks with impulses occurring at random times \(\xi _{k}\), \(k=1,2,\ldots\)
References
Agarwal, R., Hristova, S., O’Regan, D.: Exponential stability for differential equations with random impulses at random times. Adv. Differ. Equ. 2013, 372 (2013)
Agarwal, R., Hristova, S., O’Regan, D.: A survey of Lyapunov functions, stability and impulsive Caputo fractional differential equations. Fract. Calc. Appl. Anal. 19(2), 290–318 (2016)
Agarwal, R.P., Hristova, S., O’Regan, D., Kopanov, P.: pmoment exponential stability of differential equations with random impulses and the Erlang distribution. Mem. Differ. Equ. Math. Phys. 70, 99–106 (2017)
Agarwal, R.P., Hristova, S., O’Regan, D., Kopanov, P.: Impulsive differential equations with gamma distributed moments of impulses and pmoment exponential stability. Acta Math. Sci. 37(4), 985–997 (2017)
Agarwal, R.P., Hristova, S., O’Regan, D., Kopanov, P.: pmoment MittagLeffler stability of Riemann–Liouville fractional differential equations with random impulses. Mathematics 8, 1379 (2020). https://doi.org/10.3390/math8081379
Alofi, A., Cao, J., Elaiw, A., AlMazrooei, A.: Delaydependent stability criterion of Caputo fractional neural networks with distributed delay. Discrete Dyn. Nat. Soc. 2014, Article ID 529358 (2014)
Das, Sh.: Functional Fractional Calculus. Springer, Berlin (2011)
Diethelm, K.: The Analysis of Fractional Differential Equations. Springer, Berlin (2010)
Gopalsamy, K.: Stability of artificial neural networks with impulses. Appl. Math. Comput. 154, 783–813 (2004)
Gu, Y., Wang, H., Yu, Y.: Stability and synchronization for Riemann–Liouville fractionalorder timedelayed inertial neural networks. Neurocomputing 340, 270–280 (2019)
Gu, Y., Wang, H., Yu, Y.: Synchronization for commensurate Riemann–Liouville fractionalorder memristorbased neural networks with unknown parameters. J. Franklin Inst. (2020). https://doi.org/10.1016/j.jfranklin.2020.06.025
Hopfield, J.J.: Neural networks and physical systems with emergent collective computational abilities. Proc. Natl. Acad. Sci. USA 79, 2554–2558 (1982)
Kaslik, E., Sivasundaram, S.: Dynamics of fractionalorder neural networks. In: Proc. Int. Joint Conf. Neural Netw, San Jose, CA, USA, Jul./Aug., pp. 611–618 (2011)
Kilbas, A.A., Srivastava, H.M., Trujillo, J.J.: Theory and Applications of Fractional Differential Equations. Elsevier, Amsterdam (2006)
Li, J.D., Wu, Z.B., Huang, N.J.: Asymptotical stability of Riemann–Liouville fractionalorder neutraltype delayed projective neural networks. Neural Process. Lett. (2019). https://doi.org/10.1007/s11063019100508
Podlubny, I.: Fractional Differential Equations. Academic Press, San Diego (1999)
Pratap, A., Alzabut, J., Dianavinnarasi, J., Cao, J., Rajchakit, G.: Finitetime MittagLeffler stability of fractionalorder quaternionvalued memristive neural networks with impulses. Neural Process. Lett. 51, 1485–1526 (2020). https://doi.org/10.1007/s11063019101541
Pu, Y.F., Yi, Z., Zhou, J.L.: Fractional Hopfield neural networks: fractional dynamic associative recurrent neural networks. IEEE Trans. Neural Netw. Learn. Syst. 28(10), 2319–2333 (2017)
Rakkiyappan, R., Balasubramaiam, P., Cao, J.: Global exponential stability of neutraltype impulsive neural networks. Nonlinear Anal., Real World Appl. 11, 122–130 (2010)
Rifhat, R., Muhammadhaji, A., Teng, Z.: Global MittagLeffler synchronization for impulsive fractionalorder neural networks with delays. Int. J. Nonlinear Sci. Numer. Simul. 19(2), 205–213 (2018)
Scardapane, S., Wang, D.: Randomness in neural networks: an overview. Wiley Interdiscip. Rev. Data Min. Knowl. Discov. 7, e1200 (2017)
Song, X., Zhao, P., Xing, Z., Peng, J.: Global asymptotic stability of CNNs with impulses and multiproportional delays. Math. Methods Appl. Sci. 39, 722–733 (2016)
Tavares, C.A., Santos, T.M.R., Lemes, N.H.T., dos Santos, J.P.C., Ferreira, J.C., Braga, J.P.: Solving illposed problems faster using fractionalorder Hopfield neural network. J. Comput. Appl. Math. 381, 112984 (2021)
Wang, F., Yang, Y., Hu, M.: Asymptotic stability of delayed fractionalorder neural networks with impulsive effects. Neurocomputing 154(22), 239–244 (2015)
Wu, Z., Li, Ch.: Exponential stability analysis of delayed neural networks with impulsive time window. In: Advanced Computational Intelligence (ICACI), 2017 Ninth International Conference on, pp. 37–42 (2017)
Yang, Z., Xu, D.: Stability analysis of delay neural networks with impulsive effects. IEEE Trans. Circuits Syst. II, Express Briefs 52(8), 517–521 (2015)
Zhang, H., Ye, M., Ye, R., Cao, J.: Synchronization stability of Riemann–Liouville fractional delaycoupled complex neural networks. Physica A 508, 155–165 (2018)
Zhang, H., Ye, R., Cao, J., Alsaedi, A.: Existence and globally asymptotic stability of equilibrium solution for fractionalorder hybrid BAM neural networks with distributed delays and impulses. Complexity 2017, Article ID 6875874 (2017). https://doi.org/10.1155/2017/6875874
Zhang, H., Ye, R., Cao, J., Alsaedi, A.: Synchronization control of Riemann–Liouville fractional competitive network systems with timevarying delay and different time scales. Int. J. Control. Autom. Syst. 16(3), 1404–1414 (2018). https://doi.org/10.1007/s1255501703710
Zhang, H., Ye, R., Cao, J., Alsaedi, A., Li, X., Wang, Y.: Lyapunov functional approach to stability analysis of Riemann–Liouville fractional neural networks with timevarying delays. Asian J. Control 20(5), 1938–1951 (2018). https://doi.org/10.1002/asjc.1675
Zhang, R., Qi, D., Wang, Y.: Dynamics analysis of fractional order threedimensional Hopfield neural network. In: Proc. 6th Int. Conf. Natural Comput., Yantai, China, pp. 3037–3039 (2010)
Zhang, X., Niu, P., Ma, Y., Wei, Y., Li, G.: Neural networks global MittagLeffler stability analysis of fractionalorder impulsive neural networks with oneside Lipschitz condition. Neural Netw. 94, 67–75 (2017)
Zhou, Q.: Global exponential stability of BAM neural networks with distributed delays and impulses. Nonlinear Anal., Real World Appl. 10, 144–153 (2009)
Acknowledgements
Not applicable.
Funding
The research is supported by the Bulgarian National Science Fund under Project KP06N32/7.
Author information
Authors and Affiliations
Contributions
All authors contributed equally to the writing of this paper. Furthermore, all authors carefully read and approved the final manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare that they have no competing interests.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Agarwal, R., Hristova, S., O’Regan, D. et al. Meansquare stability of Riemann–Liouville fractional Hopfield’s graded response neural networks with random impulses. Adv Differ Equ 2021, 98 (2021). https://doi.org/10.1186/s13662021032378
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s13662021032378
MSC
 34A37
 34D20
 34F99
 92B20
Keywords
 Hopfield’s graded response neural network
 Riemann–Liouville fractional derivative
 Impulses at random times
 Lyapunov functions
 Meansquare MittagLeffler stability in time