# Nonlinear Dynamics and Chaos in Fractional-Order Hopfield Neural Networks with Delay

Authors: Xia Huang; Zhen Wang; Yuxia Li
Journal: Advances in Mathematical Physics
 (2013)

---

## Abstract

A fractional-order two-neuron Hopfield neural network with delay is proposed based on the classic well-known Hopfield neural networks, and further, the complex dynamical behaviors of such a network are investigated. A great variety of interesting dynamical phenomena, including single-periodic, multiple-periodic, and chaotic motions, are found to exist. The existence of chaotic attractors is verified by the bifurcation diagram and phase portraits as well.


---

## Body

## 1. Introduction

Fractional calculus, which mainly deals with derivatives and integrals of arbitrary order, was firstly introduced 300 years ago. However, it is only in recent decades that fractional calculus is applied to physics and engineering [1–3]. The main advantage of fractional-order models in comparison with its integer-order counterparts is that fractional derivatives provide an excellent tool in the description of memory and hereditary properties of various processes. In fractional calculus, a generalized capacitor, called “fractance,” is often considered to be the main operator. It is actually an electrical circuit in which its voltage and current are related by the fractional-order differential equation [4].Chaos theory has been extensively investigated in various fields of research after the first observation of chaotic attractors in Lorenz system. Recently, study on the complex dynamical behaviors of fractional-order systems has become a hot research topic due to the fact that fractional-order systems show higher nonlinearity and more degrees of freedom in the models, and therefore fractional-order chaotic systems are considered to have the potential ability of improving the security of chaotic communication systems [5]. It has been known that chaos in many well-known integer-order chaotic systems will remain when the orders become fractional, and a great number of fractional-order chaotic systems have been proposed as a consequence [6–14]. Moreover, chaotic behaviors have also been found to exist in some discontinuous systems with fractional derivatives [15]. However, it is worthwhile to note that none of the aforementioned fractional-order chaotic systems are time-delayed systems.On the other hand, the dynamics of delayed neural networks (DNNs) with traditional integer-order derivatives have been extensively studied both in theory and applications. [16–25]. It has been reported that DNNs can really display quite rich dynamical behaviors. For instance, Lu studied the complex dynamics of a DNN of Hopfield-type with two neurons and concluded that for a certain set of system parameters such a network does exhibit chaotic attractors [23]. The complex dynamics of a delay-free neural network of Hopfield-type with four neurons have been investigated in [24], and hyperchaotic attractors are found to exist for some particular set of weight matrices. Chaotic attractors are also known to exist in delayed cellular neural networks [25].However, the dynamical analysis of fractional-order neural networks is a very recent and promising research topic. Actually, if we replace the common capacitor in the integer-order Hopfield neural networks (HNNs) by the aforementioned “fractance,” we obtain the model of fractional-order HNNs. The incorporation of fractional derivatives into the network is a great improvement in modeling. It has been pointed out that fractional differentiation provides neurons with a fundamental and general computation that can contribute to efficient information processing [26]. More recently, efforts have been made to investigate the complex dynamics of fractional-order neural networks. In [27], Arena et al. firstly introduced a cellular neural network (CNN) with fractional-order cells. In [28], Petráš presented a fractional three-cell CNN which exhibits limit cycle and stable orbit for different parameter values. A fractional two-cell chaotic CNN was reported in [29] and the corresponding strange attractor was shown. In [30], a fractional-order four-cell CNN has been presented and hyperchaotic attractors have been displayed. In [31], the dynamics of fractional-order delay-free HNNs, including stability and multistability, bifurcations, and chaos, have been investigated.Time-delay is ubiquitous in physical systems, control systems, and biological systems due to finite switching speeds of amplifiers, finite signal propagation time in biological networks, and so on. Chaotic attractors in a fractional-order CNN with time-delay have been observed when the fractional-orderα≥0.1 [32]. The analysis of delay dynamics in networked control systems has been made in [33]. Unfortunately, little effort has been devoted to the complex dynamics of delayed fractional-order neural networks of Hopfield-type so far. This is a new subject and needs to be explored in depth. The main aim of this paper is to investigate the complex dynamics of fractional-order HNNs with time delay; a great variety of interesting dynamical behaviors, such as periodic and chaotic will be observed and the effect of the time delay will also be discovered. The existence of chaotic attractors is verified by bifurcation diagram and phase portraits, respectively.The rest of this paper is organized as follows. In Section2, definition for fractional derivatives and a modified numerical algorithm for solving delayed fractional-order differential equations are presented. In Section 3, a delayed fractional-order HNN with two neurons is proposed. Bifurcation analysis is made in Section 4. The lowest order, as well as the highest order, for chaos to exist is determined and the effect of the time delay is revealed. Finally, some concluding remarks are reported in Section 5.


## 2. Preliminaries and Notations

There are three most frequently used definitions for fractional derivatives, that is, Riemann-Liouville, Grünwald-Letnikov, and Caputo’s definitions. The main advantage of Caputo definition is that the initial conditions for fractional-order differential equations with Caputo derivatives take on the same form as for integer-order differential equations [1]. And therefore, this paper is based on Caputo’s definition.Definition 1 (see [1]).
The Caputo fractional derivative of orderα of a continuous function f:R+→R is defined as follows:
(1)Dtαf(t)={1Γ(n-α)∫0tf(n)(τ)(t-τ)α+1-ndτ,n-1<α<n,dndtnf(t),α=n,
where Γ is Γ-function, and
(2)Γ(z)=∫0∞‍e-ttz-1dt,Γ(z+1)=zΓ(z).The numerical calculation of fractional-order differential equations (FDEs) is not as simple as that of ordinary differential equations (ODEs). Due to the nonlocal character of fractional derivative operator, the numerical methods for solving ODEs have to be modified to cater for solving FDEs. In [34, 35], a method to numerically solve FDEs has been proposed based on the Adams-Bashforth-Moulton predictor-corrector scheme. Furthermore, an algorithm for solving fractional-order delayed differential equations (FDDEs) in the form of Dtαx(t)=f(t,x(t-τ)) is presented in [36]. We modify the predictor-corrector algorithm proposed in [36] such that it is appropriate to solve FDDEs in the form of (3) as below.Consider the FDDEs described by(3)Dtαx(t)=f(t,x(t),x(t-τ)),t∈[0,T],0<α≤1,x(t)=g(t),t∈[-τ,0].It should be noted thatf is assumed to satisfy the Lipschitz condition with respect to its second and third variables, respectively, and g is assumed to be continuous in (3) in order to ensure the existence of solutions. For more details, the reader can consult [37] and the references cited therein.Applying fractional integrationItα on both sides of (3), we obtain
(4)x(t)=g(0)+1Γ(α)∫0t‍(t-ξ)α-1f(ξ,x(ξ),x(ξ-τ))dξ.Discretizing (4) for uniform grid, tn=nh(n=-l,-l+1,…,-1,0,1,…,N), in which l and N are integers and satisfy T=Nh and τ=lh. Let
(5)xh(tj)=g(tj),j=-l,-l+1,…,-1,0,
and denote
(6)xh(tj-τ)=xh(jh-lh)=xh(tj-l),j=0,1,…,N.Suppose that we have obtained the approximations forxh(ti)(i=1,2,…,n), and now we wish to calculate xh(tn+1) by using
(7)x(tn+1)=g(0)+1Γ(α)∫0tn+1‍(tn+1-ξ)α-1×f(ξ,x(ξ),x(ξ-τ))dξ.We use approximationsxh(tn) for x(tn) in (7). Thus, the modified predictor-corrector algorithm can be presented as follows:
(8)xh(tn+1)=g(0)+hαΓ(α+2)f(tn+1,xhp(tn+1),xh(tn+1-τ))+hαΓ(α+2)∑j=0n‍aj,n+1f(tj,xh(tj),xh(tj-τ))=g(0)+hαΓ(α+2)f(tn+1,xhp(tn+1),xh(tn+1-l))+hαΓ(α+2)∑j=0n‍aj,n+1f(tj,xh(tj),xh(tj-l)),
where
(9)aj,n+1={nα+1-(n-α)(n+1)α,j=0,(n-j+2)α+1+(n-j)α+1-2(n-j+1)α+1,1≤j≤n,
and xhp(tn+1) is the predicted value of xh(tn+1) which can be determined by
(10)xhp(tn+1)=g(0)+1Γ(α)∑j=0n‍bj,n+1f(tj,xh(tj),xh(tj-τ))=g(0)+1Γ(α)∑j=0n‍bj,n+1f(tj,xh(tj),xh(tj-l)),
where
(11)bj,n+1=hαα((n+1-j)α-(n-j)α).Remark 2.
It should be noticed that the algorithm proposed in [36] can be used to calculate the FDDEs in the form of Dtαx(t)=f(t,x(t-τ)), where the variable x(t) does not explicitly appear in the right-hand side function f. However, when f is also a function of x(t), that is, the FDDEs described by Dtαx(t)=f(t,x(t),x(t-τ)), the algorithm proposed in [36] fails to be used in this case. For this reason, we modify the algorithm such that it is appropriate to solve FDDEs in the form of (3). Note that (10) is used indispensably to predict the value of xh(tn+1) as xhp(tn+1). This is the main difference between the modified algorithm and the algorithm proposed in [36].


## 3. Description of the Delayed Fractional-Order HNNs

In this paper, we consider the fractional-order HNNs with time delay described by(12)Dtαxi(t)=-aixi(t)+∑j=1n‍bijf(xj(t))+∑j=1n‍cijf(xj(t-τ))+Ii,i=1,2,…,n,xi(t)=ϕi(t),t∈[-τ,0],0<α<1,whereα denotes the Caputo fractional derivative of order α, ai>0, bij and cij are real numbers, τ≥0 represents the time delay, and Ii are external inputs. The activation function f(x) is chosen as f(x)=tanh(x), and xi(t)=ϕi(t), t∈[-τ,0], is the initial condition.It should be noted that whenα=1, (12) is reduced to the classical integer-order delayed HNNs. The complex dynamical behaviors of such a network with two neurons have been investigated in [23] and single-periodic, multiple-periodic, and chaotic motions have been revealed. In this paper, we study the fractional-order case, that is, the complex dynamics of system (12) with two neurons.Rewrite (12) into a compact form
(13)Dtαx(t)=-Ax(t)+Bf(x(t))+Cf(x(t-τ))+I,x(t)=ϕ(t),t∈[-τ,0],0<α<1,
where x(t)=(x1(t),x2(t))T, f(x(t))=(f(x1(t)),f(x2(t)))T, f(x(t-τ))=(f(x1(t-τ)),f(x2(t-τ)))T, I=(I1,I2)T, ϕ(t)=(ϕ1(t),ϕ2(t))T, and
(14)A=(a100a2),B=(b11b12b21b22),C=(c11c12c21c22).It should be noticed that we always assume thatI=0 in the remainder of this paper.


## 4. Bifurcation and Chaos in Delayed Fractional-Order HNN

We firstly fix the values of system parameters of (13) as
(15)A=(1001),B=(2.0-0.1-5.02.0),C=(-1.5-0.1-0.2-1.5),
and the time delay τ=1. The initial condition is always chosen as the constant function on [-τ,0]. The equilibrium points are calculated numerically as x1*=(-0.37614,2.35978),x2*=(0,0), and x3*=(0.37614,-2.35978). In this section, we employ the numerical method proposed in Section 2 to solve (13). The step size h is chosen as 0.05, and the simulation time T is chosen as 1000.When the fractional orderα=0.82, Figure 1(a) shows the two separate period-one orbits with two groups of initial conditions x1(t)=0.4, x2(t)=0.6 and x1(t)=-0.4, x2(t)=-0.6 for t∈[-1,0], respectively. It can be easily found from Figure 1(a) that one period orbit oscillates around the equilibrium point x1*=(-0.37614,2.35978); the other oscillates around the equilibrium point x3*=(0.37614,-2.35978). With the increase of the derivative order, period-two orbits and period-four orbits appear. Figure 1(b) shows two separate period-two orbits with order α=0.84 and Figure 1(c) shows two separate period-four orbits with order α=0.85. If we continue to increase the derivative order, then system (13) begins to exhibit chaotic behavior. Figure 1(d) shows two separate coexisting single-scroll chaotic attractors with order α=0.90. It should be noted that Figures 1(b), 1(c), and 1(d) take on the same initial values as those in Figure 1(a).Different dynamical behaviors of system (13) with fixed parameter values b22=2.0, c22=-1.5 and two groups of initial conditions (0.4,0.6)T and (-0.4,-0.6)T for t∈[-1,0], respectively; (a) period-one orbits when α=0.82; (b) period-two orbits when α=0.84; (c) period-four orbits when α=0.85; (d) separate single-scroll chaotic attractors when α=0.90.
(a)
(b)
(c)
(d)If we further increase the derivative order to 0.92, two separate single-scroll chaotic attractors merge into a double-scroll chaotic attractor. Figure2(a) shows a fully developed double-scroll chaotic attractor with order α=0.92 and the initial condition is set as x1(t)=0.4, x2(t)=0.6 for t∈[-1,0]. When the derivative order is increased to α=0.99, Figure 2(b) shows a periodic orbit with the initial condition x1(t)=0.4, x2(t)=0.6 for t∈[-1,0]. That is to say, for fractional-order nonlinear system with time delay, there is a chance to be periodic after it has already entered the chaotic domain.(a) Double-scroll chaotic attractor whenα=0.92 with the initial condition (0.4,0.6)T for t∈[-1,0]; (b) periodic orbit when α=0.99 with the initial condition (0.4,0.6)T for t∈[-1,0].
(a)
(b)We summarize the considered cases in Figures1 and 2 in Table 1. We can find from Table 1 that when keeping the values of b22 and c22 fixed, system (13) firstly undergoes the process of period-doubling bifurcation with the increase of α to some extent and then tends from disorder to order when the value of α continues to increase. This indicates that the dynamical characteristics of fractional-order nonlinear systems with delays are completely different from fractional-order nonlinear systems without delays.Table 1
Dynamics of system (13) with b22=2.0,  c22=-1.5, and different α.
α
Observation
Figure
0.82
Period-1
Figure1(a)
0.84
Period-2
Figure1(b)
0.85
Period-4
Figure1(c)
0.90
Single-scroll chaos
Figure1(d)
0.92
Double-scroll chaos
Figure2(a)
0.99
Period
Figure2(b)Remark 3.
It is generally known that chaotic behavior in fractional-order nonlinear systems without time delays is preserved when the derivative order is greater than a certain value (called as the lowest order). However, an interesting phenomenon for delayed fractional-order nonlinear system is observed in the simulation; different from fractional-order system without time delay, chaotic phenomena exist only for a certain interval of derivative order, that is to say, a lowest order as well as a highest order has been found to exist in order to ensure the occurrence of chaos. As long as the derivative order is beyond these two bounds, the chaotic attractor will vanish.In order to confirm the period-doubling bifurcation process, we draw the bifurcation diagrams ofx1 with respect to the derivative order α. Figure 3 shows a bifurcation process when α ranges from 0.8 to 1 with b22=2.0,c22=-1.5. It can be determined from Figure 3 that a periodic window is found when α is about 0.99. It confirms what we have observed in Figures 1 and 2.Figure 3
Bifurcation diagrams ofx1 with respect to the derivative order α when b22=2.0,c22=-1.5.In what follows, we modify only the values ofb22 and c22 into b22=3.0,c22=-2.5 to investigate the dynamics of system (13). Obviously, the equilibrium points of system (13) do not change. It can be easily seen that with the increase of the system order, system (13) undergoes a similar process of period-doubling bifurcation.When the system orderα=0.78, Figure 4(a) shows two separate period-one orbits with two groups of initial conditions x1(t)=0.4, x2(t)=0.6 and x1(t)=-0.4, x2(t)=-0.6 for t∈[-1,0], respectively. Figures 4(b) and 4(c) show two separate period-two and period-four orbits with system order α=0.79 and α=0.80, respectively. Figure 4(d) shows two separate single-scroll chaotic attractors with derivative order α=0.83. It should be noted that Figures 4(b), 4(c), and 4(d) take on the same initial values as those in Figure 4(a).Different dynamical behaviors of system (13) with fixed parameter values b22=3.0, c22=-2.5 and two groups of initial conditions (0.4,0.6)T and (-0.4,-0.6)T for t∈[-1,0], respectively; (a) period-one orbits when α=0.78; (b) period-two orbits when α=0.79; (c) period-four orbits when α=0.80; (d) separate single-scroll chaotic attractors when α=0.83.
(a)
(b)
(c)
(d)It should also be noted that another interesting phenomenon is observed; that is, even when the system enters the chaotic domain and if we continue to increase the fractional order, now the system will exhibit different patterns of chaotic attractors. Figure5 shows different fully developed double-scroll chaotic attractors with parameters b22=3.0, c22=-2.5 when system order is further increased. Figure 5(a) shows a double-scroll chaotic attractor with fractional order α=0.87 and initial condition x1(t)=0.4, x2(t)=0.6 for t∈[-1,0]. Figures 5(b) and 5(c) show two chaotic attractors which are symmetric about the origin with fractional order α=0.93 and initial conditions x1(t)=0.4, x2(t)=0.6 and x1(t)=-0.4, x2(t)=-0.6 for t∈[-1,0], respectively. Figure 5(d) shows another fully developed double-scroll chaotic attractor with fractional order α=0.97 and initial conditions x1(t)=0.4, x2(t)=0.6 for t∈[-1,0].Different fully developed double-scroll chaotic attractors; (a) withα=0.87 and initial value [0.4,0.6]T; (b) with α=0.93 and initial value [0.4,0.6]T; (c) with α=0.93 and initial value [-0.4,-0.6]T; (d) with α=0.97 and initial value [0.4,0.6]T.
(a)
(b)
(c)
(d)Similarly, we summarize the considered cases in Figures4 and 5 in Table 2. We can see from Table 2 that when keeping the values of b22=3.0 and c22=-2.5 fixed, system (13) undergoes the process of period-doubling bifurcation with the increase of α and then the chaotic behavior is preserved although the patterns of the chaotic attractors are different.Table 2
Dynamics of system (13) with b22=3.0,  c22=-2.5, and different α.
α
Observation
Figure
0.78
Period-1
Figure4(a)
0.79
Period-2
Figure4(b)
0.80
Period-4
Figure4(c)
0.83
Single-scroll chaos
Figure4(d)
0.87
Double-scroll chaos
Figure5(a)
0.93
Double-scroll chaos
Figure5(b)
0.93
Double-scroll chaos
Figure5(c)
0.97
Double-scroll chaos
Figure5(d)Similarly, in order to confirm the period-doubling bifurcation process, we draw the bifurcation diagrams ofx1 with respect to derivative order α. Figure 6 demonstrates bifurcation process when α ranges from 0.75 to 1 with b22=3.0, c22=-2.5, which confirms what we have observed in Figures 4 and 5.Figure 6
Bifurcation diagrams ofx1 with respect to the derivative order α when b22=3.0,c22=-2.5.


## 5. Conclusion

In this paper, the complex dynamical behaviors of delayed fractional-order Hopfield-type neural networks with two neurons are detailedly investigated with the aid of numerical simulations. Different varieties of interesting dynamical behaviors, including single-periodic, multiple-periodic, and double-scroll chaotic attractors, have been discovered. It should be pointed out that different from fractional-order nonlinear systems without time delay, a lowest order as well as a highest order has been found to exist in order to ensure the emergence of chaos. The existence of chaotic attractors is verified with bifurcation diagram and phase portraits. The novel fractional-order chaos provides a new chaos generator and can be applied in many engineering applications, especially in the secure communication.



---

*Source: 657245-2013-11-13.xml*