# Control of Chaos Using the Controller Identification Technique

Authors: Alexandre Molter; Fabricio B. Cabral
Journal: Mathematical Problems in Engineering
 (2017)

---

## Abstract

Modeling and simulation of chaotic system with dynamic control have been extensively presented in the past decades. Several control techniques have been proposed for the control of chaos. One technique that has not been sufficiently explored for the control of nonlinear systems is the controller identification technique. This technique is based on the evaluation of controllers even if they are not online. This technique does not use a priori knowledge of the plant parameters. In this work, we propose a class of controllers candidates to follow desired trajectories. Simulation results are presented for the control of chaotic systems.


---

## Body

## 1. Introduction

Phenomena which exhibit chaotic behavior appear in several areas, attracting researchers which try to describe this behavior through mathematical equations and to control its dynamic.The search for efficient control techniques of nonlinear systems continues to be a challenge to researchers. Among a variety of controllers used in dynamical systems, proportional integrative derivative (PID) is the most common and practical to be adopted by control engineers. Since the PID controllers are commonly used in industrial control systems, they are usually adjusted by empirical methods. On the other hand, there are more sophisticated control techniques involving complex theoretical developments, which impose very restrictive hypothesis on the systems to be controlled, as nonlinear control techniques.The theoretical success of robust control led many researchers to say that control should focus on the plant parameter estimation and its bounds. However, other researchers in the control area, such as Safonov and Tsao [1], become unsatisfied with the robust control paradigm, which required the control of a family of plants instead of the control of one, which would lead to conservative results. They stated that it was time to reformulate the control problem. A first formulation was the unfalsified control [1, 2]. This control has two major characteristics: it advances from plant parameter estimation to controller parameter estimation [3] and it considers model falsification in the sense of Popper instead of model validation [4, 5]. This was a first formulation of the controller identification problem, which in general considers a list of candidate controllers and a criterion to judge the performance of these controllers without needing to put them online [6].In fact, there are few control techniques which require minimal information on the systems to be controlled. Among these techniques we can cite the ones based on the unfalsified control paradigm and the controller identification technique [2, 6]. The unfalsified control paradigm allows us to formulate the control problem based on experimental data [7]. The advantage of this technique, when compared to others, is that it does not require a priori knowledge of the state or physical properties of the plant. This fact illustrates a potential to be explored through the use of the controller identification technique, which can also be used for the control of nonlinear dynamical systems.The main goal of this work is to use the controller identification technique to control the trajectories of dynamical systems with chaotic behavior. The novelty of this approach is that the plant is treated as a model free plant which accounts for any model mismatches and that we try to identify a low order controller for a complex system.The proposed technique will be applied to control a Rössler [8], a Lotka–Volterra three-species system [9–11], and a Rössler hyperchaos model [12]. In the literature we can find several works dealing with control of chaos. We highlight those related to the control of the Rössler system [13, 14] and the predator-prey systems [15–17]. In general, one can observe in these applications that the controllers used are of proportional kind. In the same way, in this work we use the controller identification technique applied to the proportional case. More precisely, given a class of candidate controllers, we identify the ones that present the best performance. The proportional control parameter is periodically modified. This update is made in order to put a better controller online. There are several ways to update the control parameters, the one chosen in this work is the step; that is, after a certain time, the control parameters are updated.Numerical simulation is presented to illustrate the effectiveness of the proposed technique. These simulations regard the systems previously cited with the requirement of following a desired trajectory. The controllability of each system is calculated, which allows us to show that the proposed control technique preserves the locally complete state controllability of the nonlinear controlled systems.This paper is organized as follows. In Section2, the technique of controller identification is presented. In Section 3, a brief explanation of local controllability is presented and the proposed technique is applied to control the chaotic Rössler, predator-prey, and Rössler hyperchaos systems with simulations. In Section 4, some concluding remarks are given.


## 2. The Controller Identification Technique

A general overview of the controller identification technique can be found in [6]. According to this technique, the only plant information used is the plant experimental data. For the cases presented in this work, we need only the reference functions r and the data y (from the dynamical system) to obtain the control u. Given a desired behavior, a class of candidate controllers is proposed. Then, a controller is selected through the use of a performance index and the fictitious reference concept. In this work, we apply the controller identification to a class of proportional controllers and the respective mathematical development follows below.The control law for a proportional controller is given by(1)u=Kr-yand, consequently, the fictitious reference is given by(2)rK=uK+y,where K is a constant.The performance index is given by(3)I=∫0ty-wm∗rK2dτ,where Wm(s) is a transfer function of desired behavior and wm is its inverse Laplace transform(4)wm=L-1Wms.Theorem 1.
Among the controllers of class (1), the one that minimizes the performance index (3) is K^ given by (5)K^=GF,where (6)F=∫0ty-ymumdτ,(7)G=∫0tum2dτ,(8)um=wm∗u,(9)ym=wm∗y,with “∗” denoting the convolution operation.Proof.
From (1), the fictitious reference is given by (2), where K is a constant.
Using (8) and (9) we have that(10)y-wm∗rK=y-wm∗uK+y,(11)I=∫0ty-wm∗rK2dτ=∫0ty-umK-ym2dτ=∫0ty2+umK2+ym2-2yumK-2yym+2umymKdτ=E-2FK+GK2,where(12)E=∫0ty-ym2dτ,F=∫0ty-ymumdτ,G=∫0tum2dτ.
The minimization of the performance index means findingK that satisfies the equation:(13)dIdK=2FK2-2GK3=0,which leads to our estimator for the proportional constant(14)K^=GF.One can note thatK^=G/F is the multiplicative constant of control functions u. In order to obtain the simulation results, K^ will be periodically updated. The objective is to minimize the difference between the measured y and the desired ym. We used a continuous time formulation for the dynamical systems.From (1)–(4) and Theorem presented above, we obtained the constant K^ that determines the proportionality constant of the optimal control function u, given by (1). This development can be extended to any odd power of the control function u. Thus, if n is an odd number, we replace (1) and (2):(15)u=Kr-yn.Isolating r produces(16)un=Kr-y,rK=unK+y.Then (8) and (10) are rewritten as(17)um=wm∗u,n(18)y-wm∗rK=y-wm∗unK+y,respectively. The other equations are not modified.The controller identification technique can be translated to the following procedure.Step 1.
Define the space-state from the dynamical system.Step 2.
Obtain the experimental data of the systemy(t); that is, define y0=y0 and choose the desired trajectories r and initial K.Step 3.
Integrate system (10)–(12).Step 4.
FindK^.Step 5.
Update the input of the systemy(t) with results obtained in the previous step. Go to Step 3.Step 6.
After reaching the number of iterations previously stipulated to updateK^, update it and go to Step 2.Step 7.
The simulation ends when the number of iterations has been reached.Figure1 shows a block diagram of the proposed control.Figure 1
Block diagram for the proposed control system.


## 3. Control of Chaos Using Controller Identification

Simulation results are considered for three nonlinear dynamical systems: Rössler, Lotka–Volterra predator-prey for two preys and one predator, and Rössler hyperchaos, all systems being dimensionless. We consider independent control laws for each equation of the system. In controlled dynamic systems, the most common way to write the control functionu=Kr-y is given by (19)uj=Kjx~j-xj,j=1,2,…,n,where n is equal to the number of system equations. The references are r=x~j and the entries are y=xj. In [13], the control laws present proportional coefficients, but the equation is not independent because u depends on all variables.The softwareMatlab andRunge-Kutta of fourth order were used in the simulations. For the two systems, the values obtained from (6)–(12) and the state y were computed concomitantly. A vector Y was created to be used in the integration process of the Runge-Kutta function, defined as(20)Y=x1x2⋯xn∣ym1um1E1F1G1⋯ymnumnEnFnGnT.The initial state is given by(21)Y0=Y0,and the initial values Kj are(22)Kj=K1K2⋯KnT.The transfer functionWm(s) is(23)Wms=1s+1.In each case below, the reference to the system, containing the desired trajectory, will be represented by a vectorx~j as follows:(24)x~j=x~1tx~2t⋯x~ntT.


### 3.1. Local Controllability

Nonlinear systems can be written using direct parameterization to bring the nonlinear dynamics to the state-dependent coefficient (SDC) form(25)x˙=Axx+Bu,where A(x) is a state-dependent matrix. The design procedure consists of using direct parameterization of A(x) to bring the nonlinear system to a linear structure having state-dependent coefficients (SDC) f(x)=A(x)x. In general, A(x) is unique only if x is scalar. Then, many possibilities exist for SDC parameterizations if x is not scalar.The proposal is to show that the pair[A(x),B] is a controllable parameterization of the nonlinear system (25) in a region where K is updated, such that [A(x),B] is pointwise controllable in the linear sense.For each update ofK, we consider the local controllability of the system. This idea is similar to locally optimal control from the state-dependent Riccati equation control [18, 19]. In the two cases that follow, we will show that the control technique, proposed here for the nonlinear dynamical systems, produces systems that are locally completely state controllable.


### 3.2. Case  1: Application to the Control of the Rössler System

Rössler system [8] is given by(26)x˙1=-x2-x3,x˙2=x1+bx2,x˙3=b+x3x1-a.Differential equations (26) define a continuous time system with chaotic behavior for b=0.2 and a=5.7. Notice that the third equation presents a nonlinearity x3x1. An interesting aspect of this system is its complex dynamical behavior in contrast with the simplicity of the description of its vector field. The phase portrait of Rössler system is shown in [8].The system with control can be written as [13](27)x˙1=-x2-x3+u1,x˙2=x1+bx2+u2,x˙3=b+x3x1-a+u3.Here, the objective of control strategyuj is to drive system (27) from any initial state xj0 to desired trajectories x~j. The desired trajectories are given by(28)x~j=5+cos⁡t1+sin⁡t1+sin⁡tT,which represents a limit cycle in the phase diagram.The initial values forK1, K2, and K3 were(29)Kj=101010T.In order to obtain the simulation results, the values ofK1, K2, and K3 were periodically updated on each 0.5 from 0 to 100.Figure2 presents the desired trajectories r1, r2, r3 and the trajectories of the controlled system (27).Figure 2
Temporal trajectories of the controlled system (27) and reference (28).One can observe convergence with a residual error in the third componentx3. Figure 3 presents the phase portrait for the controlled Rössler system.Figure 3
Phase portrait for the controlled Rössler system.From Figure3 we can notice convergence to the limit cycle given by x~j.The local controllability for the Rössler system (27) can be obtained by rewriting the system in the state-dependent coefficients form (25). One possible parameterization for (27) is(30)x˙=0-1-11b0bx10x1-ax1x2x3+100010001u1u2u3,for x1≠0.The rank of the controllability matrix is computed for each update ofK. It has value of 3, which means that the nonlinear system (27) is locally completely state controllable.


### 3.3. Case  2: Application to the Control of the Biological Lotka–Volterra System

The biological Lotka–Volterra model describes populations in competition [11]. The general form of this model is given by(31)x˙j=xjcj-∑j=1najixi,j=1,2,3,where xj is density of the species j at time t,n is the number of species interacting in the system, cj is the reproduction or mortality rate, and aji are predation, competition, or conversion rates. For two preys and one predator, or the two hosts and one parasitoid, the model becomes(32)x˙1=x1c1-a11x1-a12x2-a13x3,x˙2=x2c2-a21x1-a22x2-a23x3,x˙3=x3c3-a31x1-a32x2-a33x3.According to Gilpin [9] and Vance [10], system (32) is nonlinear and exhibits chaotic behavior for the following model coefficients: c1=c2=-c3=1, a11=a12=0.001, a22=0.001, a21=0.0015, a13=0.01, a23=0.001, a31=-0.005, a32=-0.0005, and a33=0. The trajectories and the strange attractor of system (31) are shown in [16].The controlled Lotka–Volterra system proposed is described by(33)x˙1=x1c1-a11x1-a12x2-a13x3+u1,x˙2=x2c2-a21x1-a22x2-a23x3+u2,x˙3=x3c3-a31x1-a32x2-a33x3+u3.The objective of control strategyuj is to drive system (33) from its initial state(34)xj0=xj0,to the desired fixed point [20], or constant trajectories(35)x~j=4105T,while minimizing performance criterion (11).The initial values forK1, K2, and K3 were the same as in Case  1. The total simulation time was of 100 with K1, K2, and K3 update on each 0.5.Figure4 shows the time series of the controlled Lotka–Volterra system with initial densities (2, 5, 2).Figure 4
Temporal evolution of the controlled Lotka–Volterra system.From Figure4, one can observe that the trajectories are practically controlled when t=20. Figure 5 shows the phase portrait behavior of the controlled Lotka–Volterra system (33).Figure 5
Phase portrait behavior of the controlled Lotka–Volterra system.The performance index for the controllers change of the controlled Lotka–Volterra system is shown in Figure6.Figure 6
Performance index given by (11).One can observe from Figure6 that performance index has minimal variation after 100 (or constant trajectory), which leads us to conclude that it stabilizes at this value.The local controllability for the Lotka–Volterra system (33) can be checked by rewriting the system in the state-dependent coefficients form (25), parameterized by(36)x˙=c1-a11x1-a12x1-a13x1-a21x2c2-a22x2-a23x2-a31x3-a32x3c3-a33x3x1x2x3+100010001u1u2u3.The rank of the controllability matrix is computed for each update ofK. It has value 3, which means that the nonlinear system (33) is locally completely state controllable.


### 3.4. Case  3: Application to the Control of the Rössler Hyperchaos System

Rössler hyperchaos system [12] is given by(37)x˙1=-x2-x3,x˙2=x1+b1x2+x4,x˙3=b2+x1x3,x˙4=-b3x3+b4x4.The 4D differential equations (37) define a continuous time system with chaotic behavior for b1=0.27857, b2=3.0, b3=0.3, and b4=0.05. As in the Rössler 3D system, the third equation presents a nonlinearity x1x3. The phase portraits of system (37) are shown in Figure 7, in four different combinations of coordinate axes.Figure 7
Phase portrait for the 4D Rössler system, with initial conditions (0,0,0,30).The 4D system (37) with control can be written as(38)x˙1=-x2-x3+u1,x˙2=x1+b1x2+x4+u2,x˙3=b2+x1x3+u3,x˙4=-b3x3+b4x4+u4.Analogously to the previous cases, the control strategyuj drives system (38) from any initial state xj0 to desired trajectories x~j. The desired trajectories are given by(39)x~j=5+cos⁡tsin⁡tsin⁡t3+sin⁡tT.The initial values forK1, K2, K3, and K4 were(40)Kj=0.00010.00010.00010.0001T.In order to obtain the simulation results, the values ofKj were periodically updated on each 0.1 from 0 to 80.Figure8 presents the desired trajectories r1, r2, r3, r4 and the trajectories of the controlled system (38).Figure 8
Temporal trajectories of the controlled system (38) and reference (39) with initial conditions (0,0,0,10).One can observe in Figure8 that there is convergence of the trajectories to the desired references.The local controllability for the 4D Rössler system (38) can be obtained by rewriting the system in the state-dependent coefficients form (25). As in the previous cases, the rank of the controllability matrix was computed for each update of K as having value 4, which means that the nonlinear system (38) is also locally completely state controllable.Using the controller identification technique in the systems with chaotic behavior requires particular care in the choices of the initial conditions and the initial values ofK. Although not shown in this work, several tests were performed with different choices of initial conditions and initial K. Each change in choices generates different control performances. Therefore, it is up to the control designer to analyze these initial data in order to better control the system.


## 3.1. Local Controllability

Nonlinear systems can be written using direct parameterization to bring the nonlinear dynamics to the state-dependent coefficient (SDC) form(25)x˙=Axx+Bu,where A(x) is a state-dependent matrix. The design procedure consists of using direct parameterization of A(x) to bring the nonlinear system to a linear structure having state-dependent coefficients (SDC) f(x)=A(x)x. In general, A(x) is unique only if x is scalar. Then, many possibilities exist for SDC parameterizations if x is not scalar.The proposal is to show that the pair[A(x),B] is a controllable parameterization of the nonlinear system (25) in a region where K is updated, such that [A(x),B] is pointwise controllable in the linear sense.For each update ofK, we consider the local controllability of the system. This idea is similar to locally optimal control from the state-dependent Riccati equation control [18, 19]. In the two cases that follow, we will show that the control technique, proposed here for the nonlinear dynamical systems, produces systems that are locally completely state controllable.


## 3.2. Case  1: Application to the Control of the Rössler System

Rössler system [8] is given by(26)x˙1=-x2-x3,x˙2=x1+bx2,x˙3=b+x3x1-a.Differential equations (26) define a continuous time system with chaotic behavior for b=0.2 and a=5.7. Notice that the third equation presents a nonlinearity x3x1. An interesting aspect of this system is its complex dynamical behavior in contrast with the simplicity of the description of its vector field. The phase portrait of Rössler system is shown in [8].The system with control can be written as [13](27)x˙1=-x2-x3+u1,x˙2=x1+bx2+u2,x˙3=b+x3x1-a+u3.Here, the objective of control strategyuj is to drive system (27) from any initial state xj0 to desired trajectories x~j. The desired trajectories are given by(28)x~j=5+cos⁡t1+sin⁡t1+sin⁡tT,which represents a limit cycle in the phase diagram.The initial values forK1, K2, and K3 were(29)Kj=101010T.In order to obtain the simulation results, the values ofK1, K2, and K3 were periodically updated on each 0.5 from 0 to 100.Figure2 presents the desired trajectories r1, r2, r3 and the trajectories of the controlled system (27).Figure 2
Temporal trajectories of the controlled system (27) and reference (28).One can observe convergence with a residual error in the third componentx3. Figure 3 presents the phase portrait for the controlled Rössler system.Figure 3
Phase portrait for the controlled Rössler system.From Figure3 we can notice convergence to the limit cycle given by x~j.The local controllability for the Rössler system (27) can be obtained by rewriting the system in the state-dependent coefficients form (25). One possible parameterization for (27) is(30)x˙=0-1-11b0bx10x1-ax1x2x3+100010001u1u2u3,for x1≠0.The rank of the controllability matrix is computed for each update ofK. It has value of 3, which means that the nonlinear system (27) is locally completely state controllable.


## 3.3. Case  2: Application to the Control of the Biological Lotka–Volterra System

The biological Lotka–Volterra model describes populations in competition [11]. The general form of this model is given by(31)x˙j=xjcj-∑j=1najixi,j=1,2,3,where xj is density of the species j at time t,n is the number of species interacting in the system, cj is the reproduction or mortality rate, and aji are predation, competition, or conversion rates. For two preys and one predator, or the two hosts and one parasitoid, the model becomes(32)x˙1=x1c1-a11x1-a12x2-a13x3,x˙2=x2c2-a21x1-a22x2-a23x3,x˙3=x3c3-a31x1-a32x2-a33x3.According to Gilpin [9] and Vance [10], system (32) is nonlinear and exhibits chaotic behavior for the following model coefficients: c1=c2=-c3=1, a11=a12=0.001, a22=0.001, a21=0.0015, a13=0.01, a23=0.001, a31=-0.005, a32=-0.0005, and a33=0. The trajectories and the strange attractor of system (31) are shown in [16].The controlled Lotka–Volterra system proposed is described by(33)x˙1=x1c1-a11x1-a12x2-a13x3+u1,x˙2=x2c2-a21x1-a22x2-a23x3+u2,x˙3=x3c3-a31x1-a32x2-a33x3+u3.The objective of control strategyuj is to drive system (33) from its initial state(34)xj0=xj0,to the desired fixed point [20], or constant trajectories(35)x~j=4105T,while minimizing performance criterion (11).The initial values forK1, K2, and K3 were the same as in Case  1. The total simulation time was of 100 with K1, K2, and K3 update on each 0.5.Figure4 shows the time series of the controlled Lotka–Volterra system with initial densities (2, 5, 2).Figure 4
Temporal evolution of the controlled Lotka–Volterra system.From Figure4, one can observe that the trajectories are practically controlled when t=20. Figure 5 shows the phase portrait behavior of the controlled Lotka–Volterra system (33).Figure 5
Phase portrait behavior of the controlled Lotka–Volterra system.The performance index for the controllers change of the controlled Lotka–Volterra system is shown in Figure6.Figure 6
Performance index given by (11).One can observe from Figure6 that performance index has minimal variation after 100 (or constant trajectory), which leads us to conclude that it stabilizes at this value.The local controllability for the Lotka–Volterra system (33) can be checked by rewriting the system in the state-dependent coefficients form (25), parameterized by(36)x˙=c1-a11x1-a12x1-a13x1-a21x2c2-a22x2-a23x2-a31x3-a32x3c3-a33x3x1x2x3+100010001u1u2u3.The rank of the controllability matrix is computed for each update ofK. It has value 3, which means that the nonlinear system (33) is locally completely state controllable.


## 3.4. Case  3: Application to the Control of the Rössler Hyperchaos System

Rössler hyperchaos system [12] is given by(37)x˙1=-x2-x3,x˙2=x1+b1x2+x4,x˙3=b2+x1x3,x˙4=-b3x3+b4x4.The 4D differential equations (37) define a continuous time system with chaotic behavior for b1=0.27857, b2=3.0, b3=0.3, and b4=0.05. As in the Rössler 3D system, the third equation presents a nonlinearity x1x3. The phase portraits of system (37) are shown in Figure 7, in four different combinations of coordinate axes.Figure 7
Phase portrait for the 4D Rössler system, with initial conditions (0,0,0,30).The 4D system (37) with control can be written as(38)x˙1=-x2-x3+u1,x˙2=x1+b1x2+x4+u2,x˙3=b2+x1x3+u3,x˙4=-b3x3+b4x4+u4.Analogously to the previous cases, the control strategyuj drives system (38) from any initial state xj0 to desired trajectories x~j. The desired trajectories are given by(39)x~j=5+cos⁡tsin⁡tsin⁡t3+sin⁡tT.The initial values forK1, K2, K3, and K4 were(40)Kj=0.00010.00010.00010.0001T.In order to obtain the simulation results, the values ofKj were periodically updated on each 0.1 from 0 to 80.Figure8 presents the desired trajectories r1, r2, r3, r4 and the trajectories of the controlled system (38).Figure 8
Temporal trajectories of the controlled system (38) and reference (39) with initial conditions (0,0,0,10).One can observe in Figure8 that there is convergence of the trajectories to the desired references.The local controllability for the 4D Rössler system (38) can be obtained by rewriting the system in the state-dependent coefficients form (25). As in the previous cases, the rank of the controllability matrix was computed for each update of K as having value 4, which means that the nonlinear system (38) is also locally completely state controllable.Using the controller identification technique in the systems with chaotic behavior requires particular care in the choices of the initial conditions and the initial values ofK. Although not shown in this work, several tests were performed with different choices of initial conditions and initial K. Each change in choices generates different control performances. Therefore, it is up to the control designer to analyze these initial data in order to better control the system.


## 4. Conclusions

In this paper we presented the controller identification technique applied to find proportional controllers for nonlinear systems with chaotic behavior. Simulation results were presented to illustrate the effectiveness of the technique. We observe convergence to the desired trajectories.From the simulation results obtained, one can note that the controller identification technique is useful for the control of chaotic systems. Nevertheless, the results are dependent on the initial parametersK and on the periodicity of the updating of K, which may indicate that the technique is not so robust in spite of its simplicity. In addition, we noted also that the controller for each system has its own peculiarities, which needs to be taken into account in each simulation. It is possible that one cannot find a general proof that the controller identification technique works for any nonlinear systems. However by the simplicity of application of the technique, we expect that it can be successfully used in other cases. It was shown in the simulations that the proposed control technique controls nonlinear systems that were locally completely state controllable.Trying to improve the performance of the systems presented, higher order candidate controllers were used, but the performance was not improved. This leads us to believe that the results for the linear case represent a good illustration of the technique. Moreover, through the use of a simple control law, we could present the use of the technique in an illustrative way.



---

*Source: 3835616-2017-11-14.xml*