# A Multilayer Feed Forward Small-World Neural Network Controller and Its Application on Electrohydraulic Actuation System

Authors: Xiaohu Li; Feng Xu; Jinhua Zhang; Sunan Wang
Journal: Journal of Applied Mathematics
 (2013)

---

## Abstract

Being difficult to attain the precise mathematical models, traditional control methods such as proportional integral (PI) and proportional integral differentiation (PID) cannot meet the demands for real time and robustness when applied in some nonlinear systems. The neural network controller is a good replacement to overcome these shortcomings. However, the performance of neural network controller is directly determined by neural network model. In this paper, a new neural network model is constructed with a structure topology between the regular and random connection modes based on complex network, which simulates the brain neural network as far as possible, to design a better neural network controller. Then, a new controller is designed under small-world neural network model and is investigated in both linear and nonlinear systems control. The simulation results show that the new controller basing on small-world network model can improve the control precision by 30% in the case of system with random disturbance. Besides the good performance of the new controller in tracking square wave signals, which is demonstrated by the experiment results of direct drive electro-hydraulic actuation position control system, it works well on anti-interference performance.


---

## Body

## 1. Introduction

As we know, neural network is an adaptive function estimator needless to know the determined math relationship between input and output, and it also has good adaptability and learning ability. These features make it very suitable to be used as intelligent controller for complex systems. Many researches show that the neural network controller is especially suitable for those uncertain or nonlinear control objects, which make it have a wide application prospect in the field of intelligent control. Obviously, the constructed neural network model directly determines the quality of the neural network controller; in short, the architecture design is critical for neural network model. At present, the structures of artificial neural network model are often designed as feedback, feed forward, single neuron, multilayer, and so on. As such, it is an important problem worthy of discussion whether these structures of neural network models are optimal and if they are able to reflect the real human brain neural network structure or not.Recent researches have shown that the structure topology and function of human brain neural network are closely related to each other; the connection mode of brain neural network structure topology offers the possibility for different brain areas to mutual collaboration [1–6]. This collaboration is mainly due to the large number of neurons in human brain, which means that the simple structure topology and function of a single neuron are multiplied by the large number of neurons. All those neurons connecting with each other by nerve fibers according to a certain kind of connection mode can make up highly complex human brain neural network. Unfortunately, the existing artificial neural network models are simple simulation of the biological neural network in structure topology and function. The common connection modes of artificial neural network can be divided into feed forward, feedback, single layer, multilayer, and so forth, all of which can be regarded as regular structure topology. In the past few decades, lots of researches have been carried out regarding artificial neural network with regular structure topology [7–10]. Although the bioneurological studies have shown that neural network inherently has random features on structure topology, the research of artificial neural network with random structure topology is relatively rarely reported. Consequently, it is essential to design a neural network model with stochastic characteristic structure, which will not only help in obtaining an optimal network performance, but also be a more realistic reflection of the structural features of the brain neural network.At present, there are two typical methods to reflect the random features of neural network: one is to adopt random connection weight between the neurons of neural network; the other is to use random neuron activation function [11]. But neither of the methods mentioned above can really reveal the random features on neural network structure topology. New achievements of complex network have provided a new method for constructing neural network model with random feature structure. Watts and Strogatz researched on the structure topology of many realistic complex networks and defined the intermediate network between completely regular and random networks as small-world network (referred to as W-S model) [12]. Many studies on complex network have shown that the realistic networks, such as disease transmission network, social network, food chain network, metabolic network, and so forth, are all small-world network on structure topology [13–18]. Meanwhile, scholars discovered that biological neural networks are also small-world network [19–23]. All of these small-world networks have random characteristics in structure. Obviously, if the structure topology of artificial neural network is built as a small-world one, it will really reflect the structure topology of the biological neural network. Erkaymaz et al. and Simard et al. rewired the links of multilayer feed forward neural network to build a small-world neural network model [24, 25]. However, in the construction process, it is apparent that the unchanging number of rewiring means a lack of randomness on structure topology, which is not consistent with W-S model. Therefore, it is necessary to rebuild a new neural network model, which relies on the rewiring probability. As self-learning is an important characteristic of artificial neural network, control application can be used to assess the performance of multilayer feed forward small-world neural network model. Since the new controller does not require a precise mathematical model, it can be applied to the electrohydraulic actuation system, with the help of which we may probe the features of small-world neural network model as well as its controller.In this paper, firstly, the multilayer feed forward small-world neural network model is built up according to the W-S model. Secondly, the mathematical model of small-world neural network is briefly described. Finally, a new controller with a small-world neural network model is designed for system control, which will not only explore the control performance of small-world neural network, but also compare control precision and anti-interference of small-world neural network with those of regular neural network. The performance of the controller is also verified by experiment on electrohydraulic actuation system.


## 2. Model Construction

In the multilayer feed forward neural network model, theith neuron of the lth layer vil only connects with its neighbor neurons, which belong to neuron sets Vl-1 and Vl+1. All of these links are feed forward, and there are no links between neurons of the same layer. As the links of each neuron are similar, this network structure topology can be regarded as regularity [26, 27]. Assuming that the number of neurons in each layer is nl, and the number of layers of neural network is L (including the input layer and output layer), the regular network structure topology is shown in Figure 1(a) when rewiring probability p=0. The operating mode of regular network is that input signals pass through the hidden layers, and transfer forwardly layer by layer, until they reach the output layer.Process of construction multilayer feed forward small-world neural network.
(a)
p
=
0
(b)
p
=
0.05
(c)
p
=
1Referring to the construction process of W-S model, a multilayer feed forward small-world neural network is built up in the literature [24]. In the construction process, the regular links of multilayer feed forward neural network are reconnected, but as a result of the determinate number of links and the network construction different from W-S model, the rewiring probability p is not used to reconstruct the network. Thus it cannot fully reflect the construction ideology of W-S model. Taking into account that the rewiring probability p has a direct impact on the generated network structure and characteristics, this paper proposes an algorithm to construct the multilayer feed forward small-world neural network model according to the rewiring probability p, and the process of algorithm is described as follows.(1)
Generate the same number of neurons in each layer, and connect neighbor neurons with feed forward links. Thus the multilayer feed forward regular neural network model is built, as shown in Figure1(a), and the connection mode of this model is regular.(2)
With rewiring probabilityp, disconnect the links from neuron i of the lth layer to neuron j of the (l+1)th layer in regular network; then randomly select neuron j′ ahead the (l+1)th layer to rewire; the new long links are not reconnection or self-loop. Clearly, if the links of the (L-1)th layer disconnect, they could not generate new long links. Therefore, the last two layers cannot be rewired.(3)
Repeat (2), until all the links are rewired besides those of the last two layers.Figure1(a) shows that when p=0, the connection mode of neural network model is completely regular, in which each neuron maintains the same number of links with adjacent neurons and this neural network model is commonly used. When p=1, as shown in Figure 1(c), all original links in the regular neural network model (except for the last two layers) are rewired into links with completely random features under disordered structure topology, forming a completely random neural network model. If 0<p<1 (e.g., p=0.05), long cross-layer links will be generated by rewiring probability p, and this structure topology is between completely regular and random, as shown in Figure 1(b). Obviously, this connection structure topology is an intermediate form from regular to random, which is in consistent with the ideology of W-S model. Therefore, this model is defined as multilayer feed forward small-world neural network model, and the smaller p is, the fewer there exist the long links in the new network model.


## 3. Network Model

In order to describe multilayer feed forward small-world neural network model distinctly, graph theory is utilized. Each neuron in multilayer feed forward small-world neural network model can be seen as a node in the graph. The links within all neurons are edges of the graph. The node set of small-world neural network model can be defined as(1)V={Vl∣l=1,2,…,L},
Where Vl={vil∣i=1,2,…,nl} is the node subset of the lth layer, L is the total layer number of the neural network model, vil is the ith node of the lth layer, and nl is the node number of each layer.Suppose the connection matrix of the neural network model is(2)W={W1,…,Wl,…,WL-1},
where Wl(l=1,2,…,L-1) is the connection submatrix of the lth layer, and wil is the connection vector of Vl→vil+1:
(3)wil=(w1il,w2il,…,wnlil)T,Wl=(w1l,w2l,…,wnll),
where i=1,2,…,nl, and  wijl∈ℝ is the connection weight of vil→vjl+1; if neuron i of the lth layer connects with neuron j of the (l+1)th layer, wijl≠0, contrariwise, wijl=0. Therefore, the regular neural network model connection matrix can be    expressed as
(4)V1V2⋯⋯VL-1VLW=V1V2⋮VL-1VL[0W10⋯0000W2⋯00⋮⋮⋮⋱⋮⋮000⋯0WL-1000⋯00].As for the multilayer small-world neural network model, due to the rewiring, the connection matrix even becomes(5)V1V2⋯⋯VL-1VLW=V1V2⋮VL-1VL[0W1′B11⋯B1L-3B1L-200W2′⋯B2L-4B2L-3⋮⋮⋮⋱⋮⋮000⋯0WL-1′000⋯00].As the reconnections of the last two layers in the neural network model do not exist (WL-1′=WL-1, Wl′=(wijl′)nl×nl) is the reconnection matrix of Wl, the elements of this matrix can be deformed into the following equation:
(6)wijl′={wijl,randij≥p0,randij<p,
where randij, which is generated at the ith row and the jth column in the matrix, is a random number between 0 and 1. Bll′=(bn1n2ll′)nl×nl is the reconnection submatrix of Vl→Vl′,  l∈{1,2,…,L-2},  l′∈{3,4,…,L}, n1,n2∈{1,2,…,nl}.From the connection matrixW, it can be seen that the neurons of the lth layer connect the (l+1)th layer’s neurons with the probability (1-p) and connect the neurons of the layer following the (l+1)th layer with the probability p. If the number of network layers and neurons is large and the rewiring probability p is small, the connection matrix will be a sparse matrix. In short, the neurons of the lth layer connect not only with the neurons of the (l-1)th layer in multilayer feed forward small-world neural network model; they also connect with the neurons of the 1~(l-2)th layers in accordance with rewiring probability p.


## 4. Control Simulation

Because of the strong ability in adaptive learning, neural network is usually used to design intelligent controller for complex industrial system. In addition, neural network can fully approximate any complex nonlinear system. Its identifier can also distinguish the characteristics of uncertain systems with high precision [28, 29]. In order to establish effective control for linear and nonlinear systems, this paper designs a controller which consists of two kinds of neural network model to obtain good performance. The controller structure is given in Figure 2. As shown in Figure 2, NNI identifies the controlled system online, e1 is the error between the reference input and the controlled system output, e2 is the error between the identification output and the controlled system output, and e(t) is the error between the system input and the controlled system output. In NNI, the gradient information of e2 is used to adjust the weight coefficient.Figure 2
Controller with small-world neural network model.In Figure2, NNI is an online identifier of the controlled system with regular structure topology and SNNC is the neural network controller with small-world structure topology. So the principle of small-world neural network control system can be described as follows: NNI identifies the controlled system online, by the use of identification result, then SNNC adjusts the weight coefficients using the identification result and outputs the control variable u(t), and then u(t) is applied to the controlled system and finally make the system output track the setting input to realize adaptive control.Select the following linear differential system as a controlled system:(7)y(k)=0.33y(k-1)+0.132y(k-2)+0.5u(k-1)+0.038u(k-2).SNNC network structure topology is selected as 3-6-6-1 (the number of input neurons is 3, the first and second hidden neurons are 6, and the output neuron is 1), NNI network structure topology is 3-6-1, the network weights and the thresholds are initialized to the range[-1,1], incremental weight updating strategy is used in Back-Propagation algorithm, and set learning rate η=0.1, inertia coefficient α=0.9, the control period number is 400, and the error criterion function is defined as follows:
(8)J(k)={12[y(k)-r(k)]2,SNNC,12[y(k)-y^(k)]2,NNI.
Select the input signal r(k) as
(9)r1(k)=0.2sin2πk26+0.3sinπk15+0.3sinπk75+v1(k),r2(k)=0.3sin2πk50+0.2sin2πk100+v2(k),
where,
(10)v1(k)={0.5,50≤k≤150,-0.5,150≤k≤250,0.1×rand(),others,v2(k)=0.05×rand().In the equation,rand()  is a random number in the range of [-1,1]. In Figure 3,  the input and output curve, the error curve are given when  p=0 and Figure 4 shows the same curves when p=0.1.Linear system (p=0).
(a)
Error curve
(b)
Control curveLinear system (p=0.1).
(a)
Error curve
(b)
Control curveFrom the figures, we can see that when constant disturbance is added (50≤k≤150,  150≤k≤250), neural network control systems all have better ability of self-adapting both p=0 and p=0.1, regardless of the rewiring probability. The neural network controller can adapt to the impact of constant disturbance through self-learning and adjusting connection weights so quickly that the output of the controlled system catches up with the input signal fast, and it can obtain a smaller error. When adding random disturbance to the input signal, especially within 250≤k≤400, the control error of p=0 is bigger than that of p=0.1 at least by 30%, which means that through rewiring, small-world neural network control system has good anti-interference capability.Select the following nonlinear system as a controlled system:(11)y(k)=1.2y(k-1)[2.5+y2(k-1)]+u3(k-1).Figures5 and 6 are given as the input signal and output curve, the error curve when p=0, p=0.1. Those diagrams also show that the error is largest when p=0. If the input is added with random disturbance, the error is relatively small when p=0.1. So small-world neural network control system has a better ability to suppress random disturbances. When the disturbance is a constant, the result is the same for linear system.Nonlinear system (p=0).
(a)
Error curve
(b)
Control curveNonlinear system (p=0.1).
(a)
Error curve
(b)
Control curve


## 5. Experiment on Electrohydraulic Actuation System

Presently, the valve-controlled hydraulic servo systems have been applied widely. This kind of system has the features of large output power, fast response, and high accuracy. However, it also has some shortcomings, such as low reliability, low efficiency, high requirements for oil cleanness, high manufacturing precision for electrohydraulic servo valve, and so on. In order to improve this situation, in recent years, the direct drive electrohydraulic servo system has been widely investigated. A swash plate mechanism is used to control the flow of hydraulic pump in direct drive electrohydraulic servo system. The change of the oblique angle of swash plate, which is regulated by the speed of the direct current motor, may help direct drive variable displacement electrohydraulic position servo control system to change its output flow and consequently serve to control the position of hydraulic actuator. Because of the high efficiency, easy operation, and big output force of this kind of system, it has been applied in many industry fields, such as electrohydraulic actuation system, precision forging machines, marine steering gear, and injection molding machines [30–34]. Due to existing nonlinear factors, it is difficult to establish the accurate mathematical model of this system. Figure 7 shows the schematic of direct drive variable displacement electrohydraulic actuation position control system. As shown in Figure 7, the hydraulic loading system is used to simulate the external load, and the control platform can control the hydraulic loading system to output different force value. The control objective of this electrohydraulic actuation system is to accurately track the given position signal, in which tracking performance, fast response, high accuracy, and good anti-interference must be taken into account. Therefore, the control strategy of this system is very important, and the small-world neural network controller is adopted to control this system given that it does not need accurate mathematical model.Figure 7
Schematic of direct drive variable displacement electrohydraulic actuation position servo control system (including hydraulic loading system).Hardware configuration of electrohydraulic actuation system is listed in Table1.Table 1
Hardware list of electro-hydraulic actuation system.
Name
Type
Specification
Brushless DC motor
BLF
Three phases 300 W
Displacement sensor
LVDT
±400 mm
Angular displacement sensor
RVDT
±30°
Swash plate hydraulic pump
Displacement pump
Swash plate angle: ±20°Maximum displacement: 84 mL/r
Hydraulic cylinder
Single-acting hydraulic cylinder
Stroke: 800 mmInternal diameter: 50 mmFirstly, in the case of no external load applied on direct drive variable displacement electrohydraulic actuation position system, the system is controlled to track square wave signal using small-world neural network. Figure8 shows the tracking result of 1 Hz square wave signal with peak value of 200 mm, where the curve of input signal is marked A, and output is marked B. The following diagrams are similar. As shown in the figure, after 2 cycles of learning, the system output signal can track the target displacement, the response time is about 0.2 s, and the steady state error is less than 0.2 mm.Figure 8
Track control of 1 Hz square wave (no load).This result shows that the use of small-world neural network control strategy for position control obtains satisfactory control precision and response speed in the case of noload. The structure topology of small-world neural network used in control test is the same as the simulation test.Figure9 shows the track control result by the use of small-world neural network control strategy under 10000 N external load. The hydraulic cylinder is controlled to track 2 Hz, peak value of 200 mm square wave signal. The result shows that the system has rapid response, about 0.25 s. The steady-state error is slightly larger, at about 2 mm. It indicates that the influence of external load will be further weakened by small-world neural network controller. Since the electrohydraulic actuation control system can also achieve fast tracking square wave signal, it can obtain satisfactory control accuracy under 10000 N external load.Figure 9
Track control of 2 Hz square wave (10000 N load).The load under actual situation usually appears quickly and unexpectedly. In order to testify whether the small-world neural network control strategy performs well or not, we simulate the step response control in the case of impact load 5000 N. The result is shown in Figure10.Figure 10
Step control curve (impact load 5000 N).As shown in the figure, at 3.7 s, the impact load 5000 N is added, and after about 0.25 s, the electrohydraulic actuation system can correct the error caused by the change of external load. The steady state error can be controlled within 0.2 mm or less. It shows that the small-world neural network controller has a better ability to suppress the impact of interference. The digital simulation results are basically consistent with the experimental results under external interference.


## 6. Conclusions

In this paper, a multilayer feed forward neural network model is proposed through reconnecting the regular links which relies heavily on the rewiring probability, and then a controller based on small-world neural network model is designed to control linear and nonlinear systems. Simulation results show that the regular and the small-world network all have better control performance under constant disturbance. But when adding random disturbance, the small-world neural network control system is superior to the corresponding regular neural network control system in control accuracy. So the multilayer small-world neural network control system has good anti-interference features. Furthermore, no matter there is load or not, the small-world neural network controller for direct drive electrohydraulic actuation position control system can obtain faster response, better control precision, and an ability of anti-interference, which means that small-world neural network can be used to develop intelligent controller for industrial systems. However, it still needs further study on how to obtain the optimal rewiring probability to make the best of the controller’s performance.



---

*Source: 872790-2013-06-08.xml*