# Development of Driver-Behavior Model Based onWOA-RBM Deep Learning Network

Authors: Junhui Liu; Yajuan Jia; Yaya Wang
Journal: Journal of Advanced Transportation
 (2020)

---

## Abstract

Human drivers’ behavior, which is very difficult to model, is a very complicated stochastic system. To characterize a high-accuracy driver behavior model under different roadway geometries, the paper proposes a new algorithm of driver behavior model based on the whale optimization algorithm-restricted Boltzmann machine (WOA-RBM) method. This method establishes an objective optimization function first, which contains the training of RBM deep learning network based on the real driver behavior data. Second, the optimal training parameters of the restricted Boltzmann machine (RBM) can be obtained through the whale optimization algorithm. Finally, the well-trained model can be used to represent the human drivers’ operation effectively. The MATLAB simulation results showed that the driver model can achieve an accuracy of 90%.


---

## Body

## 1. Introduction

Driver models can be applied to (1) vehicle dynamics [1] including vehicle component design, vehicle dynamics analysis, overall vehicle stability analysis, and design of onboard controls; (2) intelligent transport systems (ITS) [2, 3] including simulation of traffic flow based on the control theory models of driver behavior and modeling drivers’ risk taking behavior; (3) driverless vehicle systems [4]; and (4) traffic energy consumption systems [5]. Traffic energy consumption systems are different from the vehicle dynamics simulation. The traffic energy consumption system will be affected by the road, so our research focuses on how the road grade impacts on the driver’s behavior characteristics. Driving behaviors, including acceleration behavior, deceleration behavior, and uniform behavior, have impacts on the driving safety [6, 7], vehicle fuel consumption [8–10], and air pollution [11]. Designing a drive cycle of the vehicle requires investigating and collecting the practical driving data, analyzing the experimental data, and establishing the road vehicle driving conditions using relevant mathematical theoretical methods. The vehicle speed of this paper is collected based on the distance, and we also considered how the road grade influences driving speeds in its operating conditions. The operating conditions of the resulting vehicles can be used to determine the vehicle’s fuel consumption and the technical development as well as evaluation of new models. It is very important to establish an accurate driver behavior model. The main factors that affect the accuracy of the driver behavior model include road geometry and weather condition [12, 13]. Since the driver behavior is a very complicated stochastic system [14–17], designing driver behavior modeling is a very challenging task.At present, the main achievements of research on driver behavior modeling technology are as follows. Cai et al. [18] developed a new concept of the driving fingerprint map to represent driving characteristics. Miyajima and Takeda [19] proposed a driver behavior modeling method by using on-road driving data. The method is realized through statistical machine-learning techniques, such as hidden Markov models and deep learning. Angkititrakul et al. [20] proposed a stochastic driver behavior model based on Gaussian mixture model framework. This proposed method allows adaptation scheme to enhance the model capability to better represent particular driving characteristics of interest. Shi et al. [21] proposed to evaluate driving styles by normalizing driving behavior based on personalized driver modeling. An aggressiveness index is proposed to quantitatively evaluate driving styles in this method, which can be applied to detect abnormal driving behavior. Yamada and Takahashi [22] proposed a driver behavior modeling method based on real traffic data under varying environmental conditions. In this method, the driving speed is assumed to be a function of several factors such as overall traveling schedule, speed, and road surface conditions. Taniguchi et al. [23] proposed an unsupervised learning method, which is established on the basis of the original double articulation analyzer model. This method predicts possible scenarios of driving behavior by segmenting and modeling incoming driving behavior time series data. Okuda et al. [24] proposed a probability-weighted autoregressive exogenous model wherein the multiple autoregressive exogenous models are composed of the probabilistic weighting functions. This model can represent the actual driving behavior. There are plentiful publications on this topic using different optimization approaches, e.g., the instantaneous optimization algorithm [25], wolf pack algorithm [26], and genetic algorithm [27, 28].However, methods in [19, 20] are very complex and strongly depend on historical data. Shi et al. [21], propose to quantitatively evaluate driving styles by normalizing driving behavior based on personalized driver modeling. The results show that the prediction accuracy of driving behavior modeling will be affected by complex environment. The establishment of methods in [22–24, 29] requires a large amount of actual driving data as measurement data, which is also strongly dependent on historical data.To solve these problems, the paper presents a new method of driver behavior model based on WOA-RBM. This method establishes an objective function, which contains the training process of RBM based on real driver behavior data. Then, the best training parameters of RBM are obtained through WOA. Finally, the RBM after training based on the best training parameters can be used to build the driver behavior model.This paper is organized as follows. Section2 describes the driving data collection. Section 3 presents the process of driving behavior modeling based on WOA-RBM. Section 4 shows the experimental results, which prove that the proposed method in this paper can achieve a better performance. Conclusions are offered in Section 5.


## 2. Driving Data Collection

In this section, the driving data come from the measurement data along the highway 120 near Manteca, CA, USA. In order to build a highly accurate driver behavior model, more than 2000 different drivers’ driving behavior data were collected for each route. The measurement data were collected in Manteca during June 17th–July 28th (six weeks), 2018 [30]. Vehicle speeds are measured at 9 points identified in Figure 1. From the map (Figure 1), this highway is an approximately straight road. When modeling the driver, only the influence of the road grade on the speed of the driver is considered, so the curvature of the road is not displayed. In future research, we will take curvature of the road into building the driver model. The road grade is small, but it still has a great impact on the energy consumption of the vehicle. The energy reduction comes from two reasons. First, if a vehicle has constant speed or accelerates, less energy is consumed by the power plant (the engine and/or the electric motor) to drive the vehicle downhill than on a flat road because the gravity contributes positive work to overcome the negative work by aerodynamic drag and tire rolling resistance. The vehicle’s potential energy is partly converted into its kinetic energy. Second, if a vehicle decelerates on a flat road or a downhill, the reduced kinetic energy is wasted by the brake as heat. On the other hand, if the vehicle decelerates on an uphill, part of the decreased kinetic energy is converted into the vehicle’s potential energy and less kinetic energy is wasted by the brake. The gained potential energy can later be converted back into kinetic energy during a downhill. In summary, road slope change turns the vehicle’s potential energy into an energy buffer to store the kinetic energy. The data are collected in 5-minute interval between 00:00 and 23:55 every day at each measurement point. Vehicle speeds at positions other than the 9 points are estimated by linear interpolation. The studied route stretches along 6.1 km of highway driving. The altitude varies from approximately 9 to 17 m. And the origin altitude is approximately 13 m while the terminal altitude is approximately 17 m. The road is sampled by 305 even steps with the step length Δs=6100/305=20 m. The recorded speed trajectories for the first week and the altitude of the road are shown in Figures 2 and 3. The drivers generally increase the velocity between 4 and 6 km because this section of the road sets speed limits.Figure 1
Route of driving data collection.Figure 2
The data of different human driver operations.Figure 3
The altitude profile of the road.Figure4 shows the slope information of road environment. When the slope is larger than 0, the road is an uphill road; when the slope is lower than 0, the road is a downhill road; when the slope is equal to 0, the road is a flat road.Figure 4
Slope information of road environment.The driving data are shown in Table1.Table 1
Segments of the vehicle speeds.
Different driversSpeeds at sample points (m/s)12345678131.290031.285131.280331.275431.270631.265731.260831.2560230.396030.396030.396030.396030.396030.396030.396030.3960330.530130.525230.520430.515530.510730.505830.500930.4961430.887730.880430.873130.865830.858530.853130.844030.8367530.530130.539830.549530.559330.569030.578730.588430.5981The data size is2004×306, the data in each row represent the driving behaviors of 2004 different drivers in the same road section, and the data in each column show the driving behaviors of each driver at different sample points.


## 3. Driver Behavior Model Based on WOA-RBM

In this paper, a new driver behavior model based on WOA-RBM is proposed, which imitates human driving behavior during real-world driving. This new method is designed based upon the theory of RBM and WOA.


### 3.1. Deep Learning Network Based on RBM

The deep learning network based on RBM can solve the problem of the multilayer network training, which is also easy to realize [31, 32]. The structure of deep learning neural network based on RBM is shown in Figure 5.Figure 5
The structure of deep learning neural network based on RBM.There are two RBMs and one backpropagation (BP) network in this structure, with a hidden layer and a visible layer in each RBM, both of which are connected through a two-way connection between layers, as shown in Figure6.Figure 6
The basic structure of RBM.As in references [31, 32], the equation of RBM can be defined as follows:(1)Ev,h=−∑i∈vaivi−∑i∈hbihi−∑i,jvihiWij,where Ev,h is the energy function between the input v vector and the hidden layer output vector h, Wij is a connection weight matrix, vi is the visible layer, hi is the hidden layer, ai is the bias of visible node i, and bj is the bias of hidden node j.The probability of each visiblev and hidden layer h can be defined as(2)pv,h=1∑v,he−Ev,he−Ev,h.The logarithmic gradient of weight in (2) can be calculated as(3)∂logpv,h∂Wij=vihjdata−vihjmodel,where vihjdata is the mean value of data and vihjmodel is the mean value of model. Therefore, the learning rules of RBM can be computed as(4)ΔWij=Lr×vihjdata−vihjmodel,where Lr is the learning rate of RBM.Similarly, the parameter of indexes in equation (1) can be calculated as follows:(5)Δai=Lr×vidata−∑k=1Nvik,Δbj=Lr×hjdata−∑k=1Nhjk.From the above analysis, it is noted that the parameters affecting RBM training performance include the initial value ofLr,ai,bj,Wij, the number of hidden layer h, and the number of visible layer v. Therefore, it is significant to choose the appropriate parameters.According to the above principle, we assume that the training process of RBM is represented as follows:(6)err=fRBMLr,v,h,ai,bj,Wij,where err represents the training error. The smaller the training error is, the closer the driving behavior model similar to the actual driving behavior is.


### 3.2. Calculation of Optimal RBM Training Parameters

Obviously, the calculation of optimal RBM training parameters is an NP-hard problem. It difficult to calculate the global optimal value directly. To resolve this problem, the paper proposes the whale optimization algorithm (WOA) [33–35]. The main steps of WOA are as follows:Step 1. Walking and foraging stage: the humpback whale can find the position of food, and the behavior of humpback whale is defined as(7)D⟶=C⟶⋅X⟶rand−X⟶t,whereC⟶ is a coefficient vector, D⟶ is the distance between the whales and food, X⟶rand is the random position, and X⟶t is the current position.The position of the next moment can be defined as(8)X⟶t+1=X⟶rand−A⟶×D⟶.The vectorsA⟶ and C⟶ in equations (7) and (8) can be presented as(9)A⟶=2a⟶⋅r⟶−a⟶,C⟶=2⋅r⟶,wherer⟶ is a random vector whose values lie in the range of 0,1 and a⟶ is the value which is decreased linearly from 2 to 0.In this paper, the whale populationX⟶t is presented as(10)X⟶t=Lr,v,h,ai,bj,Wij.Step 2. Encircling and contracting stage: when the humpback whale finds the target food, the other whales will go to the position of the humpback whale and surround the food. The equation of this stage can be presented as follows:(11)D⟶=C⟶⋅X⟶t∗−X⟶t,X⟶t+1=X⟶t∗−A⟶⋅D⟶,whereX⟶t∗ is the vector of random position, which is chose to the current whale population.Step 3. Spiral predation stage: all the whales will move in a spiral direction of the optimal position of the humpback whale, and then the whales will generate many bubbles to surround the food for predation; the equation of this stage is(12)X⟶t+1=X⟶t∗+D′⟶⋅ebl⟶⋅cos2πl⟶,where D′⟶=X⟶t∗−X⟶t is the distance between the whale and the optimal solutions, b is a shape of logarithmic spiral, and l is a random number in the range of −1,1.Finally, we can define a random valuep to distinguish the contraction-bounding stage from the spiral predator. The equation is as follows:(13)X⟶t+1=X⟶t∗+D⟶⋅ebl⟶⋅cos2πl⟶,p≥0.5,X⟶∗−A⟶⋅D⟶,p<0.5.To sum up, the flowchart of WOA is shown in Figure7.Figure 7
The flowchart of WOA.


### 3.3. Driver Behavior Model Based on WOA-RBM

Upon the completion of the optimization process, we obtain the optimal parameters:(14)Xopt⟶=Lropt,vopt,hopt,ai,opt,bj,opt,Wij,opt.Subsequently, the optimized RBM model can be expressed as(15)Ev,h=−∑i∈voptai,optvi,opt−∑i∈hopthi,opthi,opt−∑i,jvi,opthi,optWij,opt.The learning rules of optimized RBM can be calculated as(16)ΔWij=Lropt×vi,opthj,optdata−vi,opthj,optmodel,Δai=Lropt×vi,optdata−∑k=1Nvi,optk,Δbj=Lropt×hj,optdata−∑k=1Nhj,optk.According to the theories introduced above, the driver behavior model based on WOA-RBM is shown in Figure8. The driver behavior model and the vehicle model constitute a closed-loop control system. The driver behavior model is actually an inverse model of the controlled object (vehicle). In this paper, based on road test data, the learning control method is used to build a driver model through machine learning. Assume that the vehicle speed at a certain position is Vs, and the driver presses down the accelerator pedal or brake pedal which as a consequence will affect the vehicle speed at the next position Vs+1. The expected speed of the next position is Ves+1, i.e., the road’s speed limit. The collected vehicle speed data are used to train the optimal control parameters which are input into the driver behavior model. At the same time, the road grade, the actual speed of the vehicle, and the deviation between the actual speed and the expected speed are also input into the driver behavior model. Subsequently, the driver behavior model outputs acceleration or deceleration to control the driving of the vehicle.Figure 8
The structure of driver behavior model based on WOA-RBM.Figure8 shows the proposed driver behavior model. In this model, the sampled driver data are used to train the WOA-RBM model. The optimal parameters Lropt, vopt, hopt, ai,opt, bj,opt, and Wij,opt of deep learning network are obtained after WOA optimization. The WOA-RBM model after training with the optimal training parameters is the driving behavior model. Finally, the driving behavior model is used in a vehicle control system. In Figure 8, the “road information” specifically refers to the road grade. ΔV indicates the difference between actual speed and desired speed. The whole closed-loop control system output is the vehicle speed. Drive operation is acceleration or deceleration.


## 3.1. Deep Learning Network Based on RBM

The deep learning network based on RBM can solve the problem of the multilayer network training, which is also easy to realize [31, 32]. The structure of deep learning neural network based on RBM is shown in Figure 5.Figure 5
The structure of deep learning neural network based on RBM.There are two RBMs and one backpropagation (BP) network in this structure, with a hidden layer and a visible layer in each RBM, both of which are connected through a two-way connection between layers, as shown in Figure6.Figure 6
The basic structure of RBM.As in references [31, 32], the equation of RBM can be defined as follows:(1)Ev,h=−∑i∈vaivi−∑i∈hbihi−∑i,jvihiWij,where Ev,h is the energy function between the input v vector and the hidden layer output vector h, Wij is a connection weight matrix, vi is the visible layer, hi is the hidden layer, ai is the bias of visible node i, and bj is the bias of hidden node j.The probability of each visiblev and hidden layer h can be defined as(2)pv,h=1∑v,he−Ev,he−Ev,h.The logarithmic gradient of weight in (2) can be calculated as(3)∂logpv,h∂Wij=vihjdata−vihjmodel,where vihjdata is the mean value of data and vihjmodel is the mean value of model. Therefore, the learning rules of RBM can be computed as(4)ΔWij=Lr×vihjdata−vihjmodel,where Lr is the learning rate of RBM.Similarly, the parameter of indexes in equation (1) can be calculated as follows:(5)Δai=Lr×vidata−∑k=1Nvik,Δbj=Lr×hjdata−∑k=1Nhjk.From the above analysis, it is noted that the parameters affecting RBM training performance include the initial value ofLr,ai,bj,Wij, the number of hidden layer h, and the number of visible layer v. Therefore, it is significant to choose the appropriate parameters.According to the above principle, we assume that the training process of RBM is represented as follows:(6)err=fRBMLr,v,h,ai,bj,Wij,where err represents the training error. The smaller the training error is, the closer the driving behavior model similar to the actual driving behavior is.


## 3.2. Calculation of Optimal RBM Training Parameters

Obviously, the calculation of optimal RBM training parameters is an NP-hard problem. It difficult to calculate the global optimal value directly. To resolve this problem, the paper proposes the whale optimization algorithm (WOA) [33–35]. The main steps of WOA are as follows:Step 1. Walking and foraging stage: the humpback whale can find the position of food, and the behavior of humpback whale is defined as(7)D⟶=C⟶⋅X⟶rand−X⟶t,whereC⟶ is a coefficient vector, D⟶ is the distance between the whales and food, X⟶rand is the random position, and X⟶t is the current position.The position of the next moment can be defined as(8)X⟶t+1=X⟶rand−A⟶×D⟶.The vectorsA⟶ and C⟶ in equations (7) and (8) can be presented as(9)A⟶=2a⟶⋅r⟶−a⟶,C⟶=2⋅r⟶,wherer⟶ is a random vector whose values lie in the range of 0,1 and a⟶ is the value which is decreased linearly from 2 to 0.In this paper, the whale populationX⟶t is presented as(10)X⟶t=Lr,v,h,ai,bj,Wij.Step 2. Encircling and contracting stage: when the humpback whale finds the target food, the other whales will go to the position of the humpback whale and surround the food. The equation of this stage can be presented as follows:(11)D⟶=C⟶⋅X⟶t∗−X⟶t,X⟶t+1=X⟶t∗−A⟶⋅D⟶,whereX⟶t∗ is the vector of random position, which is chose to the current whale population.Step 3. Spiral predation stage: all the whales will move in a spiral direction of the optimal position of the humpback whale, and then the whales will generate many bubbles to surround the food for predation; the equation of this stage is(12)X⟶t+1=X⟶t∗+D′⟶⋅ebl⟶⋅cos2πl⟶,where D′⟶=X⟶t∗−X⟶t is the distance between the whale and the optimal solutions, b is a shape of logarithmic spiral, and l is a random number in the range of −1,1.Finally, we can define a random valuep to distinguish the contraction-bounding stage from the spiral predator. The equation is as follows:(13)X⟶t+1=X⟶t∗+D⟶⋅ebl⟶⋅cos2πl⟶,p≥0.5,X⟶∗−A⟶⋅D⟶,p<0.5.To sum up, the flowchart of WOA is shown in Figure7.Figure 7
The flowchart of WOA.


## 3.3. Driver Behavior Model Based on WOA-RBM

Upon the completion of the optimization process, we obtain the optimal parameters:(14)Xopt⟶=Lropt,vopt,hopt,ai,opt,bj,opt,Wij,opt.Subsequently, the optimized RBM model can be expressed as(15)Ev,h=−∑i∈voptai,optvi,opt−∑i∈hopthi,opthi,opt−∑i,jvi,opthi,optWij,opt.The learning rules of optimized RBM can be calculated as(16)ΔWij=Lropt×vi,opthj,optdata−vi,opthj,optmodel,Δai=Lropt×vi,optdata−∑k=1Nvi,optk,Δbj=Lropt×hj,optdata−∑k=1Nhj,optk.According to the theories introduced above, the driver behavior model based on WOA-RBM is shown in Figure8. The driver behavior model and the vehicle model constitute a closed-loop control system. The driver behavior model is actually an inverse model of the controlled object (vehicle). In this paper, based on road test data, the learning control method is used to build a driver model through machine learning. Assume that the vehicle speed at a certain position is Vs, and the driver presses down the accelerator pedal or brake pedal which as a consequence will affect the vehicle speed at the next position Vs+1. The expected speed of the next position is Ves+1, i.e., the road’s speed limit. The collected vehicle speed data are used to train the optimal control parameters which are input into the driver behavior model. At the same time, the road grade, the actual speed of the vehicle, and the deviation between the actual speed and the expected speed are also input into the driver behavior model. Subsequently, the driver behavior model outputs acceleration or deceleration to control the driving of the vehicle.Figure 8
The structure of driver behavior model based on WOA-RBM.Figure8 shows the proposed driver behavior model. In this model, the sampled driver data are used to train the WOA-RBM model. The optimal parameters Lropt, vopt, hopt, ai,opt, bj,opt, and Wij,opt of deep learning network are obtained after WOA optimization. The WOA-RBM model after training with the optimal training parameters is the driving behavior model. Finally, the driving behavior model is used in a vehicle control system. In Figure 8, the “road information” specifically refers to the road grade. ΔV indicates the difference between actual speed and desired speed. The whole closed-loop control system output is the vehicle speed. Drive operation is acceleration or deceleration.


## 4. Experiment

The proposed driving behavior model in this paper is simulated and validated through MATLAB 2017b platform. The performance of the proposed driving behavior model and several other existing driving models are also compared. The configuration of the computer is as follows: Intel i-9700 K processor with 8 cores, CPU frequency of 4 GHz, memory size of 16 G, 64 bit Windows 7 Professional operation system, and Nvidia GeForce GTX 980 graphics card.


### 4.1. The Parameters

The initial parameters of the proposed driver behavior model are shown in Table2.Table 2
The initial parameters.
No.VariableValue1Number of whale population502Iteration times1003WOA search space dimension104Initial learning rate0.15Batch size106Number of hidden layers47Number of visible layers28Training times509Number of driver behavior data200010Length of each driver behavior data30011Average velocity30 m/s12Simulation platformMATLAB 2017bIn this experiment, 100 different road sections were collected, and about 2000 drivers’ driving data were collected for each route. The driving behavior data of each driver in each route were collected at 306 points.In this paper, 70 groups are randomly selected as training samples, and the remaining 30 groups are selected as testing samples.


### 4.2. WOA Optimization Process

The optimization process of WOA is illustrated in Figure9.Figure 9
The optimization process of WOA.Figure9 shows that when the number of iterations is 9, WOA minimizes the training error of RBM deep learning neural network. The comparison of RBM parameters before and after optimization is shown in Table 3.Table 3
Simulation parameters.
No.ParameterInitial valueOptimal value1Lr10.00392v123h124a0.91340.08885b0.63250.17486W0.09750.6883The simulation results show that with the increase of the number of iterations, the training error of RBM deep learning network gradually reduces. When the number of iterations is 4, WOA minimizes the training error of RBM deep learning neural network, which is within a precision of10−4. The comparison of RBM parameters before and after optimization is shown in Table 3. After optimized by WOA, the RBM optimal learning rate Lr is 0.0039, the number of visual layers v is 2, the number of hidden layers h is 2, the optimal values of parameters a and b are 0.1748 and 0.6883, respectively, and the optimal initial average of the initial network weights w is 0.088. Under these parameters, the training effect of RBM can obtain the optimal result.


### 4.3. The Performance of Driver Behavior Model

The information of the road is already shown in Figure4. The actual driving behavior and the driving behavior predicted by the driver behavior model are simulated in Figure 10.Figure 10
WOA-RBM-based driver behavior model prediction.
(a)(b)(c)(d)(e)(f)Figure10 shows that the six drivers’ behaviors from the output of the WOA-RBM-based driver behavior model are consistent with the actual driving behavior. Therefore, the driving behavior model proposed in this paper exhibits high prediction accuracy.Furthermore, the standard error of estimate (SEE) is used to evaluate the proposed models by more driving behaviors, which is defined as(17)SEEi=∑n=1Ndatactuali,n−datWOA−RBMi,n2N,where datactuali,n are the actual driver behavior data, i.e., the vehicle speeds from the i−th driver at the n−th sampled point, and datWOA−RBMi,s are the predicted driver behavior data from the i−th driver at the n−th sampled point.The simulation result of SEE is shown in Figure11.Figure 11
Simulation of SEE.Figure11 shows that the SEE of the driving data and the actual data is obtained by the WOA-RBM model. The simulation results show that the SEE of more than 2000 different drivers is lower than one. Therefore, the driver behavior model based on WOA-RBM can correctly simulate the behavior of the driver.Through training the 100 driving operation data in different routes, a high level of prediction accuracy is obtained. The corresponding test structure is shown in Figure12:Figure 12
The different routes of SEE.From the results of simulation, it can be seen that for 100 different routes, the driving behavior prediction algorithm proposed in this paper can be obtained with lower SEE. Compared with the simulation results in Figure13, for different routes, the SEE of the driving behavior prediction algorithm proposed in this paper is always close to 0.2. It shows that the accuracy of the algorithm is high.Figure 13
SEE of different driver behavior model predictions.Overfitting means the training error is very small, while the generalization error is very large. Because the model may be too complex, it “remembers” the training samples, but its generalization error is very high. In the algorithm proposed in this topic, the dropout mechanism is used to prevent overfitting.


### 4.4. Comparison

To evaluate the performance of the WOA-RBM-based driver behavior model, some other driver behavior models are presented for comparison and analysis, including the model based on database of personal mobility driving [36], stochastic driver pedal behavior model [16], driver behavior modeling using on-road driving data [19], and driver behavior modeling using hidden Markov model based on genetic algorithm [28]. The simulation results of the four methods are shown in Figures 14–16.Figure 14
Different driver behavior model predictions.Figure 15
Longitudinal forces on a running vehicle.Figure 16
A comparison of energy consumption.The driving behavior predicted by the driver behavior model is shown in Figure14. The simulation result indicates that the driving data obtained by the proposed WOA-RBM model are closer to the actual driving data.The SEE value of the outputs of different driving models and the real driving data is calculated according to equation (17). It can be seen that the performance of the WOA-RBM-based driving model proposed in this paper is better than that of the driving models proposed in [16, 19, 28, 36]. This is due to the fact that the WOA-RBM-based driving model proposed in this paper can obtain the optimal training parameters of RBM deep learning through WOA and can obtain a model more in line with actual driving data by learning driving training data.Figure13 shows that the SEE of the WOA-RBM model is the lowest, while the model in [28] is the largest.Figure13 shows the SEE of all the driver models. The driving data are added to verify the influence of different training data, which is shown in Table 4. Comparing the five driving models, the corresponding SEE values are calculated by equation (17) and the WOA-RBM driving behavior prediction model proposed in this paper has the highest prediction performance which has better performance than other algorithms with less training samples.Table 4
The effect of the number of training samples on the performance of the algorithm.
No. of training samplesSEEWOA-RBMRef [36]Ref [16]Ref [19]Ref [28]2000.2050.220.2520.3110.3581000.210.230.260.320.37800.2250.2640.320.3540.412500.2460.3050.3910.4150.475200.2890.3720.4450.4820.523Table5 shows the influence of different roads, including smooth road, less undulating road, and large undulating road. The simulation results show that the proposed WOA-RBM model has the best performance among all kinds of roads. Several remaining algorithms have larger prediction errors. Especially on road with large undulations, the difference becomes more and more obvious.Table 5
The effect of different roads on the performance of the algorithm.
Different roadsSEEWOA-RBMCDRef [36]Ref [16]Ref [19]Ref [28]Smooth road0.1570.1780.1830.2040.2240.315Less undulating0.2250.2450.27530.2830.3480.410Large undulating0.3100.3210.3820.4120.4500.486On the other hand, the correct and optimal driving behavior can also reduce the energy consumption of the vehicle. In our previous paper [29], the energy consumption model has been discussed. In this paper, the same energy consumption estimation method is used. The energy is calculated as the mechanical energy required for propelling the vehicle. The energy consumption of a vehicle can be estimated from its longitudinal dynamics, as illustrated in Figure 15. By Newton’s law, we have the following equation:(18)Ftrac=Mveha+Froll+Faero+Fgrade=Mveha+crollMvehgcosα+12ρairAfcdvveh2+Mvehgsinα,where Mveh is the vehicle mass, a is the vehicle acceleration, vveh is the vehicle speed, Froll is the rolling friction, Faero is the aerodynamic drag, Fgrade is the force caused by the road slope, Ftrac is the traction force generated by the powertrain, g is the gravity acceleration, α is the road grade angle in radiant, croll is the rolling friction coefficient, ρair is the density of the ambient air, cd is the air resistance coefficient, and Af is the frontal area of the vehicle. Figure 16 compares the performance of energy consumption.The correct and optimal driving behavior can also reduce the energy consumption of vehicle. Figure16 shows that the proposed WOA-RBM-based driver behavior model has lower energy consumption than other four models.When operating a motor vehicle, providing the proper driving operation is essential, as it will reduce energy consumption. This means that frequent acceleration and braking is an improper driving method and will increase energy consumption.


## 4.1. The Parameters

The initial parameters of the proposed driver behavior model are shown in Table2.Table 2
The initial parameters.
No.VariableValue1Number of whale population502Iteration times1003WOA search space dimension104Initial learning rate0.15Batch size106Number of hidden layers47Number of visible layers28Training times509Number of driver behavior data200010Length of each driver behavior data30011Average velocity30 m/s12Simulation platformMATLAB 2017bIn this experiment, 100 different road sections were collected, and about 2000 drivers’ driving data were collected for each route. The driving behavior data of each driver in each route were collected at 306 points.In this paper, 70 groups are randomly selected as training samples, and the remaining 30 groups are selected as testing samples.


## 4.2. WOA Optimization Process

The optimization process of WOA is illustrated in Figure9.Figure 9
The optimization process of WOA.Figure9 shows that when the number of iterations is 9, WOA minimizes the training error of RBM deep learning neural network. The comparison of RBM parameters before and after optimization is shown in Table 3.Table 3
Simulation parameters.
No.ParameterInitial valueOptimal value1Lr10.00392v123h124a0.91340.08885b0.63250.17486W0.09750.6883The simulation results show that with the increase of the number of iterations, the training error of RBM deep learning network gradually reduces. When the number of iterations is 4, WOA minimizes the training error of RBM deep learning neural network, which is within a precision of10−4. The comparison of RBM parameters before and after optimization is shown in Table 3. After optimized by WOA, the RBM optimal learning rate Lr is 0.0039, the number of visual layers v is 2, the number of hidden layers h is 2, the optimal values of parameters a and b are 0.1748 and 0.6883, respectively, and the optimal initial average of the initial network weights w is 0.088. Under these parameters, the training effect of RBM can obtain the optimal result.


## 4.3. The Performance of Driver Behavior Model

The information of the road is already shown in Figure4. The actual driving behavior and the driving behavior predicted by the driver behavior model are simulated in Figure 10.Figure 10
WOA-RBM-based driver behavior model prediction.
(a)(b)(c)(d)(e)(f)Figure10 shows that the six drivers’ behaviors from the output of the WOA-RBM-based driver behavior model are consistent with the actual driving behavior. Therefore, the driving behavior model proposed in this paper exhibits high prediction accuracy.Furthermore, the standard error of estimate (SEE) is used to evaluate the proposed models by more driving behaviors, which is defined as(17)SEEi=∑n=1Ndatactuali,n−datWOA−RBMi,n2N,where datactuali,n are the actual driver behavior data, i.e., the vehicle speeds from the i−th driver at the n−th sampled point, and datWOA−RBMi,s are the predicted driver behavior data from the i−th driver at the n−th sampled point.The simulation result of SEE is shown in Figure11.Figure 11
Simulation of SEE.Figure11 shows that the SEE of the driving data and the actual data is obtained by the WOA-RBM model. The simulation results show that the SEE of more than 2000 different drivers is lower than one. Therefore, the driver behavior model based on WOA-RBM can correctly simulate the behavior of the driver.Through training the 100 driving operation data in different routes, a high level of prediction accuracy is obtained. The corresponding test structure is shown in Figure12:Figure 12
The different routes of SEE.From the results of simulation, it can be seen that for 100 different routes, the driving behavior prediction algorithm proposed in this paper can be obtained with lower SEE. Compared with the simulation results in Figure13, for different routes, the SEE of the driving behavior prediction algorithm proposed in this paper is always close to 0.2. It shows that the accuracy of the algorithm is high.Figure 13
SEE of different driver behavior model predictions.Overfitting means the training error is very small, while the generalization error is very large. Because the model may be too complex, it “remembers” the training samples, but its generalization error is very high. In the algorithm proposed in this topic, the dropout mechanism is used to prevent overfitting.


## 4.4. Comparison

To evaluate the performance of the WOA-RBM-based driver behavior model, some other driver behavior models are presented for comparison and analysis, including the model based on database of personal mobility driving [36], stochastic driver pedal behavior model [16], driver behavior modeling using on-road driving data [19], and driver behavior modeling using hidden Markov model based on genetic algorithm [28]. The simulation results of the four methods are shown in Figures 14–16.Figure 14
Different driver behavior model predictions.Figure 15
Longitudinal forces on a running vehicle.Figure 16
A comparison of energy consumption.The driving behavior predicted by the driver behavior model is shown in Figure14. The simulation result indicates that the driving data obtained by the proposed WOA-RBM model are closer to the actual driving data.The SEE value of the outputs of different driving models and the real driving data is calculated according to equation (17). It can be seen that the performance of the WOA-RBM-based driving model proposed in this paper is better than that of the driving models proposed in [16, 19, 28, 36]. This is due to the fact that the WOA-RBM-based driving model proposed in this paper can obtain the optimal training parameters of RBM deep learning through WOA and can obtain a model more in line with actual driving data by learning driving training data.Figure13 shows that the SEE of the WOA-RBM model is the lowest, while the model in [28] is the largest.Figure13 shows the SEE of all the driver models. The driving data are added to verify the influence of different training data, which is shown in Table 4. Comparing the five driving models, the corresponding SEE values are calculated by equation (17) and the WOA-RBM driving behavior prediction model proposed in this paper has the highest prediction performance which has better performance than other algorithms with less training samples.Table 4
The effect of the number of training samples on the performance of the algorithm.
No. of training samplesSEEWOA-RBMRef [36]Ref [16]Ref [19]Ref [28]2000.2050.220.2520.3110.3581000.210.230.260.320.37800.2250.2640.320.3540.412500.2460.3050.3910.4150.475200.2890.3720.4450.4820.523Table5 shows the influence of different roads, including smooth road, less undulating road, and large undulating road. The simulation results show that the proposed WOA-RBM model has the best performance among all kinds of roads. Several remaining algorithms have larger prediction errors. Especially on road with large undulations, the difference becomes more and more obvious.Table 5
The effect of different roads on the performance of the algorithm.
Different roadsSEEWOA-RBMCDRef [36]Ref [16]Ref [19]Ref [28]Smooth road0.1570.1780.1830.2040.2240.315Less undulating0.2250.2450.27530.2830.3480.410Large undulating0.3100.3210.3820.4120.4500.486On the other hand, the correct and optimal driving behavior can also reduce the energy consumption of the vehicle. In our previous paper [29], the energy consumption model has been discussed. In this paper, the same energy consumption estimation method is used. The energy is calculated as the mechanical energy required for propelling the vehicle. The energy consumption of a vehicle can be estimated from its longitudinal dynamics, as illustrated in Figure 15. By Newton’s law, we have the following equation:(18)Ftrac=Mveha+Froll+Faero+Fgrade=Mveha+crollMvehgcosα+12ρairAfcdvveh2+Mvehgsinα,where Mveh is the vehicle mass, a is the vehicle acceleration, vveh is the vehicle speed, Froll is the rolling friction, Faero is the aerodynamic drag, Fgrade is the force caused by the road slope, Ftrac is the traction force generated by the powertrain, g is the gravity acceleration, α is the road grade angle in radiant, croll is the rolling friction coefficient, ρair is the density of the ambient air, cd is the air resistance coefficient, and Af is the frontal area of the vehicle. Figure 16 compares the performance of energy consumption.The correct and optimal driving behavior can also reduce the energy consumption of vehicle. Figure16 shows that the proposed WOA-RBM-based driver behavior model has lower energy consumption than other four models.When operating a motor vehicle, providing the proper driving operation is essential, as it will reduce energy consumption. This means that frequent acceleration and braking is an improper driving method and will increase energy consumption.


## 5. Conclusion

In this paper, a new algorithm of driver behavior model based on WOA-RBM deep learning network is proposed. The model establishes an objective function, which contains the training of deep learning network. The RBM after training based on optimal training parameters is used to predict the output action accurately through the road information. In the future, it is of great interest to collect huge amounts of real driving data from different roads and different drivers.



---

*Source: 8859891-2020-09-29.xml*