# Vessel Track Prediction Based on Fractional Gradient Recurrent Neural Network with Maneuvering Behavior Identification

Authors: Han Xue; Tian Chai
Journal: Scientific Programming
 (2021)

---

## Abstract

To improve the accuracy of ship track prediction, a fractional-order gradient descent method is adopted into a recurrent neural network (RNN). The convergence of the proposed algorithm is proved. Identification of ship maneuvering behavior, atmospheric information, and oceanographic information is considered in vessel tack prediction. The ship track of Xiamen Port is predicted using the new algorithm. Error analysis is made with different factional orders and traffic busy degrees. Results show that the testing and training error differs with different fractional orders. The predicted track results can not only improve the efficiency of marine traffic management but also prevent and warn the safety accidents, so as to avoid accidents.


---

## Body

## 1. Introduction

Ship trajectory prediction is to predict the ship's future navigation position by analyzing the history and current trajectory law of the target ship under the premise of considering the external environment around the target ship and the performance of the ship’s own equipment. Ship track prediction uses the current navigation state of the ship, combined with the operation of the pilot, the surrounding environment information and the ship’s maneuverability, and other constraints to predict the future position of the ship. This is a basic technology of marine traffic management and a necessary condition to realize the automation and intelligence of marine traffic management. The predicted track results can not only improve the efficiency of marine traffic management but also prevent and warn the safety accidents, so as to avoid accidents.A long short-term memory network (LSTM) deep learning model was proposed [1]. Vessel trajectory prediction using historical AIS data was presented [2]. Gaussian process model was studied [3].The research of ship track prediction adopts a variety of advanced artificial intelligence optimization algorithms, such as neural network. In 1990, the first fully connected recurrent neural network (RNN), namely, Elman network, was proposed [4]. In 1997, a bidirectional RNN with deep structure was proposed [5]. In 1997, LSTM was proposed [6]. However, due to the problems of gradient vanishing and gradient exploding, RNN training is very difficult and its application is very limited. An adaptive optics prediction algorithm based on LSTM was proposed [7]. An adaptive PSO optimized LSTM network was proposed [8]. A modified atom search optimization-based deep RNN was proposed for epileptic seizure prediction [9].However, gradient descent sometimes has some disadvantages, such as fluctuation. Therefore, its improvement such as the introduction of fractional-order calculus is needed. The variable-order fractional discrete-time neural network was proposed [10]. A fractional-order complex-valued RNN was designed [11]. A fractional-order memristive RNN was proposed [12].In the intelligent maritime traffic system, some research achievements have been made. A ship trajectory and navigation state prediction method based on AIS data was proposed, with properly designed learning, motion modelling, and knowledge base-assisted particle filtering processes [13]. A density-based clustering and bidirectional long short-term memory- (BLSTM-) based supervised learning were proposed for vessel trajectory reconstruction [14]. Douglas Peucker (DP) and kernel density estimation (KDE) algorithms were used for the compression and visualization of large ship trajectory and the acceleration of GPU [15]. A continuous berth scheduling problem was solved with the objective of minimizing the total operating cost [16].However, due to the problems of gradient vanishing and gradient exploding, RNN training is sometimes very difficult. This paper adopts fractional order. The influence of fractional order and learning rate on the algorithm performance is analyzed. The main contributions of this paper are as follows:(1)
Fractional-order calculus is applied to gradient descent for training recurrent neural network(2)
The convergence of fractional gradient recurrent neural network is proved(3)
Identification of ship maneuvering behavior, atmospheric information, and oceanographic information is considered in vessel tack predictionThe remainder of this paper can be divided into the following four parts. Section2 mainly proposes the related work. The vessel track prediction based on fractional gradient recurrent neural network is then presented in Section 3. Extensive experiments are carried out in Section 4. We end this work by summing up the main contributions in Section 5.


## 2. Related Work

### 2.1. Identification of Ship Maneuvering Behavior

There are three types of ship maneuvering: keeping current course, changing course, and changing speed. Sample three points.Pi is the i-th trajectory point in the trajectory. The time interval between the adjacent points Pi−1 and Pi+1 is Δt. Vi is the velocity from Pi to Pi−1. Vi+1 is the vector velocity from Pi to Pi+1:(1)Vi=PiPi−1Δt,(2)Vi+1=PiPi+1Δt.C represents the course of the ship and V is the speed of the ship. as is the ship speed change rate and ac is the course change rate:(3)as=ΔvΔt=Vi+1−ViΔt,(4)ac=Ci+1−CiΔt.Four threshold parameters are set to divide the ship maneuvering behavior mode:(5)Threshold=aWeak,aSharp,aAcceleration,VZero,where aWeak is weak yaw with changing course, aSharp is the strong yaw with changing course, VZero is the speed threshold of berthing, and aAcceleration is the variable speed threshold.The identification model of ship maneuvering mode is set according to different kinematic constraints. The identification rules are as follows:(a)
IfVi<VZero and Vi+1<VZero, Pi belongs to staying(b)
Ifas<0 and as>aAcceleration, Pi belongs to deceleration navigation behavior(c)
Ifas>0 and as>aAcceleration, Pi is considered to be accelerated(d)
WhenVi>VZero, Vi+1>VZero, as<aAcceleration, and ac<aWeak, Pi belongs to keeping direction and speed(e)
Ifac<0 and aWeak<ac<aSharp, Pi belongs to weak yaw with left rudder(f)
Ifac>0 and aWeak<ac<aSharp, Pi belongs to weak yaw with right rudder(g)
Ifac<0 and ac>aSharp, Pi belongs to strong yaw with left rudder(h)
Ifac>0 and ac>aSharp, Pi belongs to strong yaw with right rudder


### 2.2. Recurrent Neural Network

RNN establishes weighted connections between neurons in layers. With the continuous progress of the sequence, the former hidden layer will affect the later hidden layer.o represents the output. y represents the value given by the neurons, and L represents the loss function. x is the input vector. w denotes the weight of the neural network. The loss function is accumulated with sequence. Since the weights are shared in RNN, weights in RNN are the same.The error is defined as follows:(6)et=ot−yt.The loss function is defined as follows:(7)Lt=12∑k=1mek2t.Denote(8)Δwt=wt+1−wt,(9)vkt=∑j=1mwkjtyt.


### 2.3. Fractional-Order Calculus

The Riemann–Liouville definition of fractional calculus is as follows.Definition 1.
For the absolute integrable functionxt in the interval t0,t, its Riemann–Liouville integral is as follows:(10)t0Dtαxt=1Γα∫t0tt−τα−1xτdτ,where α is the fractional order, whose real part is positive.Γx is the gamma function defined as follows:(11)Γx=∫0∞e−ttx−1dt.Definition 2.
For the absolute integrable functionxt in the interval t0,t, its Riemann–Liouville differential is defined as follows:(12)t0Dtαxt=dmdtn1Γm−α∫t0tt−τm−α−1xτdτ,where α∈m−1,m.m is a positive integer.Definition 3.
Forfx=x−x0v, the following formula holds:(13)x0Dxpfx=Γv+1Γv−p+1x−x0v−p.


### 2.4. Vessel Track Prediction Based on Neural Network

The neural network model is used to learn the current navigation conditions and the driving habits of the ship drivers. The navigation state of the next moment is predicted by the historical speed, course, and meteorological and hydrological information. Thus, the navigation state of the ship in the future is predicted by recursive iteration.The position of the ship at the next moment is predicted by the longitude and latitude, speed, course of the ship, and the interference of the current marine environment at the last moment. Take the historical dynamic navigation data and the historical sea wind and current data as the input of the neural network. Take the expected ship position as output, and the neural network is trained by comparing the difference between the real position and output position. The trained neural network can predict the position change of the ship through the dynamic data of the ship's current navigation and the interference of sea wind and current. Fractional-order training is adopted to further improve the prediction accuracy of the model.The dynamic data of ship navigation, sea wind, and current interference are as follows:(14)xt=Vs,Cs,Vw,Cw,Hw,Ht,where Vs is the speed of the ship, Cs is the course of the ship, Vw is the speed of sea wind around the ship, Cw is the direction of the wind around the ship, Hw is the height of the wave around the ship, and Ht is the height of the tidal around the ship. The number of input layer nodes is 6, and the number of output layer nodes is 2. The hidden layer is defined as one layer. Figure 1 shows the track prediction method by neural network.Figure 1
Track prediction method by neural network.


## 2.1. Identification of Ship Maneuvering Behavior

There are three types of ship maneuvering: keeping current course, changing course, and changing speed. Sample three points.Pi is the i-th trajectory point in the trajectory. The time interval between the adjacent points Pi−1 and Pi+1 is Δt. Vi is the velocity from Pi to Pi−1. Vi+1 is the vector velocity from Pi to Pi+1:(1)Vi=PiPi−1Δt,(2)Vi+1=PiPi+1Δt.C represents the course of the ship and V is the speed of the ship. as is the ship speed change rate and ac is the course change rate:(3)as=ΔvΔt=Vi+1−ViΔt,(4)ac=Ci+1−CiΔt.Four threshold parameters are set to divide the ship maneuvering behavior mode:(5)Threshold=aWeak,aSharp,aAcceleration,VZero,where aWeak is weak yaw with changing course, aSharp is the strong yaw with changing course, VZero is the speed threshold of berthing, and aAcceleration is the variable speed threshold.The identification model of ship maneuvering mode is set according to different kinematic constraints. The identification rules are as follows:(a)
IfVi<VZero and Vi+1<VZero, Pi belongs to staying(b)
Ifas<0 and as>aAcceleration, Pi belongs to deceleration navigation behavior(c)
Ifas>0 and as>aAcceleration, Pi is considered to be accelerated(d)
WhenVi>VZero, Vi+1>VZero, as<aAcceleration, and ac<aWeak, Pi belongs to keeping direction and speed(e)
Ifac<0 and aWeak<ac<aSharp, Pi belongs to weak yaw with left rudder(f)
Ifac>0 and aWeak<ac<aSharp, Pi belongs to weak yaw with right rudder(g)
Ifac<0 and ac>aSharp, Pi belongs to strong yaw with left rudder(h)
Ifac>0 and ac>aSharp, Pi belongs to strong yaw with right rudder


## 2.2. Recurrent Neural Network

RNN establishes weighted connections between neurons in layers. With the continuous progress of the sequence, the former hidden layer will affect the later hidden layer.o represents the output. y represents the value given by the neurons, and L represents the loss function. x is the input vector. w denotes the weight of the neural network. The loss function is accumulated with sequence. Since the weights are shared in RNN, weights in RNN are the same.The error is defined as follows:(6)et=ot−yt.The loss function is defined as follows:(7)Lt=12∑k=1mek2t.Denote(8)Δwt=wt+1−wt,(9)vkt=∑j=1mwkjtyt.


## 2.3. Fractional-Order Calculus

The Riemann–Liouville definition of fractional calculus is as follows.Definition 1.
For the absolute integrable functionxt in the interval t0,t, its Riemann–Liouville integral is as follows:(10)t0Dtαxt=1Γα∫t0tt−τα−1xτdτ,where α is the fractional order, whose real part is positive.Γx is the gamma function defined as follows:(11)Γx=∫0∞e−ttx−1dt.Definition 2.
For the absolute integrable functionxt in the interval t0,t, its Riemann–Liouville differential is defined as follows:(12)t0Dtαxt=dmdtn1Γm−α∫t0tt−τm−α−1xτdτ,where α∈m−1,m.m is a positive integer.Definition 3.
Forfx=x−x0v, the following formula holds:(13)x0Dxpfx=Γv+1Γv−p+1x−x0v−p.


## 2.4. Vessel Track Prediction Based on Neural Network

The neural network model is used to learn the current navigation conditions and the driving habits of the ship drivers. The navigation state of the next moment is predicted by the historical speed, course, and meteorological and hydrological information. Thus, the navigation state of the ship in the future is predicted by recursive iteration.The position of the ship at the next moment is predicted by the longitude and latitude, speed, course of the ship, and the interference of the current marine environment at the last moment. Take the historical dynamic navigation data and the historical sea wind and current data as the input of the neural network. Take the expected ship position as output, and the neural network is trained by comparing the difference between the real position and output position. The trained neural network can predict the position change of the ship through the dynamic data of the ship's current navigation and the interference of sea wind and current. Fractional-order training is adopted to further improve the prediction accuracy of the model.The dynamic data of ship navigation, sea wind, and current interference are as follows:(14)xt=Vs,Cs,Vw,Cw,Hw,Ht,where Vs is the speed of the ship, Cs is the course of the ship, Vw is the speed of sea wind around the ship, Cw is the direction of the wind around the ship, Hw is the height of the wave around the ship, and Ht is the height of the tidal around the ship. The number of input layer nodes is 6, and the number of output layer nodes is 2. The hidden layer is defined as one layer. Figure 1 shows the track prediction method by neural network.Figure 1
Track prediction method by neural network.


## 3. Main Results

### 3.1. FRNN Algorithm

The weight is updated using the gradient:(15)wkjt+1=wkjt−ηDwkjαLt.The fractional-order derivative ofLt is as follows:(16)DwkjαLt=∂Lt∂vktwkj1−αtyjtΓ2−α.The derivative ofLt is as follows:(17)∇wkjLt=∂Lt∂vkty.Substituting (16) into the first item of (15) yields(18)wkjt+1=wkjt−η∂Lt∂vktwkj1−αtyjtΓ2−α.Substituting (18) into the first item of (8) yields(19)Δwkjt=−η∂Lt∂vktwkj1−αtyjtΓ2−α.Substituting (19) into the first item of (17) yields(20)∇wkjLt=−Γ2−αηwkjα−1tΔwkjt.


### 3.2. Convergence of FRNN

Lemma 1.
The loss functionL is monotonically decreasing,(21)Lwt+1≤Lwt.Proof.
Based on the Taylor mean value theorem,(22)ΔL=Lwt+1−Lwt=L′Δwt+12L″Δwt2.
Applying (20) to (22), we have(23)ΔL<−Γ2−αηwα−1t+cΔwt2,where c>1/2L″. From (23), one can obtain that (21) will hold if the following is satisfied:(24)η≤Γ2−αwtα−1c.Lemma 2.
The set {L(t)} is convergent,(25)limt⟶∞Lwt=L∗.Proof.
From (7), we have Lwt≥0.
From Lemma1, Lwt+1≤Lwt. Therefore, there exits L∗≥0 satisfying(26)limt⟶∞Lwt=L∗.Theorem 1.
Assume (24) is valid. Then, the set DwtαLwt converges to zero,(27)limt⟶+∞DwtαLwt=0.Proof.
Denote(28)λ=Γ2−αηwα−1t−c≥0.
From (23), one can obtain(29)Lwt+1≤Lwt−Γ2−αηwα−1t−cΔwt2=Lwt−λΔwt2=Lw0−λ∑t=0kΔwt2.
SinceLwt≥0, we have(30)λ∑t=0kΔwt2≤Lw0.
Whent⟶+∞,(31)∑t=0∞Δwt2≤∞.
Thus, we have(32)limt⟶∞Δwt=0.
Substituting (15) into (8) yields(33)Δwt=−ηDwtαLt.
Substituting (33) into (32) yields(34)limt⟶∞−ηDwtαLt=0.
Thus, we have(35)limt⟶+∞DwtαLwt=0.
From Theorem1, we conclude that FRNN converges.


### 3.3. Trajectory Prediction Based on FRNN

The process of the FRNN algorithm for ship track prediction is shown as follows:Step 1: initialize the neural network modelStep 2: input training samplesStep 3: calculate the hidden layerStep 4: calculate the output layerStep 5: calculate the output errorStep 6: if the learning requirement is satisfied, turn to step 2 until the training results meet the requirementsStep 7: initialize the neural network with the optimal weightsStep 8: input data needed for prediction into the trained neural network and output prediction results


## 3.1. FRNN Algorithm

The weight is updated using the gradient:(15)wkjt+1=wkjt−ηDwkjαLt.The fractional-order derivative ofLt is as follows:(16)DwkjαLt=∂Lt∂vktwkj1−αtyjtΓ2−α.The derivative ofLt is as follows:(17)∇wkjLt=∂Lt∂vkty.Substituting (16) into the first item of (15) yields(18)wkjt+1=wkjt−η∂Lt∂vktwkj1−αtyjtΓ2−α.Substituting (18) into the first item of (8) yields(19)Δwkjt=−η∂Lt∂vktwkj1−αtyjtΓ2−α.Substituting (19) into the first item of (17) yields(20)∇wkjLt=−Γ2−αηwkjα−1tΔwkjt.


## 3.2. Convergence of FRNN

Lemma 1.
The loss functionL is monotonically decreasing,(21)Lwt+1≤Lwt.Proof.
Based on the Taylor mean value theorem,(22)ΔL=Lwt+1−Lwt=L′Δwt+12L″Δwt2.
Applying (20) to (22), we have(23)ΔL<−Γ2−αηwα−1t+cΔwt2,where c>1/2L″. From (23), one can obtain that (21) will hold if the following is satisfied:(24)η≤Γ2−αwtα−1c.Lemma 2.
The set {L(t)} is convergent,(25)limt⟶∞Lwt=L∗.Proof.
From (7), we have Lwt≥0.
From Lemma1, Lwt+1≤Lwt. Therefore, there exits L∗≥0 satisfying(26)limt⟶∞Lwt=L∗.Theorem 1.
Assume (24) is valid. Then, the set DwtαLwt converges to zero,(27)limt⟶+∞DwtαLwt=0.Proof.
Denote(28)λ=Γ2−αηwα−1t−c≥0.
From (23), one can obtain(29)Lwt+1≤Lwt−Γ2−αηwα−1t−cΔwt2=Lwt−λΔwt2=Lw0−λ∑t=0kΔwt2.
SinceLwt≥0, we have(30)λ∑t=0kΔwt2≤Lw0.
Whent⟶+∞,(31)∑t=0∞Δwt2≤∞.
Thus, we have(32)limt⟶∞Δwt=0.
Substituting (15) into (8) yields(33)Δwt=−ηDwtαLt.
Substituting (33) into (32) yields(34)limt⟶∞−ηDwtαLt=0.
Thus, we have(35)limt⟶+∞DwtαLwt=0.
From Theorem1, we conclude that FRNN converges.


## 3.3. Trajectory Prediction Based on FRNN

The process of the FRNN algorithm for ship track prediction is shown as follows:Step 1: initialize the neural network modelStep 2: input training samplesStep 3: calculate the hidden layerStep 4: calculate the output layerStep 5: calculate the output errorStep 6: if the learning requirement is satisfied, turn to step 2 until the training results meet the requirementsStep 7: initialize the neural network with the optimal weightsStep 8: input data needed for prediction into the trained neural network and output prediction results


## 4. Results and Discussion

### 4.1. Datasets

The AIS data used for prediction are the ship track data of Xiamen port. The original data should remove the wrong AIS data in the pretreatment. The records of obvious errors in AIS data include the following three types:(1)
The length of the ship’s code is not 9 digits or unreasonable record(2)
The longitude and latitude of the ship exceed the reasonable range, for example, longitude >180 or latitude >90 or negative longitude and latitude(3)
The ship’s speed and course exceed the reasonable range, for example, course >360 or speed <0


### 4.2. Maneuvering Behavior Identification

#### 4.2.1. Constant Speed Mode

Table1 lists information of MSC Bilbao ship, which belongs to constant speed mode.Table 1
Constant speed of MSC Bilbao.
LongitudeLatitudeCVHeadacas122.19833229.863167334.012.7335——122.19783529.864166334.012.733500122.19716829.865333334.012.73350.980122.19650129.8665335.012.733500122.19591929.8675335.012.733500122.19533729.8685335.012.7335——The trajectory is plotted in Figure2.Figure 2
Track of MSC Bilbao.


#### 4.2.2. Acceleration Mode

Table2 lists information of HAIYANG989 ship, which belongs to acceleration mode.Table 2
Acceleration of HAIYANG989.
LongitudeLatitudeCVHeadacas122.01500729.929411126.78.3152——122.01643929.928562120.38.3150−80122.01958829.927161112.38.31482.90.3122.0220729.926304115.28.6150−1.90122.02286829.925993113.38.6150−4.10.1122.02545629.925104109.28.7151100.5122.03040429.922681119.29.2153−4.30122.03727229.921108114.99.2149——The trajectory is plotted in Figure3.Figure 3
Track of HAIYANG989.


#### 4.2.3. Deceleration Mode

Table3 lists information of SANTA LAURA ship, which belongs to deceleration mode.Table 3
Deceleration of SANTA LAURA.
LongitudeLatitudeCVHeadacas122.19085629.8732833112.9333——122.18989529.87476733312.93333.0−0.9122.18941229.87598133412.63330.8−0.3122.18830129.878043334.812.33332.3−0.9122.18719129.880105335.5123330.9−1.2122.18617429.88207335.811.63330.3−0.2122.18567729.883038336.111.4332−0.6−0.6122.18493729.884462335.911.2332−0.3−0.3122.18469229.884932335.811.1332−1.1−0.1122.18418329.885851334.811332−3.2−0.3122.18367529.886768333.710.9332−0.9−0.6122.18315429.887667333.410.7333——The trajectory is plotted in Figure4.Figure 4
Track of SANTA LAURA.


#### 4.2.4. Turn Slightly to the Left

Table4 lists information of SOFIE MAERSK ship, which belongs to turning slightly to the left mode.Table 4
Turning slightly to the left of SOFIE MAERSK.
LongitudeLatitudeCVHeadacas122.166329.915511323.811.6318.0——122.16570629.916073319.311.5316.0−3.80.1122.16481929.916836315.511.6315.0−2.80.2122.16411929.9173685314.611.7315.0−1.70.1122.16341929.917901314.011.7315.0−1.40.1122.162719529.9184335312.611.8314.5−3.00.2122.1620229.918966311.611.8314.0−1.5−0.6122.15976629.920626311.111.6304.0——The trajectory is plotted in Figure5.Figure 5
Track of SOFIE MAERSK.


#### 4.2.5. Turn Slightly to the Right

Table5 lists information of HAIYANG989 ship, which belongs to turning slightly to the right mode.Table 5
Turning slightly to the right of HAIYANG989.
LongitudeLatitudeCVHeadacas121.99253129.948695122.77.1159.0——121.99343329.947961124.87.3159.03.90.3121.99410429.947551126.17.4159.03.60.3121.99477529.947156127.37.5160.01.60.0121.99538129.94673128.97.6160.04.70.1121.99598829.946305130.47.6161.09.30.0121.99656629.945835133.57.6161.0——The trajectory is plotted in Figure6.Figure 6
Track of HAIYANG989.


#### 4.2.6. Turn Sharply to the Left

Table6 lists information of KAPITAN AFANASYEV ship, which belongs to turning sharply to the left mode.Table 6
Turning sharply to the left of KAPITAN AFANASYEV.
LongitudeLatitudeCVHeadacas122.195929.86381342.79.8345——122.195629.86431343.29.7345−7.3−0.5122.194729.8671335.99.2327−10.5−0.6122.194529.86737332.49326−18.0−0.3122.194329.86764326.48.9325−5.60.0122.193929.86806320.88.9326——The trajectory is plotted in Figure7.Figure 7
Track of KAPITAN AFANASYEV.


#### 4.2.7. Turn Sharply to the Right

Table7 lists information of KAPITAN AFANASYEV ship, which belongs to turning sharply to the right mode.Table 7
Turning sharply to the right of KAPITAN AFANASYEV.
LongitudeLatitudeCVHeadacas122.16128729.907758122.913.9128——122.16201229.907304126.114.013324.0−0.9122.1624129.907017134.113.713530.01.2122.16267929.906807144.114.113715.30.0122.16306229.906494159.514.114020.00.0122.1633329.906264166.114.114124.0−0.6122.16375329.905811174.113.914460.00.0122.16389229.905654234.113.914422.90.5122.16436429.90506241.814.114518.00.0122.16439629.905001247.814.1145——The trajectory is plotted in Figure8.Figure 8
Track of KAPITAN AFANASYEV.


### 4.3. Prediction Results

#### 4.3.1. Results with Different Traffic Busy Degrees

Figure9 shows the ship track prediction with MMSI 413705970.Figure 9
Ship track prediction with MMSI 413705970 on December 30, 2019.Figure10 shows the longitude prediction error of the ship with MMSI 413705970 on December 30, 2019.Figure 10
Error of longitude with MMSI 413705970.Figure11 shows its prediction error of latitude with MMSI 413705970.Figure 11
Error of latitude with MMSI 413705970.Figure12 shows the ship track prediction with MMSI 412600383.Figure 12
Ship track prediction with MMSI 412600383.Figure13 shows its prediction error of longitude.Figure 13
Error of longitude with MMSI 412600383.Figure14 shows the prediction error of latitude with MMSI 412600383.Figure 14
Error of latitude with MMSI 412600383.The above figures show that the new algorithm can accurately predict the ship track.


#### 4.3.2. Results with Different Fractional Orders

The test and training accuracy with different fractional orders and batch sizes are listed in Table8. The maximal iteration is 100.Table 8
Testing and training accuracy with different fractional orders and batch sizes.
200300400αTestingTrainingTestingTrainingTestingTraining0.994.350000%95.110000%95.590000%96.000000%95.780000%96.478333%0.895.100000%95.791667%95.500000%96.326667%95.210000%96.103333%0.795.130000%95.683333%95.800000%96.305000%95.750000%96.450000%0.695.050000%95.708333%95.660000%96.345000%95.430000%96.188333%0.593.550000%94.170000%95.800000%96.385000%95.130000%96.215000%0.494.730000%95.641667%95.610000%96.343333%95.670000%96.533333%0.395.550000%96.373333%95.810000%96.668333%95.820000%96.696667%0.295.280000%96.091667%95.960000%96.720000%96.030000%96.866667%0.195.500000%96.278333%95.580000%96.416667%96.050000%96.876667%Table8 shows that the testing and training error differs with different fractional orders. The maximum training accuracy is obtained when the fractional order is 0.3. When the fractional order is 0.3, the test accuracy is the highest.The test accuracy with different fractional orders and batch sizes is shown in Figure15.Figure 15
Test accuracy.The train accuracy with different fractional orders and batch sizes is shown in Figure16.Figure 16
Train accuracy.Figure17 shows the loss function curve.Figure 17
Loss function curve.Figure18 shows the accuracy curve.Figure 18
Accuracy curve.Figure19 shows the neural network weight curve.Figure 19
Neural network weight curve.


#### 4.3.3. Comparison

The proposed algorithm is compared with RNN and FRNN without maneuvering behavior identification (MBI). The errors of longitude of the ship with MMSI 413705970 are shown in Figure20.Figure 20
Errors of longitude.The errors of latitude are shown in Figure21.Figure 21
Errors of latitude.Figures20 and 21 show that the performance of the proposed algorithms is better than that of RNN and FRNN without maneuvering behavior identification.


## 4.1. Datasets

The AIS data used for prediction are the ship track data of Xiamen port. The original data should remove the wrong AIS data in the pretreatment. The records of obvious errors in AIS data include the following three types:(1)
The length of the ship’s code is not 9 digits or unreasonable record(2)
The longitude and latitude of the ship exceed the reasonable range, for example, longitude >180 or latitude >90 or negative longitude and latitude(3)
The ship’s speed and course exceed the reasonable range, for example, course >360 or speed <0


## 4.2. Maneuvering Behavior Identification

### 4.2.1. Constant Speed Mode

Table1 lists information of MSC Bilbao ship, which belongs to constant speed mode.Table 1
Constant speed of MSC Bilbao.
LongitudeLatitudeCVHeadacas122.19833229.863167334.012.7335——122.19783529.864166334.012.733500122.19716829.865333334.012.73350.980122.19650129.8665335.012.733500122.19591929.8675335.012.733500122.19533729.8685335.012.7335——The trajectory is plotted in Figure2.Figure 2
Track of MSC Bilbao.


### 4.2.2. Acceleration Mode

Table2 lists information of HAIYANG989 ship, which belongs to acceleration mode.Table 2
Acceleration of HAIYANG989.
LongitudeLatitudeCVHeadacas122.01500729.929411126.78.3152——122.01643929.928562120.38.3150−80122.01958829.927161112.38.31482.90.3122.0220729.926304115.28.6150−1.90122.02286829.925993113.38.6150−4.10.1122.02545629.925104109.28.7151100.5122.03040429.922681119.29.2153−4.30122.03727229.921108114.99.2149——The trajectory is plotted in Figure3.Figure 3
Track of HAIYANG989.


### 4.2.3. Deceleration Mode

Table3 lists information of SANTA LAURA ship, which belongs to deceleration mode.Table 3
Deceleration of SANTA LAURA.
LongitudeLatitudeCVHeadacas122.19085629.8732833112.9333——122.18989529.87476733312.93333.0−0.9122.18941229.87598133412.63330.8−0.3122.18830129.878043334.812.33332.3−0.9122.18719129.880105335.5123330.9−1.2122.18617429.88207335.811.63330.3−0.2122.18567729.883038336.111.4332−0.6−0.6122.18493729.884462335.911.2332−0.3−0.3122.18469229.884932335.811.1332−1.1−0.1122.18418329.885851334.811332−3.2−0.3122.18367529.886768333.710.9332−0.9−0.6122.18315429.887667333.410.7333——The trajectory is plotted in Figure4.Figure 4
Track of SANTA LAURA.


### 4.2.4. Turn Slightly to the Left

Table4 lists information of SOFIE MAERSK ship, which belongs to turning slightly to the left mode.Table 4
Turning slightly to the left of SOFIE MAERSK.
LongitudeLatitudeCVHeadacas122.166329.915511323.811.6318.0——122.16570629.916073319.311.5316.0−3.80.1122.16481929.916836315.511.6315.0−2.80.2122.16411929.9173685314.611.7315.0−1.70.1122.16341929.917901314.011.7315.0−1.40.1122.162719529.9184335312.611.8314.5−3.00.2122.1620229.918966311.611.8314.0−1.5−0.6122.15976629.920626311.111.6304.0——The trajectory is plotted in Figure5.Figure 5
Track of SOFIE MAERSK.


### 4.2.5. Turn Slightly to the Right

Table5 lists information of HAIYANG989 ship, which belongs to turning slightly to the right mode.Table 5
Turning slightly to the right of HAIYANG989.
LongitudeLatitudeCVHeadacas121.99253129.948695122.77.1159.0——121.99343329.947961124.87.3159.03.90.3121.99410429.947551126.17.4159.03.60.3121.99477529.947156127.37.5160.01.60.0121.99538129.94673128.97.6160.04.70.1121.99598829.946305130.47.6161.09.30.0121.99656629.945835133.57.6161.0——The trajectory is plotted in Figure6.Figure 6
Track of HAIYANG989.


### 4.2.6. Turn Sharply to the Left

Table6 lists information of KAPITAN AFANASYEV ship, which belongs to turning sharply to the left mode.Table 6
Turning sharply to the left of KAPITAN AFANASYEV.
LongitudeLatitudeCVHeadacas122.195929.86381342.79.8345——122.195629.86431343.29.7345−7.3−0.5122.194729.8671335.99.2327−10.5−0.6122.194529.86737332.49326−18.0−0.3122.194329.86764326.48.9325−5.60.0122.193929.86806320.88.9326——The trajectory is plotted in Figure7.Figure 7
Track of KAPITAN AFANASYEV.


### 4.2.7. Turn Sharply to the Right

Table7 lists information of KAPITAN AFANASYEV ship, which belongs to turning sharply to the right mode.Table 7
Turning sharply to the right of KAPITAN AFANASYEV.
LongitudeLatitudeCVHeadacas122.16128729.907758122.913.9128——122.16201229.907304126.114.013324.0−0.9122.1624129.907017134.113.713530.01.2122.16267929.906807144.114.113715.30.0122.16306229.906494159.514.114020.00.0122.1633329.906264166.114.114124.0−0.6122.16375329.905811174.113.914460.00.0122.16389229.905654234.113.914422.90.5122.16436429.90506241.814.114518.00.0122.16439629.905001247.814.1145——The trajectory is plotted in Figure8.Figure 8
Track of KAPITAN AFANASYEV.


## 4.2.1. Constant Speed Mode

Table1 lists information of MSC Bilbao ship, which belongs to constant speed mode.Table 1
Constant speed of MSC Bilbao.
LongitudeLatitudeCVHeadacas122.19833229.863167334.012.7335——122.19783529.864166334.012.733500122.19716829.865333334.012.73350.980122.19650129.8665335.012.733500122.19591929.8675335.012.733500122.19533729.8685335.012.7335——The trajectory is plotted in Figure2.Figure 2
Track of MSC Bilbao.


## 4.2.2. Acceleration Mode

Table2 lists information of HAIYANG989 ship, which belongs to acceleration mode.Table 2
Acceleration of HAIYANG989.
LongitudeLatitudeCVHeadacas122.01500729.929411126.78.3152——122.01643929.928562120.38.3150−80122.01958829.927161112.38.31482.90.3122.0220729.926304115.28.6150−1.90122.02286829.925993113.38.6150−4.10.1122.02545629.925104109.28.7151100.5122.03040429.922681119.29.2153−4.30122.03727229.921108114.99.2149——The trajectory is plotted in Figure3.Figure 3
Track of HAIYANG989.


## 4.2.3. Deceleration Mode

Table3 lists information of SANTA LAURA ship, which belongs to deceleration mode.Table 3
Deceleration of SANTA LAURA.
LongitudeLatitudeCVHeadacas122.19085629.8732833112.9333——122.18989529.87476733312.93333.0−0.9122.18941229.87598133412.63330.8−0.3122.18830129.878043334.812.33332.3−0.9122.18719129.880105335.5123330.9−1.2122.18617429.88207335.811.63330.3−0.2122.18567729.883038336.111.4332−0.6−0.6122.18493729.884462335.911.2332−0.3−0.3122.18469229.884932335.811.1332−1.1−0.1122.18418329.885851334.811332−3.2−0.3122.18367529.886768333.710.9332−0.9−0.6122.18315429.887667333.410.7333——The trajectory is plotted in Figure4.Figure 4
Track of SANTA LAURA.


## 4.2.4. Turn Slightly to the Left

Table4 lists information of SOFIE MAERSK ship, which belongs to turning slightly to the left mode.Table 4
Turning slightly to the left of SOFIE MAERSK.
LongitudeLatitudeCVHeadacas122.166329.915511323.811.6318.0——122.16570629.916073319.311.5316.0−3.80.1122.16481929.916836315.511.6315.0−2.80.2122.16411929.9173685314.611.7315.0−1.70.1122.16341929.917901314.011.7315.0−1.40.1122.162719529.9184335312.611.8314.5−3.00.2122.1620229.918966311.611.8314.0−1.5−0.6122.15976629.920626311.111.6304.0——The trajectory is plotted in Figure5.Figure 5
Track of SOFIE MAERSK.


## 4.2.5. Turn Slightly to the Right

Table5 lists information of HAIYANG989 ship, which belongs to turning slightly to the right mode.Table 5
Turning slightly to the right of HAIYANG989.
LongitudeLatitudeCVHeadacas121.99253129.948695122.77.1159.0——121.99343329.947961124.87.3159.03.90.3121.99410429.947551126.17.4159.03.60.3121.99477529.947156127.37.5160.01.60.0121.99538129.94673128.97.6160.04.70.1121.99598829.946305130.47.6161.09.30.0121.99656629.945835133.57.6161.0——The trajectory is plotted in Figure6.Figure 6
Track of HAIYANG989.


## 4.2.6. Turn Sharply to the Left

Table6 lists information of KAPITAN AFANASYEV ship, which belongs to turning sharply to the left mode.Table 6
Turning sharply to the left of KAPITAN AFANASYEV.
LongitudeLatitudeCVHeadacas122.195929.86381342.79.8345——122.195629.86431343.29.7345−7.3−0.5122.194729.8671335.99.2327−10.5−0.6122.194529.86737332.49326−18.0−0.3122.194329.86764326.48.9325−5.60.0122.193929.86806320.88.9326——The trajectory is plotted in Figure7.Figure 7
Track of KAPITAN AFANASYEV.


## 4.2.7. Turn Sharply to the Right

Table7 lists information of KAPITAN AFANASYEV ship, which belongs to turning sharply to the right mode.Table 7
Turning sharply to the right of KAPITAN AFANASYEV.
LongitudeLatitudeCVHeadacas122.16128729.907758122.913.9128——122.16201229.907304126.114.013324.0−0.9122.1624129.907017134.113.713530.01.2122.16267929.906807144.114.113715.30.0122.16306229.906494159.514.114020.00.0122.1633329.906264166.114.114124.0−0.6122.16375329.905811174.113.914460.00.0122.16389229.905654234.113.914422.90.5122.16436429.90506241.814.114518.00.0122.16439629.905001247.814.1145——The trajectory is plotted in Figure8.Figure 8
Track of KAPITAN AFANASYEV.


## 4.3. Prediction Results

### 4.3.1. Results with Different Traffic Busy Degrees

Figure9 shows the ship track prediction with MMSI 413705970.Figure 9
Ship track prediction with MMSI 413705970 on December 30, 2019.Figure10 shows the longitude prediction error of the ship with MMSI 413705970 on December 30, 2019.Figure 10
Error of longitude with MMSI 413705970.Figure11 shows its prediction error of latitude with MMSI 413705970.Figure 11
Error of latitude with MMSI 413705970.Figure12 shows the ship track prediction with MMSI 412600383.Figure 12
Ship track prediction with MMSI 412600383.Figure13 shows its prediction error of longitude.Figure 13
Error of longitude with MMSI 412600383.Figure14 shows the prediction error of latitude with MMSI 412600383.Figure 14
Error of latitude with MMSI 412600383.The above figures show that the new algorithm can accurately predict the ship track.


### 4.3.2. Results with Different Fractional Orders

The test and training accuracy with different fractional orders and batch sizes are listed in Table8. The maximal iteration is 100.Table 8
Testing and training accuracy with different fractional orders and batch sizes.
200300400αTestingTrainingTestingTrainingTestingTraining0.994.350000%95.110000%95.590000%96.000000%95.780000%96.478333%0.895.100000%95.791667%95.500000%96.326667%95.210000%96.103333%0.795.130000%95.683333%95.800000%96.305000%95.750000%96.450000%0.695.050000%95.708333%95.660000%96.345000%95.430000%96.188333%0.593.550000%94.170000%95.800000%96.385000%95.130000%96.215000%0.494.730000%95.641667%95.610000%96.343333%95.670000%96.533333%0.395.550000%96.373333%95.810000%96.668333%95.820000%96.696667%0.295.280000%96.091667%95.960000%96.720000%96.030000%96.866667%0.195.500000%96.278333%95.580000%96.416667%96.050000%96.876667%Table8 shows that the testing and training error differs with different fractional orders. The maximum training accuracy is obtained when the fractional order is 0.3. When the fractional order is 0.3, the test accuracy is the highest.The test accuracy with different fractional orders and batch sizes is shown in Figure15.Figure 15
Test accuracy.The train accuracy with different fractional orders and batch sizes is shown in Figure16.Figure 16
Train accuracy.Figure17 shows the loss function curve.Figure 17
Loss function curve.Figure18 shows the accuracy curve.Figure 18
Accuracy curve.Figure19 shows the neural network weight curve.Figure 19
Neural network weight curve.


### 4.3.3. Comparison

The proposed algorithm is compared with RNN and FRNN without maneuvering behavior identification (MBI). The errors of longitude of the ship with MMSI 413705970 are shown in Figure20.Figure 20
Errors of longitude.The errors of latitude are shown in Figure21.Figure 21
Errors of latitude.Figures20 and 21 show that the performance of the proposed algorithms is better than that of RNN and FRNN without maneuvering behavior identification.


## 4.3.1. Results with Different Traffic Busy Degrees

Figure9 shows the ship track prediction with MMSI 413705970.Figure 9
Ship track prediction with MMSI 413705970 on December 30, 2019.Figure10 shows the longitude prediction error of the ship with MMSI 413705970 on December 30, 2019.Figure 10
Error of longitude with MMSI 413705970.Figure11 shows its prediction error of latitude with MMSI 413705970.Figure 11
Error of latitude with MMSI 413705970.Figure12 shows the ship track prediction with MMSI 412600383.Figure 12
Ship track prediction with MMSI 412600383.Figure13 shows its prediction error of longitude.Figure 13
Error of longitude with MMSI 412600383.Figure14 shows the prediction error of latitude with MMSI 412600383.Figure 14
Error of latitude with MMSI 412600383.The above figures show that the new algorithm can accurately predict the ship track.


## 4.3.2. Results with Different Fractional Orders

The test and training accuracy with different fractional orders and batch sizes are listed in Table8. The maximal iteration is 100.Table 8
Testing and training accuracy with different fractional orders and batch sizes.
200300400αTestingTrainingTestingTrainingTestingTraining0.994.350000%95.110000%95.590000%96.000000%95.780000%96.478333%0.895.100000%95.791667%95.500000%96.326667%95.210000%96.103333%0.795.130000%95.683333%95.800000%96.305000%95.750000%96.450000%0.695.050000%95.708333%95.660000%96.345000%95.430000%96.188333%0.593.550000%94.170000%95.800000%96.385000%95.130000%96.215000%0.494.730000%95.641667%95.610000%96.343333%95.670000%96.533333%0.395.550000%96.373333%95.810000%96.668333%95.820000%96.696667%0.295.280000%96.091667%95.960000%96.720000%96.030000%96.866667%0.195.500000%96.278333%95.580000%96.416667%96.050000%96.876667%Table8 shows that the testing and training error differs with different fractional orders. The maximum training accuracy is obtained when the fractional order is 0.3. When the fractional order is 0.3, the test accuracy is the highest.The test accuracy with different fractional orders and batch sizes is shown in Figure15.Figure 15
Test accuracy.The train accuracy with different fractional orders and batch sizes is shown in Figure16.Figure 16
Train accuracy.Figure17 shows the loss function curve.Figure 17
Loss function curve.Figure18 shows the accuracy curve.Figure 18
Accuracy curve.Figure19 shows the neural network weight curve.Figure 19
Neural network weight curve.


## 4.3.3. Comparison

The proposed algorithm is compared with RNN and FRNN without maneuvering behavior identification (MBI). The errors of longitude of the ship with MMSI 413705970 are shown in Figure20.Figure 20
Errors of longitude.The errors of latitude are shown in Figure21.Figure 21
Errors of latitude.Figures20 and 21 show that the performance of the proposed algorithms is better than that of RNN and FRNN without maneuvering behavior identification.


## 5. Conclusion

This paper utilizes fractional gradient descent to improve RNN. The proposed algorithm can adaptively learn the optimal weights. It complies with the literature review compared with RNN and FRNN without maneuvering behavior identification, which can improve prediction accuracy.The academic implications are applying fractional-order calculus to gradient descent for training recurrent neural network. The convergence of fractional gradient recurrent neural network is proved.The limitations of the paper are not able to predict long time track. In future studies, the input data of the track prediction model will include the dynamic information of the surrounding ships and the constraint information of the geographical environment, so as to achieve the long-term prediction of the ship's track or under some sudden or extreme conditions. The kinematic model of the ship will be considered. The influence of different time intervals on the ship's trajectory will be measured.



---

*Source: 5526082-2021-03-13.xml*