# DNA Optimization Threshold Autoregressive Prediction Model and Its Application in Ice Condition Time Series

Authors: Xiao-Hua Yang; Yu-Qi Li
Journal: Mathematical Problems in Engineering
 (2012)

---

## Abstract

There are many parameters which are very difficult to calibrate in the threshold autoregressive prediction model for nonlinear time series. The threshold value, autoregressive coefficients, and the delay time are key parameters in the threshold autoregressive prediction model. To improve prediction precision and reduce the uncertainties in the determination of the above parameters, a new DNA (deoxyribonucleic acid) optimization threshold autoregressive prediction model (DNAOTARPM) is proposed by combining threshold autoregressive method and DNA optimization method. The above optimal parameters are selected by minimizing objective function. Real ice condition time series at Bohai are taken to validate the new method. The prediction results indicate that the new method can choose the above optimal parameters in prediction process. Compared with improved genetic algorithm threshold autoregressive prediction model (IGATARPM) and standard genetic algorithm threshold autoregressive prediction model (SGATARPM), DNAOTARPM has higher precision and faster convergence speed for predicting nonlinear ice condition time series.


---

## Body

## 1. Introduction

Many natural phenomena, such as ice condition, runoff, are usually nonlinear, complex, and dynamic processes. Prediction of ice conditions is of primary importance for weather forecasting, agriculture, geosciences, and marine transportation safety. The simulation of the nonlinear time series was very difficult with the traditional deterministic mathematic models, which cause new challenges to calibrate the parameters [1, 2]. There are many methods for predicting nonlinear time series [3–10]. Threshold autoregressive (TAR) models are typically applied to time series data as an extension of autoregressive models for higher degree of flexibility in model parameters through a regime switching behavior. TAR models were introduced by Tong and Li in 1977 and more fully developed in the seminal paper [11]. The threshold autoregressive model is a special case of Tong’s general threshold autoregressive models. The latter allows the threshold variable to be very flexible, such as an exogenous time series in the open-loop threshold autoregressive system [11–13]. For a comprehensive review of developments over the 30 years since the birth of the model, see Tong [14]. However, the uncertainties in determining the parameters of the threshold variables, autoregressive coefficients, and the delay time exist in the developed threshold autoregressive model. So as to improve the prediction accuracy, the key problem is how to determine the parameters in the prediction model.The global optimization in determining all the parameters is intractable mathematically. Once an objective function has many local extreme points, the traditional optimization methods may not obtain the global optimal solution. A genetic algorithm (GA) based on the genetic evolution of a species was proposed by Holland [15]. GA is a global optimization algorithm. However, the computational amount is very large and premature convergence phenomena exist in GA [16–20]. Recently, Adleman [21] showed that DNA can be used to solve a computationally hard problem. Many scientists used DNA computation to solve real problems [22–24].In this study, DNA optimization threshold autoregressive prediction model (DNAOTARPM) is presented to determine the parameters and to improve the calculation precision for predicting ice condition time series. In order to validate the new method, some real ice condition time series are used.


## 2. DNA Optimization Threshold Autoregressive Prediction Model (DNAOTARPM)

The TAR model is a tool for predicting future values in time series assuming that the behavior of the time series changes once the time series shifts to a different regime. The switch from one regime to another depends on thep past values of the x series. The model consists of k autoregressive (AR) parts for each different regime. The model is usually referred to as the TAR (k, p) model where k is the number of regimes and p is the order of the autoregressive part. Since those can differ between regimes, the p portion is sometimes dropped and models are denoted simply as TAR (k). A k-regime TAR (d;p1,p2,…,pk) model for time series x(i) (i=1,2,…,n) has the form(2.1)x(i)=b(j,0)+∑l=1pjb(j,l)x(i-l)+e(j,i),x(i-d)∈(r(j-1),r(j)],(j=1,2,…,k),
where r(0)=-∞, r(k)=+∞, r(j) (j=1,2,…,k-1) are k-1 nontrivial threshold parameters dividing the domain into k different regimes; d is the delay time parameters, b(j,l) is the regressive coefficients in the jth regime, e(j,i) stands for white-noise error term with constant variance, and pj is the autoregressive order in the jth regime of the model. The threshold parameters satisfy the constraint:(2.2)-∞=r(0)<r(1)<r(2)<⋯<r(k-1)<r(k)=+∞.Hered,k,r(1),r(2),…,r(k-1),p1,p2,…,pk, and b(j,l) are parameters in TAR model. It is very difficult to determine these parameters with the traditional methods.In this paper, we use DNA optimization method to determine the parameters and improve model accuracy. The new model, DNA optimization threshold autoregressive prediction method (DNAOTARPM), is described as follows.Step 1 (Determine the delay timed and the number of regressive coefficients).
The delay timed is determined by the autocorrelation function method [21]. The autocorrelation function R(j) for delay time j is calculated as
(2.3)R(j)=∑i=j+1n(x(i)-mx)(x(i-j)-mx)∑i=1n(x(i)-mx)2,mx=∑i=1nx(i)n.
The delay time d is selected when autocorrelation function R(j) [25] satisfies the following condition:
(2.4)R(j)∉[R1(j),R2(j)],(2.5)R1(j)=-1-uα/2⋅(n-j-1)0.5n-j,R2(j)=-1+uα/2⋅(n-j-1)0.5n-j,
where uα/2 is the upper 100·(α/2) percentage point of the normal distribution for 1-α confidence level. The number of regressive coefficients pl≤max(j),l=1,2,…,k. Some of the j values are regarded as the delay time.Step 2 (Determine the number and ranges of threshold parameters).
Considering a set{(x(i),x(i-d))|i=1,2,3,…;d=1,2,…} from the time series (i)(i=1,2,…,n), we divide x(i-d) into s regimes (s>k). Suppose there are Nj number of x(i-d) in the jth part, and the corresponding x(i) is regarded as x(i,j). In the jth part, the conditional expectation of x(i) given the event X=x(i-d) is
(2.6)E(x(i)x(i-d))j=∑i=1Njx(i,j)Nj,(j=1,2,…,s;d=1,2,…).
Let x(i-d) be horizontal axis, and let E(x(i)/x(i-d)) be vertical axis; we can get the scatter plots. When the scatter plots are piecewise linear map, we can estimate the number and ranges of threshold parameters. The piecewise number of piecewise linear map is the number of threshold parameters, and the ranges of the piecewise points are the ranges of threshold parameters.Step 3 (Construct the objective function).
The parameter estimation for DNAOTARPM can be obtained by the following objective function, namely, the mean of least residual absolute value sum:(2.7)Min⁡f=f(r(1),r(2),…,r(k-1);b(j,l))=∑i|(x(i)-x′(i))|n.Step 4 (Solve objective function by DNA optimization method).
Solving the parameters ofr(1),r(2),…,r(k-1);b(j,l),(j=1,2,…,k;l=1,2,…,pj), in the optimization objective function (2.7) is one nonlinear optimization problem. It is rather difficult to deal with it using a traditional optimization method. The above optimal model can be solved by the following DNA optimization method [24]. The k-regime prediction formula will be seen in the following application part in detail.If we solve objective function (2.7) with improved genetic algorithm, we call the method improved genetic algorithm [18] threshold autoregressive prediction method (IGATARPM), and if we solve objective function (2.7) with standard genetic optimization method [15], we call the method standard genetic algorithm threshold autoregressive prediction method (SGATARPM).


## 3. DNA Optimization Method (DNAOM)

Consider the following optimization problem:(3.1)Min⁡f(c1,c2,…,cp)st.aj≤cj≤bjforj=1,2,…,p,
where c={cj,j=1,2,…,p}, cj is a parameter to be optimized,  f is an objective function, and f≥0, [aj,bj] is the range of cj.The procedure of DNAOM is shown as follows [25].Step 1 (DNA encoding).
Suppose DNA-encoding length ism in every parameter, the jth parameter range is the interval [aj,bj], and then each interval is divided into 2m-1 subintervals:
(3.2)cj=aj+θj⋅(2m-1)⋅hj,
where the length of subinterval of the jth parameter hj=(bj-aj)/(2m-1) is constant. The searching location Ij=θj·(2m-1) is an integer, and 0≤Ij<2m, θj is a random variable, and 0≤θj≤1, for j=1,2,…,p.
The DNA code array of thejth parameter is denoted by the grid points of {d(j,k)|k=1,2,…,m} for every individual:
(3.3)Ij=∑k=1md(j,k)⋅2k-1.
DNAOM’s process operates on a population of individuals (also called DNA code array, strings, or chromosomes). Each individual represents a potential solution to the problem. For corresponding 1×1→T,1×0→A,0×1→G,0×0→C. The first position value “1” or “0” expresses the position of DNA code and the second position value “1” or “0” expresses the true value of binary code and the value of DNA code.Step 2 (creating the initial population).
To cover the whole solution space and to avoid individuals entering into the same region, large uniformity random population is selected in this algorithm. Once the initial father population has been generated, the decoding and fitness evaluation should be done.Step 3 (evaluating fitness value of each individual).
The smaller the valuef(i) is, the higher the fitness of its corresponding ith chromosome is (i=1,2,…,N). So the fitness function of ith chromosome is defined as follows:
(3.4)F(i)=1[f(i)]2+1.0.Step 4 (selection).
Select chromosome pairs randomly depending on their fitness value from the initial population. Two groups ofN-chromosomes d1(j,k,i) and d2(j,k,i), are gotten (j=1,2,…,p;k=1,2,…,m;i=1,2,…,N).Step 5 (two-point crossover and two-point mutation).
Perform crossover and mutation on chromosomes the same as GA.Step 6 (DNA evolution).
Repeat Steps3–6 until the evolution times q=Q (Q is the total evolution times) or the termination condition is satisfied.Step 7 (accelerating cycle).
The parameter ranges ofne-excellent individuals obtained by Q-times of the DNA-encoded optimal evolution alternating are regarded as the new ranges of the parameters, and then the whole process is back to the DNA-encoding. The DNAOM computation is over until the algorithm running times reaches the designed T times or there exists an optimal chromosome Cfit whose fitness satisfies a given criterion. In the former case the Cfit is the fittest chromosome or the most excellent chromosome in the population. That is, the chromosome Cfit represents the solution [25].The parameters of the DNAOM are selected as follows. The lengthm=10, population size N=100, the number of excellent individuals ne=10, the times of evolution alternating Q=3, the crossover probability pc=1.0, and the mutation probability pm=0.5.


## 4. Application in Ice Condition Time Series

The real ice condition time series in this study are chosen as the annual ice condition at Bohai in China for the period of 1966 to 1994 (29 years) [25]. For the ice condition time series, the first modeling data set is the data during the period of 1966 to 1993 (28 years). The prediction lead time is the year of 1970–1994 (25 years).


### 4.1. The Autocorrelation FunctionR(j) for Delay Time j

The changes of the autocorrelation functions for the time series are presented at the confidence level 70% in Figure1.Figure 1
The autocorrelation function figure for the observed time series.From Figure1, we can see that only the values of R(1), R(3), R(4) satisfy condition (2.4). So the delay time d is 1, 3, or 4 in DNAOTARPM.


### 4.2. The Number and Ranges of Threshold Parameters

The number and ranges of threshold parameters of the above ice condition time series are determined by the conditional expectation ofx(i) given the event X=x(i-d). The scatter plot of the conditional expectation is shown in Figure 2.The scatter plot of the conditional expectation: (a)E(x(i)/x(i-1)): x(i-1); (b) E(x(i)/x(i-3)): x(i-3); (c) E(x(i)/x(i-4)): x(i-4).
(a)
d=1(b)
d=3(c)
d=4From Figure2, we can see that there are two piecewise linear maps, and the piecewise point is around the mean value of the time series. So we suppose y(i)=x(i)-meanvalue, and the k-regime TAR(d;p1,p2,…,pk) model has the following form for d=1,3,4:(4.1)y′(i)={b(1,1)y(i-1)+b(1,3)y(i-3)+b(1,4)y(i-4),y(i-d)≤r(1),b(2,1)y(i-1)+b(2,3)y(i-3)+b(2,4)y(i-4),y(i-d)>r(1),x′(i)=y′(i)+meanvalue.The parameters ofr(1),b(j,l)(j=1,2;l=1,3,4) are required in this model. In this work, the three parameters are estimated with respect to one criterion, namely, the mean of least residual absolute value sum shown in (2.6).


### 4.3. Result Comparison between DNAOTARPM, IGATARPM, and SGATARPM

The time series were predicted by DNAOTARPM, IGATARPM, and SGATARPM, respectively.Mean least residual absolute value sumf is 0.5737 for DNAOTARPM. The evaluation number of the objective function is 900. The computational results of the above model are given in Table 1.Table 1
The comparison of the prediction results for DNAOTARPM, IGATARPM, and SGATARPM at Bohai.
MethodsParametersObjective functionminimum fr(1)b(1,1)b(1,3)b(1,4)b(2,1)b(2,3)b(2,4)[−1.0,1.0][−0.5,0.5][−0.5,0.5][−0.5,0.5][−0.5,0.5][−0.5,0.5][−0.5,0.5]DNAO-TARPM−0.020.340.24−0.360.130.39−0.460.5737IGA-TARPM−0.750.120.40−0.200.200.28−0.440.6016SGA-TARPM0.900.260.33−0.50−0.06−0.350.360.6380For IGATARPM, the evaluation number of the objective function is 2700, and the prediction errorf is 0.6016.For SGATARPM, the evaluation number of the objective function is 2700, and the prediction errorf is 0.6380.From Table1, we can see that prediction results for DNAOTARPM are better than those with the other methods. The prediction results of the practical example are shown in Figure 3 with different methods.Figure 3
Comparison of prediction results with DNAOTARPM, IGATARPM, and SGATARPM at Bohai.From Table1 and Figure 3, we can see that the results achieved with our DNAOTARPM method are satisfactory in global optimum and prediction precision.Compared with IGATARPM and SGATARPM, DNAOTARPM has a faster convergence speed and higher precision. And it is useful for parameter optimization of the nonlinear ice condition time series model.


## 4.1. The Autocorrelation FunctionR(j) for Delay Time j

The changes of the autocorrelation functions for the time series are presented at the confidence level 70% in Figure1.Figure 1
The autocorrelation function figure for the observed time series.From Figure1, we can see that only the values of R(1), R(3), R(4) satisfy condition (2.4). So the delay time d is 1, 3, or 4 in DNAOTARPM.


## 4.2. The Number and Ranges of Threshold Parameters

The number and ranges of threshold parameters of the above ice condition time series are determined by the conditional expectation ofx(i) given the event X=x(i-d). The scatter plot of the conditional expectation is shown in Figure 2.The scatter plot of the conditional expectation: (a)E(x(i)/x(i-1)): x(i-1); (b) E(x(i)/x(i-3)): x(i-3); (c) E(x(i)/x(i-4)): x(i-4).
(a)
d=1(b)
d=3(c)
d=4From Figure2, we can see that there are two piecewise linear maps, and the piecewise point is around the mean value of the time series. So we suppose y(i)=x(i)-meanvalue, and the k-regime TAR(d;p1,p2,…,pk) model has the following form for d=1,3,4:(4.1)y′(i)={b(1,1)y(i-1)+b(1,3)y(i-3)+b(1,4)y(i-4),y(i-d)≤r(1),b(2,1)y(i-1)+b(2,3)y(i-3)+b(2,4)y(i-4),y(i-d)>r(1),x′(i)=y′(i)+meanvalue.The parameters ofr(1),b(j,l)(j=1,2;l=1,3,4) are required in this model. In this work, the three parameters are estimated with respect to one criterion, namely, the mean of least residual absolute value sum shown in (2.6).


## 4.3. Result Comparison between DNAOTARPM, IGATARPM, and SGATARPM

The time series were predicted by DNAOTARPM, IGATARPM, and SGATARPM, respectively.Mean least residual absolute value sumf is 0.5737 for DNAOTARPM. The evaluation number of the objective function is 900. The computational results of the above model are given in Table 1.Table 1
The comparison of the prediction results for DNAOTARPM, IGATARPM, and SGATARPM at Bohai.
MethodsParametersObjective functionminimum fr(1)b(1,1)b(1,3)b(1,4)b(2,1)b(2,3)b(2,4)[−1.0,1.0][−0.5,0.5][−0.5,0.5][−0.5,0.5][−0.5,0.5][−0.5,0.5][−0.5,0.5]DNAO-TARPM−0.020.340.24−0.360.130.39−0.460.5737IGA-TARPM−0.750.120.40−0.200.200.28−0.440.6016SGA-TARPM0.900.260.33−0.50−0.06−0.350.360.6380For IGATARPM, the evaluation number of the objective function is 2700, and the prediction errorf is 0.6016.For SGATARPM, the evaluation number of the objective function is 2700, and the prediction errorf is 0.6380.From Table1, we can see that prediction results for DNAOTARPM are better than those with the other methods. The prediction results of the practical example are shown in Figure 3 with different methods.Figure 3
Comparison of prediction results with DNAOTARPM, IGATARPM, and SGATARPM at Bohai.From Table1 and Figure 3, we can see that the results achieved with our DNAOTARPM method are satisfactory in global optimum and prediction precision.Compared with IGATARPM and SGATARPM, DNAOTARPM has a faster convergence speed and higher precision. And it is useful for parameter optimization of the nonlinear ice condition time series model.


## 5. Conclusions

In order to improve prediction precision and reduce the uncertainties in determination of the parameters for forecasting nonlinear ice condition time series, a new DNA optimization threshold autoregressive prediction model (DNAOTARPM) is proposed in this paper. The ice condition time series at Bohai in China are studied by using DNAOTARPM. The main conclusions are given as follows.(1)
DNAOTARPM is established by using DNA optimization method and threshold autoregressive model. The delay timed is selected with autocorrelation function, and the results indicate x(i-1),x(i-3),x(i-4) have significant influence on the ice condition time series (α=0.30) at Bohai.(2)
DNA optimization method is proposed for optimizing all parameters in DNAOTARPM model. The optimal parameters, that is, the threshold value, autoregressive coefficients, and the delay time, are obtained for predicting the ice condition time series at Bohai by using DNA optimization method.(3)
The prediction errors are 0.5737, 0.6016, and 0.6380 with DNAOTARPM, IGATARPM, and SGATARPM at Bohai, respectively. DNAOTARPM can reduce the calculation errors. It provides a new way to forecast nonlinear ice condition time series.(4)
The evaluation number of the objective function is 900, 2700, and 2700 with DNAOTARPM, IGATARPM, and SGATARPM at Bohai, respectively. Compared with IGATARPM and SGATARPM, DNAOTARPM model has a faster convergence speed. The new model (DNAOTARPM) can be used in predicting other nonlinear systems in the future and its theory will be further studied.



---

*Source: 191902-2011-12-21.xml*