# A Hybrid Genetic Programming Method in Optimization and Forecasting: A Case Study of the Broadband Penetration in OECD Countries

Authors: Konstantinos Salpasaranis; Vasilios Stylianakis
Journal: Advances in Operations Research
 (2012)

---

## Abstract

The introduction of a hybrid genetic programming method (hGP) in fitting and forecasting of the broadband penetration data is proposed. The hGP uses some well-known diffusion models, such as those of Gompertz, Logistic, and Bass, in the initial population of the solutions in order to accelerate the algorithm. The produced solutions models of the hGP are used in fitting and forecasting the adoption of broadband penetration. We investigate the fitting performance of the hGP, and we use the hGP to forecast the broadband penetration in OECD (Organisation for Economic Co-operation and Development) countries. The results of the optimized diffusion models are compared to those of the hGP-generated models. The comparison indicates that the hGP manages to generate solutions with high-performance statistical indicators. The hGP cooperates with the existing diffusion models, thus allowing multiple approaches to forecasting. The modified algorithm is implemented in the Python programming language, which is fast in execution time, compact, and user friendly.


---

## Body

## 1. Introduction

Many methods have been proposed for predicting the penetration of new technology in a community. The subject has been described and analyzed by worldwide literature, extensively [1–6].Examples of the above methods are the diffusion models for the adoption of new technologies. The diffusion models are mathematical functions that follow an S-shaped curve in time. The diffusion models used in this study are the Gompertz, Logistic, and Bass [4]. The parameters of the models have been estimated by regression analysis [5].Genetic algorithm (GA) is a probabilistic search method which uses the Darwinian principle of natural selection in finding an appropriate solution of a specific problem [7]. GP is more general than GA, because the produced solution corresponds to a new program [8]. The implementation of genetic programming (GP) in optimization problems has produced some important forecasting tools [7, 8].Generally, a GP begins with a set of initial randomly chosen functions (solutions) and this set is called population. A chromosome is a program solution of GP. Each solution has a fitness value, and this chromosome’s fitness is evaluated. The next generation is the resultant of the Darwinian selection process. In this process, the best chromosomes, according to their fitness values, are selected for the next generation. Some of the selected chromosomes are randomly combined (crossover) and generate new chromosomes (offspring). The mutation process also occurs, according to which a part of a randomly selected chromosome is changing. Finally, the chromosomes with better fitness values have better probability of being selected. The chromosomes of the new generation have better overall fitness value than those of the past generations. The whole process is repeated until an end condition has occurred [8, 9].This paper is structured as follows. At first, the diffusion models are shortly presented. The basic structure of the new modified GP (hGP) and its analysis follow. The next section contains the results analysis, and, finally, the conclusion is presented. In the AppendicesA, B, and C, the syntax of some produced models and the statistic indicators as well as the estimation formulas of the modified GA are provided.


## 2. Diffusion Models

Typically the diffusion process of innovative technologies in a society, such as broadband access, follows the sigmoid curve [6]. In this paper, some well-known diffusion models have been used as follows.


### 2.1. Logistic Model

The logistic diffusion model is the most known model among the sigmoid curves. The model is described by (2.1):
(2.1)y(t)=S1+a·ef{t},
where the diffusion of a new product in a society at time t is presented as y(t). Also, f(t)=a+b·t is a time-dependant function, and a,b are constant parameters. The S parameter is the limit of the function y(t). When time t→∞, then y(t)→S [5].


### 2.2. Gompertz Model

The Gompertz model was introduced as a law of mortality [10]. The equation that we use is the known format of  (2.2), as follows:
(2.2)y(t)=S·eef(t).We can also use the alternative format, Gompertz with constant, which is described in (2.3):
(2.3)y(t)=S·eef(t)+c,
where f(t)=a+b·t is a time-dependent function and a,b,c are constant parameters [5].


### 2.3. Bass Model

The Bass model proposes that the market for a new product consists of two major categories: innovators and imitators.Firstly, the innovators purchase the new product, and the imitators follow afterwards.This model’s function is an extended logistic curve, where the cumulative adoption of the new technologyy(t) for time t is presented in (2.4):
(2.4)y(t)=A-C·e-B·t1+D·e-B·t.In (2.4), parameter A corresponds to initial purchasers of the new technology product. Parameter B is the sum of the innovators and imitators coefficients, p and q, respectively. This is presented as B=p+q.C parameter is C=r·p, where r is a constant and D parameter is D=r·q/A [4, 11].


## 2.1. Logistic Model

The logistic diffusion model is the most known model among the sigmoid curves. The model is described by (2.1):
(2.1)y(t)=S1+a·ef{t},
where the diffusion of a new product in a society at time t is presented as y(t). Also, f(t)=a+b·t is a time-dependant function, and a,b are constant parameters. The S parameter is the limit of the function y(t). When time t→∞, then y(t)→S [5].


## 2.2. Gompertz Model

The Gompertz model was introduced as a law of mortality [10]. The equation that we use is the known format of  (2.2), as follows:
(2.2)y(t)=S·eef(t).We can also use the alternative format, Gompertz with constant, which is described in (2.3):
(2.3)y(t)=S·eef(t)+c,
where f(t)=a+b·t is a time-dependent function and a,b,c are constant parameters [5].


## 2.3. Bass Model

The Bass model proposes that the market for a new product consists of two major categories: innovators and imitators.Firstly, the innovators purchase the new product, and the imitators follow afterwards.This model’s function is an extended logistic curve, where the cumulative adoption of the new technologyy(t) for time t is presented in (2.4):
(2.4)y(t)=A-C·e-B·t1+D·e-B·t.In (2.4), parameter A corresponds to initial purchasers of the new technology product. Parameter B is the sum of the innovators and imitators coefficients, p and q, respectively. This is presented as B=p+q.C parameter is C=r·p, where r is a constant and D parameter is D=r·q/A [4, 11].


## 3. Genetic Programming Method

The specific hGP implements a hybrid strategy, which consists of two parts, the nonlinear regression analysis and the modified genetic algorithm part. The flowchart of Figure1 shows the parts of the hGP.Figure 1
Flowchart of the hGP.Firstly, a random set of solutions is created. Simultaneously, the candidate diffusion models are optimized by regression analysis and the produced models are inserted into the initial set of solutions. Now, the initial population of the hGP is prepared. Then, each solution is evaluated by its fitness function and the best solutions are inserted into a sorted list. The first, initial generation is ready. The termination criterion of the program is the maximum number of generations. After that, the selection of the best solutions takes place. It consists of the random combination of the best solutions, according to the crossover law and the random change of another randomly chosen solution. These solutions are going to be optimized by regression, and the next generation is ready. Finally, the whole process is repeated.


### 3.1. Solution Representation

In GP, each chromosome is not a fixed-length character string but a program that is a possible solution to the problem [12]. A chromosome in hGP, specifically, is presented as a string of characters in the Python programming language or as a parse tree. For example, the chromosome a+b*·e(c-d*t) is presented in Figures 2 and 3 as string and parse tree, respectively [12].Figure 2
Representation of a chromosome in hGP as string.Figure 3
Representation of a chromosome in hGP as a parse tree.The functions that are used in hGP are the addition (+), subtraction (−), protected division (/), multiplication (*), and exponential (E), because these are the same with the diffusion models’ functions.The parse tree consists of nodes. The terminal nodes are referred to as leaves. The leaves of the tree contain the variables or the constants of the program. As we can see the nonterminal nodes of the tree correspond to the function set of the hGP.


### 3.2. Initial Population

The initial population is generated by the fusion of a randomly produced number of chromosomes and the diffusion models which are optimized by regression analysis. The initial diffusion models’ chromosomes are the optimized Logistic, Gompertz family, and Bass models. It should be noted that the diffusion models may differ according to the problem. The parameters of the initial diffusion models are optimized by nonlinear regression analysis, and the Levenberg-Marquardt algorithm has been used.From a programmer’s point of view, each chromosome is a string data type which is presented as a parse tree in the internal structure of the Python programming language. The population appears as a list of strings. This list corresponds to the first generation for the program.


### 3.3. Evaluation

During the evaluation process, we can use many functions as fitness indicators (with real data). In the specific implementation, we use two different fitness functions as follows.In the fitting process, each chromosome is evaluated with the sum of squared error (SSE), as in AppendixC in (C.1). In forecasting, the evaluation function corresponds to the weighted sum of squared error (wSSE) function, as in (C.2).


### 3.4. Selection

In hGP, the chromosomes with the best values of the fitness function (smaller than a precision limit) are inserted into a Python’s list. The members of the list are sorted according to their fitness value. In Figure4, we can see the structure of the sorted list. Then some randomly chosen chromosomes will be selected in order to produce the next generation using crossover and mutation processes.Figure 4
Representation of the sorted list of the selected chromosomes in hGP.


### 3.5. Crossover

As it has been aforementioned, in the implementation of hGP, each chromosome is a string data type or a parse tree in the internal structure of the programming language. In the crossover process, two parents are randomly selected from the chromosomes’ list with the best fitness value.A crossover point is randomly chosen in the first parent string. Also another crossover point is randomly chosen in the second parent string. The first child (offspring) is generated when the substring of the first parent, which begins at the crossover point, is replaced by the substring from the second parent, which begins at the second crossover point. The second child is generated by the crossing over of the other parts (substrings) of the parents’ strings. In Figures5 and 6, the crossover operation is presented.Figure 5
Crossover of the hybrid genetic programming method (string representation).Figure 6
Crossover of the hybrid genetic programming method (parse tree representation).


### 3.6. Mutation

In the mutation process, a chromosome is randomly chosen from the chromosomes list, with the best fitness value. The substring point, in which the mutation will take place, is also randomly chosen. The mutation replaces the function (+, −, /, *,E) which is presented at the mutation point with a new random function in the substring.The mutation operation is presented in Figures7 and 8.Figure 7
Mutation of the hybrid genetic programming method (string representation).Figure 8
Mutation of the hybrid genetic programming method (parse tree representation).


## 3.1. Solution Representation

In GP, each chromosome is not a fixed-length character string but a program that is a possible solution to the problem [12]. A chromosome in hGP, specifically, is presented as a string of characters in the Python programming language or as a parse tree. For example, the chromosome a+b*·e(c-d*t) is presented in Figures 2 and 3 as string and parse tree, respectively [12].Figure 2
Representation of a chromosome in hGP as string.Figure 3
Representation of a chromosome in hGP as a parse tree.The functions that are used in hGP are the addition (+), subtraction (−), protected division (/), multiplication (*), and exponential (E), because these are the same with the diffusion models’ functions.The parse tree consists of nodes. The terminal nodes are referred to as leaves. The leaves of the tree contain the variables or the constants of the program. As we can see the nonterminal nodes of the tree correspond to the function set of the hGP.


## 3.2. Initial Population

The initial population is generated by the fusion of a randomly produced number of chromosomes and the diffusion models which are optimized by regression analysis. The initial diffusion models’ chromosomes are the optimized Logistic, Gompertz family, and Bass models. It should be noted that the diffusion models may differ according to the problem. The parameters of the initial diffusion models are optimized by nonlinear regression analysis, and the Levenberg-Marquardt algorithm has been used.From a programmer’s point of view, each chromosome is a string data type which is presented as a parse tree in the internal structure of the Python programming language. The population appears as a list of strings. This list corresponds to the first generation for the program.


## 3.3. Evaluation

During the evaluation process, we can use many functions as fitness indicators (with real data). In the specific implementation, we use two different fitness functions as follows.In the fitting process, each chromosome is evaluated with the sum of squared error (SSE), as in AppendixC in (C.1). In forecasting, the evaluation function corresponds to the weighted sum of squared error (wSSE) function, as in (C.2).


## 3.4. Selection

In hGP, the chromosomes with the best values of the fitness function (smaller than a precision limit) are inserted into a Python’s list. The members of the list are sorted according to their fitness value. In Figure4, we can see the structure of the sorted list. Then some randomly chosen chromosomes will be selected in order to produce the next generation using crossover and mutation processes.Figure 4
Representation of the sorted list of the selected chromosomes in hGP.


## 3.5. Crossover

As it has been aforementioned, in the implementation of hGP, each chromosome is a string data type or a parse tree in the internal structure of the programming language. In the crossover process, two parents are randomly selected from the chromosomes’ list with the best fitness value.A crossover point is randomly chosen in the first parent string. Also another crossover point is randomly chosen in the second parent string. The first child (offspring) is generated when the substring of the first parent, which begins at the crossover point, is replaced by the substring from the second parent, which begins at the second crossover point. The second child is generated by the crossing over of the other parts (substrings) of the parents’ strings. In Figures5 and 6, the crossover operation is presented.Figure 5
Crossover of the hybrid genetic programming method (string representation).Figure 6
Crossover of the hybrid genetic programming method (parse tree representation).


## 3.6. Mutation

In the mutation process, a chromosome is randomly chosen from the chromosomes list, with the best fitness value. The substring point, in which the mutation will take place, is also randomly chosen. The mutation replaces the function (+, −, /, *,E) which is presented at the mutation point with a new random function in the substring.The mutation operation is presented in Figures7 and 8.Figure 7
Mutation of the hybrid genetic programming method (string representation).Figure 8
Mutation of the hybrid genetic programming method (parse tree representation).


## 4. Results

In this section, the dataset, the statistic indicators, and the results of the study will be presented. The results will also be analysed in order to provide a satisfactory prediction for the broadband penetration in OECD countries.


### 4.1. Dataset

In this study, the proposed method has been implemented on two different datasets. The first dataset presents the overall OECD broadband penetration. The data came from the OECD portal [13], which presents the total fixed (wired) broadband penetration in OECD countries. According to OECD reports, the overall broadband penetration is rapidly growing. The dataset concerns the time period from the second quarter (Q2) of the year 2002 until the forth quarter (Q4) of the year 2010. The dataset is comprised of 18 data points.The method is also implemented on the second dataset which concerns three innovators countries in fixed (wired) broadband technology adoption [14], namely, Sweden, The Netherlands, and Denmark. This dataset concerns the time period from the second quarter (Q2) of the year 2001 until the fourth quarter (Q4) of 2010 that is 20 data points. Thus, the fitting and forecasting ability of hGP are both tested in markets that have reached or are going to reach the saturation point of the penetration curve.


### 4.2. Statistic Indicators

As mentioned above, the fitness function of each individual is the sum of squared error (SSE) for the fitting process. The results are analyzed by the estimation of some widely used statistical indices. The main indices of our analysis are the mean absolute percentage error (MAPE), the mean square error (MSE), the mean absolute error (MAE), and the root mean square error (RMSE).The statistic indicators of MAPE, MSE, MAE and RMSE are presented in AppendixB.


### 4.3. Fitting Results

As aforementioned, the statistic indicator used for the fitting process is the SSE. In this section, the fitting performance of the generated models by the hGP as well as the comparison of the optimized diffusion models with the hGP’s models is presented. Both hGP and optimized diffusion models concerning the fitting performance are presented in AppendixA.1.


#### 4.3.1. Fitting Results for the Overall OECD Broadband Penetration

Table1 contains the initialization parameters for the execution of hGP concerning the whole dataset of the OECD countries.Table 1
Parameters initialization of hGP.
Parameters of the hGP
Maximum number of generations
500
Evaluation function
SSE
Upper limit of the precision for the candidates for crossover and mutation
0.5An example of the fitting performance for the first five hGP models, according to their fitness value (SSE), is presented in Figure9. The graphs represent the broadband penetration percentage (y-axis) and time (x-axis) as date. Each time point (x-axis) corresponds to a six-month period. The relative statistical indices SSE, MAPE, MSE, RMSE, and MAE of the produced hGP models are presented in Table 2.Table 2
Statistical indices of the first five produced hGP models (OECD overall).
Statistical indices of the hGP for OECD overall dataset
Model name
MAPE
SSE
MSE
RMSE
MAE
hGP Model 1
0.007863
4.53047
E
-
05
2.51693
E
-
06
0.001586
0.001301
hGP Model 2
0.009163
4.91669
E
-
05
2.73149
E
-
06
0.001653
0.001271
hGP Model 3
0.010628
4.95931
E
-
05
2.75517
E
-
06
0.00166
0.001363
hGP Model 4
0.010628
4.95931
E
-
05
2.75517
E
-
06
0.00166
0.001363
hGP Model 5
0.010628
4.95932
E
-
05
2.75518
E
-
06
0.00166
0.001363Figure 9
The fitting performance of the first five hGP models (OECD overall).Also, the fitting performance of the optimized diffusion models, according to their fitness value (SSE), is presented in Figure10 and their statistical indices in Table 3.Table 3
Representation of the statistics for the optimized diffusion models sorted by SSE.
Statistical indices of the optimized diffusion models for OECD overall dataset
Model name
MAPE
SSE
MSE
RMSE
MAE
Logistic
0.015544
0.000134615
7.47864
E
-
06
0.00273471
0.00211296
Bass
0.015544
0.000134616
7.47867
E
-
06
0.00273472
0.00211297
Gompertz with constant
0.022755
0.000166627
9.25707
E
-
06
0.00304254
0.00249006
Gompertz
0.033951
0.000316133
1.7563
E
-
05
0.00419082
0.0037315Figure 10
The fitting performance of the optimized diffusion models for OECD overall dataset.When considering Tables2 and 3, the hGP method achieves better statistical indices than those of the optimized diffusion models. For example, the first hGP model shows a SSE value of 4.53047E−05 and the Logistic model 0.000134615. It should be noted that hGP was executed for 500 generations, which is a rather medium number of generations. Thus, better results could be achieved for larger number of generations.


#### 4.3.2. Fitting Results for Sweden, The Netherlands, and Denmark Broadband Penetration

Table4 contains the initialization parameters for the execution of hGP concerning the dataset for The Netherlands-Sweden-Denmark countries.Table 4
Parameters initialization of the hGP.
Parameters of the hGP
Maximum number of generations
500
Evaluation function
SSE
Upper limit of the precision for the candidates for crossover and mutation
0.5The fitting performance for the first five hGP models, according to their fitness value (SSE) as well as the performance of the optimized diffusion models is presented in Figures11 and 12 for Sweden, Figures 13 and 14 for The Netherlands, and  Figures 15 and 16 for Denmark, respectively. The relative statistical indices SSE, MAPE, MSE, RMSE, and MAE of the produced hGP models are presented in Tables 5 and 6 for Sweden, Tables 7 and 8 for The Netherlands, and Tables 9 and 10 for Denmark.Table 5
Statistical indices of the first five produced hGP models (Sweden).
Statistical indices of the hGP for Sweden dataset
Model name
MAPE
SSE
MSE
RMSE
MAE
hGP Model 1
0.008675744
7.46756
E
-
05
4.63861
E
-
05
3.73378
E
-
06
0.001932299
hGP Model 2
0.009181524
8.90721
E
-
05
5.39797
E
-
05
4.45361
E
-
06
0.002110357
hGP Model 3
0.033258076
0.000264358
6.12299
E
-
05
1.32179
E
-
05
0.003635641
hGP Model 4
0.048504881
0.000515968
0.000103702
2.57984
E
-
05
0.005079212
hGP Model 5
0.04856113
0.000517456
0.000104259
2.58728
E
-
05
0.005086532Table 6
Representation of the statistics for the optimized diffusion models sorted by SSE (Sweden).
Statistical indices of the optimized diffusion models for Sweden dataset
Model name
MAPE
SSE
MSE
RMSE
MAE
Logistic
0.055827
0.001689
8.45
E
-
05
0.009191
0.007991
Bass
0.055827
0.001689
8.45
E
-
05
0.009191
0.007991
Gompertz with constant
0.083396
0.002071
0.000104
0.010175
0.009002
Gompertz
0.086425
0.003551
0.000178
0.013326
0.011753Table 7
Statistical indices of the first five produced hGP models (The Netherlands).
Statistical indices of hGP for The Netherlands dataset
Model name
MAPE
SSE
MSE
RMSE
MAE
hGP Model 1
0.013729
0.00018787
9.39
E
-
06
0.003065
0.002343
hGP Model 2
0.012842
0.00018848
9.42
E
-
06
0.00307
0.002304
hGP Model 3
0.01377
0.00019367
9.68
E
-
06
0.003112
0.002264
hGP Model 4
0.01377
0.00019367
9.68
E
-
06
0.003112
0.002264
hGP Model 5
0.010985
0.00020294
1.01
E
-
05
0.003185
0.002155Table 8
Statistics for the optimized diffusion models sorted by SSE (The Netherlands).
Statistical indices of the optimized diffusion models for The Netherlands dataset
Model name
MAPE
SSE
MSE
RMSE
MAE
Logistic
0.015446
0.00023692
1.18
E
-
05
0.003442
0.002548
Bass
0.015447
0.00023692
1.18
E
-
05
0.003442
0.002548
Gompertz with constant
0.031535
0.000412654
2.06
E
-
05
0.004542
0.003828
Gompertz
0.07946
0.001367898
6.84
E
-
05
0.00827
0.007501Table 9
Statistical indices of the first five produced hGP models (Denmark).
Statistical indices of hGP for Denmark dataset
Model name
MAPE
SSE
MSE
RMSE
MAE
hGP Model 1
0.045512
0.000566649
2.83324
E
-
05
0.005323
0.004332
hGP Model 2
0.047466
0.000599483
2.99742
E
-
05
0.005475
0.004452
hGP Model 3
0.047487
0.000599823
2.99912
E
-
05
0.005476
0.004453
hGP Model 4
0.047489
0.000599875
2.99938
E
-
05
0.005477
0.004454
hGP Model 5
0.047531
0.000600572
3.00286
E
-
05
0.00548
0.004456Table 10
Statistics for the optimized diffusion models sorted by SSE (Denmark).
Statistical indices of the optimized diffusion models for Denmark dataset
Model name
MAPE
SSE
MSE
RMSE
MAE
Logistic
0.049134
0.001110701
5.55
E
-
05
0.007452
0.006494
Bass
0.049134
0.001110704
5.55
E
-
05
0.007452
0.006494
Gompertz with constant
0.049134
0.001110701
5.55
E
-
05
0.007452
0.006494
Gompertz
0.049134
0.001110704
5.55
E
-
05
0.007452
0.006494Figure 11
The fitting performance of the first five hGP models for Sweden.Figure 12
The fitting performance of the optimized diffusion models for Sweden.Figure 13
The fitting performance of the first five hGP models for The Netherlands.Figure 14
The fitting performance of the optimized diffusion models for The Netherlands.Figure 15
The fitting performance of the first five hGP models for Denmark.Figure 16
The fitting performance of the optimized diffusion models for Denmark.According to Tables5 and 6, the hGP method achieves better statistical indices than those of the optimized diffusion models. For example, the first hGP model achieves an SSE value 7.46756E−05 while the Logistic model an SSE value of 0.001689.Once again, according to Tables7 and 8, the hGP method achieves better statistical indices than those of the optimized diffusion models.Finally, according to Tables9 and 10, the hGP method achieves better statistical indices than those of the optimized diffusion models. The first hGP model achieves an SSE value of 0.000566649 while the Logistic model 0.001110701.


### 4.4. Forecasting Results

The forecasting results of the generated models by hGP are presented in this section as well as the comparison of the optimized diffusion models with the hGP’s models. The statistic indicator used for the forecasting process is the wSSE. Both hGP and the optimized diffusion models concerning the forecasting performance are presented in AppendixA.2.


#### 4.4.1. Forecasting Results for the Overall OECD Broadband Penetration

Table11 contains the initialization parameters for the execution of hGP for the forecasting process. The whole dataset of the OECD countries contains 18 data points (2 points per year since 2002 until 2010). The forecasting method for a 2-year prediction uses 14 points (data for hGP training) of the dataset and implements the statistical indices to this 14-point subset. The graph of the forecasting performance is shown in Figure 17. In every graph, the forecast period window is presented into the blue rectangle.Table 11
Initialization parameters of hGP.
Parameters of the hGP
Maximum number of generations
500
Evaluation function
wSSE
Upper limit of the precision for the candidates for crossover and mutation
0.09Figure 17
The forecasting performance of hGP (forecast period—2 years ahead).The relative statistical indices, for the training points, of the produced forecasting hGP models are presented in Table12.Table 12
Statistical indices of the first five produced forecasting hGP models for OECD overall.
Statistical indices of the hGP for OECD forecasting (14 points training)
Model name
MAPE
wSSE
MSE
RMSE
MAE
hGP Model 1
0.009744
3.67091
E
-
05
4.02
E
-
06
0.002005
0.001412
hGP Model 2
0.014944
4.00502
E
-
05
4.82
E
-
06
0.002195
0.001608
hGP Model 3
0.014527
4.55281
E
-
05
5.38
E
-
06
0.002319
0.001683
hGP Model 4
0.019881
5.2309
E
-
05
6.65
E
-
06
0.002579
0.002041
hGP Model 5
0.020006
5.40818
E
-
05
6.86
E
-
06
0.00262
0.002063The forecasting performance of the optimized diffusion models, according to their fitness value (wSSE) for the 14 training points, is presented in Figure18 and their statistical indices in Table 13.Table 13
Representation of the statistics for the optimized diffusion models sorted by wSSE (forecast period—2 years ahead).
Statistical indices of the optimized diffusion models for OECD forecasting (14-point training)
Model name
MAPE
wSSE
MSE
RMSE
MAE
Logistic
0.016716
6.13566
E
-
05
7.18
E
-
06
0.002679
0.002025
Bass
0.016716
6.13573
E
-
05
7.18
E
-
06
0.002679
0.002025
Gompertz with constant
0.021155
6.98404
E
-
05
8.51
E
-
06
0.002917
0.002349
Gompertz
0.022379
9.5999
E
-
05
1.08
E
-
05
0.003284
0.002678Figure 18
The forecasting performance of the optimized diffusion models (forecast period—2 years ahead).Considering Tables12 and 13, the conclusion is that the hGP method achieves better statistical indices than those of the optimized diffusion models. We can see that the first hGP model achieves a wSSE value 3.67091E−05 while the Logistic model 6.13566E−05. The comparison of the models residuals against time (data points), especially for the 4 last data points (the forecast period), shows the predominance of the hGP models (see Figure 19).Figure 19
The forecasting performance of the models (forecast period—2 years ahead).


#### 4.4.2. Forecasting Results for the Sweden-The Netherlands-Denmark Broadband Penetration

Table14 contains the initialization parameters for the execution of hGP in the forecasting process. The datasets of Sweden, The Netherlands, and Denmark contain 20 data points (2 points per year since 2001 until 2010). The forecasting method for a 2-year prediction uses 16 data points for hGP training of the dataset and implements the statistical indices to the subset of the training points. The graphs of the forecasting performance of the hGP and optimized diffusion models are shown in Figures 20 and 21 for Sweden, Figures 23 and 24 for The Netherlands, and Figures 26 and 27 for Denmark, respectively. The relative statistical indices for the training data are presented in Tables 15 and 16 for Sweden, Tables 17 and 18 for The Netherlands, and Tables 19 and 20 for Denmark. Finally, the statistical indices, MAPE and MAE, that describe the forecasting performance of the models in a forecasting horizon of 2-years are presented in Figures 22, 25, and 28 for the three countries.Table 14
Parameters initialization of hGP.
Parameters of the hGP
Maximum number of generations
500
Evaluation function
wSSE
Upper limit of the precision for the candidates for crossover and mutation
0.9Table 15
Statistical indices of the first five produced hGP models (Sweden) forecast period—2 years.
Statistical indices of hGP for Sweden dataset (16-point training)
Model name
MAPE
wSSE
MSE
RMSE
MAE
hGP Model 1
0.011145
5.53
E
-
05
4.81
E
-
06
0.002192
0.001692
hGP Model 2
0.008093
5.66
E
-
05
4.71
E
-
06
0.002171
0.001546
hGP Model 3
0.008504
5.67
E
-
05
4.69
E
-
06
0.002166
0.001538
hGP Model 4
0.008105
5.69
E
-
05
4.74
E
-
06
0.002176
0.001549
hGP Model 5
0.008151
5.79
E
-
05
4.81
E
-
06
0.002192
0.001557Table 16
Statistics for the optimized diffusion models sorted by wSSE (Sweden) forecast period—2 years.
Statistical indices of the optimized diffusion models for Sweden dataset (16-point training)
Model name
MAPE
wSSE
MSE
RMSE
MAE
Logistic
0.054539
0.000433
5.03
E
-
05
0.007089
0.006376
Bass
0.054539
0.000433
5.03
E
-
05
0.007089
0.006376
Gompertz with constant
0.06964
0.000513
6.58
E
-
05
0.008114
0.007267
Gompertz
0.054088
0.000825
8.47
E
-
05
0.009202
0.007889Table 17
Statistical indices of the first five produced hGP models for The Netherlands (forecast period—2 years).
Statistical indices of hGP for The Netherlands dataset (16-point training)
Model name
MAPE
wSSE
MSE
RMSE
MAE
hGP Model 1
0.014673
0.000100
8.58
E
-
06
0.002929
0.002194
hGP Model 2
0.017209
0.000103
8.84
E
-
06
0.002973
0.00227
hGP Model 3
0.017209
0.000103
8.84
E
-
06
0.002973
0.00227
hGP Model 4
0.017223
0.000103
8.85
E
-
06
0.002975
0.002271
hGP Model 5
0.017253
0.000103
8.86
E
-
06
0.002976
0.002272Table 18
Statistics for the optimized diffusion models sorted by wSSE for The Netherlands (forecast period—2 years).
Statistical indices of the optimized diffusion models for The Netherlands dataset (16-point training)
Model name
MAPE
wSSE
MSE
RMSE
MAE
Logistic
0.018228
7.31
E
-
05
7.36
E
-
06
0.002712
0.002069
Bass
0.018228
7.31
E
-
05
7.36
E
-
06
0.002712
0.002069
Gompertz with constant
0.033352
0.000162
1.76
E
-
05
0.004199
0.003502
Gompertz
0.074251
0.000437
5.84
E
-
05
0.007639
0.006336Table 19
Statistical indices of the first five produced hGP models for Denmark (forecast period—2 years).
Statistical indices of the hGP for Denmark dataset (16-point training)
Model name
MAPE
wSSE
MSE
RMSE
MAE
hGP Model 1
0.024844
3.39655
E
-
05
7.25
E
-
06
0.002692
0.002018
hGP Model 2
0.024808
6.20484
E
-
05
1.02
E
-
05
0.003201
0.002468
hGP Model 3
0.022951
6.42515
E
-
05
1.05
E
-
05
0.003233
0.002483
hGP Model 4
0.022944
6.42636
E
-
05
1.05
E
-
05
0.003233
0.002483
hGP Model 5
0.022944
6.42636
E
-
05
1.05
E
-
05
0.003233
0.002483Table 20
Statistics for the optimized diffusion
models sorted by wSSE for Denmark (forecast period—2
years).
Statistical
indices of the optimized diffusion models for Denmark dataset
(16-point training)
Model
name
MAPE
wSSE
MSE
RMSE
MAE
Logistic
0.058957
0.000319962
4.33
E
-
05
0.006582
0.005759
Bass
0.048066
0.000362021
4.14
E
-
05
0.006434
0.005734
Gompertz
with
constant
0.05776
0.000562689
6.02
E
-
05
0.007756
0.007007
Gompertz
0.042059
0.000683336
6.6
E
-
05
0.008125
0.006943Figure 20
The forecasting performance of the first five hGP models for Sweden (forecast period—2 years ahead).Figure 21
The forecasting performance of the optimized diffusion models for Sweden (forecast period—2 years ahead).Figure 22
The forecasting performance of the models for Sweden (forecast period—2 years ahead).Figure 23
The forecasting performance of the first five hGP models and the optimized diffusion models for The Netherlands (forecast period—2 years ahead).Figure 24
The forecasting performance of the optimized diffusion models for The Netherlands (forecast period—2 years ahead).Figure 25
The forecasting performance of the models for The Netherlands (forecast period—2 years ahead).Figure 26
The forecasting performance of the first five hGP models for Denmark (forecast period—2 years ahead).Figure 27
The forecasting performance of the optimized diffusion models for Denmark (forecast period—2 years ahead).Figure 28
The forecasting performance of the optimized diffusion models for Denmark (forecast period—2 years ahead).(
1
) Forecasting Results for Sweden Broadband Penetration
Considering Tables15 and 16, it is concluded that the hGP method again achieves better statistical indices than those of the optimized diffusion models for the training subset. The first hGP model has a wSSE value of 5.53E−05 while the Logistic model 0.000433. It should be mentioned that the hGP achieves a satisfactory performance after the 16th data point, with minimized residuals (errors), MAPE and MAE for the last 4 data points (2-year forecast horizon, see Figure 22).(
2
)  Forpecasting Results for The Netherlands Broadband Penetration
Further commenting on the forecasting results, according to Tables17 and 18, it is concluded that the hGP method again achieves better statistical indices than those of the optimized diffusion models for the 16-point training subset. The first hGP model shows a wSSE value of 0.00010 while the Logistic and Bass models 7.31E-05. Both parts, the hGP and diffusion models, specially Logistic and Bass models, achieve well enough performance after the 16th data point, with minimized residuals (errors) for the last 4 data points (2-year forecast horizon, see Figure 25).(
3
)  Forecasting Results for Denmark Broadband Penetration
Finally, according to Tables19 and 20, once again the hGP method achieves better statistical indices than those of the optimized diffusion models for the training subset. The first hGP model achieves a wSSE value of 3.39655E−05 while the Logistic model 0.000319962. The hGP achieves well enough performance after the 16th data point, with minimized residuals (errors), MAPE and MAE for the last 4 data points (2-year forecast horizon, see Figure 28).


## 4.1. Dataset

In this study, the proposed method has been implemented on two different datasets. The first dataset presents the overall OECD broadband penetration. The data came from the OECD portal [13], which presents the total fixed (wired) broadband penetration in OECD countries. According to OECD reports, the overall broadband penetration is rapidly growing. The dataset concerns the time period from the second quarter (Q2) of the year 2002 until the forth quarter (Q4) of the year 2010. The dataset is comprised of 18 data points.The method is also implemented on the second dataset which concerns three innovators countries in fixed (wired) broadband technology adoption [14], namely, Sweden, The Netherlands, and Denmark. This dataset concerns the time period from the second quarter (Q2) of the year 2001 until the fourth quarter (Q4) of 2010 that is 20 data points. Thus, the fitting and forecasting ability of hGP are both tested in markets that have reached or are going to reach the saturation point of the penetration curve.


## 4.2. Statistic Indicators

As mentioned above, the fitness function of each individual is the sum of squared error (SSE) for the fitting process. The results are analyzed by the estimation of some widely used statistical indices. The main indices of our analysis are the mean absolute percentage error (MAPE), the mean square error (MSE), the mean absolute error (MAE), and the root mean square error (RMSE).The statistic indicators of MAPE, MSE, MAE and RMSE are presented in AppendixB.


## 4.3. Fitting Results

As aforementioned, the statistic indicator used for the fitting process is the SSE. In this section, the fitting performance of the generated models by the hGP as well as the comparison of the optimized diffusion models with the hGP’s models is presented. Both hGP and optimized diffusion models concerning the fitting performance are presented in AppendixA.1.


### 4.3.1. Fitting Results for the Overall OECD Broadband Penetration

Table1 contains the initialization parameters for the execution of hGP concerning the whole dataset of the OECD countries.Table 1
Parameters initialization of hGP.
Parameters of the hGP
Maximum number of generations
500
Evaluation function
SSE
Upper limit of the precision for the candidates for crossover and mutation
0.5An example of the fitting performance for the first five hGP models, according to their fitness value (SSE), is presented in Figure9. The graphs represent the broadband penetration percentage (y-axis) and time (x-axis) as date. Each time point (x-axis) corresponds to a six-month period. The relative statistical indices SSE, MAPE, MSE, RMSE, and MAE of the produced hGP models are presented in Table 2.Table 2
Statistical indices of the first five produced hGP models (OECD overall).
Statistical indices of the hGP for OECD overall dataset
Model name
MAPE
SSE
MSE
RMSE
MAE
hGP Model 1
0.007863
4.53047
E
-
05
2.51693
E
-
06
0.001586
0.001301
hGP Model 2
0.009163
4.91669
E
-
05
2.73149
E
-
06
0.001653
0.001271
hGP Model 3
0.010628
4.95931
E
-
05
2.75517
E
-
06
0.00166
0.001363
hGP Model 4
0.010628
4.95931
E
-
05
2.75517
E
-
06
0.00166
0.001363
hGP Model 5
0.010628
4.95932
E
-
05
2.75518
E
-
06
0.00166
0.001363Figure 9
The fitting performance of the first five hGP models (OECD overall).Also, the fitting performance of the optimized diffusion models, according to their fitness value (SSE), is presented in Figure10 and their statistical indices in Table 3.Table 3
Representation of the statistics for the optimized diffusion models sorted by SSE.
Statistical indices of the optimized diffusion models for OECD overall dataset
Model name
MAPE
SSE
MSE
RMSE
MAE
Logistic
0.015544
0.000134615
7.47864
E
-
06
0.00273471
0.00211296
Bass
0.015544
0.000134616
7.47867
E
-
06
0.00273472
0.00211297
Gompertz with constant
0.022755
0.000166627
9.25707
E
-
06
0.00304254
0.00249006
Gompertz
0.033951
0.000316133
1.7563
E
-
05
0.00419082
0.0037315Figure 10
The fitting performance of the optimized diffusion models for OECD overall dataset.When considering Tables2 and 3, the hGP method achieves better statistical indices than those of the optimized diffusion models. For example, the first hGP model shows a SSE value of 4.53047E−05 and the Logistic model 0.000134615. It should be noted that hGP was executed for 500 generations, which is a rather medium number of generations. Thus, better results could be achieved for larger number of generations.


### 4.3.2. Fitting Results for Sweden, The Netherlands, and Denmark Broadband Penetration

Table4 contains the initialization parameters for the execution of hGP concerning the dataset for The Netherlands-Sweden-Denmark countries.Table 4
Parameters initialization of the hGP.
Parameters of the hGP
Maximum number of generations
500
Evaluation function
SSE
Upper limit of the precision for the candidates for crossover and mutation
0.5The fitting performance for the first five hGP models, according to their fitness value (SSE) as well as the performance of the optimized diffusion models is presented in Figures11 and 12 for Sweden, Figures 13 and 14 for The Netherlands, and  Figures 15 and 16 for Denmark, respectively. The relative statistical indices SSE, MAPE, MSE, RMSE, and MAE of the produced hGP models are presented in Tables 5 and 6 for Sweden, Tables 7 and 8 for The Netherlands, and Tables 9 and 10 for Denmark.Table 5
Statistical indices of the first five produced hGP models (Sweden).
Statistical indices of the hGP for Sweden dataset
Model name
MAPE
SSE
MSE
RMSE
MAE
hGP Model 1
0.008675744
7.46756
E
-
05
4.63861
E
-
05
3.73378
E
-
06
0.001932299
hGP Model 2
0.009181524
8.90721
E
-
05
5.39797
E
-
05
4.45361
E
-
06
0.002110357
hGP Model 3
0.033258076
0.000264358
6.12299
E
-
05
1.32179
E
-
05
0.003635641
hGP Model 4
0.048504881
0.000515968
0.000103702
2.57984
E
-
05
0.005079212
hGP Model 5
0.04856113
0.000517456
0.000104259
2.58728
E
-
05
0.005086532Table 6
Representation of the statistics for the optimized diffusion models sorted by SSE (Sweden).
Statistical indices of the optimized diffusion models for Sweden dataset
Model name
MAPE
SSE
MSE
RMSE
MAE
Logistic
0.055827
0.001689
8.45
E
-
05
0.009191
0.007991
Bass
0.055827
0.001689
8.45
E
-
05
0.009191
0.007991
Gompertz with constant
0.083396
0.002071
0.000104
0.010175
0.009002
Gompertz
0.086425
0.003551
0.000178
0.013326
0.011753Table 7
Statistical indices of the first five produced hGP models (The Netherlands).
Statistical indices of hGP for The Netherlands dataset
Model name
MAPE
SSE
MSE
RMSE
MAE
hGP Model 1
0.013729
0.00018787
9.39
E
-
06
0.003065
0.002343
hGP Model 2
0.012842
0.00018848
9.42
E
-
06
0.00307
0.002304
hGP Model 3
0.01377
0.00019367
9.68
E
-
06
0.003112
0.002264
hGP Model 4
0.01377
0.00019367
9.68
E
-
06
0.003112
0.002264
hGP Model 5
0.010985
0.00020294
1.01
E
-
05
0.003185
0.002155Table 8
Statistics for the optimized diffusion models sorted by SSE (The Netherlands).
Statistical indices of the optimized diffusion models for The Netherlands dataset
Model name
MAPE
SSE
MSE
RMSE
MAE
Logistic
0.015446
0.00023692
1.18
E
-
05
0.003442
0.002548
Bass
0.015447
0.00023692
1.18
E
-
05
0.003442
0.002548
Gompertz with constant
0.031535
0.000412654
2.06
E
-
05
0.004542
0.003828
Gompertz
0.07946
0.001367898
6.84
E
-
05
0.00827
0.007501Table 9
Statistical indices of the first five produced hGP models (Denmark).
Statistical indices of hGP for Denmark dataset
Model name
MAPE
SSE
MSE
RMSE
MAE
hGP Model 1
0.045512
0.000566649
2.83324
E
-
05
0.005323
0.004332
hGP Model 2
0.047466
0.000599483
2.99742
E
-
05
0.005475
0.004452
hGP Model 3
0.047487
0.000599823
2.99912
E
-
05
0.005476
0.004453
hGP Model 4
0.047489
0.000599875
2.99938
E
-
05
0.005477
0.004454
hGP Model 5
0.047531
0.000600572
3.00286
E
-
05
0.00548
0.004456Table 10
Statistics for the optimized diffusion models sorted by SSE (Denmark).
Statistical indices of the optimized diffusion models for Denmark dataset
Model name
MAPE
SSE
MSE
RMSE
MAE
Logistic
0.049134
0.001110701
5.55
E
-
05
0.007452
0.006494
Bass
0.049134
0.001110704
5.55
E
-
05
0.007452
0.006494
Gompertz with constant
0.049134
0.001110701
5.55
E
-
05
0.007452
0.006494
Gompertz
0.049134
0.001110704
5.55
E
-
05
0.007452
0.006494Figure 11
The fitting performance of the first five hGP models for Sweden.Figure 12
The fitting performance of the optimized diffusion models for Sweden.Figure 13
The fitting performance of the first five hGP models for The Netherlands.Figure 14
The fitting performance of the optimized diffusion models for The Netherlands.Figure 15
The fitting performance of the first five hGP models for Denmark.Figure 16
The fitting performance of the optimized diffusion models for Denmark.According to Tables5 and 6, the hGP method achieves better statistical indices than those of the optimized diffusion models. For example, the first hGP model achieves an SSE value 7.46756E−05 while the Logistic model an SSE value of 0.001689.Once again, according to Tables7 and 8, the hGP method achieves better statistical indices than those of the optimized diffusion models.Finally, according to Tables9 and 10, the hGP method achieves better statistical indices than those of the optimized diffusion models. The first hGP model achieves an SSE value of 0.000566649 while the Logistic model 0.001110701.


## 4.3.1. Fitting Results for the Overall OECD Broadband Penetration

Table1 contains the initialization parameters for the execution of hGP concerning the whole dataset of the OECD countries.Table 1
Parameters initialization of hGP.
Parameters of the hGP
Maximum number of generations
500
Evaluation function
SSE
Upper limit of the precision for the candidates for crossover and mutation
0.5An example of the fitting performance for the first five hGP models, according to their fitness value (SSE), is presented in Figure9. The graphs represent the broadband penetration percentage (y-axis) and time (x-axis) as date. Each time point (x-axis) corresponds to a six-month period. The relative statistical indices SSE, MAPE, MSE, RMSE, and MAE of the produced hGP models are presented in Table 2.Table 2
Statistical indices of the first five produced hGP models (OECD overall).
Statistical indices of the hGP for OECD overall dataset
Model name
MAPE
SSE
MSE
RMSE
MAE
hGP Model 1
0.007863
4.53047
E
-
05
2.51693
E
-
06
0.001586
0.001301
hGP Model 2
0.009163
4.91669
E
-
05
2.73149
E
-
06
0.001653
0.001271
hGP Model 3
0.010628
4.95931
E
-
05
2.75517
E
-
06
0.00166
0.001363
hGP Model 4
0.010628
4.95931
E
-
05
2.75517
E
-
06
0.00166
0.001363
hGP Model 5
0.010628
4.95932
E
-
05
2.75518
E
-
06
0.00166
0.001363Figure 9
The fitting performance of the first five hGP models (OECD overall).Also, the fitting performance of the optimized diffusion models, according to their fitness value (SSE), is presented in Figure10 and their statistical indices in Table 3.Table 3
Representation of the statistics for the optimized diffusion models sorted by SSE.
Statistical indices of the optimized diffusion models for OECD overall dataset
Model name
MAPE
SSE
MSE
RMSE
MAE
Logistic
0.015544
0.000134615
7.47864
E
-
06
0.00273471
0.00211296
Bass
0.015544
0.000134616
7.47867
E
-
06
0.00273472
0.00211297
Gompertz with constant
0.022755
0.000166627
9.25707
E
-
06
0.00304254
0.00249006
Gompertz
0.033951
0.000316133
1.7563
E
-
05
0.00419082
0.0037315Figure 10
The fitting performance of the optimized diffusion models for OECD overall dataset.When considering Tables2 and 3, the hGP method achieves better statistical indices than those of the optimized diffusion models. For example, the first hGP model shows a SSE value of 4.53047E−05 and the Logistic model 0.000134615. It should be noted that hGP was executed for 500 generations, which is a rather medium number of generations. Thus, better results could be achieved for larger number of generations.


## 4.3.2. Fitting Results for Sweden, The Netherlands, and Denmark Broadband Penetration

Table4 contains the initialization parameters for the execution of hGP concerning the dataset for The Netherlands-Sweden-Denmark countries.Table 4
Parameters initialization of the hGP.
Parameters of the hGP
Maximum number of generations
500
Evaluation function
SSE
Upper limit of the precision for the candidates for crossover and mutation
0.5The fitting performance for the first five hGP models, according to their fitness value (SSE) as well as the performance of the optimized diffusion models is presented in Figures11 and 12 for Sweden, Figures 13 and 14 for The Netherlands, and  Figures 15 and 16 for Denmark, respectively. The relative statistical indices SSE, MAPE, MSE, RMSE, and MAE of the produced hGP models are presented in Tables 5 and 6 for Sweden, Tables 7 and 8 for The Netherlands, and Tables 9 and 10 for Denmark.Table 5
Statistical indices of the first five produced hGP models (Sweden).
Statistical indices of the hGP for Sweden dataset
Model name
MAPE
SSE
MSE
RMSE
MAE
hGP Model 1
0.008675744
7.46756
E
-
05
4.63861
E
-
05
3.73378
E
-
06
0.001932299
hGP Model 2
0.009181524
8.90721
E
-
05
5.39797
E
-
05
4.45361
E
-
06
0.002110357
hGP Model 3
0.033258076
0.000264358
6.12299
E
-
05
1.32179
E
-
05
0.003635641
hGP Model 4
0.048504881
0.000515968
0.000103702
2.57984
E
-
05
0.005079212
hGP Model 5
0.04856113
0.000517456
0.000104259
2.58728
E
-
05
0.005086532Table 6
Representation of the statistics for the optimized diffusion models sorted by SSE (Sweden).
Statistical indices of the optimized diffusion models for Sweden dataset
Model name
MAPE
SSE
MSE
RMSE
MAE
Logistic
0.055827
0.001689
8.45
E
-
05
0.009191
0.007991
Bass
0.055827
0.001689
8.45
E
-
05
0.009191
0.007991
Gompertz with constant
0.083396
0.002071
0.000104
0.010175
0.009002
Gompertz
0.086425
0.003551
0.000178
0.013326
0.011753Table 7
Statistical indices of the first five produced hGP models (The Netherlands).
Statistical indices of hGP for The Netherlands dataset
Model name
MAPE
SSE
MSE
RMSE
MAE
hGP Model 1
0.013729
0.00018787
9.39
E
-
06
0.003065
0.002343
hGP Model 2
0.012842
0.00018848
9.42
E
-
06
0.00307
0.002304
hGP Model 3
0.01377
0.00019367
9.68
E
-
06
0.003112
0.002264
hGP Model 4
0.01377
0.00019367
9.68
E
-
06
0.003112
0.002264
hGP Model 5
0.010985
0.00020294
1.01
E
-
05
0.003185
0.002155Table 8
Statistics for the optimized diffusion models sorted by SSE (The Netherlands).
Statistical indices of the optimized diffusion models for The Netherlands dataset
Model name
MAPE
SSE
MSE
RMSE
MAE
Logistic
0.015446
0.00023692
1.18
E
-
05
0.003442
0.002548
Bass
0.015447
0.00023692
1.18
E
-
05
0.003442
0.002548
Gompertz with constant
0.031535
0.000412654
2.06
E
-
05
0.004542
0.003828
Gompertz
0.07946
0.001367898
6.84
E
-
05
0.00827
0.007501Table 9
Statistical indices of the first five produced hGP models (Denmark).
Statistical indices of hGP for Denmark dataset
Model name
MAPE
SSE
MSE
RMSE
MAE
hGP Model 1
0.045512
0.000566649
2.83324
E
-
05
0.005323
0.004332
hGP Model 2
0.047466
0.000599483
2.99742
E
-
05
0.005475
0.004452
hGP Model 3
0.047487
0.000599823
2.99912
E
-
05
0.005476
0.004453
hGP Model 4
0.047489
0.000599875
2.99938
E
-
05
0.005477
0.004454
hGP Model 5
0.047531
0.000600572
3.00286
E
-
05
0.00548
0.004456Table 10
Statistics for the optimized diffusion models sorted by SSE (Denmark).
Statistical indices of the optimized diffusion models for Denmark dataset
Model name
MAPE
SSE
MSE
RMSE
MAE
Logistic
0.049134
0.001110701
5.55
E
-
05
0.007452
0.006494
Bass
0.049134
0.001110704
5.55
E
-
05
0.007452
0.006494
Gompertz with constant
0.049134
0.001110701
5.55
E
-
05
0.007452
0.006494
Gompertz
0.049134
0.001110704
5.55
E
-
05
0.007452
0.006494Figure 11
The fitting performance of the first five hGP models for Sweden.Figure 12
The fitting performance of the optimized diffusion models for Sweden.Figure 13
The fitting performance of the first five hGP models for The Netherlands.Figure 14
The fitting performance of the optimized diffusion models for The Netherlands.Figure 15
The fitting performance of the first five hGP models for Denmark.Figure 16
The fitting performance of the optimized diffusion models for Denmark.According to Tables5 and 6, the hGP method achieves better statistical indices than those of the optimized diffusion models. For example, the first hGP model achieves an SSE value 7.46756E−05 while the Logistic model an SSE value of 0.001689.Once again, according to Tables7 and 8, the hGP method achieves better statistical indices than those of the optimized diffusion models.Finally, according to Tables9 and 10, the hGP method achieves better statistical indices than those of the optimized diffusion models. The first hGP model achieves an SSE value of 0.000566649 while the Logistic model 0.001110701.


## 4.4. Forecasting Results

The forecasting results of the generated models by hGP are presented in this section as well as the comparison of the optimized diffusion models with the hGP’s models. The statistic indicator used for the forecasting process is the wSSE. Both hGP and the optimized diffusion models concerning the forecasting performance are presented in AppendixA.2.


### 4.4.1. Forecasting Results for the Overall OECD Broadband Penetration

Table11 contains the initialization parameters for the execution of hGP for the forecasting process. The whole dataset of the OECD countries contains 18 data points (2 points per year since 2002 until 2010). The forecasting method for a 2-year prediction uses 14 points (data for hGP training) of the dataset and implements the statistical indices to this 14-point subset. The graph of the forecasting performance is shown in Figure 17. In every graph, the forecast period window is presented into the blue rectangle.Table 11
Initialization parameters of hGP.
Parameters of the hGP
Maximum number of generations
500
Evaluation function
wSSE
Upper limit of the precision for the candidates for crossover and mutation
0.09Figure 17
The forecasting performance of hGP (forecast period—2 years ahead).The relative statistical indices, for the training points, of the produced forecasting hGP models are presented in Table12.Table 12
Statistical indices of the first five produced forecasting hGP models for OECD overall.
Statistical indices of the hGP for OECD forecasting (14 points training)
Model name
MAPE
wSSE
MSE
RMSE
MAE
hGP Model 1
0.009744
3.67091
E
-
05
4.02
E
-
06
0.002005
0.001412
hGP Model 2
0.014944
4.00502
E
-
05
4.82
E
-
06
0.002195
0.001608
hGP Model 3
0.014527
4.55281
E
-
05
5.38
E
-
06
0.002319
0.001683
hGP Model 4
0.019881
5.2309
E
-
05
6.65
E
-
06
0.002579
0.002041
hGP Model 5
0.020006
5.40818
E
-
05
6.86
E
-
06
0.00262
0.002063The forecasting performance of the optimized diffusion models, according to their fitness value (wSSE) for the 14 training points, is presented in Figure18 and their statistical indices in Table 13.Table 13
Representation of the statistics for the optimized diffusion models sorted by wSSE (forecast period—2 years ahead).
Statistical indices of the optimized diffusion models for OECD forecasting (14-point training)
Model name
MAPE
wSSE
MSE
RMSE
MAE
Logistic
0.016716
6.13566
E
-
05
7.18
E
-
06
0.002679
0.002025
Bass
0.016716
6.13573
E
-
05
7.18
E
-
06
0.002679
0.002025
Gompertz with constant
0.021155
6.98404
E
-
05
8.51
E
-
06
0.002917
0.002349
Gompertz
0.022379
9.5999
E
-
05
1.08
E
-
05
0.003284
0.002678Figure 18
The forecasting performance of the optimized diffusion models (forecast period—2 years ahead).Considering Tables12 and 13, the conclusion is that the hGP method achieves better statistical indices than those of the optimized diffusion models. We can see that the first hGP model achieves a wSSE value 3.67091E−05 while the Logistic model 6.13566E−05. The comparison of the models residuals against time (data points), especially for the 4 last data points (the forecast period), shows the predominance of the hGP models (see Figure 19).Figure 19
The forecasting performance of the models (forecast period—2 years ahead).


### 4.4.2. Forecasting Results for the Sweden-The Netherlands-Denmark Broadband Penetration

Table14 contains the initialization parameters for the execution of hGP in the forecasting process. The datasets of Sweden, The Netherlands, and Denmark contain 20 data points (2 points per year since 2001 until 2010). The forecasting method for a 2-year prediction uses 16 data points for hGP training of the dataset and implements the statistical indices to the subset of the training points. The graphs of the forecasting performance of the hGP and optimized diffusion models are shown in Figures 20 and 21 for Sweden, Figures 23 and 24 for The Netherlands, and Figures 26 and 27 for Denmark, respectively. The relative statistical indices for the training data are presented in Tables 15 and 16 for Sweden, Tables 17 and 18 for The Netherlands, and Tables 19 and 20 for Denmark. Finally, the statistical indices, MAPE and MAE, that describe the forecasting performance of the models in a forecasting horizon of 2-years are presented in Figures 22, 25, and 28 for the three countries.Table 14
Parameters initialization of hGP.
Parameters of the hGP
Maximum number of generations
500
Evaluation function
wSSE
Upper limit of the precision for the candidates for crossover and mutation
0.9Table 15
Statistical indices of the first five produced hGP models (Sweden) forecast period—2 years.
Statistical indices of hGP for Sweden dataset (16-point training)
Model name
MAPE
wSSE
MSE
RMSE
MAE
hGP Model 1
0.011145
5.53
E
-
05
4.81
E
-
06
0.002192
0.001692
hGP Model 2
0.008093
5.66
E
-
05
4.71
E
-
06
0.002171
0.001546
hGP Model 3
0.008504
5.67
E
-
05
4.69
E
-
06
0.002166
0.001538
hGP Model 4
0.008105
5.69
E
-
05
4.74
E
-
06
0.002176
0.001549
hGP Model 5
0.008151
5.79
E
-
05
4.81
E
-
06
0.002192
0.001557Table 16
Statistics for the optimized diffusion models sorted by wSSE (Sweden) forecast period—2 years.
Statistical indices of the optimized diffusion models for Sweden dataset (16-point training)
Model name
MAPE
wSSE
MSE
RMSE
MAE
Logistic
0.054539
0.000433
5.03
E
-
05
0.007089
0.006376
Bass
0.054539
0.000433
5.03
E
-
05
0.007089
0.006376
Gompertz with constant
0.06964
0.000513
6.58
E
-
05
0.008114
0.007267
Gompertz
0.054088
0.000825
8.47
E
-
05
0.009202
0.007889Table 17
Statistical indices of the first five produced hGP models for The Netherlands (forecast period—2 years).
Statistical indices of hGP for The Netherlands dataset (16-point training)
Model name
MAPE
wSSE
MSE
RMSE
MAE
hGP Model 1
0.014673
0.000100
8.58
E
-
06
0.002929
0.002194
hGP Model 2
0.017209
0.000103
8.84
E
-
06
0.002973
0.00227
hGP Model 3
0.017209
0.000103
8.84
E
-
06
0.002973
0.00227
hGP Model 4
0.017223
0.000103
8.85
E
-
06
0.002975
0.002271
hGP Model 5
0.017253
0.000103
8.86
E
-
06
0.002976
0.002272Table 18
Statistics for the optimized diffusion models sorted by wSSE for The Netherlands (forecast period—2 years).
Statistical indices of the optimized diffusion models for The Netherlands dataset (16-point training)
Model name
MAPE
wSSE
MSE
RMSE
MAE
Logistic
0.018228
7.31
E
-
05
7.36
E
-
06
0.002712
0.002069
Bass
0.018228
7.31
E
-
05
7.36
E
-
06
0.002712
0.002069
Gompertz with constant
0.033352
0.000162
1.76
E
-
05
0.004199
0.003502
Gompertz
0.074251
0.000437
5.84
E
-
05
0.007639
0.006336Table 19
Statistical indices of the first five produced hGP models for Denmark (forecast period—2 years).
Statistical indices of the hGP for Denmark dataset (16-point training)
Model name
MAPE
wSSE
MSE
RMSE
MAE
hGP Model 1
0.024844
3.39655
E
-
05
7.25
E
-
06
0.002692
0.002018
hGP Model 2
0.024808
6.20484
E
-
05
1.02
E
-
05
0.003201
0.002468
hGP Model 3
0.022951
6.42515
E
-
05
1.05
E
-
05
0.003233
0.002483
hGP Model 4
0.022944
6.42636
E
-
05
1.05
E
-
05
0.003233
0.002483
hGP Model 5
0.022944
6.42636
E
-
05
1.05
E
-
05
0.003233
0.002483Table 20
Statistics for the optimized diffusion
models sorted by wSSE for Denmark (forecast period—2
years).
Statistical
indices of the optimized diffusion models for Denmark dataset
(16-point training)
Model
name
MAPE
wSSE
MSE
RMSE
MAE
Logistic
0.058957
0.000319962
4.33
E
-
05
0.006582
0.005759
Bass
0.048066
0.000362021
4.14
E
-
05
0.006434
0.005734
Gompertz
with
constant
0.05776
0.000562689
6.02
E
-
05
0.007756
0.007007
Gompertz
0.042059
0.000683336
6.6
E
-
05
0.008125
0.006943Figure 20
The forecasting performance of the first five hGP models for Sweden (forecast period—2 years ahead).Figure 21
The forecasting performance of the optimized diffusion models for Sweden (forecast period—2 years ahead).Figure 22
The forecasting performance of the models for Sweden (forecast period—2 years ahead).Figure 23
The forecasting performance of the first five hGP models and the optimized diffusion models for The Netherlands (forecast period—2 years ahead).Figure 24
The forecasting performance of the optimized diffusion models for The Netherlands (forecast period—2 years ahead).Figure 25
The forecasting performance of the models for The Netherlands (forecast period—2 years ahead).Figure 26
The forecasting performance of the first five hGP models for Denmark (forecast period—2 years ahead).Figure 27
The forecasting performance of the optimized diffusion models for Denmark (forecast period—2 years ahead).Figure 28
The forecasting performance of the optimized diffusion models for Denmark (forecast period—2 years ahead).(
1
) Forecasting Results for Sweden Broadband Penetration
Considering Tables15 and 16, it is concluded that the hGP method again achieves better statistical indices than those of the optimized diffusion models for the training subset. The first hGP model has a wSSE value of 5.53E−05 while the Logistic model 0.000433. It should be mentioned that the hGP achieves a satisfactory performance after the 16th data point, with minimized residuals (errors), MAPE and MAE for the last 4 data points (2-year forecast horizon, see Figure 22).(
2
)  Forpecasting Results for The Netherlands Broadband Penetration
Further commenting on the forecasting results, according to Tables17 and 18, it is concluded that the hGP method again achieves better statistical indices than those of the optimized diffusion models for the 16-point training subset. The first hGP model shows a wSSE value of 0.00010 while the Logistic and Bass models 7.31E-05. Both parts, the hGP and diffusion models, specially Logistic and Bass models, achieve well enough performance after the 16th data point, with minimized residuals (errors) for the last 4 data points (2-year forecast horizon, see Figure 25).(
3
)  Forecasting Results for Denmark Broadband Penetration
Finally, according to Tables19 and 20, once again the hGP method achieves better statistical indices than those of the optimized diffusion models for the training subset. The first hGP model achieves a wSSE value of 3.39655E−05 while the Logistic model 0.000319962. The hGP achieves well enough performance after the 16th data point, with minimized residuals (errors), MAPE and MAE for the last 4 data points (2-year forecast horizon, see Figure 28).


## 4.4.1. Forecasting Results for the Overall OECD Broadband Penetration

Table11 contains the initialization parameters for the execution of hGP for the forecasting process. The whole dataset of the OECD countries contains 18 data points (2 points per year since 2002 until 2010). The forecasting method for a 2-year prediction uses 14 points (data for hGP training) of the dataset and implements the statistical indices to this 14-point subset. The graph of the forecasting performance is shown in Figure 17. In every graph, the forecast period window is presented into the blue rectangle.Table 11
Initialization parameters of hGP.
Parameters of the hGP
Maximum number of generations
500
Evaluation function
wSSE
Upper limit of the precision for the candidates for crossover and mutation
0.09Figure 17
The forecasting performance of hGP (forecast period—2 years ahead).The relative statistical indices, for the training points, of the produced forecasting hGP models are presented in Table12.Table 12
Statistical indices of the first five produced forecasting hGP models for OECD overall.
Statistical indices of the hGP for OECD forecasting (14 points training)
Model name
MAPE
wSSE
MSE
RMSE
MAE
hGP Model 1
0.009744
3.67091
E
-
05
4.02
E
-
06
0.002005
0.001412
hGP Model 2
0.014944
4.00502
E
-
05
4.82
E
-
06
0.002195
0.001608
hGP Model 3
0.014527
4.55281
E
-
05
5.38
E
-
06
0.002319
0.001683
hGP Model 4
0.019881
5.2309
E
-
05
6.65
E
-
06
0.002579
0.002041
hGP Model 5
0.020006
5.40818
E
-
05
6.86
E
-
06
0.00262
0.002063The forecasting performance of the optimized diffusion models, according to their fitness value (wSSE) for the 14 training points, is presented in Figure18 and their statistical indices in Table 13.Table 13
Representation of the statistics for the optimized diffusion models sorted by wSSE (forecast period—2 years ahead).
Statistical indices of the optimized diffusion models for OECD forecasting (14-point training)
Model name
MAPE
wSSE
MSE
RMSE
MAE
Logistic
0.016716
6.13566
E
-
05
7.18
E
-
06
0.002679
0.002025
Bass
0.016716
6.13573
E
-
05
7.18
E
-
06
0.002679
0.002025
Gompertz with constant
0.021155
6.98404
E
-
05
8.51
E
-
06
0.002917
0.002349
Gompertz
0.022379
9.5999
E
-
05
1.08
E
-
05
0.003284
0.002678Figure 18
The forecasting performance of the optimized diffusion models (forecast period—2 years ahead).Considering Tables12 and 13, the conclusion is that the hGP method achieves better statistical indices than those of the optimized diffusion models. We can see that the first hGP model achieves a wSSE value 3.67091E−05 while the Logistic model 6.13566E−05. The comparison of the models residuals against time (data points), especially for the 4 last data points (the forecast period), shows the predominance of the hGP models (see Figure 19).Figure 19
The forecasting performance of the models (forecast period—2 years ahead).


## 4.4.2. Forecasting Results for the Sweden-The Netherlands-Denmark Broadband Penetration

Table14 contains the initialization parameters for the execution of hGP in the forecasting process. The datasets of Sweden, The Netherlands, and Denmark contain 20 data points (2 points per year since 2001 until 2010). The forecasting method for a 2-year prediction uses 16 data points for hGP training of the dataset and implements the statistical indices to the subset of the training points. The graphs of the forecasting performance of the hGP and optimized diffusion models are shown in Figures 20 and 21 for Sweden, Figures 23 and 24 for The Netherlands, and Figures 26 and 27 for Denmark, respectively. The relative statistical indices for the training data are presented in Tables 15 and 16 for Sweden, Tables 17 and 18 for The Netherlands, and Tables 19 and 20 for Denmark. Finally, the statistical indices, MAPE and MAE, that describe the forecasting performance of the models in a forecasting horizon of 2-years are presented in Figures 22, 25, and 28 for the three countries.Table 14
Parameters initialization of hGP.
Parameters of the hGP
Maximum number of generations
500
Evaluation function
wSSE
Upper limit of the precision for the candidates for crossover and mutation
0.9Table 15
Statistical indices of the first five produced hGP models (Sweden) forecast period—2 years.
Statistical indices of hGP for Sweden dataset (16-point training)
Model name
MAPE
wSSE
MSE
RMSE
MAE
hGP Model 1
0.011145
5.53
E
-
05
4.81
E
-
06
0.002192
0.001692
hGP Model 2
0.008093
5.66
E
-
05
4.71
E
-
06
0.002171
0.001546
hGP Model 3
0.008504
5.67
E
-
05
4.69
E
-
06
0.002166
0.001538
hGP Model 4
0.008105
5.69
E
-
05
4.74
E
-
06
0.002176
0.001549
hGP Model 5
0.008151
5.79
E
-
05
4.81
E
-
06
0.002192
0.001557Table 16
Statistics for the optimized diffusion models sorted by wSSE (Sweden) forecast period—2 years.
Statistical indices of the optimized diffusion models for Sweden dataset (16-point training)
Model name
MAPE
wSSE
MSE
RMSE
MAE
Logistic
0.054539
0.000433
5.03
E
-
05
0.007089
0.006376
Bass
0.054539
0.000433
5.03
E
-
05
0.007089
0.006376
Gompertz with constant
0.06964
0.000513
6.58
E
-
05
0.008114
0.007267
Gompertz
0.054088
0.000825
8.47
E
-
05
0.009202
0.007889Table 17
Statistical indices of the first five produced hGP models for The Netherlands (forecast period—2 years).
Statistical indices of hGP for The Netherlands dataset (16-point training)
Model name
MAPE
wSSE
MSE
RMSE
MAE
hGP Model 1
0.014673
0.000100
8.58
E
-
06
0.002929
0.002194
hGP Model 2
0.017209
0.000103
8.84
E
-
06
0.002973
0.00227
hGP Model 3
0.017209
0.000103
8.84
E
-
06
0.002973
0.00227
hGP Model 4
0.017223
0.000103
8.85
E
-
06
0.002975
0.002271
hGP Model 5
0.017253
0.000103
8.86
E
-
06
0.002976
0.002272Table 18
Statistics for the optimized diffusion models sorted by wSSE for The Netherlands (forecast period—2 years).
Statistical indices of the optimized diffusion models for The Netherlands dataset (16-point training)
Model name
MAPE
wSSE
MSE
RMSE
MAE
Logistic
0.018228
7.31
E
-
05
7.36
E
-
06
0.002712
0.002069
Bass
0.018228
7.31
E
-
05
7.36
E
-
06
0.002712
0.002069
Gompertz with constant
0.033352
0.000162
1.76
E
-
05
0.004199
0.003502
Gompertz
0.074251
0.000437
5.84
E
-
05
0.007639
0.006336Table 19
Statistical indices of the first five produced hGP models for Denmark (forecast period—2 years).
Statistical indices of the hGP for Denmark dataset (16-point training)
Model name
MAPE
wSSE
MSE
RMSE
MAE
hGP Model 1
0.024844
3.39655
E
-
05
7.25
E
-
06
0.002692
0.002018
hGP Model 2
0.024808
6.20484
E
-
05
1.02
E
-
05
0.003201
0.002468
hGP Model 3
0.022951
6.42515
E
-
05
1.05
E
-
05
0.003233
0.002483
hGP Model 4
0.022944
6.42636
E
-
05
1.05
E
-
05
0.003233
0.002483
hGP Model 5
0.022944
6.42636
E
-
05
1.05
E
-
05
0.003233
0.002483Table 20
Statistics for the optimized diffusion
models sorted by wSSE for Denmark (forecast period—2
years).
Statistical
indices of the optimized diffusion models for Denmark dataset
(16-point training)
Model
name
MAPE
wSSE
MSE
RMSE
MAE
Logistic
0.058957
0.000319962
4.33
E
-
05
0.006582
0.005759
Bass
0.048066
0.000362021
4.14
E
-
05
0.006434
0.005734
Gompertz
with
constant
0.05776
0.000562689
6.02
E
-
05
0.007756
0.007007
Gompertz
0.042059
0.000683336
6.6
E
-
05
0.008125
0.006943Figure 20
The forecasting performance of the first five hGP models for Sweden (forecast period—2 years ahead).Figure 21
The forecasting performance of the optimized diffusion models for Sweden (forecast period—2 years ahead).Figure 22
The forecasting performance of the models for Sweden (forecast period—2 years ahead).Figure 23
The forecasting performance of the first five hGP models and the optimized diffusion models for The Netherlands (forecast period—2 years ahead).Figure 24
The forecasting performance of the optimized diffusion models for The Netherlands (forecast period—2 years ahead).Figure 25
The forecasting performance of the models for The Netherlands (forecast period—2 years ahead).Figure 26
The forecasting performance of the first five hGP models for Denmark (forecast period—2 years ahead).Figure 27
The forecasting performance of the optimized diffusion models for Denmark (forecast period—2 years ahead).Figure 28
The forecasting performance of the optimized diffusion models for Denmark (forecast period—2 years ahead).(
1
) Forecasting Results for Sweden Broadband Penetration
Considering Tables15 and 16, it is concluded that the hGP method again achieves better statistical indices than those of the optimized diffusion models for the training subset. The first hGP model has a wSSE value of 5.53E−05 while the Logistic model 0.000433. It should be mentioned that the hGP achieves a satisfactory performance after the 16th data point, with minimized residuals (errors), MAPE and MAE for the last 4 data points (2-year forecast horizon, see Figure 22).(
2
)  Forpecasting Results for The Netherlands Broadband Penetration
Further commenting on the forecasting results, according to Tables17 and 18, it is concluded that the hGP method again achieves better statistical indices than those of the optimized diffusion models for the 16-point training subset. The first hGP model shows a wSSE value of 0.00010 while the Logistic and Bass models 7.31E-05. Both parts, the hGP and diffusion models, specially Logistic and Bass models, achieve well enough performance after the 16th data point, with minimized residuals (errors) for the last 4 data points (2-year forecast horizon, see Figure 25).(
3
)  Forecasting Results for Denmark Broadband Penetration
Finally, according to Tables19 and 20, once again the hGP method achieves better statistical indices than those of the optimized diffusion models for the training subset. The first hGP model achieves a wSSE value of 3.39655E−05 while the Logistic model 0.000319962. The hGP achieves well enough performance after the 16th data point, with minimized residuals (errors), MAPE and MAE for the last 4 data points (2-year forecast horizon, see Figure 28).


## 5. Conclusions

This paper introduces a new GP method that produces fitting and forecasting solutions models with well enough performance. The whole process is assisted by the insertion of some widely used diffusion models like Logistic, Gompertz family, and Bass, in the initial population of the chromosomes. The hGP method was implemented with a dataset concerning the overall broadband penetration of the OECD countries, as well as the datasets of Sweden, The Netherlands, and Denmark which are pioneers in broadband technologies. Both the fitting and the forecasting performance of the method presented satisfactory statistical indices.The proposed method differs from the classic GP method in several points. First, some well-known diffusion models, Logistic, Gompertz family, and Bass, which have been optimized by regression analysis, have been inserted in the randomly generated initial population. Second, the regression process has been implemented for each chromosome and after each crossover and mutation operation in order to maximize the algorithm’s efficiency. Also, the crossover and mutation processes are implemented by a random selection of individuals from a sorted list which contains the chromosomes with the best performance.In general, the produced hGP could be considered as a tool which generates solutions with well enough performance in fitting and forecasting of the broadband penetration.In this paper, the forecasting horizon of hGP was two years ahead. A further investigation of the hGP performance for a longer forecast horizon would be desirable. It should be noted that the hGP method performance could be further improved with the insertion of more functions into the function set. A future study with an enrichment of the function set of the hGP could thus be considered.



---

*Source: 904797-2012-10-02.xml*