# Spatial Approach of Artificial Neural Network for Solar Radiation Forecasting: Modeling Issues

Authors: Yashwant Kashyap; Ankit Bansal; Anil K. Sao
Journal: Journal of Solar Energy
 (2015)

---

## Abstract

Design of neural networks architecture has been done on setting up the number of neurons, delays, and activation functions. The expected model was initiated and tested with Indian solar horizontal irradiation (GHI) metrological data. The results are assessed using the effect of different statistical errors. The effort is made to verify simulation capability of ANN architecture accurately, on hourly radiation data. ANN model is a well-organized technique to estimate the radiation using different meteorological database. In this paper, we have used nine spatial neighbour locations and 10 years of data for assessment of neural network. Hence, overall 90 different inputs are compared, on customized ANN model. Results show the flexibility with respect to spatial orientation of model inputs.


---

## Body

## 1. Introduction

Utility working in the field of solar energy production is compulsory to develop its forecast ability in diverse climatic situation [1, 2]. Unusual fluctuations occur in direct and diffuse incident irradiation (up to 100%), due to existence of clouds [3, 4].In recent years, artificial neural networks (ANN) have been used for forecasting and regression of solar radiation in different latitudes and climate conditions. Since its development, no accurate method has been found to solve stability and uncertainty of delayed networks. Therefore, delayed network stability study has gain additional importance. In recent years, awareness of delayed neural networks has increased. It is necessary for the ANN to appear in globally stable region. A numbers of method have been developed to determine optimum numeral of delays, especially, by means of cross validation [5–11].Numerous researchers have made efforts and suggested techniques for setting number of neuron in artificial neural network. In 2011, Gonzalez-Carrasco et al. considered a new method of optimizing the number of neurons in data mining. In 1998, Fujita documented numerical approximation of the number of neurons of the neural network. In 1997, Tamura and Tateishi observed that in standard Akaike recovered neuron produced independently. In 2003, Zhang et al. develop suitable methods for neurons. In 1995 Li et al. observed voluntary approach neurons of the time series prediction [12–16].Most important works has been done towards using of activation functions. Jordan obtain the logistic function which is a standard design of the next prospect in a binary classification convolution [17]. Yao and Liu enhanced the structure of complete networks with two strange activation function, those are sigmoid and Gaussian basis [18]. Sopena et al. available number of test appearance on multilayer feed forward networks used a sine activation function [19, 20]. However, the difficulty along with transfer functions is not a theoretical condition for their selection [21].The literature assessment demonstrates that the ANNs have not been used for spatial domain analysis. In this paper, consider such special characteristics of spatial domain with solar radiation time series data. Associated study considered source of3×3 spatial matrixes and 10 years of time series. Spatiotemporal aspect has been used for ANN analysis. Results are evaluated with standard statistics errors. All spatial inputs are tested based on delay, neurons, and activation functions as modeling factor.


## 2. Data Processing

### 2.1. Data Collection

The default value of the radiation area is about 1360 Wm−2 and carries diffuse horizontal radiation (GHI) and direct normal irradiation (DNI). These two terms are used to calculate the global horizontal irradiation (GHI) as follows:
(1)GHI=DHI+DNI*cos⁡Φ,
where Φ is the solar zenith angle [22]. Longitudinal data for India in the form of 10 kilometers (0.1°×0.1° resolution) points in space [23] are available. Sunny satellites are used every hour from January 2003 to June 2012. This work includes the latitude and longitude 31.85°–33.65° and 74.65°–78.45° accumulated in GHI in northern India, as shown in Figure 1. The data are in a rectangular grid 400×400 km² placed. The GHI exists in a particular time zone 5.5 to a central location of the proposed area in Figure 2 for 5,000 hours of 2008.Figure 1
Spatial distribution of solar radiation and data points.Figure 2
Global horizontal irradiation plot (GHI) of 5000 hours.


### 2.2. Data Processing

Important approach of data mining is used to scale the input and target in the ANN. Thus, the normalization is used with the standard deviation and the mean of the training data set. Therefore, for the data of solar radiation with a zero mean and standard deviation unit of the next equation:(2)y=x-xmean*ystdxstd+ymean,
where y, ymean, ystd, x, xmean, and xstd data sets are data, mean, and slandered deviation of target and data and mean and slandered deviation of training set, respectively.The data sets are in form of time series and require interpreting into spatial domain. The input data sets are prepared primarily in physical position allocating to topology function. Using a rectangular grid function may also be used similar to hexagon or random topology. It begins with input data in a rectangular grid similar to that shown in Figure3 for an instance. Assume that spatial data are in 3×3 arrays of nine different locations. The input 1 has position (1, 1), input 2 has the position (1, 2), input 3 has the positions (1, 3) and (2, 1), and so forth. Another three-dimensional topology of spatial data set is shown in Figure 4. The center input has neighbourhoods of increasing diameter nearby it. A neighbourhood of diameter 1 includes the center and its instant neighbours. The neighbourhood of diameter 2 consists of the diameter 1 and its immediate neighbours. The rectangular topology function and all the neighbourhoods for a multiple input map are characterized by an M-by-M matrix of distance.Figure 3
Spatial approach of Neural Network distribution in 2D of Solar Radiation.Figure 4
Spatial approach of Neural Network distribution in 3D of Solar Radiation.


## 2.1. Data Collection

The default value of the radiation area is about 1360 Wm−2 and carries diffuse horizontal radiation (GHI) and direct normal irradiation (DNI). These two terms are used to calculate the global horizontal irradiation (GHI) as follows:
(1)GHI=DHI+DNI*cos⁡Φ,
where Φ is the solar zenith angle [22]. Longitudinal data for India in the form of 10 kilometers (0.1°×0.1° resolution) points in space [23] are available. Sunny satellites are used every hour from January 2003 to June 2012. This work includes the latitude and longitude 31.85°–33.65° and 74.65°–78.45° accumulated in GHI in northern India, as shown in Figure 1. The data are in a rectangular grid 400×400 km² placed. The GHI exists in a particular time zone 5.5 to a central location of the proposed area in Figure 2 for 5,000 hours of 2008.Figure 1
Spatial distribution of solar radiation and data points.Figure 2
Global horizontal irradiation plot (GHI) of 5000 hours.


## 2.2. Data Processing

Important approach of data mining is used to scale the input and target in the ANN. Thus, the normalization is used with the standard deviation and the mean of the training data set. Therefore, for the data of solar radiation with a zero mean and standard deviation unit of the next equation:(2)y=x-xmean*ystdxstd+ymean,
where y, ymean, ystd, x, xmean, and xstd data sets are data, mean, and slandered deviation of target and data and mean and slandered deviation of training set, respectively.The data sets are in form of time series and require interpreting into spatial domain. The input data sets are prepared primarily in physical position allocating to topology function. Using a rectangular grid function may also be used similar to hexagon or random topology. It begins with input data in a rectangular grid similar to that shown in Figure3 for an instance. Assume that spatial data are in 3×3 arrays of nine different locations. The input 1 has position (1, 1), input 2 has the position (1, 2), input 3 has the positions (1, 3) and (2, 1), and so forth. Another three-dimensional topology of spatial data set is shown in Figure 4. The center input has neighbourhoods of increasing diameter nearby it. A neighbourhood of diameter 1 includes the center and its instant neighbours. The neighbourhood of diameter 2 consists of the diameter 1 and its immediate neighbours. The rectangular topology function and all the neighbourhoods for a multiple input map are characterized by an M-by-M matrix of distance.Figure 3
Spatial approach of Neural Network distribution in 2D of Solar Radiation.Figure 4
Spatial approach of Neural Network distribution in 3D of Solar Radiation.


## 3. Artificial Neural Network (ANN)

### 3.1. Neural Networks for Hourly Solar Radiation

Artificial neural networks processing systems have ability to learn through information [24]. Figure 2 shows a classic demonstration for a neuron n architecture where I1,I2,I3,…,Im, w1n,w2n,w3n,…,wmn, bn, Xn, On, and f(·) are the signals, weights, bias, activation potential, output signal, and activation function, respectively. Afterwards, one can supervise that the neuron efficiency is given by
(3)On=fbn+∑i=1mwniXi.
Such usual network architecture is usually referred to as a multilayer neural network [25]. It is based on its topology and the amount of the weights in the input layer. The simplification of an artificial neural network is the capacity of replicating preferred signals for different input signals and the capacity of holding the dynamics of the system [26].However, to determine number of neurons in each layer is not trivial. Research articles have explained cases where underfitting and overfitting might occur when smaller and larger numbers of neurons are used in the network [16]. Numerous approaches have been used without success to find the appropriate method for computing the number of neurons in each layer [27]. However, due to their simplicity, these methods have been extensively utilized in time series analysis [28]. The ultimate outcome of ANN is group of weights and input variables for linear and nonlinear process [29, 30]. In this paper, we have used one-output nodes in the outer layer for forecasting of GHI. The accuracy of the various ANN models is compared to the most correct model of hourly solar radiation, as described below.Custom Network. Start network designing using toolbox offer special choice. To construct custom arrangements, start with an empty network and set its properties as special as shown in Figure 6. The network used numerous function properties that have been set in many ways, as desired for network architecture. In this section use the slight normal network and different spatial inputs. The input network recognizes normalized value range from −1 to +1 of radiation. The number of layers used for this network is two, initialized with the Nguyen Widrow layer initialization method and trained with the Levenberg-Marquardt as described below. To train greater number of layers it needs additional time. While there are simply 2 layers in solar radiation network for default custom models that can be trained for 1000 epochs, the literature described in terms of accuracy, when using 2 layers in ANN, is much higher than that of higher layers. Hence, we can consider the network with 2 hidden layers, which provides the highest precision value, as the most appropriate network for this problem. Any output vectors in output layer will learn to associate the connected target vectors with minimal mean squared error including weights and biases [29–32].


### 3.2. Neural Network Training

The LMA deliver enhanced performance as soon as being connected with classic back propagation processes. Due to Newton’s technique the networks modernized law is(4)wn+1=wn-Hn-1gn,wn+1=wn-JnTJn+εnI-1gn,
where w, n, H, g, J, I, and ε are the network weight matrix, number of repetitions, the Hessian matrix, the gradient matrix, the Jacobian matrix, the identity matrix, and a scalar, respectively [25].The projected networks were trained by 70% of the delivered data, whereas the continuing 15% was used for validation and remaining 15% was for testing the trained network. Thereafter, the trained networks were used for forecast using last 100 days of data. The suggested ANNs forecast the solar radiation at center point of position 5 from Figure3 (in terms of 2×2 matrix) from 2012 year of data, and at that time the forecast effects were equated through the measured data. Individually inputs of 9 spatial locations and 10 year of data (total 90) were verified separately by the hourly radiation values, and all of the suggested inputs were matched collectively by the RMSE values of solar radiation. These special networks were compared with training RMSE error.


## 3.1. Neural Networks for Hourly Solar Radiation

Artificial neural networks processing systems have ability to learn through information [24]. Figure 2 shows a classic demonstration for a neuron n architecture where I1,I2,I3,…,Im, w1n,w2n,w3n,…,wmn, bn, Xn, On, and f(·) are the signals, weights, bias, activation potential, output signal, and activation function, respectively. Afterwards, one can supervise that the neuron efficiency is given by
(3)On=fbn+∑i=1mwniXi.
Such usual network architecture is usually referred to as a multilayer neural network [25]. It is based on its topology and the amount of the weights in the input layer. The simplification of an artificial neural network is the capacity of replicating preferred signals for different input signals and the capacity of holding the dynamics of the system [26].However, to determine number of neurons in each layer is not trivial. Research articles have explained cases where underfitting and overfitting might occur when smaller and larger numbers of neurons are used in the network [16]. Numerous approaches have been used without success to find the appropriate method for computing the number of neurons in each layer [27]. However, due to their simplicity, these methods have been extensively utilized in time series analysis [28]. The ultimate outcome of ANN is group of weights and input variables for linear and nonlinear process [29, 30]. In this paper, we have used one-output nodes in the outer layer for forecasting of GHI. The accuracy of the various ANN models is compared to the most correct model of hourly solar radiation, as described below.Custom Network. Start network designing using toolbox offer special choice. To construct custom arrangements, start with an empty network and set its properties as special as shown in Figure 6. The network used numerous function properties that have been set in many ways, as desired for network architecture. In this section use the slight normal network and different spatial inputs. The input network recognizes normalized value range from −1 to +1 of radiation. The number of layers used for this network is two, initialized with the Nguyen Widrow layer initialization method and trained with the Levenberg-Marquardt as described below. To train greater number of layers it needs additional time. While there are simply 2 layers in solar radiation network for default custom models that can be trained for 1000 epochs, the literature described in terms of accuracy, when using 2 layers in ANN, is much higher than that of higher layers. Hence, we can consider the network with 2 hidden layers, which provides the highest precision value, as the most appropriate network for this problem. Any output vectors in output layer will learn to associate the connected target vectors with minimal mean squared error including weights and biases [29–32].


## 3.2. Neural Network Training

The LMA deliver enhanced performance as soon as being connected with classic back propagation processes. Due to Newton’s technique the networks modernized law is(4)wn+1=wn-Hn-1gn,wn+1=wn-JnTJn+εnI-1gn,
where w, n, H, g, J, I, and ε are the network weight matrix, number of repetitions, the Hessian matrix, the gradient matrix, the Jacobian matrix, the identity matrix, and a scalar, respectively [25].The projected networks were trained by 70% of the delivered data, whereas the continuing 15% was used for validation and remaining 15% was for testing the trained network. Thereafter, the trained networks were used for forecast using last 100 days of data. The suggested ANNs forecast the solar radiation at center point of position 5 from Figure3 (in terms of 2×2 matrix) from 2012 year of data, and at that time the forecast effects were equated through the measured data. Individually inputs of 9 spatial locations and 10 year of data (total 90) were verified separately by the hourly radiation values, and all of the suggested inputs were matched collectively by the RMSE values of solar radiation. These special networks were compared with training RMSE error.


## 4. Model Evaluation Criteria

Finally, the model has been selected based on the lowest forecasting error. The estimation of error can be many forms such as root mean square error (RMSE) and MAE (mean absolute error):(5)MAE=1n∑t=1nIt-It^,RMSE=1n∑t=1nIt-It^2.
In (5) there are different expressions for error estimation where It represents measured value at forecasted horizon t and It^ is forecasted value. Also n represents the total number of test samples. This validation process defines the model accuracy and stop iteration process for ANN model [33].


### 4.1. Model Behavior with Delays

In this section, we used one input at a time with delay out of 90 different radiation data. The hidden layer required was often (10) ten neurons; the input delay varies from one to thirty (30). For GHI, the wrong alarm frequency was constantly low while being trained on the maximum amount of past data [34]. All configuration models are tested for 30 times at continuous time delay of 1 to 30. The network has to optimize at minimum root mean square (RMSE) on the training data set [28].Figure7 and Table 1 illustrate an evaluation of measured and forecasted values by the suggested ANNs; this evaluation was built on hourly averages of global radiations. Established radiation on input numbers (from the Table 1) (IN-10, IN-3, and IN-9) had very small dissimilarity on global forecast. IN-10 was superior and then IN-3 in terms of radiation forecasting, but both had comparable values. IN-90 was the poorest between the suggested networks with the highest error in global radiation forecasting. It starts error with 32.23% RMSE at 5 delays and ends with 19.63% at 23 delays and further remains constant in between for all other inputs and delays.Table 1
Radiation forecasting; spatial comparison of ANN models with time delay.
Number of inputs
Training
Forecasting
Year
Delay
Column
Row
Ranking
Input radiation
MAE
RMSE
MAE
RMSE
10*
7.81*
16.55*
3.85*
19.63*
11*
23*
1*
1*
1*
GHI*
3**
9.24**
20.05**
4.03**
20.07**
12**
27**
1**
3**
2**
GHI**
9***
8.07***
16.88***
4.07***
20.17***
12***
26***
3***
3***
3***
GHI***
11
7.68
16.47
4.27
20.66
11
7
1
2
4
GHI
22
7.81
16
4.29
20.71
10
8
2
1
5
GHI
21
7.79
16.06
4.4
20.98
10
26
1
3
6
GHI
26
7.88
15.96
4.47
21.14
10
19
3
2
7
GHI
24
7.89
15.92
4.6
21.44
10
15
2
3
8
GHI
8
8.49
17.22
4.73
21.75
12
1
3
2
9
GHI
4
8.96
19.01
4.79
21.89
12
22
2
1
10
GHI
12
7.93
16.51
4.85
22.02
11
26
1
3
11
GHI
31
8.26
15.94
4.85
22.03
9
27
2
1
12
GHI
6
8.77
17.94
4.85
22.03
12
1
2
3
13
GHI
5
8.74
18.21
4.89
22.11
12
1
2
2
14
GHI
1
12.28
29.34
4.95
22.25
12
24
1
1
15
GHI
23
7.91
15.88
4.95
22.25
10
26
2
2
16
GHI
7
8.5
17.47
4.96
22.27
12
3
3
1
17
GHI
28
8.29
15.94
5.03
22.43
9
20
1
1
18
GHI
30
8.31
15.82
5.18
22.77
9
14
1
3
19
GHI
18
8.04
16.08
5.26
22.94
11
25
3
3
20
GHI
19
8.31
16.09
5.27
22.95
10
23
1
1
21
GHI
14
7.86
16.28
5.29
23.01
11
23
2
2
22
GHI
44
8.93
15.72
5.4
23.24
8
3
3
2
23
GHI
15
8.16
16.31
5.42
23.29
11
2
2
3
24
GHI
16
7.9
16.23
5.42
23.29
11
29
3
1
25
GHI
33
8.35
15.81
5.45
23.35
9
15
2
3
26
GHI
42
8.81
15.72
5.49
23.43
8
20
2
3
27
GHI
20
7.76
16.1
5.51
23.46
10
7
1
2
28
GHI
13
8
16.33
5.55
23.56
11
4
2
1
29
GHI
52
8.56
15.68
5.62
23.72
7
5
3
1
30
GHI
39
8.42
15.75
5.63
23.74
8
23
1
3
31
GHI
40
8.74
15.79
5.64
23.75
8
7
2
1
32
GHI
41
8.41
15.65
5.65
23.77
8
25
2
2
33
GHI
51
8.92
15.74
5.71
23.89
7
0
2
3
34
GHI
32
8.19
15.88
5.72
23.91
9
15
2
2
35
GHI
17
7.8
16.16
5.73
23.95
11
0
3
2
36
GHI
47
8.78
15.75
5.83
24.14
7
1
1
2
37
GHI
25
8.14
15.9
5.9
24.29
10
21
3
1
38
GHI
70
9.06
15.83
5.91
24.3
5
10
3
1
39
GHI
36
8.38
15.71
5.95
24.38
9
3
3
3
40
GHI
38
8.44
15.76
6.02
24.54
8
10
1
2
41
GHI
27
8.55
15.83
6.03
24.56
10
11
3
3
42
GHI
50
9.2
15.64
6.22
24.95
7
12
2
2
43
GHI
48
8.93
15.74
6.25
25
7
23
1
3
44
GHI
45
8.74
15.65
6.3
25.09
8
23
3
3
45
GHI
62
8.57
15.78
6.31
25.12
6
25
3
2
46
GHI
46
9.03
15.78
6.43
25.35
7
17
1
1
47
GHI
34
8.31
15.75
6.44
25.37
9
23
3
1
48
GHI
2
12.02
24.59
6.44
25.38
12
1
1
2
49
GHI
37
8.39
15.66
6.51
25.52
8
2
1
1
50
GHI
71
8.87
15.77
6.65
25.79
5
3
3
2
51
GHI
55
8.75
15.73
6.69
25.87
6
8
1
1
52
GHI
29
8.48
15.8
6.74
25.96
9
7
1
2
53
GHI
59
8.94
15.64
6.75
25.98
6
15
2
2
54
GHI
35
8.57
15.88
6.82
26.11
9
21
3
2
55
GHI
73
9
15.63
6.83
26.13
4
28
1
1
56
GHI
83
9.16
15.99
6.9
26.27
3
15
1
2
57
GHI
49
8.62
15.57
6.91
26.28
7
7
2
1
58
GHI
53
9.06
15.68
6.94
26.34
7
22
3
2
59
GHI
58
8.8
15.77
7.03
26.52
6
10
2
1
60
GHI
63
8.79
15.81
7.05
26.56
6
5
3
3
61
GHI
57
9.14
15.71
7.09
26.62
6
8
1
3
62
GHI
61
8.83
15.63
7.11
26.66
6
1
3
1
63
GHI
56
9.21
15.86
7.21
26.86
6
29
1
2
64
GHI
65
9.06
16.02
7.26
26.95
5
25
1
2
65
GHI
43
8.94
15.75
7.29
27.01
8
7
3
1
66
GHI
66
9.15
15.79
7.3
27.02
5
28
1
3
67
GHI
82
9.47
15.96
7.31
27.03
3
11
1
1
68
GHI
85
9.27
16.05
7.37
27.15
3
17
2
1
69
GHI
75
9.01
15.74
7.41
27.21
4
12
1
3
70
GHI
79
9.28
16.07
7.43
27.26
4
28
3
1
71
GHI
54
8.93
15.59
7.44
27.27
7
4
3
3
72
GHI
76
9.27
15.9
7.48
27.34
4
5
2
1
73
GHI
69
9.06
15.58
7.49
27.37
5
25
2
3
74
GHI
64
8.76
15.75
7.51
27.41
5
28
1
1
75
GHI
81
8.99
15.97
7.53
27.44
4
24
3
3
76
GHI
74
9.41
15.71
7.54
27.45
4
15
1
2
77
GHI
67
8.99
15.78
7.58
27.53
5
22
2
1
78
GHI
87
9.19
16.04
7.67
27.7
3
12
2
3
79
GHI
80
9.26
15.99
7.69
27.73
4
12
3
2
80
GHI
77
8.9
15.92
7.87
28.05
4
25
2
2
81
GHI
78
9.21
15.84
7.96
28.22
4
4
2
3
82
GHI
60
9.04
15.86
8.25
28.72
6
0
2
3
83
GHI
72
9.17
15.76
8.43
29.03
5
5
3
3
84
GHI
84
9.3
16.25
8.47
29.1
3
24
1
3
85
GHI
68
9.43
15.96
8.54
29.22
5
23
2
2
86
GHI
88
9.2
16.13
8.78
29.63
3
0
3
1
87
GHI
86
9.02
15.85
9.35
30.57
3
6
2
2
88
GHI
89
9.25
16.26
10.2
31.93
3
6
3
2
89
GHI
90
9.52
16.15
10.39
32.23
3
5
3
3
90
GHI
Stars (*) shows best three results in order.Table1 demonstrated a summary evaluation of the suggested models by percentage performance of the MAE, MSE, and RMSE. These results show that the solar radiation forecasting differs too much irrespective of ANN inputs. Forecasting is affected based on number of time delays applied in different ANN inputs. The delay decides the convergence property of ANN inputs. Table 1 shows that some of the input converges very fast with minimum error as IN-51 with 0 time delays and around 23.89 percent of testing RMSE error. Similarly other comparable methods of IN-16 show the 23.29 percent of testing RMSE error but long time delay (29). The hourly correlation factor between two clear skies days is almost one day, which is perfect for time series prediction considering the same interval. In terms of spatial analysis top best five testing results show percentage in RMSE 19.63, 20.07, 20.17, 20.66, and 20.71 of neighbour positions 11(1), 13(7), 33(9), 12(4), and 21(2) and delays of 23, 27, 26, 7, and 8. On the other hand, compare the worse results are 29.22, 29.63, 30.57, 31.93 and 32.23 of position 22(5), 31(3), 22(5), 32(6) and 33(9) with delay of 23, 0, 6, 6, and 5, respectively. From these results there is no special pattern of spatial position; this may be due to different delay correlate between inputs and outputs. But from results, position 5 appears in worst case as compared to the best performance from neighbour places. On the other hand, temporal analysis shows clear pattern between input and output with respect to different years of data. In the table, top best results are from 2011, 2012, 2012, 2011, and 2010, respectively. If compared with the worse results which are 2005, 2003, 2003, 2003, and 2003, respectively, it clearly shows that the best result performed by ANN model depends on closer year of data. The contribution of delay is random, some inputs perform well with higher delay and some perform at lower delay, it all depends on property of data with respect to time.


### 4.2. Model Behavior with Neurons

Table2 demonstrates that the projected neuron model offers superior results for evaluation. The current technique is used to control the number of neurons based on trial-and-error. It starts with minimum number of neurons and increased neuron to its maximum limit. The drawback is that it is time consuming and there is no surety of setting the neuron. The particular measures for 90 inputs used range of 10–300 neurons at interval of 10 neurons and target for a minimized MAE value. Since the smallest RMSE demonstrates the estimation method accuracy at local level or small number of data sets, MAE indicates global accuracy. In this case previous obtained outcome delays are used and standard transfer functions,hyperbolic tangent sigmoid (tansig), for respective numbers of inputs, are used as well.Table 2
Radiation forecasting; spatial comparison of ANN models with time delay and neurons.
Number of inputs
%performance (MAE)
%training
%forecasting
Year
Delay
Neurons
Column
Row
Ranking
Training
Validation
Testing
MSE
RMSE
MSE
RMSE
3*
3.61*
4.63*
3.98*
3.89*
19.72*
1.4*
25.25*
12*
27*
190*
1*
3*
1*
4**
3.14**
4.63**
4.08**
3.63**
19.04**
1.06**
25.97**
12**
22**
190**
2**
1**
2**
5***
2.52***
5.21***
4.12***
3.38***
18.38***
0.92***
25.64***
12***
1***
250***
2***
2***
3***
7
2.13
5.05
4.17
3.12
17.68
1.33
27.27
12
3
130
3
1
4
8
1.9
5.56
4.34
3.12
17.66
1.02
24.57
12
1
40
3
2
5
6
2.49
4.91
4.66
3.41
18.46
1.47
27.53
12
1
10
2
3
6
9
1.42
6.02
4.86
3.03
17.39
1.36
26.14
12
26
220
3
3
7
10
1.47
5.71
4.92
3.01
17.34
1.38
29.15
11
23
10
1
1
8
12
1.63
5.35
5.01
3.05
17.47
1.85
31.25
11
26
40
1
3
9
11
1.46
5.17
5.27
2.97
17.22
1.46
28.03
11
7
70
1
2
10
2
5.97
6.41
5.6
5.98
24.46
1.16
24.04
12
1
40
1
2
11
14
1.28
5.97
5.68
3.1
17.6
2.57
33.4
11
23
10
2
2
12
17
1.04
8.63
5.83
3.52
18.76
3.9
35.03
11
0
40
3
2
13
13
1.5
5.72
5.97
3.24
18
2.1
33.36
11
4
190
2
1
14
16
1.08
6.72
6.18
3.23
17.97
2.1
31.22
11
29
40
3
1
15
15
1.22
6.82
6.27
3.35
18.3
2.24
33.32
11
2
100
2
3
16
24
1.13
9.21
6.73
3.87
19.67
2.06
31.33
10
15
190
2
3
17
20
1.11
7.35
6.8
3.5
18.7
2.34
33.16
10
7
10
1
2
18
22
0.98
6.54
6.87
3.27
18.08
2.73
34.22
10
8
160
2
1
19
19
1.38
7.71
7
3.77
19.41
2.1
35.34
10
23
40
1
1
20
18
1.63
7.8
7.11
3.96
19.9
1.95
33.83
11
25
70
3
3
21
25
0.77
7.61
7.27
3.44
18.55
2.46
31.66
10
21
160
3
1
22
23
1.03
8.58
7.32
3.8
19.48
3.13
35.56
10
26
10
2
2
23
1
8.63
9.64
7.4
8.59
29.3
1.23
24.56
12
24
100
1
1
24
21
0.99
6.74
7.51
3.44
18.55
2.84
34.87
10
26
40
1
3
25
26
1.49
8.47
7.55
4.1
20.25
3.2
37.13
10
19
190
3
2
26
27
1.07
7.76
8.13
3.82
19.55
2.88
37.07
10
11
160
3
3
27
30
0.59
8.98
8.6
3.87
19.67
5.54
39.24
9
14
40
1
3
28
33
0.56
9.06
8.88
3.93
19.81
4.65
39.12
9
15
70
2
3
29
28
0.69
9.13
8.92
4.02
20.06
4.57
38.17
9
20
280
1
1
30
32
1.54
8.91
9.15
4.54
21.3
4.3
40.59
9
15
130
2
2
31
31
0.7
9.1
9.29
4.1
20.24
3.12
34.99
9
27
70
2
1
32
29
0.55
9.02
9.3
3.99
19.98
3.49
36.37
9
7
40
1
2
33
35
1.11
10.36
9.83
4.71
21.69
3.48
38.8
9
21
70
3
2
34
34
1.11
9.39
9.89
4.52
21.27
4.43
40.55
9
23
10
3
1
35
36
0.52
11.23
9.89
4.53
21.29
4.29
38.3
9
3
40
3
3
36
38
0.93
11.2
10.77
4.95
22.26
8.21
44.5
8
10
190
1
2
37
37
1.97
12.4
11.1
5.88
24.25
6.9
45.45
8
2
70
1
1
38
39
0.76
11.5
11.2
4.99
22.35
4.97
40.14
8
23
40
1
3
39
41
0.83
10.73
11.54
4.95
22.25
3.94
38.95
8
25
40
2
2
40
40
1.31
13.36
12.32
5.92
24.33
7.38
46.38
8
7
130
2
1
41
42
0.16
14.69
13.62
5.76
23.99
8.07
45.3
8
20
250
2
3
42
43
1.34
16.11
14.92
7.01
26.47
7.08
46.3
8
7
70
3
1
43
45
0.42
17.75
15.56
6.91
26.29
4.44
39.67
8
23
130
3
3
44
44
1.18
17.51
15.82
7.38
27.16
7.8
44.42
8
3
10
3
2
45
46
0.18
17.25
16.9
6.94
26.34
7.67
44.37
7
17
160
1
1
46
49
0.53
19.18
16.9
7.53
27.45
7.41
45.44
7
7
10
2
1
47
88
0.18
17.25
16.9
7.93
28.15
7.67
44.37
3
17
10
3
1
48
50
0.16
19.08
18.23
7.56
27.49
8.13
46.83
7
12
40
2
2
49
48
0.29
20.01
19.13
8
28.28
8.71
46.84
7
23
40
1
3
50
90
0.29
20.01
19.13
7.53
27.45
8.71
46.84
3
23
10
3
3
51
47
0.12
20.08
19.2
7.93
28.15
9.49
47.3
7
1
10
1
2
52
89
0.12
20.08
19.2
8
28.28
9.49
47.3
3
1
40
3
2
53
52
0.68
18.12
19.5
7.93
28.16
9.09
47.95
7
5
10
3
1
54
51
0.68
23.05
19.68
8.95
29.92
8.77
48.03
7
0
10
2
3
55
54
0.08
21.86
19.73
8.36
28.92
11
47.76
7
4
100
3
3
56
53
0.55
17.38
20.36
7.87
28.06
8.02
45.79
7
22
40
3
2
57
55
0.87
24.57
22.69
9.97
31.58
10.3
49.56
6
8
10
1
1
58
59
0.25
26.97
23.02
10.2
31.86
17.9
54.05
6
15
40
2
2
59
56
0.29
26.5
23.88
10.3
32.02
14.2
49.96
6
29
10
1
2
60
57
0.28
23.74
24.18
9.75
31.23
15.3
52.12
6
8
100
1
3
61
60
1.27
28.78
25.18
11.6
33.99
20.8
57.46
6
0
10
2
3
62
58
0.46
26.42
27.7
11.1
33.32
15.3
54.03
6
10
10
2
1
63
61
0.83
33.84
29.19
13.1
36.2
20.3
58.13
6
1
100
3
1
64
62
0.87
39.29
35.88
15.6
39.44
29
61.93
6
25
100
3
2
65
64
0.34
37.43
36.82
15.1
38.79
20.7
57.98
5
28
10
1
1
66
63
0.19
39.91
39.17
15.9
39.91
22.7
58.54
6
5
40
3
3
67
65
0.71
41.55
39.73
16.7
40.84
22.7
58.99
5
25
40
1
2
68
67
0.27
38.23
43.05
16.4
40.51
16.8
55.46
5
22
10
2
1
69
66
0.86
46.81
45.66
19
43.6
33.1
65.04
5
28
10
1
3
70
72
0.33
49.37
46.61
19.4
44.04
48.8
71.06
5
5
40
3
3
71
68
0.15
44.15
46.88
18.3
42.77
20.2
58.32
5
23
40
2
2
72
71
0.47
52.86
47.01
20.3
45
36.5
64.64
5
3
10
3
2
73
69
0.04
45.92
48.93
19
43.58
27.4
62.44
5
25
10
2
3
74
70
0.13
54.96
52.36
21.5
46.41
32.3
64.95
5
10
10
3
1
75
73
0.3
60.39
57.24
23.7
48.69
33.7
65.57
4
28
10
1
1
76
74
0.13
61.7
59.4
24.3
49.29
50.6
72.01
4
15
220
1
2
77
75
0.19
72.76
67.71
28.2
53.11
51.7
72.36
4
12
100
1
3
78
76
0.34
95.94
83.47
36.1
60.07
103
84.87
4
5
40
2
1
79
78
0.66
87.31
84.02
34.7
58.87
56.2
74.84
4
4
10
2
3
80
77
0.31
94.98
90.5
37.3
61.06
65.4
78.53
4
25
10
2
2
81
84
0.32
102.57
95.5
39.8
63.09
51.2
73.22
3
24
130
1
3
82
80
0.85
99.43
95.94
39.6
62.91
63.8
75.11
4
12
10
3
2
83
86
0.59
111.68
97.12
42.1
64.89
110
89.42
3
6
130
2
2
84
79
0.97
95.18
98.15
39.2
62.64
69.5
79.25
4
28
40
3
1
85
82
0.19
102.8
98.39
40.3
63.52
68.9
78.37
3
11
40
1
1
86
87
0.61
102.77
99.64
40.9
63.91
71.1
78.49
3
12
160
2
3
87
81
0.78
101.58
100.87
41
64
62.6
75.64
4
24
40
3
3
88
85
0.81
113.12
101.42
43.4
65.87
61.4
76.05
3
17
10
2
1
89
83
0.22
97.83
102.08
40.1
63.33
64
77.16
3
15
160
1
2
90The accuracy was tested by using the training sets results in each case. Figure8 and Table 2 show the results with all errors, performance coefficients, delays, and different neurons for each input. It is preferred that simplification capability increased while the number of neurons is increased. In solar radiation estimation problem, the precision degree of the productivity was 3.61, 4.63, and 3.98% in training, validation, and testing, respectively, while 190 neurons are used in IN-3 at delay (27). Comparatively the same result was obtained in IN-4, IN-5, IN-7, and IN-8 with 4.08, 4.12, 4.17, and 4.34% testing accuracy at 190, 250, 130, and 40 neuron with 22, 1, 3, and 1 delay. In terms of spatial analysis the top best five results show percentage testing MAE 3.98, 4.08, 4.12, 4.17, and 4.34% of positions 13(7), 21(2), 22(5), 31(3), and 32(6) considering the neurons 90, 190, 250, 130, and 40, respectively. This result shows that position does not give clear future of spatial orientation of radiation performance. On the other hand temporal analysis shows clear pattern between input and output with respect to different years of data. In the table, top best results are from 2012, 2012, 2012, 2012, and 2012, respectively. If compared with the worse results which are testing MAE errors 98.39, 99.64, 100.87, 101.42, and 102.08 of years 2003, 2003, 2004, 2003, and 2003, considering neurons 40, 160, 40, 10, and 160, respectively, it clearly shows that best result performed by ANN model depends on closer year of data similarly like delay case.


### 4.3. Model Behavior with Multiple Transfer Functions (Activation Functions)

In this study, different activation functions are used as shown in Figure9 that depend on different number of iterations for comparing their performances on radiation data. For every standard activation function, we used the number of neurons in the hidden layer as mentioned in neuron section for different inputs shown in Figure 8. After presenting in Table 3 different performance parameters, interpretations of their results will follow here. We used the different number of delays in the first section and different neurons in the second section and to compare different inputs with differences activation functions are described here. According to the first graph from Figure 10 generated by the all inputs are compare with the different activation functions. However, each input performs significantly different behavior with its one kind of function.Satlins activation function results perform the most successful one, for all the test parameters. However, the accuracy of the inputs was totally different in training and testing cases; higher accurate result (lowest MAE value) shows the inverse effect during testing case.Table 3
Radiation forecasting; spatial comparison of ANN models with time delay, neurons and transfer function.
Number of inputs
%performance (MAE)
%training
%forecasting
Year
Delay
Neurons
Transferfunction
Column
Row
Ranking
Training
Validation
Testing
MSE
RMSE
MSE
RMSE
11*
2.14*
4.32*
3.04*
2.76*
16.61*
0.78*
24.3*
11*
7*
70*
satlins*
1*
2*
1*
7**
2.86**
4.22**
3.08**
3.18**
17.83**
0.73**
24.51**
12**
3**
130**
compet**
3**
1**
2**
6***
3.12***
3.41***
3.13***
3.18***
17.83***
0.63***
22.2***
12***
1***
10***
hardlims***
2***
3***
3***
9
2.47
3.46
3.25
2.82
16.8
0.86
24.16
12
26
220
hardlim
3
3
4
15
2.14
3.6
3.29
2.66
16.31
1.35
27
11
2
100
purelin
2
3
5
29
1.63
4.76
3.33
2.6
16.12
0.69
25.05
9
7
40
compet
1
2
6
14
2.31
3.41
3.34
2.73
16.53
1.18
26.59
11
23
10
purelin
2
2
7
8
2.4
4.32
3.39
2.98
17.26
0.59
22.29
12
1
40
satlin
3
2
8
17
1.98
4.09
3.44
2.7
16.42
0.94
26.29
11
0
40
poslin
3
2
9
10
2.24
3.44
3.45
2.72
16.5
0.8
23.47
11
23
10
logsig
1
1
10
25
1.78
4.29
3.5
2.63
16.21
0.97
24.57
10
21
160
purelin
3
1
11
19
2
4.14
3.51
2.73
16.52
1.61
27.84
10
23
40
tansig
1
1
12
3
4.21
3.9
3.52
4.01
20.03
0.53
20.96
12
27
190
poslin
1
3
13
12
2.05
4.01
3.56
2.74
16.56
1.1
25.59
11
26
40
hardlims
1
3
14
5
2.79
4.52
3.59
3.29
18.15
0.44
21.05
12
1
250
poslin
2
2
15
26
1.82
4.31
3.6
2.68
16.36
1.6
29.29
10
19
190
compet
3
2
16
18
1.91
3.78
3.62
2.62
16.2
1.11
26.58
11
25
70
satlins
3
3
17
32
1.69
4.56
3.65
2.65
16.29
1.25
27.4
9
15
130
satlins
2
2
20
28
1.74
4.43
3.65
2.66
16.3
1.41
28.09
9
20
280
purelin
1
1
19
16
2.04
3.74
3.65
2.7
16.44
0.77
23.57
11
29
40
purelin
3
1
18
4
3.22
4.4
3.66
3.55
18.83
0.68
22.41
12
22
190
satlin
2
1
21
13
2.07
3.88
3.69
2.76
16.61
1.43
28.84
11
4
190
poslin
2
1
22
21
1.64
4.65
3.71
2.65
16.29
1.08
25.53
10
26
40
logsig
1
3
23
30
1.69
4.39
3.71
2.64
16.24
1.45
27.97
9
14
40
tansig
1
3
24
33
1.71
5.3
3.71
2.83
16.82
1.47
28.26
9
15
70
satlin
2
3
25
27
1.69
4.15
3.75
2.59
16.1
1.63
29.64
10
11
160
hardlims
3
3
26
34
1.69
3.98
3.86
2.58
16.07
1.1
25.55
9
23
10
tansig
3
1
28
23
1.72
4.29
3.86
2.67
16.33
1.35
26.66
10
26
10
satlin
2
2
27
35
1.68
4.36
3.94
2.67
16.34
1.24
27.56
9
21
70
purelin
3
2
29
20
1.64
4.4
3.96
2.66
16.3
0.99
25.71
10
7
10
purelin
1
2
30
31
1.65
4.15
4
2.62
16.2
1.39
28.13
9
27
70
poslin
2
1
32
22
1.7
4.1
4
2.64
16.25
1.41
28.43
10
8
160
satlins
2
1
31
38
1.7
5.8
4.03
2.98
17.27
2
30.4
8
10
190
compet
1
2
33
24
1.56
4.15
4.05
2.58
16.06
0.78
24.45
10
15
190
compet
2
3
34
37
1.62
4.39
4.1
2.67
16.33
1.83
29.63
8
2
70
hardlims
1
1
35
36
1.55
4.93
4.11
2.74
16.56
2.06
30.85
9
3
40
tansig
3
3
36
39
1.33
5.09
4.35
2.69
16.39
1.47
28.58
8
23
40
hardlims
1
3
37
40
1.29
5.51
4.54
2.78
16.68
1.48
30.01
8
7
130
tansig
2
1
38
44
1.24
5.79
4.56
2.81
16.77
2.06
32.39
8
3
10
compet
3
2
39
47
1.02
6.39
4.61
2.81
16.76
2.37
33.24
7
1
10
logsig
1
2
40
46
1.16
5.94
4.71
2.83
16.82
1.47
29.4
7
17
160
poslin
1
1
41
42
1.12
5.52
4.72
2.72
16.5
1.29
28.96
8
20
250
hardlim
2
3
42
41
1.21
5.62
4.75
2.8
16.73
0.99
28.11
8
25
40
hardlim
2
2
43
43
1.21
5.36
4.78
2.75
16.59
1.96
31.28
8
7
70
tansig
3
1
44
45
1.16
6.66
4.9
3.01
17.34
2.03
31.28
8
23
130
hardlims
3
3
45
52
1.09
5.36
5.04
2.74
16.54
1.71
31.25
7
5
10
compet
3
1
46
51
1.03
6.14
5.05
2.86
16.91
1.79
31.64
7
0
10
satlin
2
3
47
48
1.13
5.4
5.11
2.78
16.68
1.35
29.22
7
23
40
compet
1
3
48
57
0.88
6.31
5.12
2.82
16.78
2.15
32.84
6
8
100
tansig
1
3
50
50
1.16
5.7
5.12
2.86
16.92
2.65
33.98
7
12
40
purelin
2
2
49
49
1.12
5.89
5.19
2.89
16.99
2.77
33.92
7
7
10
compet
2
1
51
56
1.01
6.75
5.38
3.03
17.41
2.04
31.21
6
29
10
compet
1
2
52
55
0.9
6.13
5.45
2.86
16.91
2.77
33.86
6
8
10
purelin
1
1
53
54
0.98
6.54
5.48
2.99
17.29
2.48
33.87
7
4
100
satlins
3
3
54
59
0.96
6.58
5.51
3
17.31
2.08
32.38
6
15
40
logsig
2
2
55
53
1
9.49
5.62
3.62
19.02
1.2
27.62
7
22
40
logsig
3
2
56
61
0.83
6.91
5.63
3
17.33
3.46
36.2
6
1
100
tansig
3
1
57
60
0.91
6.52
5.75
3
17.32
3
36.7
6
0
10
tansig
2
3
58
2
5.85
6.76
5.91
6.05
24.59
1.34
25.05
12
1
40
poslin
1
2
59
58
0.9
6.48
6.03
3.04
17.43
3.16
35.41
6
10
10
tansig
2
1
60
62
0.75
8.21
6.09
3.31
18.19
2.5
34.12
6
25
100
satlin
3
2
61
65
0.67
6.9
6.44
3.07
17.53
3.46
36.21
5
25
40
poslin
1
2
63
63
0.71
6.49
6.44
3.01
17.36
3.31
35.07
6
5
40
logsig
3
3
62
66
0.69
7.08
6.45
3.12
17.66
2.52
34.33
5
28
10
hardlim
1
3
64
69
0.6
7.6
6.5
3.18
17.83
3.15
35.33
5
25
10
logsig
2
3
65
67
0.68
6.93
6.68
3.13
17.69
2.84
34.2
5
22
10
satlins
2
1
66
71
0.74
7.55
6.68
3.29
18.13
4.45
38.71
5
3
10
tansig
3
2
67
70
0.69
7.41
6.69
3.23
17.97
3.04
34.97
5
10
10
logsig
3
1
68
64
0.69
7.06
6.76
3.18
17.82
3.08
34.94
5
28
10
hardlim
1
1
69
68
0.74
6.56
6.9
3.14
17.71
3.39
36.01
5
23
40
poslin
2
2
70
72
0.79
6.72
7.31
3.28
18.11
2.77
34.86
5
5
40
compet
3
3
71This may be the case of over- or underfitting of model with data. The rest of the functions used in this study were not successful and accurate enough in group. Table3 showslogsigfunction with IN-69 reporting the best activation function for training. However, testing results show that the accuracy ofsatlins activation function with IN-11 was much better. This situation explains that total mean absolute error (MAE) according to iterations cannot determine the network accuracy. Hence, we obtain the real accuracy based on testing results. Table 3 shows the error for each activation function for different numbers of inputs, which vary from 1 to 72 after removing the last two years (2003 and 2004) of data due to its poor performance. In terms of spatial analysis top best five percentage MAE testing results show 3.04, 3.08, 3.13, 3.25, and 3.29% of positions 12(4), 31(3), 23(8), 33(9), and 23(8) with transfer functions “satlins,” “compet,” “hardlims,” “hardlim,” and “purelin,” respectively. However, compare with the worse results, which are MAE test error 6.68, 6.69, 6.76, 6.9, and 7.31% of position 32(6), 31(7), 11(1), 22(5), and 33(9) with transfer function “tansig,” “logsig,” “hardlim,” “poslin,” and “compet,” respectively. This result shows no special pattern related to spatial position; even then the target position is 22(5) not directly related to the same position 22(5) of input in terms of performance; therefore it is important to consider the neighbor position in the modeling of ANN. As it is not a direct relation between input and output irrespective of position, the modeling needs expert supervision. On the other hand temporal analysis shows clear pattern between input and output with respect to different years of data. In the table, top best results are from 2011, 2012, 2012, 2012, and 2011, respectively. If compared with worse five results which are 2005, 2005, 2005, 2005, and 2005, respectively, it clearly shows that the best result performed by ANN model depends on much closer year of data similarly like delay and neuron case. Besides the best performance the worst cases result shows that old years of data and lower neuron number do not play important role in better performance.


## 4.1. Model Behavior with Delays

In this section, we used one input at a time with delay out of 90 different radiation data. The hidden layer required was often (10) ten neurons; the input delay varies from one to thirty (30). For GHI, the wrong alarm frequency was constantly low while being trained on the maximum amount of past data [34]. All configuration models are tested for 30 times at continuous time delay of 1 to 30. The network has to optimize at minimum root mean square (RMSE) on the training data set [28].Figure7 and Table 1 illustrate an evaluation of measured and forecasted values by the suggested ANNs; this evaluation was built on hourly averages of global radiations. Established radiation on input numbers (from the Table 1) (IN-10, IN-3, and IN-9) had very small dissimilarity on global forecast. IN-10 was superior and then IN-3 in terms of radiation forecasting, but both had comparable values. IN-90 was the poorest between the suggested networks with the highest error in global radiation forecasting. It starts error with 32.23% RMSE at 5 delays and ends with 19.63% at 23 delays and further remains constant in between for all other inputs and delays.Table 1
Radiation forecasting; spatial comparison of ANN models with time delay.
Number of inputs
Training
Forecasting
Year
Delay
Column
Row
Ranking
Input radiation
MAE
RMSE
MAE
RMSE
10*
7.81*
16.55*
3.85*
19.63*
11*
23*
1*
1*
1*
GHI*
3**
9.24**
20.05**
4.03**
20.07**
12**
27**
1**
3**
2**
GHI**
9***
8.07***
16.88***
4.07***
20.17***
12***
26***
3***
3***
3***
GHI***
11
7.68
16.47
4.27
20.66
11
7
1
2
4
GHI
22
7.81
16
4.29
20.71
10
8
2
1
5
GHI
21
7.79
16.06
4.4
20.98
10
26
1
3
6
GHI
26
7.88
15.96
4.47
21.14
10
19
3
2
7
GHI
24
7.89
15.92
4.6
21.44
10
15
2
3
8
GHI
8
8.49
17.22
4.73
21.75
12
1
3
2
9
GHI
4
8.96
19.01
4.79
21.89
12
22
2
1
10
GHI
12
7.93
16.51
4.85
22.02
11
26
1
3
11
GHI
31
8.26
15.94
4.85
22.03
9
27
2
1
12
GHI
6
8.77
17.94
4.85
22.03
12
1
2
3
13
GHI
5
8.74
18.21
4.89
22.11
12
1
2
2
14
GHI
1
12.28
29.34
4.95
22.25
12
24
1
1
15
GHI
23
7.91
15.88
4.95
22.25
10
26
2
2
16
GHI
7
8.5
17.47
4.96
22.27
12
3
3
1
17
GHI
28
8.29
15.94
5.03
22.43
9
20
1
1
18
GHI
30
8.31
15.82
5.18
22.77
9
14
1
3
19
GHI
18
8.04
16.08
5.26
22.94
11
25
3
3
20
GHI
19
8.31
16.09
5.27
22.95
10
23
1
1
21
GHI
14
7.86
16.28
5.29
23.01
11
23
2
2
22
GHI
44
8.93
15.72
5.4
23.24
8
3
3
2
23
GHI
15
8.16
16.31
5.42
23.29
11
2
2
3
24
GHI
16
7.9
16.23
5.42
23.29
11
29
3
1
25
GHI
33
8.35
15.81
5.45
23.35
9
15
2
3
26
GHI
42
8.81
15.72
5.49
23.43
8
20
2
3
27
GHI
20
7.76
16.1
5.51
23.46
10
7
1
2
28
GHI
13
8
16.33
5.55
23.56
11
4
2
1
29
GHI
52
8.56
15.68
5.62
23.72
7
5
3
1
30
GHI
39
8.42
15.75
5.63
23.74
8
23
1
3
31
GHI
40
8.74
15.79
5.64
23.75
8
7
2
1
32
GHI
41
8.41
15.65
5.65
23.77
8
25
2
2
33
GHI
51
8.92
15.74
5.71
23.89
7
0
2
3
34
GHI
32
8.19
15.88
5.72
23.91
9
15
2
2
35
GHI
17
7.8
16.16
5.73
23.95
11
0
3
2
36
GHI
47
8.78
15.75
5.83
24.14
7
1
1
2
37
GHI
25
8.14
15.9
5.9
24.29
10
21
3
1
38
GHI
70
9.06
15.83
5.91
24.3
5
10
3
1
39
GHI
36
8.38
15.71
5.95
24.38
9
3
3
3
40
GHI
38
8.44
15.76
6.02
24.54
8
10
1
2
41
GHI
27
8.55
15.83
6.03
24.56
10
11
3
3
42
GHI
50
9.2
15.64
6.22
24.95
7
12
2
2
43
GHI
48
8.93
15.74
6.25
25
7
23
1
3
44
GHI
45
8.74
15.65
6.3
25.09
8
23
3
3
45
GHI
62
8.57
15.78
6.31
25.12
6
25
3
2
46
GHI
46
9.03
15.78
6.43
25.35
7
17
1
1
47
GHI
34
8.31
15.75
6.44
25.37
9
23
3
1
48
GHI
2
12.02
24.59
6.44
25.38
12
1
1
2
49
GHI
37
8.39
15.66
6.51
25.52
8
2
1
1
50
GHI
71
8.87
15.77
6.65
25.79
5
3
3
2
51
GHI
55
8.75
15.73
6.69
25.87
6
8
1
1
52
GHI
29
8.48
15.8
6.74
25.96
9
7
1
2
53
GHI
59
8.94
15.64
6.75
25.98
6
15
2
2
54
GHI
35
8.57
15.88
6.82
26.11
9
21
3
2
55
GHI
73
9
15.63
6.83
26.13
4
28
1
1
56
GHI
83
9.16
15.99
6.9
26.27
3
15
1
2
57
GHI
49
8.62
15.57
6.91
26.28
7
7
2
1
58
GHI
53
9.06
15.68
6.94
26.34
7
22
3
2
59
GHI
58
8.8
15.77
7.03
26.52
6
10
2
1
60
GHI
63
8.79
15.81
7.05
26.56
6
5
3
3
61
GHI
57
9.14
15.71
7.09
26.62
6
8
1
3
62
GHI
61
8.83
15.63
7.11
26.66
6
1
3
1
63
GHI
56
9.21
15.86
7.21
26.86
6
29
1
2
64
GHI
65
9.06
16.02
7.26
26.95
5
25
1
2
65
GHI
43
8.94
15.75
7.29
27.01
8
7
3
1
66
GHI
66
9.15
15.79
7.3
27.02
5
28
1
3
67
GHI
82
9.47
15.96
7.31
27.03
3
11
1
1
68
GHI
85
9.27
16.05
7.37
27.15
3
17
2
1
69
GHI
75
9.01
15.74
7.41
27.21
4
12
1
3
70
GHI
79
9.28
16.07
7.43
27.26
4
28
3
1
71
GHI
54
8.93
15.59
7.44
27.27
7
4
3
3
72
GHI
76
9.27
15.9
7.48
27.34
4
5
2
1
73
GHI
69
9.06
15.58
7.49
27.37
5
25
2
3
74
GHI
64
8.76
15.75
7.51
27.41
5
28
1
1
75
GHI
81
8.99
15.97
7.53
27.44
4
24
3
3
76
GHI
74
9.41
15.71
7.54
27.45
4
15
1
2
77
GHI
67
8.99
15.78
7.58
27.53
5
22
2
1
78
GHI
87
9.19
16.04
7.67
27.7
3
12
2
3
79
GHI
80
9.26
15.99
7.69
27.73
4
12
3
2
80
GHI
77
8.9
15.92
7.87
28.05
4
25
2
2
81
GHI
78
9.21
15.84
7.96
28.22
4
4
2
3
82
GHI
60
9.04
15.86
8.25
28.72
6
0
2
3
83
GHI
72
9.17
15.76
8.43
29.03
5
5
3
3
84
GHI
84
9.3
16.25
8.47
29.1
3
24
1
3
85
GHI
68
9.43
15.96
8.54
29.22
5
23
2
2
86
GHI
88
9.2
16.13
8.78
29.63
3
0
3
1
87
GHI
86
9.02
15.85
9.35
30.57
3
6
2
2
88
GHI
89
9.25
16.26
10.2
31.93
3
6
3
2
89
GHI
90
9.52
16.15
10.39
32.23
3
5
3
3
90
GHI
Stars (*) shows best three results in order.Table1 demonstrated a summary evaluation of the suggested models by percentage performance of the MAE, MSE, and RMSE. These results show that the solar radiation forecasting differs too much irrespective of ANN inputs. Forecasting is affected based on number of time delays applied in different ANN inputs. The delay decides the convergence property of ANN inputs. Table 1 shows that some of the input converges very fast with minimum error as IN-51 with 0 time delays and around 23.89 percent of testing RMSE error. Similarly other comparable methods of IN-16 show the 23.29 percent of testing RMSE error but long time delay (29). The hourly correlation factor between two clear skies days is almost one day, which is perfect for time series prediction considering the same interval. In terms of spatial analysis top best five testing results show percentage in RMSE 19.63, 20.07, 20.17, 20.66, and 20.71 of neighbour positions 11(1), 13(7), 33(9), 12(4), and 21(2) and delays of 23, 27, 26, 7, and 8. On the other hand, compare the worse results are 29.22, 29.63, 30.57, 31.93 and 32.23 of position 22(5), 31(3), 22(5), 32(6) and 33(9) with delay of 23, 0, 6, 6, and 5, respectively. From these results there is no special pattern of spatial position; this may be due to different delay correlate between inputs and outputs. But from results, position 5 appears in worst case as compared to the best performance from neighbour places. On the other hand, temporal analysis shows clear pattern between input and output with respect to different years of data. In the table, top best results are from 2011, 2012, 2012, 2011, and 2010, respectively. If compared with the worse results which are 2005, 2003, 2003, 2003, and 2003, respectively, it clearly shows that the best result performed by ANN model depends on closer year of data. The contribution of delay is random, some inputs perform well with higher delay and some perform at lower delay, it all depends on property of data with respect to time.


## 4.2. Model Behavior with Neurons

Table2 demonstrates that the projected neuron model offers superior results for evaluation. The current technique is used to control the number of neurons based on trial-and-error. It starts with minimum number of neurons and increased neuron to its maximum limit. The drawback is that it is time consuming and there is no surety of setting the neuron. The particular measures for 90 inputs used range of 10–300 neurons at interval of 10 neurons and target for a minimized MAE value. Since the smallest RMSE demonstrates the estimation method accuracy at local level or small number of data sets, MAE indicates global accuracy. In this case previous obtained outcome delays are used and standard transfer functions,hyperbolic tangent sigmoid (tansig), for respective numbers of inputs, are used as well.Table 2
Radiation forecasting; spatial comparison of ANN models with time delay and neurons.
Number of inputs
%performance (MAE)
%training
%forecasting
Year
Delay
Neurons
Column
Row
Ranking
Training
Validation
Testing
MSE
RMSE
MSE
RMSE
3*
3.61*
4.63*
3.98*
3.89*
19.72*
1.4*
25.25*
12*
27*
190*
1*
3*
1*
4**
3.14**
4.63**
4.08**
3.63**
19.04**
1.06**
25.97**
12**
22**
190**
2**
1**
2**
5***
2.52***
5.21***
4.12***
3.38***
18.38***
0.92***
25.64***
12***
1***
250***
2***
2***
3***
7
2.13
5.05
4.17
3.12
17.68
1.33
27.27
12
3
130
3
1
4
8
1.9
5.56
4.34
3.12
17.66
1.02
24.57
12
1
40
3
2
5
6
2.49
4.91
4.66
3.41
18.46
1.47
27.53
12
1
10
2
3
6
9
1.42
6.02
4.86
3.03
17.39
1.36
26.14
12
26
220
3
3
7
10
1.47
5.71
4.92
3.01
17.34
1.38
29.15
11
23
10
1
1
8
12
1.63
5.35
5.01
3.05
17.47
1.85
31.25
11
26
40
1
3
9
11
1.46
5.17
5.27
2.97
17.22
1.46
28.03
11
7
70
1
2
10
2
5.97
6.41
5.6
5.98
24.46
1.16
24.04
12
1
40
1
2
11
14
1.28
5.97
5.68
3.1
17.6
2.57
33.4
11
23
10
2
2
12
17
1.04
8.63
5.83
3.52
18.76
3.9
35.03
11
0
40
3
2
13
13
1.5
5.72
5.97
3.24
18
2.1
33.36
11
4
190
2
1
14
16
1.08
6.72
6.18
3.23
17.97
2.1
31.22
11
29
40
3
1
15
15
1.22
6.82
6.27
3.35
18.3
2.24
33.32
11
2
100
2
3
16
24
1.13
9.21
6.73
3.87
19.67
2.06
31.33
10
15
190
2
3
17
20
1.11
7.35
6.8
3.5
18.7
2.34
33.16
10
7
10
1
2
18
22
0.98
6.54
6.87
3.27
18.08
2.73
34.22
10
8
160
2
1
19
19
1.38
7.71
7
3.77
19.41
2.1
35.34
10
23
40
1
1
20
18
1.63
7.8
7.11
3.96
19.9
1.95
33.83
11
25
70
3
3
21
25
0.77
7.61
7.27
3.44
18.55
2.46
31.66
10
21
160
3
1
22
23
1.03
8.58
7.32
3.8
19.48
3.13
35.56
10
26
10
2
2
23
1
8.63
9.64
7.4
8.59
29.3
1.23
24.56
12
24
100
1
1
24
21
0.99
6.74
7.51
3.44
18.55
2.84
34.87
10
26
40
1
3
25
26
1.49
8.47
7.55
4.1
20.25
3.2
37.13
10
19
190
3
2
26
27
1.07
7.76
8.13
3.82
19.55
2.88
37.07
10
11
160
3
3
27
30
0.59
8.98
8.6
3.87
19.67
5.54
39.24
9
14
40
1
3
28
33
0.56
9.06
8.88
3.93
19.81
4.65
39.12
9
15
70
2
3
29
28
0.69
9.13
8.92
4.02
20.06
4.57
38.17
9
20
280
1
1
30
32
1.54
8.91
9.15
4.54
21.3
4.3
40.59
9
15
130
2
2
31
31
0.7
9.1
9.29
4.1
20.24
3.12
34.99
9
27
70
2
1
32
29
0.55
9.02
9.3
3.99
19.98
3.49
36.37
9
7
40
1
2
33
35
1.11
10.36
9.83
4.71
21.69
3.48
38.8
9
21
70
3
2
34
34
1.11
9.39
9.89
4.52
21.27
4.43
40.55
9
23
10
3
1
35
36
0.52
11.23
9.89
4.53
21.29
4.29
38.3
9
3
40
3
3
36
38
0.93
11.2
10.77
4.95
22.26
8.21
44.5
8
10
190
1
2
37
37
1.97
12.4
11.1
5.88
24.25
6.9
45.45
8
2
70
1
1
38
39
0.76
11.5
11.2
4.99
22.35
4.97
40.14
8
23
40
1
3
39
41
0.83
10.73
11.54
4.95
22.25
3.94
38.95
8
25
40
2
2
40
40
1.31
13.36
12.32
5.92
24.33
7.38
46.38
8
7
130
2
1
41
42
0.16
14.69
13.62
5.76
23.99
8.07
45.3
8
20
250
2
3
42
43
1.34
16.11
14.92
7.01
26.47
7.08
46.3
8
7
70
3
1
43
45
0.42
17.75
15.56
6.91
26.29
4.44
39.67
8
23
130
3
3
44
44
1.18
17.51
15.82
7.38
27.16
7.8
44.42
8
3
10
3
2
45
46
0.18
17.25
16.9
6.94
26.34
7.67
44.37
7
17
160
1
1
46
49
0.53
19.18
16.9
7.53
27.45
7.41
45.44
7
7
10
2
1
47
88
0.18
17.25
16.9
7.93
28.15
7.67
44.37
3
17
10
3
1
48
50
0.16
19.08
18.23
7.56
27.49
8.13
46.83
7
12
40
2
2
49
48
0.29
20.01
19.13
8
28.28
8.71
46.84
7
23
40
1
3
50
90
0.29
20.01
19.13
7.53
27.45
8.71
46.84
3
23
10
3
3
51
47
0.12
20.08
19.2
7.93
28.15
9.49
47.3
7
1
10
1
2
52
89
0.12
20.08
19.2
8
28.28
9.49
47.3
3
1
40
3
2
53
52
0.68
18.12
19.5
7.93
28.16
9.09
47.95
7
5
10
3
1
54
51
0.68
23.05
19.68
8.95
29.92
8.77
48.03
7
0
10
2
3
55
54
0.08
21.86
19.73
8.36
28.92
11
47.76
7
4
100
3
3
56
53
0.55
17.38
20.36
7.87
28.06
8.02
45.79
7
22
40
3
2
57
55
0.87
24.57
22.69
9.97
31.58
10.3
49.56
6
8
10
1
1
58
59
0.25
26.97
23.02
10.2
31.86
17.9
54.05
6
15
40
2
2
59
56
0.29
26.5
23.88
10.3
32.02
14.2
49.96
6
29
10
1
2
60
57
0.28
23.74
24.18
9.75
31.23
15.3
52.12
6
8
100
1
3
61
60
1.27
28.78
25.18
11.6
33.99
20.8
57.46
6
0
10
2
3
62
58
0.46
26.42
27.7
11.1
33.32
15.3
54.03
6
10
10
2
1
63
61
0.83
33.84
29.19
13.1
36.2
20.3
58.13
6
1
100
3
1
64
62
0.87
39.29
35.88
15.6
39.44
29
61.93
6
25
100
3
2
65
64
0.34
37.43
36.82
15.1
38.79
20.7
57.98
5
28
10
1
1
66
63
0.19
39.91
39.17
15.9
39.91
22.7
58.54
6
5
40
3
3
67
65
0.71
41.55
39.73
16.7
40.84
22.7
58.99
5
25
40
1
2
68
67
0.27
38.23
43.05
16.4
40.51
16.8
55.46
5
22
10
2
1
69
66
0.86
46.81
45.66
19
43.6
33.1
65.04
5
28
10
1
3
70
72
0.33
49.37
46.61
19.4
44.04
48.8
71.06
5
5
40
3
3
71
68
0.15
44.15
46.88
18.3
42.77
20.2
58.32
5
23
40
2
2
72
71
0.47
52.86
47.01
20.3
45
36.5
64.64
5
3
10
3
2
73
69
0.04
45.92
48.93
19
43.58
27.4
62.44
5
25
10
2
3
74
70
0.13
54.96
52.36
21.5
46.41
32.3
64.95
5
10
10
3
1
75
73
0.3
60.39
57.24
23.7
48.69
33.7
65.57
4
28
10
1
1
76
74
0.13
61.7
59.4
24.3
49.29
50.6
72.01
4
15
220
1
2
77
75
0.19
72.76
67.71
28.2
53.11
51.7
72.36
4
12
100
1
3
78
76
0.34
95.94
83.47
36.1
60.07
103
84.87
4
5
40
2
1
79
78
0.66
87.31
84.02
34.7
58.87
56.2
74.84
4
4
10
2
3
80
77
0.31
94.98
90.5
37.3
61.06
65.4
78.53
4
25
10
2
2
81
84
0.32
102.57
95.5
39.8
63.09
51.2
73.22
3
24
130
1
3
82
80
0.85
99.43
95.94
39.6
62.91
63.8
75.11
4
12
10
3
2
83
86
0.59
111.68
97.12
42.1
64.89
110
89.42
3
6
130
2
2
84
79
0.97
95.18
98.15
39.2
62.64
69.5
79.25
4
28
40
3
1
85
82
0.19
102.8
98.39
40.3
63.52
68.9
78.37
3
11
40
1
1
86
87
0.61
102.77
99.64
40.9
63.91
71.1
78.49
3
12
160
2
3
87
81
0.78
101.58
100.87
41
64
62.6
75.64
4
24
40
3
3
88
85
0.81
113.12
101.42
43.4
65.87
61.4
76.05
3
17
10
2
1
89
83
0.22
97.83
102.08
40.1
63.33
64
77.16
3
15
160
1
2
90The accuracy was tested by using the training sets results in each case. Figure8 and Table 2 show the results with all errors, performance coefficients, delays, and different neurons for each input. It is preferred that simplification capability increased while the number of neurons is increased. In solar radiation estimation problem, the precision degree of the productivity was 3.61, 4.63, and 3.98% in training, validation, and testing, respectively, while 190 neurons are used in IN-3 at delay (27). Comparatively the same result was obtained in IN-4, IN-5, IN-7, and IN-8 with 4.08, 4.12, 4.17, and 4.34% testing accuracy at 190, 250, 130, and 40 neuron with 22, 1, 3, and 1 delay. In terms of spatial analysis the top best five results show percentage testing MAE 3.98, 4.08, 4.12, 4.17, and 4.34% of positions 13(7), 21(2), 22(5), 31(3), and 32(6) considering the neurons 90, 190, 250, 130, and 40, respectively. This result shows that position does not give clear future of spatial orientation of radiation performance. On the other hand temporal analysis shows clear pattern between input and output with respect to different years of data. In the table, top best results are from 2012, 2012, 2012, 2012, and 2012, respectively. If compared with the worse results which are testing MAE errors 98.39, 99.64, 100.87, 101.42, and 102.08 of years 2003, 2003, 2004, 2003, and 2003, considering neurons 40, 160, 40, 10, and 160, respectively, it clearly shows that best result performed by ANN model depends on closer year of data similarly like delay case.


## 4.3. Model Behavior with Multiple Transfer Functions (Activation Functions)

In this study, different activation functions are used as shown in Figure9 that depend on different number of iterations for comparing their performances on radiation data. For every standard activation function, we used the number of neurons in the hidden layer as mentioned in neuron section for different inputs shown in Figure 8. After presenting in Table 3 different performance parameters, interpretations of their results will follow here. We used the different number of delays in the first section and different neurons in the second section and to compare different inputs with differences activation functions are described here. According to the first graph from Figure 10 generated by the all inputs are compare with the different activation functions. However, each input performs significantly different behavior with its one kind of function.Satlins activation function results perform the most successful one, for all the test parameters. However, the accuracy of the inputs was totally different in training and testing cases; higher accurate result (lowest MAE value) shows the inverse effect during testing case.Table 3
Radiation forecasting; spatial comparison of ANN models with time delay, neurons and transfer function.
Number of inputs
%performance (MAE)
%training
%forecasting
Year
Delay
Neurons
Transferfunction
Column
Row
Ranking
Training
Validation
Testing
MSE
RMSE
MSE
RMSE
11*
2.14*
4.32*
3.04*
2.76*
16.61*
0.78*
24.3*
11*
7*
70*
satlins*
1*
2*
1*
7**
2.86**
4.22**
3.08**
3.18**
17.83**
0.73**
24.51**
12**
3**
130**
compet**
3**
1**
2**
6***
3.12***
3.41***
3.13***
3.18***
17.83***
0.63***
22.2***
12***
1***
10***
hardlims***
2***
3***
3***
9
2.47
3.46
3.25
2.82
16.8
0.86
24.16
12
26
220
hardlim
3
3
4
15
2.14
3.6
3.29
2.66
16.31
1.35
27
11
2
100
purelin
2
3
5
29
1.63
4.76
3.33
2.6
16.12
0.69
25.05
9
7
40
compet
1
2
6
14
2.31
3.41
3.34
2.73
16.53
1.18
26.59
11
23
10
purelin
2
2
7
8
2.4
4.32
3.39
2.98
17.26
0.59
22.29
12
1
40
satlin
3
2
8
17
1.98
4.09
3.44
2.7
16.42
0.94
26.29
11
0
40
poslin
3
2
9
10
2.24
3.44
3.45
2.72
16.5
0.8
23.47
11
23
10
logsig
1
1
10
25
1.78
4.29
3.5
2.63
16.21
0.97
24.57
10
21
160
purelin
3
1
11
19
2
4.14
3.51
2.73
16.52
1.61
27.84
10
23
40
tansig
1
1
12
3
4.21
3.9
3.52
4.01
20.03
0.53
20.96
12
27
190
poslin
1
3
13
12
2.05
4.01
3.56
2.74
16.56
1.1
25.59
11
26
40
hardlims
1
3
14
5
2.79
4.52
3.59
3.29
18.15
0.44
21.05
12
1
250
poslin
2
2
15
26
1.82
4.31
3.6
2.68
16.36
1.6
29.29
10
19
190
compet
3
2
16
18
1.91
3.78
3.62
2.62
16.2
1.11
26.58
11
25
70
satlins
3
3
17
32
1.69
4.56
3.65
2.65
16.29
1.25
27.4
9
15
130
satlins
2
2
20
28
1.74
4.43
3.65
2.66
16.3
1.41
28.09
9
20
280
purelin
1
1
19
16
2.04
3.74
3.65
2.7
16.44
0.77
23.57
11
29
40
purelin
3
1
18
4
3.22
4.4
3.66
3.55
18.83
0.68
22.41
12
22
190
satlin
2
1
21
13
2.07
3.88
3.69
2.76
16.61
1.43
28.84
11
4
190
poslin
2
1
22
21
1.64
4.65
3.71
2.65
16.29
1.08
25.53
10
26
40
logsig
1
3
23
30
1.69
4.39
3.71
2.64
16.24
1.45
27.97
9
14
40
tansig
1
3
24
33
1.71
5.3
3.71
2.83
16.82
1.47
28.26
9
15
70
satlin
2
3
25
27
1.69
4.15
3.75
2.59
16.1
1.63
29.64
10
11
160
hardlims
3
3
26
34
1.69
3.98
3.86
2.58
16.07
1.1
25.55
9
23
10
tansig
3
1
28
23
1.72
4.29
3.86
2.67
16.33
1.35
26.66
10
26
10
satlin
2
2
27
35
1.68
4.36
3.94
2.67
16.34
1.24
27.56
9
21
70
purelin
3
2
29
20
1.64
4.4
3.96
2.66
16.3
0.99
25.71
10
7
10
purelin
1
2
30
31
1.65
4.15
4
2.62
16.2
1.39
28.13
9
27
70
poslin
2
1
32
22
1.7
4.1
4
2.64
16.25
1.41
28.43
10
8
160
satlins
2
1
31
38
1.7
5.8
4.03
2.98
17.27
2
30.4
8
10
190
compet
1
2
33
24
1.56
4.15
4.05
2.58
16.06
0.78
24.45
10
15
190
compet
2
3
34
37
1.62
4.39
4.1
2.67
16.33
1.83
29.63
8
2
70
hardlims
1
1
35
36
1.55
4.93
4.11
2.74
16.56
2.06
30.85
9
3
40
tansig
3
3
36
39
1.33
5.09
4.35
2.69
16.39
1.47
28.58
8
23
40
hardlims
1
3
37
40
1.29
5.51
4.54
2.78
16.68
1.48
30.01
8
7
130
tansig
2
1
38
44
1.24
5.79
4.56
2.81
16.77
2.06
32.39
8
3
10
compet
3
2
39
47
1.02
6.39
4.61
2.81
16.76
2.37
33.24
7
1
10
logsig
1
2
40
46
1.16
5.94
4.71
2.83
16.82
1.47
29.4
7
17
160
poslin
1
1
41
42
1.12
5.52
4.72
2.72
16.5
1.29
28.96
8
20
250
hardlim
2
3
42
41
1.21
5.62
4.75
2.8
16.73
0.99
28.11
8
25
40
hardlim
2
2
43
43
1.21
5.36
4.78
2.75
16.59
1.96
31.28
8
7
70
tansig
3
1
44
45
1.16
6.66
4.9
3.01
17.34
2.03
31.28
8
23
130
hardlims
3
3
45
52
1.09
5.36
5.04
2.74
16.54
1.71
31.25
7
5
10
compet
3
1
46
51
1.03
6.14
5.05
2.86
16.91
1.79
31.64
7
0
10
satlin
2
3
47
48
1.13
5.4
5.11
2.78
16.68
1.35
29.22
7
23
40
compet
1
3
48
57
0.88
6.31
5.12
2.82
16.78
2.15
32.84
6
8
100
tansig
1
3
50
50
1.16
5.7
5.12
2.86
16.92
2.65
33.98
7
12
40
purelin
2
2
49
49
1.12
5.89
5.19
2.89
16.99
2.77
33.92
7
7
10
compet
2
1
51
56
1.01
6.75
5.38
3.03
17.41
2.04
31.21
6
29
10
compet
1
2
52
55
0.9
6.13
5.45
2.86
16.91
2.77
33.86
6
8
10
purelin
1
1
53
54
0.98
6.54
5.48
2.99
17.29
2.48
33.87
7
4
100
satlins
3
3
54
59
0.96
6.58
5.51
3
17.31
2.08
32.38
6
15
40
logsig
2
2
55
53
1
9.49
5.62
3.62
19.02
1.2
27.62
7
22
40
logsig
3
2
56
61
0.83
6.91
5.63
3
17.33
3.46
36.2
6
1
100
tansig
3
1
57
60
0.91
6.52
5.75
3
17.32
3
36.7
6
0
10
tansig
2
3
58
2
5.85
6.76
5.91
6.05
24.59
1.34
25.05
12
1
40
poslin
1
2
59
58
0.9
6.48
6.03
3.04
17.43
3.16
35.41
6
10
10
tansig
2
1
60
62
0.75
8.21
6.09
3.31
18.19
2.5
34.12
6
25
100
satlin
3
2
61
65
0.67
6.9
6.44
3.07
17.53
3.46
36.21
5
25
40
poslin
1
2
63
63
0.71
6.49
6.44
3.01
17.36
3.31
35.07
6
5
40
logsig
3
3
62
66
0.69
7.08
6.45
3.12
17.66
2.52
34.33
5
28
10
hardlim
1
3
64
69
0.6
7.6
6.5
3.18
17.83
3.15
35.33
5
25
10
logsig
2
3
65
67
0.68
6.93
6.68
3.13
17.69
2.84
34.2
5
22
10
satlins
2
1
66
71
0.74
7.55
6.68
3.29
18.13
4.45
38.71
5
3
10
tansig
3
2
67
70
0.69
7.41
6.69
3.23
17.97
3.04
34.97
5
10
10
logsig
3
1
68
64
0.69
7.06
6.76
3.18
17.82
3.08
34.94
5
28
10
hardlim
1
1
69
68
0.74
6.56
6.9
3.14
17.71
3.39
36.01
5
23
40
poslin
2
2
70
72
0.79
6.72
7.31
3.28
18.11
2.77
34.86
5
5
40
compet
3
3
71This may be the case of over- or underfitting of model with data. The rest of the functions used in this study were not successful and accurate enough in group. Table3 showslogsigfunction with IN-69 reporting the best activation function for training. However, testing results show that the accuracy ofsatlins activation function with IN-11 was much better. This situation explains that total mean absolute error (MAE) according to iterations cannot determine the network accuracy. Hence, we obtain the real accuracy based on testing results. Table 3 shows the error for each activation function for different numbers of inputs, which vary from 1 to 72 after removing the last two years (2003 and 2004) of data due to its poor performance. In terms of spatial analysis top best five percentage MAE testing results show 3.04, 3.08, 3.13, 3.25, and 3.29% of positions 12(4), 31(3), 23(8), 33(9), and 23(8) with transfer functions “satlins,” “compet,” “hardlims,” “hardlim,” and “purelin,” respectively. However, compare with the worse results, which are MAE test error 6.68, 6.69, 6.76, 6.9, and 7.31% of position 32(6), 31(7), 11(1), 22(5), and 33(9) with transfer function “tansig,” “logsig,” “hardlim,” “poslin,” and “compet,” respectively. This result shows no special pattern related to spatial position; even then the target position is 22(5) not directly related to the same position 22(5) of input in terms of performance; therefore it is important to consider the neighbor position in the modeling of ANN. As it is not a direct relation between input and output irrespective of position, the modeling needs expert supervision. On the other hand temporal analysis shows clear pattern between input and output with respect to different years of data. In the table, top best results are from 2011, 2012, 2012, 2012, and 2011, respectively. If compared with worse five results which are 2005, 2005, 2005, 2005, and 2005, respectively, it clearly shows that the best result performed by ANN model depends on much closer year of data similarly like delay and neuron case. Besides the best performance the worst cases result shows that old years of data and lower neuron number do not play important role in better performance.


## 5. Conclusion

This document includes the modeling characteristic of artificial neural networks based on spatial feature. The estimated model was initiated and tested on solar radiation data. The results are evaluated with different statistical error. This document certifies the ability of ANN to accurately reproduce hour’s global radiation forecast. The estimation accuracy of the hourly solar radiation can be achieved by using conventional meteorological data of ten years. This model has been used extensively for the specific application; due to the dynamic nature, modeling needs professional advice. This section gives more value to the parameter that shows the progress of the ANN architecture, the delay, neurons, and the corresponding transfer function of spatial position (Figure5). The results show a high degree of flexibility in the choice of different inputs and connected parameters for comparative accuracy.Figure 5
Basic neuron network architecture.Figure 6
Typical custom neuron architecture.Figure 7
Radiation forecasting; spatial comparison of ANN models during training with time delay.Figure 8
Radiation forecasting; spatial comparison of ANN models during training with time delay and neurons.Figure 9
ANN models used with different transfer function.Figure 10
Radiation forecasting; spatial comparison of ANN models during training with time delay, neurons, and transfer function.



---

*Source: 410684-2015-02-18.xml*