# A Simple Method of Residential Electricity Load Forecasting by Improved Bayesian Neural Networks

Authors: Shubin Zheng; Qianwen Zhong; Lele Peng; Xiaodong Chai
Journal: Mathematical Problems in Engineering
 (2018)

---

## Abstract

Electricity load forecasting is becoming one of the key issues to solve energy crisis problem, and time-series Bayesian Neural Network is one popular method used in load forecast models. However, it has long running time and relatively strong dependence on time and weather factors at a residential level. To solve these problems, this article presents an improved Bayesian Neural Networks (IBNN) forecast model by augmenting historical load data as inputs based on simple feedforward structure. From the load time delays correlations and impact factors analysis, containing different inputs, number of hidden neurons, historic period of data, forecasting time range, and range requirement of sample data, some advices are given on how to better choose these factors. To validate the performance of improved Bayesian Neural Networks model, several residential sample datasets of one whole year from Ausgrid have been selected to build the improved Bayesian Neural Networks model. The results compared with the time-series load forecast model show that the improved Bayesian Neural Networks model can significantly reduce calculating time by more than 30 times and even when the time or meteorological factors are missing, it can still predict the load with a high accuracy. Compared with other widely used prediction methods, the IBNN also performs a better accuracy and relatively shorter computing time. This improved Bayesian Neural Networks forecasting method can be applied in residential energy management.


---

## Body

## 1. Introduction

In recent years, how to continuously meet people's energy needs has become a hot research topic of global concern. In addition to improving energy efficiency and developing new energy sources, rational management of energy is also a useful way to solve the energy crisis. The premise of effective energy management is more accurate energy load forecasting. Therefore, researchers have done a lot of research work on the prediction of electricity demand. Yu et al. [1] studied the use of sparse coding for modeling and forecasting individual household electricity loads. Qiu et al. [2] presented an ensemble method composed of Empirical Mode Decomposition (EMD) algorithm and deep learning approach. Hsiao [3] proposed an approach to model the very short-term load of individual households based on context information and daily schedule pattern analysis. Aman et al. [4] analyzed dynamic demand response (D2R) of prediction models, especially deeply discussed the scenario of small customers. Behl et al. [5] provided a model based control with regression trees algorithm, which allows performing closed-loop control for demand response (DR) strategy synthesis for large commercial buildings. Chen et al. [6] designed a Support Vector Regression (SVR) forecasting model with the ambient temperature of two hours before DR event as input variables. Cabrera et al. [7] proposed a methodology to obtain probabilistic forecasts of electricity load that is based on functional data analysis of generalized quantile curves. Marszal-Pomianowska et al. [8] presented a high-resolution model of household electricity use developed based upon a combination of measured and statistical data. Liang et al. [9, 10] proposed two electricity demand forecasting methods. One applied a new weight determination method with forecasting accuracy as induced variables based on extreme learning machine and multiple regression models. The other was from a carbon emission view to give a hybrid model based on wavelet transform and least squares support vector machine optimized by an improved cuckoo search.With the vigorous development of artificial intelligence, the neural network method has also been applied by many researchers in the field of electricity load forecasting [11–15]. Neural network methods already have some mature training algorithms and network structures. Among various neural network algorithms that have been widely used, like Scaled Conjugate Gradient, Levenberg Marquardt, Bayesian, etc., the performance of Bayesian Neural Networks (BNN) is validated as one of the most effective way to build the electricity load prediction model [16–22]. And related to the structures, Time-Series Neural Networks (TSNN) structure is more reasonable and effective than the simple Feedforward Neural Networks (FFNN) structure since the electricity load has obvious time-cycle characteristics [23–25]. However, as the traditional continuous time delay feedback increases, the efficiency of the prediction model is significantly reduced under TSNN structure.To improve the above problem, an improved BNN (IBNN) model of residential short-term electricity demand is proposed by a relatively simple method with both high performance and high efficiency. This method is based on the basic BNN method and the simple FFNN structure and considers the characteristics of electricity demand cyclic changing over time. Through analyzing the correlation results between historical electricity demand data and current electricity demand data at different time ranges, the historical demand data with stronger correlations are selected as the predictive vectors to construct the prediction model instead of continuous feedback in the TSNN.The remaining of this paper is organized as follows. Firstly, an IBNN based on FFNN is built by adding historical demand data as inputs through correlation analysis of electricity consumption at different delayed time scales. Moreover, inputs selection of the IBNN forecast model is discussed and further with the effect analysis of relative factors on the forecast performance. Then, the results of the time-series BNN model and the IBNN model are compared and discussed, especially on the program running time and the dependence on time or meteorology factors. Further the comparison also is made between the IBNN method and several common applied machine learning regression methods. The results show that the IBNN model performs relatively better in all evaluation indicators. Finally, conclusions are summarized and the future work is briefly mentioned.


## 2. Method of Improved Bayesian Neural Networks (IBNN)

This section firstly provides the basic BNN model structure, then the improved BNN model is presented in this paper. The selected evaluations of IBNN prediction model are briefly introduced. Finally, the impacts of inputs and relative factors are discussed.


### 2.1. Basic BNN Model Structure

Bayesian feedforward neural network structure (BFFNN) model is selected as the basic neural networks in our study for residential load forecasting. The principle of Bayesian approach is described in [16, 26]. The FFNN structure is shown in Figure 1.Figure 1
Structure of FFNN.To obtain high accuracy of the electricity demand prediction, the authors also apply the most popular structure of NN which is called multilayer perceptron (MLP). This structure mostly has an input layer, one or several hidden layers, and an output layer. Every layer obtains its weight and bias matrixes through Bayesian training algorithm.It can be found from the process of BNN in Figure2 that the NN forecasting model is built through finding a minimum error between the predict values and the actual observed values, which is adjusted by some defined rules, Bx, WOx, and WHx in the software until it satisfies a defined error rule (<Er), as shown in the following:(1)LVI=LVI+minfOfHVI·WH+bH·WO+bO-LVIFigure 2
Structure diagram of BNN training algorithm.Here in (1), LVI is the real historical value,WH is the weight matrix of hidden layer, bH is the bias vector of hidden layer, and WOTS and bOTS express the weight matrix and bias vector of output layer, respectively. fO and fH are the functions of output layer and hidden layer, respectively, as shown in (2)fHx=tansigx=21+exp⁡-2∗x-1(3)fOx=purelinx=xAfter obtaining the forecast model, the forecast load can be given by (4). Here in the following equation, IV is a vector contains the latest values of inputs which form this forecast model, and there may be one or several past historical load values. L^FBIV is the forecast load value by the built IBNN model.(4)L^FBIV=fOfHIV·WH+bH·WO+bOFrom a time-series view, a dynamic BNN method is widely applied in prediction models. The past data are seen as feedback in the model. In this paper, the time-series forecasting problem is defined as Nonlinear Autoregressive with External (Exogenous) Input (NARX), with feedback connections enclosing several layers of the network [27, 28]. The Bayesian time-series neural network structure can be simplified as Figure 3, where TDL means tapped delay line.Figure 3
Structure of TSNN.However, the performance of the time-series BNN model is affected by the setup of time delay line, and with the increasing number of time delay values, the computing time is significantly growing. Due to the fact that there are only several input vectors, such as time of everyday, day-type, ambient temperature, and relative humidity, many of them are meteorological data, and another problem may be that the model is greatly affected by the meteorological data.


### 2.2. Improved Bayesian Neural Networks (IBNN) Model

The structure of IBNN is illustrated in Figure4, besides the time inputs like time and day-type and meteorology inputs like temperature and humidity, the model also uses the historical load data as inputs.Figure 4
Structure and process of IBNN model.Different from traditional time-series with continuous historical values or fixed interval historical values feedback, an improved model with highly correlation historical values of prediction target as inputs is designed to obtain relatively higher accuracy but shorter computing time. The chosen historical data may be only one vector which is close to the forecast interval or several vectors from same time intervals and close intervals.Pearson correlation coefficient (P) and Spearman correlation coefficient (S) are used to measure their correlations. If each variable has N scalar observations, the Pearson correlation coefficient, P, is defined as [29–31](5)PM1,M2=1N-1∑i=1NM1i-μM1-σM1M2i-μM2σM2whereμM1 and σM1 are the mean and standard deviation of M1, respectively, and μM2 and σM2 are the mean and standard deviation of M2. The above equation can also be described as correlation coefficient based on the covariance of M1 and M2,The Spearman correlation coefficient (S) [32, 33], S, can be computed by the following equation:(6)SM1,M2=∑iM1i-M1-M2i-M2-∑iM1i-M1-2∑iM2i-M2-2Figures5–7 are the correlation coefficients results of three residences from a sample of 300 homes supplied by Ausgrid from July 2010 to June 2011, which are No. 11, No. 17, and No. 50, respectively.Figure 5
Correlation coefficients of past time load vectors of No. 11.
(a) (b)Figure 6
Correlation coefficients of past time load vectors of No. 17.
(a) (b)Figure 7
Correlation coefficients of past time load vectors of No. 50.
(a) (b)As can be seen from the figures, the solid line indicates the correlation coefficients calculated by different time delay vectors and the current predicted value, and the dotted line is the line connecting the highest value point of the correlation coefficients in the delays of the daily cycle. It can be clearly seen from the dotted line and the calculated values that the highest value of the correlation coefficients in the daily cycle is obtained by delaying an integral multiple of 24 hours, that is, the same time period of the past day. In addition, the calculation results of No. 11 and No. 50 can also be seen that the correlation coefficients calculated by the delay of weekly cycle may be slightly higher than other daily calculation values. This is because most households have significant differences between working days and rest days and individual households have a special electricity consumption cycle mode in one week, which leads the current forecast value have a high correlation values with the same time delays on the same day-type of past weeks. In order to further numerically compare the correlation coefficients, the partial operation results are listed in Table1.Table 1
Correlation coefficients of past time load vectors of three residences.
Past Load/number of home No. 11 No. 17 No. 50 Pearson Correlation Spearman Correlation Pearson Correlation Spearman Correlation Pearson Correlation Spearman Correlation L n - 1 0.82 0.83 0.85 0.79 0.21 0.53 L n - 2 0.64 0.73 0.71 0.67 0.10 0.39 L n - 3 0.54 0.64 0.59 0.55 0.07 0.33 L n - 4 0.48 0.56 0.50 0.44 0.04 0.21 L n - 5 0.42 0.50 0.42 0.39 0.01 0.13 L n - 6 0.36 0.42 0.35 0.31 -0.02 0.07 L n - 24 / t i 0.56 0.63 0.56 0.56 0.14 0.30 L n - 24 / t i ⋅ 2 0.51 0.54 0.50 0.53 0.14 0.31 L n - 24 / t i ⋅ 7 0.55 0.60 0.40 0.47 0.17 0.35 L n - 24 / t i ⋅ 7 ⋅ 2 0.50 0.52 0.35 0.40 0.16 0.32It can be seen from the table that the correlations between the historical electricity consumption over the past two hours and the current forecast period are significantly lower and are even generally lower than the past delay time of day cycles to the current forecast period. For families with obvious weekly cycles, as No. 11 and No. 50, the weekly same time period correlations are even higher than the closest daily delay correlation.It can also be obtained from the above analysis that there are differences in the electricity consumption patterns of different households, and different input historical data make the forecast model different and the performance different. Specific analysis of specific targets is required, so that it is possible to select predictive variables with higher prediction accuracy. To find how to select the historical data as inputs can better improve the performance of forecast model and how the model related factors impact the performance, several compared forecast models are designed in the next section.


### 2.3. Performance Evaluation

The following four indexes are selected to evaluate the forecast model performance. MSE is the mean square error or the residual mean square. Equation (7) shows how to calculate the MSE value. y^i is a vector of N predictions, and yi is the vector of observed values corresponding to the inputs to the function which generates the predictions. ei stands for the square of the errors. An MSE value closer to 0 indicates a fitting that is more useful for prediction when the model is not overfitted. (7)MSE=1N∑i=1Nei2=1N∑i=1Ny^i-yi2MAPE is the mean absolute percentage error, which is accuracy evaluation and comparison of a forecasting method in statistics and especially a widely used metric in energy [32, 34]. The definition of MAPE is as follows:(8)MAPE=1N∑i=1Nyi-y^iyi×100%However, for small household electricity consumption, the daily electricity consumption varies greatly with time. If only the MAPE is considered, large percentage errors will be obtained in small power consumption periods, so that the MAPE throughout the day will become very large. The low power consumption is often only tens to hundreds of watts per hour, but at peak times, electricity is often used more than kW per hour. In other words, it is more important to accurately predict the electricity consumption during peak hours, so the mean absolute error (MAE) is also adopted to evaluate the prediction accuracy. The MAE can be calculated as(9)MAE=∑i=1Nyi-y^iNAnother statistic metric, regression coefficient,R, is also applied to indicate the amount of variance explained by the model. R is defined as (10), y-i is the mean of the observed data value, y^i- is the mean of the predicted values, ∑i=1N(yi-y^i)2 is the residual sum of squares, and ∑i=1N(yi-y-i)2 is the explained sum of squares. R can take on any value between 0 and 1, with a value closer to 1 indicating that a greater proportion of variance is accounted for by the model [35].(10)R=∑i=1Nyi^-y^i-yi-y-i∑i=1Nyi^-y^i-2∑i=1Nyi-y-i2


## 2.1. Basic BNN Model Structure

Bayesian feedforward neural network structure (BFFNN) model is selected as the basic neural networks in our study for residential load forecasting. The principle of Bayesian approach is described in [16, 26]. The FFNN structure is shown in Figure 1.Figure 1
Structure of FFNN.To obtain high accuracy of the electricity demand prediction, the authors also apply the most popular structure of NN which is called multilayer perceptron (MLP). This structure mostly has an input layer, one or several hidden layers, and an output layer. Every layer obtains its weight and bias matrixes through Bayesian training algorithm.It can be found from the process of BNN in Figure2 that the NN forecasting model is built through finding a minimum error between the predict values and the actual observed values, which is adjusted by some defined rules, Bx, WOx, and WHx in the software until it satisfies a defined error rule (<Er), as shown in the following:(1)LVI=LVI+minfOfHVI·WH+bH·WO+bO-LVIFigure 2
Structure diagram of BNN training algorithm.Here in (1), LVI is the real historical value,WH is the weight matrix of hidden layer, bH is the bias vector of hidden layer, and WOTS and bOTS express the weight matrix and bias vector of output layer, respectively. fO and fH are the functions of output layer and hidden layer, respectively, as shown in (2)fHx=tansigx=21+exp⁡-2∗x-1(3)fOx=purelinx=xAfter obtaining the forecast model, the forecast load can be given by (4). Here in the following equation, IV is a vector contains the latest values of inputs which form this forecast model, and there may be one or several past historical load values. L^FBIV is the forecast load value by the built IBNN model.(4)L^FBIV=fOfHIV·WH+bH·WO+bOFrom a time-series view, a dynamic BNN method is widely applied in prediction models. The past data are seen as feedback in the model. In this paper, the time-series forecasting problem is defined as Nonlinear Autoregressive with External (Exogenous) Input (NARX), with feedback connections enclosing several layers of the network [27, 28]. The Bayesian time-series neural network structure can be simplified as Figure 3, where TDL means tapped delay line.Figure 3
Structure of TSNN.However, the performance of the time-series BNN model is affected by the setup of time delay line, and with the increasing number of time delay values, the computing time is significantly growing. Due to the fact that there are only several input vectors, such as time of everyday, day-type, ambient temperature, and relative humidity, many of them are meteorological data, and another problem may be that the model is greatly affected by the meteorological data.


## 2.2. Improved Bayesian Neural Networks (IBNN) Model

The structure of IBNN is illustrated in Figure4, besides the time inputs like time and day-type and meteorology inputs like temperature and humidity, the model also uses the historical load data as inputs.Figure 4
Structure and process of IBNN model.Different from traditional time-series with continuous historical values or fixed interval historical values feedback, an improved model with highly correlation historical values of prediction target as inputs is designed to obtain relatively higher accuracy but shorter computing time. The chosen historical data may be only one vector which is close to the forecast interval or several vectors from same time intervals and close intervals.Pearson correlation coefficient (P) and Spearman correlation coefficient (S) are used to measure their correlations. If each variable has N scalar observations, the Pearson correlation coefficient, P, is defined as [29–31](5)PM1,M2=1N-1∑i=1NM1i-μM1-σM1M2i-μM2σM2whereμM1 and σM1 are the mean and standard deviation of M1, respectively, and μM2 and σM2 are the mean and standard deviation of M2. The above equation can also be described as correlation coefficient based on the covariance of M1 and M2,The Spearman correlation coefficient (S) [32, 33], S, can be computed by the following equation:(6)SM1,M2=∑iM1i-M1-M2i-M2-∑iM1i-M1-2∑iM2i-M2-2Figures5–7 are the correlation coefficients results of three residences from a sample of 300 homes supplied by Ausgrid from July 2010 to June 2011, which are No. 11, No. 17, and No. 50, respectively.Figure 5
Correlation coefficients of past time load vectors of No. 11.
(a) (b)Figure 6
Correlation coefficients of past time load vectors of No. 17.
(a) (b)Figure 7
Correlation coefficients of past time load vectors of No. 50.
(a) (b)As can be seen from the figures, the solid line indicates the correlation coefficients calculated by different time delay vectors and the current predicted value, and the dotted line is the line connecting the highest value point of the correlation coefficients in the delays of the daily cycle. It can be clearly seen from the dotted line and the calculated values that the highest value of the correlation coefficients in the daily cycle is obtained by delaying an integral multiple of 24 hours, that is, the same time period of the past day. In addition, the calculation results of No. 11 and No. 50 can also be seen that the correlation coefficients calculated by the delay of weekly cycle may be slightly higher than other daily calculation values. This is because most households have significant differences between working days and rest days and individual households have a special electricity consumption cycle mode in one week, which leads the current forecast value have a high correlation values with the same time delays on the same day-type of past weeks. In order to further numerically compare the correlation coefficients, the partial operation results are listed in Table1.Table 1
Correlation coefficients of past time load vectors of three residences.
Past Load/number of home No. 11 No. 17 No. 50 Pearson Correlation Spearman Correlation Pearson Correlation Spearman Correlation Pearson Correlation Spearman Correlation L n - 1 0.82 0.83 0.85 0.79 0.21 0.53 L n - 2 0.64 0.73 0.71 0.67 0.10 0.39 L n - 3 0.54 0.64 0.59 0.55 0.07 0.33 L n - 4 0.48 0.56 0.50 0.44 0.04 0.21 L n - 5 0.42 0.50 0.42 0.39 0.01 0.13 L n - 6 0.36 0.42 0.35 0.31 -0.02 0.07 L n - 24 / t i 0.56 0.63 0.56 0.56 0.14 0.30 L n - 24 / t i ⋅ 2 0.51 0.54 0.50 0.53 0.14 0.31 L n - 24 / t i ⋅ 7 0.55 0.60 0.40 0.47 0.17 0.35 L n - 24 / t i ⋅ 7 ⋅ 2 0.50 0.52 0.35 0.40 0.16 0.32It can be seen from the table that the correlations between the historical electricity consumption over the past two hours and the current forecast period are significantly lower and are even generally lower than the past delay time of day cycles to the current forecast period. For families with obvious weekly cycles, as No. 11 and No. 50, the weekly same time period correlations are even higher than the closest daily delay correlation.It can also be obtained from the above analysis that there are differences in the electricity consumption patterns of different households, and different input historical data make the forecast model different and the performance different. Specific analysis of specific targets is required, so that it is possible to select predictive variables with higher prediction accuracy. To find how to select the historical data as inputs can better improve the performance of forecast model and how the model related factors impact the performance, several compared forecast models are designed in the next section.


## 2.3. Performance Evaluation

The following four indexes are selected to evaluate the forecast model performance. MSE is the mean square error or the residual mean square. Equation (7) shows how to calculate the MSE value. y^i is a vector of N predictions, and yi is the vector of observed values corresponding to the inputs to the function which generates the predictions. ei stands for the square of the errors. An MSE value closer to 0 indicates a fitting that is more useful for prediction when the model is not overfitted. (7)MSE=1N∑i=1Nei2=1N∑i=1Ny^i-yi2MAPE is the mean absolute percentage error, which is accuracy evaluation and comparison of a forecasting method in statistics and especially a widely used metric in energy [32, 34]. The definition of MAPE is as follows:(8)MAPE=1N∑i=1Nyi-y^iyi×100%However, for small household electricity consumption, the daily electricity consumption varies greatly with time. If only the MAPE is considered, large percentage errors will be obtained in small power consumption periods, so that the MAPE throughout the day will become very large. The low power consumption is often only tens to hundreds of watts per hour, but at peak times, electricity is often used more than kW per hour. In other words, it is more important to accurately predict the electricity consumption during peak hours, so the mean absolute error (MAE) is also adopted to evaluate the prediction accuracy. The MAE can be calculated as(9)MAE=∑i=1Nyi-y^iNAnother statistic metric, regression coefficient,R, is also applied to indicate the amount of variance explained by the model. R is defined as (10), y-i is the mean of the observed data value, y^i- is the mean of the predicted values, ∑i=1N(yi-y^i)2 is the residual sum of squares, and ∑i=1N(yi-y-i)2 is the explained sum of squares. R can take on any value between 0 and 1, with a value closer to 1 indicating that a greater proportion of variance is accounted for by the model [35].(10)R=∑i=1Nyi^-y^i-yi-y-i∑i=1Nyi^-y^i-2∑i=1Nyi-y-i2


## 3. Inputs Selection and Relative Factors Analysis

In this part, aiming at giving a better chosen on input vectors of IBNN method load forecasting model, authors define several models of BNN to analyze different factors.


### 3.1. Basic Inputs Selection of IBNN Model

At first, an IBNN model is built with 16 load related inputs, named as BNN_16. The vectors of inputs are shown in(11)VI=t,dt,T,Tn-1,Tn-2,RH,RHn-1,RHn-2,Ln-1,Ln-2,Ln-3,Ln-4,Ln-24/ti,Ln-24/ti·2,Ln-24/ti·7,Ln-24/ti·7·2Here in the above equation, the input factors which are mostly considered in the existed models would be the time category and the meteorological category. In this article, time of everyday,t, day-type (which is defined as integers from 1 to 7 to express Monday to Sunday and 8 to express special holidays), dt, ambient temperature, T, and relative humidity, RH, are firstly considered as the inputs. n is used to represent the series order number of historical sample data’s intervals, and ti is the observed interval time. For instance, Tn-1 means the temperature vector observed from the past one interval. Due to the fact that there is no record before the historical first interval, here use T1 as the initial value to complement the vector. If other vectors lack some items, use the same complement method. According to [36], for marine climate or inshore areas, relative humidity also may affect the consumption on electricity. As in this model, there is no time delay in the NN structure and there is a study suggesting that human’s perception of temperature and relative humidity is delay with some time [37]. Taking this study as a reference, then adding historical environmental data as input vectors also very likely can improve the BNN prediction model’s performance. With similar meaning of subscript, the eight historical data vectors in the back are actual load in the first past interval, Ln-1, second past interval, Ln-2, third past interval, Ln-3, fourth past interval, Ln-4,same interval of yesterday, Ln-24/ti, same interval of the day before yesterday, Ln-24/ti·2, same interval in last week of the same day-type, Ln-24/ti·7, and same interval in week before last week of the same day-type, Ln-24/ti·7·2, respectively. These eight inputs of the forecast model basically cover the most relevant historical load values within past two weeks. The target vector is defined as Ln, which is the time series of last observation.The actual load data used in this article are from a sample of 300 homes supplied by Ausgrid from July 2010 to June 2011. The related weather information is from Australian Bureau of Meteorology. No. 17 of 300 homes is selected to validate and discuss the built forecasting models as it has the largest average daily electricity demand. The average daily electricity consumption is 36.83 kWh and the average interval electricity consumption is 0.77 kWh. As the data is observed every half hour, the total sample number is 17520 in one whole year with 365 days. The training set, validation set, and test set is created by a fixed partition algorithm called ‘divideind’ in Matlab with 60%, 20%, and 20% respectively.


### 3.2. Models with Different Periods of Historical Data

As the electricity demand is testified to vary with changes of the weather factors, the period of historical data, to great extent, decides the performance of obtained forecasting model. In Table2, number of input vectors is increased with extending the range of historical data.Table 2
Inputs of IBNN with different period of historic data.
Model Inputs vectors (number of input vectors) BNN_noL t , d t , T , T n - 1 , T n - 2 , R H , R H n - 1 , R H n - 2   ( 8 ) BNN_0.5hours t , d t , T , T n - 1 , T n - 2 , R H , R H n - 1 , R H n - 2 , L n - 1   ( 9 ) BNN_1hour t , d t , T , T n - 1 , T n - 2 , R H , R H n - 1 , R H n - 2 , L n - 1 , L n - 2   ( 10 ) BNN_2hours t , d t , T , T n - 1 , T n - 2 , R H , R H n - 1 , R H n - 2 , L n - 1 , L n - 2 , L n - 3 , L n - 4   ( 12 ) BNN_2days t , d t , T , T n - 1 , T n - 2 , R H , R H n - 1 , R H n - 2 , L n - 1 , L n - 2 , L n - 3 , L n - 4 , L n - 24 / t i   ( 13 ) BNN_3days t , d t , T , T n - 1 , T n - 2 , R H , R H n - 1 , R H n - 2 , L n - 1 , L n - 2 , L n - 3 , L n - 4 , L n - 24 / t i , L n - 24 / t i ⋅ 2   ( 14 ) BNN_1week t , d t , T , T n - 1 , T n - 2 , R H , R H n - 1 , R H n - 2 , L n - 1 , L n - 2 , L n - 3 , L n - 4 , L n - 24 / t i , L n - 24 / t i ⋅ 2 , L n - 24 / t i ⋅ 7   ( 15 ) BNN_2weeks (BNN_16) t , d t , T , T n - 1 , T n - 2 , R H , R H n - 1 , R H n - 2 , L n - 1 , L n - 2 , L n - 3 , L n - 4 , L n - 24 / t i , L n - 24 / t i ⋅ 2 , L n - 24 / t i ⋅ 7 , L n - 24 / t i ⋅ 7 ⋅ 2   ( 16 ) BNN_1month t , d t , T , T n - 1 , T n - 2 , R H , R H n - 1 , R H n - 2 , L n - 1 , L n - 2 , L n - 3 , L n - 4 , L n - 24 / t i , L n - 24 / t i ⋅ 2 , L n - 24 / t i ⋅ 7 , L n - 24 / t i ⋅ 7 ⋅ 2 , L n - 24 / t i ⋅ 7 ⋅ 3   a n d   L n - 24 / t i ⋅ 7 ⋅ 4   ( 18 ) BNN_2months t , d t , T , T n - 1 , T n - 2 , R H , R H n - 1 , R H n - 2 , L n - 1 , L n - 2 , L n - 3 , L n - 4 , L n - 24 / t i , L n - 24 / t i ⋅ 2 , L n - 24 / t i ⋅ 7 , L n - 24 / t i ⋅ 7 ⋅ 2 , L n - 24 / t i ⋅ 7 ⋅ 3 , L n - 24 / t i ⋅ 7 ⋅ 4 , L n - 24 / t i ⋅ 7 ⋅ 5 , L n - 24 / t i ⋅ 7 ⋅ 6 , L n - 24 / t i ⋅ 7 ⋅ 7   a n d   L n - 24 / t i ⋅ 7 ⋅ 8   ( 22 )Due to the demand usually with a weekly cycle, here only add vectors of real load data at the same time in past weeks. The model is studied with real load data in the next part. Because the time interval of the data applied in this paper is 0.5 hour, to clearly illustrate the different time period, the compared models are named with real time period in inputs selection.According to the models built in Table2, the following values are obtained from the IBNN program. When increasing the number of inputs with historic data, in Table 3, the results show that performance of training set will be slightly better with the raising number of inputs. However, the test set is obtained with random algorithm, and from the table, the performance of test set does not keep improving with the increasing inputs number. This suggests if the real load observations for training are enough, there is no need to add too many historic inputs vectors.Table 3
Results of IBNN models with different range of history data.
Model IBNN (Inputs number/Hidden neurons) Training set (60%) Test set (20%) Computing time (s) MSE R MAPE (%) MSE R MAPE (%) BNN_0.5hours (9/8) 9.83e-2 8.71e-1 11.58 9.43e-2 8.71e-1 11.66 9 BNN_1hour (10/8) 9.63e-2 8.72e-1 11.30 9.54e-2 8.76e-1 11.88 10 BNN_2hours (12/8) 9.46e-2 8.77e-1 11.45 1.00e-1 8.58e-1 12.32 14 BNN_2days (13/8) 8.83e-2 8.85e-1 10.80 8.62e-2 8.84e-1 10.36 14 BNN_3days (14/8) 8.66e-2 8.86e-1 10.65 8.45e-2 8.91e-1 10.60 13 BNN_1week (15/8) 8.37e-2 8.92e-1 10.64 8.97e-2 8.76e-1 10.68 16 BNN_2weeks (16/8) 8.43e-2 8.89e-1 10.63 8.57e-2 8.89e-1 10.54 18 BNN_1month (18/8) 8.30e-2 8.92e-1 10.81 7.96e-2 8.92e-1 10.35 34 BNN_2months (22/8) 7.44e-2 9.05e-1 10.67 8.30e-2 8.85e-1 11.44 37The comparison between real data and the IBNN model with different numbers of historic inputs is illustrated in Figure8. Obviously, the prediction model BNN_0.5 hour is significantly less effective than the other three. The graph also shows that when historical data reaches a certain time range, using more input vectors with longer history data can no’t apparently improve the accuracy of the forecasting model and only increase the computing time.Figure 8
Comparison of real data and forecasting values under BNN_0.5hour, BNN_2 weeks, BNN_1 month, and BNN_2 months of 8 hidden neurons.


### 3.3. Models with Different Prediction Time Range

To test the accuracies of the IBNN models under different prediction time, compared models with 16 inputs are designed, which are listed in Table4.Table 4
Inputs of IBNN under different prediction time.
Model Inputs vectors (number of input vectors) BNN_0.5h V I p t 1 = t , d t , T n - 1 , T n - 2 , T n - 3 , R H n - 1 , R H n - 2 , R H n - 3 , L n - 2 , L n - 3 , L n - 4 , L n - 5 , L n - 24 / t i , L n - 24 / t i ⋅ 2 , L n - 24 / t i ⋅ 7 , L n - 24 / t i ⋅ 7 ⋅ 2 BNN_1h V I p t 2 = t , d t , T n - 1 / t i , T n - 1 / t i - 1 , T n - 1 / t i - 2 , R H n - 1 / t i , R H n - 1 / t i - 1 , R H n - 1 / t i - 2 , L n - - 1 / t i - 1 , L n - 1 / t i - 2 , L n - 1 / t i - 3 , L n - 1 / t i - 4 , L n - 24 / t i , L n - 24 / t i ⋅ 2 , L n - 24 / t i ⋅ 7 , L n - 24 / t i ⋅ 7 ⋅ 2 BNN_4h V I p t 3 = t , d t , T n - 4 / t i , T n - 4 / t i - 1 , T n - 4 / t i - 2 , R H n - 4 / t i , R H n - 4 / t i - 1 , R H n - 4 / t i - 2 , L n - - 4 / t i - 1 , L n - 4 / t i - 2 , L n - 4 / t i - 3 , L n - 4 / t i - 4 , L n - 24 / t i , L n - 24 / t i ⋅ 2 , L n - 24 / t i ⋅ 7 , L n - 24 / t i ⋅ 7 ⋅ 2 BNN_12h V I p t 4 = t , d t , T n - 12 / t i , T n - 12 / t i - 1 , T n - 12 / t i - 2 , R H n - 12 / t i , R H n - 12 / t i - 1 , R H n - 12 / t i - 2 , L n - - 12 / t i - 1 , L n - 12 / t i - 2 , L n - 12 / t i - 3 , L n - 12 / t i - 4 , L n - 24 / t i , L n - 24 / t i ⋅ 2 , L n - 24 / t i ⋅ 7 , L n - 24 / t i ⋅ 7 ⋅ 2 BNN_24h V I p t 5 = t , d t , T n - 24 / t i , T n - 24 / t i - 1 , T n - 24 / t i - 2 , R H n - 24 / t i , R H n - 24 / t i - 1 , R H n - 24 / t i - 2 , L n - - 24 / t i - 1 , L n - 24 / t i - 2 , L n - 24 / t i - 3 , L n - 24 / t i - 4 , L n - 24 / t i ⋅ 2 , L n - 24 / t i , L n - 24 / t i ⋅ 7 , L n - 24 / t i ⋅ 7 ⋅ 2For better upgrading the forecast learning model, in our design the chosen historical inputs should be the latest observed actual load data. With this consideration in Table4, it can be seen that the load historical input vectors are changed according to the prediction time range. First is a model to forecast load half hour ahead, second is to forecast load 1 hour ahead, until the last is to forecast load 24 hours ahead. The models are distinguished by the subscripts which represent the prediction time range. The prediction of electricity demand is usually used for energy management and electricity devices control, so with different optimization methods, the forecasting model needs to have reasonable prediction time.To predict the electricity load of several hours in advance, five forecasting models which applied the same sample data are built to examine the effectiveness of the IBNN model in the above. Table5 gives the results of the model with different forecasting time ahead.Table 5
Results of BNN_0.5h, BNN_12h, and BNN_24h.
Model Training set (60%) Test set (20%) Computing time (s) MSE R MAPE MSE R MAPE (%) (%) BNN_0.5h 8.35e-2 8.90e-1 10.62 8.71e-2 8.86e-1 10.65 7 BNN_1h 1.32e-1 8.20e-1 12.26 1.37e-1 8.15e-1 13.00 12 BNN_4h 1.80e-1 7.43e-1 14.41 1.91e-1 7.31e-1 14.47 26 BNN_12h 1.84e-1 7.39e-1 14.45 1.83e-1 7.32e-1 14.77 8 BNN_24h 1.82e-1 7.43e-1 14.41 1.84e-1 7.30e-1 14.56 12From the table it is clearly that the IBNN forecasting model can give a relatively high accuracy in very short-term forecasting. With the prediction time range extending, the MSE and R-square values become lower. However, when the range is more than 4 hours, there is not evident changing trend from the results. That means when existing sample data are used to forecast the load in a very short time in advance, the accuracy is very high, but when to forecast the load in the following few hours or a day, the accuracy seems to be around a lower boundary.As the discussion above, Figure9 shows two days’ comparison between the real data and the forecasting data with different forecasting times. From the graph, it is apparently that the dashed line, which is results from the model of forecasting 0.5 hour ahead, is very close to the black line, which is the actual load observation. The other two lines are results from forecasting models of 12 hours and 24 hours in advance respectively, it cannot easily define which one is better.Figure 9
Comparison of real data and forecasting values under BNN_0.5h, BNN_12h, and BNN_24h of 8 hidden neurons.


### 3.4. Range Requirement of Load Sample Data

Evidently that the forecasting model will have higher accuracy with longer period of historic electricity data. However, it is more useful to give a forecasting model which can predict the electricity load even with a relative short load recorded period, such as one year or just several months. To discuss such problem in this article, the authors try to assess the IBNN forecasting model (BNN_16) with five different periods of actual sample data under 8 hidden neurons, which are 1 month, 3 months, half year, 9 months, and a whole year, respectively.The obtained values in Table6 show that, with longer history period, the MSE becomes higher and the R-square becomes lower. However, the performance of the test set gets better. As the case studied here is one home in Sydney, seasonal weather factors must be taken into consideration. From the table, it can be concluded that, to obtain higher accuracy of prediction, at least half year load record should be used for building the forecasting model.Table 6
Results of BNN_16 model with different periods of historical data.
Historic period Training set (60%) Test set (20%) Computing time (s) MSE R MAPE MSE R MAPE (%) (%) 1 month 6.15e-2 9.61e-1 9.20 1.32e-1 9.14e-1 9.36 4 3 months 9.94e-2 9.00e-1 11.73 1.54e-1 8.47e-1 11.92 4 Half year 7.61e-2 8.91e-1 10.88 8.88e-2 8.76e-1 11.05 8 9 months 8.26e-2 8.91e-1 10.76 9.05e-2 8.83e-1 10.87 11 1 year 8.28e-2 8.92e-1 10.63 8.89e-2 8.83e-1 10.59 12


## 3.1. Basic Inputs Selection of IBNN Model

At first, an IBNN model is built with 16 load related inputs, named as BNN_16. The vectors of inputs are shown in(11)VI=t,dt,T,Tn-1,Tn-2,RH,RHn-1,RHn-2,Ln-1,Ln-2,Ln-3,Ln-4,Ln-24/ti,Ln-24/ti·2,Ln-24/ti·7,Ln-24/ti·7·2Here in the above equation, the input factors which are mostly considered in the existed models would be the time category and the meteorological category. In this article, time of everyday,t, day-type (which is defined as integers from 1 to 7 to express Monday to Sunday and 8 to express special holidays), dt, ambient temperature, T, and relative humidity, RH, are firstly considered as the inputs. n is used to represent the series order number of historical sample data’s intervals, and ti is the observed interval time. For instance, Tn-1 means the temperature vector observed from the past one interval. Due to the fact that there is no record before the historical first interval, here use T1 as the initial value to complement the vector. If other vectors lack some items, use the same complement method. According to [36], for marine climate or inshore areas, relative humidity also may affect the consumption on electricity. As in this model, there is no time delay in the NN structure and there is a study suggesting that human’s perception of temperature and relative humidity is delay with some time [37]. Taking this study as a reference, then adding historical environmental data as input vectors also very likely can improve the BNN prediction model’s performance. With similar meaning of subscript, the eight historical data vectors in the back are actual load in the first past interval, Ln-1, second past interval, Ln-2, third past interval, Ln-3, fourth past interval, Ln-4,same interval of yesterday, Ln-24/ti, same interval of the day before yesterday, Ln-24/ti·2, same interval in last week of the same day-type, Ln-24/ti·7, and same interval in week before last week of the same day-type, Ln-24/ti·7·2, respectively. These eight inputs of the forecast model basically cover the most relevant historical load values within past two weeks. The target vector is defined as Ln, which is the time series of last observation.The actual load data used in this article are from a sample of 300 homes supplied by Ausgrid from July 2010 to June 2011. The related weather information is from Australian Bureau of Meteorology. No. 17 of 300 homes is selected to validate and discuss the built forecasting models as it has the largest average daily electricity demand. The average daily electricity consumption is 36.83 kWh and the average interval electricity consumption is 0.77 kWh. As the data is observed every half hour, the total sample number is 17520 in one whole year with 365 days. The training set, validation set, and test set is created by a fixed partition algorithm called ‘divideind’ in Matlab with 60%, 20%, and 20% respectively.


## 3.2. Models with Different Periods of Historical Data

As the electricity demand is testified to vary with changes of the weather factors, the period of historical data, to great extent, decides the performance of obtained forecasting model. In Table2, number of input vectors is increased with extending the range of historical data.Table 2
Inputs of IBNN with different period of historic data.
Model Inputs vectors (number of input vectors) BNN_noL t , d t , T , T n - 1 , T n - 2 , R H , R H n - 1 , R H n - 2   ( 8 ) BNN_0.5hours t , d t , T , T n - 1 , T n - 2 , R H , R H n - 1 , R H n - 2 , L n - 1   ( 9 ) BNN_1hour t , d t , T , T n - 1 , T n - 2 , R H , R H n - 1 , R H n - 2 , L n - 1 , L n - 2   ( 10 ) BNN_2hours t , d t , T , T n - 1 , T n - 2 , R H , R H n - 1 , R H n - 2 , L n - 1 , L n - 2 , L n - 3 , L n - 4   ( 12 ) BNN_2days t , d t , T , T n - 1 , T n - 2 , R H , R H n - 1 , R H n - 2 , L n - 1 , L n - 2 , L n - 3 , L n - 4 , L n - 24 / t i   ( 13 ) BNN_3days t , d t , T , T n - 1 , T n - 2 , R H , R H n - 1 , R H n - 2 , L n - 1 , L n - 2 , L n - 3 , L n - 4 , L n - 24 / t i , L n - 24 / t i ⋅ 2   ( 14 ) BNN_1week t , d t , T , T n - 1 , T n - 2 , R H , R H n - 1 , R H n - 2 , L n - 1 , L n - 2 , L n - 3 , L n - 4 , L n - 24 / t i , L n - 24 / t i ⋅ 2 , L n - 24 / t i ⋅ 7   ( 15 ) BNN_2weeks (BNN_16) t , d t , T , T n - 1 , T n - 2 , R H , R H n - 1 , R H n - 2 , L n - 1 , L n - 2 , L n - 3 , L n - 4 , L n - 24 / t i , L n - 24 / t i ⋅ 2 , L n - 24 / t i ⋅ 7 , L n - 24 / t i ⋅ 7 ⋅ 2   ( 16 ) BNN_1month t , d t , T , T n - 1 , T n - 2 , R H , R H n - 1 , R H n - 2 , L n - 1 , L n - 2 , L n - 3 , L n - 4 , L n - 24 / t i , L n - 24 / t i ⋅ 2 , L n - 24 / t i ⋅ 7 , L n - 24 / t i ⋅ 7 ⋅ 2 , L n - 24 / t i ⋅ 7 ⋅ 3   a n d   L n - 24 / t i ⋅ 7 ⋅ 4   ( 18 ) BNN_2months t , d t , T , T n - 1 , T n - 2 , R H , R H n - 1 , R H n - 2 , L n - 1 , L n - 2 , L n - 3 , L n - 4 , L n - 24 / t i , L n - 24 / t i ⋅ 2 , L n - 24 / t i ⋅ 7 , L n - 24 / t i ⋅ 7 ⋅ 2 , L n - 24 / t i ⋅ 7 ⋅ 3 , L n - 24 / t i ⋅ 7 ⋅ 4 , L n - 24 / t i ⋅ 7 ⋅ 5 , L n - 24 / t i ⋅ 7 ⋅ 6 , L n - 24 / t i ⋅ 7 ⋅ 7   a n d   L n - 24 / t i ⋅ 7 ⋅ 8   ( 22 )Due to the demand usually with a weekly cycle, here only add vectors of real load data at the same time in past weeks. The model is studied with real load data in the next part. Because the time interval of the data applied in this paper is 0.5 hour, to clearly illustrate the different time period, the compared models are named with real time period in inputs selection.According to the models built in Table2, the following values are obtained from the IBNN program. When increasing the number of inputs with historic data, in Table 3, the results show that performance of training set will be slightly better with the raising number of inputs. However, the test set is obtained with random algorithm, and from the table, the performance of test set does not keep improving with the increasing inputs number. This suggests if the real load observations for training are enough, there is no need to add too many historic inputs vectors.Table 3
Results of IBNN models with different range of history data.
Model IBNN (Inputs number/Hidden neurons) Training set (60%) Test set (20%) Computing time (s) MSE R MAPE (%) MSE R MAPE (%) BNN_0.5hours (9/8) 9.83e-2 8.71e-1 11.58 9.43e-2 8.71e-1 11.66 9 BNN_1hour (10/8) 9.63e-2 8.72e-1 11.30 9.54e-2 8.76e-1 11.88 10 BNN_2hours (12/8) 9.46e-2 8.77e-1 11.45 1.00e-1 8.58e-1 12.32 14 BNN_2days (13/8) 8.83e-2 8.85e-1 10.80 8.62e-2 8.84e-1 10.36 14 BNN_3days (14/8) 8.66e-2 8.86e-1 10.65 8.45e-2 8.91e-1 10.60 13 BNN_1week (15/8) 8.37e-2 8.92e-1 10.64 8.97e-2 8.76e-1 10.68 16 BNN_2weeks (16/8) 8.43e-2 8.89e-1 10.63 8.57e-2 8.89e-1 10.54 18 BNN_1month (18/8) 8.30e-2 8.92e-1 10.81 7.96e-2 8.92e-1 10.35 34 BNN_2months (22/8) 7.44e-2 9.05e-1 10.67 8.30e-2 8.85e-1 11.44 37The comparison between real data and the IBNN model with different numbers of historic inputs is illustrated in Figure8. Obviously, the prediction model BNN_0.5 hour is significantly less effective than the other three. The graph also shows that when historical data reaches a certain time range, using more input vectors with longer history data can no’t apparently improve the accuracy of the forecasting model and only increase the computing time.Figure 8
Comparison of real data and forecasting values under BNN_0.5hour, BNN_2 weeks, BNN_1 month, and BNN_2 months of 8 hidden neurons.


## 3.3. Models with Different Prediction Time Range

To test the accuracies of the IBNN models under different prediction time, compared models with 16 inputs are designed, which are listed in Table4.Table 4
Inputs of IBNN under different prediction time.
Model Inputs vectors (number of input vectors) BNN_0.5h V I p t 1 = t , d t , T n - 1 , T n - 2 , T n - 3 , R H n - 1 , R H n - 2 , R H n - 3 , L n - 2 , L n - 3 , L n - 4 , L n - 5 , L n - 24 / t i , L n - 24 / t i ⋅ 2 , L n - 24 / t i ⋅ 7 , L n - 24 / t i ⋅ 7 ⋅ 2 BNN_1h V I p t 2 = t , d t , T n - 1 / t i , T n - 1 / t i - 1 , T n - 1 / t i - 2 , R H n - 1 / t i , R H n - 1 / t i - 1 , R H n - 1 / t i - 2 , L n - - 1 / t i - 1 , L n - 1 / t i - 2 , L n - 1 / t i - 3 , L n - 1 / t i - 4 , L n - 24 / t i , L n - 24 / t i ⋅ 2 , L n - 24 / t i ⋅ 7 , L n - 24 / t i ⋅ 7 ⋅ 2 BNN_4h V I p t 3 = t , d t , T n - 4 / t i , T n - 4 / t i - 1 , T n - 4 / t i - 2 , R H n - 4 / t i , R H n - 4 / t i - 1 , R H n - 4 / t i - 2 , L n - - 4 / t i - 1 , L n - 4 / t i - 2 , L n - 4 / t i - 3 , L n - 4 / t i - 4 , L n - 24 / t i , L n - 24 / t i ⋅ 2 , L n - 24 / t i ⋅ 7 , L n - 24 / t i ⋅ 7 ⋅ 2 BNN_12h V I p t 4 = t , d t , T n - 12 / t i , T n - 12 / t i - 1 , T n - 12 / t i - 2 , R H n - 12 / t i , R H n - 12 / t i - 1 , R H n - 12 / t i - 2 , L n - - 12 / t i - 1 , L n - 12 / t i - 2 , L n - 12 / t i - 3 , L n - 12 / t i - 4 , L n - 24 / t i , L n - 24 / t i ⋅ 2 , L n - 24 / t i ⋅ 7 , L n - 24 / t i ⋅ 7 ⋅ 2 BNN_24h V I p t 5 = t , d t , T n - 24 / t i , T n - 24 / t i - 1 , T n - 24 / t i - 2 , R H n - 24 / t i , R H n - 24 / t i - 1 , R H n - 24 / t i - 2 , L n - - 24 / t i - 1 , L n - 24 / t i - 2 , L n - 24 / t i - 3 , L n - 24 / t i - 4 , L n - 24 / t i ⋅ 2 , L n - 24 / t i , L n - 24 / t i ⋅ 7 , L n - 24 / t i ⋅ 7 ⋅ 2For better upgrading the forecast learning model, in our design the chosen historical inputs should be the latest observed actual load data. With this consideration in Table4, it can be seen that the load historical input vectors are changed according to the prediction time range. First is a model to forecast load half hour ahead, second is to forecast load 1 hour ahead, until the last is to forecast load 24 hours ahead. The models are distinguished by the subscripts which represent the prediction time range. The prediction of electricity demand is usually used for energy management and electricity devices control, so with different optimization methods, the forecasting model needs to have reasonable prediction time.To predict the electricity load of several hours in advance, five forecasting models which applied the same sample data are built to examine the effectiveness of the IBNN model in the above. Table5 gives the results of the model with different forecasting time ahead.Table 5
Results of BNN_0.5h, BNN_12h, and BNN_24h.
Model Training set (60%) Test set (20%) Computing time (s) MSE R MAPE MSE R MAPE (%) (%) BNN_0.5h 8.35e-2 8.90e-1 10.62 8.71e-2 8.86e-1 10.65 7 BNN_1h 1.32e-1 8.20e-1 12.26 1.37e-1 8.15e-1 13.00 12 BNN_4h 1.80e-1 7.43e-1 14.41 1.91e-1 7.31e-1 14.47 26 BNN_12h 1.84e-1 7.39e-1 14.45 1.83e-1 7.32e-1 14.77 8 BNN_24h 1.82e-1 7.43e-1 14.41 1.84e-1 7.30e-1 14.56 12From the table it is clearly that the IBNN forecasting model can give a relatively high accuracy in very short-term forecasting. With the prediction time range extending, the MSE and R-square values become lower. However, when the range is more than 4 hours, there is not evident changing trend from the results. That means when existing sample data are used to forecast the load in a very short time in advance, the accuracy is very high, but when to forecast the load in the following few hours or a day, the accuracy seems to be around a lower boundary.As the discussion above, Figure9 shows two days’ comparison between the real data and the forecasting data with different forecasting times. From the graph, it is apparently that the dashed line, which is results from the model of forecasting 0.5 hour ahead, is very close to the black line, which is the actual load observation. The other two lines are results from forecasting models of 12 hours and 24 hours in advance respectively, it cannot easily define which one is better.Figure 9
Comparison of real data and forecasting values under BNN_0.5h, BNN_12h, and BNN_24h of 8 hidden neurons.


## 3.4. Range Requirement of Load Sample Data

Evidently that the forecasting model will have higher accuracy with longer period of historic electricity data. However, it is more useful to give a forecasting model which can predict the electricity load even with a relative short load recorded period, such as one year or just several months. To discuss such problem in this article, the authors try to assess the IBNN forecasting model (BNN_16) with five different periods of actual sample data under 8 hidden neurons, which are 1 month, 3 months, half year, 9 months, and a whole year, respectively.The obtained values in Table6 show that, with longer history period, the MSE becomes higher and the R-square becomes lower. However, the performance of the test set gets better. As the case studied here is one home in Sydney, seasonal weather factors must be taken into consideration. From the table, it can be concluded that, to obtain higher accuracy of prediction, at least half year load record should be used for building the forecasting model.Table 6
Results of BNN_16 model with different periods of historical data.
Historic period Training set (60%) Test set (20%) Computing time (s) MSE R MAPE MSE R MAPE (%) (%) 1 month 6.15e-2 9.61e-1 9.20 1.32e-1 9.14e-1 9.36 4 3 months 9.94e-2 9.00e-1 11.73 1.54e-1 8.47e-1 11.92 4 Half year 7.61e-2 8.91e-1 10.88 8.88e-2 8.76e-1 11.05 8 9 months 8.26e-2 8.91e-1 10.76 9.05e-2 8.83e-1 10.87 11 1 year 8.28e-2 8.92e-1 10.63 8.89e-2 8.83e-1 10.59 12


## 4. Results and Discussion

### 4.1. Comparison between IBNN and TSNN

The same data set as above is chosen for the following validation and analysis. The authors use a toolbox named Neural Net in Matlab to run the designed forecasting model. The time-series Bayesian Neural Networks (TS_BNN) method has been described in the introduction part. The inputs of time-series BNN are defined as follows:(12)VI_TS=t,dt,T,RHTable7 lists the computing results of TS_BNN model and BNN_16 under different hidden neurons or time delays. Here the authors firstly analyze effect of the time delays and hidden neurons on the TS_BNN forecasting model. From the results it can be found that TS_BNN with the increasing of the closed-loop input time delays and the performance of prediction model is evidently improved. However, when the time delays are set to 50 intervals, 25 hours, which is one more hour than one day, the running time reaches half past three minutes.Table 7
Results of time-series BNN and BNN_16 model.
Model   Training set (60%) Test set (20%) Computing time (s) Time delay Hidden neurons MSE R MAPE MSE R MAPE (%) (%) TS_BNN 1 2 1.07e-1 8.58e-1 11.75 1.05e-1 8.57e-1 11.86 6 2 2 1.06e-2 8.58e-1 11.79 1.04e-1 8.63e-1 12.25 5 50 2 8.79e-2 8.83e-1 10.74 8.76e-2 8.87e-1 11.34 192 1 6 1.01e-2 8.65e-1 11.46 9.80e-2 8.74e-1 11.67 27 1 8 9.84e-2 8.68e-1 11.73 1.05e-1 8.66e-1 11.50 29  BNN_16 - 2 9.27e-2 8.78e-1 11.38 9.41e-2 8.75e-1 11.40 2 - 3 8.90e-2 8.84e-1 11.41 9.65e-2 8.68e-1 11.55 2 - 5 8.56e-2 8.88e-1 10.93 9.46e-2 8.75e-1 10.72 3 - 8 8.26e-2 8.92e-1 10.64 8.56e-2 8.87e-1 10.52 6 - 10 8.16e-2 8.93e-1 10.54 8.77e-2 8.88e-1 10.92 7 - 15 7.78e-2 8.99e-1 10.55 8.97e-2 8.80e-1 10.42 18 - 18 7.72e-2 8.99e-1 10.36 8.95e-2 8.83e-1 10.87 139 - 20 7.62e-2 9.01e-1 10.43 8.80e-2 8.83e-1 10.94 148 - 30 7.19e-2 9.07e-1 10.13 9.29e-2 8.78e-1 10.98 355 - 50 6.47e-2 9.17e-1 9.62 9.41e-2 8.73e-1 11.59 732 - 100 5.81e-2 9.26e-1 9.04 1.07e-1 8.59e-1 12.50 1856From Table7, it shows that, with the increasing of hidden neurons number, the MSE of the training set becomes lower and R-square values become higher; these performances seem facially better. However, the MSE values of test set do not decrease and the R-square values do not increase completely with the increasing of hidden neurons. Above computing results show that prediction model can not obtain completely better performance with the number of hidden neurons. In Table 7, when the hidden neurons of BNN_16 are 8, the MSE and R-square of test set have reached close to the optimal value. When the hidden neurons are more than 8, the computing results are in repeated fluctuations. Correspondingly, it can be seen that, with the increase of hidden neurons, the operation time of BNN prediction model is obviously prolonged. Therefore, it is very important to select appropriate hidden neurons according to the model to improve the performance and efficiency of BNN model and reduce the computation time. In general, the numbers of hidden neurons are within the range of 3~8. It also should to be noted that the best performance of TS_BNN model is under the condition with 50 time delays and 2 hidden neurons, with more than three minutes of running time. The closest performance of BNN_16 is under the condition of 8 hidden neurons with only six seconds. Obviously BNN_16 forecast model significantly reduces the time.The randomly selected comparison between actual recorded data and the IBNN model can be seen in Figure10, which is from 8th Oct 2010 to 15th Oct 2010. Here the illustration of one week’s forecasting load values and real load values comparison is just randomly selected. From the figure, it is obvious that the forecasting model performs well with the trend varying of the real data. However, when the actual data changed severely, the deviation between actual data and forecast data increased to a certain extent.Figure 10
Comparison of real data and forecasting values under IBNN of 8 hidden neurons.Table8 discussed the influence of input vectors under TS_BNN model. Due to the time delay of historical load data, the TS_BNN model only uses four related factors as input vectors, which are time, temperature, relative humidity, and day-type. The approach used here is to eliminate one of the relevant factors to observe the results of the computation.Table 8
Results of time-series BNN under different input vectors.
TS-BNN (Hidden neurons 4) Input vectors Training set (60%) Test set (20%) Computing time (s) MSE R MAPE (%) MSE R MAPE (%) [ t , d t , T , R H ] 9.97e-2 8.61e-1 11.67 1.02e-1 8.55e-1 11.78 15  [ d t , T , R H ] 1.07e-1 8.55e-1 11.82 1.11e-1 8.58e-1 12.49 7 [ t , d t , R H ] 1.08e-1 8.55e-1 11.60 1.05e-2 8.61e-1 11.45 9 [ t , d t , T ] 1.04e-1 8.60e-1 11.76 1.14e-1 8.52e-1 11.13 15 [ t , T , R H ] 1.01e-1 8.66e-1 11.91 1.09e-1 8.53e-1 11.44 5From the above results, although it is difficult to say what kind of factors related has more impact on electricity consumption of the consumer, by comparing the situations of eliminating a factor and using total four input vectors, the results show whatever reducing anyone of the four inputs; the performance of the prediction model became lower than the model with total four inputs. It means that all the four factors should have influence on the consumer’s electricity load.To analyze the impacts of different considered input factors on IBNN model, here the authors define 13 models with different numbers of inputs vectors (listed in Table9).Table 9
Comparison models with the basic IBNN with 16 inputs.
Model No. Inputs vectors describe (number of input vectors) Inputs selection 1 BNN_16 (16) t , d t , T , T n - 1 , T n - 2 , R H , R H n - 1 , R H n - 2 , L n - 1 , L n - 2 , L n - 3 , L n - 4 , L n - 24 / t i , L n - 24 / t i ⋅ 2 , L n - 24 / t i ⋅ 7 , L n - 24 / t i ⋅ 7 ⋅ 2 2 No historical Load (8) t , d t , T , T n - 1 , T n - 2 , R H , R H n - 1 , R H n - 2 3 Less T (14) t , d t , T , R H , R H n - 1 , R H n - 2 , L n - 1 , L n - 2 , L n - 3 , L n - 4 , L n - 24 / t i , L n - 24 / t i ⋅ 2 , L n - 24 / t i ⋅ 7 , L n - 24 / t i ⋅ 7 ⋅ 2 4 Less RH (14) t , d t , T , T n - 1 , T n - 2 , R H , L n - 1 , L n - 2 , L n - 3 , L n - 4 , L n - 24 / t i , L n - 24 / t i ⋅ 2 , L n - 24 / t i ⋅ 7 , L n - 24 / t i ⋅ 7 ⋅ 2 5 No T (13) t , d t , R H , R H n - 1 , R H n - 2 , L n - 1 , L n - 2 , L n - 3 , L n - 4 , L n - 24 / t i , L n - 24 / t i ⋅ 2 , L n - 24 / t i ⋅ 7 , L n - 24 / t i ⋅ 7 ⋅ 2 6 No RH (13) t , d t , T , T n - 1 , T n - 2 , L n - 1 , L n - 2 , L n - 3 , L n - 4 , L n - 24 / t i , L n - 24 / t i ⋅ 2 , L n - 24 / t i ⋅ 7 , L n - 24 / t i ⋅ 7 ⋅ 2 7 No time (15) d t , T , T n - 1 , T n - 2 , R H , R H n - 1 , R H n - 2 , L n - 1 , L n - 2 , L n - 3 , L n - 4 , L n - 24 / t i , L n - 24 / t i ⋅ 2 , L n - 24 / t i ⋅ 7 , L n - 24 / t i ⋅ 7 ⋅ 2 8 No day-type (15) t , T , T n - 1 , T n - 2 , R H , R H n - 1 , R H n - 2 , L n - 1 , L n - 2 , L n - 3 , L n - 4 , L n - 24 / t i , L n - 24 / t i ⋅ 2 , L n - 24 / t i ⋅ 7 , L n - 24 / t i ⋅ 7 ⋅ 2 9 Only Load (8) L n - 1 , L n - 2 , L n - 3 , L n - 4 , L n - 24 / t i , L n - 24 / t i ⋅ 2 , L n - 24 / t i ⋅ 7 , L n - 24 / t i ⋅ 7 ⋅ 2 10 Only T and Load (9) T , L n - 1 , L n - 2 , L n - 3 , L n - 4 , L n - 24 / t i , L n - 24 / t i ⋅ 2 , L n - 24 / t i ⋅ 7 , L n - 24 / t i ⋅ 7 ⋅ 2 11 Time, T and Load (10) t , T , L n - 1 , L n - 2 , L n - 3 , L n - 4 , L n - 24 / t i , L n - 24 / t i ⋅ 2 , L n - 24 / t i ⋅ 7 , L n - 24 / t i ⋅ 7 ⋅ 2 12 day-type, T and Load (10) d t , T , L n - 1 , L n - 2 , L n - 3 , L n - 4 , L n - 24 / t i , L n - 24 / t i ⋅ 2 , L n - 24 / t i ⋅ 7 , L n - 24 / t i ⋅ 7 ⋅ 2 13 T, RH and Load (10) T , R H , L n - 1 , L n - 2 , L n - 3 , L n - 4 , L n - 24 / t i , L n - 24 / t i ⋅ 2 , L n - 24 / t i ⋅ 7 , L n - 24 / t i ⋅ 7 ⋅ 2 T-Temperature RH-Relative Humidity.Besides discussing the impact of each factor, here the authors also want to find if increasing the number of historic temperature or humidity inputs can improve the forecasting performance. Under this consideration, 2 models called Less T and Less RH are defined, unlike applying another two past historical input vectors of temperature and humidity, applying only one temperature input and one humidity input.As mentioned above, the effects of different input factors on the model are analyzed. The MSE and R-square of training set are calculated with 3, 8, and 15 hidden neurons, respectively, to find similar results and exclude the impact on system randomly selecting data.From the calculated values in Table10, there are the following results. First, the comparison of the ‘Less T’ and ‘Less RH’ with the normal 16 inputs model (BNN_16) shows that increasing the input number of historic weather data cannot improve the model’s forecasting performance and surprisingly slightly lower the performance. However, the results in the table only show that this unit is not very sensitive with the temperature and humidity or there is a deduction that adding historical load vectors as inputs enhances the robustness of the prediction model. Second, deleting one related factor in the input vectors, there are ‘no T’, ‘no RH’, ‘no time’, and ‘no day-type’, four compared items with the results of BNN_16. The temperature has the largest impact on the model’s accuracy as the MSE of no T becomes the biggest and R-square gets the lowest value. There is not noticeable effect of the other three factors from the obtained values. However, it cannot just from the simple calculated values define that these three factors have positive effects on improving the model. Time and day-type to the basic load forecasting knowledge will significantly affect some users’ consumption mode, so the above results only can show that, under this IBNN model, the effect of these three factors is not obvious.Table 10
Results on analyzing impacts of related input factors.
Inputs impacts (number of input vectors) 3 Hidden neurons 8 Hidden neurons 15 Hidden neurons Training set (60%) Training set (60%) Training set (60%) MSE R MAPE MSE R MAPE MSE R MAPE (%) (%) (%) 1 BNN_16 (16) 9.02e-2 8.82e-1 11.24 8.71e-2 8.86e-1 10.64 8.48e-2 8.85e-1 10.35 2 No Load (8) 2.77e-1 5.84e-1 18.06 2.63e-1 5.86e-1 17.84 2.32e-1 6.25e-1 17.87 3 Less T (14) 9.07e-2 8.82e-1 11.29 9.02e-2 8.82e-1 10.51 8.13e-2 8.95e-1 10.41 4 Less RH (14) 9.11e-2 8.78e-1 11.12 8.23e-2 8.85e-1 10.63 8.35e-2 8.89e-1 10.48 5 No T (13) 9.21e-2 8.74e-1 11.18 9.10e-2 8.74e-1 10.66 9.07e-2 8.79e-1 10.41 6 No RH (13) 9.26e-2 8.76e-1 11.14 8.81e-2 8.83e-1 10.67 8.43e-2 8.83e-1 10.38 7 No time (15) 8.96e-2 8.85e-1 11.11 9.05e-2 8.79e-1 11.10 8.39e-2 8.91e-1 10.78 8 No day-type (15) 9.64e-2 8.79e-1 11.42 9.15e-2 8.86e-1 10.76 9.04e-2 8.89e-1 10.35 9 Only Load (8) 9.63e-2 8.70e-1 11.29 9.38e-2 8.76e-1 11.05 9.22e-2 8.83e-1 10.94 10 Only T and Load (9) 8.78e-2 8.88e-1 11.19 8.44e-2 8.90e-1 10.89 8.85e-2 8.83e-1 10.80 11 Time, T and Load (10) 9.14e-2 8.66e-1 11.17 8.65e-2 8.91e-1 10.86 8.11e-2 8.91e-1 10.52 12 day-type, T and Load (10) 9.33e-2 8.77e-1 11.53 8.70e-2 8.81e-1 11.14 8.21e-2 8.90e-1 10.93 13 T, RH and Load (10) 9.31e-2 8.71e-1 11.23 8.39e-2 8.91e-1 10.90 8.63e-2 8.86e-1 10.65From Tables9 and 10, the comparison of results by TS_BNN model and BNN_16 model validates the first deduction that the input historical load vectors enhance the robustness of the prediction model. In other words, it may also be noted that the increasing of inputs vectors on historical load data may improve the stability of the prediction model, and the influence of other factors on the performance is relatively reduced.In order to further validate the effectiveness of the model, Table11 uses the same BNN_16 structure to train the prediction models for 15 households which are randomly selected from the same Ausgrid yearly data set.Table 11
Results on different datasets.
Home number∖Methods IBNN (BNN_16) TSNN (TS_BNN, time delays = 25) MSE R MAE Time MSE R MAE Time 11 2.47e-2 0.87 0.10 17.48 2.38e-2 0.89 0.10 476.87 13 3.43e-2 0.85 0.09 12.05 3.24e-2 0.88 0.10 350.22 16 2.86e-2 0.87 0.10 7.79 2.83e-2 0.88 0.10 477.66 22 7.76e-2 0.72 0.16 9.73 7.24e-2 0.75 0.16 480.80 25 8.60e-2 0.90 0.15 11.94 8.34e-2 0.89 0.15 264.94 28 2.32e-2 0.87 0.07 21.89 2.68e-2 0.85 0.09 199.21 31 4.30e-2 0.83 0.09 10.56 4.78e-2 0.86 0.11 207.40 34 4.03e-2 0.82 0.11 12.84 4.25e-2 0.84 0.12 482.75 37 2.43e-2 0.89 0.09 12.86 1.81e-2 0.91 0.09 330.83 40 1.11e-2 0.91 0.06 14.64 1.12e-2 0.91 0.06 199.69 44 1.98e-2 0.79 0.07 11.09 2.11e-2 0.84 0.08 263.15 47 2.34e-2 0.90 0.09 9.64 2.36e-2 0.89 0.09 143.94 50 4.67e-2 0.51 0.13 7.49 4.58e-2 0.54 0.13 222.25 55 4.63e-2 0.89 0.16 5.63 4.83e-2 0.88 0.16 475.61 58 7.52e-2 0.84 0.17 11.77 8.09e-2 0.83 0.19 315.73As can be found from Table11, the performances of TSNN and IBNN training are very close, but the computing time is reduced by an average of 31 times. The shortest reduction time is from No. 28 family, which is 8 times shorter, and the longest reduction time is from No. 55 family which is shortened by more than 83 times.


### 4.2. Comparison with Other Prediction Methods

The comparison is between the proposed IBNN method and the methods from the MATLAB Statistics and Machine Learning Toolbox. The parameters of machine learning methods are defined as defaults. Table12 lists all the computing results with the inputs the same as BNN_16 of No. 17 household dataset.Table 12
Performance results of prediction methods.
Method Corresponding number MSE R MAE Time (s) Linear 1 9.90e-02 0.75 0.20 2.10 Interactions Linear 2 9.39e-02 0.77 0.20 4.79 Robust Linear 3 1.05e-01 0.74 0.19 3.74 Stepwise Linear 4 9.40e-02 0.77 0.20 1256.50 Fine Tree 5 1.30e-01 0.68 0.22 7.09 Medium Tree 6 1.09e-01 0.73 0.20 3.53 Coarse Tree 7 1.01e-01 0.75 0.19 2.73 Linear SVM 8 1.03e-01 0.75 0.19 96.97 Quadratic SVM 9 9.78e-02 0.76 0.19 214.74 Cubic SVM 10 9.25e-02 0.77 0.18 828.17 Fine Gaussian SVM 11 2.07e-01 0.49 0.29 159.63 Medium Gaussian SVM 12 9.05e-02 0.78 0.18 112.76 Coarse Gaussian SVM 13 9.88e-02 0.76 0.19 78.12 Boosted Trees 14 9.39e-02 0.77 0.19 23.57 Bagged Trees 15 8.45e-02 0.79 0.17 54.57 BNN_16 16 8.26e-02 0.89 0.18 9.33As can be seen from Table12, the MSE and R values of the IBNN method show the best results compared to other machine learning methods. Although the MAE value of IBNN is slightly inferior to the Bagged Trees method, it is greatly reduced in computation time by nearly five times. In order to more intuitively compare various methods, the authors have defined the corresponding number as the horizontal coordinate to draw the four evaluation indicators, respectively, as shown in the Figure 11.Figure 11
Performance comparison of prediction methods.


## 4.1. Comparison between IBNN and TSNN

The same data set as above is chosen for the following validation and analysis. The authors use a toolbox named Neural Net in Matlab to run the designed forecasting model. The time-series Bayesian Neural Networks (TS_BNN) method has been described in the introduction part. The inputs of time-series BNN are defined as follows:(12)VI_TS=t,dt,T,RHTable7 lists the computing results of TS_BNN model and BNN_16 under different hidden neurons or time delays. Here the authors firstly analyze effect of the time delays and hidden neurons on the TS_BNN forecasting model. From the results it can be found that TS_BNN with the increasing of the closed-loop input time delays and the performance of prediction model is evidently improved. However, when the time delays are set to 50 intervals, 25 hours, which is one more hour than one day, the running time reaches half past three minutes.Table 7
Results of time-series BNN and BNN_16 model.
Model   Training set (60%) Test set (20%) Computing time (s) Time delay Hidden neurons MSE R MAPE MSE R MAPE (%) (%) TS_BNN 1 2 1.07e-1 8.58e-1 11.75 1.05e-1 8.57e-1 11.86 6 2 2 1.06e-2 8.58e-1 11.79 1.04e-1 8.63e-1 12.25 5 50 2 8.79e-2 8.83e-1 10.74 8.76e-2 8.87e-1 11.34 192 1 6 1.01e-2 8.65e-1 11.46 9.80e-2 8.74e-1 11.67 27 1 8 9.84e-2 8.68e-1 11.73 1.05e-1 8.66e-1 11.50 29  BNN_16 - 2 9.27e-2 8.78e-1 11.38 9.41e-2 8.75e-1 11.40 2 - 3 8.90e-2 8.84e-1 11.41 9.65e-2 8.68e-1 11.55 2 - 5 8.56e-2 8.88e-1 10.93 9.46e-2 8.75e-1 10.72 3 - 8 8.26e-2 8.92e-1 10.64 8.56e-2 8.87e-1 10.52 6 - 10 8.16e-2 8.93e-1 10.54 8.77e-2 8.88e-1 10.92 7 - 15 7.78e-2 8.99e-1 10.55 8.97e-2 8.80e-1 10.42 18 - 18 7.72e-2 8.99e-1 10.36 8.95e-2 8.83e-1 10.87 139 - 20 7.62e-2 9.01e-1 10.43 8.80e-2 8.83e-1 10.94 148 - 30 7.19e-2 9.07e-1 10.13 9.29e-2 8.78e-1 10.98 355 - 50 6.47e-2 9.17e-1 9.62 9.41e-2 8.73e-1 11.59 732 - 100 5.81e-2 9.26e-1 9.04 1.07e-1 8.59e-1 12.50 1856From Table7, it shows that, with the increasing of hidden neurons number, the MSE of the training set becomes lower and R-square values become higher; these performances seem facially better. However, the MSE values of test set do not decrease and the R-square values do not increase completely with the increasing of hidden neurons. Above computing results show that prediction model can not obtain completely better performance with the number of hidden neurons. In Table 7, when the hidden neurons of BNN_16 are 8, the MSE and R-square of test set have reached close to the optimal value. When the hidden neurons are more than 8, the computing results are in repeated fluctuations. Correspondingly, it can be seen that, with the increase of hidden neurons, the operation time of BNN prediction model is obviously prolonged. Therefore, it is very important to select appropriate hidden neurons according to the model to improve the performance and efficiency of BNN model and reduce the computation time. In general, the numbers of hidden neurons are within the range of 3~8. It also should to be noted that the best performance of TS_BNN model is under the condition with 50 time delays and 2 hidden neurons, with more than three minutes of running time. The closest performance of BNN_16 is under the condition of 8 hidden neurons with only six seconds. Obviously BNN_16 forecast model significantly reduces the time.The randomly selected comparison between actual recorded data and the IBNN model can be seen in Figure10, which is from 8th Oct 2010 to 15th Oct 2010. Here the illustration of one week’s forecasting load values and real load values comparison is just randomly selected. From the figure, it is obvious that the forecasting model performs well with the trend varying of the real data. However, when the actual data changed severely, the deviation between actual data and forecast data increased to a certain extent.Figure 10
Comparison of real data and forecasting values under IBNN of 8 hidden neurons.Table8 discussed the influence of input vectors under TS_BNN model. Due to the time delay of historical load data, the TS_BNN model only uses four related factors as input vectors, which are time, temperature, relative humidity, and day-type. The approach used here is to eliminate one of the relevant factors to observe the results of the computation.Table 8
Results of time-series BNN under different input vectors.
TS-BNN (Hidden neurons 4) Input vectors Training set (60%) Test set (20%) Computing time (s) MSE R MAPE (%) MSE R MAPE (%) [ t , d t , T , R H ] 9.97e-2 8.61e-1 11.67 1.02e-1 8.55e-1 11.78 15  [ d t , T , R H ] 1.07e-1 8.55e-1 11.82 1.11e-1 8.58e-1 12.49 7 [ t , d t , R H ] 1.08e-1 8.55e-1 11.60 1.05e-2 8.61e-1 11.45 9 [ t , d t , T ] 1.04e-1 8.60e-1 11.76 1.14e-1 8.52e-1 11.13 15 [ t , T , R H ] 1.01e-1 8.66e-1 11.91 1.09e-1 8.53e-1 11.44 5From the above results, although it is difficult to say what kind of factors related has more impact on electricity consumption of the consumer, by comparing the situations of eliminating a factor and using total four input vectors, the results show whatever reducing anyone of the four inputs; the performance of the prediction model became lower than the model with total four inputs. It means that all the four factors should have influence on the consumer’s electricity load.To analyze the impacts of different considered input factors on IBNN model, here the authors define 13 models with different numbers of inputs vectors (listed in Table9).Table 9
Comparison models with the basic IBNN with 16 inputs.
Model No. Inputs vectors describe (number of input vectors) Inputs selection 1 BNN_16 (16) t , d t , T , T n - 1 , T n - 2 , R H , R H n - 1 , R H n - 2 , L n - 1 , L n - 2 , L n - 3 , L n - 4 , L n - 24 / t i , L n - 24 / t i ⋅ 2 , L n - 24 / t i ⋅ 7 , L n - 24 / t i ⋅ 7 ⋅ 2 2 No historical Load (8) t , d t , T , T n - 1 , T n - 2 , R H , R H n - 1 , R H n - 2 3 Less T (14) t , d t , T , R H , R H n - 1 , R H n - 2 , L n - 1 , L n - 2 , L n - 3 , L n - 4 , L n - 24 / t i , L n - 24 / t i ⋅ 2 , L n - 24 / t i ⋅ 7 , L n - 24 / t i ⋅ 7 ⋅ 2 4 Less RH (14) t , d t , T , T n - 1 , T n - 2 , R H , L n - 1 , L n - 2 , L n - 3 , L n - 4 , L n - 24 / t i , L n - 24 / t i ⋅ 2 , L n - 24 / t i ⋅ 7 , L n - 24 / t i ⋅ 7 ⋅ 2 5 No T (13) t , d t , R H , R H n - 1 , R H n - 2 , L n - 1 , L n - 2 , L n - 3 , L n - 4 , L n - 24 / t i , L n - 24 / t i ⋅ 2 , L n - 24 / t i ⋅ 7 , L n - 24 / t i ⋅ 7 ⋅ 2 6 No RH (13) t , d t , T , T n - 1 , T n - 2 , L n - 1 , L n - 2 , L n - 3 , L n - 4 , L n - 24 / t i , L n - 24 / t i ⋅ 2 , L n - 24 / t i ⋅ 7 , L n - 24 / t i ⋅ 7 ⋅ 2 7 No time (15) d t , T , T n - 1 , T n - 2 , R H , R H n - 1 , R H n - 2 , L n - 1 , L n - 2 , L n - 3 , L n - 4 , L n - 24 / t i , L n - 24 / t i ⋅ 2 , L n - 24 / t i ⋅ 7 , L n - 24 / t i ⋅ 7 ⋅ 2 8 No day-type (15) t , T , T n - 1 , T n - 2 , R H , R H n - 1 , R H n - 2 , L n - 1 , L n - 2 , L n - 3 , L n - 4 , L n - 24 / t i , L n - 24 / t i ⋅ 2 , L n - 24 / t i ⋅ 7 , L n - 24 / t i ⋅ 7 ⋅ 2 9 Only Load (8) L n - 1 , L n - 2 , L n - 3 , L n - 4 , L n - 24 / t i , L n - 24 / t i ⋅ 2 , L n - 24 / t i ⋅ 7 , L n - 24 / t i ⋅ 7 ⋅ 2 10 Only T and Load (9) T , L n - 1 , L n - 2 , L n - 3 , L n - 4 , L n - 24 / t i , L n - 24 / t i ⋅ 2 , L n - 24 / t i ⋅ 7 , L n - 24 / t i ⋅ 7 ⋅ 2 11 Time, T and Load (10) t , T , L n - 1 , L n - 2 , L n - 3 , L n - 4 , L n - 24 / t i , L n - 24 / t i ⋅ 2 , L n - 24 / t i ⋅ 7 , L n - 24 / t i ⋅ 7 ⋅ 2 12 day-type, T and Load (10) d t , T , L n - 1 , L n - 2 , L n - 3 , L n - 4 , L n - 24 / t i , L n - 24 / t i ⋅ 2 , L n - 24 / t i ⋅ 7 , L n - 24 / t i ⋅ 7 ⋅ 2 13 T, RH and Load (10) T , R H , L n - 1 , L n - 2 , L n - 3 , L n - 4 , L n - 24 / t i , L n - 24 / t i ⋅ 2 , L n - 24 / t i ⋅ 7 , L n - 24 / t i ⋅ 7 ⋅ 2 T-Temperature RH-Relative Humidity.Besides discussing the impact of each factor, here the authors also want to find if increasing the number of historic temperature or humidity inputs can improve the forecasting performance. Under this consideration, 2 models called Less T and Less RH are defined, unlike applying another two past historical input vectors of temperature and humidity, applying only one temperature input and one humidity input.As mentioned above, the effects of different input factors on the model are analyzed. The MSE and R-square of training set are calculated with 3, 8, and 15 hidden neurons, respectively, to find similar results and exclude the impact on system randomly selecting data.From the calculated values in Table10, there are the following results. First, the comparison of the ‘Less T’ and ‘Less RH’ with the normal 16 inputs model (BNN_16) shows that increasing the input number of historic weather data cannot improve the model’s forecasting performance and surprisingly slightly lower the performance. However, the results in the table only show that this unit is not very sensitive with the temperature and humidity or there is a deduction that adding historical load vectors as inputs enhances the robustness of the prediction model. Second, deleting one related factor in the input vectors, there are ‘no T’, ‘no RH’, ‘no time’, and ‘no day-type’, four compared items with the results of BNN_16. The temperature has the largest impact on the model’s accuracy as the MSE of no T becomes the biggest and R-square gets the lowest value. There is not noticeable effect of the other three factors from the obtained values. However, it cannot just from the simple calculated values define that these three factors have positive effects on improving the model. Time and day-type to the basic load forecasting knowledge will significantly affect some users’ consumption mode, so the above results only can show that, under this IBNN model, the effect of these three factors is not obvious.Table 10
Results on analyzing impacts of related input factors.
Inputs impacts (number of input vectors) 3 Hidden neurons 8 Hidden neurons 15 Hidden neurons Training set (60%) Training set (60%) Training set (60%) MSE R MAPE MSE R MAPE MSE R MAPE (%) (%) (%) 1 BNN_16 (16) 9.02e-2 8.82e-1 11.24 8.71e-2 8.86e-1 10.64 8.48e-2 8.85e-1 10.35 2 No Load (8) 2.77e-1 5.84e-1 18.06 2.63e-1 5.86e-1 17.84 2.32e-1 6.25e-1 17.87 3 Less T (14) 9.07e-2 8.82e-1 11.29 9.02e-2 8.82e-1 10.51 8.13e-2 8.95e-1 10.41 4 Less RH (14) 9.11e-2 8.78e-1 11.12 8.23e-2 8.85e-1 10.63 8.35e-2 8.89e-1 10.48 5 No T (13) 9.21e-2 8.74e-1 11.18 9.10e-2 8.74e-1 10.66 9.07e-2 8.79e-1 10.41 6 No RH (13) 9.26e-2 8.76e-1 11.14 8.81e-2 8.83e-1 10.67 8.43e-2 8.83e-1 10.38 7 No time (15) 8.96e-2 8.85e-1 11.11 9.05e-2 8.79e-1 11.10 8.39e-2 8.91e-1 10.78 8 No day-type (15) 9.64e-2 8.79e-1 11.42 9.15e-2 8.86e-1 10.76 9.04e-2 8.89e-1 10.35 9 Only Load (8) 9.63e-2 8.70e-1 11.29 9.38e-2 8.76e-1 11.05 9.22e-2 8.83e-1 10.94 10 Only T and Load (9) 8.78e-2 8.88e-1 11.19 8.44e-2 8.90e-1 10.89 8.85e-2 8.83e-1 10.80 11 Time, T and Load (10) 9.14e-2 8.66e-1 11.17 8.65e-2 8.91e-1 10.86 8.11e-2 8.91e-1 10.52 12 day-type, T and Load (10) 9.33e-2 8.77e-1 11.53 8.70e-2 8.81e-1 11.14 8.21e-2 8.90e-1 10.93 13 T, RH and Load (10) 9.31e-2 8.71e-1 11.23 8.39e-2 8.91e-1 10.90 8.63e-2 8.86e-1 10.65From Tables9 and 10, the comparison of results by TS_BNN model and BNN_16 model validates the first deduction that the input historical load vectors enhance the robustness of the prediction model. In other words, it may also be noted that the increasing of inputs vectors on historical load data may improve the stability of the prediction model, and the influence of other factors on the performance is relatively reduced.In order to further validate the effectiveness of the model, Table11 uses the same BNN_16 structure to train the prediction models for 15 households which are randomly selected from the same Ausgrid yearly data set.Table 11
Results on different datasets.
Home number∖Methods IBNN (BNN_16) TSNN (TS_BNN, time delays = 25) MSE R MAE Time MSE R MAE Time 11 2.47e-2 0.87 0.10 17.48 2.38e-2 0.89 0.10 476.87 13 3.43e-2 0.85 0.09 12.05 3.24e-2 0.88 0.10 350.22 16 2.86e-2 0.87 0.10 7.79 2.83e-2 0.88 0.10 477.66 22 7.76e-2 0.72 0.16 9.73 7.24e-2 0.75 0.16 480.80 25 8.60e-2 0.90 0.15 11.94 8.34e-2 0.89 0.15 264.94 28 2.32e-2 0.87 0.07 21.89 2.68e-2 0.85 0.09 199.21 31 4.30e-2 0.83 0.09 10.56 4.78e-2 0.86 0.11 207.40 34 4.03e-2 0.82 0.11 12.84 4.25e-2 0.84 0.12 482.75 37 2.43e-2 0.89 0.09 12.86 1.81e-2 0.91 0.09 330.83 40 1.11e-2 0.91 0.06 14.64 1.12e-2 0.91 0.06 199.69 44 1.98e-2 0.79 0.07 11.09 2.11e-2 0.84 0.08 263.15 47 2.34e-2 0.90 0.09 9.64 2.36e-2 0.89 0.09 143.94 50 4.67e-2 0.51 0.13 7.49 4.58e-2 0.54 0.13 222.25 55 4.63e-2 0.89 0.16 5.63 4.83e-2 0.88 0.16 475.61 58 7.52e-2 0.84 0.17 11.77 8.09e-2 0.83 0.19 315.73As can be found from Table11, the performances of TSNN and IBNN training are very close, but the computing time is reduced by an average of 31 times. The shortest reduction time is from No. 28 family, which is 8 times shorter, and the longest reduction time is from No. 55 family which is shortened by more than 83 times.


## 4.2. Comparison with Other Prediction Methods

The comparison is between the proposed IBNN method and the methods from the MATLAB Statistics and Machine Learning Toolbox. The parameters of machine learning methods are defined as defaults. Table12 lists all the computing results with the inputs the same as BNN_16 of No. 17 household dataset.Table 12
Performance results of prediction methods.
Method Corresponding number MSE R MAE Time (s) Linear 1 9.90e-02 0.75 0.20 2.10 Interactions Linear 2 9.39e-02 0.77 0.20 4.79 Robust Linear 3 1.05e-01 0.74 0.19 3.74 Stepwise Linear 4 9.40e-02 0.77 0.20 1256.50 Fine Tree 5 1.30e-01 0.68 0.22 7.09 Medium Tree 6 1.09e-01 0.73 0.20 3.53 Coarse Tree 7 1.01e-01 0.75 0.19 2.73 Linear SVM 8 1.03e-01 0.75 0.19 96.97 Quadratic SVM 9 9.78e-02 0.76 0.19 214.74 Cubic SVM 10 9.25e-02 0.77 0.18 828.17 Fine Gaussian SVM 11 2.07e-01 0.49 0.29 159.63 Medium Gaussian SVM 12 9.05e-02 0.78 0.18 112.76 Coarse Gaussian SVM 13 9.88e-02 0.76 0.19 78.12 Boosted Trees 14 9.39e-02 0.77 0.19 23.57 Bagged Trees 15 8.45e-02 0.79 0.17 54.57 BNN_16 16 8.26e-02 0.89 0.18 9.33As can be seen from Table12, the MSE and R values of the IBNN method show the best results compared to other machine learning methods. Although the MAE value of IBNN is slightly inferior to the Bagged Trees method, it is greatly reduced in computation time by nearly five times. In order to more intuitively compare various methods, the authors have defined the corresponding number as the horizontal coordinate to draw the four evaluation indicators, respectively, as shown in the Figure 11.Figure 11
Performance comparison of prediction methods.


## 5. Conclusion

Traditional time-series BNN load forecast model has some problems when applied in residential load forecast area, such as long running time and relatively strong dependence on time and weather factors. To solve these problems, based on basic BNN training method and simple FFNN structure, an improved BNN forecast model is built by augmenting historical load data as inputs through correlation analysis of electricity consumption at different delayed time scales. Further from the impact factors analysis, containing different inputs, number of hidden neurons, historic period of data, forecasting time range, and range requirement of sample data, some advices are given on how to better choose these factors. To validate the effectiveness of IBNN model, several residential sample datasets of a whole year from Ausgrid have been selected to build the IBNN models. The results compared with the time-series prediction model and common applied machine learning methods show that the IBNN model can significantly reduce calculating time and even when the time or meteorological factors are missing; it can still predict the electricity demand with a high accuracy. Future work will focus on the application of IBNN forecasting model in renewable residential energy management, especially for PV-storage system.



---

*Source: 4276176-2018-09-13.xml*