## 4 Experiments
### Results
In the data pre-processing, most of the parameters are site-agnostic and optimized based on averaged performance over all selected sites. All sites share the same pool of available features. This leads to less training time, a simpler data pipeline and ensures a good overall performance. But it is not guaranteed that the model is tuned to its maximum performance on each site. When customer needs arise for the optimization of some certain site, further experiments on input features and parameters on specific sites of concern should be performed. Figure 6 shows the histograms of pointwise forecast error distribution of IMPROVER and MSB for a single site on lead day 0. The results show that error distribution of MSB data is more zero-centred and is narrower, which implies both a smaller mean error and less critical error rate of the dataset. However, the figure also shows that MSB error distribution is not perfectly Gaussian, which implies that systematic error still exists even though the overall performance is already improved compared with IMPROVER grid data. \begin{table}
\begin{tabular}{c c c c c c c c c} \hline \hline
**Site/Lead Time (Days)** & **0** & **1** & **2** & **3** & **4** & **5** & **6** & **7** \\ \hline Alice Springs Airport & 15.27 & 13.66 & 14.38 & 14.67 & 13.93 & 13.94 & 13.29 & 12.07 \\ Archerfield Airport & 16.10 & 14.87 & 15.45 & 13.19 & 13.71 & 13.72 & 13.58 & 14.21 \\ Avalon Airport & 3.75 & 3.32 & 1.75 & 2.81 & 6.91 & 5.60 & 4.63 & 5.67 \\ Coffs Harbour Airport & 16.22 & 16.30 & 16.45 & 15.10 & 13.70 & 14.71 & 14.44 & 14.91 \\ Curtin Aero & 1.46 & 1.79 & 3.54 & 5.36 & 6.55 & 8.82 & 10.19 & 13.06 \\ Geraldton Airport & 27.58 & 27.36 & 26.12 & 24.16 & 22.44 & 21.98 & 21.40 & 21.23 \\ Hobart (Ellerslie Road) & 9.86 & 9.88 & 8.59 & 8.32 & 7.01 & 6.29 & 4.59 & 5.22 \\ Mount Isa & 8.78 & 7.69 & 8.68 & 8.76 & 9.28 & 10.22 & 13.64 & 14.14 \\ Tindal RAF & 7.18 & 6.25 & 6.13 & 8.78 & 9.36 & 7.09 & 8.19 & 8.50 \\ Townsville & 15.54 & 17.45 & 17.29 & 16.64 & 12.91 & 12.52 & 12.37 & 15.18 \\ Woomera Aerodrome & 4.34 & 4.71 & 6.64 & 7.76 & 6.73 & 9.33 & 5.80 & 5.86 \\ \hline \hline \end{tabular}
\end{table} 
Table 4: Percentage (%) of reduction of hourly RMSE by lead day, temperature forecast. \begin{table}
\begin{tabular}{c c c c c c c c} \hline \hline
**Site/Lead Time (Days)** & **0** & **1** & **2** & **3** & **4** & **5** & **6** & **7** \\ \hline Alice Springs Airport & 10.70 & 11.74 & 15.30 & 17.89 & 18.30 & 14.66 & 12.89 & 13.30 \\ Archerfield Airport & 24.52 & 19.43 & 19.53 & 20.38 & 18.04 & 17.83 & 19.41 & 17.06 \\ Avalon Airport & 0.54 & 2.62 & 3.34 & 3.76 & 2.65 & 0.23 & \(-1.66\) & \(-1.82\) \\ Coffs Harbour Airport & 8.36 & 8.05 & 10.83 & 9.78 & 8.26 & 9.42 & 11.00 & 8.87 \\ Curtin Aero & \(-6.46\) & \(-1.26\) & 2.78 & 4.47 & 4.49 & 4.96 & 3.47 & 2.67 \\ Geraldton Airport & 37.13 & 33.37 & 31.56 & 30.58 & 30.59 & 30.50 & 29.48 & 28.14 \\ Hobart (Ellerslie Road) & 6.04 & 7.02 & 7.41 & 4.28 & 8.43 & 7.05 & 1.91 & \(-0.90\) \\ Mount Isa & 4.62 & 8.64 & 14.55 & 18.51 & 18.44 & 16.60 & 19.67 & 21.49 \\ Tindal RAAF & 3.75 & 6.14 & 8.16 & 8.47 & 7.93 & 9.46 & 6.42 & 7.24 \\ Townsville & 10.61 & 11.57 & 14.16 & 15.77 & 22.43 & 24.06 & 19.77 & 14.35 \\ Woomera Aerodrome & 16.97 & 15.90 & 14.78 & 13.49 & 14.15 & 11.24 & 10.57 & 7.88 \\ \hline \hline \end{tabular}
\end{table} 
Table 5: Percentage (%) of reduction of hourly RMSE by lead day, dew point temperature forecast.