# Using Neural Networks for Bicycle Route Planning
## 4 Results  
### Bicycle Routes Created with NN-s  
In addition to the MSE calculation, we evaluated the performance of our NN by cross-checking two different models. From the assumption that human experience in defining Vrgorac and Kinin bicycle routes were similar, we checked if the NN models built on these routes would give consistent results, so we cross-checked them. We used the Vrgorac NN model to create routes on the Kinin area and then compared them to the actual human-made routes on the Kinin area. Vice-versa, we used the Kinin NN model to create routes on the Vrgorac area and then compared them to the actual human-made routes on the Vrgorac area. The results obtained gave a piece of information about the representativity of our NN models.  
GIS multiple-criteria model was based on points of interest, which were used as stops in route calculation. Thus, it was needed to choose locations in Vrgorac and Kinin, which will be included in calculated routes as stops. There was uncertainty about how the points are going to be distributed. The shape of all the routes provided on websites [24; 25], which were used as ground truth, is circular. Based on that, it was decided to place points on edge parts of routes. The aim was to use as few points as possible. All routes, except Vrgorac flat, needed three points to obtain the same or similar route as the ground truth one. Since the ground truth routes were circular, the additional one point was required to make a start and end location at the same place. Vrgorac flatter route required an extra point caused by strange ground truth route shape.  
Graphical representation of the percentage of length overlapping provided in Table 4 is shown in Figure 4. Results in Table 4 and Figures 5-8 show that there is a significant similarity between the routes produced using different models. The route NN chooses is marked with red, along with used stops, while the non-overlapping part of the route is marked with black colour. To measure the similarity, we used two metrics--the number of segments that overlapped and the length of the overlapped segments. The Vrgorac flat model used on Kinin gave the identical route as the ground truth (Figure 5). For the steep Kinin route, 5 of 8 segments overlapped with the ground truth route, and 85% of the route length overlapped (Figure 6). Vice versa, using the flat Kinin model on Vrgorac roads provided 78% overlapping in length (18 of 21 segments) with the ground truth route (Figure 7). Using the steep Kinin model on Vrgorac roads, 75% of the length (14 of 17 segments) of the steep road overlapped with the ground truth route (Figure 8). From the data shown in Table 4, it can be concluded that NN models trained in the area of Vrgorac and Kinin provide a good representation of the desirability of individual bicycle paths, especially for flatter paths.  
Figure 4: Model verification results-percentage of the length overlap in cross-checking NNs between results of GIS MA and Vrgorac NN for Imotski bicycle routes.  
Figure 5: Vrgorac model on Knin roads-flat.  
Figure 6: Vrgorac model on Knin roads-steep.  
Figure 7: Knin model on Vrgorac roads-flat.