# Evolutionary System Design with Answer Set Programming
## 6 Experiments
### Experimental Evaluation
Regarding Hamming distance, most configurations using heuristics or S2 with advanced routing and binding distance improve over the baselines. Routing bou with  
\begin{table}
\begin{tabular}{l c c c c c} \hline \hline  & HD & & \(\epsilon\)D & & HD\(\times\epsilon\)D \\ C & AVG-R & C & AVG-R & C & AVG-R \\ \hline BOU-BR-H1-L & 8.3 & XYZ-BR-H2 & 17.4 & BOU-BR-H2-L & 14.1 \\ BOU-BR-H2-L & 8.5 & XYZ-B-H1-L & 18.1 & BOU-BR-H1-F-8 & 14.3 \\ BOU-BR-H1-F-8 & 10.5 & XYZ-B-H2-L & 18.1 & BOU-BR-H1-L & 14.3 \\ BOU-BR-H2-F-8 & 10.8 & XYZ-BR-H2-F-4 & 19.2 & BOU-BR-H1-F-2 & 14.4 \\ BOU-BR-H1-F-2 & 12.3 & XYZ-BR-H2-F-2 & 19.4 & BOU-BR-H2-F-8 & 14.8 \\ BOU-BR-H2-F-4 & 13.0 & XYZ-BR-H2-L & 19.4 & BOU-BR-H2-F-2 & 16.7 \\ BOU-BR-H1-F-4 & 13.4 & XYZ-BR-H1 & 19.8 & XYZ-B-H1-L & 17.1 \\ BOU-BR-H2-F-2 & 13.7 & XYZ-BR-H1-F-2 & 19.9 & XYZ-B-H2-L & 17.1 \\ XYZ-BR-H1-L & 14.9 & XYZ-BR-H2-F-8 & 20.0 & BOU-BR-H1-F-4 & 17.9 \\ XYZ-B-H1-L & 15.3 & BOU-BR-H1-F-8 & 20.2 & BOU-BR-H2-F-4 & 18.0 \\ XYZ-B-H2-L & 15.3 & XYZ-BR-H1-F-8 & 20.3 & XYZ-BR-H1-L & 18.8 \\ XYZ-BR-H2-L & 17.1 & BOU-B-H1-F-4 & 20.4 & XYZ-BR-H2-L & 18.9 \\ BOU-B-H1-L & 18.7 & BOU-B-H2-F-4 & 20.4 & XYZ-BR-H1-F-8 & 21.3 \\ BOU-B-H2-L & 18.7 & XYZ-BR-H1-F-4 & 20.4 & XYZ-BR-H2-F-8 & 21.3 \\ XYZ-BR-H1-F-8 & 19.6 & XYZ-BR-H1-L & 20.7 & BOU-BR-H1- & 21.6 \\ XYZ-BR-H2-F-8 & 20.8 & BOU-BR-H2-F-8 & 21.0 & XYZ-BR-H2-F-2 & 21.9 \\ XYZ-BR-H1-F-4 & 21.0 & XYZ-B-H1-F-8 & 21.2 & XYZ-BR-H1-F-4 & 22.4 \\ BOU-BR-H1 & 22.1 & XYZ-B-H2-F-8 & 21.2 & BOU-BR-H2 & 22.7 \\ BOU-BR-H2 & 22.1 & BOU-BR-H1-F-2 & 21.4 & BOU-B-H1-F-4 & 22.7 \\ ARB-BR-H2-L & 23.1 & BOU-BR-H1-L & 21.7 & BOU-B-H1-F-4 & 22.7 \\ BOU-B-H1-F-8 & 23.4 & BOU-B-H1-F-2 & 21.9 & XYZ-BR-H2-F-4 & 22.9 \\ BOU-B-H2-F-8 & 23.4 & BOU-B-H2-F-2 & 21.9 & XYZ-BR-H1-F-2 & 23.0 \\ XYZ-B-H1-F-4 & 23.4 & BOU-BR-H2-L & 22.0 & BOU-B-H1-L & 23.3 \\ XYZ-B-H2-F-4 & 23.4 & XYZ & 22.3 & BOU-B-H2-L & 23.3 \\ XYZ-BR-H2-F-4 & 23.4 & BOU-BR-H1 & 22.3 & XYZ-BR-H2-H2 & 23.5 \\ XYZ-B-H1-F-8 & 23.5 & BOU-B-H1-F-8 & 22.5 & XYZ-B-H1-F-8 & 23.8 \\ XYZ-B-H2-F-8 & 23.5 & BOU-B-H2-F-8 & 22.5 & XYZ-B-H2-F-8 & 23.8 \\ XYZ-BR-H2-F-2 & 23.8 & BOU-B-H1-L & 23.1 & XYZ-BR-H1-H & 24.1 \\ ARB-BR-H1-L & 24.0 & BOU-B-H2-L & 23.1 & BOU-B-H1-F-8 & 24.3 \\ XYZ-BR-H1-F-2 & 25.5 & BOU-BR-H2-2 & 23.4 & BOU-B-H2-F-8 & 24.3 \\ BOU-B-H1-F-4 & 25.6 & XYZ-B-H1-F-2 & 23.6 & XYZ-B-H1-F-4 & 25.1 \\ BOU-B-H2-F-4 & 25.6 & XYZ-B-H2-F-2 & 23.6 & XYZ-B-H2-F-4 & 25.1 \\ XYZ-B-H1-F-2 & 25.7 & XYZ-B-H1-F-4 & 23.9 & BOU-B-H1-F-2 & 25.3 \\ XYZ-B-H2-F-2 & 25.7 & XYZ-B-H2-F-4 & 23.9 & BOU-B-Henhanced importance of similarity atoms clearly performs best; the more emphasis on deciding similarity atoms first, the closer the first answer. This may be due to more flexibility of bou routing compared with XYZ, and the reordering of the search space by the heuristic does not seem to negatively impact the solving. There is no clear favorite between heuristics H1 and H2, but taking both binding and routing similarity into account is at the top. Because S1 and preferences overall do not find as many solutions, they are absent from the top 50. With respect to \(\epsilon\)-dominance, i.e., the quality of the first solution, advanced routing techniques and heuristics are again at the top. Now, the XYZ routing is in front, likely due to the smaller problem size and search space allowing for a faster exploration, even if it is approximate. Note that the spread of ranks is a lot closer among all configurations; this indicates that the top configurations found first solutions of similar quality. Finally, bou routing with heuristics and both binding and routing similarities achieves the best ranks by combining similarity and quality, and it also outperforms the baselines. The trend that could be seen for individual Hamming distance and \(\epsilon\)-dominance continues. It seems that the restrictive strategies and more complex preferences do not provide a good trade-off. On the other hand, heuristics and advanced routing clearly outperforms the design space exploration from scratch.