## 3 Results
### Impact of Identical Network Initialization
\begin{table}
\begin{tabular}{c c c c c c} \hline  & Alien \#1 & Alien \#2 & Alien \#3 & Alien \#4 & Alien \#5 \\ \hline Alien \#1 & 0.000 & 0.619 & 0.822 & 0.643 & 0.718 \\ Alien \#2 & 0.619 & 0.000 & 0.774 & 0.700 & 0.638 \\ Alien \#3 & 0.822 & 0.774 & 0.000 & 0.757 & 0.740 \\ Alien \#4 & 0.643 & 0.700 & 0.757 & 0.000 & 0.613 \\ Alien \#5 & 0.718 & 0.638 & 0.740 & 0.613 & 0.000 \\ \hline  & Boxing \#1 & Boxing \#2 & Boxing \#3 & Boxing \#4 & Boxing \#5 \\ \hline Boxing \#1 & 0.000 & 0.929 & 0.929 & 0.973 & 0.933 \\ Boxing \#2 & 0.929 & 0.000 & 0.773 & 0.979 & 0.850 \\ Boxing \#3 & 0.929 & 0.773 & 0.000 & 0.974 & 0.289 \\ Boxing \#4 & 0.973 & 0.979 & 0.974 & 0.000 & 0.972 \\ Boxing \#5 & 0.933 & 0.850 & 0.289 & 0.972 & 0.000 \\ \hline  & Freeway \#1 & Freeway \#2 & Freeway \#3 & Freeway \#4 & Freeway \#5 \\ \hline Freeway \#1 & 0.000 & 0.065 & 0.072 & 0.074 & 0.074 \\ Freeway \#2 & 0.065 & 0.000 & 0.067 & 0.068 & 0.072 \\ Freeway \#3 & 0.072 & 0.067 & 0.000 & 0.075 & 0.079 \\ Freeway \#4 & 0.074 & 0.068 & 0.075 & 0.000 & 0.072 \\ Freeway \#5 & 0.074 & 0.072 & 0.079 & 0.072 & 0.000 \\ \hline  & Qbert \#1 & Qbert \#2 & Qbert \#3 & Qbert \#4 & Qbert \#5 \\ \hline Qbert \#1 & 0.000 & 0.758 & 0.916 & 0.898 & 0.879 \\ Qbert \#2 & 0.758 & 0.000 & 0.895 & 0.730 & 0.713 \\ Qbert \#3 & 0.916 & 0.895 & 0.000 & 0.903 & 0.891 \\ Qbert \#4 & 0.898 & 0.730 & 0.903 & 0.000 & 0.777 \\ Qbert \#5 & 0.879 & 0.713 & 0.891 & 0.777 & 0.000 \\ \hline  & Qbert \#1 & Qbert \#2 & Qbert \#3 & Qbert \#4 & Qbert \#5 \\ \hline Qbert \#1 & 0.000 & 0.758 & 0.916 & 0.898 & 0.879 \\ Qbert \#2 & 0.758 & 0.000 & 0.895 & 0.730 & 0.713 \\ Qbert \#3 & 0.916 & 0.895 & 0.000 & 0.903 & 0.891 \\ Qbert \#4 & 0.898 & 0.730 & 0.903 & 0.000 & 0.777 \\ Qbert \#5 & 0.879 & 0.713 & 0.891 & 0.777 & 0.000 \\ \hline  & Qbert \#5 & 0.879 & 0.713 & 0.891 & 0.777 & 0.000 \\ \hline  & Qbert \#1 & Qbert \#2 & Qbert \#3 & Qbert \#4 & Qbert \#5 \\ \hline Qbert \#1 & 0.000 & 0.758 & 0.916 & 0.898 & 0.879 \\ Qbert \#2 & 0.758 & 0.000 & 0.895 & 0.730 & 0.713 \\ Qbert \#3 & 0.916 & 0.895 & 0.000 & 0.903 & 0.891 \\ Qbert \#4 & 0.898 & 0.730 & 0.903 & 0.000 & 0.777 \\ Qbert \#5 & 0.879 & 0.713 & 0.891 & 0.777 & 0.000 \\ \hline  & Qbert \#1 & Qbert \#2 & Qbert \#3 & Qbert \#4 & Qbert \#5 \\ \hline Qbert \#1 & 0.000 & 0.758 & 0.916 & 0.898 & 0.879 \\ Qbert \#2 & 0.758 & 0.000 & 0.895 & 0.730 & 0.713 \\ Qbert \#3 & 0.916 & 0.895 & 0.000 & 0.903 & 0.891 \\ Qbert \#4 & 0.898 & 0.730 & 0.903 & 0.000 & 0.777 \\ Qbert \#5 & 0.879 & 0.713 & 0.891 & 0.777 & 0.000 \\ \hline  & Qbert \#1 & Qbert \#2 & Qbert \#3 & Qbert \#4 & Qbert \#5 \\ \hline Qbert \#1 & 0.000 & 0.758 & 0.916 & 0.898 & 0.879 \\ Qbert \#2 & 0.758 & 0.000 & 0.895 & 0.730 & 0.713 \\ Qbert \#3 & 0.916 & 0.895 & 0.000 & 0.903 & 0.891 \\ Qbert \#4 & 0.898 & 0.730 & 0.903 & 0.000 & 0.777 \\ Qbert \#5 & 0.879 & 0.713 & 0.891 & 0.777 & 0.000 \\ \hline  & Qbert \#1 & Qbert \#2 & Qbert \#3 & Qbert \#4 & Qbert \#5 \\ \hline Qbert \#1 & 0.000 & 0.758 & 0.916 & 0.898 & 0.879 \\ Qbert \#2 & 0.758 & 0.000 & 0.895 & 0.730 & 0.713 \\ Qbert \#3 & 0.916 & 0.895 & 0.000 & 0.903 & 0.891 \\ Qbert \#4 & 0.898 & 0.730 & 0.903 & 0.000 & 0.777 \\ Qbert \#5 & 0.879 & 0.713 & 0.891 & 0.777 & 0.000 \\ \hline  & Qbert \#1 & Qbert \#2 & Qbert \#3 & Qbert \#4 & Qbert \#5 \\ \hline \end{tabular}
\end{table} 
Table 14: Pairwise TV distance for agents with identically initialized networks. \begin{table}
\begin{tabular}{c c c c c c} \hline  & Alien \#1 & Alien \#2 & Alien \#3 & Alien \#4 & Alien \#5 \\ \hline Alien \#1 & 7.938 (34.771) & 5.529 (40.785) & 5.497 (40.223) & 4.728 (40.526) & 4.891 (40.635) \\ Alien \#2 & 5.081 (17.172) & 4.217 (8.028) & 4.382 (16.863) & 4.026 (14.063) & 5.109 (11.535) \\ Alien \#3 & 4.118 (14.219) & 3.482 (14.628) & 4.185 (13.904) & 3.327 (14.711) & 3.784 (14.777) \\ Alien \#4 & 4