## 3 Methodology
### Model Evaluation  
The _Model Evaluation_ tool provides a selection of two- and three-map comparison metrics (Figure 7) and outputs an HTML file containing the calculated values. Two-map comparison measures are typically used to quantify the cell-by-cell agreement between a real and simulated map, while three-map comparisons emphasize agreement of changed locations [83]. In the _Model Evaluation_ tool, two-map comparison metrics include overall accuracy measures [34], cross-tabulation matrices [84], disagreements of quantity and allocation [85], and Kappa statistics [86]. The three-map comparison metrics implemented include change error measures [87], figure of merit (FOM) [83], and class-level change metrics [88].  
\begin{table}
\begin{tabular}{l l l l} \hline \hline  & \multicolumn{2}{c}{**Basic CA Tool**} & \multicolumn{2}{c}{**Advanced CA Tool**} \\ \hline Description & \(\bullet\) & A model execution tool with setup options & \(\bullet\) & A binary or multi-class model execution tool used to apply transition rules specified in a _Transition Rule_ file \\  & & available in an ArcGIS Dock Pane tool for & \(\bullet\) & Initial raster layer \\ Description & \(\bullet\) & rapidly implementing binary models (i.e., changes occur in one direction, from 0 to 1) & \(\bullet\) & The number of iterations/timesteps for model execution \\  & & enabled in an _Négibhorod-Based_ rule defined using & \(\bullet\) & A _Transition Rule_ file \\ \hline Parameterization & \(\bullet\) & Initial raster layer & \(\bullet\) & Initial raster layer \\  & \(\bullet\) & Output geodatabase and output prefix & \(\bullet\) & Output geodatabase and output prefix \\  & & model execution & \(\bullet\) & The number of iterations/timesteps for model execution \\  & & \(\bullet\) & A _Neighborhood-Based_ rule defined using & \(\bullet\) & A _Transition Rule_ file \\  & & embedded input options & \(\bullet\) & Apart from model initialization settings, the model parameters are read from the _Transition Rule_ file \\ \hline Benefits & \(\bullet\) & Beneficial for rapid implementation of binary models (i.e., expansion or retraction of one phenomena) & \(\bullet\) & Beneficial for both binary and multi-class model implementation \\  & & Users do not have to use separate functions & \(\bullet\) & Supports model execution with an unlimited number of transition rules and types \\  & & from the _Model Parameterization_ tool group & \(\bullet\) & Users can encode multi-directional and overlapping transition rules \\  & & \(\bullet\) & Facilitates quick experiments to observe & \(\bullet\) \\  & & effects of _Neighborhood-Based_, _Allocation and Quantity_, or _Constraint_ rule settings & \(\bullet\) & _Transition Rule_ files can be swapped out to implement different scenarios \\ \hline Limitations & \(\bullet\) & Users are limited to representing one-way binary changes & \(\bullet\) & Several steps are required before running the _Advanced CA_ tool (i.e., specifying any _Neighborhood Definition_ files and the _Transition Rule_ file) \\  & & If the user closes the ArcGIS Pro application, parameters entered in the tool UI will not persist. Users will have to consult an existing _Model Parameter Report_ to replicate previous input values, if available & \(\bullet\) & The nested configuration of _Neighborhood Definition_ file paths within _Transition Rule_ files require multiple steps to configure or update \\ \hline \hline \end{tabular}
\end{table}
Table 2: Comparison of _Model Execution_ tools.