# Edge Computing Simulators for IoT System Design: An Analysis of Qualities and Metrics
## Appendix A : Extracted Metrics  
The extracted metrics after applying the filtering are listed in Table A1. In the table, two types of metrics are presented, the ISO/IEC metrics, and the metrics extracted from the literature. We classified extracted metrics from the literature based on the metrics suggested by ISO/IEC 25023. For increased readability, we removed statistical terms like average, mean, and percentage.  
\begin{table}
\begin{tabular}{p{113.8 pt} p{113.8 pt} p{113.8 pt}} \hline
**ISO/IEC 25010 Qualities** & **ISO/IEC 25023 Measures** & **Related Metrics Used in the Literature** \\ \hline \multirow{6}{*}{Mean response time} & & Service allocation delay, first response time of processing a dataset, service latency (used in 3 papers), system response time (3), service execution delay \\ \cline{2-3}  & & CPU time, round-trip time (2), processing delay, latency of application, communications latency, latency ratio, delay of transferring datasets, completion time, time to write or read (2), time taken to create container for new images, time taken to transfer the application file, time taken to transfer the logging file, transmission delay, loading time, delay jitter, execution time (2), delivery latency, response times of computation tasks, activation times, running time, accessing cost of data chunks, handover latency, latency of data synchronization, workload completion time, waiting time, end to end delay, sync time, delay, queuing delay (2), execution time, container activation time \\ \hline \multirow{6}{*}{Throughput} & & Number of messages processed, throughput of request serviced, successful executed job throughput, queue length in time, bandwidth throughput, disk throughput \\ \cline{2-3}  & Memory utilization & Queue utilization, allocated slots \\ \cline{2-3}  & & Processing power, processing cost for each application, CPU utilization (3), computing load, CPU consumption, max system load, fairness by Gini coefficient, computation cost, system load \\ \cline{2-3}  & I/O devices utilization usage & Storage overhead \\ \cline{2-3}  & & Communication cost, number of retransmissions (2), bandwidth consumptions, required bandwidth, traffic load, amount of data sent between fog sites, volume of data transmitted, amount of network traffic sent, communication overhead \\ \cline{2-3}  & & Energy consumption* & Energy consumption (7), transmission energy, power consumption (3), allocated power, residual energy, energy efficiency \\ \hline \multirow{6}{*}{Capacity} & & Number of satisfied requests, system loss rate, cloud requests fulfilled, number of existing jobs in the CPU queues, rate of targets dropped over arrival, cumulative delivery ratio, provisioned capacity, service drop rate, number of finalized jobs, number of executed packets \\ \cline{2-3}  & & System availability & Uptime \\ \cline{2-3}  & Fault tolerance & Failure avoidance & Scheduled requests with crash \\ \cline{2-3}  & \multicolumn{3}{p{113.8 pt}}{*Energy consumption is not among ISO/IEC 25023 measures.} \\ \cline{2-3}  & & & \\ \end{tabular}
\end{table}
Table A1: Metrics used in the literature, categorized according to the ISO/IEC standards (the numbers between brackets show the number of papers that used the metric).