## 5 Experiments
### Test of the Proposed Method
#### 5.1.2 Application of the Method to the Scenarios
Cost and power consumption is secondary as to allow for moderate-duration operations in critical applications. & The UAV should handle real-time object detection without requiring high-end AI processing. Specific evaluation indicators for accuracy, computational efficiency, resource utilization, adaptability, and robustness criteria, tailored to different application scenarios and device constraints, are provided in Appendix A, Table A1. In this study, the retrieved evaluation indicators for each scenario are provided in Table 2. Also, a simplified object model diagram for the case study is given in Appendix B to offer visual assistance on the realization of the method. \begin{table}
\begin{tabular}{c c c c c c} \hline \hline  
\begin{table}
\begin{tabular}{c c c c c c} \hline \hline
It is important to note that we also included the \"Cost\" metric under the Portability, Replaceability characteristic since the cost of edge hardware is often considered and weighed against other criteria such as performance, power consumption, and reliability. In some cases, although higher-cost edge hardware may offer better capabilities, decision-makers evaluate whether those benefits are worth the additional expense based on the specific use case. In addition, we included the Weight and Size metrics under the Usability characteristic since they are important for UAV's agility and flight performance [58]. Lighter and compact hardware helps in increasing flight time and maneuverability. Measurement Layer/HW Model Metrics Measurement Process Flow--Step 5: Measurement Execution for HW Criteria (Collect Data for Hardware Model Criteria/Metrics) In this step, relevant metrics of edge hardware candidates are provided. A list of widely used edge hardware products suitable for UAVs are provided in Table 3 along with the relevant quality metrics (namely, MTBF, Processing Power, Supported AI Frameworks, Power Consumption, Weight, Size, Flash Memory, RAM, Cost Metrics). \begin{table}
\begin{tabular}{c c c c c} \hline \hline \multirow{2}{*}{**Scenario ID**} & \multirow{2}{*}{**Quality Models**} & **ISO 25010** & **ISO 25010** & **Related Evaluation Indicators/Metrics** & \
\begin{tabular}{c} **Measurement Method of the Indicator/Metric** \\ \end{tabular} \\ \hline \multirow{6}{*}{Scenario IV} & \multirow{6}{*}{
\begin{tabular}{c} Functional \\ Suitability \\ \end{tabular} } & Functional & AI Model: Mean & mean average precision: \\  & & Correctness & average precision & benchmarking specifications \\ \cline{2-5}  & & & Time & AI Model: FPS & FPS: benchmarking specifications \\ \cline{2-5}  & & & & & Average power consumption: \\  & & & & & benchmarking specifications \\ \cline{2-5}  & & & & & \\ \cline{2-5}  & & & & & \\ \cline{2-5}  & & & & & \\ \cline{2-5}  & & & & & \\ \cline{2-5}  & & & & & \\ \cline{2-5}  & & & & & \\ \cline{2-5}  & & & & & \\ \cline{2-5}  & & & & & \\ \cline{2-5}  & & & & & \\ \cline{2-5}  & & & & & \\ \cline{2-5}  & & & & & \\ \cline{2-5}  & & & & & \\ \cline{2-5}  & & & & & \\ \hline \hline \end{tabular}
\end{table} 
Table 2: _Cont._  
\begin{table}
\begin{tabular}{c c c c c c c c c c c c} \hline \hline  
Evaluation Layer/Evaluation and Ranking of Hardware Options  
Process Flow--Step 6: Evaluation & Ranking (Apply MCDA methods to evaluate and rank HW candidates based on weighted scores)  
Process Flow--Step 7: Selection of Edge HW  
In the evaluation step, six fuzzy MCDA techniques are employed. The rationale on the use of fuzzy MCDA techniques for the selection of edge hardware and AI models, and the descriptions of the employed fuzzy methods, namely the TOPSIS, MABAC, COMET, SPOTIS, COCOSO, VIKOR methods, are explained in Section 2.6. A significant issue considered in the evaluation process is the assignment of weights to the relevant edge hardware criteria/metrics. The following process is employed to determine the weights of both edge hardware and AI models criteria:  
* Focus Session Setup: A focus session was conducted with a group of six expert practitioners in the field working for a civil aviation company.