# A Methodology to Evaluate User Experience for People with Autism Spectrum Disorder
## 6 Validation and Discussion
### Quantitative Results  
Table 1 shows the results obtained by each of the factors (F1-F4). The information obtained is analyzed below. It is important to mention that the methodology specification delivered to the experts only had three substages in the Results Analysis Stage. Considering the feedback from the experts, a new substage called \"Grouping of potential problems\" has been added, and substage S3.3 was renamed. * (F1) Utility: The average utility of the methodology specification is high (4.77). Stage S3 (Results Analysis) is considered the most useful (4.91). The S2.2 substage (Inspections) is considered the least useful, however, its average is still high (4.59). The standard deviation is relatively low, ranging from 0.29 (stage S3) to 0.67 (stage S2.2). The standard deviation of stage S3 (Results Analysis) is the lowest of the four factors. The perceived usefulness of the methodology is high. * (F2) Clarity: The average clarity of the methodology specification is high (4.39). Substage S2.2 (Inspections) is considered to have more clarity (4.59). Substages S1.1 (Method Execution Planning) and S3.3 (Integration of Results) are considered less clear (4.23). The standard deviation varies between 0.59 (substage S2.2) and 0.97 (substage S.3.3). The perceived clarity about the methodology is high. Considering the results obtained, the specification of the less clear perceived substages (S1.1 and S3.3) have been improved. * (F3) Ease of use: The average ease of use of the methodology specification is moderate (3.69). Stage S3 (Results Analysis) and substage S3.2 (Qualitative Analysis) are considered to be the easier to use (4.00). Substage S2.3 (User Tests) is considered the most difficult to perform (3.18) and is the one with the highest standard deviation \begin{table}
\begin{tabular}{c c c c c c c c c} \hline \hline  & \multicolumn{2}{c}{**F1—Utility**} & \multicolumn{2}{c}{**F2—Clarity**} & \multicolumn{2}{c}{**F3—Ease of Use**} & \multicolumn{2}{c}{**F4—Lack of Detail**} \\ \cline{2-9}  & **AVG** & **SD** & **AVG** & **SD** & **AVG** & **SD** & **AVG** & **SD** \\ \hline
**S1: Planning Stage** & 4.82 & 0.50 & 4.36 & 0.73 & 3.73 & 0.77 & 2.59 & 1.26 \\ S1.1: Method Execution Planning & 4.77 & 0.53 & 4.23 & 0.81 & 3.73 & 0.83 & 2.64 & 1.43 \\ S1.2: Experiment Design & 4.82 & 0.50 & 4.41 & 0.73 & 3.55 & 0.96 & 2.32 & 1.36 \\ S1.3: Evaluators Selection & 4.73 & 0.63 & 4.45 & 0.67 & 3.59 & 0.91 & 2.45 & 1.30 \\ S1.4: Participants Selection & 4.77 & 0.53 & 4.27 & 0.70 & 3.36 & 1.09 & 2.73 & 1.39 \\
**S2: Execution Stage** & 4.82 & 0.50 & 4.41 & 0.85 & 3.68 & 0.99 & 2.50 & 1.41 \\ S2.1: Preliminary Evaluation & 4.64 & 0.58 & 4.45 & 0.80 & 3.91 & 0.92 & 2.41 & 1.37 \\ S2.2: Inspections & 4.59 & 0.67 & 4.59 & 0.59 & 3.64 & 0.95 & 2.50 & 1.47 \\ S2.3: User Tests & 4.86 & 0.47 & 4.50 & 0.67 & 3.18 & 1.14 & 2.55 & 1.37 \\
**S3: Results Analysis Stage** & 4.91 & 0.29 & 4.41 & 0.85 & 4.00 & 0.93 & 2.18 & 1.33 \\ S3.1: Quantitative Analysis & 4.68 & 0.57 & 4.36 & 0.90 & 3.91 & 1.02 & 2.23 & 1.38 \\ S3.2: Qualitative Analysis & 4.77 & 0.43 & 4.36 & 0.85 & 4.00 & 0.93 & 2.18 & 1.30 \\ S3.3: Integration of Results & 4.82 & 0.50 & 4.23 & 0.97 & 3.68 & 0.89 & 2.32 & 1.43 \\
**4.77** & & **4.39** & & **3.69** & & **2.43** & & \\ \hline \hline \end{tabular}
\end{table} 
Table 1: Results for factors F1, F2, F3 and F4. (1.14); experts commented that this stage has been considered the most difficult to carry out, due to the unforeseen events that may arise and the various profiles that people with ASD may have, and not necessarily due to the complexity of the substage specification. Standard deviations are relatively high, ranging from 0.77 (stage S1) to 1.14 (substage S2.3). * (F4) Lack of Detail: The average lack of detail in the specification of the methodology is low (2.43). Due to the nature of the question, having a low average does not imply having obtained negative results. A high average means that the methodology is missing more details.