# A Methodology to Evaluate User Experience for People with Autism Spectrum Disorder
## 6 Validation and Discussion  
Considering our preliminary proposal of the methodology [11], we have improved the methodology based on the opinions of three UX expert researchers. In this, each stage and substage have been detailed and restructured, and we included a new substage: S1.2 (Experiment Design). After consolidating these changes in a new version of the methodology, an expert judgment validation has been carried out, with 22 experts that have knowledge about UX/Usability, ASD, or both.  
The experts' profiles include academic researchers, PhD students, computer scientists with UX/Usability expertise, and domain specific experts, such as speech therapists, psychologists, counselors, and educators with hands on experience working with people with ASD. Some of these experts have experience in both UX/Usability and ASD, and some have ASD themselves.  
In the expert judgment validation, each participant has been given a specification document of the methodology, which includes a summarized version and a detailed version, and a survey which was created based on the proposal from [PERSON] et al. [44]. The validation carried out is aimed at obtaining feedback from experts.  
The survey has been divided into three sections.  
(1) _First section:_ Learn about the background of the participating experts.  
(2) _Second section:_ Evaluate the stages and substages of the methodology, using a five-level Likert scale (1--worst to 5--best) in four factors (F1, F2, F3 and F4):  
* (F1) Usefulness: How useful do you consider each stage and substage of the methodology?
* (F2) Clarity: How do you rate the clarity of each stage and substage of the methodology?
* (F3) Ease of use: How easy would it be to implement each stage and substage of the methodology?
* (F4) Lack of Detail: Do you think that the stages and/or substages of the methodology need more detail or additional elements?  
(3) _Third section:_ Know their opinions about the methodology, the stages and substages, which includes:  
* Two questions (Q1 and Q2) focused on finding out their general opinion about the methodology, through a five-level Likert scale (1--worst to 5--best).  
(Q1) Use in future evaluations: If you had to evaluate the user experience in systems, products or services used by people with ASD, would you use our proposed methodology?  
(Q2) Completeness: Do you think that the methodology covers all the aspects to be evaluated in systems, products or services used by people with ASD?  
* Five open questions focused on knowing their opinions and comments on the methodology, stages and substages.  
(Q1): Would you remove or add any evaluation method proposed by the methodology? Which one(s) and why?  
(Q2): Would you change, add, or eliminate any aspect of a stage or substage of the methodology? Which one(s) and why?  
(Q3): Would you change, add, or eliminate any aspect of the evaluation methods considered in the proposed methodology? Which one(s) and why?  
(Q4): What aspects do you consider were not covered by the proposed methodology and should be included in the methodology to evaluate systems used by people with ASD?  
(Q5): Do you have any additional comments and/or suggestions for the authors?  
The following results were obtained from this survey.