# FRAMUX-EV: A Framework for Evaluating User Experience in Agile Software Development
## 4 Methodology  
The methodology for developing the framework was divided into seven distinct steps (see Figure 1).  
In Step 1, we defined the problem statement, proposed the objectives, established a methodology (including the approach, scope, and steps), and outlined the work plan.  
In Step 2, we conducted a systematic literature review of frameworks, methodologies, UX evaluation methods, challenges, and recommendations related to integrating UX into agile software development [29]. We identified different studies that incorporated components of UX evaluation in agile development, focusing on roles, artifacts, events, or evaluation methods. However, no proposals were found that comprehensively evaluated UX across all phases of the agile development process, including UX events, artifacts, and evaluation methods. We identified several UX evaluation methods from these proposals, along with challenges and recommendations related to various UX stages and roles.  
In Step 3, we conducted six in-depth interviews to gather and analyze the experiences of various practitioners (e.g., challenges, recommendations, relationships between roles and teams, and adopted practices) when integrating UX into agile software development [30]. Additionally, these interviews were conducted to validate the findings of the systematic literature review. As a result, we identified several methods used for UX evaluation, along with the challenges faced when integrating UX into agile environments, as well as recommendations and practices suggested by practitioners.  
In Step 4, we synthesized the insights gathered from both the systematic literature review [29] (i.e., 23 UX evaluation methods, 56 problems, and 91 recommendations) and practitioner interviews [30] (i.e., 9 evaluation methods, 25 problems, and 40 recommendations). A comprehensive comparative analysis was conducted to identify common elements, the most frequently mentioned aspects, novel insights, and notable cases of success or failure. Based on this analysis, some of the most relevant findings were selected to create the initial framework proposal.  
In Stage 5, based on the findings from the previous stage, we proposed different UX components to be included in the proposal: 8 UX evaluation methods, 7 UX artifacts, and 4 UX events. This proposal of components resulted in the first version of FRAMUX-EV, a framework for evaluating user experience in agile software development.  
In Step 6, we conducted the first validation of FRAMUX-EV to evaluate the usefulness and ease of integration of the proposed UX components (UX artifacts, UX events, and UX evaluation methods) for evaluating UX in agile software development, specifically within Scrum. The validation involved gathering feedback from experts (developers and UX roles) regarding the elements that they suggested adding, modifying, or removing to improve the framework.  
In Step 7, we defined the refinements required for the first version of FRAMUX-EV based on the information gathered in the previous step. The experts' feedback on each component, along with future actions to refine UX events and UX artifacts, is detailed in Section 6.1, Section 6.2 and Section 7.6.