# SDA-Vis: A Visualization System for Student Dropout Analysis Based on Counterfactual Exploration
## 6 Domain Experts' Validations  
After participating in the case studies, the domain experts gave us some feedback regarding validation of the tool. The validation process was conducted by three domain experts who verified whether SDA-Vis fulfilled the analytical objectives defined in Section 3.1. This tester team had vast experience in university assistance, and its members had worked to detect students at risk of early dropout. First, the domain experts were trained to use the system, and then they were asked the following four questions:  
* Q1: Does the methodology of the SDA-Vis system help you to analyze and reduce dropouts?
* Q2: Are the findings of the SDA-Vis system relevant?
* Q3: Is the SDA-Vis system more suitable for dropout reduction than the system you use?
* Q4: Is the SDA-Vis system easier to use than the current system?  
For the domain experts, the counterfactual explanation model (Methodology--Q1) was deemed an exciting and promising alternative, allowing action to be taken. One of the experts said: _The proposed system has enabled an excellent alternative solution to the challenges we face in our daily analysis. In our current study, we lack predictive models of attrition based on academic, social, and economic data._  
To address Q2, the domain experts conducted some analytical tasks, and after their analysis we collected their impressions. One of the experts said: _Our current analysis is based only on the semester grading of the courses (Academic Risk Alert--ARA). For instance, we analyze only students with grades lower than \(5.75\) (0-20 scale). I believe that the planning of actions for all students is essential. Moreover, the detection of specific problems could be necessary to assign an academic tutor to analyze the student's educational, psychological, and social situation._  
Domain experts were involved in SDA-Vis's design, and they considered that the system does integrate dynamic and intuitive resources (Usability--Q3). The expert who prepared the reports stated: _This system makes the analysis very dynamic and easy to interpret, even taking into account external variables. Recently, we implemented a dashboard based on QLIK (alik.com (accessed on 31 May 2022)) that allows identifying the ARA students automatically. However, it is limited and hard to follow for many users (similar to Excel). Even worse, the analysis of external factors must be done manually based on our expertise._  
Finally, the domain experts considered SDA-Vis a helpful system compared to the currently used tools (Usefulness--Q4). One of the experts stated: _I consider SDA-Vis a beneficial analytical system, and it is far advanced compared to the methodologies we currently use. Our traditional tools are descriptive, while SDA-Vis gives us multiple interactive solutions. It could be essential for academic tutors, professors, and policy decision makers to apply corrective actions and decrease student dropout rates._  
As detailed, we obtained positive feedback. In addition, the experts were quite enthusiastic about SDA-Vis, as it allowed them to identify, understand, and suggest solutions to take corrective actions.