## 4 Result
### Feature Importance Analysis Using XGBoost and Comparative Review with SHAP
#### 4.2.2 Feature Importance Analysis for AI Literacy in Class Implementation Phase  
Feature Importance Analysis for AI Literacy in the Class Implementation Phase is presented in [Table 7, Figure 5]. \begin{table}
\begin{tabular}{c c c} \hline \hline \multirow{2}{*}{**Feature**} & **XGBoost** & **SHAP** \\  & **Feature Importance** & **Mean Absolute Value** \\ \hline Importance of AI Literacy in Class Assessment Phase & 0.2588 & 0.1138 \\ \hline Importance of AI Literacy in Class Preparation Phase & 0.1266 & 0.0905 \\ \hline Importance of Teaching Methods in AI Literacy for AI-Integrated Education & 0.1185 & 0.1219 \\ \hline Importance of Skills in AI Literacy for AI-Integrated Education & 0.0699 & 0.0596 \\ \hline Importance of AI Literacy in Class Implementation Phase & 0.0691 & 0.0657 \\ \hline Importance of AI Literacy in Class Application of Assessment Results Phase & 0.0679 & 0.0527 \\ \hline Importance of Skills in AI Literacy & 0.0611 & 0.0851 \\ \hline Perceived Need for AI Literacy Learning Level for Students & 0.0526 & 0.0780 \\ \hline Importance of Knowledge in AI Literacy & 0.0476 & 0.0556 \\ \hline Importance of Knowledge in AI Literacy for AI-Integrated Education & 0.0473 & 0.0580 \\ \hline Importance of Teaching Methods in AI Literacy & 0.0403 & 0.0644 \\ \hline Perceived Need for AI Literacy Learning Level for Teachers & 0.0403 & 0.0478 \\ \hline \hline \end{tabular}
\end{table} 
Table 7: Feature Importance of AI Literacy in the Class Implementation Phase. The background color is used to highlight cases with higher values. In this analysis, \"Importance of AI Literacy in Class Implementation Phase\" recorded the highest Feature Importance value (0.2588). This was followed by \"Importance of Teaching Methods in AI Literacy for AI-Integrated Education\" (0.1266), \"Importance of AI Literacy in Class Preparation Phase\" (0.1185), \"Importance of Knowledge in AI Literacy for AI-Integrated Education\" (0.0699), and \"Importance of AI Literacy in Class Assessment Phase\" (0.0691). Comparative analysis with SHAP revealed that features like \"Importance of AI Literacy in Class Application of Assessment Results Phase\" (XGBoost: 0.0679, SHAP: 0.0527) and \"Importance of Teaching Methods in AI Literacy for AI-Integrated Education\" (XGBoost: 0.1266, SHAP: 0.0905) had lower mean absolute values in SHAP, whereas \"Importance of Skills in AI Literacy\" (XGBoost: 0.0611, SHAP: 0.0851) and \"Perceived Need for AI Literacy Learning Level for Students\" (XGBoost: 0.0526, SHAP: 0.0780) showed higher mean absolute values, highlighting significant variations in the valuation of these features between the two analyses. Expanding on these results, the SHAP analysis clarifies why certain features diverged in importance. For example, the \"Importance of Teaching Methods in AI Literacy for AI-Integrated Education\" was a prominent predictor in XGBoost but exhibited a much smaller average impact in SHAP, suggesting that its influence on class implementation outcomes is contingent on other factors (possibly overlapping with teachers' knowledge or phase-specific priorities). Conversely, features such as teachers' emphasis on AI Literacy skills and their perception of students' AI Literacy needs, while ranked lower by XGBoost, showed elevated SHAP contributions. This indicates that when a teacher strongly prioritizes  
Figure 5: Feature Importance Comparison: XGBoost and SHAP Analysis for AI Literacy in the Class Implementation Phase. practical AI skills or perceives a high student need for AI literacy, it leads to substantial changes in their implementation-phase performance--an effect that the global XGBoost metric may under-represent. SHAP dependence plots further reveal that these factors do not operate in isolation but interact. Notably, the positive effect of a teacher's belief in the importance of AI Literacy during the assessment phase (a top XGBoost feature for class implementation) is significantly amplified if the teacher also possesses strong AI Literacy skills.