## 5 Results  
### Overview of the Help Functions Using ITS-CAL  
In this experiment, 36 students participated in the final exam using the ITS-CAL system. One freshman, classified in the low-knowledge cluster, was absent from the exam.  
\begin{table}
\begin{tabular}{c c} \hline \hline
**Num** & **Questions** \\ \hline
1 & Using ITS-CAL has helped me improve my programming skills. \\ \hline
2 & ITS-CAL was very helpful in developing my programming skills. \\ \hline
3 & I had no difficulty using ITS-CAL for programmed learning. \\ \hline
4 & It is very convenient to use the ITS-CAL learning program. \\ \hline
5 & ITS-CAL gives people a humane and friendly impression. \\ \hline
6 & The explanation provided by ITS-CAL is very good. \\ \hline
7 & ITS-CAL responses are well structured. \\ \hline
8 & The answers to the ITS-CAL are accurate. \\ \hline
9 & ITS-CAL will have a negative impact on learning because I can easily find answers and solutions without much effort. \\ \hline
10 & ITS-CAL’s responses sometimes confuse me. \\ \hline
11 & ITS-CAL may make academic cheating easier. \\ \hline
12 & ITS-CAL has amazing features. \\ \hline
13 & ITS-CAL is a helpful and effective language learning technique. \\ \hline
14 & ITS-CAL is an excellent supplemental study resource. \\ \hline
15 & ITS-CAL is a comfortable learning environment. \\ \hline
16 & I feel motivated to use ITS-CAL more. \\ \hline
17 & I hope I can use ITS-CAL in future classes and exams. \\ \hline
18 & I will not use the ITS-CAL feature because of the penalty points. \\ \hline
19 & I would like to have a “hint” button to help me write the program. \\ \hline
20 & I think the response of the “hint” button is helpful to me. \\ \hline
21 & I would like to have a “debug” button to help me write programs. \\ \hline
22 & I think the “debug” button response is helpful to me. \\ \hline
23 & I would like to have a “Ask a Question” button to help me write the program. \\ \hline
24 & I think the responses from the “Ask a Question” button are helpful to me. \\ \hline
25 & I would like to have an “unlimited questions” button to help me write code. \\ \hline
26 & I think the responses from the “Unlimited Questions” button are helpful to me. \\ \hline
27 & I have some suggestions for this system: such as ITS-CAL interface design, ease of use, response speed of each function, whether the function response content is useful, which function can help me write programs, which function is not actually used. You can write down any opinions you have about ITS-CAL, such as which function’s response is useless, which function’s response is very helpful, etc. \\ \hline \hline \end{tabular}
\end{table}
Table 3: System usage questionnaire.  
The results, as summarized in Table 4, indicate differences in the frequency of usage among the three auxiliary functions: Hint, Debug, and User-defined Question.  
The Hint function was the most frequently used, reflecting students' tendency to seek guidance on solution directions when encountering difficulties. The Debug function was the second most used, primarily for addressing code errors. The User-defined Question function was used the least, likely due to its higher cognitive cost (e.g., requiring clear articulation of questions) or students' limited familiarity with the feature. On average, each student used the ITS-CAL help functions 4.72 times during the exam, with an average pass rate of 37.50%. The total usage breakdown was as follows: 42.35% for Hint, 27.06% for Debug, and 30.59% for User-defined Question, indicating a preference for the simpler and more direct Hint function.