## 5 Results
### System Usage Questionnaire Results  
According to the results of the student questionnaire survey on the ITS-CAL system, most students expressed positive opinions regarding its functionality and its role in supporting learning. Approximately 60% of students agreed that ITS-CAL contributed to improving their programming skills and highly appreciated the system's user-friendliness and convenience. Additionally, 48% of students found the system to be convenient during the learning process, emphasizing its humanized design. However, a smaller proportion of students reported challenges, particularly with the accuracy and clarity of the system's responses. Specifically, 16% of students found the responses insufficiently accurate, while 8% felt that some response structures were overly general, causing confusion.  
1. Satisfaction with System Functions
* Hint Function: The Hint function received the highest recognition among the three features, with 40% of students stating that it was helpful in solving problems. However, 20% of students did not use this function, indicating potential limitations in its practicality and suggesting room for further enhancement.
* Debug Function: The Debug function received comparatively lower evaluations, with only 29% of students indicating that it significantly assisted in solving program errors. Moreover, 33% of students did not use this feature, which may reflect a combination of design limitations and reduced need for debugging support during the exam.
* User-defined Question Function: This function also exhibited relatively low usage. A total of 28% of students did not engage with it, and only 32% believed it provided helpful responses for their learning needs. These findings indicate the need for improvements in the design and user guidance associated with this function to encourage broader and more effective utilization.  
2. Qualitative Feedback  
Qualitative responses from students highlighted specific needs and expectations for ITS-CAL's future development. Many students described the system as a \"helpful and effective learning resource\" and expressed satisfaction with its overall functionality. However, several areas for improvement were noted and are as follows:* Content of the Hint Function: some students remarked that the hints provided were too simplistic and lacked specific guidance for handling hidden test data.
* Practicality of the Debug Function: a number of students felt that the Debug function's responses were overly general and insufficiently detailed to address specific issues effectively.
* Interface Design Suggestions: students recommended increasing the size of the code editing area to enhance usability and adding a \"usage count\" notification to the system to prevent unintentional overuse.
* Deduction Mechanism: Some students criticized the scoring deduction mechanism as overly strict, suggesting that it might discourage them from using the system's features. They expressed a desire for greater flexibility to explore ITS-CAL's functionalities without excessively impacting their scores.
3. Overall Student Attitude and Recommendations Overall, the survey results indicate that most students hold a positive attitude toward ITS-CAL, recognizing its value in supporting programming education. Nevertheless, several key areas require attention to optimize the system's design and effectiveness:
* Improving Accuracy and Clarity: enhancing the precision and detail of the Hint and Debug functions to better address students' specific learning needs.
* Optimizing Interface Design: expanding the code editing area and incorporating additional features, such as usage notifications, to improve the user experience.
* Adjusting the Deduction Mechanism: balancing the scoring penalty to encourage greater exploration and use of ITS-CAL's features without unduly penalizing students.
* Enhancing User Guidance: providing clearer instructions and strategies to help students effectively utilize the User-defined Question function, thereby increasing its practical value.