## 4 Evaluation
### Results Analysis
#### 4.3.3 Section 3 Analysis  
There are eight test questions in this section. They cover the conversion of values between binary, decimal, and hexadecimal, including fixed-point number conversion and signed number conversion. Group 1 Test Results  
The test results are shown in Figure 16. From the chart, we can see the answer status of the questions. The overall number of submissions is lower than that in the previous sections because this section is about basic base conversion, with fixed formulas that can be applied and fewer special situations. Students can directly obtain the correct answers using the formulas they have learned. The final correct answer rate was close to 100%. The first three questions had a high rate of correct answers on the first submission. These three questions involved 4-bit numerical conversions and were relatively simple, so the rates of correct answers were quite high. From the overall test results analysis, the main reasons for low average accuracy upon first submission in certain questions are as follows:  
* Question 5: This question asks participants to convert a binary value into a fixed-point number. The average accuracy of the first submission is 75.6%. This question is more difficult for students who are exposed to fixed-point numbers for the first time. However, the next question, Question 6, asks students to convert fixed-point numbers back to binary values. It can be seen that the correct answer rate for the first answer significantly improved, to 86.8%. It can be concluded that after practice, students' understanding of the concept can be greatly improved, and they can perform better when they are exposed to similar questions again. * Question 7: This question asks students to convert a binary value into a corresponding signed number. The first-time correct answer rate is 75.2%. For students who are encountering two complementary numbers for the first time, this question requires them to learn a new concept, so the first-time correct answer rate is lower. Similar to previous situations, such as Questions 5 and 6, Question 8 is a reverse conversion of the results. After obtaining an initial understanding of the concept, the results significantly improve upon a second exposure to similar questions. Figure 15: Individual student performance for Group 2 in Section 2. Individual Student Performance in Group 1  
Figure 17 shows the answers of individual students in Group 1 in Section 3. It can be observed from the figure that the average number of submissions for most students is less than 1.5, which means that most students can obtain a correct answer within one or two attempts. The top students (around the top 20%) showed high levels of accuracy, mostly above 95%, on their first submissions. The initial accuracy of other students dropped slightly; however, after repeated revisions, most of them were still able to achieve a high accuracy rate, showing that they have good learning potential and improvement abilities. This proves that the content of this system is not too difficult and good results can be obtained as long as more attempts are made. Group 2 Test Results  
As shown in Figure 18, the overall response curve for Group 2 is close to the trend observed in Group 1. However, Group 2 exhibited a slightly lower average accuracy of the first submission and a higher average number of submissions per question, although  
Figure 16: Solution results for Group 1 in Section 3. Figure 17: Individual student performance for Group 1 in Section 3.  
the final accuracy still approached 100%. This outcome is expected, as some students in Group 2 did not have a background in computer science. The results highlight that prior knowledge significantly impacts the first-attempt accuracy for beginners. Nevertheless, our consistent instructional approach and concept sequencing enabled students from different backgrounds to ultimately achieve comparable outcomes. Similar to Group 1, Questions 5 and 7 had a lower average accuracy upon first submission, likely due to their more complex concepts.