## 4 Experiments and Evaluation
### Experiment in Junior High School
#### 4.2.2 Discussion and Results
\begin{table}
\begin{tabular}{c c c c c c} \hline \hline
**Group** & **Number** & **Mean** & **Std Dev** & **Diff** & \(p\)**-Value** \\ \hline Control Group & 24 & 24.04 & 11.27 & 1.77 & 0.61 \\ Experiment Group & 16 & 25.81 & 10.27 & & \\ \hline \hline \end{tabular}
\end{table} 
Table 1: The \(t\)-test analysis result of a pre-test in the control and experiment group. \begin{table}
\begin{tabular}{c c c c c} \hline \hline
**Test** & **Mean** & **Std Dev** & **Diff** & \(p\)**-Value** \\ \hline Pre-test & 24.04 & 10.27 & 10.21 & 0.0984 \\ Post-test & 30.25 & 14.82 & & \\ \hline \hline \end{tabular}
\end{table} 
Table 2: The \(t\)-test analysis result of pre-test and post-test scores of students in the control group. \begin{table}
\begin{tabular}{c c c c c} \hline \hline
**Test** & **Mean** & **Std Dev** & **Diff** & \(p\)**-Value** \\ \hline Pre-test & 25.81 & 11.27 & 34.13 & 9.09e-09 \\ Post-test & 59.94 & 13.22 & & \\ \hline \hline \end{tabular}
\end{table} 
Table 3: The \(t\)-test analysis result of pre-test and post-test scores of students in the experiment group. (2) Questionnaire Survey  
A questionnaire regarding student attitudes about the R-WOSARLS was conducted in the experiment group, following their use of the system to observe seasonal constellation. We revised the usability and learners' satisfaction part of the questionnaire in the previous experiment. The new part is listed as below:  
* The interface of R-WOSARLS is clear and easy for me to understand. * It is easy for me to operate the system to complete constellation tasks. * The Chinese font, size, color, etc. of the interface are suitable. * Using the R-WOSARLS to observe seasonal constellations is interesting. * I'd like the teacher to use the system when teaching about constellations in the classroom. * I'd like to use the system to observe constellations after school. * The R-WOSARLS can help me enhance my motivation for observing seasonal constellations. * I would recommend other people to use the system if they intend to observe seasonal constellations. * I'd like to download and install the system in my smartphone if I have a smartphone. * In the future, I intend to use the same kind of system for studying other astronomical issues. Twenty-five effective questionnaires were received. The questionnaire included three parts, which were the usefulness (Q1-Q5) and usability (Q6-Q8) of, and the students' satisfaction (Q9-Q15) with, the system. An analysis of the questionnaires was undertaken to investigate whether the students enjoyed the system. With regard to the learning effect, in five of the questions about the learning items, almost all of the students had agreed that the functions of the system were very effective, as shown in Table 5. Moreover, students also agreed that the system could help them improve their knowledge of constellations and erase previous misconceptions they had on the topic. During interviews with them, students confirmed that the AR view was very useful to them in observing the constellations and was able to provide a visual learning experience like the real world, including helping them understand the azimuth and elevation angle in the sky. In addition, science teachers agreed during the interview that the system did help reduce their teaching burden and pressure, since students can observe constellations by themselves on their personal smartphones in school and after it. It can be concluded that the R-WOSARLS was helpful for students to achieve the learning goals of constellation observation in a classroom environment. Based on Table 6, in terms of interface design, students agreed that the system was easy to understand, and the functions were simple to use in the system, as the mean of Q6 and Q8 were 4.28 \begin{table}
\begin{tabular}{c c c c c} \hline \hline
**Group** & **Mean** & **Std Dev** & **Diff** & _p-Value_ \\ \hline Experiment & 59.94 & 13.22 & 29.69 & 1.28e-07 \\ Control & 30.25 & 14.82 & & \\ \hline \hline \end{tabular}
\end{table}