# The Effects of Augmented Reality Companion on User Engagement in Energy Management Mobile App
## 4 Results
### User Engagement Scale  
The mean and standard deviation of Group A's UES for the UIs in the four dimensions (\"aesthetic appeal: AE\", \"focused attention: FA\", \"perceived usability: PU\", and \"reward factor: RW\") are displayed in Figure 5. AE, representing visual attractiveness, was rated higher in the TUI (M = 4.04, SD = 0.56) than ARUI (M = 4.01, SD = 0.81). PU asked about aspects of perceived usability, and the TUI (M = 4.36, SD = 0.42) was perceived as having better usability than the ARUI (M = 4.07, SD = 0.60). RW, which is positive experiential outcomes (e.g., willingness to recommend our app to others and having fun with the interaction), also scored a higher mean in the TUI (M = 3.96, SD = 0.55) than ARUI (M = 3.93, SD = 0.76). The overall engagement score is the sum of all the average scores of the UES dimensions (i.e., AE, FA, PU, and RW). The max score of overall engagement score is 20 and the TUI (M = 15.09, SD = 1.64) received a higher score than the ARUI (M = 15.01, SD = 2.51). Unlike the previous three dimensions and overall engagement score, FA, which represented a concentration level, was evaluated with a higher score in the ARUI (M = 3.01, SD = 1.00) than TUI (M = 2.73, SD = 0.80). To determine whether the data analysis result had a statistically significant difference, we conducted a paired sample \(t\)-test. Table 4 presents a paired sample \(t\)-test (right-tailed) results with a degree of freedom of 23. Figure 5: The user engagement scale (UES) result of Group A: means of the TUI and ARUI. The results are grouped into four dimensions, such as “aesthetic appeal (AE)”, “focused attention (FA)”, “perceived usability (PU)”, and “reward factor (RW)”, and into the overall engagement score, which is a sum of four scores of each dimension. The dark purple bars in the FA dimension mean the ARUI scored higher than the TUI. We used quantile-quantile plots (Q-Q plots) to confirm the normal distribution of the differences in the data. We then checked the \(p\)-value (\(p\)) and test statistic (\(t\)) to confirm whether we can accept the null hypothesis (\(H_{0}^{1}\): There is no difference in user engagement between the ARUI and TUI). Since the \(p\) of AE and RW were higher than 0.05, we failed to reject the null hypotheses, which meant there were no significant differences between the ARUI and TUI in AE and RW dimensions for user engagement. Regarding the PU, \(p\) showed less than 0.05, which meant we might reject the null hypothesis. The 95% confidence interval also indicated the same evidence that we might reject the null hypothesis for the PU since it did not cross zero. However, the critical value of our case was 1.71 (degree of freedom = 23, \(\alpha\) = 0.05, right-tailed test), and the \(t\) of PU was \(-\)2.52, which was far less than the critical value. Therefore, we failed to reject the null hypothesis for the PU since the \(t\) of PU was away from the rejection region. On the other hand, FA showed a \(p\) less than 0.05, 95% of a confidence interval that did not include zero, and a \(t\) of 2.49. As in our case (degree of freedom = 23, \(\alpha\) = 0.05, right-tailed test), the critical value was 1.71, which was less than the FA's \(t\). Therefore, we rejected the null hypothesis for FA and accepted the alternative hypothesis (\(H_{a}^{1}\): The ARUI increases user engagement compared to the TUI) for FA dimension. In summary, there is no significant increase in the ARUI of three out of four dimensions of UES, such as AE (\(t\)(23) = \(-\)0.21, \(p\) = 0.42, 95% of confidence interval (CI) [\(-\)0.31, 0.24]), PU (\(t\)(23) = \(-\)2.52, \(p\) = 0.01, CI [\(-\)0.49, \(-\)0.09]), and RW (\(t\)(23) = \(-\)0.41, and \(p\) = 0.34, CI [\(-\)0.17, 0.11]). However, the paired sample \(t\)-test result showed a statistically significant increase in the ARUI at FA, \(t\)(23) = 2.49, \(p\) = 0.01, and CI [0.09, 0.47], meaning that the ARUI provided more engagement than the TUI in the aspect of FA.