A Virtual Reality App Intervention to Improve Concussion Recognition and Reporting in Athletes Aged 9 to 12 Years: Development and Pilot Testing
Authors: Sullivan Lindsay , McKenzie Lara B , Roberts Kristin , Recker Robyn , Schwebel David C , Pommering Thomas , Yang Jingzhen 
Published: May 2023

Background
Existing concussion education programs for preteen athletes typically do not result in sustained improvements in concussion symptom recognition or reporting behaviors. Virtual reality (VR) technology offers an innovative tool that may improve concussion symptom recognition and reporting behaviors among preteen athletes.

Objective
We aimed to describe the design and development of a VR concussion education app, Make Play Safe (MPS), and present findings on the usability and preliminary efficacy of MPS in improving concussion recognition and reporting intentions among soccer athletes aged 9-12 years.

Methods
A collaborative user-centered design process was implemented to develop and evaluate MPS, a semi-immersive VR concussion education app designed to address two behavioral outcomes in preteen athletes aged 9-12 years: (1) recognizing concussion and (2) reporting concussion. The development of MPS occurred in three phases: (1) design and development, (2) usability testing, and (3) preliminary efficacy testing. During phase 1, consultations were completed with 6 experts. Additionally, 5 interviews with children who had a history of concussion were conducted to collect feedback about the proof of concept of MPS. During phase 2, a participatory workshop with 11 preteen athletes and a small group discussion with 6 parents and 2 coaches were conducted to explore the usefulness and acceptability of MPS from the perspective of end users. Finally, phase 3 included preliminary efficacy testing with 33 soccer athletes aged 9-12 years to examine changes in concussion-related knowledge, attitudes, and reporting intentions from pre- to postintervention. The data generated from each phase of this study informed the development of the final version of the proof of concept of the VR concussion education app, MPS.

Results
Experts positively rated the features of MPS and noted that the design and content were innovative and age-appropriate. Preteens with a history of concussion indicated the scenarios and symptoms portrayed in the app represented well what they experienced while concussed. Further, they stated that the app would be an engaging way for children to learn about concussions. The 11 healthy children in the workshop perceived the app positively, noting that the scenarios were informative and engaging. Results from preliminary efficacy testing revealed increases in many athletes’ knowledge and reporting intentions from pre- to postintervention. Others demonstrated no significant changes or a decrease in knowledge, attitudes, or reporting intentions from pre- to postintervention. Group-level changes in concussion knowledge and intention to report concussions were statistically significant (P<.05), while changes in attitudes toward reporting concussions were not (P=.08).

Conclusions
Results suggest VR technology may be an effective and efficient tool to equip preteen athletes with the requisite knowledge and skills to recognize and report future concussions. Further research is recommended to examine the use of VR as an effective strategy to improve concussion-reporting behaviors in preteen athletes.