An e-Learning Program for Physiotherapists to Manage Knee Osteoarthritis Via Telehealth During the COVID-19 Pandemic: Real-World Evaluation Study Using Registration and Survey Data
Authors: Jorge Ana Elisa Serafim , Bennell Kim Louise , Kimp Alexander Jared , Campbell Penny Kate , Hinman Rana Shane 
Published: September 2021

Background
The COVID-19 pandemic necessitated clinicians to transition to telehealth, often with little preparation or training. The Physiotherapy Exercise and Physical Activity for Knee Osteoarthritis (PEAK) e-learning modules were developed to upskill physiotherapists in management of knee osteoarthritis (OA) via telehealth and in-person. In the research setting, the e-learning modules are perceived by physiotherapists as effective when they are part of a comprehensive training program for a clinical trial. However, the effectiveness of the modules on their own in a real-world setting is unknown.

Objective
This study aims to evaluate the reach, effectiveness, adoption, and implementation of PEAK e-learning modules.

Methods
This longitudinal study was informed by the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework. Participants were clinicians, researchers, educators, and health care students who registered for access to the modules between April 1 and November 30, 2020. Reach was evaluated by outcomes (countries, referral sources, and attrition) extracted from registration data and embedded within precourse surveys in the Learning Management System (LMS). Effectiveness was evaluated by outcomes (confidence with videoconferencing; likelihood of using education, strengthening exercise, and physical activity in a treatment plan for knee OA; usefulness of modules) measured using a 10-point numeric rating scale (NRS; score range from 1=not confident or likely or useful at all to 10=extremely confident or likely or useful) in pre- and postcourse (on completion) surveys in the LMS. Adoption and implementation were evaluated by demographic and professional characteristics and outcomes related to the use of learning and usefulness of program elements (measured via a 4-point Likert scale, from not at all useful to extremely useful) in a survey administered 4 months after module completion.

Results
Broad reach was achieved, with 6720 people from 97 countries registering for access. Among registrants, there were high levels of attrition, with 36.65% (2463/6720) commencing the program and precourse survey and 19.61% (1318/6720) completing all modules and the postcourse survey. The program was effective. Learners who completed the modules demonstrated increased confidence with videoconferencing (mean change 3.1, 95% CI 3.0-3.3 NRS units) and increased likelihood of using education, strengthening and physical activity in a knee OA treatment plan, compared to precourse. Adoption and implementation of learning (n=149 respondents) occurred at 4 months. More than half of the respondents used their learning to structure in-person consultations with patients (80/142, 56.3%) and patient information booklets in their clinical practice (75/142, 52.8%).

Conclusions
Findings provide evidence of the reach and effectiveness of an asynchronous self-directed e-learning program in a real-world setting among physiotherapists. The e-learning modules offer clinicians an accessible educational course to learn about best-practice knee OA management, including telehealth delivery via videoconferencing. Attrition across the e-learning program highlights the challenges of keeping learners engaged in self-directed web-based learning.