PB2004: BCMA-DIRECTED THERAPY FOR MULTIPLE MYELOMA: EFFECTIVENESS OF ONLINE EDUCATION IN IMPROVING KNOWLEDGE AND COMPETENCE IN PRACTICAL APPLICATION
Authors: V. Harvey-Jones, S. Koekkoek, J. Vandenbroucque, M.-V. Mateos
Journal: HemaSphere (2022)

Background: With BCMA-targeted therapies becoming available for multiple myeloma, it is important that physicians are knowledgeable and competent in how to use these novel agents. Furthermore, physicians need to gain confidence in understanding and managing associated adverse events (AEs) to optimize patient risk-benefit and individualize therapy. Aims: To determine whether online continuing medical education (CME) could improve the knowledge, competence and confidence of clinicians regarding clinical aspects of BCMA-directed therapies. Methods: Two 30-minute online video panel discussions with synchronized slides were launched for physicians outside the USA during 2021 to a target audience of hematologist/oncologists (hem/oncs) and ophthalmologists. Educational effect was assessed for each activity using a repeated-pair design with pre-/post-assessment. 3 multiple choice questions (Qs) assessed knowledge/competence, and 1Q rated on a Likert-type scale assessed confidence. A paired samples t-test was conducted for significance testing on overall average number of correct responses and for confidence rating, and a McNemar’s test was conducted at the Q or learning objective level (5% significance level, P <.05). Cohen’s d with correction for paired samples estimated the effect size of the education on number of correct responses (<.20 modest, .20-.49 small, .59-.79 moderate, ≥.80 large). Data were subsequently combined and analyzed to provide a summative overview of the effect of the education across the combined knowledge-, competence- and confidence-based Qs from the two programs. Data were collected from April–July 2021. Results: Between 47–76 hem/oncs (N=123) and 58–176 ophthalmologists (N=234) completed pre- and post-activity Qs. A statistically significant effect was seen for hem/oncs across both activities (P<0.05–P<0.001) with improvements in knowledge/competence ranging from 34–37%. Furthermore, there was an overall improvement in confidence, ranging from 30–57%. The education had less impact on ophthalmologists; while some improvements were seen in single activities, in the summative overview the greatest improvement was seen in knowledge and competence in managing ocular toxicities. The summative overview showed that hem/oncs had significant improvements in knowledge of trial data with BCMA-directed therapies (average correct response rate: 24% pre- vs 43% post-CME; P<0.05) and competence in managing BCMA-therapy associated AEs (17% pre- vs 36% post-CME; P<0.01). Relative changes of 9% (NS) and 13% (NS) were observed in knowledge of AE management and competence in treatment initiation, respectively. Ophthalmologists showed significant improvements in knowledge of AE management (21% pre- vs 52% post-CME; P<0.001) and competence in AE management (67% pre- vs 76% post-CME; P<0.001). Relative changes of 32% (NS) and -9% (NS) were observed in knowledge of trial data and competence in treatment initiation, respectively. In combined self-assessed confidence Qs, 46% of hem/oncs increased in and 51% maintained confidence. 50% of ophthalmologists increased in and 46% maintained confidence. All confidence changes were significant (P<0.01/ P<0.001). In the single activities, ~50% of participants stated they would modify treatment plans and ~80% were committed to those changes. Summary/Conclusion: These two educational activities resulted in significant educational impact, particularly for hem/oncs. Online CME is valuable in improving knowledge, competence and confidence, as well as identifying areas of future educational need and potentially improving patient outcomes.