Clinical trial NCT03884114: Comparison of Three Modalities to Assess Clinical Competence of Medical Students
Official title: Assessment of Clinical Competence of Medical Students: a Comparison of High-fidelity Simulation, Serious Game and Multiple-choice Questions
Study type: INTERVENTIONAL
Overall status: COMPLETED
Phase: NA
Conditions: Educational Problems
Keywords: technology-enhanced simulation
serious games
multiple choice questionnaires
medical education
Lead sponsor: Ilumens
Sponsor class: OTHER
First posted: 2019-03-21
Enrollment: 42
Sex: ALL
Minimum age (years): 18
Standard ages: ADULT
OLDER_ADULT
Accepts healthy volunteers: yes
Intervention model: SEQUENTIAL
Intervention model description: All medical students are evaluated using a high-fidelity simulation environment, then using a serious game, then using multiple choice questionnaire, all on the same topic.
Primary purpose: OTHER

Brief summary: This study, focusing on the management of pediatric asthma exacerbations, assesses the clinical skills of medical students using three different evaluation tools: (i) the simulation game "Effic'Asthme" developed to train individuals on the management of pediatric asthma exacerbations; (ii) a multiple choice questionnaire (MCQ) on the same subject developed for the purpose of the study and (iii) high fidelity (HF)-simulation, considered as the gold-standard for its enhanced realism.

Its objective is to determine which of the simulation game or the MCQ reflects the best the clinical competence of medical students evaluated on a HF simulator.

Detailed description: The assessment of medical students' clinical competence has long been of concern to educational institutions. Objective structural clinical examination (OSCE) and assessments in high-fidelity (HF) simulation settings represent interesting evaluation modalities but are associated with huge costs, especially when they are used for large-scale standardized assessments. Multiple choice questionnaires (MCQ) remain the most common evaluation tool in medical schools.

Simulation games may represent an interesting compromise between the cheap but limited assessment allowed by MCQs, and the comprehensive but highly expensive assessment allowed by OSCE and HF simulation.

This study, focusing on the management of pediatric asthma exacerbations, assesses the clinical skills of medical students using three different evaluation tools: (i) the simulation game "Effic'Asthme" developed to train individuals on the management of pediatric asthma exacerbations; (ii) a MCQ on the same subject developed for the purpose of the study and (iii) HF-simulation, considered as the gold-standard for its enhanced realism.

Its objective is to determine which of the simulation game or the MCQ reflects the best the clinical competence of medical students evaluated on a HF simulator.

Eligibility criteria: Inclusion Criteria:

* medical students from Paris 5 University who meet the following criteria

  * Being in their fifth year of medical school
  * Having passed their pediatric exam in the previous 15 days
  * Willing to participate in the study

Exclusion Criteria:

* refusal to participate

Primary outcomes:
measure: Items of the "asthma exacerbation performance score"
timeFrame: Baseline
Secondary outcomes:
measure: The total score on the "asthma exacerbation performance score"
timeFrame: Baseline
measure: The satisfaction of students using Likert-scales with each evaluation modality
timeFrame: Baseline
Other outcomes:
Locations:
city: Paris Cedex 06
country: France
facility: Université Paris Descartes
Study officials:
affiliation: Université Paris Descartes
name: David Drummond, MD, PhD
role: PRINCIPAL_INVESTIGATOR
References:
citation: Norcini JJ, Swanson DB, Grosso LJ, Webster GD. Reliability, validity and efficiency of multiple choice question and patient management problem item formats in assessment of clinical competence. Med Educ. 1985 May;19(3):238-47. doi: 10.1111/j.1365-2923.1985.tb01314.x.
citation: Drummond D, Delval P, Abdenouri S, Truchot J, Ceccaldi PF, Plaisance P, Hadchouel A, Tesniere A. Serious game versus online course for pretraining medical students before a simulation-based mastery learning course on cardiopulmonary resuscitation: A randomised controlled study. Eur J Anaesthesiol. 2017 Dec;34(12):836-844. doi: 10.1097/EJA.0000000000000675.
citation: Adjedj J, Ducrocq G, Bouleti C, Reinhart L, Fabbro E, Elbez Y, Fischer Q, Tesniere A, Feldman L, Varenne O. Medical Student Evaluation With a Serious Game Compared to Multiple Choice Questions Assessment. JMIR Serious Games. 2017 May 16;5(2):e11. doi: 10.2196/games.7033.
citation: Fonteneau T, Billion E, Abdoul C, Le S, Hadchouel A, Drummond D. Simulation Game Versus Multiple Choice Questionnaire to Assess the Clinical Competence of Medical Students: Prospective Sequential Trial. J Med Internet Res. 2020 Dec 16;22(12):e23254. doi: 10.2196/23254.