Evaluation of Multiscore Feedback in Professionalism for Anesthesia

Study Overview
=================
Brief Summary
-----------------
Professionalism is one of the six competences required by The Accreditation for Graduate Medical Education Outcome Project to be taught and evaluated during residency. Anesthesia residents are faced with unique communication challenges in their practice including brief contact time with their patients, operating room efficiency pressure, etc. To assess professionalism in Anesthesiology residents is important to obtain evaluations from people with whom they interact including patients, surgeons, colleagues and members of the support team. The Multisource feedback (MSF) approach has been used to evaluate communication skills and professionalism among practicing physicians and residents in a variety of settings. This evaluation model has never been used previously to evaluate anesthesia residents. The investigators propose a randomized controlled trial to validate and evaluate a MSF in professionalism for anesthesia residents. Participants include eighty residents doing two months rotation in Pediatric Anesthesia Department at The Cleveland Clinic Anesthesia Institute from July 1, 2011 and June 30, 2013. MSF questionnaires will be validated using face and content validity methods and comparing them with the current system of evaluation. Residents will be randomly assigned to a feedback group or to the control group. Both groups will receive MSF evaluation from the faculty, patients' parent and coworker. Only the group assigned to feedback is going to have a 'coaching meeting' every month to identify strengths and weaknesses and create strategies for improvement. The investigators are planning to compare the mean values of the baseline evaluations with the mean values obtained after the first and second months from the MSF.

Conditions
-----------------
CA2 and CA3 Residents Doing a Two Month Rotation in, Pediatric Anesthesia Department

Intervention / Treatment
-----------------
* Other: Feedback group
* Other: Control group


Participation Criteria
=================
Eligibility Criteria
-----------------
Inclusion Criteria: CA2 and CA3 residents doing a two month rotation in Pediatric Anesthesia Department Exclusion Criteria: N/A
Sexes Eligible for Study
-----------------
All

Accepts Healthy Volunteers
-----------------
Accepts Healthy Volunteers

Study Plan
=================
How is the study designed?
-----------------

Design Details

Primary Purpose: Other
Allocation: Randomized
Intervention Model: Single Group Assignment
Masking: None (Open Label)


Arms and Interventions

| Participant Group/Arm | Intervention/Treatment |
| --- | --- |
| Placebo Comparator: Control Group<br>Residents will be randomly assigned to a feedback group or to the control group. Besides the standard evaluation at the end of the rotation, in both groups, residents will receive every week a MSF evaluation from the faculty, the patients' parent, and the coworker. Also, for every resident a baseline self assessment will be applied at the beginning and at the end of the rotation. Only the group assigned to feedback is going to have a 'coaching meeting' every month with the Chairman of Department of Pediatric Anesthesia to identify strengths and weaknesses and create strategies for improvement, based on the MSF. | Other: Control group<br>* Besides the standard evaluation at the end of the rotation, in both groups, residents will receive every week a Multiscore Feedback (MSF) evaluation from the faculty, the patients' parent, and the coworker. Also, for every resident a baseline self assessment will be applied at the beginning and at the end of the rotation.<br>|
| Active Comparator: Feedback group<br>Residents will be randomly assigned to a feedback group or to the control group. Besides the standard evaluation at the end of the rotation, in both groups, residents will receive every week a MSF evaluation from the faculty, the patients' parent, and the coworker. Also, for every resident a baseline self assessment will be applied at the beginning and at the end of the rotation. Only the group assigned to feedback is going to have a 'coaching meeting' every month with the Chairman of Department of Pediatric Anesthesia to identify strengths and weaknesses and create strategies for improvement, based on the MSF. | Other: Feedback group<br>* Besides the standard evaluation at the end of the rotation, in both groups, residents will receive every week a Multiscore Feedback (MSF) evaluation from the faculty, the patients' parent, and the coworker. Also, for every resident a baseline self assessment will be applied at the beginning and at the end of the rotation. This group is going to have a 'coaching meeting' every month with the Chairman of Department of Pediatric Anesthesia to identify strengths and weaknesses and create strategies for improvement, based on the Multiscore Feedback (MSF).<br>|

What is the study measuring?
-----------------
Primary Outcome Measures

| Outcome Measure | Measure Description | Time Frame |
| --- | --- | --- |
| Validate Multiscore Feedback (MSF) | To evaluate content validity, copies of the questionnaires will be sent to experts in education in the Anesthesia Institute and Graduate Medical Education at The Cleveland Clinic; they will be asked if the new questionnaires are a good tool to measure professionalism for anesthesia residents | up to 60 days | 

Secondary Outcome Measures

| Outcome Measure | Measure Description | Time Frame |
| --- | --- | --- |
| secondary goal is to test a Multiscore Feedback (MSF) as a method of evaluation in professionalism for anesthesia residents. | We will assess the impact of feedback using the MSF (versus no feedback) on the professional behavior of anesthesia residents as measured by the MSF. The randomized groups of residents with and without feedback will be compared on mean MSF score after the first and second months of the rotation using a linear mixed effects model to account for the correlation between measurements on the same resident and to adjust for baseline score as a covariate. | up to 18 months | 

 Terms related to the study
=================
Keywords Provided by Centre Hospitalier Valida
-----------------
CA2 and CA3 residents, Pediatric Anesthesia