The July Effect: Fertile Ground for Systems Improvement
Authors: Paul Barach, Ingrid Philibert
Journal: Annals of Internal Medicine (2011)

Editorials6 September 2011The July Effect: Fertile Ground for Systems ImprovementFREEPaul Barach, MD, MPH and Ingrid Philibert, PhD, MBAPaul Barach, MD, MPHFrom University Medical Center Utrecht, 3508 GA Utrecht, the Netherlands, and Accreditation Council for Graduate Medical Education, Chicago, IL 60654. and Ingrid Philibert, PhD, MBAFrom University Medical Center Utrecht, 3508 GA Utrecht, the Netherlands, and Accreditation Council for Graduate Medical Education, Chicago, IL 60654.Author, Article, and Disclosure Informationhttps://doi.org/10.7326/0003-4819-155-5-201109060-00352 SectionsAboutVisual AbstractPDF ToolsAdd to favoritesDownload CitationsTrack CitationsPermissions ShareFacebookTwitterLinkedInRedditEmail A decade after the publication of the Institute of Medicine report To Err Is Human(1), health care still is considered a low-reliability industry associated with significant preventable patient harm. An editorial describing the experience of 2 physicians, father and son, during their first night of call separated by 30 years offers sobering insight into the preventable harm and terrors experienced by rookie physicians as they confront their first patients (2). It highlights why academic health centers brace themselves for the arrival of new trainees and describes an almost unchanged experience, despite the passage of time and the institution of systems to improve the safety and quality of clinical care and learning in teaching hospitals (2).Despite these systems, significant risk for patient harm in teaching hospitals is a persistent problem, largely because of the lack of safeguards surrounding inexperienced new physicians when they are first entrusted with major clinical responsibilities. Policies, guidelines, and checklists help raise awareness and prevent some harm, but they appear to fall short of helping create an ultrasafe system (3). Despite unprecedented levels of spending, preventable medical errors abound, uncoordinated care still frustrates patients and providers, and health care costs continue to rise (4).High reliability—or consistent performance at high levels of safety at all period—is a hallmark for other high-risk industries, such as aviation and nuclear power (5). Reliable patient care is the ultimate responsibility of the attending physician and the clinical microsystem. Clinical microsystems provide a conceptual and practical framework for thinking about the organization and the mindful delivery of safe care (6, 7). Medical education, from the first year of medical school through the end of residency training, requires learners to assume graded responsibility and autonomy in clinical practice while the trainees engender trust in their attending physicians (8). Ideally, the attending physician holds quality of care constant while balancing the amount of supervision and autonomy he or she gives the learner. Patients trust that the teaching faculty members are taking care of them, watching out for their welfare, and coordinating the clinical care delivered by all members of the team. Patients would not consent to care if they knew that the opportunities for residents to learn come at the expense of their welfare and life.The superb systematic review by Young and colleagues in this issue (9) adds evidence to the long-held suspicion that in practice, the quality of care in teaching hospitals decreases at the start of the academic year. Patients and physicians have suspected this, but individual studies often offered inconclusive findings. Now we have the evidence. The review clearly traces the worsening in patient quality and safety by new interns and residents as they advance toward mastering patient care. Higher-quality studies have consistently found greater evidence of a true "July effect" throughout training.The finding is sobering. The public expects safe, high-quality health care and wants its teaching hospitals to lead the way: in generating and applying new knowledge, in teaching the next generation of health professionals, and in demonstrating high scores on publically reported quality and safety measures. The evidence from closed-claims studies comparing medical errors in teaching and nonteaching settings does not bear this out (10).Clearly highlighted by the review, and potentially even more disturbing, is that the debate over the existence, magnitude, and impact of the July effect spans 20 years. Even if one interprets Young and colleagues' comments that "unpublished studies may be more likely to have negative results," the existence of this phenomenon seems incontrovertible and unsettling. Alarmingly, Young and colleagues note that effective interventions will benefit from better information about the causes and magnitudes of harm in a variety of clinical settings and that until efficient models are developed, "addressing the effects of changeovers will probably require considerable resources." Thus, the July effect can be added to patient outcomes that require further study or have solutions that are considered out of financial reach for a nation that already spends more than 16% of a sizable gross domestic product on health care. Members of the medical and education communities may acknowledge the July effect as a topic requiring further study; a problem with an unfunded mandate; or, worse, a necessary tradeoff in institutions where learners participate in care. None of these are acceptable.We should accept that Young and colleagues' review provides the best available evidence and that effective interventions requiring implementation and robust evaluation exist. "Good" science involves more than evidence of effect; it requires innovative research methods, including action research, observational methods, and improvement science methods to better understand how to socialize and support new physicians during large cohort turnovers. These new methods can help shed light on the relationships and interactions between trainees and their teachers and between patients and the technologies that support this interaction. When cohort turnover studies are de-coupled from practice and are poorly reconciled with the practical, material, and temporal arrangements of delivering health care services, they miss the organizational, political, and emotional processes of learning and their effect on the socialization of trainees (11).Young and colleagues' review identified clinical inexperience, inadequate supervision of trainees functioning in new clinical roles, and loss of "systems knowledge" due to team turnover and departure of the experienced, "systems-literate" clinicians as the mechanisms that cause these outcomes. The relevant empiric work has been done. Needed now is the courage to apply existing data on the effectiveness of interventions in these areas to attenuate or eliminate the July effect. The solutions—such as enhancing supervision, reducing the tempo of the uptake of clinical responsibilities in the first weeks of service, avoiding overnight responsibilities during that period, coupling experienced providers with inexperienced ones in a buddy system, and implementing even more involved interventions (for example, staggering the start dates of trainees over the year)—will greatly enhance individual learning, performance, and patient safety. Simulation, team training, and better "on-boarding" of new trainees centered on the clinical microsystem will help transfer knowledge from departing trainees. Many of these interventions already are standard approaches currently included in the Accreditation Council for Graduate Medical Education's accreditation standards, and the enhancements to the supervision standards to be implemented in July 2011 are particularly relevant (12). These interventions require no future "test of concept" studies; they require political will and financial support for implementation and evaluation.Ensuring safe care in teaching hospitals in July cannot wait any longer. It will require the ability to pool data from local tests of change. Ideally, identical interventions will be implemented across several settings, and the studies will be powered to ascertain the effectiveness of the change and to ensure sufficient organizational breadth for generalizability across different teaching institutions. Finally, future work should address the dearth of data on the effect of the changeover in the ambulatory setting. The effect among outpatients may be more subtle; data already suggest that harm is common (13), and less than one half of ambulatory patients receive the health services indicated to optimally manage their health (14).Reliable quality and safe patient care throughout the academic year will require a multipronged approach, one that recognizes the need to immerse trainees in a new clinical environment but with seasoned mentorship, close supervision, and graduated clinical responsibilities. The complex interrelationships among the July effect, handoffs of clinical care, excessive work hours, sleep deprivation, and increased medical errors highlight a profound need for a robust and resilient systems approach to mitigate the chaotic healthcare settings in which trainees must perform and survive. It is time to move beyond the "counting and control model" to one that enables and supports dedicated trainees struggling to manage the ever-growing complexity of their new social and technical environments. We need to better understand how best to protect patients and providers during cohort turnovers while developing a culture where trainees feel psychologically safe to speak up, admit error, challenge poor practices, and learn to be accountable for their actions (15).Paul Barach, MD, MPHUniversity Medical Center Utrecht3508 GA Utrecht, the NetherlandsIngrid Philibert, PhD, MBAAccreditation Council for Graduate Medical EducationChicago, IL 60654References1. Kohn LT, Corrigan JM, Donaldson MS, eds. Committee on Quality of Health Care in America, Institute of Medicine. To Err Is Human: Building a Safer Health System. Washington, DC: National Academy Press; 2000. Google Scholar2. Inui TS, Inui TS. An intergenerational reflection on the first night on call—plus ça change, plus c'est la même chose? (The more things change, the more they stay the same?). Journal of Graduate Medical Education. 2010;2:4-6. CrossrefMedlineGoogle Scholar3. Amalberti R, Auroy Y, Berwick D, Barach P. Five system barriers to achieving ultrasafe health care. Ann Intern Med. 2005;142:756-64. [PMID: 15867408] LinkGoogle Scholar4. Landrigan CP, Parry GJ, Bones CB, Hackbarth AD, Goldmann DA, Sharek PJ. Temporal trends in rates of patient harm resulting from medical care. N Engl J Med. 2010;363:2124-34. [PMID: 21105794] CrossrefMedlineGoogle Scholar5. Weick KE, Sutcliffe KM. Managing the Unexpected: Assuring High Performance in an Age of Complexity. University of Michigan Business School Management Series. San Francisco: Jossey-Bass; 2001. Google Scholar6. Mohr JJ, Barach P, Cravero JP, Blike GT, Godfrey MM, Batalden PB, et al. Microsystems in health care: Part 6. Designing patient safety into the microsystem. Jt Comm J Qual Saf. 2003;29:401-8. [PMID: 12953604] MedlineGoogle Scholar7. Weick K, Sutcliffe K. Mindfulness and the quality of organizational attention. Organization Science. 2006;17:514-24. CrossrefGoogle Scholar8. Sterkenburg A, Barach P, Kalkman C, Gielen M, ten Cate O. When do supervising physicians decide to entrust residents with unsupervised tasks? Acad Med. 2010;85:1408-17. [PMID: 20736669] CrossrefMedlineGoogle Scholar9. Young JQ, Ranji SR, Wachter RM, Lee CM, Niehaus B, Auerbach AD. "July effect": impact of the academic year-end changeover on patient outcomes. A systematic review. Ann Intern Med. 2011;154:309-15. LinkGoogle Scholar10. Singh H, Thomas EJ, Petersen LA, Studdert DM. Medical errors involving trainees: a study of closed malpractice claims from 5 insurers. Arch Intern Med. 2007;167:2030-6. [PMID: 17954795] CrossrefMedlineGoogle Scholar11. Bosk C. Forgive and Remember: Managing Medical Failure. 2nd ed. Chicago: Univ of Chicago Pr; 2003. Google Scholar12. Accreditation Council for Graduate Medical Education, Common Program Requirements. Effective July 1, 2011. Accessed at www.acgme.org/acWebsite/home/Common_Program_Requirements_07012011.pdf on 15 June 2011. Google Scholar13. Bishop TF, Ryan AK, Casalino LP. Paid malpractice claims for adverse events in inpatient and outpatient settings. JAMA. 2011;305:2427-31. [PMID: 21673294] CrossrefMedlineGoogle Scholar14. McGlynn EA, Asch SM, Adams J, Keesey J, Hicks J, DeCristofaro A, et al. The quality of health care delivered to adults in the United States. N Engl J Med. 2003;348:2635-45. [PMID: 12826639] CrossrefMedlineGoogle Scholar15. Edmondson AC. Psychological safety and learning behaviours in work teams. Administrative Science Quarterly. 1999;44:350-383. CrossrefGoogle Scholar Comments0 CommentsSign In to Submit A Comment Author, Article, and Disclosure InformationAuthors: Paul Barach, MD, MPH; Ingrid Philibert, PhD, MBAAffiliations: From University Medical Center Utrecht, 3508 GA Utrecht, the Netherlands, and Accreditation Council for Graduate Medical Education, Chicago, IL 60654.Disclosures: Disclosures can be viewed at www.acponline.org/authors/icmje/ConflictOfInterestForms.do?msNum=M11-1449.Corresponding Author: Paul Barach, MD, MPH, Department of Perioperative Care and Emergency Medicine, University Medical Center Utrecht, Mail Stop Q05.4.310, Heidelberglaan 100, 3508 GA, Utrecht, the Netherlands; e-mail, p.[email protected]nl.Current Author Addresses: Dr. Barach: Department of Perioperative Care and Emergency Medicine, University Medical Center Utrecht, Mail Stop Q05.4.310, Heidelberglaan 100, 3508 GA, Utrecht, the Netherlands.Dr. Philibert: Accreditation Council for Graduate Medical Education, 515 North State Street, Chicago, IL 60654. PreviousarticleNextarticle Advertisement FiguresReferencesRelatedDetailsSee Also"July Effect": Impact of the Academic Year-End Changeover on Patient Outcomes John Q. Young , Sumant R. Ranji , Robert M. Wachter , Connie M. Lee , Brian Niehaus , and Andrew D. Auerbach Impact of the "July Effect" on Patient Outcomes Shimon (Seymour) M. Glick Impact of the "July Effect" on Patient Outcomes Louella Vaughan , Derek Bell , and Graeme McAlister Impact of the "July Effect" on Patient Outcomes Mark P. Jarrett Metrics Cited byTargeted Training for Subspecialist Care in Children With Medical ComplexityClinical handover and handoff in healthcare: a systematic review of systematic reviewsManagement of the Academic Emergency DepartmentReadiness for ResidencyUsing an Adaptive, Self-Directed Web-Based Learning Module to Enhance Residents' Medical Knowledge Prior to a New Clinical RotationAbsence of July Phenomenon in Acute Ischemic Stroke Care Quality and OutcomesManaging the Complex High-Risk Surgical PatientProvision of Care by Medical Residents and the Impact on QualityImpacto de la calidad de la atención por parte de los residentesMedical intensive care unit consults occurring within 48 hours of admission: A prospective studyIs There a "July Effect" for Inpatient Glycemic Control?Is There A "July Effect" for Inpatient Glycemic Control?Imperfect beginnings: Incoming residents vary in their ability to interpret basic electrocardiogram findingsImpact of Academic Year Timing on Percutaneous Coronary Intervention Outcomes at Training InstitutionsA "Reverse July Effect": Association Between Timing of Admission, Medical Team Workload, and 30-Day Readmission RateMaking July SaferImpact of the "July Effect" on Patient OutcomesShimon (Seymour) M. Glick, MDImpact of the "July Effect" on Patient OutcomesLouella Vaughan, DPhil, Derek Bell, MD, and Graeme McAlisterImpact of the "July Effect" on Patient OutcomesMark P. Jarrett, MDImproving communication and reliability of patient handovers in pediatric cardiac care 6 September 2011Volume 155, Issue 5Page: 331-332KeywordsGraduate medical educationHealth careHealth care providersHealth care qualityHealth services researchMedical educationMedical servicesPatientsSafetySystematic reviews ePublished: 6 September 2011 Issue Published: 6 September 2011 Copyright & PermissionsCopyright © 2011 by American College of Physicians. All Rights Reserved.PDF downloadLoading ...