Keeping Up With Emerging Evidence in (Almost) Real Time
Authors: Christine Laine, Darren B. Taichman, Eliseo Guallar, Cynthia D. Mulrow
Journal: Annals of Internal Medicine (2020)

Editorials21 July 2020Keeping Up With Emerging Evidence in (Almost) Real TimeFREEChristine Laine, MD, MPH, Editor in Chief, Darren B. Taichman, MD, PhD, Executive Editor, Eliseo Guallar, MD, MPH, DrPH, Deputy Editor, Statistics, and Cynthia D. Mulrow, MD, MSc, Senior Deputy EditorChristine Laine, MD, MPH, Editor in ChiefFrom Editor in Chief (C.L.); Executive Editor (D.B.T.); Deputy Editor, Statistics (E.G.); and Senior Deputy Editor (C.D.M.)., Darren B. Taichman, MD, PhD, Executive EditorFrom Editor in Chief (C.L.); Executive Editor (D.B.T.); Deputy Editor, Statistics (E.G.); and Senior Deputy Editor (C.D.M.)., Eliseo Guallar, MD, MPH, DrPH, Deputy Editor, StatisticsFrom Editor in Chief (C.L.); Executive Editor (D.B.T.); Deputy Editor, Statistics (E.G.); and Senior Deputy Editor (C.D.M.)., and Cynthia D. Mulrow, MD, MSc, Senior Deputy EditorFrom Editor in Chief (C.L.); Executive Editor (D.B.T.); Deputy Editor, Statistics (E.G.); and Senior Deputy Editor (C.D.M.).Author, Article, and Disclosure Informationhttps://doi.org/10.7326/M20-2627 SectionsAboutVisual AbstractPDF ToolsAdd to favoritesDownload CitationsTrack CitationsPermissions ShareFacebookTwitterLinkedInRedditEmail Although many aspects of daily life have come to a halt during the coronavirus disease 2019 (COVID-19) pandemic, research certainly has not. The pursuit of evidence to prevent infection with severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), improve patient outcomes, and quell the pandemic is fast and furious. Clinicians and epidemiologists are rushing to report their observations, investigators are launching trials with very short timelines for completion, and journals are receiving record numbers of manuscript submissions. In just 6 weeks during March and April 2020, Annals received one quarter the number of manuscript submissions we received during all of 2019 and, like many journals, Annals is speeding peer review and publication of manuscripts found to be suitable for our readers. This frenetic pace can leave us with "evidence whiplash." What was thought to be true or promising one day is sometimes found to be false or dangerous a short while later. Continual piecemeal release of evidence can be confusing and can contribute to information overload, especially when the new evidence is flawed or uncertain. The rapid accumulation of evidence presents particular challenges for those working to summarize available evidence to inform answers to the many pressing questions the pandemic has generated. Rapid and/or living systematic reviews offer a potential solution (1, 2).Annals' first rapid, living systematic review appears in this issue. Chou and colleagues examine the burden of SARS-CoV-2, SARS-CoV-1, and Middle East respiratory syndrome coronavirus on health care workers (HCWs) and risk factors for infection (3). They searched multiple electronic databases, including a World Health Organization database of publications on coronavirus diseases and the medRxiv preprint server, from 2003 through 27 March 2020, with ongoing surveillance through 24 April 2020, for studies reporting incidence of or outcomes associated with coronavirus infections in HCWs and studies on the association between risk factors and infection. They found that HCWs experienced significant burden from coronavirus infections and that personal protective equipment and infection control training were associated with decreased infection risk while certain exposures were associated with increased risk. Of the 64 studies that met inclusion criteria, only 18 addressed SARS-CoV-2. Recognizing that the conclusions of this systematic review will likely become outdated quickly as more evidence on SARS-CoV-2 emerges, the authors planned for this systematic review to be both "rapid" and "living."A rapid review simplifies or omits some components of the systematic review process to produce information in a timely manner (1). Given the urgency of the pandemic, Chou and colleagues streamlined the systematic review process by not registering the protocol prospectively, limiting the search of the gray literature, restricting dual review to only 25% of abstracts, conducting single-reviewer data abstraction and assessment of study limitations, and using no formal instrument for critical appraisal of the evidence (3).A living systematic review includes a prospective plan for continual surveillance of evidence with periodic critical appraisal and synthesis of new evidence (2). The methods of living systematic reviews are similar to those of traditional systematic reviews, though living reviews also include explicit, transparent, and predefined decisions about how often and for how long new evidence will be sought and screened, as well as when and how new evidence will be incorporated into the review (4). For example, Chou and colleagues plan to update their search monthly (3). Both rapid reviews and traditional systematic reviews may become living reviews.Those who conduct living reviews commit to immediate incorporation of any newly identified important evidence. Journals that publish living reviews must commit to communicating the updated evidence to readers. At Annals, we anticipate 3 potential outcomes of periodic evidence updates: no new evidence is identified; new evidence is identified, but it changes neither the nature nor the strength of prior conclusions; and new evidence emerges that warrants a substantive change in the nature and/or strength of the prior evidence synthesis.Annals will require authors of living reviews to post a "surveillance comment" to the initial review, at the interval prespecified in its methods, describing the results of the updated search. When authors identify no new evidence, this comment will serve to alert readers that an updated search was performed but identified no new eligible evidence. When authors find evidence that is pertinent but does not alter prior conclusions, they should cite and briefly describe, critique, and contextualize the new evidence. Annals will publish these minor updates as "new evidence alerts" in the Letters section, where they will be linked to and indexed with the initial review article. When authors believe that new evidence changes the nature or strength of the conclusions or when evidence synthesis requires major changes in methods, they should consult the editors about whether a major update is warranted. If the editors believe that it is, the authors should submit a new systematic review for peer review.Annals is committed to publishing high-quality, timely evidence relevant to clinical medicine and public health. We look forward to receiving rapid, living systematic reviews on rapidly changing issues. Authors interested in submitting rapid or living systematic reviews to Annals should consult the "Information for Authors" page at Annals.org for details on format. We also look forward to feedback from those who conduct the evidence reviews and from our readers to help us refine their format and publication process.Those who conduct, publish, and rely on systematic evidence reviews have long expressed frustration when new information renders an evidence synthesis out-of-date, sometimes soon after completion (5). The substantial amount of pandemic-related evidence posted on preprint servers before peer review highlights another important feature of rapid and living reviews: the need to search the gray literature and to critically appraise and synthesize such evidence. The concept of rapid and living reviews garnered attention well before the COVID-19 pandemic, but the tsunami of new information related to this novel coronavirus creates an environment that is primed to demonstrate the promise (and also possibly the pitfalls) of rapid, living reviews.References1. Khangura S, Konnyu K, Cushman R, et al. Evidence summaries: the evolution of a rapid review approach. Syst Rev. 2012;1:10. [PMID: 22587960] doi:10.1186/2046-4053-1-10 CrossrefMedlineGoogle Scholar2. Elliott JH, Turner T, Clavisi O, et al. Living systematic reviews: an emerging opportunity to narrow the evidence-practice gap. PLoS Med. 2014;11:e1001603. [PMID: 24558353] doi:10.1371/journal.pmed.1001603 CrossrefMedlineGoogle Scholar3. Chou R, Dana T, Buckley DI, et al. Epidemiology of and risk factors for coronavirus infection in health care workers. A living rapid review. Ann Intern Med. 2020;173:120-36. doi:10.7326/M20-1632 LinkGoogle Scholar4. Elliott JH, Synnot A, Turner T, et al; Living Systematic Review Network. Living systematic review: 1. Introduction-the why, what, when, and how. J Clin Epidemiol. 2017;91:23-30. [PMID: 28912002] doi:10.1016/j.jclinepi.2017.08.010 CrossrefMedlineGoogle Scholar5. Shojania KG, Sampson M, Ansari MT, et al. How quickly do systematic reviews go out of date? A survival analysis. Ann Intern Med. 2007;147:224-33. [PMID: 17638714] LinkGoogle Scholar Comments0 CommentsSign In to Submit A Comment Author, Article, and Disclosure InformationAffiliations: From Editor in Chief (C.L.); Executive Editor (D.B.T.); Deputy Editor, Statistics (E.G.); and Senior Deputy Editor (C.D.M.).Disclosures: Disclosures can be viewed at www.acponline.org/authors/icmje/ConflictOfInterestForms.do?msNum=M20-2627.Corresponding Author: Christine Laine, MD, MPH, American College of Physicians, 190 N. Independence Mall West, Philadelphia, PA 19106; e-mail, [email protected]org.Current Author Addresses: Drs. Laine and Taichman: American College of Physicians, 190 N. Independence Mall West, Philadelphia, PA 19106.Dr. Guallar: Departments of Epidemiology and Medicine, Johns Hopkins Bloomberg School of Public Health, 2024 East Monument Street, Room 2-645, Baltimore, MD 21205.Dr. Mulrow: University of Texas Health Science Center at San Antonio, 7703 Floyd Curl Drive, San Antonio, TX 78229.This article was published at Annals.org on 5 May 2020. PreviousarticleNextarticle Advertisement FiguresReferencesRelatedDetailsSee AlsoEpidemiology of and Risk Factors for Coronavirus Infection in Health Care Workers Roger Chou , Tracy Dana , David I. Buckley , Shelley Selph , Rongwei Fu , and Annette M. Totten Update Alert 6: Epidemiology of and Risk Factors for Coronavirus Infection in Health Care Workers Roger Chou , Tracy Dana , Shelley Selph , Annette M. Totten , David I. Buckley , and Rongwei Fu Update Alert 7: Epidemiology of and Risk Factors for Coronavirus Infection in Health Care Workers Roger Chou , Tracy Dana , Shelley Selph , Annette M. Totten , David I. Buckley , and Rongwei Fu Metrics Cited byCurrent definitions of living systematic reviews and living guidelines need to changeREALIZATION OF HUMAN RIGHTS DURING THE PANDEMIC OF COVID-19Selecting Treatments During an Infectious Disease Pandemic: Chasing the EvidenceMarshall J. Glesby, MD, PhD and Roy M. Gulick, MD, MPHHydroxychloroquine or Chloroquine for Treatment or Prophylaxis of COVID-19 A Living Systematic ReviewAdrian V. Hernandez, MD, PhD, Yuani M. Roman, MD, MPH, Vinay Pasupuleti, MD, MS, PhD, Joshuan J. Barboza, MSc, and C. Michael White, PharmDCOVID-19 and Angiotensin-Converting Enzyme Inhibitor/Angiotensin-Receptor Blocker TherapyWilliam G. Kussmaul III, MDLiving systematic reviews at The BMJOverwhelming research during COVID-19 21 July 2020Volume 173, Issue 2Page: 153-154KeywordsCOVID-19EpidemiologyHealth care providersInfectious disease surveillanceInformation technologyMedical risk factorsPeer reviewPrevention, policy, and public healthSystematic reviewsUpper respiratory tract infections ePublished: 5 May 2020 Issue Published: 21 July 2020 Copyright & PermissionsCopyright © 2020 by American College of Physicians. All Rights Reserved.PDF downloadLoading ...