Living, Rapid Reviews in a Rapidly Evolving World
Authors: Stephanie Chang
Journal: Annals of Internal Medicine (2022)

EditorialsJanuary 2023Living, Rapid Reviews in a Rapidly Evolving WorldFREEStephanie Chang, MD, MPHStephanie Chang, MD, MPHDeputy Editor, Annals of Internal Medicine and American College of Physicians, Washington, DCAuthor, Article, and Disclosure Informationhttps://doi.org/10.7326/M22-3283 SectionsAboutVisual AbstractPDF ToolsAdd to favoritesDownload CitationsTrack CitationsPermissions ShareFacebookTwitterLinkedInRedditEmail When the COVID-19 pandemic began, clinicians struggled to make decisions in the absence of any direct evidence. Researchers responded rapidly to fill the knowledge void with many studies of varying quality, using different interventions, cointerventions, comparators, and populations. Simultaneously, the systematic review field mobilized to organize and help collate, manage, and translate the rapid proliferation of research for on-the-ground decision makers (1, 2).In the face of a voracious need for information but an insufficient, although rapidly developing, evidence base, the living, rapid review was born. Rapid reviews, although poorly defined, emerged out of the acknowledgment that traditional systematic reviews often take more than 12 months to complete, but decisions need to be made faster (3). Previously established methods for updating reviews (4) formed the foundation of the living review. The pandemic brokered this marriage, and since 2020, Annals of Internal Medicine has published 7 living, rapid reviews related to the COVID-19 pandemic. The publication by Holmer and colleagues (5) marks the completion of 5.In this second and final update, Holmer and colleagues (5) examine the duration of IgG antibody response, the role of previous SARS-CoV-2 infection to prevent reinfection, and the role of antibodies in protection from reinfection. The authors found low strength of evidence that antibodies are maintained for at least 12 months, although this may be less in immunocompromised groups and with later variants. They found moderate strength of evidence that prior infection with the Delta SARS-CoV-2 variant protected against symptomatic reinfection with the Omicron BA.1 and BA.2 variants (50% to 67%) and was highly protective against severe disease. There was low strength of evidence that prior infection with BA.1 or BA.2 protected against symptomatic reinfection with BA.4 or BA.5 variants for up to 5 months. However there was little evidence on the role of antibody testing to predict future reinfection risk.Updating a review is often more complicated than rerunning a search, adding more studies to an evidence table, and updating a meta-analysis. In 2016, Garner and colleagues (4) published a consensus and checklist for updating systematic reviews. That guidance suggested that the decision to update a review should start with asking whether the review addresses a current question. If the question is no longer current, the panel recommended that no further update is needed, such as when the intervention is not in use or has been superseded. In 2022, El Mikati and colleagues (6) published a framework for living practice guidelines. Once a guideline is in the living mode, authors note that each update should start with revisiting the relevance of the question and whether any modifications are needed (for example, changing the outcomes of interest) before moving on to updating the systematic evidence review and clinical practice recommendation.The review by Holmer and colleagues highlights many of the challenges of conducting living, rapid reviews not only when the evidence is rapidly evolving, but the environment and virus itself also continue to evolve. When this review began in 2020, the primary question motivating the review was whether antibodies could be used as a marker of immunity (7). Although the authors could not make this link, in the original review, they did find that most adults with SARS-CoV-2 infection developed antibodies that persisted for at least 3 months. With the advent of vaccination further confusing the measurement of antibodies, in the first update, rather than continuing down the established, but less clinically useful, path on examining evidence for antibodies as a marker of immunity, the authors turned to understanding the role of SARS-CoV-2 infection on reinfection (8). They found that before the Delta and Omicron variants, infection had strong protection against symptomatic reinfections for 7 months compared with unvaccinated, uninfected persons. This second and final update returns to update both questions about the antibody response and protection from reinfection after infection.Although both Garner and colleagues (4) and El Mikati and colleagues (6) account for the possibility of changing questions in living updates, both suggest or imply that reviewers and guideline developers restrict updates to relatively minor changes in questions. This topic exemplifies the challenges that may arise from broader changes in scope and questions. The authors of this living, rapid review could have considered that changes in the vaccination and variant landscape made the original primary question obsolete and abandoned the review and/or started a new review. Instead, they used a pragmatic approach and evolved the questions to encompass related questions on reinfection risk to remain pertinent to the decisional milieu at the time. They used what they called a SWATH review (9) where updates may focus on different parts of the overarching topic coincident with the emergence of research and interest by decision makers. Challenges in transparently conveying the linkages between the updates and the original review may be offset by increased flexibility in being able to address the question most relevant to decision making.This living, rapid review demonstrated novel methods to maintain flexibility and relevance in a rapidly changing environment. As interest and experience in living reviews increase, the systematic review field will continue to learn and experiment with different approaches to handle changing questions and methods. The COVID-19 pandemic has spurred interest in living reviews and shown how quickly questions themselves become outdated. However, interest in living reviews continues beyond COVID-19. Research, by nature, means learning and changing context; thus, the challenges around changing questions will certainly not be unique to COVID-19.References1. Boutron I, Chaimani A, Meerpohl JJ, et al; COVID-NMA Consortium. The COVID-NMA Project: building an evidence ecosystem for the COVID-19 pandemic [Editorial]. Ann Intern Med. 2020;173:1015-7. [PMID: 32931326] doi:10.7326/M20-5261 LinkGoogle Scholar2. Rada G, Pérez D, Araya-Quintanilla F, et al. Epistemonikos: a comprehensive database of systematic reviews for health decision-making. BMC Med Res Methodol. 2020;20:286. [PMID: 33256642] doi:10.1186/s12874-020-01157-x CrossrefMedlineGoogle Scholar3. Hartling L, Guise JM, Kato E, et al. EPC methods: an exploration of methods and context for the production of rapid reviews. (Prepared by the Scientific Resource Center under Contract No. 290-2012-00004-C.) AHRQ Publication No. 15-EHC008-EF. Agency for Healthcare Research and Quality; 2015. Accessed at https://effectivehealthcare.ahrq.gov/products/rapid-review-production/white-paper on 14 November 2022. Google Scholar4. Garner P, Hopewell S, Chandler J, et al; Panel for Updating Guidance for Systematic Reviews (PUGs). When and how to update systematic reviews: consensus and checklist. BMJ. 2016;354:i3507. [PMID: 27443385] doi:10.1136/bmj.i3507 CrossrefMedlineGoogle Scholar5. Holmer HK, Mackey K, Fiordalisi CV, et al. Major update 2: antibody response and risk for reinfection after SARS-CoV-2 infection—final update of a living, rapid review. Ann Intern Med. 2023;176:85-91. doi:10.7326/M22-1745 LinkGoogle Scholar6. El Mikati IK, Khabsa J, Harb T, et al; Living Guidelines Group. A framework for the development of living practice guidelines in health care. Ann Intern Med. 2022;175:1154-60. [PMID: 35785533] doi:10.7326/M22-0514 LinkGoogle Scholar7. Arkhipova-Jenkins I, Helfand M, Armstrong C, et al. Antibody response after SARS-CoV-2 infection and implications for immunity. A rapid living review. Ann Intern Med. 2021;174:811-21. [PMID: 33721517] doi:10.7326/M20-7547 LinkGoogle Scholar8. Helfand M, Fiordalisi C, Wiedrick J, et al. Risk for reinfection after SARS-CoV-2. A living, rapid review for American College of Physicians practice points on the role of the antibody response in conferring immunity following SARS-CoV-2 infection. Ann Intern Med. 2022;175:547-55. [PMID: 35073157] doi:10.7326/M21-4245 LinkGoogle Scholar9. Agency for Healthcare Research and Quality. Immunity after COVID-19. Accessed at https://effectivehealthcare.ahrq.gov/products/immunity-after-covid/protocol on 14 November 2022. Google Scholar Comments0 CommentsSign In to Submit A Comment Author, Article, and Disclosure InformationAuthors: Stephanie Chang, MD, MPHAffiliations: Deputy Editor, Annals of Internal Medicine and American College of Physicians, Washington, DCDisclosures: Disclosures can be viewed at www.acponline.org/authors/icmje/ConflictOfInterestForms.do?msNum=M22-3283.Corresponding Author: Stephanie Chang, MD, MPH, American College of Physicians, 25 Massachusetts Avenue #700, Washington, DC 20001; e-mail, [email protected].org.This article was published at Annals.org on 29 November 2022. PreviousarticleNextarticle Advertisement FiguresReferencesRelatedDetailsSee AlsoMajor Update 2: Antibody Response and Risk for Reinfection After SARS-CoV-2 Infection—Final Update of a Living, Rapid Review Haley K. Holmer , Katherine Mackey , Celia V. Fiordalisi , and Mark Helfand Metrics January 2023Volume 176, Issue 1Page: 135-136KeywordsAntibodiesCOVID-19ImmunityResearch quality assessmentSystematic reviewsTreatment guidelines ePublished: 29 November 2022 Issue Published: January 2023 Copyright & PermissionsCopyright © 2022 by American College of Physicians. All Rights Reserved.PDF downloadLoading ...