IDEAL framework

IDEAL framework
IDEAL (Idea, Development, Exploration, Assessment, Long-term study) is a framework for describing the stages of innovation in surgery and other interventional procedures. The purpose of IDEAL is to improve the quality of research in surgery by emphasizing appropriate methods, transparency of data and rigorous reporting of outcomes.
To achieve this, the IDEAL framework provides a set of recommendations for improving the evidence base from research at each stage of innovation, as outlined in the seminal paper published in The Lancet in 2009. The recommendations emphasize evaluating new procedures prospectively, entering patients and studies into registries and databases to capture all incidences of a procedure, and reporting outcomes by established protocols. It is the first and only such framework for evidence-based practice that was established specifically for surgery and interventional procedures.
Background
The IDEAL framework was the result of an expert consensus developed from a series of meetings held at Balliol College, Oxford, from 2007 to 2009. This group was known as the Balliol Collaboration. The purpose of the meetings was to address the challenges unique to establishing the optimal evidence base in surgery, including practical, methodological, and ethical challenges. Attendees to the meeting (the “IDEAL collaboration”) included experts in evidence-based medicine, including Cochrane Collaboration founder Iain Chalmers, public health expert Muir Gray, statistician and founder of the Centre for Statistics in Medicine in Oxford Doug Altman, clinician-researchers, methodologists, and manufacturers of medical devices.
Framework and recommendations
The five stages of IDEAL, and the recommendations for each stage, are as follows:
Stage 1: Idea
All new procedures should be reported automatically
An online registry should be established for reporting of procedures
Reports should include adverse events
Stage 2a: Development
Protocols for prospective development studies should be established
Protocols should include details about patient selection, operative methods and predefined outcomes
A registry for these protocols should be established
The publication of retrospective case series should be avoided
If retrospective case series are to be published, they should include all consecutive patients and adhere to a reporting template such as STROBE
Stage 2b: Exploration
A prospective research database should be established
Validated methods for evaluating learning curves, such as CUSUM, should be used
Reporting should be more disease-based than procedure-based
Outcome measures should be predefined and include technical, clinical, and patient-reported outcomes
Stage 3: Assessment
Study design should be a randomized controlled trial, or acceptable alternatives
Stage 4: Long-term study
Reporting should include only key outcomes and relevant information
When comparing outcomes among different surgeons or interventionalists and institutions, results should be adjusted for the comorbidities of the patient and the learning curve of the surgeon or interventionalist
Proposals
In the original publication in The Lancet, the authors outline a number of proposals for key stakeholders in the generation of surgical evidence. These include journal editors, funders of services and research, regulators, and professional societies.
IDEAL collaboration
The original IDEAL collaboration consists of attendees to the Balliol meetings. Subsequent members include other stakeholders in evidence-based surgery and interventional procedures. The IDEAL collaboration is led by Oxford surgeon-researcher Peter McCulloch.
Role in device regulation
While the initial Balliol meetings were intended to address innovations in surgery and interventional procedures, it soon became clear that there were also deficits in the evaluation of medical devices and implants used in such procedures. In December 2011, the Center for Devices and Radiological Health of the United States Food and Drug Administration held a public workshop on using the IDEAL framework to help develop high-quality evidence for devices and implants. In September 2012, the FDA published its strategy for improved postmarket surveillance based in part on the discussions from the IDEAL meeting, including the promotion of registries for devices, better assessment of evidence already published, and improved reporting of adverse events.
IDEAL collaborators have written several editorials and commentaries in journals such as the British Medical Journal and The Lancet concerning the regulation of devices.
External links
The IDEAL Collaboration—The IDEAL Collaboration website, including key publications, background materials, blog and discussion forum
References
Surgery
Clinical research
Evidence-based medicine