Glyn Elwyn BA MB BCh MSc PhD ¹,², Isabelle Scholl Dipl-Psych ³, Caroline Tietbohl BA ⁴, Mala Mann MIInfSc MCLIP ¹, Adrian GK Edwards MB BCh MPhil PhD ¹, Katherine Clay BN MA ⁵, France Légaré MD PhD 6 , Trudy van der Weijden, MD PhD 7 , Carmen Lewis MD MPH 8 , Richard Wexler MD 9 , Dominick Frosch PhD 4, 11. Cochrane Institute of Primary Care and Public Health ¹ Cardiff University Heath Park United Kingdom CF14 4YS Support Unit for Research Evidence ¹ Cardiff University Heath Park Cardiff United Kingdom CF14 4YS The Dartmouth Center for Health Care Delivery Science ² Dartmouth College 37 Dewey Field Road New Hampshire, NH 03755 USA Department of Medical Psychology ³ University Medical Center Hamburg-Eppendorf Martinistr. 52 20246 Hamburg Germany Department of Health Services Research 4 Palo Alto Medical Foundation Research Institute 795 El Camino Real Palo Alto, CA 94301 USA Office of Professional Education and Outreach 5 The Dartmouth Institute of Health Policy and Clinical Practice 46 Centerra Parkway, Suite 203 Lebanon, NH 03756 USA Research Center Hospitalier Universitaire de Québec 6 Knowledge Transfer and Health Technology Assessment Research Group Hôpital St-François D'Assise 10 rue Espinay, Québec QC, Canada, G1L 3L5 School CAPHRI, Department of General Practice  7 Peter Debyeplein 1, 6229 HA Maastricht The Netherlands Carmen Lewis  8 University of North Carolina Campus Box 7110 Chapel Hill NC 27599 USA Richard Wexler 9 Informed Medical Decisions Foundation 40 Court Street Suite 300 Boston MA 02108 USA Department of Medicine ¹¹ University of California, Los Angeles 911 Broxton Avenue Los Angeles, CA 90024 USA Keywords: implementation, patient decision support interventions, patient decision aids.
Correspondence: Glyn Elwyn glynelwyn@gmail.com

Abstract
Background: Two decades of research has established the positive effect of using patient-targeted decision support interventions: patients gain knowledge, greater understanding of probabilities and increased confidence in decisions. Yet, despite their efficacy, their effectiveness in routine practice has yet to be established and widespread adoption has not occurred. The aim of this review was to search for and analyze the findings of published peer-reviewed studies that investigated the effectiveness of strategies, methods or approaches to implement patient-targeted DESIs into routine clinical settings. Method: An electronic search strategy was devised and adapted for the following databases: ASSIA, CINAHL, Embase, HMIC, Medline, Medline-in-process, OpenSIGLE, PsycINFO, Scopus, Social Services Abstracts and the Web of Science. In addition, we used snowballing techniques. Studies were included after dual independent assessment. Results: After assessment, 5322 abstracts yielded 51 articles for consideration. After examining full- texts, 17 studies were included and subjected to data extraction. The approach used in all studies was one where clinicians and their staff used a referral model, asking eligible patients to use decision support. The results point to significant challenges to the implementation of patient decision support using this model, including indifference on the part of health care professionals. This indifference stemmed from a reported lack of confidence in the content of DESIs and concern about disruption to established workflows, ultimately contributing to organisational inertia regarding their adoption. Conclusions: It seems too early to make firm recommendations about how best to implement patient decision support into routine practice because approaches that use a ‘referral model’ consistently report difficulties. We sense that the underlying issues that militate against the use of patient decision support and, more generally, limit the adoption of shared decision making, are under-investigated and under- specified. Future reports from implementation studies could be improved by following guidelines, for example the SQUIRE proposals, and by adopting methods that would be able to go beyond the 'barriers' and ‘facilitators’ approach to understand more about the nature of professional and organisational resistance to these tools. The lack of incentives that reward the use of these interventions needs to be considered as a significant impediment.
Background
The difficulty of translating knowledge into practice is well established and is a familiar phenomenon to researchers who promote the adoption of patient decision support interventions (DESIs) [1][2]. Two decades of research has established the positive effect of using these interventions; patients gain knowledge, greater understanding of probabilities and increased confidence in decisions [3]. The policy context has gradually become much more supportive in recent years. In the USA, the 2010 Affordable Care Act (USA) [4] was explicit about the promotion of shared decision making (SDM) and the use of DESIs. Some states have passed legislation supporting their use [5]. Similarly in the UK, shared decision making has been at the center of policy developments [6] and investments have been made in the development of online DESIs [7]. Canada is supporting province-wide work in the use of DESIs in Saskatchewan [8]. Many other countries are alert to the benefits and are considering policy developments in this area [9]. Yet, despite these policy developments and the existence of 86 controlled trials that have demonstrated the efficacy of these interventions [3], their effectiveness and adoption into mainstream clinical practice has yet to be established. There are reports of early implementation efforts in the field but many are not yet published in the peer-reviewed literature [10]. The Dartmouth-Hitchcock Medical Center, New Hampshire, has routinely provided many patients with DESIs (DVDs and booklets) for over a decade through their Center for Shared Decision Making [11] and Group Health in Seattle has reported organization-wide adoption of DESIs for selected conditions [12][13]. However, these well-known settings remain isolated examples of adoption. Though there are many who develop and evaluate these tools in academic settings, no studies of sustained wide-scale adoption have been reported. In 2006, Gravel described clinicians' reluctance to use patient DESIs because they did not believe that they were applicable to their patients and clinical situations [1]. Légaré examined 6764 titles and abstracts and analyzed five RCTs [2], tentatively concluding that the promotion of shared decision making may depend on a) training healthcare professionals and b) the adoption of patient targeted DESIs [2]. A conceptual analysis using the normalization process model highlighted some of the intra- organisational issues that might underlie the difficulties that are being experienced [14]. The stimulus for this review arose from work being undertaken by the International Patient Decision Aids (IPDAS) Collaboration which has produced a checklist [15] and an instrument to assess the quality of these interventions [16]. The Collaboration initiated a review of its quality dimensions in 2010. As part of this work, we wanted to know whether we could identify evidence to inform recommendations about how best to implement patient DESIs into practice. We wanted to reflect the increasing emphasis being given to delivery research encompassing implementation or improvement science [17]. Pronovost highlights an issue that is becoming of central importance for policy makers – to examine why interventions that have positive effects for patients under controlled conditions do not become established in routine settings [17]. To address this gap in knowledge, the aim of this review was to search for and analyze the findings of peer-reviewed studies that investigated the effectiveness of strategies, methods or approaches to implement patient-targeted DESIs into routine clinical settings and workflows. We undertook a systematic review using the following definitions and approach to search, selection and data processing. Definition of the Dimension: This review is focused on work designed to implement patient DESIs into routine clinical settings. We adopted the following definitions: “… implementation is the constellation of processes intended to get an intervention into use within an organization" [18] and "… implementation is the critical gateway between an organisational decision to adopt an intervention and the routine use of that intervention, i.e. the transition period in which targeted stakeholders become increasingly skillful, consistent and committed in their use of an intervention' [19]. We are aware that the nature of patient DESIs can vary [20]. We focus on the following types of DESIs in this review: 1) brief tools designed for use in synchronous encounters (face-to-face or mediated by other means) and 2) more extensive tools (booklet, video, DVD or websites) that clinicians recommend patients to use, either before or after clinical encounters. Search strategy: An electronic strategy was devised in collaboration with an information scientist (MM) and adapted for the following databases (1947- 24 January 2012): ASSIA, CINAHL, Embase, HMIC, Medline, Medline-in-process, OpenSIGLE, PsycINFO, Scopus, Social Services Abstracts and the ISI Web of Science (Science Citation Index Expanded, Social Science Citation Index and ISI Proceedings). Specific author searches were performed on the following researchers: M. Holmes-Rovner, K. R. Sepucha, J. Belkora, D. Frosch and D. Stacey. In addition, we used range of ‘snowballing’ techniques to increase the sensitivity of the search, including reference list follow up, contact with subject experts and searched content tables of relevant journals. We used Google Scholar and also searched the Kings Fund website. Articles included in a review of strategies to implement shared decision making were also considered [2]. Research colleagues were alerted to the review using two electronic networks, e.g. the SDM listserve (n=470), and the SDM Facebook group members (n=346). Inclusion and exclusion criteria: Studies published in peer-reviewed journals were considered if they reported on the use of methods to promote the use of patient DESIs in routine practice. Studies were included if they assessed barriers to implementation and/or investigated the process of introducing organizations to the potential use of these interventions. RCTs that studied implementation strategies were included, provided their outcome measurements included assessments of whether these interventions became integrated into routines, at the system level or equivalent. All health care settings and all patient groups were considered, including systems where patients were directed to access DESIs by contacting a telephone call-center or using the web. No date or language restrictions were used. Studies were excluded if they did not attempt to implement DESIs in routine practice, if their sole aim was to measure effectiveness of DESIs at the patient level or if they evaluated more general interventions to ‘activate’ patients. Study identification, data extraction and analysis: Search outputs were merged and duplicates were removed. Titles and abstracts were assessed independently by two reviewers and disagreement was resolved by discussion. Data extraction forms were piloted and adapted. Data from each publication were extracted, even if articles reported the same study. The following fields were used: study identifiers, study type (RCT, quasi-experimental, observational, quality improvement report, case study report, other), intervention or implementation strategy, research method, country and study setting, underpinning conceptual framework, healthcare delivery funding model (general taxation, voluntary or private insurance, other), groups described (implementation group, professional group, patient group), study purpose, duration, funder, incentives for patients or professionals, organizational level (microsystem or team, department, institution), DESI type, point at which the DESI is introduced to the patient (e.g. before, during or after the clinical encounter), method of distribution. Data were also extracted on implementation outcomes, including the number of patients who were eligible, referred to or provided with DESIs, used DESIs and were seen by a health professional after using DESIs. Finally, data about outcomes related to professionals and systems, e.g. views, barriers and facilitators were extracted. Independent data extractions, completed by IS and CT, were compared and discussed. Disagreements resolved by discussion with GE. Each study was summarized, and a synthesis of the results was produced. Anticipating significant diversity in methods, we did not assess the study quality. Assessment of implementation level: Each study was assessed independently by GE and IS and categorized according to the intervention described and the level of implementation achieved, using an adapted model of implementation – see Table 1 [21] [22]. Disagreements were resolved by discussion.
Results
Studies included: Databases searches in July 2011 and January 2012 generated 4911 abstracts. 411 additional abstracts were identified using other sources. After removing duplicates 2848 abstracts remained. Examining Légaré’s review of interventions to implement shared decision making [2] did not lead to further study inclusion. After independent review by IS, CT and GE, 51 studies were retained for further discussion by two raters (IS and GE). After examining full-text articles, 17 were retained for data extraction, see flow diagram in Figure 1. A total of 34 studies were excluded at this stage. Further details of the studies excluded are provided in Table 2. Overview of studies: The studies are summarized in Table 3 and Table 4. The majority of studies included used mixed methods (n=11). Three studies used qualitative methods [23][24][25], and three relied on quantitative methods [26][27][28]. Eleven studies were based in the USA and two in the UK. Four were based in call-centers (three in Canada[29][30][27] and one in Australia [31]) and two in the UK [32] [23]. Implementation was studied in both primary and secondary care settings, often involving multiple professions. Decision support for ‘screening’ tests was mostly based in primary care or in internal medicine organizations. Clinical topics were varied, with several studies on breast and prostate cancer. Notwithstanding their common focus, there was significant diversity in both approach and evaluation. Eight of the 17 studies had been supported by the then Foundation for Informed Medical Decision Making. Conceptual frameworks: Of the 17 studies, few describe an explicit implementation framework as the basis of their evaluations. Stacey cites the Ottawa model of research use in four similar studies [29][30][27][31], a model based on knowledge translation [33]. Roger's 'theory of innovation diffusion' is cited by Feibelman [34]. Holmes-Rovner [35] and Belkora [36], use a logic model as the basis for their evaluations. Implementation strategies: Of the 17 studies, six were based on recruiting organizations at an institutional level and eight at a microsystem (team or department) level. Evaluation was often based on counts of the number of DESIs given to patients and counts of patient use based on follow-up surveys. Studies in nurse-led call-centers used training events and simulated patient callers to assess professional willingness to use patient DESIs. Almost all of the studies used a ‘referral’ model of DESI implementation, where patients were either sent the DESI by post and asked to view it, or were directed to use the DESI (at home or in clinic) by either the clinician or another member of the clinical team. Most studies reported difficulties in operationalizing the referral model. One study compared different methods of delivering DESIs to patients eligible for a preventive-type decision (e.g. colorectal cancer screening) [26]. The authors found that systematic automated delivery was most efficient in reaching the greatest number of eligible patients, although it led to 20% of patients being inappropriately offered the interventions [26]. Irrespective of delivery mode, the patient viewing rate was estimated to be 25% of those sent out [26]. Belkora’s approach of getting pre-medical students to coach patients to list questions and use DESIs ahead of clinical encounters is a variant of the referral method, and relies on the identification of eligible patients ahead of encounters with clinicians [37][36]. All methods required organizational commitment. Only one study reported implementation costs, using estimates of the staff time used to identify patients [28]. The existence of barriers: The dominant theme in a majority of the studies was the existence of barriers to efficient delivery. Stacey [31], Feibelman 2011 [34] and Frosch [24] reported professionals’ attitudes and their call for more training in how to use decision support and undertake SDM [29][30][27][31]. There are also reports that clinicians may not trust or agree with the content of DESIs [38][23][34]. Some professionals were reported to hold the view that patients did not want decisional responsibility when facing difficult diagnoses [39] and that DESIs were in 'competition' with other information designed for patients, suggesting that the intended aim of the DESIs, (i.e. to support patients in engaging in decisions), was not always understood [23][30][34]. Studies also reported that clinicians did not view the task of referring patients to use DESIs as part of their role, often citing competing demands and time pressure as the main reason why they could not incorporate this task into their usual care [38][23][40][39][30][37][26][36][34][24]. As Bracket reports, when clinicians were responsible for identifying patients, distribution of DESIs failed because they were ‘distracted by other duties’ [26]. Frosch [24] and Uy [25] describe two such studies, characterized essentially by implementation failure, particularly in organizations where team work was poor. One study illustrated this disinterest by using a modest financial incentive to encourage DESI distribution to patients; although effective while in operation, this strategy had no lasting impact as distribution ceased completely once the incentive ceiling had been met [25]. The studies demonstrate significant gaps between those patients who were deemed eligible, those who are successfully provided with the tools and those who made use of them [38][40][39][26][34][28]. Patient-level measures were, for the most part, not reported and were not the focus of this review. To overcome the problem of competing demands and low prioritization, system-based approaches were tested and found to be more successful [26][37][36][28]. However, system-based approaches rely on clinical problems where patients can be identified ahead of visits to the clinic. In situations where patients can potentially be identified ahead of clinic visits, logistical problems were reported. Mailing DESIs to patients will only be effective if patients use them. Brackett reported viewing rates of 25% [26], and, in a referral model, Uy reports 37% [25]. Inviting patients to view the DESIs in-clinic prior to a visit requires space, equipment and a well-organized scheduling system. All require organizational commitment. Call-center settings also report organizational tension, notably a concern that call-handling efficiency might be disrupted by the adoption of decision support protocols [31]. Facilitators: Some studies report factors that facilitated the use of DESIs. The provision of training and skills development [29][30][35] and the identification of a clinical champion, especially in a leadership position, were important positive factors [40][25]. However, the most often cited predictor of success was the introduction of a system where eligible patients were systematically identified [40][26], or supported to use DESIs ahead of relevant clinical consultations [37][36]. In other words, methods of distribution that did not to rely on clinicians to initiate access to these tools proved to be the most effective by far. Levels of implementation achieved: The levels of DESI adoption achieved were generally framed by the studies as being ‘less than expected’. However, the studies did not explicitly report whether or not sustained use of DESIs had been achieved although testing ‘feasibility’ was often the primary aim and reported early stages in learning about the potential use of these tools. Nevertheless, the implicit goal in most studies was to encourage the adoption of patient DESIs and so it remains of interest to assess the outcomes using an implementation model (Table 1). We do acknowledge that lack of detail and data made it difficult to assess the 'degree of implementation' achieved (see Table 4). Judged against the implementation model, 10 of the 17 studies were categorized as achieving 'insight' (see Table 4), 4 achieved a level of 'change' [26][36][34][28] and none of the studies indicated that organizations had been able to achieve 'maintenance' levels, where DESIs were in sustained use. This may be due to the barriers identified in the studies, which contributed to recruitment patterns that showed low interest in participation and in less-than-anticipated distribution of these interventions to patients.
Discussion
Principal findings
Despite the increasing interest in moving patient decision support from the world of randomized trials to that of routine settings, this review points to major implementation challenges. In contrast to the positive findings reported in trials [3], these studies paint a picture of professional indifference and organisational inertia. Many of the barriers are similar to those encountered in other attempts to improve practice performance, where other competing priorities take precedence and where uncertainty about the added value of the proposed intervention favors the status quo [41]. Note that the organizations in these studies were willing volunteers and so implementation might be even more difficult in other settings. Although many countries are considering shared decision making in their policy developments, most of the implementation work to date has been located in North America. Ten studies were based in the USA and three in Canada, an illustration that this work remains in the research domain [9]. The majority of the work was conducted with limited resources in comparison to research funded by mainstream sources, such as the National Institute for Health, and so in appraising these studies we need to recognize the constraints imposed by these limitations. The studies do however reveal issues that are specific to the challenge of implementing patient DESIs. Reliance on clinicians to refer patients to these tools leads to limited utilization, and so using system- based approaches, where feasible, reaches more patients. Unfortunately, system approaches rely on identifying eligible patients ahead of visits and this task is only possible for a limited number of conditions. Even when this is feasible, logistical and infrastructure challenges still impede integration into practice. When patients present with undifferentiated problems, identifying their decision support needs ahead of a visit may be impossible. This issue limits the scope for studies that adopt a referral model: most are based on clinical issues where prior identification is possible, e.g. invitations for screening and prevention. Yet, even in secondary care where it is often possible to predict the clinical decisions that will be needed, the process of ensuring patients use DESIs ahead of encounters is a challenge because the windows of opportunity are often short. Ultimately, the studies indicate that this degree of capital and logistical infrastructure is challenging to initiate and maintain and will require sustained investment [40][37][36][34][24][28]. These issues also make the limits of system-based approaches apparent and highlight the fact that referral by clinicians at the point of care will continue to be necessary for many clinical issues for which decision support is available. The included studies use a ‘referral model’ of DESI dissemination whereby practitioners or their support staff identified patients eligible for decision support. The referral model proposes that these tools are ‘adjuncts’ that support shared decision making, when used ahead of visits, or shortly afterwards [42]. However, the concept that these tools are positively viewed as ‘adjuncts’ by clinicians does not seem to be supported in practice. Many of the studies report that professionals distrust the content of the tools, question their evidence-base, believe that they do not reflect ‘local’ data, think that patients will decline to take part in decisions and, critically, that offering options is not what they would advocate from a ‘best practice’ perspective. These findings suggest that the reluctance to prioritize the use of DESIs might lie deeper than a general resistance to change. The referral model might be based on assumptions about their contribution that is not shared by front-line clinicians [43], a suggestion we discuss further below. An alternative model where SDM is initiated by the practitioner in the space of clinical encounters, using briefer DESIs to catalyze dialogue about options, which in turn lead to the use of more extensive tools [44], does not seem to have been extensively investigated, although a few trials exist [45][46]. Although many barriers to implementation were described (see Table 4), these were seldom examined in depth, with the exception of three studies that employed qualitative interviews [23][24][25]. Additional insights might have been gained if more studies had explored the views of professionals regarding the use of DESIs and specifically about their impact on practice workflows.
Strengths and weaknesses of the study method
The search strategy was developed in consultation with an information scientist and piloted before application to multiple electronic databases. We deliberately excluded work from conference proceedings and non-peer reviewed material. The review does not attempt to pool the data from the studies nor assess their quality: we judged the methods and results to be too heterogeneous. The study team was experienced in the field and was familiar with the evidence-base. Dual independent review was accomplished at key stages of the review process. There was low inter-rater agreement on the first round of assessing implementation levels achievement and this required attention in a second round. The results were seldom organized in a way that assisted this assessment: more work is required to set clear criteria for assessing implementation attainment levels.
Relation to other literature
The challenge of implementing patient DESIs is already well documented [1] [2] and we also know that practitioners do not achieve shared decision making [47]. However, we must be careful not to equate the successful introduction of DESIs into clinical pathways as automatically leading to SDM. For instance, Frosch found that the use of a PSA DESI ahead of a clinical encounter led to less SDM if a patient was not in favor of screening [48]. While we can be confident that these interventions have positive results at the patient level [3], we do not as yet fully understand their impact on clinician-patient dialogue. Other models where practitioners might use brief tools and take more responsibility for initiating the process of shared decision making face-to-face with patients deserve further investigation. More use could have been made of developments in the evaluation of complex interventions [49], implementation and evaluation studies [50]. Realist evaluations provide a way to study why interventions that have good effect in some settings fail when attempts are made to introduce them in other clinical settings: context matters [51]. Many opportunities exist to bring these worlds of inquiry to bear on how best to implement patient DESIs. Damschroder et al provided a consolidated framework for advancing implementation science [50]: a synthesis of 19 models that describes five domains, namely, intervention characteristics, outer setting, inner setting, characteristics of the individuals involved and the process of implementation. Future studies should consider the reported utility of these conceptual frameworks to guide implementation.
Conclusions
The goal for this review was to make recommendations about how best to implement patient targeted DESIs into practice. Having reviewed the existing studies, it seems too early for such recommendations. Perhaps the effort to implement was done too soon, ahead of any work done to achieve levels 1 and 2 of Grol’s model - ‘orientation’ and ‘insight’ - in the recruited organizations. Without these first steps, it is unlikely that level 3, 'acceptance', would have occurred, and so the motivation to use patient DESIs might have been absent. Although it would not be difficult for us to suggest general principles of successful adoption [52], we feel that it might be more helpful to emphasize that the specific underlying issues that militate against the use of patient DESIs and, more generally, limit the adoption of shared decision making, are under-investigated and under-specified. However, we do have two substantive research recommendations. It would be helpful to have a framework for reporting these studies, based on the SQUIRE guidelines [53], adapted to cover the reporting of the patient identification processes, the numbers of patients eligible for specific DESIs (initial denominator), the inevitable attrition in numbers along the delivery pathway, the delivery mechanism, the evaluation of use by the patient and the impact on decision outcomes (process and quality). In addition, approaches not previously used in this field should be considered as a means to investigate and measure the challenges of implementing new delivery-systems [54]. For instance, methods such as cognitive task analysis, ethnography and action research, tools to assess the ‘adaptive reserve’ of teams [55] or their ‘readiness for change’ [56], are approaches that would pay more attention to the role of the participants in shaping and using the technologies [57], and how they fit into the demands of other technologies, such as the electronic medical record and demands for performance metrics. Amidst all of this will be the need to monitor which professional and team-related behaviors will be rewarded as health systems increasingly seek to ensure patients experience better quality of care [58]. As a final comment, we need to acknowledge that all the existing studies operated in a policy context where no rewards or incentives existed to promote the use of patient decision support and were being done in parallel in a period where considerable resources were being invested in the adoption of electronic health care records. Acknowledgements: We thank Alice Andrews and Dawn Carey of the Dartmouth Center for Healthcare Delivery Science for their comments on a draft of this manuscript, and to Professors Hilary Llewellyn- Thomas and Robert Volk, IPDAS Update Coordinators for their guidance. Funding: No direct funding was received from any source to support this review. Declarations of competing interests: Glyn Elwyn, Dominick Frosch and Carmen Lewis have received research funding from the Informed Medical Decision Making Foundation, a not-for-profit (501(c3)) private foundation. Glyn Elwyn and Dominick Frosch have received travel support and honoraria from the same Foundation and Richard Wexler receives salary as a Director from this Foundation. The Informed Medical Decision Making Foundation develops content for patient decision support and has a royalty arrangement with a for-profit company, Health Dialog. The tools are used as part of the services Health Dialog provides to consumers through health care organizations and employers. Adrian Edwards, France Légaré, Trudy van der Weijden, Mala Mann, Isabelle Scholl, Caroline Tietbohl declare no conflicts of interest. Authors' Contributions: GE and DF designed the review, with support from MM, IS and AE. GE, DF, IS, CT and MM were responsible for the search, selection and extraction processes. All other authors contributed to the review protocol and the coordination of the work. All authors read, contributed and approved the final manuscript. Acknowledgements: We thank Alice Andrews and Dawn Carey of the Dartmouth Center for Healthcare Delivery Science for their comments on a draft of this manuscript, and to Professors Hilary Llewellyn- Thomas and Robert Volk, IPDAS Update Coordinators for their guidance. [1] K. Gravel, F. Légaré, and I. Graham, "Barriers and facilitators to implementing shared decision- making in clinical practice: a systematic review of health professionals' perceptions," Implementation Science, vol. 1, p. 16, 2006. [2] F. Légaré et al., "Interventions for improving the adoption of shared decision making by healthcare professionals.,” Cochrane Database of Systematic Reviews, no. 5, p. CD006732, Jan. 2010. [3] D. Stacey et al., "Decision aids for people facing health treatment or screening decisions," Cochrane Database of Systematic Reviews , no. 10, p. CD001431, 2011. [4] Senate and House of Representatives, "Patient Protection and Affordable Care Act. HR 3590," Washington, 2010. [5] Washington State Legislature, "Washington State Legislature. RCW 41.05.033. Shared decision- making demonstration project — Preference-sensitive care," 2007. [6] Department of Health, “Equity and excellence: liberating the NHS,” London, 2010. [7] G. Elwyn, A. Coulter, S. Laitner, E. Walker, P. Watson, and R. Thomson, "Implementing shared decision making in the NHS.," BMJ, vol. 341, p. c5146, Jan. 2010. [8] F. Légaré, D. Stacey, P.-G. Forest, and M.-F. Coutu, "Moving SDM forward in Canada: milestones, public involvement, and barriers that remain,” German Journal for Evidence and Quality in Health Care, vol. 105, pp. 245-253, 2011. [9] M. Härter, T. van der Weijden, and G. Elwyn, “Policy and practice developments in the implementation of shared decision making: an international perspective.," Zeitschrift für Evidenz Fortbildung und Qualität im Gesundheitswesen, vol. 105, no. 4, pp. 229-33, Jan. 2011. [10] Informed Medical Decisions Foundation, "Research and Implementation Report," Boston, Massachusetts, 2011. [11] The Dartmouth Institute, “Improving Value-Based Care and Outcomes of Clinical Populations in an Electronic Health Record System Environment. Technical Report," Hanover, New Hampshire, 2011. [12] C. Hsu, D. Liss, E. Westbroo, and D. Arterburn, "Incorporating Patient Decision Aids into Standard Clinical Practice in an Integrated Delivery System. Medical Decision Making,” Medical Decision Making, vol. In Press, 2012. [13] Group Health, "Helping You Make Health Care Decisions Anytime, Anywhere," http://www.ghc.org/features/feature.jhtml?reposid=/common/features/story/20120101- messageFromScott.jhtml (accessed 24 March 2012), 2012. [14] G. Elwyn, F. Légaré, T. V. D. Weijden, A. Edwards, C. May, and T. van Der Weijden, "Arduous implementation: does the Normalisation Process Model explain why it's so difficult to embed decision support technologies for patients in routine clinical practice," Implementation Science, vol. 3, no. 1, p. 57, Jan. 2008. [15] G. Elwyn et al., “Developing a quality criteria framework for patient decision aids: online international Delphi consensus process," BMJ, vol. 333, no. 7565, p. 417, Aug. 2006. [16] G. Elwyn et al., “Assessing the quality of decision support technologies using the International Patient Decision Aid Standards instrument (IPDASi),” PLoS One, vol. 4, no. 3, p. e4705, Jan. 2009. [17] P. J. Pronovost and C. A. Goeschel, "Time to take health delivery research seriously.," JAMA, vol. 306, no. 3, pp. 310-1, Jul. 2011. [18] B. A. Rabin, R. C. Brownson, D. Haire-Joshu, M. W. Kreuter, and N. L. Weaver, “A glossary for dissemination and implementation research in health.,” Journal of Public Health Management and Practice, vol. 14, no. 2, pp. 117-23. [19] K. Klein and J. Sorra, “The challenge of innovation implementation,” Academy of Management Review, vol. 21, pp. 1055-1080, 1996. [20] G. Elwyn, D. Frosch, A. E. Volandes, A. Edwards, and V. M. Montori, "Investing in Deliberation: A Definition and Classification of Decision Support Interventions for People Facing Difficult Health Decisions.," Medical Decision Making, vol. 30, no. 6, pp. 701-11, Nov. 2010. [21] R. Grol and M. Wensing, "What drives change? Barriers to and incentives for achieving evidence- based practice.," The Medical Journal of Australia , vol. 180, no. 6 Suppl, pp. S57-60, Mar. 2004. [22] R. P. T. M. Grol, M. C. Bosch, M. E. J. L. Hulscher, M. P. Eccles, and M. Wensing, “Planning and studying improvement in patient care: the use of theoretical perspectives.,” The Milbank Quarterly, vol. 85, no. 1, pp. 93-138, Jan. 2007. [23] H. Stapleton, M. Kirkham, and G. Thomas, “Qualitative study of evidence based leaflets in maternity care,” BMJ, vol. 324, no. 7338, p. 639, 2002. [24] D. L. Frosch, K. J. Singer, and S. Timmermans, "Conducting implementation research in community-based primary care: a qualitative study on integrating patient decision support interventions for cancer screening into routine practice," Health Expectations , vol. 14, pp. 73-84, 2011. [25] V. Uy, S. G. May, C. Tietbohl, and D. L. Frosch, “Barriers and facilitators to routine distribution of patient decision support interventions: a preliminary study in community-based primary care settings.," Health Expectations, vol. VOL/, pp. 1-12, Jan. 2012. [26] C. Brackett, S. Kearing, N. Cochran, A. Tosteson, and W. Blair Brooks, "Strategies for distributing cancer screening decision aids in primary care," Patient Education and Counseling, vol. 78, pp. 155-16, 2010. [27] D. Stacey, A. M. O’Connor, I. D. Graham, and M. P. Pomey, “Randomized controlled trial of the effectiveness of an intervention to implement evidence-based patient decision support in a nursing call centre," vol. 12, no. 8, pp. 410-415, 2006. [28] K. M. Miller, A. Brenner, J. M. Griffith, M. P. Pignone, and C. L. Lewis, "Promoting decision aid use in primary care using a staff member for delivery.,” Patient Education and Counseling, vol. Epub ahead, Jun. 2011. [29] D. Stacey, I. Graham, A. O’Connor, and M. Pomey, “Barriers and facilitators influencing call center nurses' decision support for callers facing values-sensitive decisions: a mixed methods study," Worldviews Evid Based Nurs, vol. 2, no. 4, pp. 184-195, Jan. 2005. [30] D. Stacey, M. Pomey, A. O'Connor, and I. Graham, "Adoption and sustainability of decision support for patients facing health decisions: an implementation case study in nursing," Implementation Science, vol. 1, p. 17, 2006. [31] D. Stacey, S. K. Chambers, M. J. Jacobsen, and J. Dunn, “Professionals Providing Decision Support for Callers : An Implementation Study," Oncology Nursing Forum, vol. 35, no. 6, pp. 961-969, 2008. [32] J. Garden, “Implementing an informed decision making programme for urology patients,” Journal of Communication in Healthcare , vol. 1, no. 3, pp. 297-310, 2008. [33] Graham ID et al., "A qualitative study of physicians' perceptions of three decision aids," Patient Educ Couns, vol. 2055, pp. 1-5, 2003. [34] S. Feibelmann, T. S. Yang, E. E. Uzogara, and K. Sepucha, "What does it take to have sustained use of decision aids? A programme evaluation for the Breast Cancer Initiative.," Health Expectations, vol. 14 Suppl 1, pp. 85-95, Mar. 2011. [35] M. Holmes-Rovner et al., "Shared Decision Making Guidance Reminders in Practice (SDM-GRIP)," Patient Education and Counseling, vol. 85, pp. 219-24, Jan. 2011. [36] J. K. Belkora, A. Teng, S. Volz, M. K. Loth, and L. J. Esserman, “Expanding the reach of decision and communication aids in a breast care center: A quality improvement study.,” Patient Education and Counseling, vol. 83, no. 2, pp. 234-239, Aug. 2011. [37] J. K. Belkora, M. K. Loth, S. Volz, and H. S. Rugo, "Implementing decision and communication aids to facilitate patient-centered care in breast cancer: a case study.,” Patient Education and Counseling, vol. 77, no. 3, pp. 360-8, Dec. 2009. [38] M. V. Holmes-Rovner, D. Valade, C. Orlowski, C. Draus, B. Nabozny-Valerio, and S. Keiser, “Implementing shared decision-making in routine practice: Barriers and opportunities,” Health Expectations, vol. 3, no. 3, pp. 182-191, 2000. [39] K. Silvia, E. Ozanne, and K. Sepucha, “Implementing breast cancer decision aids in community sites: barriers and resources," Health Expectations , vol. 11, no. 1, pp. 46-53, Mar. 2008. [40] K. A. Silvia and K. R. Sepucha, “Decision aids in routine practice: lessons from the breast cancer initiative," Health Expectations, vol. 9, no. 3, pp. 255-264, Sep. 2006. [41] M. D. Cabana et al., "Why don't physicians follow clinical practice guidelines? A framework for improvement.," JAMA, vol. 282, no. 15, pp. 1458-65, Oct. 1999. [42] A. O'Connor et al., "Toward the 'tipping point': decision aids and informed patient choice.," Health Affairs, vol. 26, no. 3, pp. 716-25, 2007. [43] L. J. M. Caldon et al., "Clinicians' concerns about decision support interventions for patients facing breast cancer surgery options: understanding the challenge of implementing shared decision-making.," Health Expectations, vol. 14, no. 2, pp. 133-146, 2010. [44] G. Elwyn et al., “How to do shared decision making: a model for clinical practice,” JGIM, vol. In Press, 2012. [45] A. Edwards et al., "Patient-based outcome results from a cluster randomized trial of shared decision making skill development and use of risk communication aids in general practice.," Family Practice, vol. 21, no. 4, pp. 347-54, Aug. 2004. [46] D. M. Mann, D. Ponieman, V. M. Montori, J. Arciniega, and T. McGinn, "The Statin Choice decision aid in primary care: a randomized trial.," Potient Education and Counseling, vol. 80, no. 1, pp. 138-40, Jul. 2010. [47] N. Couët et al., “Using OPTION to assess the level to which health professionals involve patients in decision-making: A systematic review," In review, 2012. [48] Frosch DL, Legare F, and Mangione CM, "Using decision aids in community-based primary care: An evaluation with ethnically diverse patients," Patient Educ Couns, vol. In Press, 2008. [49] N. C. Campbell et al., "Designing and evaluating complex interventions to improve health care," BMJ, vol. 334, no. 7591, p. 455, 2007. [50] L. J. Damschroder, D. C. Aron, R. E. Keith, S. R. Kirsh, J. A. Alexander, and J. C. Lowery, "Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science.," Implementation Science , vol. 4, p. 50, Jan. 2009. [51] P. R, T. N, Pawson R, and Tilley N, Realistic Evaluation . London: Sage Publicaitons, 1997. [52] T. Greenhalgh et al., “Diffusion of innovations in service organizations: systematic review and recommendations," Millbank Quarterly, vol. 82, pp. 581-629, 2004. [53] F. Davidoff, P. Batalden, D. Stevens, G. Ogrinc, and S. E. Mooney, “Publication guidelines for quality improvement studies in health care: evolution of the SQUIRE project.," BMJ, vol. 338, p. a3152, Jan. 2009. [54] J. A. Alexander and L. R. Hearld, "Methods and metrics challenges of delivery-system research.," Implementation Science, vol. 7, no. 1, p. 15, Mar. 2012. [55] P. A. Nutting, B. F. Crabtree, W. L. Miller, K. C. Stange, E. Stewart, and C. Jaén, "Transforming physician practices to patient-centered medical homes: lessons from the national demonstration project.," Health faiAfrs , vol. 30, no. 3, pp. 439-45, Mar. 2011. [56] B. J. Weiner, H. Amick, and S.-Y. D. Lee, "Conceptualization and measurement of organizational readiness for change: a review of the literature in health services research and other fields.," Medical Care Research and Review, vol. 65, no. 4, pp. 379-436, Aug. 2008. [57] T. Greenhalgh and S. Wieringa, “Is it time to drop the ‘knowledge translation’ metaphor? A critical literature review.," Journal of the Royal Society of Medicine , vol. 104, no. 12, pp. 501-9, Dec. 2011. [58] National Institute for Health and Clinical Excellence, “Quality standard for patient experience in adult NHS services. 2012. www.nice.org.uk/guidance/qualitystandards/patientexperience/ home.jsp.," 2012. [59] J. K. Belkora, M. K. Loth, D. F. Chen, J. Y. Chen, S. Volz, and L. J. Esserman, “Monitoring the implementation of Consultation Planning, Recording, and Summarizing in a breast care center.," Patient Education and Counseling, vol. 73, no. 3, pp. 536-43, Dec. 2008. [60] J. A. Kotecha and R. V. Birtwhistle, "Use of electronic medical records," Canadian Family Physician, vol. 55, no. 9, p. 899, Sep. 2009. [61] V. Bhavnani and B. Fisher, “Patient factors in the implementation of decision aids in general practice: a qualitative study," Health Expectations , vol. 13, no. 1, pp. 45-54, 2010. [62] C. Charles, A. Gafni, and T. Whelan, “Self-reported use of shared decision-making among breast cancer specialists and perceived barriers and facilitators to implementing this approach,” Health Expectations, vol. 7, no. 4, pp. 338–348, 2004. [63] D. Doran et al., "Integrating evidence-based interventions into client care plans," Stud Health Technol Inform., vol. 143, pp. 9-13, 2009. [64] D. L. Frosch, C. M. Mangione, and F. Légaré, "Using decision aids in community-based primary care: a theory-driven evaluation with ethnically diverse patients.,” Patient Education and Counseling, vol. 73, no. 3, pp. 490-6, Dec. 2008. [65] I. D. Graham et al., “Physicians’ intentions and use of three patient decision aids,” BMC Medical Informatics and Decision Making, vol. 7, p. 20, 2007. [66] J. Hamann, R. Cohen, S. Leucht, R. Busch, and W. Kissling, “Shared decision making and long-term outcome in schizophrenia treatment,” The Journal of Clinical Psychiatry, vol. 68, no. 7, pp. 992- 997, 2007. [67] C. L. Lewis, A. T. Brenner, J. M. Griffith, and M. P. Pignone, "The uptake and effect of a mailed multi-modal colon cancer screening intervention: a pilot controlled trial.," Implementation Science, vol. 3, p. 32, Jan. 2008. [68] H. C. Ossebaard, J. E. W. C. van Gemert-Pijnen, M. J. Sorbi, and E. R. Seydel, “A study of a Dutch online decision aid for parents of children with ADHD,” Journal of Telemedicine and Telecare , vol. 16, no. 1, pp. 15-19, Jan. 2009. [69] D. Stacey, K. A. S. Higuchi, P. Menard, B. Davies, I. D. Graham, and A. M. O'Connor, "Integrating patient decision support in an undergraduate nursing curriculum: An implementation project," vol. 6, no. 1, 2009. [70] D. Stacey, A. M. O'Connor, C. DeGrasse, and S. Verma, "Development and evaluation of a breast cancer prevention decision aid for higher-risk women,” Health Expectations , vol. 6, no. 1, pp. 3- 18, Mar. 2003. [71] J. Thistlethwaite, C. Heal, R. N. Tie, and R. Evans, “Shared decision making between registrars and patients - Web based decision aids," Australian Family Physician, vol. 36, no. 8, pp. 670-672, Aug. 2007. [72] A. Towle, W. Godolphin, G. Grams, and A. LaMarre, "Putting informed and shared decision making into practice," Health Expectations , vol. 9, no. 4, pp. 321-332, Dec. 2006. [73] D. B. Watson, R. G. Thomson, and M. J. Murtagh, “Professional centred shared decision making: patient decision aids in practice in primary care,” BMC Health Services Research, vol. 8, p. 5, 2008. [74] O. Hirsch, H. Keller, T. Krones, and N. Donner-Banzhoff, “Acceptance of shared decision making with reference to an electronic library of decision aids (arriba-lib) and its association to decision making in patients. An evaluation study.," Implementation Science, vol. 6, no. 1, p. 70, Jul. 2011. [75] J. Billings, “Promoting the dissemination of decision aids: an odyssey in a dysfunctional health care financing system," Health Affairs, vol. Suppl Web, p. VAR128-VAR132, Jan. 2004. [76] J. Demilew, “Integrating MIDIRS ‘Informed Choice’ leaflets into a maternity service,” in Informed Choice in Maternity Care, M. Kirkahm, Ed. Basingstoke: Palgrave Macmillan, 2004. [77] M. Holmes-Rovner, J. Gruman, and D. R. Rovner, “Shared decision-making in the US--research & development outpaces delivery," Zeitschrift für ärztliche Fortbildung und Qualitätssicherung, vol. 101, no. 4, pp. 254-258, Jan. 2007. [78] L. Lenert, "Transforming healthcare through patient empowerment.," Studies in Health Technology and Informatics, vol. 153, pp. 159-75, Jan. 2010. [79] C. L. Lewis, M. P. Pignone, C. L. Lewis, and M. P. Pignone, "Promoting informed decision-making in a primary care practice by implementing decision aids," NC Med J, vol. 70, no. 2, pp. 136-139, 2009. [80] F. Légaré, "Establishing patient decision aids in primary care: update on the knowledge base," vol. 102, no. 7, pp. 427-430, 2008. [81] K. McCaffery, L. Irwig, and P. Bossuyt, "Patient decision aids to support clinical decision making: evaluating the decision or the outcomes of the decision," Medical Decision Making, vol. 27, no. 5, pp. 619-625, 2007. [82] A. O’Connor, I. Graham, and A. Visser, “Implementing shared decision making in diverse health care systems: the role of patient decision aids.," Patient Education and Counseling, vol. 57, no. 3, pp. 247-249, Jun. 2005. [83] M. P. Pignone and C. L. Lewis, “Using Quality Improvement Techniques to Increase Colon Cancer Screening," The American Journal of Medicine, vol. 122, no. 5, pp. 419-420, May 2009. [84] G. C. Scott and L. A. Lenert, “Extending contemporary decision support system designs to patient- oriented systems," vol. .. Annual , pp. 376-380, 1998. [85] K. Sepucha and A. G. Mulley, "A perspective on the patient's role in treatment decisions.," Medical Care Research and Review, vol. 66, no. 1, Suppl, p. 53S-74S, Feb. 2009. [86] K. Sepucha and A. Mulley, "Extending decision support: preparation and implementation," Patient Education and Counseling, vol. 50, no. 3, pp. 269–271, Jul. 2003. [87] M. Simmons, S. Hetrick, and A. Jorm, "Shared decision-making: benefits, barriers and current opportunities for application.," Australasian Psychiatry , vol. 18, no. 5, pp. 394-7, Oct. 2010. [88] K. Y. Wen et al., "Developing and validating a model to predict the success of an IHCS implementation: the Readiness for Implementation Model," vol. 17, no. 6, pp. 707-713, 2010. [89] E. Wirrmann and J. Askham, "Implementing patient decision aids in urology," Oxford, 2006. [90] K. L. Vandemheen, S. D. Aaron, C. Poirier, E. Tullis, and A. O'Connor, "Development of a decision aid for adult cystic fibrosis patients considering referral for lung transplantation.,” Progress in Transplantation , vol. 20, no. 1, pp. 81-7, Mar. 2010.
Table 4
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 exp Decision Making/ (95638) exp Patient Participation/ (14669) (share* adj decision adj mak*).ti,ab. (1164) (decis* adj mak*).mp. (97836) (decis* adj choic*).tw. (42) shared decision making.mp. (1142) (patient adj3 decision making).tw. (1211) or/1-7 (146942) exp Decision Support Techniques/ (46924) exp Decision Support Systems, Clinical/ (3461) decision making techniques.tw. (36) decision support method*.tw. (34) (decision adj3 aids).tw. (592) decision support intervention*.tw. (48) decision making strat*.tw. (224) decision making approach*.tw. (110) or/9-16 (50838) exp Organizational Culture/ (10369) (embed* or set in or rooted).tw. (65537) (integrat* adj3 organi?ational).tw. (159) "put into practice".tw. (544) (routine adj3 (care or practice)).mp. (11645) organi?ational system.mp. (89) (apply or application or utili?e or utili?ation or usage).tw. (544512) (disseminat* or implement*).mp. (228214) or/18-25 (832290) (implement* adj3 patient decision*).mp. (11) (implement* adj3 decision aid*).mp. (27) (appl* adj3 decision aid*).mp. (12) (utili?* adj3 decision aid*).mp. (5) or/27-30 (48) 8 and 17 and 26 (1259) 32 33 31 or 32 (1279)