Transparent stakeholder engagement in practice: Lessons learned from applying comprehensive environmental assessment to research planning for nanomaterials
Authors: Powers Christina , Hendren Christine , Wang Amy , Davis J Michael 
Published: April 2014

Abstract
As efforts to develop new applications of engineered nanoscale materials (ENMs) continue to grow, so too has interest in the environmental, health, and safety (EHS) implications of these materials. However, thorough evaluation and interpretation of such implications could require substantial resources (e.g., estimated as &gt;$120 million per year in federal funding 2013–2017). A structured, strategic approach for transparently planning research would support improved linkages between ENM research and risk assessments, and thereby enhance the utility of financial and other resources for EHS studies of ENMs. For this reason, we applied Comprehensive Environmental Assessment (CEA) as an approach to provide transparent input into research planning for 2 types of ENMs: nanoscale titanium dioxide and nanoscale silver. For each of these CEA applications, we employed a collective judgment method known as Nominal Group Technique (NGT) in 2 workshops sponsored by the US Environmental Protection Agency (USEPA). The objective of this paper is to present the outcomes of these CEA applications in the context of how our methodology can inform future efforts to identify collective goals in science (e.g., research priorities) through structured decision support approaches. Outcomes include clear lists of research priorities for each ENM developed through transparently engaging stakeholders having diverse technical and sector perspectives. In addition, we identified several procedural aspects that could be refined, including emphasizing breakout group interactions, identifying broad information priorities before more detailed research questions, and using rating rather than ranking prioritization methods. Beyond the research directions identified for specific ENMs, lessons learned about engaging stakeholders in research planning are expected to inform future research planning efforts for ENMs and other emerging materials across the scientific community. Integr Environ Assess Manag 2014;10:498–510. © 2014 SETAC
Key Points
Research priorities for specific engineered nanomaterials were obtained using a Comprehensive Environmental Assessment (CEA) case-study approach that engaged stakeholders with diverse technical/organizational perspectives in a transparent collective judgment process known as Nominal Group Technique. Lists of research priorities for nanoscale titanium dioxide and nanoscale silver developed through the CEA approach are presented in the context of illustrating and examining the methodology employed, including two US EPA-sponsored workshops. Procedural refinements include: emphasizing breakout group interactions, identifying broad information priorities before deriving more detailed research questions, providing clear guidelines for research question development, and using rating rather than ranking prioritization methods. This work can help inform future research planning efforts using a structured decision-support approach not only for nanomateria