Title: Assessment of the Impact of the NIHR Health Technology Assessment Programme
Funder: Department of Health (England)

Abstract: The aim of this study is to assess the impact of the NIHR HTA Programme during the period 2003 to 2013 including the health and economic impact of the programme and other impacts on policy practice and research. Though largely retrospective we believe it is important that the study includes a forward-looking component considering how the HTA can develop its impact based on the evidence found. The Commissioning Brief suggests a case study approach. We see this as the core of this study but propose a wider approach. By looking at the impacts of the programme as a whole as well as specific case study examples we hope to be able to give a more complete picture of the impact of the HTA programme. Therefore we identify three key study questions:1.What broad impacts on policy practice health research the economy and society more widely have resulted from the HTA programme as a whole over the period 2003-2013?2.What is the impact on policy practice health research the economy and society more widely of the HTA programme at a project level looking at a sample of projects over the period 2003-2013 in detail?3.What actions can the HTA programme take to help maximise its impact on policy practice health research the economy and society more widely in the future?We see this project as consisting of two main elements:1.Analysis of the impact of the HTA programme as a whole. This will include:a.Interviews with NIHR and wider organisations to understand the impact of the HTA programme on their practice. This will cover:i.‘Customers’ of HTA research ( e.g. NICE NSC) to understand how the programme supports their work and the impact it has overallii.Other research funders (e.g. MRC Wellcome Trust) to understand the impact the HTA programme has on them for example as an exemplar of best practice in requiring that systematic reviews should be conducted before a new clinical trial is funded. b.Bibliometric analysis of the HTA programme including:i.Academic impact of the studies published through the HTA programme using citation analysisii.Analysis of citations of HTA work on clinical guidelines to investigate impact on policy and practicec.An online survey of PIs based on the survey used by RAND Europe to help universities identify their impact for the REF 2014. 2.Analysis of the impact of a sample of HTA projects through detailed case studies. These will be based on the payback framework but with the range of impacts captured expanded to include wider societal benefits drawing on the impact categories used in the REF 2014. We propose to conduct twelve case studies. However we also include a unit price per case study for additional case studies if required.RAND Europe has conducted several large scale projects based on payback case studies and is internationally renowned as a centre of expertise in understanding the wider impacts of research. For this work we have a team with significant expertise in health and biomedical research strategy and evaluation; in-depth knowledge of international approaches to research impact evaluation particularly the REF; and extensive experience in relevant research methods notably payback case studies. This project would commence in April 2014 and would be completed by the end of April 2015 including submission of a final report for publication in the HTA journal. A short report aimed at policy makers and research funders will also be produced.


Research activity codes: 8.4 RESEARCH DESIGN AND METHODOLOGIES (HEALTH SERVICES)
Health categories: GENERIC HEALTH RELEVANCE