Title: Effective methods of data collection by post and electronically – an updated and expanded review of the evidence
Funder: Department of Health and Social Care

Abstract: Questionnaires are an inexpensive and efficient way to gather information from patients and the public. They are frequently used in healthcare research, health services management and for other purposes, and might be administered by postal or electronic methods. However, if some people do not reply to the questionnaire, doubts can be raised about the reliability of the data that are collected. Therefore, it is important to identify effective ways to encourage as many people as possible to respond. One of the most important systematic reviews of this topic, containing more than 500 research studies is the Cochrane Methodology Review of methods to increase response to questionnaires. This was first published in 2003 and updated in 2009. It continues to be very widely used by people but is need of further updating to ensure that its findings are as robust, reliable and current as possible. This is especially important now because the COVID-19 pandemic and its associated measures have led to increased reliance on information that is collected remotely and we need to ensure that such information is accurate and complete. The project will not only update the overall findings of the review and apply the current high standards for Cochrane Reviews in this process, it will also include in-depth statistical analysis of specific methods to encourage response, including shorter questionnaires, use of monetary incentives and various forms of personalisation.

Lay abstract: Research question: What are effective methods of collecting data by post and electronically?_x000D_ Background: Questionnaires are an inexpensive and efficient way to gather information from patients and the public. They are frequently used in healthcare research and management. However, non-response can be a major issue. Therefore, it is important to identify effective ways to encourage people to respond. A key systematic review of this topic, containing more than 500 research studies, is the Cochrane Methodology Review of methods to increase response to questionnaires. First published in 2003, and updated in 2009, it continues to be widely used but needs further updating to ensure that its findings are robust, reliable and current. The COVID-19 pandemic has highlighted the importance of remote methods for collecting data. _x000D_ Aims and objectives:_x000D_ • Update the Cochrane Methodology Review including assessments of the risk of bias and Summary of Findings tables;_x000D_ • Use meta-analysis and meta-regression to determine the impacts of questionnaire length, financial incentives and personalisation;_x000D_ • Prepare an updated report and submit papers to high-impact journals highlighting key changes to results, placing findings in the context of modern data collection methods and the COVID-19 pandemic; _x000D_ • Publish Summary of Findings for NHS Providers via YouTube Channel video, online resource-Library and in NIHR Evidence._x000D_ Methods: We will update searches for eligible studies of all randomised or quasi-randomised trials of methods designed to increase response to a postal or electronic questionnaire that seeks information from a member of the public (whether or not this is in relation to a health condition). We define ‘Postal’ as postal-service or hand delivery to a home or work address, and ‘Electronic’ as delivery or administration by electronic means (e.g. email, SMS, mobile App, or Internet). Searches will be run on 14 electronic bibliographic databases and downloaded into a Covidence database. Two reviewers will independently screen records for potential eligibility and full text reports will be obtained and assessed independently for inclusion with review team discussion to resolve disagreements. Data will be extracted and entered into the Cochrane Review Manager software for analysis. The risk of bias will be assessed for each study using the modified Cochrane Collaboration tool to assess Risk of Bias and used when interpreting the results for the evidence synthesis. Summary of Findings tables will be added in the updated report using the GRADE (Grading of Recommendations Assessment, Development and Evaluation) approach. Meta-analysis and regression will quantify the effect on response of: each $0.01 increase in incentive given, personalisation of letters/emails or SMS invitations, and questionnaire length._x000D_ Timelines for delivery: The work programme comprises five work packages to be completed between August 2021 and July 2022._x000D_ Anticipated impact and dissemination: The review is used by healthcare practitioners and is one of the most highly cited Cochrane Reviews (>2200 citations including at least 16 NIHR HTA monographs.) An updated and expanded review is expected to attract interest from healthcare researchers and practitioners. Dissemination will include publishing: papers in journals, a Summary of Findings video for NHS Providers YouTube Channel, and Summary of Findings in the NHS Providers online resource-Library and in NIHR Evidence.

Research activity codes: 8.4 RESEARCH DESIGN AND METHODOLOGIES (HEALTH SERVICES)
Health categories: GENERIC HEALTH RELEVANCE