# The research burden of randomized controlled trial participation: a systematic thematic synthesis of qualitative evidence

Nivantha Naidoo, van Thu Nguyen, Philippe Ravaud, Bridget Young, Philippe Amiel, Daniel Schanté, Mike Clarke, Isabelle Boutron

► To cite this version:

Nivantha Naidoo, van Thu Nguyen, Philippe Ravaud, Bridget Young, Philippe Amiel, et al.. The research burden of randomized controlled trial participation: a systematic thematic synthesis of qualitative evidence. BMC Medicine, 2020, 18 (1), pp.6. 10.1186/s12916-019-1476-5. hal-02546706

HAL Id: hal-02546706

https://hal.science/hal-02546706v1

Submitted on 14 Oct 2024

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>
RESEARCH ARTICLE

Open Access

<figure><img src="image_2.png" /></figure>

Check for
updates

# The research burden of randomized controlled trial participation: a systematic thematic synthesis of qualitative evidence

Nivantha Naidoo¹,², Van Thu Nguyen¹,³, Philippe Ravaud¹,²,⁴, Bridget Young³, Philippe Amiel⁵, Daniel Schanté⁶,⁷, Mike Clarke⁸ and Isabelle Boutron¹,²*

**Abstract**

**Background:** Participation in randomized controlled trials (RCTs) may be quite demanding and could represent an important burden for patients. We aimed to explore this research burden (i.e., the psychological, physical, and financial burdens) experienced by patients through their participation in a RCT.

**Methods:** We conducted a systematic review of qualitative studies exploring adult patients' experiences with RCT participation. We searched MEDLINE (PubMed), CINAHL, PSYCHINFO, and Embase (search date March 2018) for eligible reports. Qualitative data coding and indexing were assisted by NVivo. The quality of reports was assessed by using the Critical Appraisal Skills Program (CASP) tool.

**Results:** We included 45 qualitative studies that involved 1732 RCT participants. Important psychological burdens were identified at every stage of the trial process. Participants reported feeling anxiety and being afraid of "being a 'guinea pig'" and described undergoing randomization and allocation to a placebo as particularly difficult resulting in disappointment, anger, and depression. Patients' follow-up and trial closure were also responsible for a wide range of psychological, physical, and financial burdens. Furthermore, factors related to burdensome impacts and consequences were discerned. These factors involved trial information, poorly organized and too-demanding follow-up, and lack of appropriate management when the patient's participation ended. Trial participation was also associated with beneficial effects such as the satisfaction of feeling "useful," gaining "a sense of control," and receiving special attention.

**Conclusions:** Our finding provides a detailed description of research burden across the whole RCT process. Many of the burdens described could be anticipated, and some avoided in a movement toward minimally disruptive clinical research. Such an approach could improve trial recruitment and retention.

**Review registration:** PROSPERO CRD42018098994

**Keywords:** Randomized controlled trials, Research burden, Trial participation

**Background**

Randomized controlled trials (RCTs), and the systematic reviews that they contribute to, are considered the gold standard in clinical interventional research [1]. However, RCT participation may be quite challenging. Patients who are already trying to manage burdens associated

with their illness and treatment could face additional burdens related to their trial participation. They may be required to travel, attend trial visits [2], undergo supplementary procedures (some of which may be invasive) [3], and complete trial questionnaires, among other demands that would not be necessary if they were not in a trial. All these tasks could be responsible for important psychological, physical, and financial burdens for patients, which may affect their willingness to begin and complete participation in a trial [4] and consequently have some implications for implementation science. However, despite

<footnote>* Correspondence: isabelle.boutron@aphp.fr
¹Université de Paris, CRESS, INSERM, INRA, F-75004 Paris, France
²Centre d'Epidémiologie Clinique, AP-HP, Hôpital Hôtel Dieu, F-75004 Paris, France
Full list of author information is available at the end of the article</footnote>
hundreds of thousands of RCTs, relatively few studies have considered the burden of research participation on patients within the context of the trial itself.

Qualitative studies embedded or associated with RCTs could help understand patients' experiences of RCT participation and the possible burdens encountered. To our knowledge, there are systematic reviews of qualitative studies to identify barriers and facilitators to recruitment and retention in RCTs [5-7]; however, no review yet has specifically explored patients' research burden.

This study aimed to explore research burdens and benefits of adult patients' participation in RCTs. This should allow the subsequent improvement of research planning and conduct.

In the context of this study, we defined “research burden” as encompassing the psychological, physical, and financial burdens to patients because of their participation in an RCT. We also defined patients as people with an illness.

# Methods

## Study design

We performed a systematic review and synthesis of qualitative research. We used thematic synthesis methods outlined by Thomas and Harden [8] and guidelines from the Cochrane Qualitative Methods Group [9]. We used an interpretative approach to go beyond the content of the original studies to develop analytical themes encompassing research burden. To ensure transparency, we adhered to the reporting guidelines set out by PRISMA [10] and ENTREQ (Additional file 1) [11].

## Search strategy

A preplanned search strategy was developed and structured around our research objective (Additional file 1) [12–16]. We searched MEDLINE (PubMed), CINAHL, PSYCHINFO, and Embase to identify qualitative studies including RCT participants to explore participants' experiences. We also searched Google Scholar and retrieved all studies that cited each of 3 pre-specified “seed” publications [3, 17, 18]. All searches were performed in March 2018.

For each qualitative study, we systematically searched for the embedded or associated trial using the reference when available. When no data were available, we contacted the authors of the qualitative study.

## Screening

Inclusion criteria: We included all English-language reports of qualitative studies of patient participants of RCTs that explored their perspectives and experiences. We defined a qualitative study as having used or reported using qualitative methods for qualitative data collection and analysis. We also included studies using mixed methods if a clearly identifiable qualitative component was present.

We defined an RCT as a study in which participants were randomly allocated to receive an intervention or a control.

Exclusion criteria: We excluded qualitative studies focusing on RCTs that included only children as well as RCTs that included only participants who had decreased decisional capacity or who required a proxy to consent to participate in the RCT. We also excluded qualitative studies of participants in screening trials, prevention trials, or only early-phase clinical trials as they may raise specific issues. Studies with mixed populations (e.g., patients and carers) were included, but only data related to patients were recorded. We also excluded studies including only potential participants or people who declined to join an RCT. Studies with both decliners and consenters were included, but only data related to consenters were recorded.

One review author (NN) independently screened all retrieved citations assisted by Covidence software. Full texts of eligible reports were retrieved and independently screened by one review author (NN).

# Data extraction

## Quantitative data extraction

One review author (NN) extracted the following descriptive information from the qualitative reports using a standard data extraction form (Additional file 1): study design, data collection methods, data analysis methods, number of participants in the qualitative study, number of RCTs the participants were sourced from, whether the study was nested in the RCT, and which clinical domain(s) were involved.

Two review authors (NN, VNT) independently appraised the methodological quality [11, 19] by using the Critical Appraisal Skills Program (CASP) tool (Additional file 1), a widely used qualitative research appraisal checklist [20]. Disagreements were resolved by consensus and when needed, a third reviewer (IB). The weighted Cohen's Kappa for agreement on CASP criteria ranged from 0.80 to 0.92.

We extracted the following information from the associated RCT reports by using a standard data extraction form (Additional file 1): clinical setting, geographical location, funding sources, number of trial arms, intervention, comparator, estimated sample size, number randomized, masking of allocation, and issues encountered.

## Qualitative data extraction, analysis, and synthesis

We followed the detailed methods for thematic synthesis outlined by Thomas and Harden [8]. Each included full-text report underwent coding and analysis assisted by NVivo Pro v12. First, three independent review authors [NN, VNT, IB] inductively line-by-line coded a set of 10 reports. We pre-specified and coded the results/findings and discussion sections covering the authors' interpretation of their data as well as any text reported as direct/verbatim patient quotes. Second, three reviewers (NN,
VNT, IB) independently organized the open codes into structured descriptive themes based on similarities and differences between codes. Third, the three reviewers met to reach consensus on the codes and themes, with further interpretative discussion focused on the research question to generate analytical themes. Next, one reviewer (NN) independently coded the remaining reports, adding new excerpts to the pre-existing codes and themes in the codebook (Additional file 1) as well as creating new codes and themes as appropriate. Throughout the coding process, the review authors met regularly to cross-check newly generated codes and themes against the data, discuss interpretation, and synthesize analytical themes encompassing “research burden” and “research benefit.”

We presented examples of coded text excerpts in quoted italics followed by [PC] or [SC]. PC stands for “primary code,” i.e., the excerpt represents a verbatim patient quote, and SC stands for “secondary code,” i.e., the excerpt represents the author’s interpretation.

## Patient and public involvement

The manuscript, codebook, figures, tables, and appendices were reviewed by a patient representative (DS), and

helpful points further clarifying the wording of the interpretative analysis were adjusted for accordingly.

## Results

### Characteristics of qualitative studies

Of the 3587 records screened, we included 45 qualitative studies (Fig. 1; Additional file 1) involving 1732 patients who had participated in an RCT (Table 1). A qualitative design was used in 37 (82%) studies. The main methods used were interviews (n = 39; 87%) and thematic analysis (n = 21; 47%). The median number of participants in each study was 21 (Q1 to Q3: 15 to 38). The studies were mainly in the field of cancer (n = 14; 31%) and chronic diseases (n = 12; 27%). Six (13.3%) qualitative studies were published before 2005. Participants were sourced from a single RCT in 31 (71%) studies and from more than one RCT in 8 (16%). For 6 (13%) studies, the number of RCTs involved was unclear. The methodological quality is reported in Table 1. We were able to retrieve 42 RCTs: 37 were published final reports and 5 were published protocols (Table 2). Issues encountered during trial implementation were reported for 10 trials, 8 related to suboptimal recruitment such as slow accrual or

<figure><img src="image_3.png" /><figcaption>**Fig. 1** Systematic review flowchart</figcaption></figure>
<table><caption>**Table 1** Characteristics of the primary qualitative reports</caption><thead><tr><th></th><th>N = 45 (100.0%)</th></tr></thead><tbody><tr><td>Primary qualitative report characteristics</td><td></td></tr><tr><td>Study design</td><td></td></tr><tr><td>Qualitative</td><td>37 (82.2%)</td></tr><tr><td>Mixed methods</td><td>8 (17.8%)</td></tr><tr><td>Data collection methods</td><td></td></tr><tr><td>Interviews</td><td>39 (86.6%)</td></tr><tr><td>Focus groups</td><td>3 (6.7%)</td></tr><tr><td>Surveys with open-ended questions</td><td>3 (6.7%)</td></tr><tr><td>Data analysis methods</td><td></td></tr><tr><td>Content analysis</td><td>9 (20.0%)</td></tr><tr><td>Thematic analysis</td><td>21 (46.7%)</td></tr><tr><td>Grounded theory</td><td>11 (24.4%)</td></tr><tr><td>Interpretive phenomenological analysis</td><td>2 (4.4%)</td></tr><tr><td>Not reported</td><td>2 (4.4%)</td></tr><tr><td>For a single qualitative study, the RCT participants were sourced from:</td><td></td></tr><tr><td>1 RCT**</td><td>31 (71.1%)</td></tr><tr><td>Multiple RCTs**</td><td>8 (15.5%)</td></tr><tr><td>Not reported***</td><td>6 (13.3%)</td></tr><tr><td>Number of RCT participants in each qualitative study</td><td></td></tr><tr><td>Median (Q1, Q3); n</td><td>21.0 (15, 38); 1732</td></tr><tr><td>Was the primary qualitative study nested in the RCTs?</td><td></td></tr><tr><td>Yes</td><td>27 (60.0%)</td></tr><tr><td>Clinical domain</td><td></td></tr><tr><td>Oncology</td><td>14 (31.1%)</td></tr><tr><td>Chronic diseases</td><td>12 (26.7%)</td></tr><tr><td>Acute illnesses</td><td>4 (8.9%)</td></tr><tr><td>Mental health</td><td>1 (2.2%)</td></tr><tr><td>Trauma/orthopedics</td><td>2 (4.4%)</td></tr><tr><td>Obstetrics</td><td>8 (17.8%)</td></tr><tr><td>Urogynecology</td><td>2 (4.4%)</td></tr><tr><td>Mixed</td><td>2 (4.4%)</td></tr><tr><td>Publication year of primary qualitative study</td><td></td></tr><tr><td>Before 2005</td><td>6 (13.3%)</td></tr><tr><td>CASP Tool Quality Appraisal</td><td>Yes</td></tr><tr><td>Q1 Was there a clear statement of the aims of the research?</td><td>45 (100.0%)</td></tr><tr><td>Q2 Is a qualitative methodology appropriate?</td><td>45 (100.0%)</td></tr><tr><td>Q3 Was the research design appropriate to address the aims of the research?</td><td>45 (100.0%)</td></tr><tr><td>Q4 Was the recruitment strategy appropriate to the aims of the research?</td><td>36 (80.0%)</td></tr><tr><td>Q5 Was the data collected in a way that addressed the research issue?</td><td>17 (37.8%)</td></tr><tr><td>Q6 Has the relationship between researcher and participants been adequately considered?</td><td>15 (33.3%)</td></tr><tr><td>Q7 Have ethical issues been taken into consideration?</td><td>42 (93.3%)</td></tr><tr><td>Q8 Was the data analysis sufficiently rigorous?</td><td>26 (57.8%)</td></tr><tr><td>Q9 Is there a clear statement of findings?</td><td>45 (100.0%)</td></tr></tbody></table>

*Due to rounding off numbers may not add up to 100

**31 qualitative studies involved a single RCT, and we were able to retrieve 27 RCT reports or protocols. 8 qualitative studies sourced participants from a total of 50 different RCTs, and we retrieved 15 RCT reports or protocols. Thus, a total of 42 RCT reports were available for description

***6 qualitative studies did not clearly report the number of RCTs that were involved
<table><caption>**Table 2** Characteristics of the RCT reports from which primary qualitative studies sourced participants</caption><thead><tr><th></th><th>N = 42 (100.0%)</th></tr></thead><tbody><tr><td>RCT characteristics</td><td></td></tr><tr><td>Clinical setting</td><td></td></tr><tr><td>Primary (home/GP/community based)</td><td>4 (9.5%)</td></tr><tr><td>Secondary (hospital based)</td><td>27 (64.3%)</td></tr><tr><td>Tertiary (specialized academic health facility based)</td><td>11 (26.2%)</td></tr><tr><td>Geographical location</td><td></td></tr><tr><td>Europe</td><td>33 (78.6%)</td></tr><tr><td>America (USA and Central)</td><td>1 (2.4%)</td></tr><tr><td>Africa</td><td>3 (7.1%)</td></tr><tr><td>Asia</td><td>1 (2.4%)</td></tr><tr><td>Oceania</td><td>1 (2.4%)</td></tr><tr><td>Multi-continental</td><td>3 (7.1%)</td></tr><tr><td>RCT funding sources/sponsorship</td><td></td></tr><tr><td>Non-profit/academic/public organizations</td><td>40 (95.0%)</td></tr><tr><td>Blinding of patients</td><td></td></tr><tr><td>Yes</td><td>13 (31.0%)</td></tr><tr><td>Number of trial arms</td><td></td></tr><tr><td>2</td><td>34 (81.0%)</td></tr><tr><td>3</td><td>7 (16.7%)</td></tr><tr><td>4</td><td>1 (2.4%)</td></tr><tr><td>Intervention **</td><td></td></tr><tr><td>Drug (topical, oral, SC, IM, IV)</td><td>22 (52.4%)</td></tr><tr><td>Surgical procedure</td><td>4 (9.5%)</td></tr><tr><td>Participative (psychological, physical, educational, palliative, rehabilitative)</td><td>11 (26.2%)</td></tr><tr><td>Other</td><td>5 (11.9%)</td></tr><tr><td>Comparator**</td><td></td></tr><tr><td>Placebo/Sham treatment</td><td>11 (26.2%)</td></tr><tr><td>Usual care/no treatment</td><td>18 (42.8%)</td></tr><tr><td>Active treatment</td><td>13 (31.0%)</td></tr><tr><td>Number of patients randomized</td><td></td></tr><tr><td>Mean (SD); n***</td><td>1199 (1999); 46,748</td></tr><tr><td>Issues with RCT?</td><td></td></tr><tr><td>None reported***</td><td>32 (76.2%)</td></tr><tr><td>Suboptimal recruitment (slow accrual, unwilling to be randomized, high refusal rate, regulatory delays, lack of eligible patients)</td><td>8 (19.0%)</td></tr><tr><td>Informed consent in an emergency</td><td>2 (4.8%)</td></tr></tbody></table>

high refusal rate and 2 to obtaining informed consent in an emergency setting.

## Burdensome impacts and consequences of trial participation

### Psychological impacts

The research burden experienced by participants in RCTs is detailed in Additional file 1 and summarized in

Fig. 2. Participants endured a diverse array of psychological burdens at every stage of the trial process. The decision to commit to a trial, understand trial information, and provide consent was responsible for anxiety and fear of “being a ‘guinea pig’ and being used to “further the career of a scientist without benefit to one’s present condition” [SC]. Many participants felt stressed and overwhelmed when dealing with the “load of information” [PC], “intimidated” [SC]

<footnote>*Due to rounding off numbers may not add up to 100</footnote>

<footnote>**If the RCT contained more than 2 arms, only 1 experimental intervention and 1 comparator was extracted</footnote>

<footnote>***There is missing data for 5 RCTs as only the protocol was available</footnote>
<figure><img src="image_4.png" /><figcaption>**Fig. 2** Classification of theme “Research Burden” and sub-themes “Burdensome Impacts and Consequences” and “Factors related to Burden”</figcaption></figure>

and confused by the complicated and technical terminologies used and embarrassed to admit not understanding trial information. Moreover, undergoing randomization carried significant psychological burden. Some struggled to accept the concept of random allocation: “deep inside, I believed the new treatment being better, and now I [agreed] to participate in a drawing of lots. I was not certain of winning the draw, if you understand? If I had got the standard treatment I maybe would have felt… it’s not as good as the one I’ve got. I think it’s wrong” [PC]. Patients expressed fear and anxiety associated with the possibility of placebo allocation: “Patients ‘run the risk’ of receiving the placebo (i.e., getting no treatment) and dying sooner” [SC]. Allocation to the control arm was associated with disappointment, anger and depression that was quite devastating: “…no hope for me… extremely depressed …went home and cried. To leave the hospital after an hour of filling forms … empty handed. I felt no one really understood how bad I felt” [PC].

Patients' follow-up was also responsible for important psychological burdens. Frustration and dissatisfaction were associated with completing trial questionnaires: “Questionnaires are always terrible because you never can express by checking a box what one wants to say” [PC]. Finally, patients

struggled to deal with the end of their participation in the trial and their transition to usual care. A sense of loss, isolation, and anxiety was associated with the end of the trial: “It was a bit of a blow.’; ‘in a way I suppose I was a bit anxious.’; ‘I felt as though I was losing friends here.’” [PC].

## Physical impacts

Patients' follow-up was also responsible for physical burdens. Particularly, “participants indicated they had experienced some negative effects from completing the outcome measures, chiefly that reading and rating their level of nausea and vomiting at a time when they were feeling nauseous had at times worsened their experience” [SC], which demonstrates direct physical burden. We also found that time consumed by trial participation was an important burden. One patient was “surprised by the fact that professionals presume that you have plenty of time” and further explained that “they did not take my possibilities and preferences into account” [PC]. Patients “had to travel to appointments in rush-hour traffic” [SC] and were forced to adapt their schedules to suit the trial. Patients reported allocation to the control arm or a placebo as a “waste of time” [PC], and there was a “personal belief [that patients] have
little time left and their time would be shortened by partic-
pating in a clinical trial" [SC].

Cost impacts

It is also essential to consider the financial burden of
trial participation: “the patient also lived a considerable
distance from the hospital, and it seems he incurred
considerable expense and inconvenience every time he
attended an appointment” [SC].

Factors related to burden of trial participation

We further discerned factors related to research burden,
which we differentiated into patients' interpretation and
trial logistics (Fig. 2; Additional file 1). Many factors
were distinctly associated with trial information. Patients
were overwhelmed due to inappropriate timing, exces-
sive volume, inadequate format, and the variety and
complexity of the information. Furthermore, some es-
sential information related to participation risks was in-
sufficient: "It would be good for people to be told up
front how bad the chemo is. How incredibly tired you
feel. That can't be said enough." [PC]. Factors related to
beliefs and understanding featured prominently as a
compounding issue such as "little or no understanding
or consideration of the unknown and potentially equal
risks and benefits of participating in the trial, and the
principle of equipoise" [SC] induced or worsened bur-
densome impacts. Other important RCT concepts (such
as reasons for using randomization) were similarly mis-
understood by patients, contributing to discomfort and
discontent related to being randomized. We also identi-
fied that factors related to patients' follow-up, for ex-
ample, frequency and length of trial questionnaires,
worsened the additional workload: "It [questionnaire]
was hard work because there were so many pages" [PC]
and "I would have favored a weekly diary rather than a
daily one" [PC]. Furthermore, attending poorly organized
and inconveniently timed trial visits led to irritation:
"The things that have annoyed me so far is you go to the
[name of principal hospital in city 3], you've got to be
there for eight o'clock in the morning, [and] they got no
bed for you. So they can't do anything until they have
found a bed for you, and I've been there from eight until
half past one, um, just hanging around" [PC].

Finally, disappointment at trial closure was punctuated
by a lack of feedback related to results or allocation.

Beneficial effects of trial participation

Trial participation was also associated with beneficial ef-
fects (Table 3; Additional file 1). Patients believed their
altruistic motivations and intentions to participate as be-
ing a “feel-good factor associated with their participation
in a trial. Patients remarked that participation “makes you
feel useful and gives satisfaction to take part in a trial [SC/

PC]” and “it makes you feel better, doesn’t it, if you feel
you are contributing something” [PC]. We also noted an
emphasis on the relevance of patients’ participation for fu-
ture research and the next generation of patients as
“worthwhile” and appreciation for the opportunity to con-
tribute meaningfully. Benefits were also reported, such as
a newfound personal insight from completing trial ques-
tionnaires: “It gave me food for thought, it gave me more
insight into perhaps what was really bothering me...some
of the questions would bring to light, maybe some of the
things I had been feeling, but didn’t realize it until I had to
answer.” [PC] We also found that a sense of control may
be regained: “And actually it helped because it was some-
thing positive to do, on certain days and ticking the boxes
and all that sort of thing. I felt because I think part of hav-
ing cancer is you lose control, and I am quite, the sort of
person that likes to be in control and this is enabling me a
little bit of control back” [PC]. Notably, an improved rela-
tionship with the trial staff and healthcare providers was
identified, with trust, support, and encouragement being
important components. Indeed, some patients described
the trial clinic as being “like home from home [PC]” and a
“safe haven or a pseudo-surrogate family” [PC]. Further-
more, receiving special attention such as closer supervi-
sion of illness and contact with healthcare staff, extra
efforts, and superior facilities was considered as greatly ad-
vantageous. One impressed patient “felt privileged to be
on a trial. We had a separate chemo facility and we all
knew we were at the Ritz” [PC].

Discussion

To our knowledge, this is the first study providing a de-
tailed description of the burdensome impacts experi-
enced by participants in clinical trials and identification
of factors associated with this burden.

This systematic review of 45 qualitative studies that in-
volved 1732 RCT participants in various fields provides a
detailed description of the diverse psychological, physical,
and financial burdens experienced by patients when they
participate in a trial. Burden arises across all stages of the
trial: the informed consent process, randomization and
masking, follow-up, and at the end of study participation.
We further discerned factors associated with trial imple-
mentation as well as factors related to patients' interpret-
ation of trial concepts that are related to research burdens.

Research burden was initially conceptualized in the
field of survey research with respondent burden,
depending on the amount of effort required by the re-
spondent, the amount of stress, and the length and fre-
quency of interviews. This concept has progressively
been extended to other types of research, with a particu-
lar focus on seriously ill patients [18]. Lingler and
colleagues proposed a broader conceptualization of re-
search burden and suggested the term “perceived
<table><caption>**Table 3** Theme “Trial Participation Benefits”</caption><thead><tr><th>Subthemes and codes</th><th>Primary text report excerpt</th></tr></thead><tbody><tr><td>➤ Altruistic benefits</td><td></td></tr><tr><td>• It feels good to do good</td><td>"This enabled women to continue to feel good about having taken part; they experienced the warm glow of having helped others"</td></tr><tr><td>• Contribution to future research</td><td>"If it can make it easier for somebody in the future, count me in"</td></tr><tr><td>• To 'pay it forward' and reciprocate previous generations' contributions</td><td>"And I also looked at it like this: these are studies for the future, and after all I have a daughter and you never know. In that case I'm the kind of person to take part in things for other people, so that it's better in the future than it is now, for example. What other people have done in the past, I'm making use of now"</td></tr><tr><td>• A way to give back to the health care service</td><td>"Undoubtedly the main motivational factor influencing participants was a desire to 'give something back'"</td></tr><tr><td>➤ Personal benefits</td><td></td></tr><tr><td>• Regain a sense of control</td><td>"Specifically, that it provided them with some control, at a time when most felt a lack of control over their cancer experience"</td></tr><tr><td>• Improve self-discipline</td><td>"Also, being enrolled in trials helped several participants to maintain self-discipline, crucial for people with chronic diseases who need to take drugs continuously"</td></tr><tr><td>• Less responsibility and workload</td><td>"This, combined with their fears of developing complications, had led them to value the input of UKPDS professionals who could 'do the thinking, planning and worrying for [them]'"</td></tr><tr><td>• Gain research knowledge</td><td>"All former trial participants said they felt more knowledgeable about trials and research since participating in a clinical trial"</td></tr><tr><td>• Increased health status awareness</td><td>"It also made me aware of any little changes....the answer might be, well, maybe a little different this time, or changed, which made me more aware of myself"</td></tr><tr><td>• Experience improved healthcare relationships</td><td>"Compassion, social support and communication related to development of positive and trusting relationships with the research team"</td></tr><tr><td>• Receive special attention</td><td>"felt privileged to be on a trial. We had a separate chemo facility and we all knew we were at the Ritz"</td></tr><tr><td>• Means to be gainfully occupied</td><td>"Yeah, yeah, I mean, it's something to do, you know, it's good fun, it breaks things up. Life gets a bit boring when you are stuck like this, you know"</td></tr><tr><td>• Monetary incentives</td><td>"However, the practical advantage to receive drugs immediately without pharmacy fees was appreciated. 'Firstly the drugs were free, which I found good. And you did not have to pay five Euros [pharmacy charge], which was also a factor'"</td></tr></tbody></table>

participant burden" [21]. Some evidence shows that research burden can be common in RCTs. For example, half the respondents in an international survey of 2194 clinical trial participants considered trial participation as disruptive to their daily routine [22]. The concept of research burden has featured prominently in recent priority-setting partnerships for trial methodology research [23, 24].

## Implications

### Impact on trial recruitment and retention

The high burden of trial participation could be an important barrier to trial participation and increase trial withdrawal. For instance, a study showed that the complexity and stringency of the protocol were among the most common reasons cited by patients as barriers to participation in clinical trials of cancer treatments [25].
Additional procedures and appointments, as well as travel time and travel costs, are frequent reasons for declining participation, missing appointments, and “withdrawing” from a trial [26]. These sentiments are an important issue because the success of RCTs depends on their ability to recruit a sufficient number of patients and to ensure that as few participants as possible withdraw from the research or become lost to follow-up. Yet, trial recruitment is generally slower than expected [27]. Many trials fail to reach their planned sample size within the timescale and funding originally envisaged. For example, less than one third of the trials from two UK academic funding institutions recruited 100% of their original target and 45% failed to recruit even 80% of the target sample size [28]. Similarly, a study of RCTs in the USA found that about one third of the trials recruited less than 75% of their planned sample [29]. The number of eligible participants declining participation varies according to the context of the study and can represent up to 50% of the patients invited to participate [30, 31]. Our results also have some implications for implementation science. Indeed, successful intervention implementation requires that patients accept trial participation. Slow recruitment increases cost and delays the transposition of results into practice. Results are less reliable if the planned sample size is not achieved [32, 33], and a high refusal rate raises important concerns about the external validity. The extrapolation of the findings to the target population will not be guaranteed [34–37], and the financial investment in the research might be wasted. This situation raises doubts about the extrapolation of trial findings to the future, target population [28, 34–37].

## Ethical considerations

Further, there are important moral and ethical reasons for seeking to avoid unduly burdening patients. The process of seeking informed consent can, for example, be responsible for burden participants psychologically; it has even been considered cruel [38]. It can be very stressful for patients to listen to a physician describing the potential benefits of the new treatment and then be informed that the treatment will be decided by randomization. Nevertheless, research burden is probably insufficiently considered by regulatory agencies, which mainly focus on the direct risk induced by the interventions and data collection. This burden is also inadequately considered by researchers who may be too busy focusing on the comprehensiveness, quality, and appropriate standardization of the data collected.

## Toward minimally disruptive and compassionate clinical research

Funders, trialists, and methodologists should rethink the planning and conduct of trials. First, they must minimize research burdens and should implement “minimally disruptive and

compassionate clinical research [39]”. Second, in the same way, a framework has been developed for the humanization of healthcare [40]; we need to move toward compassionate clinical research. Indeed, our results highlight that most of the burden experienced by participants are psychological burdens. While it is impossible to completely reduce this burden, trialists could implement interventions to favor compassionate and empathic support to patients. Such support has demonstrated its beneficial effect for healthcare [41]. The results of this review could help improve the design and conduct of RCTs by helping researchers to identify and implements strategies to reduce research burden. Such strategies might be implemented and evaluated in a Study Within A Trial (SWAT) [42] and thereby add to the evidence base on recruitment and retention in trials [5, 6]. Further, we need to explore other study designs that could reduce burden and improve external validity such as trials embedded in registries, cohorts, or routinely collected data [43] but also observational studies and use of routinely collected data. Patient and public involvement at the planning stage of the trial could also help reduce the burden [44–46] and drawing on patients’ experimental knowledge, ideas, and input when designing interventions to reduce research burden is essential [47–50]. The amount of data recorded as well as the modalities for recording data could also be questioned. For instance, O’Leary and colleagues showed that the median number of items collected per participant in a sample of cancer RCTs was 599 (range 186 to 1035), but only 18% of the data collected was actually used and reported in the resulting articles [46]. Similarly, a retrospective study of patient travel burden in cancer clinical trials using a Google Maps calculator showed that the median unidirectional distance traveled from home to the study site was 40 km (interquartile range 17.7 to 120.7) [51]. The benefits of trial participation identified in this study should also be considered for the planning and conducting of future research although it is important to acknowledge that some factors (e.g., completion of questionnaire) were considered as beneficial for some patients and burdensome by others.

## Limitations

There are limitations to our study. First, although our search strategy aimed to be comprehensive, we cannot exclude that we may have missed some studies. Nevertheless, the guidance for qualitative reviews focuses more on confidence in the synthesized findings, rather than on comprehensiveness [52]. Second, privacy and confidentiality reasons meant that we did not contact the authors of the included studies to request their complete data, and therefore, our thematic analysis and synthesis was limited to the findings and patient quotes published in the qualitative reports. Further, for feasibility reasons, we excluded some types of patients from this research burden project, such as adults with decreased decisional capacity for consent or requiring a proxy and children. We did not consider decliners
although they have a potentially valuable perspective on research burden. We also excluded early-phase trials as well as screening trials or prevention trials.

Finally, we could not take into account participants' individual health status, i.e., disease progression and treatment burdens, as well as their personal capacity which could highly impact the burden experienced.

## Conclusion

Our findings provide a detailed description of research burden across the whole RCT process. This compendious representation further elucidates key factors related to burden. The consideration of these modifiable factors in the planning and design of RCTs, such as the timing, volume, complexity, or format of trial information or the organization of patients' follow-up, could help perform better RCTs. Many of the burdensome impacts described could be anticipated, and some avoided in a movement toward minimally disruptive clinical research. Such approach could improve trial recruitment and retention.

## Supplementary information

Supplementary information accompanies this paper at https://doi.org/10.1186/s12916-019-1476-5.

**Additional file 1.** ENTREQ checklist. Search strategies. Data extraction form. CASP tool. Codebook. Table of primary full text reports included in systematic review and thematic synthesis.

### Abbreviations

CASP: Critical Appraisal Skills Program; PC: Primary code; RCT: Randomized controlled trial; SC: Secondary code

### Acknowledgements

We thank Elise Diard for developing the figures.

We thank Laura Smalesfor proofreading this manuscript.

### Authors' contributions

NN, VNT, PR, and IB were responsible for the conception and design. NN, VNT, PR, DS, and IB were responsible for the acquisition of data and analysis. All were responsible for the interpretation of data. NN and IB were responsible for the manuscript draft. VNT, PR, BY, PA, DS, and MC critically appraised and improved the manuscript. All approved the submitted final version.

### Funding

This project was funded by the Institut National du Cancer (INCA), France.

### Availability of data and materials

Dataset available from the corresponding author (isabelle.boutron@aphp.fr).

### Ethics approval and consent to participate

Not applicable.

### Consent for publication

Not applicable.

### Competing interests

Isabelle Boutron is Editorial Board Member for BMC Medicine.

### Author details

Received: 24 September 2019 Accepted: 29 November 2019

Published online: 20 January 2020

### References

1. Chlebowski RT, Hendrix SL, Langer RD, et al. Influence of estrogen plus progestin on breast cancer and mammography in healthy postmenopausal women: the Women's Health Initiative randomized trial. JAMA. 2003;289(24):3243-53.

2. Nipp RD, Powell E, Chabner B, Moy B. Recognizing the financial burden of cancer patients in clinical trials. Oncologist. 2015;20(6):572-5.

3. Kimmelman J, Resnik DB, Peppercorn J, Ratain MJ: Burdensome research procedures in trials: why less is more. J Natl Cancer Inst. 2017;109(4):djw315.

4. Townsley CA, Selby R, Siu LL. Systematic review of barriers to the recruitment of older patients with cancer onto clinical trials. J Clin Oncol. 2005;23(13):3112-24.

5. Treweek S, Pitkethly M, Cook J, Fraser C, Mitchell E, Sullivan F, Jackson C, Taskila TK, Gardner H. Strategies to improve recruitment to randomised trials. Cochrane Database Syst Rev. 2018;2:MR000013.

6. Brueton VC, Tierney J, Stenning S, Harding S, Meredith S, Nazareth I, Rait G. Strategies to improve retention in randomised trials. Cochrane Database Syst Rev. 2013;12:MR000032.

7. Skea ZC, Newlands R, Gillies K. Exploring non-retention in clinical trials: a meta-ethnographic synthesis of studies reporting participant reasons for drop out. BMJ Open. 2019;9(6):e021959.

8. Thomas J, Harden A. Methods for the thematic synthesis of qualitative research in systematic reviews. BMC Med Res Methodol. 2008;8:45.

9. Harris JL, Booth A, Cargo M, Hannes K, Harden A, Flemming K, Garside R, Pantoja T, Thomas J, Noyes J. Cochrane Qualitative and Implementation Methods Group guidance paper 6: methods for question formulation, searching, and protocol development for qualitative evidence synthesis. J Clin Epidemiol. 2017.

10. Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6(7):e1000097.

11. Tong A, Flemming K, McInnes E, Oliver S, Craig J. Enhancing transparency in reporting the synthesis of qualitative research: ENTREQ. BMC Med Res Methodol. 2012;12(1):181.

12. Methley AM, Campbell S, Chew-Graham C, McNally R, Cheraghi-Sohi S. PICO, PICOS and SPIDER: a comparison study of specificity and sensitivity in three search tools for qualitative systematic reviews. BMC Health Serv Res. 2014;14:579.

13. Shaw RL, Booth A, Sutton AJ, Miller T, Smith JA, Young B, Jones DR, Dixon-Woods M. Finding qualitative research: an evaluation of search strategies. BMC Med Res Methodol. 2004;4:5-5.

14. Evans D. Database searches for qualitative research. J Med Library Association. 2002;90(3):290-3.

15. Booth A: Chapter 3: searching for studies. In: Supplementary guidance for inclusion of qualitative research in Cochrane systematic reviews of interventions. Edited by Noyes J BA, Hannes K, Harden A, Harris J, Lewin S, Lockwood C, vol. version 1 (updated August 2011): Cochrane Collaboration Qualitative Methods Group, 2011; 2011.

16. Booth A. Searching for qualitative research for inclusion in systematic reviews: a structured methodological review. Syst Rev. 2016;5:74.

17. Lingler JH, Schmidt K, Gentry A, Hu L, Terhorst L. Perceived Research Burden Assessment (PeRBA): instrument development and psychometric evaluation. JERHRE. 2014;9(4):46-9.

18. Ulrich CM, Wallen GR, Feister A, Grady C. Respondent burden in clinical research: when are we asking too much of subjects? IRB. 2005;27(4):17-20.

19. Mays N, Pope C. Rigour and qualitative research. Br Med J. 1995;311(6997):109-12.

20. Verboom B, Montgomery P, Bennett S. What factors affect evidence-informed policymaking in public health? Protocol for a systematic review of qualitative evidence using thematic synthesis. Syst Rev. 2016;5:61.

<footnote n="1">¹Université de Paris, CRESS, INSERM, INRA, F-75004 Paris, France. ²Centre d'Epidémiologie Clinique, AP-HP, Hôpital Hôtel Dieu, F-75004 Paris, France.</footnote>

<footnote n="3">³Department of Health Services Research, Institute of Population Health</footnote>

<footnote>Sciences, University of Liverpool, Liverpool L69 3GB, UK. ⁴Department of Epidemiology, Mailman School of Public Health, Columbia University, New York, NY, USA. ⁵INSERM U 1123 ECEVE (Clinical Epidemiology, Economic, Evaluation, Vulnerable populations), University Paris Diderot, Paris, France.</footnote>

<footnote n="6">⁶Jusqu'A La Mort Accompagner la Vie (JALMALV), Strasbourg, France.</footnote>

<footnote n="7">⁷Comité des Utilisateurs et Professionnels, Institut National du Cancer (INCa), Paris, France. ⁸Queen's University Belfast School of Medicine Dentistry and Biomedical Sciences, Belfast, UK.</footnote>
21. Lingler JH, Schmidt KL, Gentry AL, Hu L, Terhorst LA. A new measure of research participant burden: brief report. J Empir Res Hum Res Ethics. 2014; 9(4):46-9.

22. Anderson A, Borfitz D, Getz K. Global public attitudes about clinical research and patient experiences with clinical trials. JAMA Netw Open. 2018;1(6):e182969.

23. Healy P, Galvin S, Williamson PR, Treeweek S, Whiting C, Maeso B, Bray C, Brocklehurst P, Moloney MC, Douiri A, et al. Identifying trial recruitment uncertainties using a James Lind Alliance Priority Setting Partnership - the PRioRiTy (Prioritising Recruitment in Randomised Trials) study. Trials. 2018;19(1):147.

24. What are the most important unanswered questions in trial retention? A James Lind Alliance Priority Setting Partnership - The PRioRiTy 2 (Prioritising Retention in Randomised Trials) Study [https://www.researchsquare.com/article/588284a5-b216-40cb-a405-25138610efa2/v1]. Accessed 10 Dec.

25. Mills EJ, Seely D, Rachlis B, Griffith L, Wu P, Wilson K, Ellis P, Wright JR. Barriers to participation in clinical trials of cancer: a meta-analysis and systematic review of patient-reported factors. Lancet Oncol. 2006;7(2):141-8.

26. Ross S, Grant A, Counsell C, Gillespie W, Russell I, Prescott R. Barriers to participation in randomised controlled trials: a systematic review. J Clin Epidemiol. 1999;52(12):1143-56.

27. Gross CP, Mallory R, Heiat A, Krumholz HM. Reporting the recruitment process in clinical trials: who are these patients and how did they get there? Ann Intern Med. 2002;137(1):10-6.

28. McDonald AM, Knight RC, Campbell MK, Entwistle VA, Grant AM, Cook JA, Elbourne DR, Francis D, Garcia J, Roberts I, et al. What influences recruitment to randomised controlled trials? A review of trials funded by two UK funding agencies. Trials. 2006;7:9.

29. Fletcher B, Gheorghe A, Moore D, Wilson S, Damery S. Improving the recruitment activity of clinicians in randomised controlled trials: a systematic review. BMJ Open. 2012;2(1):e000496.

30. Shimm DS, Spece RG. Rate of refusal to participate in clinical trials. IRB. 1992; 14(2):7-9.

31. Toerien M, Brookes ST, Metcalfe C, de Salis I, Tomlin Z, Peters TJ, Sterne J, Donovan JL. A review of reporting of participant recruitment and retention in RCTs in six major journals. Trials. 2009;10:52.

32. Dechartres A, Trinquart L, Boutron I, Ravaud P. Influence of trial sample size on treatment effect estimates: meta-epidemiological study. BMJ. 2013;346:f2304.

33. Montori VM, Devereaux PJ, Adhikari NK, Burns KE, Eggert CH, Briel M, Lacchetti C, Leung TW, Darling E, Bryant DM, et al. Randomized trials stopped early for benefit: a systematic review. JAMA. 2005;294(17):2203-9.

34. Rothwell PM. External validity of randomised controlled trials: "to whom do the results of this trial apply?". Lancet. 2005;365(9453):82-93.

35. Ahmad N, Boutron I, Moher D, Pitrou I, Roy C, Ravaud P. Neglected external validity in reports of randomized trials: the example of hip and knee osteoarthritis. Arthritis Rheum. 2009;61(3):361-9.

36. Dekkers OM, von Elm E, Algra A, Romijn JA, Vandenbroucke JP. How to assess the external validity of therapeutic trials: a conceptual approach. Int J Epidemiol. 2009;39(1):89-94.

37. Ethgen M, Boutron L, Steg PG, Roy C, Ravaud P. Quality of reporting internal and external validity data from randomized controlled trials evaluating stents for percutaneous coronary intervention. BMC Med Res Methodol. 2009;9:24.

38. Tobias JS, Souhami RL. Fully informed consent can be needlessly cruel. BMJ. 1993;307(6913):1199-201.

39. Sara Dick M, CCRP: minimally disruptive research: a respectful approach to conducting clinical studies. In: Edited by UNIT K; 2017.

40. Todres L, Galvin KT, Holloway I. The humanization of healthcare: a value framework for qualitative research. Int J Qual Stud Health Well Being. 2009; 4(2):68-77.

41. Youngson R, Blennerhassett M. Humanising healthcare. BMJ. 2016;355:i6262.

42. Treeweek S, Bevan S, Bower P, Campbell M, Christie J, Clarke M, Collett C, Cotton S, Devane D, El Feky A, et al. Trial forge guidance 1: what is a Study Within A Trial (SWAT)? Trials. 2018;19(1):139.

43. Relton C, Torgerson D, O'Cathain A, Nicholl J. Rethinking pragmatic randomised controlled trials: introducing the "cohort multiple randomised controlled trial" design. BMJ. 2010;340:c1066.

44. Wicks P, Richards T, Denegri S, Godlee F. Patients' roles and rights in research. BMJ. 2018;362:k3193.

45. Montori V. Why we revolt: a patient revolution for careful and kind care: patient revolution; 2017.

46. O'Leary E, Seow H, Julian J, Levine M, Pond GR. Data collection in cancer clinical trials: too much of a good thing? Clin Trials. 2013;10(4):624-32.

47. Caron-Flinterman JF, Broerse JE, Bunders JF. The experiential knowledge of patients: a new resource for biomedical research? Soc Sci Med. 2005;60(11):2575-84.

48. Domecq JP, Prutsky G, Elraiyah T, Wang Z, Nabhan M, Shippee N, Brito JP, Boehmer K, Hasan R, Firwana B, et al. Patient engagement in research: a systematic review. BMC Health Serv Res. 2014;14:89.

49. Rolfe DE, Ramsden VR, Banner D, Graham ID. Using qualitative Health Research methods to improve patient and public involvement and engagement in research. Res Involvement Engagement. 2018;4:49.

50. Price A, Albarqouni L, Kirkpatrick J, Clarke M, Liew SM, Roberts N, Burls A. Patient and public involvement in the design of clinical trials: an overview of systematic reviews. J Eval Clin Pract. 2018;24(1):240-53.

51. Borno HT, Zhang L, Siegel A, Chang E, Ryan CJ. At what cost to clinical trial enrollment? A retrospective study of patient travel burden in cancer clinical trials. Oncologist. 2018;23(10):1242-9.

52. Noyes J, Booth A, Flemming K, Garside R, Harden A, Lewin S, Pantoja T, Hannes K, Cargo M, Thomas J. Cochrane Qualitative and Implementation Methods Group guidance paper 3: methods for assessing methodological limitations, data extraction and synthesis, and confidence in synthesized qualitative findings. J Clin Epidemiol. 2018;97:49-58.

## Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Ready to submit your research? Choose BMC and benefit from:

* fast, convenient online submission

* thorough peer review by experienced researchers in your field

* rapid publication on acceptance

* support for research data, including large and complex data types

* gold Open Access which fosters wider collaboration and increased citations

* maximum visibility for your research: over 100M website views per year

At BMC, research is always in progress.

Learn more biomedcentral.com/submissions

<figure><img src="image_5.png" /></figure>

BMC