# Blinding and sham control methods in trials of physical, psychological, and self-management interventions for pain (article II): a meta-analysis relating methods to trial results

David Hohenschurz-Schmidt, Jerry Draper-Rodi, Lene Vase, Whitney Scott, Alison Mcgregor, Nadia Soliman, Andrew Macmillan, Axel Olivier, Cybill Ann Cherian, Daniel Corcoran, et al.

► To cite this version:

David Hohenschurz-Schmidt, Jerry Draper-Rodi, Lene Vase, Whitney Scott, Alison Mcgregor, et al. Blinding and sham control methods in trials of physical, psychological, and self-management interventions for pain (article II): a meta-analysis relating methods to trial results. Pain, 2023, 164 (3), pp.509-533. 10.1097/j.pain.0000000000002730. hal-04871191

HAL Id: hal-04871191

https://hal.science/hal-04871191v1

Submitted on 28 May 2025

HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.

L'archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d'enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.

<figure><img src="image_1.png" /></figure>

Distributed under a Creative Commons Attribution 4.0 International License
<figure><img src="image_2.png" /></figure>

# Blinding and sham control methods in trials of physical, psychological, and self-management interventions for pain (article II): a meta-analysis relating methods to trial results

David Hohenschurz-Schmidt<sup>a,∗</sup>, Jerry Draper-Rodi<sup>b</sup>, Lene Vase<sup>c</sup>, Whitney Scott<sup>d,e</sup>, Alison McGregor<sup>f</sup>, Nadia Soliman<sup>a</sup>, Andrew MacMillan<sup>b</sup>, Axel Olivier<sup>g</sup>, Cybill Ann Cherian<sup>h</sup>, Daniel Corcoran<sup>i</sup>, Hilary Abbey<sup>b</sup>, Sascha Freigang<sup>j</sup>, Jessica Chan<sup>g</sup>, Jules Phalip<sup>k</sup>, Lea Nørgaard Sørensen<sup>l</sup>, Maite Delafin<sup>m</sup>, Margarida Baptista<sup>n</sup>, Naomi R. Medforth<sup>o</sup>, Nuria Ruffini<sup>p</sup>, Stephanie Skøtt Andresen<sup>q</sup>, Sylvain Ytier<sup>r</sup>, Dorota Ali<sup>s</sup>, Harriet Hobday<sup>t</sup>, Anak Agung Ngurah Agung Adhiyoga Santosa<sup>u</sup>, Jan Vollert<sup>a,v,w,x</sup>, Andrew S.C. Rice<sup>a</sup>

## Abstract

Sham interventions in randomized clinical trials (RCTs) of physical, psychological, and self-management (PPS) therapies for pain are highly variable in design and believed to contribute to poor internal validity. However, it has not been formally tested whether the extent to which sham controls resemble the treatment under investigation consistently affects trial outcomes, such as effect sizes, differential attrition, participant expectancy, and blinding effectiveness. Placebo- or sham-controlled RCTs of PPS interventions of clinical pain populations were searched in 12 databases. The similarity of control interventions to the experimental treatment was rated across 25 features. Meta-regression analyses assessed putative links between employed control interventions, observed effect sizes in pain-related outcomes, attrition, and blinding success. The sample included 198 unique control interventions, dominated by manual therapy and chronic musculoskeletal pain research. Meta-analyses indicated small-to-moderate benefits of active treatments over control interventions, across subgroups of manual therapies, exercise, and rehabilitation, and psychological intervention trials. Multiple meta-regression modelling demonstrated that similarity between sham control and tested interventions predicted variability in pain-related outcomes, attrition, and blinding effectiveness. Influential variables were differences relating to the extent of intervention exposure, participant experience, and treatment environments. The results support the supposed link between blinding methods and effect sizes, based on a large and systematically sourced overview of methods. However, challenges to effective blinding are complex and often difficult to discern from trial reports. Nonetheless, these insights have the potential to change trial design, conduct, and reporting and will inform guideline development.

**Keywords:** Randomized controlled trials, Placebos, Placebo effect, Control groups, Systematic review, Meta-analysis, Physical therapy modalities, Rehabilitation, Psychotherapy

<footnote>Sponsorships or competing interests that may be relevant to content are disclosed at the end of this article.</footnote>

<footnote><sup>a</sup> Pain Research, Department Surgery & Cancer, Faculty of Medicine, Imperial College, London, United Kingdom, <sup>b</sup> Research Centre, University College of Osteopathy, London, United Kingdom, <sup>c</sup> Department of Psychology and Behavioural Sciences, Section for Psychology and Neuroscience, Aarhus University, Aarhus, Denmark, <sup>d</sup> Health Psychology Section, Department of Psychology, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, United Kingdom, <sup>e</sup> INPUT Pain Management Unit, Guy's and St Thomas' NHS Foundation Trust, London, United Kingdom, <sup>f</sup> Human Performance Group, Department Surgery & Cancer, Faculty of Medicine, Imperial College, London, United Kingdom, <sup>g</sup> Faculty of Medicine, Imperial College London, London, United Kingdom, <sup>h</sup> Chemical Engineering Department, Khalifa University, Abu Dhabi, United Arab Emirates, <sup>i</sup> Department of Neurosurgery, Medical University Graz, Graz, Austria, <sup>k</sup> Résidence les Estrangers, La Bourboule, France, <sup>l</sup> Department of Occupational Medicine, Danish Ramazzini Centre, Aarhus University Hospital, Aarhus, Denmark, <sup>m</sup> The Penn Clinic, Hertfordshire, Hatfield, United Kingdom, <sup>n</sup> Wolfson Centre for Age Related Diseases, Department of Psychology, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, United Kingdom, <sup>o</sup> London, United Kingdom, <sup>p</sup> National Centre Germany, Foundation C.O.M.E. Collaboration, Berlin, Germany, <sup>q</sup> Department of Psychology and Behavioural Sciences, Aarhus University, Aarhus, Denmark, <sup>r</sup> Vevey, Switzerland, <sup>s</sup> Genetic and Developmental Psychiatry Centre, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, United Kingdom, <sup>t</sup> Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, United Kingdom, <sup>u</sup> Denpasar, Indonesia, <sup>v</sup> Division of Neurological Pain Research and Therapy, Department of Neurology, University Hospital of Schleswig-Holstein, Campus Kiel, Germany, <sup>w</sup> Department of Anaesthesiology, Intensive Care and Pain Medicine, University Hospital Muenster, Münster, Germany, <sup>x</sup> Neurophysiology, Mannheim Center of Translational Neuroscience (MCTN), Medical Faculty Mannheim, Heidelberg University, Heidelberg, Germany</footnote>

<footnote>*Corresponding author. Address: Pain Research, Dept. Surgery & Cancer, Faculty of Medicine, Imperial College, Chelsea & Westminster Hospital campus, 369 Fulham Road London, London SW10 9NH, United Kingdom. Tel.: +44 (0)20 3315 8816. E-mail address: d.hohenschurz-schmidt19@imperial.ac.uk (D. Hohenschurz-Schmidt).</footnote>

<footnote>Supplemental digital content is available for this article. Direct URL citations appear in the printed text and are provided in the HTML and PDF versions of this article on the journal's Web site (www.painjournalonline.com).</footnote>

<footnote>PAIN 164 (2023) 509–533</footnote>

<footnote>Copyright © 2023 The Author(s). Published by Wolters Kluwer Health, Inc. on behalf of the International Association for the Study of Pain. This is an open access article distributed under the Creative Commons Attribution License 4.0 (CCBY), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</footnote>

<footnote>http://dx.doi.org/10.1097/j.pain.0000000000002730</footnote>
# 1. Introduction

Clinical trials are believed to show larger effects when they are not blinded.⁴⁵,⁵⁷ Blinding or masking refers to preventing trial participants from knowing which of the available treatments they receive, so that such knowledge does not affect their expectation of treatment benefit and thus bias trial results. Expectancies are widely assumed to mediate health benefits due to contextual factors: the placebo effect. Further placebo mechanisms include learning and conditioning, where various symptom-modifying neurobiological pathways are activated and which are dependent on contextual factors of a treatment. Related placebo contributors are the therapeutic interaction and the treatment's meaning to patients.⁷,²⁶,⁴⁸

In clinical trials, “placebo” or “sham” control interventions are used for blinding and to control for the psychosocial context of the treatment, spontaneous remission, and other confounding factors.⁴⁸,⁷⁶ In principle, this can be achieved through a therapeutic ritual that does not include features of the experimental treatment believed to produce the treatment effects and subject to study in a given trial. The concept of placebo controls is best illustrated by drug studies, where identical pills can be used, not containing the pharmacologically active agent but otherwise allowing for the same doctor interactions and rituals of pill taking.⁷⁶ However, nonpharmacological therapies are often more complex in their procedures and more reliant on patient-provider interactions than drug therapies. Furthermore, the distinction between specific and contextual treatment components can be highly challenging and controversial.²³,⁶¹,⁷⁷ Consequently, blinding is more difficult in trials of nonpharmacological treatments.¹⁶ In nonpharmacological studies, such specifically designed control interventions are usually called “sham” or “attention controls,” despite slight differences in meaning.

For complex intervention studies, inert pills are not considered adequate controls, mainly because less elaborate placebos produce less pronounced placebo effects.⁴⁶,⁵⁴,⁸⁹ Efficacy trials of complex interventions require complex control interventions, matching some or most features of the intervention. For example, sham ultrasound is often used in manual therapy trials, which is a largely dissimilar complex control treatment in this context. While low-similarity shams are easy to design and have, on occasion, been shown to effectively blind participants to group allocation,⁸ they may have a higher risk of unblinding and are unable to control for influential but unknown contextual factors. Importantly, trials that use dissimilar controls are believed to overestimate treatment efficacy.⁵ Furthermore, the placebo response is highly variable,⁷⁸,⁸³ and it is often unclear which aspects of the psychosocial treatment context influence the individual trial and to what extent, making it desirable to fully replicate the experimental treatment's context.

Therefore, a high degree of similarity between control and experimental interventions is commonly recommended for efficacy trials,³,⁵,¹⁸,³⁴,³⁹,⁵²,⁶⁴,⁷⁵ but quantitative data to substantiate such recommendations are sparse. Some authors have used the concepts of “indistinguishability,” “sham fidelity,” and “structural equivalence” to denote this similarity.⁵,⁵²,⁶⁴ Despite “indistinguishability” being commonly recommended, it has not been systematically assessed which aspects in the resemblance between experimental and control interventions predict differences in trial outcomes. Such knowledge would enable researchers to prioritise and target efforts during the development of novel control interventions for efficacy trials, acknowledging the practical constraints of clinical trials. The present meta-analysis draws on previous work to define numerous features across

which control and treatment interventions may be compared,³,⁵,¹⁴,¹⁷,¹⁸,²¹,²⁴,³⁴,³⁹,⁴⁵,⁶⁴,⁶⁸,⁷³,⁷⁵ but it refrains from a dichotomous distinction into “similar” and “dissimilar.”

There are currently no guidelines for dedicated control interventions in efficacy or mechanistic trials of physical, psychological, and self-management therapies (PPS) for pain. Such guidelines can only be sensibly developed based on improved insights regarding the effect of design decisions on trial feasibility, participant blinding, and outcomes. As such, the question of whether similarity between test and control interventions matters is of primary importance. Also, with blinding effectiveness rarely reported in trial publications,⁴¹ the retrospective assessment of control intervention quality would be facilitated by establishing quality standards. To advance this field, a systematic review of sham-controlled RCTs of PPS interventions was conducted. In a linked publication, we have reported the results of similarity assessments between control and experimental treatments, and information on additional blinding methods, control intervention development processes, blinding assessments, and reporting guideline compliance.⁴¹ Here, we compare the control and tested interventions across multiple features and test whether different levels of similarity between interventions predict differences in trial results, including pain-related outcomes, blinding effectiveness, and differential attrition.

# 2. Methods

Reporting of this systematic review follows the PRISMA 2020 statement.⁶² Further methodological detail is reported in a parallel article⁴¹ where the included trial methods were described in detail, including discussion of similarity features between interventions and differences between therapy groups. In short, the following methods were used for the systematic search, record screening, and data extraction.

## 2.1. Protocol and registration

A protocol was registered with the International Prospective Register of Systematic Reviews (PROSPERO) (registration ID: CRD42020206590). This publication reports the second part of the review, including outcome data and the meta-analysis. Protocol deviations occurred in relation to the employed meta-analysis methods as specified below.

## 2.2. Eligibility criteria

We included randomized controlled trials of PPS interventions for adults living with pain. Studies had to report at least one pain-related outcome measure. PPS interventions included all forms of manual and physical therapy; exercise and rehabilitation therapy; conversation-based and psychological therapies; body-mind, spiritual, religious, and other nonmaterial healing practices; web-based treatments; relaxation; and educational interventions (the latter 2 were classified as “self-management” here). We excluded drug studies, surgery, nutrition and infusions, device-based treatments, acupuncture and dry needling, and any other treatment based on meridian or reflex point considerations because these provide different challenges and opportunities for control intervention design than the group of nonpharmacological interventions studied here.⁶,¹⁸ To be eligible for this review, trials had to use a sham control intervention (or “attention” or “placebo control”). Pilot or feasibility studies were only included if they specifically assessed features of
the control intervention in a pain population, irrespective of employed outcome measures (henceforth called validation studies). This review systematically assessed studies published from 2008 onwards.¹⁵

## 2.3. Data sources

The following databases were searched from January 2008 to 24 November 2021. MEDLINE, EMBASE, PsychInfo, the Cochrane Database of Systematic Reviews, the Cochrane Central Register of Controlled Trials (CENTRAL), National Institutes of Health Clinicaltrials.gov, AMED (Allied and Complementary Medicine), CINAHL (nursing and allied health), the Physiotherapy evidence database (pedro.org.au), ostmed.dr (ostmed-dr.oclc.org), osteopathic research web (osteopathic-research.com), and the index to chiropractic literature (chiroindex.org). The year 2008 was used as a cutoff because the first reporting guideline for nonpharmacological trials was published in that year.¹⁵

## 2.4. Search strategy

The search strategy was built around the following keywords and is provided in full for each database as supplement (spreadsheet, Supplemental Digital Content 1, available at http://links.lww.com/PAIN/B675). Aligning with the PICOS framework, this review's target population, interventions, control conditions, outcomes, and study designs are encompassed by the following:

Pain OR painful conditions AND Physical, Psychological, Self-management therapies (specific therapy and technique names) AND placebo control OR sham control OR attention control AND controlled clinical trials. Limit: 2008-present. Pain-related outcome measures were not searched for specifically.

## 2.5. Study selection

Eligibility screening was performed in duplicate by 2 independent reviewers drawn from a pool of specifically trained research contributors. Disagreements were resolved by a third independent reviewer. Screening was first performed based on study title and abstract and next based on the full text.

Instead of excluding smaller trials over risk of bias concerns,³⁰,³¹,³⁷,⁸⁴,⁸⁵ this review provides a descriptive overview of existing, otherwise eligible, trials of less than 20 participants per arm at randomization, allowing for the potential identification of novel or promising alternative methods of placebo controlling. Furthermore, we included these smaller studies in sensitivity analyses of the meta-regression modelling. Thus, and in extension of our initial protocol, outcome data were extracted, and risk-of-bias assessments performed for these trials.

## 2.6. Data extraction

Data extraction also required 2 independent reviewers, with discrepancies resolved through discussion or by a third independent reviewer. In trials with more than one sham control group, data for all sham control groups were extracted and treated independently in the analysis. Publications reporting multiple sham controls were assessed independently for each pair of intervention and control intervention, with data from an active intervention arm used twice for comparisons with control interventions if required (sample size of the respective group was halved to account for duplicate inclusion). Where a single sham group acted as comparator for multiple active interventions, data

were extracted from the active intervention that most resembled the control intervention.

The domains of data extraction were bibliographic information, general study design, trial reporting, sham control and blinding methods, trial result (including attrition and blinding effectiveness), and risk of bias using the Cochrane Risk of Bias tool 2 (RoB 2).⁷¹ Resemblance between sham and experimental treatments was rated for 25 features.

Pain-related outcome measures were extracted for sham control and active intervention groups at baseline and earliest follow-up after treatment. Pain-related outcomes can be unidimensional (usually pain intensity rating scales) or multidimensional (eg, questionnaires assessing disease-related function, pain interference or quality of life).⁷⁴ In the absence of research on whether these are differentially susceptible to placebo effects, we strove to extract both a unidimensional and a multidimensional outcome measure per study. Specifically, data were sampled for the declared primary pain-related outcome, irrespective of its nature. Where available, another pain-related outcome of the opposite dimensionality was extracted. Where authors did not declare a primary outcome measure, data for a unidimensional and a multidimensional measure were extracted if available. Direction of effect was considered. Where necessary, data were extracted from figures using the Adobe Reader measurement tool. Authors were contacted through email if data were missing that were required for the calculation of effect sizes or if data appeared erroneous. For cross-over designs, only results from the first phase were extracted.

## 2.7. Data analysis

### 2.7.1. Descriptives and subgroups

A descriptive overview of blinding methods used in the field of PPS interventions for pain is provided in a parallel publication⁴¹ and the Supplemental Digital Content 2 (available at http://links.lww.com/PAIN/B676), including a basic description of placebo controlled interventions, their development and reported ratio-nale, the similarity between control and active interventions, compliance with relevant reporting guidelines, and reports of blinding effectiveness.

Studies were subgrouped into large and small trials or by therapy type where appropriate. Trials of less than 20 participants per arm at randomization and placebo control validation studies without pain-related outcome measures were not used for primary meta-analyses but included in sensitivity analyses. Trials that could not be pooled were only analysed descriptively.⁴¹ Criteria for nonpooling were pain or disability that was not expected to improve in a comparable manner over the course of the study (cancer- and pregnancy-related pain) and studies with patients who had no pain or pharmaceutically reduced pain at outset (pain interventions during or immediately after surgery). Outliers were checked for errors in data reporting or entry and removed if errors in the primary data were suspected or if between-group standardised mean changes deviated from the group mean by more than 2.5 standard deviations.

### 2.7.2. Meta-analysis: placebo responses and treatment effects

For all studies with more than 20 participants per arm, we synthesised outcome data and present a risk of bias (RoB) assessment.⁷¹ For each included control group, placebo responses were calculated as standardised mean changes (SMC) from baseline to first follow-up after the end of the treatment period,
for both a uni- and a multidimensional pain-related outcome measure, where available. To calculate SMCs, a change score was divided by the pooled standard deviations.

Between-group differences were calculated as the difference in SMCs between active and control groups for the same measures and timepoints. Meta-analyses of between-group differences were performed per therapy subgroup and for uni- and multidimensional measures, separately. For each group of therapies, summary effects were calculated using random effects models weighted by the inverse of the variance and plotted using RevMan 5 software.⁷² The heterogeneity of overall effects was estimated using Tau² (T²) and I² statistics and tested for significance using Z statistics.¹³ Data are presented in forest plots, also illustrating study-specific risk of bias.

### 2.7.3. Meta-analysis: similarity ratings

"Similarity ratings" were calculated by converting the evaluation of how similar individual features were between active and sham control interventions into numerical scores. Specifically, clear "Yes" (similar) and "No" (dissimilar) evaluations were rated as 2 and -2, respectively. "Probably Yes" and "Probably No" were awarded 1 and -1 points, and 0 points were given for items that could not be rated because of insufficient information. Non-applicable items were not rated. Results of these ratings are presented in the parallel publication⁴¹ and as supplement to this article (Supplemental Digital Content 3, table, available at http://links.lww.com/PAIN/B677). These data were used as covariates for meta-regression in this review.

### 2.7.4. Meta-analysis: blinding effectiveness, blinding indices, and treatment expectations

During data extraction, we identified all studies that provided an indication as to the effectiveness of the employed blinding methods. Where group guesses were reported in a manner that allowed for the calculation of the Bang blinding index (BI), the index was calculated for active and control groups individually⁴ and a ratio calculated as Hedge g for each comparison between active and sham control groups.²⁵ Descriptive results are again provided as a supplemental table (Supplemental Digital Content 4, available at http://links.lww.com/PAIN/B678). The effect size of Hedge g was estimated irrespectively of the interventions studied, using meta-analysis methods as above.

In addition, we identified trials that reported measuring participant expectancy or related concepts (treatment credibility and satisfaction). On the suggestion of a reviewer and not specified in the original protocol, we examined these reports for the possibility of data pooling and meta-analysis of expectancy measures. For meta-analysis and regression with similarity ratings, reported expectancy data had to be (1) clearly attributable to expectation of treatment benefit only (ie, not presented as a compound measure with questions on treatment credibility or evaluated as treatment satisfaction), (2) sampled after at least one exposure to the test or control intervention but not after the final of multiple treatment sessions (to avoid confounding with treatment satisfaction), and (3) reported in full and per trial group.

### 2.7.5. Multiple meta-regression analysis: the role of similarity between intervention and sham controls in predicting trial outcomes or blinding effectiveness

Based on interim feedback from subject experts, we deviated from the preregistered protocol to perform a more rigorous meta-

regression analysis instead of simple correlation testing. Specifically, to assess the potential relationship between the trial results and how (dis)similar sham and active interventions were, for each individual therapy subgroup, meta-regression analyses were performed using methods-of-moments random effects models.¹³,⁸⁶ The SMC between sham control and active intervention groups was used as the dependent variable, and models were weighted by the inverse of their variances. Models were built for each subgroup individually, identifying potential predictive variables from the pool of similarity ratings. This was accomplished based on nonparametric correlation analyses between all ratings for each subgroup to identify a selection of variables with little interdependence between each other and then further refined by iterative adjustment of the model until a model of supposed best fit was found. Put simply, we tested if similarity ratings could account for some of the differences in pain-related outcomes between trials. In particular, this method examined differences that were not likely because of the "true" difference in treatment efficacy but because of other factors, for example, control methods.

Meta-regression modelling was also performed for a subgroup of studies for which the Bang blinding index could be calculated, testing whether similarity features could predict variance in the studies' blinding success as well as testing whether the blinding index could predict the variance in studies' effect sizes. These analyses were irrespective of the type of therapy tested in the trials. Similarly, 2 meta-regression models were computed to examine whether differences in attrition between studies predicted trial outcomes and, furthermore, whether the degree of similarity between active and sham interventions predicted the degree of differential attrition. The results of meta-regression models are presented per therapy group below. Primary analyses were performed with large studies only (20 or more participants per group), and sensitivity was tested using the complete data set and/or excluding studies that did not formally qualify as outliers (ie, were included in the meta-analysis and primary modelling) but whose confidence intervals did not overlap with those of the aggregate effect.

We initially planned to use a trial-level average of similarity ratings for meta-regression analyses but decided to use ratings for individual items only, given concerns about the validity of a compound score. Notably, many of the individual items' ratings were intercorrelated so that an overall score would have been biased. Also, an equal weighting of all items as part of an average was seen as an undue assumption. We do, however, explore the average of all similarity ratings as part of our descriptive analysis (reported separately⁴¹).

## 3. Results

### 3.1. Sample description

Included trials' characteristics are illustrated in **Table 1. Figure 1** shows the study selection process. We reviewed 194 publications (plus protocols where available), extracting data for 197 unique sham interventions and 198 comparisons between sham and experimental interventions. Manual therapy trials were most common, and there were multiple psychological and rehabilitation trials. Mostly, patients with musculoskeletal pain were recruited. While sham control interventions were not always well described, we were able to classify a range of employed methods, including control interventions that were clearly modelled based on the active treatment under investigation and such that were very dissimilar. Further describing levels of
<table><caption>**Table 1**
Sample overview.</caption><thead><tr><th rowspan="2">Therapy types</th><th colspan="2">Total sample</th><th colspan="2">Large trials</th><th colspan="2">Small trials</th></tr><tr><th>n</th><th>%</th><th>n</th><th>%</th><th>n</th><th>%</th></tr></thead><tbody><tr><td>Manual therapy with spinal manipulation</td><td>48</td><td>24.2</td><td>36</td><td>25.0</td><td>12</td><td>22.2</td></tr><tr><td>Craniosacral therapy and gentle myofascial release</td><td>22</td><td>11.1</td><td>16</td><td>11.1</td><td>6</td><td>11.1</td></tr><tr><td>Other manual therapy</td><td>64</td><td>32.3</td><td>40</td><td>27.8</td><td>24</td><td>44.4</td></tr><tr><td>Rehabilitation/physiotherapy</td><td>22</td><td>11.1</td><td>16</td><td>11.1</td><td>6</td><td>11.1</td></tr><tr><td>Self-management</td><td>5</td><td>2.5</td><td>4</td><td>2.7</td><td>1</td><td>1.9</td></tr><tr><td>Cognitive behavioural and other psychotherapy</td><td>27</td><td>13.6</td><td>26</td><td>18.1</td><td>1</td><td>1.9</td></tr><tr><td>Spiritual/energetic/esoteric healing</td><td>8</td><td>4.0</td><td>5</td><td>3.5</td><td>3</td><td>5.6</td></tr><tr><td>Other</td><td>2</td><td>1.0</td><td>1</td><td>0.7</td><td>1</td><td>1.9</td></tr><tr><td>Intervention complexity*</td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>Simple</td><td>112</td><td>56.6</td><td>73</td><td>50.7</td><td>39</td><td>72.2</td></tr><tr><td>Complex</td><td>82</td><td>41.4</td><td>71</td><td>49.3</td><td>11</td><td>20.4</td></tr><tr><td>Pain descriptor</td><td></td><td></td><td></td><td></td><td></td><td></td></tr><tr><td>Musculoskeletal pain</td><td>121</td><td>61.1</td><td>88</td><td>61.1</td><td>33</td><td>61.1</td></tr><tr><td>Headaches and orofacial pain</td><td>22</td><td>11.1</td><td>15</td><td>10.4</td><td>7</td><td>13.0</td></tr><tr><td>Diffuse chronic pain</td><td>18</td><td>9.1</td><td>16</td><td>11.1</td><td>2</td><td>3.7</td></tr><tr><td>Injury-related and medical intervention-related pain</td><td>19</td><td>9.6</td><td>8</td><td>5.6</td><td>11</td><td>20.4</td></tr><tr><td>Cancer-related pain</td><td>6</td><td>3.0</td><td>6</td><td>4.2</td><td>0</td><td>0.0</td></tr><tr><td>Visceral pain</td><td>5</td><td>2.5</td><td>4</td><td>2.8</td><td>1</td><td>1.9</td></tr><tr><td>Neuropathic pain</td><td>5</td><td>2.5</td><td>5</td><td>3.5</td><td>0</td><td>0.0</td></tr><tr><td>Pregnancy-related pain</td><td>1</td><td>0.5</td><td>1</td><td>0.7</td><td>0</td><td>0.0</td></tr><tr><td>Preregistered trial protocol available</td><td>114</td><td>57.9</td><td>90</td><td>62.9</td><td>24</td><td>44.4</td></tr><tr><td>Total included</td><td colspan="2">Total sample</td><td colspan="2">Large trials</td><td colspan="2">Small trials</td></tr><tr><td></td><td colspan="2">198</td><td colspan="2">144</td><td colspan="2">54</td></tr></tbody></table>

The types of therapies, intervention complexity, and pain population are provided for the entire sample and per group. "Large" trials had 20 or more participants per arm, and their pain-related outcome data were used for meta-analyses. Special cases (large trials): In one trial, data from the active intervention group was used twice to compare it with 2 different sham controls: Bialosky et al. (2014) used a "standard" and an "enhanced" sham control. Three publications reported more than one trial: D'Souza et al. (2008) studied 2 groups with different types of headaches, and Assefi et al.'s (2008) publication included 2 active interventions and a matching sham control each. Finally, Sharpe et al. (2012) reported 2 trials in a single publication, which were treated entirely independently here. In general, only patients who informed the present analyses are counted in this table, patients were not counted twice, and analyses of reporting refer to individual trials.

similarity between control and experimental interventions, we identified features for which similarity was frequently given, such as the amount and frequency of treatments. For other aspects, similarity was more variable, often also depending on the category of intervention studied. The first part of this results section will describe the entire sample, highlighting the subset of large trials eligible for primary meta-analyses, whereas the second part presents the meta-analysis of eligible studies only (Table 1). A table with each study's details is provided as supplement (Supplemental Digital Content 2, available at http://links.lww.com/PAIN/B676).

## 3.2. Validation studies

Two<sup>35,80</sup> of 8 validation studies<sup>19,24,29,38,47,56</sup> were eligible for primary meta-analysis of pain-related outcomes. Three validation studies with more than 20 participants per group<sup>24,29,56</sup> did not provide pain-related outcome data and were thus not included into respective meta-analyses. However, they were included into the meta-analysis of trials reporting on blinding success.

## 3.3. Placebo and sham control intervention designs

Employed sham control interventions are listed and classified in the companion article, as are the results of the similarity

assessment between sham and tested interventions and differences between therapies.<sup>41</sup> Importantly, average similarity ratings were not significantly different between large and small trials (F(1,197) = 3.56, *P* = 0.061). However, physiotherapy/ rehabilitation trials employed overall more dissimilar sham interventions than spinal manipulation trials, other manual therapies (excluding craniosacral therapy), and trials of spiritual or energetic therapies. Apart from the difference to other manual therapy trials, these differences were still significant when only large trials were tested and when pregnancy- and cancer-related trials were excluded as in our meta-regression analyses below.

## 3.4. Reports of blinding effectiveness

In 19 reports, blinding indices were provided or data were reported in a manner that allowed for calculating the Bang index.<sup>4</sup> These studies were included for meta-analysis.

## 3.5. Reports of expectation of benefit from interventions

Only 6 trials (with 7 control interventions) reported expectancy data in a manner that allowed for data pooling.<sup>10,11,28,29,56,60</sup> Apart from being an excessively small sample for meta-analysis,<sup>13</sup> none of those studies reported significant differences in expectations between groups after an initial exposure to trial

<footnote>* Intervention complexity: single-step or single-technique interventions were judged as "simple," irrespective of how often these were applied, and others as complex. N = 194 unique trials.</footnote>
<figure><img src="image_3.png" /><figcaption>**Figure 1.** PRISMA flow diagram of the systematic search and selection process. Complete search strings per database and a list of all studies excluded at the full-text screening stage are provided in the Supplementary Digital Content file 1, available at http://links.lww.com/PAIN/B675.</figcaption></figure>

interventions. Meta-analysis and regression testing were thus not deemed promising and were not performed. In the remaining 23 trials with some mention of expectation-related assessments, the reasons for noncomparability were (1) inappropriate timepoint of assessments (either unexposed at baseline, or retrospectively after completing multisession treatment programme and thus likely confounded by satisfaction), (2) compound assessment with treatment credibility without individually reporting data of expectancy-only questions,²⁷ (3) confounding expectancy and satisfaction, and (4) insufficient outcome data reporting. More details are presented in Supplementary Digital Content 4, available at http://links.lww.com/PAIN/B678.

## 3.6. Study outcomes

### 3.6.1. Employed outcome measures

The most common unidimensional outcome measures employed were pain intensity rating scales (92%). Pressure pain thresholds were used in 8% of the 168 pairs of active and control interventions with extractable unidimensional outcome measures. Multidimensional outcome measures were available for 130 comparisons. These measures were mainly disability questionnaires (68%), followed by multidimensional pain questionnaires (19%), functional tests (8%), disease activity or symptom scores (5%), and general health questionnaires (2%). Relatively more objective and supposedly pain-related outcome measures were employed in 37% of all trials, including functional tests, disease markers, nerve conduction, autonomic nervous system parameters, brain imaging, work absenteeism, or medication use.

### 3.6.2. Attrition

The difference in percentual attrition (ie, the differential attrition) between active and sham control groups was a mean of 0.4% more in active treatment groups (−0.74 to 1.595% CI, Q(136) = 6054, *P* = 0.51, *T*² = 43.52, *I*² = 97.8%), as estimated with a random-effects model with all studies weighted equally and applied to all large studies irrespective of therapy type (participants = 13,150, studies = 137, not reported in 6 studies). Longer studies reported more percentual attrition (*r*<sub>s</sub>'s(135) = 0.43, *P* < 0.001; 0.42, *P* < 0.001, respectively for active and control groups). Drop-out reasons related to the nature of the control intervention were reported in 9 studies (6.3%).

### 3.6.3. Risk of bias

In studies used for the primary meta-analysis, the overall risk of bias was judged low in 17% of studies, high in 44%, and some concerns existed for 38% (Fig. 2). In the smaller studies, 15% were rated as low risk and 82% high risk, and there were some concerns for 4% (not illustrated).

### 3.6.4. Pain-related outcome measures

Effect sizes (as standardised mean changes [SMC]) could be calculated for 166 intervention-vs-control comparisons for unidimensional outcomes and 125 comparisons using multidimensional outcome measures. Between-groups SMCs are illustrated below per subgroup. For the entire sample, between-group differences were not significantly different when studies were grouped by high, some or low overall risk of bias (unidimensional outcomes: F(2,164) = 1.217, *P* = 0.3.; multidimensional: F(2,123) = 0.231, *P* = 0.79).

## 3.7. Meta-analyses and meta-regression

Of 198 included comparisons, 120 were included in the primary meta-analysis, with a further 49 smaller studies used for secondary sensitivity analyses. Reasons for nonpooling included classification as outlier or apparent data errors (n = 5), patient populations in which no comparable improvements in pain report were expected (n = 8), and therapy subgroups too small for pooling (n = 16) (Fig. 1 – PRISMA flowchart). Because not all studies provided data for each outcome, study numbers in the following analyses vary.

### 3.7.1. Sham control within-group effects (placebo responses)

Across all studies included in the primary meta-analysis, changes from baseline to earliest follow-up within sham control groups had an average SMC effect size of −0.46 (−0.53 to −0.38 95% CI, *P* < 0.0001, *T*² = 0.12, *I*² = 69.9%, participants = 10,557, studies = 112) for unidimensional outcomes and −0.32 (−0.39 to −0.24 95% CI, *P* < 0.0001, *T*² = 0.08, *I*² = 62.06%, participants = 9,447, studies = 95) for multidimensional outcomes, indicating small to moderate placebo responses.

In the following, between-group differences will be presented per therapy subgroup and meta-regression analyses examining the role of different variables in predicting heterogeneity in trial outcomes.
<figure><img src="image_4.png" /><figcaption>**Figure 2.** Risk of bias assessment for all comparisons with 20 or more participants per group (n = 128). Overall risk-of-bias was judged “High” if at least one domain had a rating of high risk-of-bias or if there were concerns in more than one domain. The overall rating of “Some concerns” was given if there were concerns in any one domain, and “Low” if all domains were rated as of low risk-of-bias, as per the Cochrane Risk of Bias tool 2 (RoB 2).⁷¹</figcaption></figure>

### 3.7.2. Spinal manipulation subgroup

With 35 comparisons between an active treatment and a sham control, the overall effect in spinal manipulation trials was -0.36 (SMC) in favour of treatment groups for unidimensional pain

measures (-0.51 to -0.21 95% CI, 3.084 participants, studies = 35, $T^2 = 0.14$, $I^2 = 71.1\%$) (Fig. 3) and -0.26 for multidimensional measures (-0.37 to -0.15 95% CI, participants = 2.384, reported in 24 studies, $T^2 = 0.02$, $I^2 = 26.7\%$) (Fig. 4).

<figure><img src="image_5.png" /><figcaption>**Figure 3.** Spinal manipulation trials, unidimensional outcome measures as standardised mean changes with risk-of-bias assessment per study.</figcaption></figure>
<figure><img src="image_6.png" /></figure>

Risk of bias legend

(A) Domain 1: Randomization

(B) Domain 2: Deviations from intended interventions (effect of adhering to interventions)

(C) Domain 3: Missing outcome data

(D) Domain 4: Measurement of the outcome

(E) Domain 5: Selection of reported result

<caption>**Figure 4.** Spinal manipulation trials, multidimensional outcome measures as standardised mean changes with risk-of-bias assessment per study.</caption>

A meta-regression model with the ratings for the following 3 features was able to predict 59% of the unaccounted between-study variance in unidimensional outcomes: similarity between active and control groups for the (1) number of treatment sessions, (2) the information about intervention efficacy provided to trial participants, and (3) treatment environment (Q[3,31] = 50.33, P < 0.0001, R² = 0.59, participants = 3.084, studies = 35, residual T² = 0.006, residual I² = 10.1%) (Table 2). Differences in the number of sessions was the best predictor of differential outcomes. Exclusion of the 2 studies with the largest effect sizes⁹,³² rendered the model nonfunctional, making necessary the removal of the variable with the least variability (similarity in session number), which then resulted in a model with a reduced but significant predictive value (details not reported in table; Q(2,30) = 7.67, P = 0.02, R² = 0.19, participants = 2.953, studies = 33, residual T² = 0.006, residual I² = 11.0%). A sensitivity analysis with all spinal manipulation therapy trials irrespective of sample size confirmed the validity of the complete model (details not reported in table; Q(3,38) = 43.86, P < 0.0001, R² = 0.48, participants = 3.240, studies = 42, residual T² = 0.02, residual I² = 20.3%).

This model was not able to predict a significant proportion of the variance when applied to between-group differences in

multidimensional outcome measures, such as pain or disability questionnaires (Q(3,20) = 3.59, P = 0.31, R² = 0.15, participants = 2.384, studies = 24, residual T² = 0.00, residual I² = 0%, results not shown in table), also not with small studies included as a sensitivity analysis (Q(3,24) = 3.6, P = 0.31, R² = 0.13, participants = 2.488, studies = 28, residual T² = 0.00, residual I² = 0%). In this model, however, the (dis)similarity in treatment environment was clearly best able to predict outcomes. Simplification of the model to only include this variable improved its ability to account for between-study variance (Q(1,22) = 2.82, P = 0.09, R² = 0.11, residual T² = 0.00, I² = 0%). It needs to be noted, however, that the unexplained variance in effect sizes was low for multidimensional outcomes (I² = 28%, Fig. 4), leaving little scope for meta-regression analyses.

### 3.7.3. Craniosacral therapy trials

The meta-analysis included 13 studies of craniosacral or gentle myofascial interventions. Effect sizes compared with control interventions were -0.52 (-0.84 to -0.2 95% CI, P = 0.001, participants = 1.022, studies = 11, I² = 78.1%) for
<caption>**Table 2**</caption>

Multiple meta-regression analysis, predicting between-study variance in unidimensional outcomes using the level of similarity between active and sham control groups for a number of selected features in spinal manipulation trials.

<table><thead><tr><th colspan="7">Descriptives</th></tr><tr><th>Mean ES</th><th>Mean (SD) similarity rating (n of sessions)</th><th>Mean (SD) similarity rating (efficacy information)</th><th>Mean (SD) similarity rating (environment)</th><th>R<sup>2</sup></th><th>k</th><th></th></tr></thead><tbody><tr><td>-0.33</td><td>1.91 (0.37)</td><td>0.6 (1.03)</td><td>1.43 (0.74)</td><td>0.5934</td><td>35</td><td></td></tr><tr><th colspan="7">Homogeneity analysis</th></tr><tr><th></th><th>Q</th><th>df</th><th>P</th><th>T<sup>2</sup></th><th>I<sup>2</sup></th><th></th></tr><tr><td>Model</td><td>50.33</td><td>3</td><td>0.0000</td><td>0.077</td><td>94.0%</td><td></td></tr><tr><td>Residual</td><td>34.49</td><td>31</td><td>0.30</td><td>0.006</td><td>10.1%</td><td></td></tr><tr><td>Total</td><td>82.15</td><td>34</td><td>0.0000</td><td></td><td></td><td></td></tr><tr><th colspan="7">Regression coefficients</th></tr><tr><th></th><th>B</th><th>SE</th><th>-95% CI</th><th>+95% CI</th><th>Z</th><th>P</th><th>Beta</th></tr><tr><td>Constant</td><td>-2.64</td><td>0.36</td><td>-3.35</td><td>-1.93</td><td>-7.27</td><td>0.0000</td><td>0.0000</td></tr><tr><td>Similarity: N of sessions</td><td>1.09</td><td>0.19</td><td>.72</td><td>1.47</td><td>5.75</td><td>0.0000</td><td>.65</td></tr><tr><td>Similarity: efficacy information</td><td>0.13</td><td>0.05</td><td>0.02</td><td>0.23</td><td>2.3</td><td>0.02</td><td>0.27</td></tr><tr><td>Similarity: environment</td><td>0.07</td><td>0.08</td><td>-0.08</td><td>0.22</td><td>0.89</td><td>0.37</td><td>0.11</td></tr><tr><td colspan="8">Method of moments random effects variance component</td></tr><tr><td colspan="8">v = 0.03</td></tr></tbody></table>

Means and variance of the similarity ratings included in the model are provided, having a possible range of -2 (different for all studies) to 2 (similar across all studies).

unidimensional measures (Fig. 5) and -0.47 (-0.81 to -0.12 95% CI, *P* < 0.0001, participants = 1.162, studies = 13, *I*² = 83.8%) for multidimensional ones (Fig. 6).

During meta-regression modelling for the differences in effects sizes in unidimensional outcomes between craniosacral trials, a model with the similarity ratings “body areas,” “application mode,” and “efficacy information” was found to predict 74% of the heterogeneity between studies (Table 3). Notably, directions of effects were such that trials showed smaller effects if control interventions consisted of devices (different application mode) and if participants were given different information about effectiveness of the study treatments. When similar body areas were treated in both groups, effect sizes were smaller too. In this subgroup, similarity in the number of sessions could not be used as predictor variable because all studies had the same number of treatment sessions between experimental and control groups. Adding 5 smaller studies reduced the usefulness of the model (details not reported in table; Q(3,12) = 3.35, *P* = 0.34, *R*² = 0.15, residual *T*² = 0.04, residual *I*² = 37.9%, participants = 1.146, studies = 16).

For multidimensional outcome measures, the model predicted 38% of the between-studies variance (Q(3,9) = 7.0, *P* = 0.07, *R*² = 0.38, residual *T*² = 0.01, residual *I*² = 21.6%, participants = 1.162, studies = 13, Table 4) and was confirmed in a sensitivity analysis with 2 additional smaller studies (details not reported in table; Q(3,11) = 7.54, *P* = 0.06, *R*² = 0.37, residual *T*² = 0.01, *I*² = 15.2%, participants = 1209, studies = 15).

### 3.7.4. Other manual therapy trials

Meta-analysed trials of other manual therapy encompassed 35 trials of massage, articulation, and manual therapies other than spinal manipulation and craniosacral or gentle myofascial techniques. The combined effect size was -0.72 (-1.02 to -0.42 95% CI, *P* < 0.0001, participants = 2.170, studies = 31,

*I*² = 90%) for unidimensional outcome measures (Fig. 7) and -0.45 (-0.68 to -0.22 95% CI, *P* < 0.0001, participants = 1.647, studies = 22, *I*² = 79%) for multidimensional measures (Fig. 8).

When considering the regression model for this subgroup, it is worthwhile noting that certain similarity parameters had little variability, that is, ratings were consistently high across studies, and were thus unlikely to be of great predictive value in the model. These are “frequency of treatment” (1.97, 0.18 M, SD), “assessments” (1.97, 0.18), “delivery format” (1.97, 0.18), and “follow-up” (2.0, 0.0).

The model with the best fit included 3 covariates: similarity ratings between active and control for “number of sessions,” “efficacy information,” and “environment.” Nonetheless, this model only predicted 16.3% of the unexplained variance in between-group effect size differences measured in unidimensional outcomes (Table 5). To evaluate how dependent those findings were on the large between-group differences seen in some studies, all studies with confidence intervals that were not overlapping with those of the pooled effect³⁵,⁴⁹,⁶⁶,⁶⁷,⁷⁰,⁸⁷ were removed. This did not enhanced the model’s predictive power (details not provided in table; Q(3,16) = 1.07, *P* = 0.78, *R*² = 0.06, residual *T*² = 0.01, residual *I*² = 7.8%, participants = 1.587, studies = 25), highlighting the (dis)similarity in the treatment environment as the most important contributor to the model. A sensitivity analysis including the smaller studies provided similar results (Q(3,48) = 3.58, *P* = 0.31, *R*² = 0.07, residual *T*² = 0.00, residual *I*² = 0%, participants = 2.752, studies = 52).

For multidimensional outcome measures, the above model was better-able to predict between-study variance (Q(3,18) = 9.97, *P* = 0.019, *R*² = 0.37, residual *T*² = 0.0, residual *I*² = 0%, participants = 1.647, studies = 22, Table 6), also in a sensitivity analysis with smaller studies that had multidimensional outcome
<figure><img src="image_7.png" /></figure>

### Risk of bias legend

* (A) Domain 1: Randomization

* (B) Domain 2: Deviations from intended interventions (effect of adhering to interventions)

* (C) Domain 3: Missing outcome data

* (D) Domain 4: Measurement of the outcome

* (E) Domain 5: Selection of reported result

<caption>**Figure 5.** Trials of craniosacral therapies, unidimensional outcome measures as standardised mean changes with risk-of-bias assessment per study.</caption>

measures available ($Q(3,29) = 10.1, P = 0.017, R^2 = 0.2$, residual $T^2 = 0.03$, residual $I^2 = 27.5\%$, participants = 1.957, studies = 33) or when an outlier was removed from the pool of large studies⁸⁸ ($Q(3,17) = 7.66, P = 0.05, R^2 = 0.34$, residual $T^2 = 0.00$, $I^2 = 0\%$, participants = 1.607, studies = 21). In either case, the (dis)similarity in the number of sessions was the best predictor of between-study variance.

### 3.7.5. All manual therapy trials combined

Albeit a more heterogeneous group, we explored if the influential variables from the manual therapy subgroups also had predictive value when applied across spinal manipulation, craniosacral, and other manual therapy interventions. Across 77 studies with a total of 6.276 participants (SMC = -0.53, -0.68 to -0.39 95% CI, $P < 0.0001$, $T^2 = 0.22$, $I^2 = 85.3\%$;

combined forest plots not presented), a combined model with all 5 previously identified covariates predicted 16.9% of between-group variance in effect size, with only the similarity ratings for the number of treatment sessions and the treatment environment adding to the model's predictive power in a noteworthy fashion (Table 7). Including all smaller studies (participants total = 7.138, studies = 110), confirmed the model, again highlighting the outstanding impact on effect sizes when the number of treatment sessions or the treatment environment differ between active and sham control groups ($Q(5,104) = 21.65, P = 0.0006, R^2 = 0.15$, residual $T^2 = 0.012$, residual $I^2 = 13.9\%$). The predictive value of this model was similar for multidimensional outcome measures (Results not shown in figure or table. Large trials only, 59 studies, 5.193 participants; Meta-analysis of combined effect: SMC = -0.35, -0.47 to -0.23 95% CI, $P < 0.0001$, $T^2 = 0.15$,

<figure><img src="image_8.png" /></figure>

### Risk of bias legend

* (A) Domain 1: Randomization

* (B) Domain 2: Deviations from intended interventions (effect of adhering to interventions)

* (C) Domain 3: Missing outcome data

* (D) Domain 4: Measurement of the outcome

* (E) Domain 5: Selection of reported result

<caption>**Figure 6.** Trials of craniosacral therapies, multidimensional outcome measures as standardised mean changes with risk-of-bias assessment per study.</caption>
<caption>**Table 3**</caption>

Multiple meta-regression analysis, predicting between-study variance in unidimensional outcomes using the level of similarity between active and sham control groups for a number of selected features in trials of craniosacral and gentle myofascial treatments.

<table><thead><tr><th colspan="7">Descriptives</th></tr><tr><th>Mean ES</th><th>Mean (SD) similarity rating (body areas)</th><th>Mean (SD) similarity rating (efficacy information)</th><th>Mean (SD) similarity rating (application mode)</th><th>R<sup>2</sup></th><th>K</th></tr></thead><tbody><tr><td>-0.48</td><td>0.18 (1.9)</td><td>0.55 (0.93)</td><td>0.18 (2.1)</td><td>0.7299</td><td>11</td></tr><tr><th colspan="7">Homogeneity analysis</th></tr><tr><th></th><th>Q</th><th>Df</th><th>P</th><th>T<sup>2</sup></th><th>I<sup>2</sup></th></tr><tr><td>Model</td><td>19.25</td><td>3</td><td>0.0002</td><td>0.1</td><td>84.4%</td></tr><tr><td>Residual</td><td>6.77</td><td>7</td><td>0.45</td><td>0.00</td><td>0%</td></tr><tr><td>Total</td><td>26.02</td><td>10</td><td>0.0037</td><td></td><td></td></tr><tr><th colspan="7">Regression coefficients</th></tr><tr><th></th><th>B</th><th>SE</th><th>-95% CI</th><th>+95% CI</th><th>Z</th><th>P</th></tr><tr><td>Constant</td><td>-0.37</td><td>0.11</td><td>-0.6</td><td>-0.14</td><td>-3.18</td><td>0.0015</td><td>0.0</td></tr><tr><td>Similarity: body areas addressed</td><td>0.17</td><td>0.06</td><td>0.06</td><td>0.28</td><td>2.98</td><td>0.0028</td><td>0.62</td></tr><tr><td>Similarity: information about treatment effectiveness provided to participants</td><td>-0.33</td><td>0.14</td><td>-0.61</td><td>-0.05</td><td>-2.34</td><td>0.0195</td><td>-0.54</td></tr><tr><td>Similarity: application mode</td><td>-0.06</td><td>0.06</td><td>-0.18</td><td>0.06</td><td>-1.04</td><td>0.2984</td><td>-0.25</td></tr><tr><td colspan="7">Method of moments random effects variance component</td></tr><tr><td colspan="7">v = 0.04</td></tr></tbody></table>

Means and variance of the similarity ratings included in the model are provided, having a possible range of -2 (different for all studies) to 2 (similar across all studies).

$I^2 = 74.3$; Meta-regression: $Q(5,53) = 17.22$, $P = 0.004$, $R^2 = 0.23$, residual $T^2 = 0.005$, residual $I^2 = 8.72\%$; Sensitivity analysis including small studies: $Q(5,70) = 19.35$, $P = 0.0017$, $R^2 = 0.18$, residual $T^2 = 0.015$, residual $I^2 = 20.4\%$, participants = 5.654, studies = 76).

### 3.7.6. Physical therapy interventions, rehabilitation, and exercise

Sixteen studies with a total of 1.554 participants examined rehabilitation and exercise interventions. Aggregated effect sizes were -0.6 (-0.89 to -0.3 95% CI, $P < 0.0001$, $I^2 = 80\%$) for

<caption>**Table 4**</caption>

Multiple meta-regression analysis, predicting between-study variance in multidimensional outcomes using the level of similarity between active and sham control groups for a number of selected features in trials of craniosacral and gentle myofascial treatments.

<table><thead><tr><th colspan="7">Descriptives</th></tr><tr><th>Mean ES</th><th>Mean (SD) similarity rating (body areas)</th><th>Mean (SD) similarity rating (efficacy information)</th><th>Mean (SD) similarity rating (application mode)</th><th>R<sup>2</sup></th><th>k</th></tr></thead><tbody><tr><td>-0.46</td><td>0.38 (1.9)</td><td>0.46 (0.88)</td><td>0.46 (2.03)</td><td>0.3789</td><td>13</td></tr><tr><th colspan="7">Homogeneity analysis</th></tr><tr><th></th><th>Q</th><th>df</th><th>P</th><th>T<sup>2</sup></th><th>I<sup>2</sup></th></tr><tr><td>Model</td><td>7.0</td><td>3</td><td>0.07</td><td>0.021</td><td>57.1%</td></tr><tr><td>Residual</td><td>11.48</td><td>9</td><td>0.24</td><td>0.013</td><td>21.6%</td></tr><tr><td>Total</td><td>18.48</td><td>12</td><td>0.1</td><td></td><td></td></tr><tr><th colspan="7">Regression coefficients</th></tr><tr><th></th><th>B</th><th>SE</th><th>-95% CI</th><th>+95% CI</th><th>Z</th><th>P</th></tr><tr><td>Constant</td><td>-0.42</td><td>0.19</td><td>-0.79</td><td>-0.06</td><td>-2.25</td><td>0.02</td><td>0.0</td></tr><tr><td>Similarity: body areas addressed</td><td>0.08</td><td>0.1</td><td>-0.12</td><td>0.27</td><td>0.79</td><td>0.43</td><td>0.2</td></tr><tr><td>Similarity: information about treatment effectiveness provided to participants</td><td>0.07</td><td>0.22</td><td>-0.37</td><td>0.5</td><td>0.32</td><td>0.75</td><td>0.08</td></tr><tr><td>Similarity: application mode</td><td>-0.25</td><td>0.1</td><td>-0.44</td><td>-0.05</td><td>-2.47</td><td>0.02</td><td>-0.69</td></tr><tr><td colspan="7">Method of moments random effects variance component</td></tr><tr><td colspan="7">v = 0.27</td></tr></tbody></table>

Means and variance of the similarity ratings included in the model are provided, having a possible range of -2 (different for all studies) to 2 (similar across all studies).
<figure><img src="image_9.png" /></figure>

Risk of bias legend

(A) Domain 1: Randomization

(B) Domain 2: Deviations from intended interventions (effect of adhering to interventions)

(C) Domain 3: Missing outcome data

(D) Domain 4: Measurement of the outcome

(E) Domain 5: Selection of reported result

<caption>**Figure 7.** Other manual therapy trials (ie, excluding spinal manipulation and craniosacral techniques and including massage, articulation etc), unidimensional outcome measures as standardised mean changes with risk-of-bias assessment per study.</caption>

unidimensional measures (Fig. 9) and −0.49 (−0.74 to −0.24 95% CI, *P* < 0.0001, *I*² = 73%) for multidimensional outcomes (Fig. 10).

Surprisingly, in this subgroup, similarity regarding the extent of treatment exposure (“number of sessions”) was not found to reliably inform a potential regression model to predict between-group effect sizes, although large variation existed between studies in how similar active and control groups were for the amount of treatment received; differences in the treatment environment were also not predictive. Instead, (dis)similarity in treatment individualisation and the level of fidelity monitoring predicted 86% of between-group variance in unidimensional outcomes (Table 8). This was confirmed when adding 3 studies with less than 20 participants per arm (Q(2,11) = 13.9, *P* = 0.001, *R*² = 0.61, residual *T*² = 0.0, residual *I*² = 0.0%, participants = 1.251, studies = 15). The small number of studies in this subgroup prevented the addition of further variables to a single model.

There were more studies that provided multidimensional outcome measures than unidimensional outcomes in the rehabilitation and exercise group, resulting in 14 large trials for this analysis (1.257 participants). The same model with similarity in fidelity monitoring and treatment individualisation predicted a nonsignificant proportion (7%) of the variance in between-group differences (Q(2,11) = 1.1, *P* = 0.57, *R*² = 0.1, residual *T*² = 0.015, residual *I*² = 25.1%, no table provided). The model was

further weakened by removing an outlier²⁰ (Q(2,10) = 0.0, *P* = 1.0, *R*² = 0.00, residual *T*² = 0.00, residual *I*² = 2.7%). Adding the 2 small trials available in this group made little difference (Q(2,12) = 1.14, *P* = 0.57, *R*² = 0.08, residual *T*² = 0.01, *I*² = 20.8%, participants = 1.314, studies = 16). Similarity in the number of treatment sessions or treatment environment were again not found to provide any predictive value.

### 3.7.7 Psychological interventions

Nineteen meta-analysed large trials studied psychological or behavioural interventions and employed unidimensional outcomes (effect size −0.34 [−0.50 to −0.19 95% CI], *P* < 0.0001, *I*² = 62%, participants = 2.085, **Figure 11**) and multidimensional measures (−0.2 [−0.32 to −0.08 95% CI], *P* = 0.001, *I*² = 39%, participants = 2.122, studies = 18, **Figure 12**). One study⁵⁹ was removed as an outlier before meta-analysis of multidimensional outcomes.

A multiple meta-regression model with the variables “application mode” and “attention focus/cognitive function” predicted 41.3% of the remaining variance between studies in unidimensional outcomes (Table 9). The model also predicted between-study variance when a small study was added (Q(2,17) = 11.69, *P* = 0.0029, *R*² = 0.41, residual *T*² = 0.00, *I*² = 0.3%, participants = 2.119, studies = 20).
<figure><img src="image_10.png" /></figure>

Risk of bias legend

(A) Domain 1: Randomization

(B) Domain 2: Deviations from intended interventions (effect of adhering to interventions)

(C) Domain 3: Missing outcome data

(D) Domain 4: Measurement of the outcome

(E) Domain 5: Selection of reported result

<caption>**Figure 8.** Other manual therapy trials, multidimensional outcome measures as standardised mean changes with risk-of-bias assessment per study.</caption>

The same model predicted 54% of unexplained heterogeneity in multidimensional outcome measures (Table 10), confirmed by a sensitivity analysis with an additional small study ($Q(2,17) = 6.92, P = 0.031$, residual $T^2 = 0.03$, residual $I^2 = 39.9\%$, participants = 2.241, studies = 20).

### 3.7.8. Blinding index subgroup

The Bang blinding index could be calculated for 18 comparisons between an active and a control intervention. In this subgroup, there were 9 spinal manipulation, 7 other manual therapy trials and one trial each of physiotherapy/rehabilitation and spiritual healing (Reiki). The average sample size at randomization was 64.4 patients (SD 37.4, range 10-154).

As per Colagiuri et al.,²⁵ the blinding indices of each trial's 2 groups were combined as a ratio using Hedge g, with values larger than 0 indicating that participants in the active group were more likely to correctly guess their allocation to the active group than those in the control group, and values below 0 indicating that patients in the sham control group were more likely to wrongly guess that they received an active treatment compared to those in the active group. Having excluded one outlier where blinding was fully unsuccessful,⁸¹ the combined Hedge g was 1.31 favouring participants in the experimental groups guessing

correctly over control participants believing to have received active treatment (unsuccessful or unbalanced blinding [0.2 to 2.43 95% CI, $P = 0.02$, $I^2 = 99.7\%$], participants = 1.013, studies = 17]). Data are presented as a forest plot below (Fig. 13).

A meta-regression model with the similarity variables “sensation” and “application mode” (eg, manual vs device) was able to predict 35% of the unexplained variance between studies ($Q(2,14) = 8.92, P = 0.012$, $R^2 = 0.35$, residual $T^2 = 0.003$, residual $I^2 = 15.1\%$, participants = 1.013, studies = 17, Table 10). Notably, this model was primarily driven by differences in the sensations participants were exposed to. This effect would have been reverted to an emphasis on differences in application modes by including the Walker et al.⁸¹ study (participants = 183), where detuned ultrasound, a handheld device delivering low-force impulses to paraspinal tissues, and random hand placements on the patient's back were used as a sham control for individualised chiropractic treatments ($Q(2,15) = 12.0, R^2 = 0.54, P = 0.002$, residual $T^2 = 0.00$, residual $I^2 = 0\%$). The apparent importance of choosing similar application modes and producing similar sensations in control interventions to achieve balanced blinding was further emphasised by excluding another study with largely unsuccessful blinding: Bennell et al. (2010)⁸ used detuned ultrasound and a nontherapeutic gel to control for standardised manual therapy
<caption>**Table 5**</caption>

**Multiple meta-regression analysis, predicting between-study variance in unidimensional outcomes using the level of similarity between active and sham control groups for a number of selected features in other manual therapy trials.**

<table><thead><tr><th colspan="7">Descriptives</th></tr><tr><th>Mean ES</th><th>Mean (SD) similarity rating (number of sessions)</th><th>Mean (SD) similarity rating (efficacy information)</th><th>Mean (SD) similarity rating (environment)</th><th>R<sup>2</sup></th><th>k</th><th></th></tr></thead><tbody><tr><td>-0.72</td><td>1.81 (0.75)</td><td>0.58 (0.85)</td><td>1.61 (0.62)</td><td>0.1631</td><td>31</td><td></td></tr><tr><th colspan="7">Homogeneity analysis</th></tr><tr><th></th><th>Q</th><th>Df</th><th>P</th><th>T<sup>2</sup></th><th>I<sup>2</sup></th><th></th></tr><tr><td>Model</td><td>5.35</td><td>3</td><td>0.1482</td><td>0.00</td><td>43.9%</td><td></td></tr><tr><td>Residual</td><td>27.43</td><td>27</td><td>0.4408</td><td>0.00</td><td>1.6%</td><td></td></tr><tr><td>Total</td><td>32.78</td><td>30</td><td>0.3324</td><td></td><td></td><td></td></tr><tr><th colspan="7">Regression coefficients</th></tr><tr><th></th><th>B</th><th>SE</th><th>-95% CI</th><th>+95% CI</th><th>Z</th><th>P</th><th>Beta</th></tr><tr><td>Constant</td><td>-1.83</td><td>0.63</td><td>-3.07</td><td>-0.59</td><td>-2.9</td><td>0.0038</td><td>0.00</td></tr><tr><td>Similarity: environment</td><td>0.52</td><td>0.26</td><td>0.01</td><td>1.03</td><td>2.0</td><td>0.0457</td><td>0.36</td></tr><tr><td>Similarity: efficacy information</td><td>0.17</td><td>0.19</td><td>-0.19</td><td>0.54</td><td>0.92</td><td>0.3578</td><td>0.16</td></tr><tr><td>Similarity: number of sessions</td><td>0.1</td><td>0.22</td><td>-0.33</td><td>0.52</td><td>0.44</td><td>0.65</td><td>0.08</td></tr><tr><td colspan="8">Method of moments random effects variance component</td></tr><tr><td colspan="8">v = 0.64</td></tr></tbody></table>

Means and variance of the similarity ratings included in the model are provided, having a possible range of -2 (different for all studies) to 2 (similar across all studies).

and a home exercise programme for shoulder pain in 120 participants (Q(2,13) = 2.25, R² = 0.14, P = 0.32, residual T² = 0.001, residual I² = 4.8%, participants = 893, studies = 16). It is also noteworthy that the trials in this subgroup exposed participants in either group to the same extent of treatment (eg, “number of sessions”) and treatment environment, so that these variables could not be tested for **Table 11**.

In 15 trials (1.084 participants), both the Bang BI and pain-related outcome data were available (estimated aggregated effect size for

unidimensional outcomes: -0.22 [-0.39 to -0.04 95% CI, P = 0.015, T² = 0.05, I² = 43.7%]; multidimensional outcomes: -0.23 [-0.36 to -0.09 95% CI, P = 0.001, T² = 0.00, I² = 9.1%], participants = 1.019, studies = 14). Meta-regression with the BI ratio as a potential predictor of between-group differences showed no relationship between the 2 for unidimensional outcome measures (Q(1,13) = 0.01, R² = 0.001, P = 0.9) or multidimensional outcomes (Q(1,12) = 1.5, R² = 0.12, P = 0.23), which was unsurprising given the small between-study heterogeneity in outcomes.

<caption>**Table 6**</caption>

**Multiple meta-regression analysis, predicting between-study variance in multidimensional outcomes using the level of similarity between active and sham control groups for a number of selected features in other manual therapy trials.**

<table><thead><tr><th colspan="7">Descriptives</th></tr><tr><th>Mean ES</th><th>Mean (SD) similarity rating (number of sessions)</th><th>Mean (SD) similarity rating (efficacy information)</th><th>Mean (SD) similarity rating (environment)</th><th>R<sup>2</sup></th><th>k</th><th></th></tr></thead><tbody><tr><td>-0.37</td><td>1.7 (0.88)</td><td>0.5 (0.8)</td><td>1.6 (0.7)</td><td>0.37</td><td>22</td><td></td></tr><tr><th colspan="7">Homogeneity analysis</th></tr><tr><th></th><th>Q</th><th>Df</th><th>P</th><th>T<sup>2</sup></th><th>I<sup>2</sup></th><th></th></tr><tr><td>Model</td><td>9.97</td><td>3</td><td>0.0188</td><td>0.02</td><td>69.9%</td><td></td></tr><tr><td>Residual</td><td>16.85</td><td>18</td><td>0.5338</td><td>0.00</td><td>0%</td><td></td></tr><tr><td>Total</td><td>26.82</td><td>21</td><td>0.18</td><td></td><td></td><td></td></tr><tr><th colspan="7">Regression coefficients</th></tr><tr><th></th><th>B</th><th>SE</th><th>-95% CI</th><th>+95% CI</th><th>Z</th><th>P</th><th>Beta</th></tr><tr><td>Constant</td><td>-0.27</td><td>0.44</td><td>-1.13</td><td>-0.6</td><td>-0.61</td><td>0.54</td><td>0.0</td></tr><tr><td>Similarity: number of sessions</td><td>-0.34</td><td>0.14</td><td>-0.62</td><td>-0.05</td><td>-2.32</td><td>0.0203</td><td>-0.47</td></tr><tr><td>Similarity: environment</td><td>0.29</td><td>0.19</td><td>-0.08</td><td>0.66</td><td>1.56</td><td>0.12</td><td>0.31</td></tr><tr><td>Similarity: efficacy information</td><td>0.02</td><td>0.15</td><td>-0.27</td><td>0.32</td><td>0.17</td><td>0.87</td><td>0.03</td></tr><tr><td colspan="8">Method of moments random effects variance component</td></tr><tr><td colspan="8">v = 0.22</td></tr></tbody></table>

Means and variance of the similarity ratings included in the model are provided, having a possible range of -2 (different for all studies) to 2 (similar across all studies).
<caption>**Table 7**</caption>

Multiple meta-regression analysis, predicting between-study variance in unidimensional outcomes using the level of similarity between active and sham control groups for a number of selected features in a combined sample of all large manual therapy trials.

<table><thead><tr><th colspan="8">Descriptives</th></tr><tr><th>Mean ES</th><th>Mean (SD) similarity rating (number of sessions)</th><th>Mean (SD) similarity rating (environment)</th><th>Mean (SD) similarity rating (efficacy information)</th><th>Mean (SD) similarity rating (application mode)</th><th>Mean (SD) similarity rating (body areas addressed)</th><th>R<sup>2</sup></th><th>k</th></tr></thead><tbody><tr><td>-0.53</td><td>1.88 (0.5)</td><td>1.47 (0.8)</td><td>1.1 (1.3)</td><td>0.34 (1.7)</td><td>1.4 (0.8)</td><td>0.169</td><td>77</td></tr><tr><th colspan="8">Homogeneity analysis</th></tr><tr><th></th><th>Q</th><th>Df</th><th>P</th><th>T<sup>2</sup></th><th>I<sup>2</sup></th><th></th><th></th></tr><tr><td>Model</td><td>15.94</td><td>5</td><td>0.007</td><td>0.009</td><td>68.6%</td><td></td><td></td></tr><tr><td>Residual</td><td>78.24</td><td>71</td><td>0.26</td><td>0.006</td><td>9.3%</td><td></td><td></td></tr><tr><td>Total</td><td>94.18</td><td>76</td><td>0.077</td><td></td><td></td><td></td><td></td></tr><tr><th colspan="8">Regression coefficients</th></tr><tr><th></th><th>B</th><th>SE</th><th>-95% CI</th><th>+95% CI</th><th>Z</th><th>P</th><th>Beta</th></tr><tr><td>Constant</td><td>-1.57</td><td>0.31</td><td>-2.18</td><td>-0.95</td><td>-5.0</td><td>0.0000</td><td>0.0</td></tr><tr><td>Similarity: number of sessions</td><td>0.33</td><td>0.15</td><td>0.04</td><td>0.62</td><td>2.3</td><td>0.0239</td><td>0.24</td></tr><tr><td>Similarity: environment</td><td>0.28</td><td>0.1</td><td>0.09</td><td>0.47</td><td>2.92</td><td>0.0035</td><td>0.31</td></tr><tr><td>Similarity: efficacy information</td><td>0.09</td><td>0.08</td><td>-0.07</td><td>0.25</td><td>1.13</td><td>0.26</td><td>0.12</td></tr><tr><td>Similarity: application mode</td><td>-0.04</td><td>0.04</td><td>-0.12</td><td>0.05</td><td>-0.85</td><td>0.39</td><td>-0.09</td></tr><tr><td>Similarity: body areas</td><td>-0.03</td><td>0.05</td><td>-0.14</td><td>0.07</td><td>-0.63</td><td>0.53</td><td>-0.31</td></tr><tr><td colspan="8">Method of moments random effects variance component</td></tr><tr><td colspan="8">v = 0.33</td></tr></tbody></table>

Means and variance of the similarity ratings included in the model are provided, having a possible range of -2 (different for all studies) to 2 (similar across all studies).

### 3.7.9. Differential attrition and trial outcomes

Differential attrition did not predict significant between-study variance in trial outcomes in the combined sample for

unidimensional outcomes (Q(1,148) = 3.2, R² = 0.02, P = 0.07, residual T² = 0.02, residual I² = 26.4%, participants = 11.009, studies = 150) or multidimensional measures (Q(1,115)

<figure><img src="image_11.png" /></figure>
<figure><img src="image_12.png" /></figure>

Risk of bias legend

(A) Domain 1: Randomization

(B) Domain 2: Deviations from intended interventions (effect of adhering to interventions)

(C) Domain 3: Missing outcome data

(D) Domain 4: Measurement of the outcome

(E) Domain 5: Selection of reported result

<caption>**Figure 10.** Physical therapy and rehabilitation intervention trials. Between-group differences in multidimensional outcome measures are presented as standardized mean change scores alongside risk-of-bias assessments per study.</caption>

= 0.0, R² = 0.0, P = 0.9, residual T² = 0.03, residual I² = 31.3%, participants = 9.868, studies = 117).

### 3.7.10. Differential attrition and similarity between active and sham control interventions

In a random-effects meta-regression model with all studies weighted equally, a model with 6 similarity ratings was able to

significantly predict 12.7% of the variation in differential drop-outs, with differences in fidelity monitoring contributing most to the model's predictive value (Table 12). A sensitivity analysis with all studies irrespective of sample size confirmed the model, with differences in treatment environment now increasing their contribution to the model (Q(6,143) = 13.2, R² = 0.08, P = 0.04, residual T² = 0.0, residual I² = 0.0%, participants = 11.829, studies = 150, no detail provided in table).

Table 8

Multiple meta-regression analysis, predicting between-study variance in unidimensional outcomes using the level of similarity between active and sham control groups for a number of selected features in a sample of all large physiotherapy and rehabilitation exercise trials.

Descriptives

<table><thead><tr><th>Mean ES</th><th>Mean (SD) similarity rating (individualisation)</th><th>Mean (SD) similarity rating (fidelity monitoring)</th><th>R<sup>2</sup></th><th>k</th></tr></thead><tbody><tr><td>-0.46</td><td>-0.17 (1.3)</td><td>1.0 (1.1)</td><td>0.62</td><td>12</td></tr></tbody></table>

Homogeneity analysis

<table><thead><tr><th></th><th>Q</th><th>Df</th><th>P</th><th>T<sup>2</sup></th><th>I<sup>2</sup></th></tr></thead><tbody><tr><td>Model</td><td>12.28</td><td>2</td><td>0.0022</td><td>0.048</td><td>83.7%</td></tr><tr><td>Residual</td><td>7.67</td><td>9</td><td>0.5678</td><td>0.00</td><td>0%</td></tr><tr><td>Total</td><td>19.95</td><td>11</td><td>0.046</td><td></td><td></td></tr></tbody></table>

Regression coefficients

<table><thead><tr><th></th><th>B</th><th>SE</th><th>-95% CI</th><th>+95% CI</th><th>Z</th><th>P</th><th>Beta</th></tr></thead><tbody><tr><td>Constant</td><td>-0.73</td><td>0.17</td><td>-1.07</td><td>-0.39</td><td>-4.23</td><td>.0000</td><td>0.0</td></tr><tr><td>Similarity: individualisation</td><td>-0.24</td><td>0.11</td><td>-0.45</td><td>-0.3</td><td>-2.2</td><td>0.0276</td><td>-0.56</td></tr><tr><td>Similarity: fidelity monitoring</td><td>0.18</td><td>0.13</td><td>-0.07</td><td>0.42</td><td>1.39</td><td>0.1647</td><td>0.35</td></tr></tbody></table>

Method of moments random effects variance component

v = 0.11

Means and variance of the similarity ratings included in the model are provided, having a possible range of -2 (different for all studies) to 2 (similar across all studies).
<figure><img src="image_13.png" /><figcaption>**Figure 11.** Psychological and behavioural interventions. Between-group differences in unidimensional outcome measures are presented as standardized mean change scores alongside risk-of-bias assessments per study.</figcaption></figure>

## 4. Discussion

Analysing 194 publications, we found moderate placebo responses across physical, psychological, and self-management therapies for pain, with patients in sham control groups improving with an average effect size of 0.46 from pretreatment to the first posttreatment assessment. Benefits of experimental interventions over sham controls ranged from effect sizes of 0.34 in psychological interventions (number needed to treat, NNT ≈ 9) to 0.72 in some manual therapies (NNT ≈ 4),⁵³ with risk-of-bias concerns in most trials. Effect sizes were smaller when multidimensional measures such as disability questionnaires were employed, as opposed to simple pain intensity scales.

In most of the studied intervention subgroups, there was considerable unexplained heterogeneity in trial results between studies. Assessing and rating the level of similarity between experimental and sham control interventions, however, explained some of that heterogeneity. For example, a proportion of variance in trial outcomes was explained by how different tested and control interventions were regarding the number of treatment sessions, application modes, or treatment environment. Furthermore, trials were at a higher risk of differential attrition when there were differences in monitoring of the groups' treatment adherence. In a subgroup of studies where the blinding success of control interventions had been measured, meta-regression analyses were also able to partially predict the risk of unbalanced blinding.

These findings underline the importance of carefully matched experimental and control interventions in efficacy and mechanistic trials. They further provide quantitative evidence that

resemblance in some features may be particularly influential. We identified several features that are commonly assessable from trial reports, capture influential aspects of (dis)similarity, and have little conceptual or practical overlap between each other. These features are the number of treatment sessions, application mode, intervention individualisation, fidelity monitoring, and the treatment environment. These are presented and discussed in Table 13.

The meta-analysis of similarity features was complicated by insufficient reporting, possibly explaining why some features that are commonly deemed important to be matched between study groups did not appear significant in our analyses. This may apply to the (dis)similarity in cointerventions and concomitant treatments³⁶ and personal interactions with staff and providers.⁵,⁴³ The information provided to participants about the supposed efficacy or rationale of the interventions is also rarely reported or must be inferred. Commonly identified as important in the literature,¹⁷,¹⁸,⁵⁵,⁷⁷ our analyses were nonetheless sensitive to this feature. Furthermore, we were unable to ascertain whether the use of different providers for both groups changed trial results because most trials used the same providers or did not report this information.⁴¹ In addition, there are therapy-specific considerations that cannot be reliably captured in a systematic evidence synthesis, for example, the replication of treatment side effects in the control group or the modification of providers' treatment "styles" to individual patients.

Inconsistency in our meta-regression findings may further be linked to the lack of variability in similarity ratings within a given subgroup, little unexplained heterogeneity in pain-related outcomes, or, of course, the possibility that similarity
<figure><img src="image_14.png" /></figure>

Risk of bias legend

(A) Domain 1: Randomization

(B) Domain 2: Deviations from intended interventions (effect of adhering to interventions)

(C) Domain 3: Missing outcome data

(D) Domain 4: Measurement of the outcome

(E) Domain 5: Selection of reported result

**Figure 12.** Psychological and behavioural interventions. Between-group differences in multidimensional outcome measures are presented as standardized mean change scores alongside risk-of-bias assessments per study. The study by Namjoo et al.⁵⁹ is illustrated here but was excluded from the meta-analysis as an outlier (weight in the model = 0%).

Table 9

Multiple meta-regression analysis, predicting between-study variance in unidimensional outcomes using the level of similarity between active and sham control groups for a number of selected features in large trials of psychological and behavioural interventions.

Descriptives

<table><thead><tr><th>Mean ES</th><th>Mean (SD) similarity rating (application mode)</th><th>Mean (SD) similarity rating (attention focus/cognitive function)</th><th>R<sup>2</sup></th><th>k</th></tr></thead><tbody><tr><td>-0.33</td><td>0.84 (1.7)</td><td>-0.26 (1.6)</td><td>0.41</td><td>19</td></tr></tbody></table>

Homogeneity analysis

<table><thead><tr><th></th><th>Q</th><th>Df</th><th>P</th><th>t<sup>2</sup></th><th>I<sup>2</sup></th></tr></thead><tbody><tr><td>Model</td><td>11.48</td><td>2</td><td>0.0032</td><td>0.02</td><td>82.6%</td></tr><tr><td>Residual</td><td>16.3</td><td>16</td><td>0.4222</td><td>0.00</td><td>1.8%</td></tr><tr><td>Total</td><td>27.78</td><td>18</td><td>0.0654</td><td></td><td></td></tr></tbody></table>

Regression coefficients

<table><thead><tr><th></th><th>B</th><th>SE</th><th>-95% CI</th><th>+95% CI</th><th>Z</th><th>P</th><th>Beta</th></tr></thead><tbody><tr><td>Constant</td><td>-0.4</td><td>0.08</td><td>-0.55</td><td>-0.24</td><td>-4.97</td><td>0.0000</td><td>0.0</td></tr><tr><td>Similarity: attention</td><td>0.09</td><td>0.04</td><td>0.006</td><td>0.17</td><td>2.1</td><td>0.036</td><td>0.41</td></tr><tr><td>Similarity: application mode</td><td>0.09</td><td>0.04</td><td>0.002</td><td>0.17</td><td>2.</td><td>0.045</td><td>0.41</td></tr></tbody></table>

Method of moments random effects variance component

$v = 0.03$

Means and variance of the similarity ratings included in the model are provided, having a possible range of -2 (different for all studies) to 2 (similar across all studies).
<caption>**Table 10**</caption>

Multiple meta-regression analysis, predicting between-study variance in multidimensional outcomes using the level of similarity between active and sham control groups for a number of selected features in large trials of psychological and behavioural interventions.

<table><thead><tr><th colspan="7">Descriptives</th></tr><tr><th>Mean ES</th><th>Mean (SD) similarity rating (application mode)</th><th>Mean (SD) similarity rating (attention focus/cognitive function)</th><th>R<sup>2</sup></th><th>k</th><th></th><th></th></tr></thead><tbody><tr><td>-0.3</td><td>0.95 (1.5)</td><td>-0.26 (1.6)</td><td>0.21</td><td>19</td><td></td><td></td></tr><tr><th colspan="7">Homogeneity analysis</th></tr><tr><th></th><th>Q</th><th>Df</th><th>P</th><th>T<sup>2</sup></th><th>I<sup>2</sup></th><th></th></tr><tr><td>Model</td><td>7.18</td><td>2</td><td>0.0276</td><td>0.01</td><td>72.1%</td><td></td></tr><tr><td>Residual</td><td>27.53</td><td>16</td><td>0.036</td><td>0.03</td><td>41.9%</td><td></td></tr><tr><td>Total</td><td>34.71</td><td>18</td><td>0.0103</td><td></td><td></td><td></td></tr><tr><th colspan="7">Regression coefficients</th></tr><tr><th></th><th>B</th><th>SE</th><th>-95% CI</th><th>+95% CI</th><th>Z</th><th>P</th><th>Beta</th></tr><tr><td>Constant</td><td>-0.49</td><td>0.13</td><td>-0.73</td><td>-0.24</td><td>-3.84</td><td>0.0001</td><td>0.0</td></tr><tr><td>Similarity: attention</td><td>0.02</td><td>0.06</td><td>-0.1</td><td>0.15</td><td>0.36</td><td>0.7219</td><td>0.06</td></tr><tr><td>Similarity: application mode</td><td>0.18</td><td>0.07</td><td>0.04</td><td>0.31</td><td>2.515</td><td>0.0109</td><td>0.44</td></tr></tbody></table>

Method of moments random effects variance component

$v = 0.13$

Means and variance of the similarity ratings included in the model are provided, having a possible range of -2 (different for all studies) to 2 (similar across all studies).

for a given item did not influence effect sizes sufficiently to detect a link. Relatedly, the patients' experience may be dominated by different treatment aspects depending on therapy type, possibly explaining why certain features only

significantly predicted study results in individual therapy types. Finally, it could be argued that this review's results may be influenced by publication bias, with negative results less likely to be published.⁶⁵ However, missing small trials will not have

<figure><img src="image_15.png" /></figure>
<caption>**Table 11**</caption>

Multiple meta-regression analysis, predicting between-study variance in the success of blinding using the level of similarity between active and sham control groups for a number of selected features in all trials where Bang blinding index could be calculated (8 spinal manipulation trials, 7 other manual therapy, 1 physiotherapy and rehabilitation exercise, and 1 Reiki intervention).

<table><thead><tr><th colspan="6">Descriptives</th></tr></thead><tbody><tr><th>Mean ES</th><td>1.32</td><td>1.24 (1.15)</td><td>1.71 (0.99)</td><td>0.35</td><td>17</td></tr><tr><th colspan="6">Homogeneity analysis</th></tr><tr><th></th><th>Q</th><th>df</th><th>P</th><th>T<sup>2</sup></th><th>I<sup>2</sup></th></tr><tr><th>Model</th><td>8.92</td><td>2</td><td>0.0116</td><td>0.008</td><td>77.6%</td></tr><tr><th>Residual</th><td>16.48</td><td>14</td><td>0.2847</td><td>0.003</td><td>15.1%</td></tr><tr><th>Total</th><td>25.4</td><td>16</td><td>0.0631</td><td></td><td></td></tr><tr><th colspan="6">Regression coefficients</th></tr><tr><th></th><th>B</th><th>SE</th><th>-95% CI</th><th>+95% CI</th><th>Z</th><th>P</th><th>Beta</th></tr><tr><th>Constant</th><td>3.0</td><td>0.87</td><td>1.27</td><td>4.7</td><td>3.42</td><td>0.0006</td><td>0.0</td></tr><tr><th>Similarity: sensations</th><td>-0.97</td><td>0.52</td><td>-2.0</td><td>0.05</td><td>-1.87</td><td>0.06</td><td>-0.5</td></tr><tr><th>Similarity: application mode</th><td>-0.28</td><td>0.6</td><td>-1.46</td><td>0.91</td><td>-0.46</td><td>0.65</td><td>-0.12</td></tr><tr><td colspan="8">Method of moments random effects variance component</td></tr><tr><td colspan="8">v = 3.09</td></tr></tbody></table>

Means and variance of the similarity ratings included in the model are provided, having a possible range of -2 (different for all studies) to 2 (similar across all studies).

<caption>**Table 12**</caption>

Multiple meta-regression analysis, predicting between-study variance in the level of differential attrition using the level of similarity between active and sham control groups for a number of selected features.

<table><thead><tr><th colspan="7">Descriptives</th></tr></thead><tbody><tr><th>Mean (SD) similarity ratings</th><td>1.69 (0.9)</td><td>0.97 (1.2)</td><td>0.61 (1.0)</td><td>0.5 (1.5)</td><td>0.8 (1.8)</td><td>0.9 (1.5)</td><td>1.2 (1.1)</td></tr><tr><th>Mean ES</th><td></td><td></td><td>R<sup>2</sup></td><td></td><td>k</td><td></td><td></td></tr><tr><th>0.3068</th><td></td><td></td><td>0.127</td><td></td><td>111</td><td></td><td></td></tr><tr><th colspan="7">Homogeneity analysis</th></tr><tr><th></th><th>Q</th><th>df</th><th>P</th><th>T<sup>2</sup></th><th>I<sup>2</sup></th><th>Z</th><th>P</th></tr><tr><th>Model</th><td>15.1</td><td>6</td><td>0.0197</td><td>0.08</td><td>60.2%</td><td></td><td></td></tr><tr><th>Residual</th><td>104.</td><td>104</td><td>0.48</td><td>0.00</td><td>0%</td><td></td><td></td></tr><tr><th>Total</th><td>119.1</td><td>110</td><td>0.26</td><td></td><td></td><td></td><td></td></tr><tr><th colspan="7">Regression coefficients</th></tr><tr><th></th><th>B</th><th>SE</th><th>-95% CI</th><th>+95% CI</th><th>Z</th><th>P</th><th>Beta</th></tr><tr><th>Constant</th><td>-1.13</td><td>1.5</td><td>-4.1</td><td>1.83</td><td>-0.75</td><td>0.45</td><td>0.0</td></tr><tr><th>Similarity: fidelity monitoring</th><td>-2.14</td><td>0.68</td><td>-3.5</td><td>-0.8</td><td>-3.13</td><td>0.0017</td><td>-0.3</td></tr><tr><th>Similarity: application mode</th><td>0.44</td><td>0.45</td><td>-0.45</td><td>1.32</td><td>1.0</td><td>0.34</td><td>0.12</td></tr><tr><th>Similarity: environment</th><td>0.87</td><td>0.7</td><td>-0.51</td><td>2.25</td><td>1.23</td><td>0.22</td><td>0.13</td></tr><tr><th>Similarity: N of sessions</th><td>0.62</td><td>0.86</td><td>-1.06</td><td>2.29</td><td>0.72</td><td>0.47</td><td>0.08</td></tr><tr><th>Similarity: standardisation</th><td>0.57</td><td>0.59</td><td>-0.59</td><td>1.72</td><td>0.96</td><td>0.34</td><td>0.1</td></tr><tr><th>Similarity: participation</th><td>-0.16</td><td>0.53</td><td>-1.19</td><td>0.88</td><td>-0.29</td><td>0.77</td><td>-0.03</td></tr><tr><td colspan="8">Method of moments random effects variance component</td></tr><tr><td colspan="8">v = 46.5</td></tr></tbody></table>

Means and variance of the similarity ratings included in the model are provided, having a possible range of -2 (different for all studies) to 2 (similar across all studies).
<table><caption>**Table 13**

**Overview of sham control design features that were shown to have an impact on trial outcomes.**</caption><thead><tr><td>Control intervention feature and description</td><td>Influence on trial results and discussion</td></tr></thead><tbody><tr><td>Number of treatment sessions<br/>The number of times a patient receives the interventions, both through a provider or self-delivered.</td><td>In our preliminary assessments, we found this feature to be highly correlated with, eg, treatment duration and treatment frequency. We thus suspect the number of treatment sessions to be a good proxy for the extent of treatment received by patients.<br/>It is important to note that differences in the exposure to an intervention often occur not only when patients are asked to attend more clinic appointments than those in the control group but also when they are provided with home exercise or self-management programmes that expose them to higher "dosages" of specific and contextual effects.</td></tr><tr><td>Application mode<br/>The mode or medium through which an intervention is delivered, including telephone, online, hands-on or conversation-based delivery. In this sample, device-based active treatments were not eligible for review, but device-based shams (such as detuned ultrasound) were common.</td><td>Questioning the suitability of sham devices for blinding in non-device RCTs, differences in the "tool" through which active and control interventions are applied lead to less credible control interventions. Regarding effects on trial outcomes, the effect can likely go either way, with more elaborate sham controls leading to smaller between-group differences<sup>33</sup> or undermining through supposed credibility differences. In other words, sham devices do seem to produce comparable placebo effects to respective active interventions but may compromise trials in other ways. The use of sham devices is still common, especially in physiotherapy and nonspinal manipulation trials (see Ref. 41).<br/>In psychological and behavioural interventions, the "application mode" may differ when control interventions rely on print or web-based materials rather than personal interactions.</td></tr><tr><td>Intervention individualisation<br/>The extent to which treatments are personalised or adapted to each patient may reach from fully standardised to highly individualised.</td><td>Likely somewhat overlapping with the concept of treatment standardisation, we found that the extent to which the active and control interventions are individualised to patients can influence trial outcomes. We can only suspect that the individualisation is communicated to the patient verbally and nonverbally, making the patient feel valued more or suppose that the treatment addresses the root cause of their problem. Contrastingly, patients receiving generic control treatment may wonder why symptomatic areas were not touched or topics not addressed that felt relevant to them. Highly standardised interventions of course offer little room for individualisation.</td></tr><tr><td>Patient participation<br/>The level of patients contributing to the intervention, ranging from physically and psychologically passive recipients to largely shaping the intervention themselves.</td><td>Many commonly used control interventions are more passive than the study treatment, especially in physiotherapy, self-management, and exercise trials. Our regression models did not clearly indicate, however, whether different participation levels contribute to differences in pain reports. While patients play an active role in most cognitive, behavioural, and exercise-based interventions for pain, manual therapies can be passive experiences for patients. This allows researchers to employ passive control interventions that match a passive treatment, as reflected by high similarity ratings in this subgroup.</td></tr><tr><td>Fidelity monitoring<br/>Monitoring and potentially promoting treatment adherence by patients or therapists' delivery of interventions according to protocols.</td><td>When the treatment adherence or therapists' intervention provision are ensured more in one group than in the other, patients will likely receive different amounts of active and control care. Differences in fidelity monitoring between groups was influential for differential attrition across all trials. Not only in physiotherapy but also in behavioural interventions, patients often perform (parts of) the intervention under their own supervision, eg, as home-based exercise programmes. Therefore, fidelity monitoring is more relevant than, eg, in most manual therapy scenarios. Potentially, fidelity monitoring itself also acts as an additional contextual factor, ensuring that patients believe that it is important how and how often the intervention is performed.</td></tr><tr><td>Treatment environment<br/>The physical environment in which interventions take place.</td><td>One of the most consistent predictors of between-study variance in pain outcomes, the treatment environment differs, eg, when the active intervention is mainly performed in a healthcare centre and the control intervention at the patient's home or vice versa.<sup>58</sup> Another example is the study by Arcos-Carmona et al. (2011) where the intervention involved aerobic exercise in a swimming pool while the control group received a magnetotherapy sham, lying prone on a treatment bench.<sup>2</sup> Unsurprisingly, this difference in environment comes with large differences in contextual factors that may result in differential placebo effects. While treatment environments were usually similar for all studied therapy types, the consistency with which differences in this feature predicted trial outcomes shows that matching of treatment environments ought to be paramount.</td></tr></tbody></table>

impacted our primary analyses (as these only included trials with more than 20 participants per arm). While we are unable to estimate the impact of missing large trials, we have not made judgements on treatment efficacy so that testing for publication bias was not deemed necessary.

Some of the employed similarity ratings may overlap with supposed "specific" elements of treatments. If, for example, cognitive distraction is a purportedly integral part of the intervention, then of course the similarity rating will be low for this feature and links to trial outcomes may be found. This may have influenced our findings in the subgroup of psychological and behavioural interventions. In this instance, the question of similarity becomes a mechanistic one, demonstrating that treatment mechanisms need to be considered in the design of control interventions and ideally reported. Conversely, mechanisms can potentially be studied using our meta-analytic approach of assessing the predictive role of (dis)similarity between active and control interventions for specific features.

Further important insights of our review relate to the nature of pain-related outcomes employed in RCTs. First, distinguishing unidimensional from multidimensional outcomes enabled us to demonstrate that the latter, more complex outcome measures produce less between-study variance in results, leading to more consistent but smaller effects. Similarly, placebo responses were smaller for multidimensional outcomes. Second, multidimensional outcomes appeared less susceptible to contextual effects produced by differences between active and control interventions. In other words, they may allow for less well-matched control interventions. However, this statement needs to be cautioned because we do not know if there are unidentified confounding factors and because this effect is partly due to the reduced heterogeneity just discussed, weakening our meta-regression models for multidimensional outcome measures.

Apart from the similarity between active and control interventions in efficacy trials, we should consider other sources of heterogeneity in trial outcomes. Patients expectations of benefit regarding the
study treatment and the planned number of provider interactions have been identified as predictors of the placebo response in drug trials.⁶⁹,⁷⁹ Both variables are conceptually related to some of the predictors identified in the present review. Other, psychobiological predictors are known but have not been tested here, including baseline pain, the nature of the studied painful condition, gender, patient personality traits, and different healthcare settings.⁴⁰,⁵¹,⁵⁵,⁷⁹ Of course, differences in intervention efficacy will have contributed to heterogeneity in effect sizes in our, often diverse, intervention subgroups. The same applies to trial-specific risk of bias, which we illustrated but did not formally include in our modelling. To these known predictors of trial outcomes, we have added the insight that resemblance between test and control interventions matters.

It needs to be noted that the prominent role of blinding in clinical trial research has recently been questioned in opinion articles¹ and by a meta-analysis that did not find differences in outcomes between blinded and nonblinded studies.⁵⁷ Our own subgroup analysis in studies reporting on blinding effectiveness indicated a similar direction but small numbers and little between-study heterogeneity prevent firm conclusions. Conversely, our other analyses clearly demonstrated that trial outcomes partly depended on characteristics of control interventions and their similarity to experimental treatments. While this testing did not consider patients' blinding status, a possible mediator of this finding was the placebo effect, rather than knowledge of group allocation. This is supported also by the fact that features known to drive placebo responses were most predictive, namely, the extent of therapeutic interaction, treatment environment, and other features directly affecting the patient experience. Differences in application modes were predictive of pain-related results in some cases, possibly because of differences in placebo responses or because they facilitated unblinding, as was the case in a subgroup of trials where blinding effectiveness was reported. To gain more certainty about the influence of blinding success on trial outcomes, more consistent reporting of blinding effectiveness is required. Nonetheless, we demonstrated that successful blinding is more likely to be achieved with control interventions that resemble experimental treatments. Participant blinding in trials is likely influenced by factors rarely assessable from trial reports, such as staff's compliance with trial procedures, or contact among participants recruited from the same population. Participant blinding is even more challenging in PPS pragmatic and comparative effectiveness trials and is rarely conducted: less than one-quarter of these perform participant blinding.⁴²

Considering our findings and what is known about the power of placebo effects in the absence of blinding ("open-label placebos"),¹²,²²,⁵⁰,⁸² it appears that well-matched control interventions are mainly important to prevent skewed trial results in explanatory trials based on different levels of psychosocial contextual factors. Whether this is independent of blinding effectiveness requires further investigation. A likely mediator of the placebo effect in trials are participants' expectations of benefit.⁶³ Here also, our unsuccessful attempt to compare reports of expectancies highlights a need for homogenisation of methods and reporting. The concept needs to be clearly delineated from treatment credibility and satisfaction, appropriate timepoints and methods of expectancy assessment in trials agreed, and outcome data reported.²⁷

## 5. Conclusions

The present review provides quantitative support for the recommendation that experimental and control interventions

in efficacy and mechanistic trials should be “structurally equivalent”⁵²,⁶⁴ or “indistinguishable”.⁵ Crucially, this review added the insight that similarity in the extent of intervention exposure, treatment environment, and patient experience are the most important considerations. Across different groups of physical, psychological, and self-management interventions, these factors predicted variability in trial results. Differences in these and several other, sometimes therapy-specific considerations can lead to differences in contextual effects and thus biased trial outcomes. Apart from impacting pain-related outcomes, such differences can undermine participant blinding and promote differential attrition. More work is needed to quantify the effects of blinding failure on pain outcomes, suggesting that there is an urgent need to conduct routine assessments of blinding effectiveness in clinical trials. Efforts to promote adequate reporting of control interventions, such as the TIDieR-Placebo checklist,⁴⁴ are welcomed. Nonetheless, more work is required to translate the present findings into evidence-based recommendations for the design, testing, and conduct of control interventions in efficacy and mechanistic RCTs of complex physical, psychological, and self-management interventions for people with pain.

## Conflict of interest statement

Mr Hohenschurz-Schmidt reports support through a PhD Studentship from the Alan and Sheila Diamond Trust for this work and personal fees from Altern Health Ltd, outside the submitted work; Dr. Draper-Rodi reports grants from Alan and Sheila Diamond Charitable Trust, during the conduct of the study; Dr. Scott reports grants from Medical Research Council and Versus Arthritis, and from the National Institute for Health and Care Research, outside the submitted work; Dr. Vollert reports personal fees from Vertex Pharmaceuticals and personal fees from Embody Orthopaedic, outside the submitted work; Prof Rice reports personal fees from IMMPACT and grants from the Alan and Sheila Diamond Trust during the conduct of the study, and personal fees from Imperial Consultants, personal fees from MD Anderson Cancer Center, other from spinifex, other from Medicines and Healthcare products Regulatory Agency (MHRA), and Commission on Human Medicines - Neurology, Pain & Psychiatry Expert Advisory Group, all outside the submitted work; In addition, Dr. Rice has a patent WO 2005/079771 & a patent EP13702262.0/ WO2013 110945 pending. All other authors report that they have no conflicts of interest.

## Acknowledgements

The authors thank all additional volunteers who did not complete the training or the screening and data extraction, the participants from a parallel Delphi process who were presented with the systematic review and provided feedback on methods, Prof Ben Colagiuri's group for facilitating the blinding index calculation, and Dr Heike Gerger for assisting with the meta-analysis methods. The PhD position supporting this work was funded by the Alan and Sheila Diamond Charitable Trust. This work has not been presented publicly or published elsewhere. Data have been used to inform a guideline development process, results of which have not been publicised yet. All listed authors have contributed substantially to the project and fulfil ICMJE criteria. No approval from an ethics committee was required.
# Appendix A. Supplemental digital content

Supplemental digital content associated with this article can be found online at http://links.lww.com/PAIN/B675, http://links.lww.com/PAIN/B676, http://links.lww.com/PAIN/B677 and http://links.lww.com/PAIN/B678.

## Article history:

Received 13 October 2021

Received in revised form 16 May 2022

Accepted 25 June 2022

Available online 11 July 2022

## References

[1] Anand R, Norrie J, Bradley JM, McAuley DF, Clarke M. Fool's gold? Why blinded trials are not always best. BMJ 2020;368:i6228.

[2] Arcos-Carmona IM, Castro-Sanchez AM, Mataran-Penarrocha GA, Gutierrez-Rubio AB, Ramos-Gonzalez E, Moreno-Lorenzo C. Effects of aerobic exercise program and relaxation techniques on anxiety, quality of sleep, depression, and quality of life in patients with fibromyalgia: a randomized controlled trial. [Efectos de un programa de ejercicios aerobicos y tecnicas de relajacion sobre el estado de ansiedad, calidad del sueno, depresion y calidad de vida en pacientes con fibromialgia]. ensayo clinico aleatorizado 2011;137:398-401.

[3] Aycock DM, Hayat MJ, Helvig A, Dunbar SB, Clark PC. Essential considerations in developing attention control groups in behavioral research. Res Nurs Health 2018;41:320-8.

[4] Bang H, Ni L, Davis CE. Assessment of blinding in clinical trials. Controlled Clin Trials 2004;25:143-56.

[5] Baskin TW. Tierney SC, Minami T, Wampold BE. Establishing specificity in psychotherapy: a meta-analysis of structural equivalence of placebo controls. J Consulting 2003;71:973-9.

[6] Beard DJ, Campbell MK, Blazeby JM, Carr AJ, Weijer C, Cuthbertson BH, Buchbinder R, Pinkney T, Bishop FL, Pugh J, Cousins S, Harris IA, Lohmander LS, Blencowe N, Gillies K, Probst P, Brennan C, Cook A, Farrar-Hockley D, Savulescu J, Huxtable R, Rangan A, Tracey I, Brocklehurst P, Ferreira ML, Nicholl J, Reeves BC, Hamdy F, Rowley SC, Cook JA. Considerations and methods for placebo controls in surgical trials (ASPIRE guidelines). Lancet 2020;395:828-38.

[7] Benedetti F, Amanzio M. Mechanisms of the placebo response. Pulm Pharmacol Ther 2013;26:520-3.

[8] Bennett K, Wee E, Coburn S, Green S, Harris A, Staples M, Forbes A, Buchbinder R. Efficacy of standardised manual therapy and home exercise programme for chronic rotator cuff disease: randomised placebo controlled trial. BMJ 2010;340:c2756.

[9] Bernal-Utrera C, Gonzalez-Gerez JJ, Saavedra-Hernandez M, Lerida-Ortega MA, Rodriguez-Blanco C. Manual therapy versus therapeutic exercise in non-specific chronic neck pain: study protocol for a randomized controlled trial. Trials 2019;20:487.

[10] Bialosky JE, Bishop MD, Price DD, Robinson ME, Vincent KR, George SZ. A randomized sham-controlled trial of a neurodynamic technique in the treatment of carpal tunnel syndrome. J orthopaedic Sports Phys Ther 2009;39:709-23.

[11] Bialosky JE, George SZ, Horn ME, Price DD, Staud R, Robinson ME. Spinal manipulative therapy-specific changes in pain sensitivity in individuals with low back pain (NCT01168999). J pain : official J Am Pain Soc 2014;15:136-48.

[12] Blease CR, Bernstein MH, Locher C. Open-label placebo clinical trials: is it the rationale, the interaction or the pill? BMJ Evidence-Based Med 2020;25:159-65.

[13] Borenstein M, Hedges LV, Higgins JPT, Rothstein HR. Introduction to Meta-Analysis. Hoboken, NJ: John Wiley & Sons, 2021.

[14] Boutron I, Altman DG, Moher D, Schulz KF, Ravaud P; for the CONSORT NPT Group. CONSORT statement for randomized trials of nonpharmacologic treatments: a 2017 update and a CONSORT extension for nonpharmacologic trial abstracts. Ann Intern Med 2017; 167:40.

[15] Boutron I, Moher D, Altman DG, Schulz KF, Ravaud P; for the CONSORT Group. Extending the CONSORT statement to randomized trials of nonpharmacologic treatment: explanation and elaboration. Ann Intern Med 2008;148:295.

[16] Boutron I, Tubach F, Giraudeau B, Ravaud P. Blinding was judged more difficult to achieve and maintain in nonpharmacologic than pharmacologic trials. J Clin Epidemiol 2004;57:543-50.

[17] Braithwaite FA, Walters JL, Moseley GL, Williams MT, McEvoy MP. Towards more credible shams for physical interventions: a Delphi survey. Clinical Trials 2020;17:1740774520910365.

[18] Braithwaite FA, Walters JL, Moseley GL, Williams MT, McEvoy MP. Towards more homogenous and rigorous methods in sham-controlled dry needling trials: Two Delphi surveys. Physiotherapy 2019;106:12-23.

[19] Brose SW, Jennings DC, Kwok J, Stuart CL, O'Connell SM, Pauli HA, Liu B. Sham manual medicine protocol for cervical strain-counterstrain research. PMR 2013;5:400-7.

[20] Cacchio A, De Blasis E, De Blasis V, Santilli V, Spacca G. Mirror therapy in complex regional pain syndrome type 1 of the upper limb in stroke patients. Neurorehabil Neural Repair 2009;23:792-9.

[21] Campbell MK, Entwistle VA, Cuthbertson BH, Skea ZC, Sutherland AG, McDonald AM, Norrie JD, Carlson RV, Bridgman S; study group KORAL. Developing a placebo-controlled trial in surgery: issues of design, acceptability and feasibility. Trials 2011;12:50.

[22] Carvalho C, Pais M, Cunha L, Rebouta P, Kaptchuk TJ, Kirsch I. Open-label placebo for chronic low back pain: a 5-year follow-up. PAIN 2021; 162:1521-7.

[23] Cerritelli F, Verzella M, Cicchitti L, D'Alessandro G, Vanacore N. The paradox of sham therapy and placebo effect in osteopathy. Medicine (Baltimore) 2016;95:e4728.

[24] Chaibi A, Saltyté Benth J, Bjorn Russell M. Validation of placebo in a manual therapy randomized controlled trial. Sci Rep 2015;5:11774.

[25] Colagiuri B, Sharpe L, Scott A. The blind leading the not-so-blind: a meta-analysis of blinding in pharmacological trials for chronic pain. J Pain 2019; 20:489-500.

[26] Colloca L. The placebo effect in pain therapies. Annu Rev Pharmacol Toxicol 2019;59:191-211.

[27] Constantino MJ, Vislå A, Coyne AE, Boswell JF. A meta-analysis of the association between patients' early treatment outcome expectation and their posttreatment outcomes. Psychotherapy 2018;55:473-85.

[28] Coste J, Medkour T, Maigne JY, Pérez M, Laroche F, Perrot S. Osteopathic medicine for fibromyalgia: a sham-controlled randomized clinical trial. Ther Adv Musculoskelet 2021;13:1759720X211009017.

[29] Curtis P, Gaylord SA, Park J, Faurot KR, Coble R, Suchindran C, Coeytaux RR, Wilkinson L, Mann JD. Credibility of low-strength static magnet therapy as an attention control intervention for a randomized controlled study of CranioSacral therapy for migraine headaches. J Altern Complement Med (New York, NY) 2011;17:711-21.

[30] Dechartres A, Trinquart L, Boutron I, Ravaud P. Influence of trial sample size on treatment effect estimates: meta-epidemiological study. BMJ 2013;346: f2304. doi: 10.1136/bmj.f2304

[31] Eccleston C, Hearn L, Williams AC. Psychological therapies for the management of chronic neuropathic pain in adults. Cochrane Database Syst Rev 2015:CD011259.

[32] Elleuch M, Ghroubi S. Vertebral manipulation in chronic low back pain: a prospective randomised study of 85 cases. Int Musculoskelet Med 2009; 31:57-62.

[33] Faltinsen E, Todorovac A, Bruun LS, Hróbjartsson A, Gluud C, Kongerslev MT, Simonsen E, Storebø OJ. Control interventions in randomised trials among people with mental health disorders. Cochrane Database Syst Rev 2022;4:MR000050.

[34] Felson DT, Redmond AC, Chapman GJ, Smith TO, Hamilton DF, Jones RK, Holt CA, Callaghan MJ, Mason DJ, Conaghan PG. Recommendations for the conduct of efficacy trials of treatment devices for osteoarthritis: a report from a working group of the Arthritis Research UK Osteoarthritis and Crystal Diseases Clinical Studies Group. Rheumatology (Oxford) 2016;55:320-6.

[35] González ÁC, Berenguer SB, Luque Mañas JM, Martin-Pintado-Zugasti A. Validation of a sham novel neural mobilization technique in patients with non-specific low back pain: a randomized, placebo-controlled trial. Musculoskelet Sci Pract 2021;53:102378.

[36] Grovle L, Hasvik E, Haugen AJ. Rescue and concomitant analgesics in placebo-controlled trials of pharmacotherapy for neuropathic pain and low back pain. PAIN 2020;161:3-10.

[37] Guyatt GH, Oxman AD, Montori V, Vist G, Kunz R, Brozek J, Alonso-Coello P, Djulbegovic B, Atkins D, Falck-Ytter Y, Williams JW, Meerpohl J, Norris SL, Akl EA, Schünemann HJ. GRADE guidelines: 5. Rating the quality of evidence—publication bias. J Clin Epidemiol 2011;64:1277-82.

[38] Hall S, Lewith G, Brien S, Little P. An exploratory pilot study to design and assess the credibility of a sham kinesiology treatment. Forschende Komplementarmedizin 20062008;15:321-6.

[39] Hart T, Bagiella E. Design and implementation of clinical trials in rehabilitation research. Arch Phys Med Rehabil 2012;93:S117-26.
[40] Häuser W, Bartram-Wunn E, Bartram C, Reinecke H, Tölle T. Systematic review: placebo response in drug trials of fibromyalgia syndrome and painful peripheral diabetic neuropathy—magnitude and patient-related predictors. PAIN 2011;152:1709–17.

[41] Hohenschurz-Schmidt D, Draper-Rodi J, Vase L, Scott W, McGregor A, Soliman N, MacMillan A, Olivier A, Cherian CA, Corcoran D, Abbey H, Freigang S, Chan J, Phillip J, Sørensen LN, Delafin M, Baptista M, Medforth N, Ruffini N, Andresen SS, Ytter S, Ali D, Hobday H, Santosa AA, Vollert J, Rice AS. Blinding and sham control methods in trials of physical, psychological, and self-management interventions for pain (article I): a systematic review and description of methods. PAIN 2023;164:469–84.

[42] Hohenschurz-Schmidt D, Kleykamp BA, Draper-Rodi J, Vollert J, Chan J, Ferguson M, McNicol E, Phalip J, Evans SR, Turk DC, Dworkin RH, Rice ASC. Pragmatic trials of pain therapies: a systematic review of methods. PAIN 2022;163:21-46.

[43] Howe LC, Goyer JP, Crum AJ. Harnessing the placebo effect: exploring the influence of physician characteristics on placebo response. Health Psychol 2017;36:1074–82.

[44] Howick J, Webster RK, Rees JL, Turner R, Macdonald H, Price A, Evers AWM, Bishop F, Collins GS, Bokelmann K, Hopewell S, Knottnerus A, Lamb S, Madigan C, Napadow V, Papanikitas AN, Hoffmann T. TIDieR-Placebo: a guide and checklist for reporting placebo and sham controls. PLOS Med 2020;17:e1003294.

[45] Hróbjartsson A, Emanuelsson F, Skou Thomsen AS, Hilden J, Brorson S. Bias due to lack of patient blinding in clinical trials. A systematic review of trials randomizing patients to blind and nonblind sub-studies. Int J Epidemiol 2014;43:1272–83.

[46] Kaptchuk TJ, Stason WB, Davis RB, Legedza ART, Schnyzer RN, Kerr CE, Stone DA, Nam BH, Kirsch I, Goldman RH. Sham device v inert pill: randomised controlled trial of two placebo treatments. BMJ 2006;332:391–7.

[47] Kawchuk GN, Haugen R, Fritz J. A true blind for subjects who receive spinal manipulation therapy. Arch Phys Med Rehabil 2009;90:366–8.

[48] Koshi EB, Short CA. Placebo theory and its implications for research and clinical practice: a review of the recent literature. Pain Pract 2007;7:4–20.

[49] Licciardone JC, Buchanan S, Hensel KL, King HH, Fulda KG, Stoll ST. Osteopathic manipulative treatment of back pain and related symptoms during pregnancy: a randomized controlled trial. Am J Obstet Gynecol 2010;202:43.e1–8.

[50] Locher C, Frey Nascimento A, Kirsch I, Kossowsky J, Meyer A, Gaab J. Is the rationale more important than deception? A randomized controlled trial of open-label placebo analgesia. PAIN 2017;158:2320–8.

[51] Macedo A, Farré M, Baños JE. A meta-analysis of the placebo response in acute migraine and how this response may be influenced by some of the characteristics of clinical trials. Eur J Clin Pharmacol 2006;62:161–72.

[52] Machado LAC, Kamper SJ, Herbert RD, Maher CG, McAuley JH. Imperfect placebos are common in low back pain trials: a systematic review of the literature. Eur Spine J 2008;17:889–904.

[53] Magnusson K. Interpreting Cohen's d effect size: An interactive viusualization (Version 2.5.0) [Web App]. R Psychologist 2021. Available at: https://rpsychologist.com/cohend/. Accessed June 30, 2021.

[54] Meissner K, Fässler M, Rücker G, Kleijnen J, Hróbjartsson A, Schneider A, Antes G, Linde K. Differential effectiveness of placebo treatments: a systematic review of migraine prophylaxis. JAMA Intern Med 2013;173:1941–51.

[55] Meissner K, Linde K. Chapter fourteen—are blue pills better than green? How treatment features modulate placebo effects. In: Int Rev Neurobiol Neurobiol Placebo Effect Part. Colloca L, ed. Vol 139. Academic Press, 2018; 357–78.

[56] Michener LA, Kardouni JR, Sousa CO, Ely JM. Validation of a sham comparator for thoracic spinal manipulation in patients with shoulder pain. Man Ther 2015;20:171–5.

[57] Moustgaard H, Clayton GL, Jones HE, Boutron I, Jørgensen L, Laursen DLT, Olsen MF, Paludan-Müller A, Ravaud P, Savović J, Sterne JAC, Higgins JPT, Hróbjartsson A. Impact of blinding on estimated treatment effects in randomised clinical trials: meta-epidemiological study. BMJ 2020;368:l6802.

[58] Mulroy SJ, Thompson L, Kemp B, Hatchett PP, Newsam CJ, Lupold DG, Haubert LL, Eberly V, Ge T-T, Azen SP, Winstein CJ, Gordon J. Physical Therapy Clinical Research N. Strengthening and optimal movements for painful shoulders (STOMPS) in chronic spinal cord injury: a randomized controlled trial. Phys Ther 2011;91:305–24.

[59] Namjoo S, Borjali A, Seirafi M, Assarzadegan F. Use of mindfulness-based cognitive therapy to change pain-related cognitive processing in patients with primary headache: a randomized trial with attention placebo control group. Anesthesiology Pain Med 2019;9:e91927.

[60] Nicholas MK, Asghari A, Blyth FM, Wood BM, Murray R, McCabe R, Brnabic A, Beeston L, Corbett M, Sherrington C, Overton S. Self-

management intervention for chronic pain in older adults: a randomised controlled trial. PAIN 2013;154:824–35.

[61] Ojanen M. Can the true effects of exercise on psychological variables be separated from placebo effects? Int J Sport Psychol 1994;25: 63–80.

[62] Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, Shamseer L, Tetzlaff JM, Akl EA, Brennan SE, Chou R, Glanville J, Grimshaw JM, Hróbjartsson A, Lalu MM, Li T, Loder EW, Mayo-Wilson E, McDonald S, McGuinness LA, Stewart LA, Thomas J, Tricco AC, Welch VA, Whiting P, Moher D. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ 2021;372:n71.

[63] Peerdeman KJ, van Laarhoven AIM, Keij SM, Vase L, Rovers MM, Peters ML, Evers AWM. Relieving patients' pain with expectation interventions: a meta-analysis. PAIN 2016;157:1179–91.

[64] Puhl AA, Reinhart CJ, Doan JB, Vernon H. The quality of placebos used in randomized, controlled trials of lumbar and pelvic joint thrust manipulation-a systematic review. Spine J 2017;17:445–56.

[65] Roest AM, de Jonge P, Williams CD, de Vries YA, Schoevers RA, Turner EH. Reporting bias in clinical trials investigating the efficacy of second-generation antidepressants in the treatment of anxiety disorders: a report of 2 meta-analyses. JAMA Psychiatry 2015;72:500–10.

[66] Rosario JL. Relief from back pain through postural adjustment: a controlled clinical trial of the immediate effects of muscular chains therapy (MCT). Int J Ther massage bodywork 2014;7:2–6.

[67] do Rosario JLP, Orcesi LS, Kobayashi FN, Aun AN, Assumpcao IT Diolindo, Blasioli GJ, Hanada ES. The immediate effects of modified Yoga positions on musculoskeletal pain relief. J Bodywork Mov Therapies 2013;17:469–74.

[68] Safer DL, Hugo EM. Designing a control for a behavioral group therapy. Behav Ther 2006;37:120–30.

[69] Sanders AE, Slade GD, Fillingim RB, Ohrbach R, Arbes SJ Jr, Tchivileva IE. Effect of treatment expectation on placebo response and analgesic efficacy: a secondary aim in a randomized clinical trial. JAMA Netw Open 2020;3:e202907.

[70] Snodgrass SJ, Rivett DA, Sterling M, Vicenzino B. Dose optimization for spinal treatment effectiveness: a randomized controlled trial investigating the effects of high and low mobilization forces in patients with neck pain. J orthopaedic Sports Phys Ther 2014;44:141–52.

[71] Sterne JAC, Savović J, Page MJ, Elbers RG, Blencowe NS, Boutron I, Cates CJ, Cheng H-Y, Corbett MS, Eldridge SM, Emberson JR, Hernán MA, Hopewell S, Hróbjartsson A, Junqueira DR, Jüni P, Kirkham JJ, Lasserson T, Li T, McAleenan A, Reeves BC, Shepperd S, Shrier I, Stewart LA, Tilling K, White IR, Whiting PF, Higgins JPT. RoB 2: a revised tool for assessing risk of bias in randomised trials. BMJ 2019; 366:i4898.

[72] The Cochrane Collaboration. Review Manager 5 (RevMan 5). The Cochrane Collaboration, 2020. Available at: https://training.cochrane.org/online-learning/core-software-cochrane-reviews/revman/revman-5-download. Accessed January 6, 2021.

[73] Tough EA, White AR, Richards SH, Lord B, Campbell JL. Developing and validating a sham acupuncture needle. Acupunct Med 2009;27: 118–22.

[74] Turk DC, Dworkin RH, Allen RR, Bellamy N, Brandenburg N, Carr DB, Cleeland C, Dionne R, Farrar JT, Galer BS, Hewitt DJ, Jadad AR, Katz NP, Kramer LD, Manning DC, McCormick CG, McDermott MP, McGrath P, Quessy S, Rappaport BA, Robinson JP, Royal MA, Simon L, Stauffer JW, Stein W, Tollett J, Witter J. Core outcome domains for chronic pain clinical trials: IMPACT recommendations. PAIN 2003;106:337–45.

[75] Turner JA, Deyo RA, Loeser JD, Von Korff M, Fordyce WE. The importance of placebo effects in pain treatment and research. JAMA 1994;271:1609–14.

[76] Vase L. Can insights from placebo and nocebo mechanism studies help improve randomized controlled trials? Clin Pharmacol Ther 2019;106: 1169-71.

[77] Vase L, Baram S, Takakura N, Takayama M, Yajima H, Kawase A, Schuster L, Kaptchuk TJ, Schou S, Jensen TS, Zachariae R, Svensson P. Can acupuncture treatment Be double-blinded? An evaluation of double-blind acupuncture treatment of postoperative pain. PLOS ONE 2015;10:e0119612.

[78] Vase L, Petersen GL, Riley JLI, Price DD. Factors contributing to large analgesic effects in placebo mechanism studies conducted between 2002 and 2007. PAIN 2009;145:36–44.

[79] Vase L, Vollert J, Finnerup NB, Miao X, Atkinson G, Marshall S, Nemeth R, Lange B, Liss C, Price DD, Maier C, Jensen TS, Segerdahl M. Predictors of the placebo analgesia response in randomized controlled trials of chronic pain: a meta-analysis of the individual data from nine industrially sponsored trials. PAIN 2015;156:1795–802.
[80] Vernon HT, Triano JJ, Ross JK, Tran SK, Soave DM, Dinulos MD. Validation of a novel sham cervical manipulation procedure. Spine J 2012;12:1021-8.

[81] Walker BF, Hebert JJ, Stomski NJ, Losco B, French SD. Short-term usual chiropractic care for spinal pain: a randomized controlled trial. Spine 2013;38:2071-8.

[82] von Wernsdorff M, Loef M, Tuschen-Caffier B, Schmidt S. Effects of open-label placebos in clinical trials: a systematic review and meta-analysis. Scientific Rep 2021;11:3855.

[83] Whalley B, Hyland ME, Kirsch I. Consistency of the placebo effect. J Psychosomatic Res 2008;64:537-41.

[84] Williams ACdeC, Fisher E, Hearn L, Eccleston C. Evidence-based psychological interventions for adults with chronic pain: precision, control, quality, and equipoise. PAIN 2021;160:2149-53.

[85] Williams ACdeC, Fisher E, Hearn L, Eccleston C. Psychological therapies for the management of chronic pain (excluding headache) in adults. Cochrane Database Syst Rev 2020;8:CD007407.

[86] Wilson DB. SPSS for Windows Meta-Analysis Macros, 2005. Available at: http://mason.gmu.edu/~dwilsonb/ma.html.

[87] Wolny T, Linek P. Neurodynamic techniques versus “sham” therapy in the treatment of carpal tunnel syndrome: a randomized placebo-controlled trial. Arch Phys Med Rehabil 2018;99:843-54.

[88] Zemadanis K, Betsos T, Mandalidis D. The short and long-term effect of weight-bearing mobilization-with-movement (MWM) and automobilization-MWM techniques on pain and functional status in patients with hip osteoarthritis. Int J Physiotherapy 2017;4:160-7.

[89] Zhang W, Robertson J, Jones AC, Dieppe PA, Doherty M. The placebo effect and its determinants in osteoarthritis: meta-analysis of randomised controlled trials. Ann Rheum Dis 2008;67:1716-23.