Statistics from Altmetric.com
QUESTIONS: In patients with various clinical conditions, what is the clinical effect of placebo as a treatment for disease? Does the effect differ for subjective and objective outcomes?
Trials published before the end of 1998 were identified by searching Medline, EMBASE/Excerpta Medica, PsycLIT, Biological Abstracts, and the Cochrane Controlled Trials Register. The search terms were synonyms of placebo, no treatment, and randomised clinical trial. Reference lists of included trials and selected review articles and books were reviewed, and experts were contacted.
Studies were selected if patients were randomly allocated to a placebo group or an untreated group. Exclusion criteria were unconcealed randomisation, sample of paid or healthy volunteers, non-blinding of assessors of objective outcomes, >50% dropouts, or if the alleged placebo had a clinical effect not associated with the treatment ritual alone.
Data were extracted using predetermined forms. Primary outcome of interest was the main outcome defined by the trial author or if not defined, the most clinically relevant outcome.
114 trials published from 1946–98 were included in the analysis. The typical placebo for drugs was a lactose tablet; for physical interventions, the procedure done with a machine turned off; and for psychological interventions, an attention placebo. 40 clinical conditions were investigated.
Meta-analysis showed that placebo did not differ from no treatment for binary outcomes (32 trials, n=3795), regardless of whether outcomes were subjective (23 trials, n=1928) or objective (9 trials, n=1867); significant heterogeneity existed among trials (p=0.003). Placebo did not differ from no treatment in trials assessing nausea (3 trials, n=182), smoking cessation relapse (6 trials, n=887), or depression (3 trials, n=152).
Meta-analysis showed that placebo was more effective than no treatment for continuous outcomes overall (82 trials, n=4730) and for subjective continuous outcomes only (53 trials, n=3081) (table); placebo did not differ from no treatment when considering objective continuous outcomes only (29 trials, n=1649). Significant heterogeneity existed among trials (p<0.001), and magnitude of placebo effect decreased with increasing sample size (p=0.05). Of trials assessing continuous outcomes, placebo was more effective than no treatment for pain (27 trials, n=1602) (table), but not for obesity (5 trials, n=128), asthma (3 trials, n=81) hypertension (7 trials, n=129), insomnia (5 trials, n=100), or anxiety (6 trials, n=257).
Placebo was more effective than no treatment in trials assessing continuous subjective outcomes and in trials assessing treatment of pain. Placebo and no treatment did not differ in trials assessing objective or subjective binary outcomes or objective continuous outcomes.
This meta-analysis by Hróbjartsson and Gøtzsche is controversial both theoretically and practically. Theoretical difficulties may be highlighted by the fact that the very authors of this epoch making meta-analysis once argued that placebo is undefinable1 and that the placebo effect is uncontrollable (ie, any comparison would underestimate it).2 The all sweeping nature of the conclusions in the original paper is also questionable: a meta-analytic summary is justified insofar as a more or less similar magnitude of effect can be expected across the range of patients, the range of interventions, and the range of outcomes for the included studies. May we expect such similar effects of comparisons of placebo and no treatment for smoking, nausea, infertility, infection, Parkinson′s disease, etc? In my opinion, the abstract above, independently prepared by the editorial office of this journal, is a better summary.
Practically then, it appears wise to concentrate on the substantive areas in which practising clinicians may be interested. For pain, the pooled standardised mean difference (SMD) was −0.27 (95% CI −0.40 to −0.15); the point estimate suggests a small effect, but the 95% CI is such that one cannot rule out the possibility of a moderate effect. For insomnia, the SMD was −0.26 (CI −0.66 to 0.13); for anxiety, it was −0.06, (CI −0.31 to 0.18). The confidence intervals are too wide to rule out a large to moderate effect. For all the other clinical questions within mental health, ≤3 RCTs were available.
On the basis of the present state of knowledge, we cannot claim that we could use“placebo treatment”for depression or anxiety.3 Nor should we talk about maximising placebo effects in our treatment unless good evidence exists to show that we really can do so.4 We are still in need of more research on placebo effects within mental health.
Sources of funding: no external funding.
A modified version of this abstract and commentary appears in Evidence-Based Medicine.
For correspondence: Dr A Hróbjartsson, Department of Medical Philosophy and Clinical Theory, University of Copenhagen, Panum Institute, Blegdamsvej 3, DK-2200, Copenhagen N, Denmark. Fax +45 3545 7007.
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.