Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Comment
. 2002:2:3.
doi: 10.1186/1471-2288-2-3. Epub 2002 Jan 25.

Meta-analysis, Simpson's paradox, and the number needed to treat

Douglas G Altman  1 , Jonathan J Deeks
Affiliations
Comment

Meta-analysis, Simpson's paradox, and the number needed to treat

Douglas G Altman et al. BMC Med Res Methodol. 2002.

Abstract

Background: There is debate concerning methods for calculating numbers needed to treat (NNT) from results of systematic reviews.

Methods: We investigate the susceptibility to bias for alternative methods for calculating NNTs through illustrative examples and mathematical theory.

Results: Two competing methods have been recommended: one method involves calculating the NNT from meta-analytical estimates, the other by treating the data as if it all arose from a single trial. The 'treat-as-one-trial' method was found to be susceptible to bias when there were imbalances between groups within one or more trials in the meta-analysis (Simpson's paradox). Calculation of NNTs from meta-analytical estimates is not prone to the same bias. The method of calculating the NNT from a meta-analysis depends on the treatment effect used. When relative measures of treatment effect are used the estimates of NNTs can be tailored to the level of baseline risk.

Conclusions: The treat-as-one-trial method of calculating numbers needed to treat should not be used as it is prone to bias. Analysts should always report the method they use to compute estimates to enable readers to judge whether it is appropriate.

PubMed Disclaimer

Comment on

References

    1. Cates C. Simpson's paradox and calculation of number needed to treat from meta-analysis. BMC Medical Research Mathodology. 2002;2:1. doi: 10.1186/1471-2288-2-1. - DOI - PMC - PubMed
    1. Moore RA, Gavaghan DJ, Edwards JE, Wiffen P, McQuay HJ. Pooling data for number needed to treat: no problems for apples. BMC Medical Research Methodology 2002, 2:2. 2002;2:2. doi: 10.1186/1471-2288-2-2. - DOI - PMC - PubMed
    1. Deeks JJ, Altman DG, Bradburn MJ. Statistical methods for examining heterogeneity and combining results from several studies in meta-analysis. In: Egger M, Davey Smith G, Altman DG, editor. Systematic Reviews in Health Care. Meta-analysis in Context. London: BMJ Books; 2001. pp. 285–312.
    1. Deeks JJ, Altman DG. Effect measures for meta-analysis of trials with binary outcomes. In: Egger M, Davey Smith G, Altman DG, editor. Systematic Reviews in Health Care. Meta-analysis in Context. London: BMJ Books; 2001. pp. 313–335.
    1. Deeks JJ. Issues in selection of a summary statistic for meta-analysis of clinical trials with binary data. Stat Med. - PubMed

Publication types