Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2000 Feb 26;320(7234):537-40.
doi: 10.1136/bmj.320.7234.537.

Systematic reviews and meta-analyses on treatment of asthma: critical evaluation

A R Jadad  1 , M Moher, G P Browman, L Booker, C Sigouin, M Fuentes, R Stevens
Affiliations

Systematic reviews and meta-analyses on treatment of asthma: critical evaluation

A R Jadad et al. BMJ. .

Erratum in

  • BMJ 2000 Apr 8;320(7240):984
  • BMJ 2000 Jul 29;321(7256):275

Abstract

Objective: To evaluate the clinical, methodological, and reporting aspects of systematic reviews and meta-analyses on the treatment of asthma and to compare those published by the Cochrane Collaboration with those published in paper based journals.

Design: Analysis of studies identified from Medline, CINAHL, HealthSTAR, EMBASE, Cochrane Library, personal collections, and reference lists.

Studies: Articles describing a systematic review or a meta-analysis of the treatment of asthma that were published as a full report, in any language or format, in a peer reviewed journal or the Cochrane Library.

Main outcome measures: General characteristics of studies reviewed and methodological characteristics (sources of articles; language restrictions; format, design, and publication status of studies included; type of data synthesis; and methodological quality).

Results: 50 systematic reviews and meta-analyses were included. More than half were published in the past two years. Twelve reviews were published in the Cochrane Library and 38 were published in 22 peer reviewed journals. Forced expiratory volume in one second was the most frequently used outcome, but few reviews evaluated the effect of treatment on costs or patient preferences. Forty reviews were judged to have serious or extensive flaws. All six reviews associated with industry were in this group. Seven of the 10 most rigorous reviews were published in the Cochrane Library.

Conclusions: Most reviews published in peer reviewed journals or funded by industry have serious methodological flaws that limit their value to guide decisions. Cochrane reviews are more rigorous and better reported than those published in peer reviewed journals.

PubMed Disclaimer

Comment in

References

    1. O'Byrne PM. Clinical comparisons of inhaler systems—what are the important aspects. J Aer Med. 1995;8:S39–S47. - PubMed
    1. Mulrow CD. Rationale for systematic reviews. In: Chalmers I, Altman DG, editors. Systematic reviews. London: BMJ Publishing; 1995. pp. 1–8.
    1. Oxman AD, Guyatt GH. Guidelines for reading literature reviews. Can Med Ass J. 1988;138:687–703. - PMC - PubMed
    1. Lau J, Ioannidis JPA, Schmid CH. Quantitative synthesis in systematic reviews. Ann Intern Med. 1997;127:820–826. - PubMed
    1. Sacks HS, Berrier J, Reitman D, Pagano D, Chalmers T. Meta-analyses of randomized control trials: an update of the quality and methodology. In: Bailar JC III, Mosteller F, editors. Medical uses of statistics. Boston: New England Medical Journal Publications; 1992. pp. 427–442.

Publication types