Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Editorial
. 2016 Apr 12:5:58.
doi: 10.1186/s13643-016-0237-1.

Limitations of A Measurement Tool to Assess Systematic Reviews (AMSTAR) and suggestions for improvement

Brittany U Burda  1 , Haley K Holmer  2 , Susan L Norris  3
Affiliations
Editorial

Limitations of A Measurement Tool to Assess Systematic Reviews (AMSTAR) and suggestions for improvement

Brittany U Burda et al. Syst Rev. .

Abstract

A Measurement Tool to Assess Systematic Reviews (AMSTAR) is a commonly used tool to assess the quality of systematic reviews; however, modifications are needed to improve its usability, reliability, and validity. In this commentary, we summarize our experience and the experiences of others who have used AMSTAR and provide suggestions for its improvement. We propose that AMSTAR should modify a number of individual items and their instructions and responses to make them more congruent with an assessment of the methodologic quality of systematic reviews. We recommend adding new items and modifying existing items to assess the quality of the body of evidence and to address subgroup and sensitivity analyses. More detailed instructions are needed for scoring individual items across multiple reviewers, and we recommend that a total score should not be calculated. These suggestions need to be empirically tested prior to implementation.

Keywords: Quality assessment; Risk of bias; Systematic review.

PubMed Disclaimer

References

    1. Shea BJ, Grimshaw JM, Wells GA, Boers M, Andersson N, Hamel C, et al. Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews. BMC Med Res Methodol. 2007;7:10. doi: 10.1186/1471-2288-7-10. - DOI - PMC - PubMed
    1. Shea BJ, Hamel C, Wells GA, Bouter LM, Kristjansson E, Grimshaw J, et al. AMSTAR is a reliable and valid measurement tool to assess the methodological quality of systematic reviews. J Clin Epidemiol. 2009;62(10):1013–20. doi: 10.1016/j.jclinepi.2008.10.009. - DOI - PubMed
    1. Shea BJ, Bouter LM, Peterson J, Boers M, Andersson N, Ortiz Z, et al. External validation of a measurement tool to assess systematic reviews (AMSTAR) PLoS ONE. 2007;2(12) doi: 10.1371/journal.pone.0001350. - DOI - PMC - PubMed
    1. Chambrone L, Faggion CM, Jr, Pannuti CM, Chambrone LA. Evidence-based periodontal plastic surgery: an assessment of quality of systematic reviews in the treatment of recession-type defects. J Clin Periodontol. 2010;37(12):1110–8. doi: 10.1111/j.1600-051X.2010.01634.x. - DOI - PubMed
    1. Klimo P, Jr, Thompson CJ, Ragel BT, Boop FA. Methodology and reporting of meta-analyses in the neurosurgical literature. J Neurosurg. 2014;120(4):796–810. doi: 10.3171/2013.11.JNS13195. - DOI - PubMed

Publication types

LinkOut - more resources