Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Review
. 2017 Sep 5;17(1):164.
doi: 10.1186/s12886-017-0561-9.

The quality of systematic reviews about interventions for refractive error can be improved: a review of systematic reviews

Evan Mayo-Wilson  1 , Sueko Matsumura Ng  2 , Roy S Chuck  3 , Tianjing Li  2
Affiliations
Review

The quality of systematic reviews about interventions for refractive error can be improved: a review of systematic reviews

Evan Mayo-Wilson et al. BMC Ophthalmol. .

Abstract

Background: Systematic reviews should inform American Academy of Ophthalmology (AAO) Preferred Practice Pattern® (PPP) guidelines. The quality of systematic reviews related to the forthcoming Preferred Practice Pattern® guideline (PPP) Refractive Errors & Refractive Surgery is unknown. We sought to identify reliable systematic reviews to assist the AAO Refractive Errors & Refractive Surgery PPP.

Methods: Systematic reviews were eligible if they evaluated the effectiveness or safety of interventions included in the 2012 PPP Refractive Errors & Refractive Surgery. To identify potentially eligible systematic reviews, we searched the Cochrane Eyes and Vision United States Satellite database of systematic reviews. Two authors identified eligible reviews and abstracted information about the characteristics and quality of the reviews independently using the Systematic Review Data Repository. We classified systematic reviews as "reliable" when they (1) defined criteria for the selection of studies, (2) conducted comprehensive literature searches for eligible studies, (3) assessed the methodological quality (risk of bias) of the included studies, (4) used appropriate methods for meta-analyses (which we assessed only when meta-analyses were reported), (5) presented conclusions that were supported by the evidence provided in the review.

Results: We identified 124 systematic reviews related to refractive error; 39 met our eligibility criteria, of which we classified 11 to be reliable. Systematic reviews classified as unreliable did not define the criteria for selecting studies (5; 13%), did not assess methodological rigor (10; 26%), did not conduct comprehensive searches (17; 44%), or used inappropriate quantitative methods (3; 8%). The 11 reliable reviews were published between 2002 and 2016. They included 0 to 23 studies (median = 9) and analyzed 0 to 4696 participants (median = 666). Seven reliable reviews (64%) assessed surgical interventions.

Conclusions: Most systematic reviews of interventions for refractive error are low methodological quality. Following widely accepted guidance, such as Cochrane or Institute of Medicine standards for conducting systematic reviews, would contribute to improved patient care and inform future research.

Keywords: Clinical guidelines; Refractive error; Research waste; Systematic review standards.

PubMed Disclaimer

Conflict of interest statement

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

EMW, SMN, TL have no financial or other interests. RSC chairs the refractive error PPP panel and is a member on the AAO PPP steering committee.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Figures

Fig. 1
Fig. 1
Flow chart showing the identification of systematic reviews of interventions for refractive error
Fig. 2
Fig. 2
Assessment of reliability criteria for 40 systematic reviews on interventions for refractive error
See this image and copyright information in PMC

References

    1. Institute of Medicine . Clinical practice guidelines we can trust. Washington, DC: The National Academies Press; 2011.
    1. Li T, Vedula SS, Scherer R, Dickersin K. What comparative effectiveness research is needed? A framework for using guidelines and systematic reviews to identify evidence gaps and research priorities. Ann Intern Med. 2012;156(5):367–377. doi: 10.7326/0003-4819-156-5-201203060-00009. - DOI - PMC - PubMed
    1. Institute of Medicine . Finding what works in health care: standards for systematic reviews. Washington, DC: The National Academies Press; 2011. - PubMed
    1. Lindsley K, Li T, Ssemanda E, Virgili G, Dickersin K. Interventions for age-related macular degeneration: are practice guidelines based on systematic reviews? Ophthalmology. 2016;123(4):884–897. doi: 10.1016/j.ophtha.2015.12.004. - DOI - PMC - PubMed
    1. Naidoo KS, Leasher J, Bourne RR, Flaxman SR, Jonas JB, Keeffe J, et al. Global vision impairment and blindness due to uncorrected refractive error, 1990-2010. Optom Vis Sci. 2016;93(3):227–234. doi: 10.1097/OPX.0000000000000796. - DOI - PubMed

MeSH terms