Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2020 Oct 1;108(4):556-563.
doi: 10.5195/jmla.2020.912.

Which are the most sensitive search filters to identify randomized controlled trials in MEDLINE?

Julie Glanville  1 , Eleanor Kotas  2 , Robin Featherstone  3 , Gordon Dooley  4
Affiliations

Which are the most sensitive search filters to identify randomized controlled trials in MEDLINE?

Julie Glanville et al. J Med Libr Assoc. .

Abstract

Objective: The Cochrane Handbook of Systematic Reviews contains search filters to find randomized controlled trials (RCTs) in Ovid MEDLINE: one maximizing sensitivity and another balancing sensitivity and precision. These filters were originally published in 1994 and were adapted and updated in 2008. To determine the performance of these filters, the authors tested them and thirty-six other MEDLINE filters against a large new gold standard set of relevant records.

Methods: We identified a gold standard set of RCT reports published in 2016 from the Cochrane CENTRAL database of controlled clinical trials. We retrieved the records in Ovid MEDLINE and combined these with each RCT filter. We calculated their sensitivity, relative precision, and f-scores.

Results: The gold standard comprised 27,617 records. MEDLINE searches were run on July 16, 2019. The most sensitive RCT filter was Duggan et al. (sensitivity=0.99). The Cochrane sensitivity-maximizing RCT filter had a sensitivity of 0.96 but was more precise than Duggan et al. (0.14 compared to 0.04 for Duggan). The most precise RCT filters had 0.97 relative precision and 0.83 sensitivity.

Conclusions: The Cochrane Ovid MEDLINE sensitivity-maximizing RCT filter can continue to be used by Cochrane reviewers and to populate CENTRAL, as it has very high sensitivity and a slightly better precision relative to more sensitive filters. The results of this study, which used a very large gold standard to compare the performance of all known RCT filters, allows searchers to make better informed decisions about which filters to use for their work.

PubMed Disclaimer

Figures

Figure 1
Figure 1
Sensitivity and relative precision of 38 randomized controlled trial (RCT) filters
See this image and copyright information in PMC

Similar articles

See all similar articles

Cited by

See all "Cited by" articles

References

    1. Higgins JPT, Green S, eds. Cochrane handbook for systematic reviews of interventions. Version 5.1.0. Cochrane; 2011. [updated March 2011].
    1. Higgins JPT, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, Welch VA, eds. Cochrane handbook for systematic reviews of interventions version 6.0. Cochrane; 2019. [updated July 2019]. - PMC - PubMed
    1. Agency for Healthcare Research Quality. Methods guide for effectiveness and comparative effectiveness reviews Rockville, MD: The Agency; 2014. - PubMed
    1. Committee on Standards for Systematic Reviews of Comparative Effectiveness Research; Institute of Medicine. Finding what works in health care: standards for systematic reviews Washington, DC: National Academies Press; 2011. - PubMed
    1. Lefebvre C, Glanville J, Beale S, Boachie C, Duffy S, Fraser C, Harbour J, McCool R, Smith L. Assessing the performance of methodological search filters to improve the efficiency of evidence information retrieval: five literature reviews and a qualitative study. Health Technol Assess. November;21(69):1–148. DOI: 10.3310/hta21690. - DOI - PMC - PubMed

LinkOut - more resources