Search where you will find most: Comparing the disciplinary coverage of 56 bibliographic databases

Abstract

This paper introduces a novel scientometrics method and applies it to estimate the subject coverages of many of the popular English-focused bibliographic databases in academia. The method uses query results as a common denominator to compare a wide variety of search engines, repositories, digital libraries, and other bibliographic databases. The method extends existing sampling-based approaches that analyze smaller sets of database coverages. The findings show the relative and absolute subject coverages of 56 databases-information that has often not been available before. Knowing the databases' absolute subject coverage allows the selection of the most comprehensive databases for searches requiring high recall/sensitivity, particularly relevant in lookup or exploratory searches. Knowing the databases' relative subject coverage allows the selection of specialized databases for searches requiring high precision/specificity, particularly relevant in systematic searches. The findings illustrate not only differences in the disciplinary coverage of Google Scholar, Scopus, or Web of Science, but also of less frequently analyzed databases. For example, researchers might be surprised how Meta (discontinued), Embase, or Europe PMC are found to cover more records than PubMed in Medicine and other health subjects. These findings should encourage researchers to re-evaluate their go-to databases, also against newly introduced options. Searching with more comprehensive databases can improve finding, particularly when selecting the most fitting databases needs particular thought, such as in systematic reviews and meta-analyses. This comparison can also help librarians and other information experts re-evaluate expensive database procurement strategies. Researchers without institutional access learn which open databases are likely most comprehensive in their disciplines.

Keywords: Basket of keywords; Bibliographic database; Comparison; Query hit counts; Search system; Subject coverage.

Fig. 1

Absolute subject coverage of 56 databases, sorted from largest to smallest (based on single-attribution; abbreviations see last page of Table 2)

Fig. 2

Relative subject coverage of 56 databases, ranked from least to most specialized (based on single-attribution; abbreviations see last page of Table 2)

Fig. 3

Comparison of absolute subject coverage between Scopus and WOS CC (based on single-attribution; %-values show coverage of Scopus versus WOC CC)

Fig. 4

Comparison of absolute subject coverage between Scopus and WOS CC (based on single-attribution; %-values show the coverage of Scopus versus Google Scholar; Social Sciences and Humanities subjects highlighted in red)