Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2021 Mar;36(3):683-690.
doi: 10.1007/s11606-020-06211-4. Epub 2021 Jan 8.

Accuracy of Administrative Database Algorithms for Hospitalized Pneumonia in Adults: a Systematic Review

Vicente F Corrales-Medina  1   2   3 , Carl van Walraven  4   5
Affiliations

Accuracy of Administrative Database Algorithms for Hospitalized Pneumonia in Adults: a Systematic Review

Vicente F Corrales-Medina et al. J Gen Intern Med. 2021 Mar.

Abstract

Background: Administrative data algorithms (ADAs) to identify pneumonia cases are commonly used in the analysis of pneumonia burden, trends, etiology, processes of care, outcomes, health care utilization, cost, and response to preventative and therapeutic interventions. However, without a good understanding of the validity of ADAs for pneumonia case identification, an adequate appreciation of this literature is difficult. We systematically reviewed the quality and accuracy of published ADAs to identify adult hospitalized pneumonia cases.

Methods: We reviewed the Medline, EMBase, and Cochrane Central databases through May 2020. All studies describing ADAs for adult hospitalized pneumonia and at least one accuracy statistic were included. Investigators independently extracted information about the sampling frame, reference standard, ADA composition, and ADA accuracy.

Results: Thirteen studies involving 24 ADAs were analyzed. Compliance with a 38-item study-quality assessment tool ranged from 17 to 29 (median, 23; interquartile range [IQR], 20 to 25). Study setting, design, and ADA composition varied extensively. Inclusion criteria of most studies selected for high-risk populations and/or increased pneumonia likelihood. Reference standards with explicit criteria (clinical, laboratorial, and/or radiographic) were used in only 4 ADAs. Only 2 ADAs were validated (one internally and one externally). ADA positive predictive values ranged from 35.0 to 96.5% (median, 84.8%; IQR, 65.3 to 89.1%). However, these values are exaggerated for an unselected patient population because pneumonia prevalences in the study cohorts were very high (median, 66%; IQR, 46 to 86%). ADA sensitivities ranged from 31.3 to 97.8% (median, 65.1%; IQR 52.5-72.4).

Discussion: ADAs for identification of adult pneumonia hospitalizations are highly heterogeneous, poorly validated, and at risk for misclassification bias. Greater standardization in reporting ADA accuracy is required in studies using pneumonia ADA for case identification so that results can be properly interpreted.

Keywords: clinical coding; data accuracy; pneumonia; systematic reviews.

PubMed Disclaimer

Conflict of interest statement

The authors declare that they do not have a conflict of interest.

Figures

Figure 1
Figure 1
Flow chart of literature search and study selection.
See this image and copyright information in PMC

References

    1. Centers for Disease Control and Prevention. Leading causes of death. Available at: https://www.cdc.gov/nchs/fastats/leading-causes-of-death.htm. Accessed February 1, 2020.
    1. Statistics Canada. Deaths and causes of death, 2015. Available at: https://www150.statcan.gc.ca/n1/daily-quotidien/180223/dq180223c-eng.htm. Accessed February 1, 2020.
    1. Prina E, Ranzani OT, Torres A. Community-acquired pneumonia. Lancet. 2015;386(9998):1097–108. doi: 10.1016/S0140-6736(15)60733-4. - DOI - PMC - PubMed
    1. Raut M, Schein J, Mody S, Grant R, Benson C, Olson W. Estimating the economic impact of a half-day reduction in length of hospital stay among patients with community-acquired pneumonia in the US. Curr Med Res Opin. 2009;25(9):2151–7. doi: 10.1185/03007990903102743. - DOI - PubMed
    1. File TM, Jr, Marrie TJ. Burden of community-acquired pneumonia in North American adults. Postgrad Med. 2010;122(2):130–41. doi: 10.3810/pgm.2010.03.2130. - DOI - PubMed

Publication types