Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2013 May 8;4(2):212-24.
doi: 10.4338/ACI-2012-12-RA-0053. Print 2013.

Diagnostic performance of electronic syndromic surveillance systems in acute care: a systematic review

M Kashiouris  1 , J C O'Horo, B W Pickering, V Herasevich
Affiliations

Diagnostic performance of electronic syndromic surveillance systems in acute care: a systematic review

M Kashiouris et al. Appl Clin Inform. .

Abstract

Context: Healthcare Electronic Syndromic Surveillance (ESS) is the systematic collection, analysis and interpretation of ongoing clinical data with subsequent dissemination of results, which aid clinical decision-making.

Objective: To evaluate, classify and analyze the diagnostic performance, strengths and limitations of existing acute care ESS systems.

Data sources: All available to us studies in Ovid MEDLINE, Ovid EMBASE, CINAHL and Scopus databases, from as early as January 1972 through the first week of September 2012.

Study selection: Prospective and retrospective trials, examining the diagnostic performance of inpatient ESS and providing objective diagnostic data including sensitivity, specificity, positive and negative predictive values.

Data extraction: Two independent reviewers extracted diagnostic performance data on ESS systems, including clinical area, number of decision points, sensitivity and specificity. Positive and negative likelihood ratios were calculated for each healthcare ESS system. A likelihood matrix summarizing the various ESS systems performance was created.

Results: The described search strategy yielded 1639 articles. Of these, 1497 were excluded on abstract information. After full text review, abstraction and arbitration with a third reviewer, 33 studies met inclusion criteria, reporting 102,611 ESS decision points. The yielded I2 was high (98.8%), precluding meta-analysis. Performance was variable, with sensitivities ranging from 21% -100% and specificities ranging from 5%-100%.

Conclusions: There is significant heterogeneity in the diagnostic performance of the available ESS implements in acute care, stemming from the wide spectrum of different clinical entities and ESS systems. Based on the results, we introduce a conceptual framework using a likelihood ratio matrix for evaluation and meaningful application of future, frontline clinical decision support systems.

Keywords: Alert; EMR; IC; computer systems; computer-assisted; computerized medical records systems; decision support systems; diagnostic; false; medical informatics applications; monitor; sniffers; surveillance.

PubMed Disclaimer

Figures

Fig. 1
Fig. 1
Flow diagram of the study selection process.
Fig. 2
Fig. 2
The likelihood matrix
See this image and copyright information in PMC

References

    1. Langmuir AD. The surveillance of communicable diseases of national importance. N Engl J Med 1963; 268: 182-192 - PubMed
    1. Teutsch SM, Thacker SB. Planning a public health surveillance system. Epidemiol Bull 1995; 16: 1-6 - PubMed
    1. Chaudhry B, et al. Systematic review: impact of health information technology on quality, efficiency, and costs of medical care. Ann Intern Med 2006; 144: 742-752 - PubMed
    1. Lenert L, Sundwall DN. Public health surveillance and meaningful use regulations: a crisis of opportunity. Am J Public Health 2012; 102: e1-e7 - PMC - PubMed
    1. Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and metaanalyses: the PRISMA statement. Ann Intern Med 2009; 151: 264-269, W64 - PubMed

Publication types