Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Comparative Study
. 2018 Feb:123:86-91.
doi: 10.1016/j.resuscitation.2017.10.028. Epub 2017 Nov 21.

Comparison of the Between the Flags calling criteria to the MEWS, NEWS and the electronic Cardiac Arrest Risk Triage (eCART) score for the identification of deteriorating ward patients

Malcolm Green  1 , Harvey Lander  2 , Ashley Snyder  3 , Paul Hudson  2 , Matthew Churpek  3 , Dana Edelson  3
Affiliations
Comparative Study

Comparison of the Between the Flags calling criteria to the MEWS, NEWS and the electronic Cardiac Arrest Risk Triage (eCART) score for the identification of deteriorating ward patients

Malcolm Green et al. Resuscitation. 2018 Feb.

Abstract

Introduction: Traditionally, paper based observation charts have been used to identify deteriorating patients, with emerging recent electronic medical records allowing electronic algorithms to risk stratify and help direct the response to deterioration.

Objective(s): We sought to compare the Between the Flags (BTF) calling criteria to the Modified Early Warning Score (MEWS), National Early Warning Score (NEWS) and electronic Cardiac Arrest Risk Triage (eCART) score.

Design and participants: Multicenter retrospective analysis of electronic health record data from all patients admitted to five US hospitals from November 2008-August 2013.

Main outcome measures: Cardiac arrest, ICU transfer or death within 24h of a score RESULTS: Overall accuracy was highest for eCART, with an AUC of 0.801 (95% CI 0.799-0.802), followed by NEWS, MEWS and BTF respectively (0.718 [0.716-0.720]; 0.698 [0.696-0.700]; 0.663 [0.661-0.664]). BTF criteria had a high risk (Red Zone) specificity of 95.0% and a moderate risk (Yellow Zone) specificity of 27.5%, which corresponded to MEWS thresholds of >=4 and >=2, NEWS thresholds of >=5 and >=2, and eCART thresholds of >=12 and >=4, respectively. At those thresholds, eCART caught 22 more adverse events per 10,000 patients than BTF using the moderate risk criteria and 13 more using high risk criteria, while MEWS and NEWS identified the same or fewer.

Conclusion(s): An electronically generated eCART score was more accurate than commonly used paper based observation tools for predicting the composite outcome of in-hospital cardiac arrest, ICU transfer and death within 24h of observation. The outcomes of this analysis lend weight for a move towards an algorithm based electronic risk identification tool for deteriorating patients to ensure earlier detection and prevent adverse events in the hospital.

Keywords: Decision support; Deteriorating patients; Early warning scores; MEWS; NEWS; Rapid response systems.

PubMed Disclaimer

Conflict of interest statement

Conflicts of Interest

Figures

Fig. 1.
Fig. 1.
Additional Saves Compared to BTF.
Fig. 2.
Fig. 2.
Additional False Positives Compared to BTF.
Fig. 3.
Fig. 3.
Accuracy Comparisons.
See this image and copyright information in PMC

Comment in

Similar articles

See all similar articles

Cited by

See all "Cited by" articles

References

    1. Brennan TA, Leape LL, Laird NM, et al. Incidence of adverse events and negligence in hospitalised patients: results of the Harvard Medical Practice Study I. N Engl J Med 1991; 324: 370–77. - PubMed
    1. Wilson RM, Runciman WB, Gibberd RW, et al. The quality in Australian Health Care Study. Med J Aust 1995; 163: 458–76. - PubMed
    1. Davis P, Lay-Yee R, Briant R, et al. Adverse events in New Zealand public hospitals I: occurrence and impact N Z Med J 2002; 115: 271. - PubMed
    1. Baker GR, Norton PG, Flintoft V, et al. The Canadian Adverse Events Study: the incidence of adverse events among hospital patients in Canada. CMAJ 2004; 170: 1678–86. - PMC - PubMed
    1. Ball C, Kirby K, Williams S. Effect of the critical care outreach team on patient survival to discharge from hospital and readmission to critical care: non-randomised population based study. BMJ. 2003. November 1; 327(7422): 1014. - PMC - PubMed

Publication types