Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2023 Apr 1;24(4):322-333.
doi: 10.1097/PCC.0000000000003186. Epub 2023 Feb 2.

The Deterioration Risk Index: Developing and Piloting a Machine Learning Algorithm to Reduce Pediatric Inpatient Deterioration

Laura O H Rust  1   2   3   4   5   6   7 , Tyler J Gorham  5 , Sven Bambach  5 , Ryan S Bode  3   4   6 , Tensing Maa  3   4   7 , Jeffrey M Hoffman  1   2   3   4   5   6   7 , Steven W Rust  5
Affiliations

The Deterioration Risk Index: Developing and Piloting a Machine Learning Algorithm to Reduce Pediatric Inpatient Deterioration

Laura O H Rust et al. Pediatr Crit Care Med. .

Abstract

Objectives: Develop and deploy a disease cohort-based machine learning algorithm for timely identification of hospitalized pediatric patients at risk for clinical deterioration that outperforms our existing situational awareness program.

Design: Retrospective cohort study.

Setting: Nationwide Children's Hospital, a freestanding, quaternary-care, academic children's hospital in Columbus, OH.

Patients: All patients admitted to inpatient units participating in the preexisting situational awareness program from October 20, 2015, to December 31, 2019, excluding patients over 18 years old at admission and those with a neonatal ICU stay during their hospitalization.

Interventions: We developed separate algorithms for cardiac, malignancy, and general cohorts via lasso-regularized logistic regression. Candidate model predictors included vital signs, supplemental oxygen, nursing assessments, early warning scores, diagnoses, lab results, and situational awareness criteria. Model performance was characterized in clinical terms and compared with our previous situational awareness program based on a novel retrospective validation approach. Simulations with frontline staff, prior to clinical implementation, informed user experience and refined interdisciplinary workflows. Model implementation was piloted on cardiology and hospital medicine units in early 2021.

Measurements and main results: The Deterioration Risk Index (DRI) was 2.4 times as sensitive as our existing situational awareness program (sensitivities of 53% and 22%, respectively; p < 0.001) and required 2.3 times fewer alarms per detected event (121 DRI alarms per detected event vs 276 for existing program). Notable improvements were a four-fold sensitivity gain for the cardiac diagnostic cohort (73% vs 18%; p < 0.001) and a three-fold gain (81% vs 27%; p < 0.001) for the malignancy diagnostic cohort. Postimplementation pilot results over 18 months revealed a 77% reduction in deterioration events (three events observed vs 13.1 expected, p = 0.001).

Conclusions: The etiology of pediatric inpatient deterioration requires acknowledgement of the unique pathophysiology among cardiology and oncology patients. Selection and weighting of diverse candidate risk factors via machine learning can produce a more sensitive early warning system for clinical deterioration. Leveraging preexisting situational awareness platforms and accounting for operational impacts of model implementation are key aspects to successful bedside translation.

PubMed Disclaimer

Conflict of interest statement

Dr. Gorham received funding from LDA Research. The remaining authors have disclosed that they do not have any potential conflicts of interest.

Comment in

References

    1. Sandquist M, Tegtmeyer K: No more pediatric code blues on the floor: Evolution of pediatric rapid response teams and situational awareness plans. Transl Pediatr 2018; 7:291–298
    1. Jayaram N, Chan ML, Tang F, et al.: Frequency of medical emergency team activation prior to pediatric cardiopulmonary resuscitation. Resuscitation 2017; 115:110–115
    1. Failure to Rescue. Agency for Healthcare Research and Quality. 2019. Available at: https://psnet.ahrq.gov/primer/failure-rescue . Accessed November 20, 2020
    1. da Silva YS, Hamilton MF, Horvat C, et al.: Evaluation of electronic medical record vital sign data versus a commercially available acuity score in predicting need for critical intervention at a tertiary children’s hospital. Pediatr Crit Care Med 2015; 16:644–651
    1. Pearson GA, Ward-Platt M, Harnden A, et al.: Why children die: Avoidable factors associated with child deaths. Arch Dis Child 2011; 96:927–931