Prediction of Clinical Deterioration in Hospitalized Adult Patients with Hematologic Malignancies Using a Neural Network Model
- PMID: 27532679
- PMCID: PMC4988721
- DOI: 10.1371/journal.pone.0161401
Prediction of Clinical Deterioration in Hospitalized Adult Patients with Hematologic Malignancies Using a Neural Network Model
Abstract
Introduction: Clinical deterioration (ICU transfer and cardiac arrest) occurs during approximately 5-10% of hospital admissions. Existing prediction models have a high false positive rate, leading to multiple false alarms and alarm fatigue. We used routine vital signs and laboratory values obtained from the electronic medical record (EMR) along with a machine learning algorithm called a neural network to develop a prediction model that would increase the predictive accuracy and decrease false alarm rates.
Design: Retrospective cohort study.
Setting: The hematologic malignancy unit in an academic medical center in the United States.
Patient population: Adult patients admitted to the hematologic malignancy unit from 2009 to 2010.
Intervention: None.
Measurements and main results: Vital signs and laboratory values were obtained from the electronic medical record system and then used as predictors (features). A neural network was used to build a model to predict clinical deterioration events (ICU transfer and cardiac arrest). The performance of the neural network model was compared to the VitalPac Early Warning Score (ViEWS). Five hundred sixty five consecutive total admissions were available with 43 admissions resulting in clinical deterioration. Using simulation, the neural network outperformed the ViEWS model with a positive predictive value of 82% compared to 24%, respectively.
Conclusion: We developed and tested a neural network-based prediction model for clinical deterioration in patients hospitalized in the hematologic malignancy unit. Our neural network model outperformed an existing model, substantially increasing the positive predictive value, allowing the clinician to be confident in the alarm raised. This system can be readily implemented in a real-time fashion in existing EMR systems.
Conflict of interest statement
Figures

Similar articles
-
Using electronic health record data to develop and validate a prediction model for adverse outcomes in the wards*.Crit Care Med. 2014 Apr;42(4):841-8. doi: 10.1097/CCM.0000000000000038. Crit Care Med. 2014. PMID: 24247472 Free PMC article.
-
Evaluation of Electronic Medical Record Vital Sign Data Versus a Commercially Available Acuity Score in Predicting Need for Critical Intervention at a Tertiary Children's Hospital.Pediatr Crit Care Med. 2015 Sep;16(7):644-51. doi: 10.1097/PCC.0000000000000444. Pediatr Crit Care Med. 2015. PMID: 25901545
-
Multicenter Comparison of Machine Learning Methods and Conventional Regression for Predicting Clinical Deterioration on the Wards.Crit Care Med. 2016 Feb;44(2):368-74. doi: 10.1097/CCM.0000000000001571. Crit Care Med. 2016. PMID: 26771782 Free PMC article.
-
Early Warning Scoring System for Early Recognition of and Timely Intervention in Deteriorating Patients in the Hospital.J Assoc Physicians India. 2016 May;64(5):59-61. J Assoc Physicians India. 2016. PMID: 27735150 Review.
-
Machine Learning-Based Early Warning Systems for Clinical Deterioration: Systematic Scoping Review.J Med Internet Res. 2021 Feb 4;23(2):e25187. doi: 10.2196/25187. J Med Internet Res. 2021. PMID: 33538696 Free PMC article.
Cited by
-
MEWS++: Enhancing the Prediction of Clinical Deterioration in Admitted Patients through a Machine Learning Model.J Clin Med. 2020 Jan 27;9(2):343. doi: 10.3390/jcm9020343. J Clin Med. 2020. PMID: 32012659 Free PMC article.
-
Sepsis and acute respiratory failure in patients with cancer: how can we improve care and outcomes even further?Curr Opin Crit Care. 2023 Oct 1;29(5):472-483. doi: 10.1097/MCC.0000000000001078. Epub 2023 Jul 28. Curr Opin Crit Care. 2023. PMID: 37641516 Free PMC article. Review.
-
Cell Population Data-Driven Acute Promyelocytic Leukemia Flagging Through Artificial Neural Network Predictive Modeling.Transl Oncol. 2020 Jan;13(1):11-16. doi: 10.1016/j.tranon.2019.09.009. Epub 2019 Nov 13. Transl Oncol. 2020. PMID: 31733590 Free PMC article.
-
Toward Modernization of Geriatric Oncology by Digital Health Technologies.Am Soc Clin Oncol Educ Book. 2020 Mar;40:1-7. doi: 10.1200/EDBK_279505. Am Soc Clin Oncol Educ Book. 2020. PMID: 32243198 Free PMC article.
-
Opening the black box of neural networks: methods for interpreting neural network models in clinical applications.Ann Transl Med. 2018 Jun;6(11):216. doi: 10.21037/atm.2018.05.32. Ann Transl Med. 2018. PMID: 30023379 Free PMC article.
References
-
- Liu V, Kipnis P, Rizk NW, Escobar GJ. Adverse outcomes associated with delayed intensive care unit transfers in an integrated healthcare system. Journal of hospital medicine: an official publication of the Society of Hospital Medicine. 2012;7(3):224–30. Epub 2011/11/01. 10.1002/jhm.964 . - DOI - PubMed
-
- Mokart D, Lambert J, Schnell D, Fouche L, Rabbat A, Kouatchet A, et al. Delayed intensive care unit admission is associated with increased mortality in patients with cancer with acute respiratory failure. Leukemia & lymphoma. 2013;54(8):1724–9. Epub 2012/11/29. 10.3109/10428194.2012.753446 . - DOI - PubMed
MeSH terms
Grants and funding
LinkOut - more resources
Full Text Sources
Other Literature Sources
Medical