Early prediction of mortality at sepsis diagnosis time in critically ill patients by using interpretable machine learning

Abstract

This study applied machine learning for the early prediction of 30-day mortality at sepsis diagnosis time in critically ill patients. Retrospective study using data collected from the Medical Information Mart for Intensive Care IV database. The data of the patient cohort was divided on the basis of the year of hospitalization, into training (2008-2013), validation (2014-2016), and testing (2017-2019) datasets. 24,377 patients with the sepsis diagnosis time < 24 h after intensive care unit (ICU) admission were included. A gradient boosting tree-based algorithm (XGBoost) was used for training the machine learning model to predict 30-day mortality at sepsis diagnosis time in critically ill patients. Model performance was measured in both discrimination and calibration aspects. The model was interpreted using the SHapley Additive exPlanations (SHAP) module. The 30-day mortality rate of the testing dataset was 17.9%, and 39 features were selected for the machine learning model. Model performance on the testing dataset achieved an area under the receiver operating characteristic curve (AUROC) of 0.853 (95% CI 0.837-0.868) and an area under the precision-recall curves of 0.581 (95% CI 0.541-0.619). The calibration plot for the model revealed a slope of 1.03 (95% CI 0.94-1.12) and intercept of 0.14 (95% CI 0.04-0.25). The SHAP revealed the top three most significant features, namely age, increased red blood cell distribution width, and respiratory rate. Our study demonstrated the feasibility of using the interpretable machine learning model to predict mortality at sepsis diagnosis time.

Keywords: Intensive care; Machine learning; Mortality; Prediction; Sepsis; Shock.