Early detection of sepsis using machine learning algorithms: a systematic review and network meta-analysis

Abstract

Background: With machine learning (ML) carving a niche in diverse medical disciplines, its role in sepsis prediction, a condition where the 'golden hour' is critical, is of paramount interest. This study assesses the factors influencing the efficacy of ML models in sepsis prediction, aiming to optimize their use in clinical practice.

Methods: We searched Medline, PubMed, Google Scholar, and CENTRAL for studies published from inception to October 2023. We focused on studies predicting sepsis in real-time settings in adult patients in any hospital settings without language limits. The primary outcome was area under the curve (AUC) of the receiver operating characteristic. This meta-analysis was conducted according to PRISMA-NMA guidelines and Cochrane Handbook recommendations. A Network Meta-Analysis using the CINeMA approach compared ML models against traditional scoring systems, with meta-regression identifying factors affecting model quality.

Results: From 3,953 studies, 73 articles encompassing 457,932 septic patients and 256 models were analyzed. The pooled AUC for ML models was 0.825 and it significantly outperformed traditional scoring systems. Neural Network and Decision Tree models demonstrated the highest AUC metrics. Significant factors influencing AUC included ML model type, dataset type, and prediction window.

Conclusion: This study establishes the superiority of ML models, especially Neural Network and Decision Tree types, in sepsis prediction. It highlights the importance of model type and dataset characteristics for prediction accuracy, emphasizing the necessity for standardized reporting and validation in ML healthcare applications. These findings call for broader clinical implementation to evaluate the effectiveness of these models in diverse patient groups.

Systematic review registration: https://inplasy.com/inplasy-2023-12-0062/, identifier, INPLASY2023120062.

Keywords: decision trees; machine learning; network meta-analysis; neural networks; sepsis.

Figure 1

PRISMA flow diagram for study selection.

Figure 2

Network plot. DT, Decision Tree; NNM, Neural Network Model; SVM, Support Vector Machine; LR, Logistic Regression; NB, Naïve Bayes; GLM, Generalized Linear Model; KNN, K-Nearest Neighbors.

Figure 3

Network meta-analysis summary forest plot for predictive efficacy of various ML models and best of scoring system used for sepsis prediction.