External validation of the Simplified Mortality Score for the Intensive Care Unit (SMS-ICU)
- PMID: 31273763
- DOI: 10.1111/aas.13422
External validation of the Simplified Mortality Score for the Intensive Care Unit (SMS-ICU)
Abstract
Background: The Simplified Mortality Score for the Intensive Care Unit (SMS-ICU) is a clinical prediction model, which estimates the risk of 90-day mortality in acutely ill adult ICU patients using 7 readily available variables. We aimed to externally validate the SMS-ICU and compare its discrimination with existing prediction models used with 90-day mortality as the outcome.
Methods: We externally validated the SMS-ICU using data from 3282 patients included in the Stress Ulcer Prophylaxis in the Intensive Care Unit trial, which randomised acutely ill adult ICU patients with risk factors for gastrointestinal bleeding to prophylactic pantoprazole or placebo in 33 ICUs in Europe. We assessed discrimination, calibration and overall performance of the SMS-ICU and compared discrimination with the commonly used and more complex SAPS II and SOFA scores.
Results: Mortality at day 90 was 30.7%. The discrimination (area under the receiver operating characteristic curve) for the SMS-ICU was 0.67 (95% CI: 0.65-0.69), as compared with 0.68 (95% CI: 0.66-0.70, P = 0.35) for SAPS II and 0.63 (95% CI: 0.61-0.65, P < 0.001) for the SOFA score. Calibration (intercept and slope) was 0.001 and 0.786, respectively, and Nagelkerke's R2 (overall performance) was 0.06. The proportions of missing data for the SMS-ICU, SAPS II and SOFA scores were 0.2%, 8.5% and 6.8%, respectively.
Conclusions: Discrimination for 90-day mortality of the SMS-ICU in this cohort was poor, but similar to SAPS II and better than that of the SOFA score with markedly less missing data.
© 2019 The Acta Anaesthesiologica Scandinavica Foundation. Published by John Wiley & Sons Ltd.
References
REFERENCES
-
- Vincent J-L, Moreno R. Clinical review: scoring systems in the critically ill. Crit Care. 2010;14:207. https://doi.org/10.1186/cc8204
-
- Le Gall J-R, Lemeshow S, Saulnier F. A new Simplified Acute Physiology Score (SAPS II) based on a European/North American multicenter study. JAMA. 1993; 270:2957-2963. [Erratum, JAMA 1994; 271: 1321].
-
- Moreno RP, Metnitz P, Almeida E, et al. SAPS 3-From evaluation of the patient to evaluation of the intensive care unit. Part 2: development of a prognostic model for hospital mortality at ICU admission. Intensive Care Med. 2005;31:1345-1355. https://doi.org/10.1007/s00134-005-2763-5
-
- Minne L, Eslami S, de Keizer N, de Jonge E, de Rooij SE, Abu-Hanna A. Effect of changes over time in the performance of a customized SAPS-II model on the quality of care assessment. Intensive Care Med. 2012;38:40-46. https://doi.org/10.1007/s00134-011-2390-2
-
- Harrison DA, Brady AR, Parry GJ, Carpenter JR, Rowan K. Recalibration of risk prediction models in a large multicenter cohort of admissions to adult, general critical care units in the United Kingdom. Crit Care Med. 2006;34:1378-1388. https://doi.org/10.1097/01.CCM.0000216702.94014.75
Publication types
MeSH terms
Substances
Grants and funding
LinkOut - more resources
Full Text Sources
Medical