Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Meta-Analysis
. 2021 Oct 29;33(5):673-686.
doi: 10.1093/icvts/ivab151.

Systematic review and meta-analysis of mortality risk prediction models in adult cardiac surgery

Shubhra Sinha  1 , Arnaldo Dimagli  1 , Lauren Dixon  1 , Mario Gaudino  2 , Massimo Caputo  1 , Hunaid A Vohra  1 , Gianni Angelini  1 , Umberto Benedetto  1
Affiliations
Meta-Analysis

Systematic review and meta-analysis of mortality risk prediction models in adult cardiac surgery

Shubhra Sinha et al. Interact Cardiovasc Thorac Surg. .

Abstract

Objectives: The most used mortality risk prediction models in cardiac surgery are the European System for Cardiac Operative Risk Evaluation (ES) and Society of Thoracic Surgeons (STS) score. There is no agreement on which score should be considered more accurate nor which score should be utilized in each population subgroup. We sought to provide a thorough quantitative assessment of these 2 models.

Methods: We performed a systematic literature review and captured information on discrimination, as quantified by the area under the receiver operator curve (AUC), and calibration, as quantified by the ratio of observed-to-expected mortality (O:E). We performed random effects meta-analysis of the performance of the individual models as well as pairwise comparisons and subgroup analysis by procedure type, time and continent.

Results: The ES2 {AUC 0.783 [95% confidence interval (CI) 0.765-0.800]; O:E 1.102 (95% CI 0.943-1.289)} and STS [AUC 0.757 (95% CI 0.727-0.785); O:E 1.111 (95% CI 0.853-1.447)] showed good overall discrimination and calibration. There was no significant difference in the discrimination of the 2 models (difference in AUC -0.016; 95% CI -0.034 to -0.002; P = 0.09). However, the calibration of ES2 showed significant geographical variations (P < 0.001) and a trend towards miscalibration with time (P=0.057). This was not seen with STS.

Conclusions: ES2 and STS are reliable predictors of short-term mortality following adult cardiac surgery in the populations from which they were derived. STS may have broader applications when comparing outcomes across continents as compared to ES2.

Registration: Prospero (https://www.crd.york.ac.uk/PROSPERO/) CRD42020220983.

Keywords: Cardiac surgery; European System for Cardiac Operative Risk Evaluation; Mortality; Prediction; Society of Thoracic Surgeons.

PubMed Disclaimer

Figures

Figure 1:
Figure 1:
Preferred Reporting Items for Systematic Reviews and Meta-Analyses flowchart.
Figure 2:
Figure 2:
Forest plots of meta-analysis of European System for Cardiac Operative Risk Evaluation 2. (A) Area under the receiver operator curve. (B) Observed-to-expected ratio.
Figure 3:
Figure 3:
Forest plots of meta-analysis of Society of Thoracic Surgeons score. (A) Area under the receiver operator curve. (B) Observed-to-expected ratio.
Figure 4:
Figure 4:
Difference in discrimination of European System for Cardiac Operative Risk Evaluation 2 and Society of Thoracic Surgeons score. TE: difference in C-stastistic; seTE: standard error of difference in C-statistic.
None
See this image and copyright information in PMC

References

    1. Nashef SAM, Roques F, Michel P, Gauducheau E, Lemeshow S, Salamon R.. European System for Cardiac Operative Risk Evaluation (EuroSCORE). Eur J Cardiothorac Surg 1999;16:9–13. - PubMed
    1. Nashef SAM, Roques F, Sharples LD, Nilsson J, Smith C, Goldstone AR. et al. EuroSCORE II. Eur J Cardiothorac Surg 2012;41:734–45. - PubMed
    1. Ranucci M, Castelvecchio S, Menicanti L, Frigiola A, Pelissero G.. Risk of assessing mortality risk in elective cardiac operations: age, creatinine, ejection fraction and the law of parsimony. Circulation 2009;119:3053–61. - PubMed
    1. Shahian DM, O'Brien SM, Filardo G, Ferraris VA, Haan CK, Rich JB. et al. The Society of Thoracic Surgeons 2008 cardiac surgery risk models: part 1-coronary artery bypass grafting surgery. Ann Thorac Surg 2009;88:S2–S22. - PubMed
    1. Geissler HJ, Hölzl P, Marohl S, Kuhn-Régnier F, Mehlhorn U, Südkamp M. et al. Risk stratification in heart surgery: comparison of six score systems. Eur J Cardiothorac Surg 2000;17:400–6. - PubMed

Publication types