External validation of the Codman score in colorectal surgery: a pragmatic tool to drive quality improvement
- PMID: 36965098
- DOI: 10.1111/codi.16547
External validation of the Codman score in colorectal surgery: a pragmatic tool to drive quality improvement
Abstract
Aim: The simple six-variable Codman score is a tool designed to reduce the complexity of contemporary risk-adjusted postoperative mortality rate predictions. We sought to externally validate the Codman score in colorectal surgery.
Methods: The American College of Surgeons National Surgical Quality Improvement Program (ACS NSQIP) participant user file and colectomy targeted dataset of 2020 were merged. A Codman score (composed of six variables: age, American Society of Anesthesiologists score, emergency status, degree of sepsis, functional status and preoperative blood transfusion) was assigned to every patient. The primary outcome was in-hospital mortality and secondary outcome was morbidity at 30 days. Logistic regression analyses were performed using the Codman score and the ACS NSQIP mortality and morbidity algorithms as independent variables for the primary and secondary outcomes. The predictive performance of discrimination area under receiver operating curve (AUC) and calibration of the Codman score and these algorithms were compared.
Results: A total of 40 589 patients were included and a Codman score was generated for 40 557 (99.02%) patients. The median Codman score was 3 (interquartile range 1-4). To predict mortality, the Codman score had an AUC of 0.92 (95% CI 0.91-0.93) compared to the NSQIP mortality score 0.93 (95% CI 0.92-0.94). To predict morbidity, the Codman score had an AUC of 0.68 (95% CI 0.66-0.68) compared to the NSQIP morbidity score 0.72 (95% CI 0.71-0.73). When body mass index and surgical approach was added to the Codman score, the performance was no different to the NSQIP morbidity score. The calibration of observed versus expected predictions was almost perfect for both the morbidity and mortality NSQIP predictions, and only well fitted for Codman scores of less than 4 and greater than 7.
Conclusion: We propose that the six-variable Codman score is an efficient and actionable method for generating validated risk-adjusted outcome predictions and comparative benchmarks to drive quality improvement in colorectal surgery.
Keywords: global benchmarking; quality improvement.
© 2023 The Authors. Colorectal Disease published by John Wiley & Sons Ltd on behalf of Association of Coloproctology of Great Britain and Ireland.
References
REFERENCES
-
- Meara JG, Leather AJM, Hagander L, Alkire BC, Alonso N, Ameh EA, et al. Global surgery 2030: evidence and solutions for achieving health, welfare, and economic development. Lancet. 2015;386(9993):569-624.
-
- Spence RT, Mueller JL, Chang DC. A novel approach to global benchmarking of risk-adjusted surgical outcomes: beyond perioperative mortality rate. JAMA Surg. 2016;151(6):501-2.
-
- Anderson JE, Lassiter R, Bickler SW, Talamini MA, Chang DC. Brief tool to measure risk-adjusted surgical outcomes in resource-limited hospitals. Arch Surg. 2012;147(9):798-803.
-
- Birkmeyer JD, Shahian DM, Dimick JB, Finlayson SRG, Flum DR, Ko CY, et al. Blueprint for a new American College of Surgeons: National Surgical Quality Improvement Program. J Am Coll Surg. 2008;207(5):777-82.
-
- Cohen ME, Liu Y, Ko CY, Hall BL. Improved surgical outcomes for ACS NSQIP hospitals over time: evaluation of hospital cohorts with up to 8 years of participation. Ann Surg. 2016;263(2):267-73.
MeSH terms
LinkOut - more resources
Full Text Sources