Severity scoring in the critically ill: part 1--interpretation and accuracy of outcome prediction scoring systems

Abstract

This review examines the use of scoring systems to assess ICU performance. APACHE (Acute Physiology and Chronic Health Evaluation), MPM (mortality probability model), and SAPS (simplified acute physiology score) are the three major ICU scoring systems in use today. Central to all three is the use of physiologic data for severity adjustment. Differences in the size, nature, and time horizon of the data set translate into minor differences in accuracy and difficulty of data abstraction. APACHE IV provides ICU and hospital predictions for mortality and length of stay, whereas MPM and SAPS only provide hospital mortality predictions (although new algorithms generated from MPM data elements may predict ICU length of stay adequately). The primary use of scoring systems is for assessing ICU performance, with the ratio of actual-to-predicted outcomes in the study cohort providing performance comparisons to the reference ICUs. The reliability of scoring system predictions depends on the completeness and accuracy of the abstracted data; accordingly, ICUs must implement robust data quality control processes. CIs of the ratios are inversely related to sample size, and care must be taken to avoid overinterpreting changes in outcomes. ICU structural and process issues also can affect scoring system performance measures. Despite good discrimination and calibration, scoring systems are used in only 10% to 15% of US ICUs. Without ICU performance data, there is little hope of improving quality and reducing costs. Current demands for transparency and computerization of documentation are likely to drive future use of ICU scoring systems.