Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2013:2013:975672.
doi: 10.1155/2013/975672. Epub 2013 Jul 9.

Validation of computerized automatic calculation of the sequential organ failure assessment score

Andrew M Harrison  1 , Hemang Yadav, Brian W Pickering, Rodrigo Cartin-Ceba, Vitaly Herasevich
Affiliations

Validation of computerized automatic calculation of the sequential organ failure assessment score

Andrew M Harrison et al. Crit Care Res Pract. 2013.

Abstract

Purpose. To validate the use of a computer program for the automatic calculation of the sequential organ failure assessment (SOFA) score, as compared to the gold standard of manual chart review. Materials and Methods. Adult admissions (age > 18 years) to the medical ICU with a length of stay greater than 24 hours were studied in the setting of an academic tertiary referral center. A retrospective cross-sectional analysis was performed using a derivation cohort to compare automatic calculation of the SOFA score to the gold standard of manual chart review. After critical appraisal of sources of disagreement, another analysis was performed using an independent validation cohort. Then, a prospective observational analysis was performed using an implementation of this computer program in AWARE Dashboard, which is an existing real-time patient EMR system for use in the ICU. Results. Good agreement between the manual and automatic SOFA calculations was observed for both the derivation (N=94) and validation (N=268) cohorts: 0.02 ± 2.33 and 0.29 ± 1.75 points, respectively. These results were validated in AWARE (N=60). Conclusion. This EMR-based automatic tool accurately calculates SOFA scores and can facilitate ICU decisions without the need for manual data collection. This tool can also be employed in a real-time electronic environment.

PubMed Disclaimer

Figures

Figure 1
Figure 1
Derivation cohort: Bland-Altman plot of the manual versus automatic scores resulted in a mean difference of 0.02 ± 2.33 (SD, N = 94). Note: plotted values frequently represent more than one patient sample.
Figure 2
Figure 2
Validation cohort: Bland-Altman plot of the manual versus automatic scores resulted in a mean difference of 0.12 ± 1.64 (SD, N = 268). Note: plotted values frequently represent more than one patient sample.
Figure 3
Figure 3
Derivation cohort: sum of the absolute value of the difference between the automatic and manual SOFA component scores. For the outlier box plot, the first box (red bracket) represents the first quartile, followed by the second and third quartiles. Fourth quartile outliers are represented by black dots. The triangle represents the mean difference (1.64).
Figure 4
Figure 4
Validation cohort: sum of the absolute value of the difference between the automatic and manual SOFA component scores. For the outlier box plot, the first box represents the first and second quartiles, followed by the third quartile. Fourth quartile outliers are represented by black dots. The triangle represents the mean difference (0.85).
See this image and copyright information in PMC

References

    1. Knaus WA, Zimmerman JE, Wagner DP, Draper EA, Lawrence DE. APACHE-acute physiology and chronic health evaluation: a physiologically based classification system. Critical Care Medicine. 1981;9(8):591–597. - PubMed
    1. Zimmerman JE, Kramer AA, McNair DS, Malila FM. Acute physiology and chronic health evaluation (APACHE) IV: hospital mortality assessment for today’s critically ill patients. Critical Care Medicine. 2006;34(5):1297–1310. - PubMed
    1. Le Gall J-R, Loirat P, Alperovitch A. A simplified acute physiology score for ICU patients. Critical Care Medicine. 1984;12(11):975–977. - PubMed
    1. Lemeshow S, Teres D, Pastides H. A method for predicting survival and mortality of ICU patients using objectively derived weights. Critical Care Medicine. 1985;13(7):519–525. - PubMed
    1. Vincent J-L, Moreno R, Takala J, et al. The SOFA (Sepsis-related Organ Failure Assessment) score to describe organ dysfunction/failure. Intensive Care Medicine. 1996;22(7):707–710. - PubMed

LinkOut - more resources