Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2012 Dec;21(12):1052-6.
doi: 10.1136/bmjqs-2012-001202. Epub 2012 Oct 15.

Case-mix adjusted hospital mortality is a poor proxy for preventable mortality: a modelling study

Affiliations
Free PMC article

Case-mix adjusted hospital mortality is a poor proxy for preventable mortality: a modelling study

Alan J Girling et al. BMJ Qual Saf. 2012 Dec.
Free PMC article

Abstract

Risk-adjustment schemes are used to monitor hospital performance, on the assumption that excess mortality not explained by case mix is largely attributable to suboptimal care. We have developed a model to estimate the proportion of the variation in standardised mortality ratios (SMRs) that can be accounted for by variation in preventable mortality. The model was populated with values from the literature to estimate a predictive value of the SMR in this context-specifically the proportion of those hospitals with SMRs among the highest 2.5% that fall among the worst 2.5% for preventable mortality. The extent to which SMRs reflect preventable mortality rates is highly sensitive to the proportion of deaths that are preventable. If 6% of hospital deaths are preventable (as suggested by the literature), the predictive value of the SMR can be no greater than 9%. This value could rise to 30%, if 15% of deaths are preventable. The model offers a 'reality check' for case mix adjustment schemes designed to isolate the preventable component of any outcome rate.

PubMed Disclaimer

Figures

Figure 1
Figure 1
Diagnostic performance of the standardised mortality ratio (2-sigma upper limit) to detect a hospital among the worst 2.5% for preventable deaths. The curve shows the dependency of the upper bound for positive predictive value (PPV) (or true positive rate (TPR)) on the preventability index under a risk-adjustment scheme accounting for 80% of the variation between hospitals. The base case relationship cV = 2cM is assumed.
Figure 2
Figure 2
Three candidate distributions to describe variation among hospitals in rates of preventable mortality. The distributions are scaled to unit median and a log-normal model is assumed. Under the base case (cV=0.4) the hospital in the 95th centile would have about four times the preventable mortality rate of the hospital at the 5th centile. Under the most dispersed distribution (cV=1.0) the ratio between the 5th and 95th centiles (ie, 0.25 and 3.93) is more than 15, an implausibly large range across a random sample of 20 hospitals.

References

    1. Department of Health and Human Services Medicare Hospital Mortality Information 1986. Washington, DC: Government Printing Office, 1987
    1. Blumberg MS. Biased estimates of expected acute myocardial infarction mortality using MedisGroups admission severity groups. JAMA 1991;265:2965–70 - PubMed
    1. Greenfield S, Aronow HU, Elashoff RM, et al. Flaws in mortality data. The hazards of ignoring comorbid disease. JAMA 1988;260:2253–5 - PubMed
    1. Hofer TP, Hayward RA. Identifying poor-quality hospitals. Can hospital mortality rates detect quality problems for medical diagnoses? Med Care 1996;34:737–53 - PubMed
    1. Park RE, Brook RH, Kosecoff J, et al. Explaining variations in hospital death rates. Randomness, severity of illness, quality of care. JAMA 1990;264:484–90 - PubMed

Publication types