Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 1998 Jun 27;316(7149):1931-5.
doi: 10.1136/bmj.316.7149.1931.

Annual league tables of mortality in neonatal intensive care units: longitudinal study. International Neonatal Network and the Scottish Neonatal Consultants and Nurses Collaborative Study Group

G J Parry  1 , C R Gould, C J McCabe, W O Tarnow-Mordi
Affiliations

Annual league tables of mortality in neonatal intensive care units: longitudinal study. International Neonatal Network and the Scottish Neonatal Consultants and Nurses Collaborative Study Group

G J Parry et al. BMJ. .

Abstract

Objective: To assess whether crude league tables of mortality and league tables of risk adjusted mortality accurately reflect the performance of hospitals.

Design: Longitudinal study of mortality occurring in hospital.

Setting: 9 neonatal intensive care units in the United Kingdom.

Subjects: 2671 very low birth weight or preterm infants admitted to neonatal intensive care units between 1988 and 1994.

Main outcome measures: Crude hospital mortality and hospital mortality adjusted using the clinical risk index for babies (CRIB) score.

Results: Hospitals had wide and overlapping confidence intervals when ranked by mortality in annual league tables; this made it impossible to discriminate between hospitals reliably. In most years there was no significant difference between hospitals, only random variation. The apparent performance of individual hospitals fluctuated substantially from year to year.

Conclusions: Annual league tables are not reliable indicators of performance or best practice; they do not reflect consistent differences between hospitals. Any action prompted by the annual league tables would have been equally likely to have been beneficial, detrimental, or irrelevant. Mortality should be compared between groups of hospitals using specific criteria-such as differences in the volume of patients, staffing policy, training of staff, or aspects of clinical practice-after adjusting for risk. This will produce more reliable estimates with narrower confidence intervals, and more reliable and rapid conclusions.

PubMed Disclaimer

Figures

Figure 1
Figure 1
Annual league tables of crude mortality for nine neonatal intensive care units for each year and for all years combined. Mortality is lower than expected when the W score and 95% confidence interval are both <0. Hospitals were ranked in descending order of apparent performance by W score
Figure 2
Figure 2
Annual league tables of risk adjusted mortality in nine neonatal intensive care units for each year and for all years combined. Mortality is lower than expected when the W score and 95% confidence interval are both <0. Hospitals were ranked in descending order of apparent performance by W score. The 95% confidence intervals of the hospitals that apparently performed best and those that apparently performed worst overlapped for every year except year 3
See this image and copyright information in PMC

Comment in

References

    1. Department of Health. Patient’s charter. London: HMSO; 1991.
    1. Clinical Outcomes Working Group. Clinical outcome indicators. Edinburgh: Scottish Office; 1994.
    1. McKee M. Indicators of clinical performance. BMJ. 1997;315:142. - PMC - PubMed
    1. Butler R. Discussion. In: Goldstein H, Spiegelhalter D. League tables and their limitations: statistical issues in comparisons of institutional performance. J R Statis Soc (A) 1996;159:409.
    1. Wise J. Clinical indicators for hospitals announced. BMJ. 1997;315:76.

Publication types