Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2004 Oct 30;329(7473):999.
doi: 10.1136/bmj.329.7473.999.

What's the evidence that NICE guidance has been implemented? Results from a national evaluation using time series analysis, audit of patients' notes, and interviews

Trevor A Sheldon  1 , Nicky Cullum, Diane Dawson, Annette Lankshear, Karin Lowson, Ian Watt, Peter West, Dianne Wright, John Wright
Affiliations

What's the evidence that NICE guidance has been implemented? Results from a national evaluation using time series analysis, audit of patients' notes, and interviews

Trevor A Sheldon et al. BMJ. .

Abstract

Objectives: To assess the extent and pattern of implementation of guidance issued by the National Institute for Clinical Excellence (NICE).

Design: Interrupted time series analysis, review of case notes, survey, and interviews.

Setting: Acute and primary care trusts in England and Wales.

Participants: All primary care prescribing, hospital pharmacies; a random sample of 20 acute trusts, 17 mental health trusts, and 21 primary care trusts; and senior clinicians and managers from five acute trusts.

Main outcome measures: Rates of prescribing and use of procedures and medical devices relative to evidence based guidance.

Results: 6308 usable patient audit forms were returned. Implementation of NICE guidance varied by trust and by topic. Prescribing of some taxanes for cancer (P < 0.002) and orlistat for obesity (P < 0.001) significantly increased in line with guidance. Prescribing of drugs for Alzheimer's disease and prophylactic extraction of wisdom teeth showed trends consistent with, but not obviously a consequence of, the guidance. Prescribing practice often did not accord with the details of the guidance. No change was apparent in the use of hearing aids, hip prostheses, implantable cardioverter defibrillators, laparoscopic hernia repair, and laparoscopic colorectal cancer surgery after NICE guidance had been issued.

Conclusions: Implementation of NICE guidance has been variable. Guidance seems more likely to be adopted when there is strong professional support, a stable and convincing evidence base, and no increased or unfunded costs, in organisations that have established good systems for tracking guidance implementation and where the professionals involved are not isolated. Guidance needs to be clear and reflect the clinical context.

PubMed Disclaimer

Figures

Fig 1
Fig 1
Wisdom teeth extraction activity, 1992-2001
Fig 2
Fig 2
Hospital use of paclitaxel (top) and docetaxel (bottom)
Fig 3
Fig 3
Total number of implantable cardioverter defibrillators implanted by quarter, 1995-2001
Fig 4
Fig 4
Use of orlistat in the community
Fig 5
Fig 5
Total use of Alzheimer's drugs in the community
See this image and copyright information in PMC

Comment in

References

    1. Department of Health. Faster access to modern treatment. London: DoH, London, 1999.
    1. Dillon A, Gibbs TG, Riley T, Sheldon TA. The National Institute for Clinical Excellence and coverage of Relenza by the NHS. In: Fox DM, Oxman AD, eds. Informing judgment: case studies of health policy and research in six countries. New York: Milbank Memorial Fund, 2001.
    1. McDowall D, McCleary R, Meidinger EE, Hay RA. Interrupted time series analysis. Quantitative applications in the social sciences, volume 21. Thousand Oaks, CA: Sage, 1980.
    1. Box G, Jenkins G. Time series analysis: forecasting and control. 2nd ed. San Francisco: Holden Day, 1984.
    1. Park RE, Fink A, Brook RH, Chassin MR, Kahn KL, Merrick NJ, et al. Physician ratings of appropriate indications for three procedures: theoretical indications vs indications used in practice. Am J Public Health 1989;79: 445-7. - PMC - PubMed

Publication types