Tools developed and disseminated by guideline producers to promote the uptake of their guidelines
- PMID: 27546228
- PMCID: PMC10506131
- DOI: 10.1002/14651858.CD010669.pub2
Tools developed and disseminated by guideline producers to promote the uptake of their guidelines
Abstract
Background: The uptake of clinical practice guidelines (CPGs) is inconsistent, despite their potential to improve the quality of health care and patient outcomes. Some guideline producers have addressed this problem by developing tools to encourage faster adoption of new guidelines. This review focuses on the effectiveness of tools developed and disseminated by guideline producers to improve the uptake of their CPGs.
Objectives: To evaluate the effectiveness of implementation tools developed and disseminated by guideline producers, which accompany or follow the publication of a CPG, to promote uptake. A secondary objective is to determine which approaches to guideline implementation are most effective.
Search methods: We searched the Cochrane Effective Practice and Organisation of Care (EPOC) Group Specialised Register, Cochrane Central Register of Controlled Trials (CENTRAL); NHS Economic Evaluation Database, HTA Database; MEDLINE and MEDLINE In-Process and other non-indexed citations; Embase; PsycINFO; CINAHL; Dissertations and Theses, ProQuest; Index to Theses; Science Citation Index Expanded, ISI Web of Knowledge; Conference Proceedings Citation Index - Science, ISI Web of Knowledge; Health Management Information Consortium (HMIC), and NHS Evidence up to February 2016. We also searched trials registers, reference lists of included studies and relevant websites.
Selection criteria: We included randomised controlled trials (RCTs) and cluster-RCTs, controlled before-and-after studies (CBAs) and interrupted time series (ITS) studies evaluating the effects of guideline implementation tools developed by recognised guideline producers to improve the uptake of their own guidelines. The guideline could target any clinical area.
Data collection and analysis: Two review authors independently extracted data and assessed the risk of bias of each included study using the Cochrane 'Risk of bias' criteria. We graded our confidence in the evidence using the approach recommended by the GRADE working group. The clinical conditions targeted and the implementation tools used were too heterogenous to combine data for meta-analysis. We report the median absolute risk difference (ARD) and interquartile range (IQR) for the main outcome of adherence to guidelines.
Main results: We included four cluster-RCTs that were conducted in the Netherlands, France, the USA and Canada. These studies evaluated the effects of tools developed by national guideline producers to implement their CPGs. The implementation tools evaluated targeted healthcare professionals; none targeted healthcare organisations or patients.One study used two short educational workshops tailored to barriers. In three studies the intervention consisted of the provision of paper-based educational materials, order forms or reminders, or both. The clinical condition, type of healthcare professional, and behaviour targeted by the CPG varied across studies.Two of the four included studies reported data on healthcare professionals' adherence to guidelines. A guideline tool developed by the producers of a guideline probably leads to increased adherence to the guidelines; median ARD (IQR) was 0.135 (0.115 and 0.159 for the two studies respectively) at an average four-week follow-up (moderate certainty evidence), which indicates a median 13.5% greater adherence to guidelines in the intervention group. Providing healthcare professionals with a tool to improve implementation of a guideline may lead to little or no difference in costs to the health service.
Authors' conclusions: Implementation tools developed by recognised guideline producers probably lead to improved healthcare professionals' adherence to guidelines in the management of non-specific low back pain and ordering thyroid-function tests. There are limited data on the relative costs of implementing these interventions.There are no studies evaluating the effectiveness of interventions targeting the organisation of care (e.g. benchmarking tools, costing templates, etc.), or for mass media interventions. We could not draw any conclusions about our second objective, the comparative effectiveness of implementation tools, due to the small number of studies, the heterogeneity between interventions, and the clinical conditions that were targeted.
Conflict of interest statement
GF None known.
AH None known.
LG None known.
ME None known.
JG holds the Canada Research Chair in Health Knowledge Transfer and Uptake.
GL is Deputy Chief Executive and Director of Health and Social Care at the National Institute for Health and Care Excellence (NICE), and has responsibility for the implementation programme that includes the development of implementation tools.
SS None known.
Figures
Update of
References
References to studies included in this review
Bekkering 2005 {published data only}
-
- Bekkering GE, Hendriks HJM, Tulder MW, Knol DL, Hoeijenbos M, Oostendorp RAB, et al. Effect on the process of care of an active strategy to implement clinical guidelines on physiotherapy for low back pain: a cluster randomised controlled trial. Quality & Safety in Health Care 2005;14:107‐12. - PMC - PubMed
-
- Hoeijenbos M, Bekkering T, Lamers L, Hendriks E, Tulder M, Koopmanschap M. Cost‐effectiveness of an active implementation strategy for the Dutch physiotherapy guideline for low back pain. Health Policy 2005;75(1):85‐98. - PubMed
Daucourt 2003 {published data only}
-
- Daucourt V, Saillour‐Glenisson F, Michel P, Jutand M‐A, Abouelfath A. A multicenter cluster randomized controlled trial of strategies to improve thyroid function testing. Medical Care 2003;41:432‐41. - PubMed
-
- Saillour‐Glenisson F, Michel P, Daucourt V. Medico‐Economic assessment of two methods for implementing thyroid‐testing guidelines. Revue d'Épidémiol et de Santé Publique 2005;53(1):S79‐88. - PubMed
Fine 2003 {published data only}
-
- Fine MJ, Stone RA, Lave JR, Hough LJ, Obrosky SD, Mor MK, et al. Implementation of an evidence‐based guideline to reduce duration of Intravenous antibiotic therapy and length of stay for patients hospitalized with community‐acquired pneumonia: A randomized controlled trial. American Journal of Medicine 2003;115:343‐51. - PubMed
Shah 2014 {published data only}
References to studies excluded from this review
Allegranzi 2013 {published data only}
-
- Allegranzi B, Gayet‐Ageron A, Damani N, Bengaly L, McLaws ML, Moro ML, et al. Global implementation of WHO’s multimodal strategy for improvement of hand hygiene: a quasi‐experimental study. Lancet Infectious Disease 2013;13(10):843‐51. - PubMed
-
- Pittet D, Allegranzi B, Storr J. The WHO Clean Care is Safer Care programme: field‐testing to enhance sustainability and spread of hand hygiene improvement. Journal of Infection and Public Health 2008;1(1):4‐10. - PubMed
Baker 2001 {published data only}
Bosch 2014 {published data only}
-
- Bosch M, McKenzie JE, Mortimer D, Tavender EJ, Francis JJ, Brennan SE, et al. Implementing evidence‐based recommended practices for the management of patients with mild traumatic brain injuries in Australian emergency care departments: study protocol for a cluster randomised controlled trial. Trials [Electronic Resource] 2014; Vol. 15:281. - PMC - PubMed
Chan 2013 {published data only}
-
- Taddio A, Ipp M, Apppleton M, Chambers C, Halperin S, Lockett D, et al. Implementing best practices for vaccination pain management. Pediatrics and Child Health [Canada] Conference: 91st Annual Conference of the Canadian Paediatric Society Montreal, QC Canada.. 2014; Vol. 19(6):e102‐3, issue 6:e102‐3.
De Beurs 2015 {published data only}
-
- Beurs DP, Groot MH, Keijser J, Mokkenstorm J, Duijn E, Winter RFP. The effect of an e‐learning supported Train‐the‐Trainer programme on implementation of suicide guidelines in mental healthcare. Journal of Affective Disorders 2015;175:446‐53. - PubMed
-
- Beurs DP, Groot MH, Bosmans JE, Keijser J, Mokkenstorm J, Verwey B, et al. Reducing patients' suicide ideation through training mental health teams in the application of the Dutch multidisciplinary practice guideline on assessment and treatment of suicidal behavior: Study protocol of a randomized controlled trial. Trials 2013; Vol. 14:1‐10. [DOI: 10.1186/1745-6215-14-372] - DOI - PMC - PubMed
-
- Beurs DP, Groot MH, Keijser J, Verwey B, Mokkenstorm J, Twisk JW, et al. Improving the application of a practice guideline for the assessment and treatment of suicidal behavior by training the full staff of psychiatric departments via an e‐learning supported Train‐the‐Trainer program: study protocol for a randomized controlled trial. Trials 2013; Vol. 14:1‐10. [DOI: 10.1186/1745-6215-14-9] - DOI - PMC - PubMed
-
- Groot M, Beurs DP, Keijser J, Kerkhof FJM. An e‐learning supported Train‐the‐Trainer program to implement a suicide practice guideline. Rationale, content and dissemination in Dutch mental health care. Internet Interventions 2015;2:323‐9. [DOI: 10.1186/1745-6215-14-9] - DOI
Eccles 2002 {published data only}
-
- Eccles M, Rousseau N, Adams P, Thomas L, North of England Stable Angina Guideline Development Group. Evidencebased guideline for the primary care management of stable angina. Family Practice 2001;18(2):217‐22. - PubMed
-
- Eccles M, Rousseau N, Higgins B, Thomas L. Evidencebased guideline on the primary care management of asthma. Family Practice 2001;18(2):223‐9. - PubMed
Eccles 2007 {published data only}
Flottorp 2002 {published data only}
-
- Flottorp S, Oxman AD, Håvelsrud K, Treweek S, Herrin J. Identifying barriers and tailoring interventions to improve the management of urinary tract infections and sore throat: apragmatic study using qualitative methods. BMJ 2003;325(7360):1‐10.
Fretheim 2006 {published data only}
-
- Fretheim A, Oxman AD, Treweek S, Bjørndal A. Rational Prescribing in Primary Care (RaPP‐trial). A randomised trial of a tailored intervention to improve prescribing of antihypertensive and cholesterol‐lowering drugs in general practice [ISRCTN48751230]. BMC Health Service Research 2003;3(5):1‐8. - PMC - PubMed
Overbeek 2010 {published data only}
-
- Overbeek LI, Hermens RP, Krieken JH, Adang EM, Casparie M, Nagengast FM, et al. Electronic reminders for pathologists promote recognition of patients at risk for Lynch syndrome: cluster‐randomised controlled trial. Virchows Archiv 2010;456:653‐9. [DOI: 10.1007/s00428-010-0907-7] - DOI - PMC - PubMed
Robling 2002 {published data only}
-
- Robling MR, Houston HLA, Kinnersley P, Hourihan MD, Cohen DR, Hale J, et al. General practitioners' use of magnetic resonance imaging: An open randomised trial comparing telephone and written requests and an open randomised controlled trial of different methods of local guideline dissemination. Clinical Radiology 2002;57:402‐7. - PubMed
Rood 2005 {published data only}
Rycroft‐Malone 2012 {published data only}
Witt 2004 {published data only}
-
- Witt K, Knudsen E, Ditlevsen S, Hollnagel H. Academic detailing has no effect on prescribing of asthma medication in Danish general practice: a 3‐year randomized controlled trial with 12‐monthly follow‐ups. Family Practice 2004;21(3):248‐53. - PubMed
References to studies awaiting assessment
Maximov 2012 {published data only}
-
- Maximov D, Lesnyak O. Implementation of the osteoarthritis clinical guideline: Results of a cluster randomized trial in primary care. Annals of Rheumatic Disorders 2012; Vol. 71, issue Suppl 3:307.
Van Driel 2007 {published data only}
References to ongoing studies
Salbach 2014 {published data only}
-
- Salbach NM, Wood‐Dauphinee S, Desrosiers J, Eng J, Graham I, Jaglal S. Effectiveness of a multi‐component knowledge translation intervention in improving implementation of a stroke rehabilitation guideline: a cluster randomized controlled trial. Canadian Stroke Congress Abstracts 2014; Vol. 37, issue Suppl 1:43.
Te Boveldt 2011 {published data only}
-
- Boveldt N, Engels Y, Besse K, Vissers K, Vernooij‐Dassen M. Rationale, design, and implementation protocol of the Dutch clinical practice guideline pain in patients with cancer: a cluster randomised controlled trial with Short Message Service (SMS) and Interactive Voice Response (IVR). Implementation Science 2011;6(126):1‐11. - PMC - PubMed
Additional references
ACC 2016
-
- American College of Cardiology. Guideline Clinical App. http://www.acc.org/tools‐and‐practice‐support/mobile‐resources/features/... 2016 (accessed August 2016).
AGREE 2010
Akl 2013
Baker 2015
Beaulieu 2004
-
- Beaulieu M‐D, Brophy J, Jacques A, Blais R, Battista R, et al. Drug treatment of stable angina pectoris and mass dissemination of therapeutic guidelines: a randomized controlled trial. QJM 2004;97(1):21‐31. - PubMed
Bebb 2007
Bekkering 2003
-
- Bekkering GE, Hendriks HJM, Koes BW. Dutch physiotherapy guidelines for low back pain.. Physiotherapy 2003;89:82‐96.
Bero 1998
Davis 1995
-
- Davis DA, Thomson MA, Oxman AD, Haynes RB. Changing physician performance. A systematic review of the effect of continuing medical education strategies. JAMA 1995;274(9):700‐5. - PubMed
Davis 1997
eGuidelines
-
- eGuidelines.co.uk. Handbook of United Kingdom and European clinical guidelines for primary and shared care. www.eguidelines.co.uk/new_guidelines.php (accessed October 2011).
EndNote X7 [Computer program]
-
- Thomson Reuters. EndNote X7. Thomson Reuters, 2014.
EPOC 2015
-
- Effective Practice, Organisation of Care (EPOC). Suggested risk of bias criteria for EPOC reviews. epoc.cochrane.org/epoc‐specific‐resources‐review‐authors 2015 (accessed 7 August 2016).
eVTE 2013
-
- e‐Learning for Healthcare. e‐VTE. www.e‐lfh.org.uk/programmes/vte/ (accessed 7 August 2016).
Field 1990
-
- Field MJ, Lohr KN (editors). Clinical Practice Guidelines – directions for a new programme . Institute of Medicine. Washington DC: National Academy Press, 1990. - PubMed
Flodgren 2011
Flodgren 2013a
Forsetlund 2009
Gagliardi 2011
Giguère 2012
Gkeredakis 2011
-
- Gkeredakis E, Swan J, Powell J, Nicolini D, Scarbrough H, Roginski C, et al. Mind the gap: Understanding utilisation of evidence and policy in health care management practice. Journal of Health Organization and Management 2011;25(3):298‐314. - PubMed
Greenhalgh 2005
-
- Greenhalgh T, Robert G, Bate P, Macfarlane F, Kyriakidou O. Diffusion of Innovations in Health Service Organisations. A systematic literature review. Oxford: Blackwell Publishing, 2005.
Grilli 2002
Grimshaw 1993
-
- Grimshaw JM, Russell IT. Effect of clinical guidelines on medical practice: a systematic review of rigorous evaluations. Lancet 1993;342(8883):1317‐22. - PubMed
Grimshaw 1995
-
- Grimshaw J, Eccles M, Russell I. Developing clinically valid practice guidelines. Journal of Evaluation in Clinical Practice 1995;1(1):37‐48. - PubMed
Grimshaw 2004
-
- Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, et al. Effectiveness and efficiency of guideline dissemination and implementation strategies. NHS R&D HTA programme 2004. - PubMed
Grimshaw 2006
Grol 2003
-
- Grol R, Grimshaw J. From best evidence to best practice: effective implementation of change in patients' care. Lancet 2003;362(9391):1225‐30. - PubMed
Higgins 2011
-
- Higgins JPT, Green S (editors). Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011]. The Cochrane Collaboration, 2011. Available from www.cochrane‐handbook.org.
Hoeijenbos 2005
-
- Hoeijenbos M, Bekkering T, Lamers L, Hendriks E, Tulder M, Koopmanschap M. Cost‐effectiveness of an active implementation strategy for the Dutch physiotherapy guideline for low back pain. Health Policy 2005;75(1):85‐98. - PubMed
Hoffman 2014
-
- Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ 2014;348:g1687. - PubMed
Horbar 2004
Jamtvedt 2006
Kanter 2010
Khunti 1998
-
- Khunti K, Baker R, Robertson N. Development of evidence‐based review criteria for the management of patients with depression in general practice. Primary Care Psychiatry 1998;4:29‐33.
Leng 2013 [pers comm]
-
- Leng G. (National Institute for Health and Care Excellence (NICE), UK). [personal communication]. Conversation with: S Shepperd, (Tools to promote the uptake of guidelines Review Study Team, Oxford, UK) 2013.
Mehta 2002
-
- Mehta RH, Montoye CK, Gallogly M, Baker P, Blount A, Faul J, et al. GAP Steering Committee of the American College of Cardiology. Improving quality of care for acute myocardial infarction: The Guidelines Applied in Practice (GAP) Initiative. JAMA 2002;287(10):1269‐76. - PubMed
Murrey 1992
-
- Murrey KO, Gottlieb LK, Schoenbaum SC. Implementing clinical guidelines: a quality management approach to reminder systems. QRB Quality Review Bulletin 1992;16(12):423‐433. - PubMed
NHS 2012a
-
- National Health Service (NHS). NHS Evidence. www.evidence.nhs.uk/accreditation# (accessed 30 March 2013).
NICE 2012b
-
- National Institute of Clinical Excellence. Online educational tools. http://www.nice.org.uk/usingguidance/education/educational_tools.jsp (accessed 30 March 2012).
NICE 2016
-
- National Institute of Clinical Excellence (NICE). Guidance and advice list. https://www.nice.org.uk/guidance/published?type=qs (accessed 12 August 2016).
O'Brien 2007
Peleg 2010
Review Manager 2014 [Computer program]
-
- The Nordic Cochrane Centre, The Cochrane Collaboration. Review Manager (RevMan). Version 5.3. Copenhagen: The Nordic Cochrane Centre, The Cochrane Collaboration, 2014.
Rogers 1995
-
- Rogers E. Diffusion of Innovation. 5th Edition. New York: Free Press. A division of Simon & Schuster, 1995.
Saillour Glénisson 2001
-
- Saillour‐Glénisson F. Guidelines for thyroid function tests in adults. Presse Medical 2001;30:686‐692. - PubMed
Saillour‐Glénisson 2005
-
- Saillour‐Glénisson F, Michel P, Daucourt V. Medico‐economic assessment of two methods for implementing thyroid‐testing guidelines. Revue d'Épidémiol et de Santé Publique 2005;53(1):1S79‐88. - PubMed
Schuster 1998
Seddon 2001
Shea 1996
Shiffman 2005
Shojania 2009
SIGN 2012
-
- Scottish Intercollegiate Guidelines Network (SIGN). SIGN implementation support. www.sign.ac.uk/implementation/index.html (accessed 30 March 2012).
Titler 2001
-
- Titler M, Everett LQ. Translating research into practice. Considerations for critical care investigators. Critical Care Nursing Clinics North America 2001;13(4):587‐604. - PubMed
Titler 2009
Wang 2002
-
- Wang D, Peleg M, Tu SW, Boxwala AA, Greenes RA, Patel VL, et al. Representation primitives, process models and patient data in computer‐interpretable clinical practice guidelines: a literature review of guideline representation models. International Journal of Medical Informatics 2002;68(1‐3):59‐70. - PubMed
Weingarten 2000
-
- Weingarten S. Translating practice guidelines into patient care: guidelines at the bedside. Chest. 2000;188 (Suppl):4S–7S 2000;188:Suppl:4S‐7S. - PubMed
Wensing 1998
References to other published versions of this review
Publication types
MeSH terms
Grants and funding
LinkOut - more resources
Full Text Sources
Other Literature Sources
Medical
