Computer-generated reminders delivered on paper to healthcare professionals: effects on professional practice and healthcare outcomes
- PMID: 28681432
- PMCID: PMC6483307
- DOI: 10.1002/14651858.CD001175.pub4
Computer-generated reminders delivered on paper to healthcare professionals: effects on professional practice and healthcare outcomes
Abstract
Background: Clinical practice does not always reflect best practice and evidence, partly because of unconscious acts of omission, information overload, or inaccessible information. Reminders may help clinicians overcome these problems by prompting them to recall information that they already know or would be expected to know and by providing information or guidance in a more accessible and relevant format, at a particularly appropriate time. This is an update of a previously published review.
Objectives: To evaluate the effects of reminders automatically generated through a computerized system (computer-generated) and delivered on paper to healthcare professionals on quality of care (outcomes related to healthcare professionals' practice) and patient outcomes (outcomes related to patients' health condition).
Search methods: We searched CENTRAL, MEDLINE, Embase, six other databases and two trials registers up to 21 September 2016 together with reference checking, citation searching and contact with study authors to identify additional studies.
Selection criteria: We included individual- or cluster-randomized and non-randomized trials that evaluated the impact of computer-generated reminders delivered on paper to healthcare professionals, alone (single-component intervention) or in addition to one or more co-interventions (multi-component intervention), compared with usual care or the co-intervention(s) without the reminder component.
Data collection and analysis: Review authors working in pairs independently screened studies for eligibility and abstracted data. For each study, we extracted the primary outcome when it was defined or calculated the median effect size across all reported outcomes. We then calculated the median improvement and interquartile range (IQR) across included studies using the primary outcome or median outcome as representative outcome. We assessed the certainty of the evidence according to the GRADE approach.
Main results: We identified 35 studies (30 randomized trials and five non-randomized trials) and analyzed 34 studies (40 comparisons). Twenty-nine studies took place in the USA and six studies took place in Canada, France, Israel, and Kenya. All studies except two took place in outpatient care. Reminders were aimed at enhancing compliance with preventive guidelines (e.g. cancer screening tests, vaccination) in half the studies and at enhancing compliance with disease management guidelines for acute or chronic conditions (e.g. annual follow-ups, laboratory tests, medication adjustment, counseling) in the other half.Computer-generated reminders delivered on paper to healthcare professionals, alone or in addition to co-intervention(s), probably improves quality of care slightly compared with usual care or the co-intervention(s) without the reminder component (median improvement 6.8% (IQR: 3.8% to 17.5%); 34 studies (40 comparisons); moderate-certainty evidence).Computer-generated reminders delivered on paper to healthcare professionals alone (single-component intervention) probably improves quality of care compared with usual care (median improvement 11.0% (IQR 5.4% to 20.0%); 27 studies (27 comparisons); moderate-certainty evidence). Adding computer-generated reminders delivered on paper to healthcare professionals to one or more co-interventions (multi-component intervention) probably improves quality of care slightly compared with the co-intervention(s) without the reminder component (median improvement 4.0% (IQR 3.0% to 6.0%); 11 studies (13 comparisons); moderate-certainty evidence).We are uncertain whether reminders, alone or in addition to co-intervention(s), improve patient outcomes as the certainty of the evidence is very low (n = 6 studies (seven comparisons)). None of the included studies reported outcomes related to harms or adverse effects of the intervention.
Authors' conclusions: There is moderate-certainty evidence that computer-generated reminders delivered on paper to healthcare professionals probably slightly improves quality of care, in terms of compliance with preventive guidelines and compliance with disease management guidelines. It is uncertain whether reminders improve patient outcomes because the certainty of the evidence is very low. The heterogeneity of the reminder interventions included in this review also suggests that reminders can probably improve quality of care in various settings under various conditions.
Conflict of interest statement
Chantal Arditi: none known.
Myriam Rège‐Walther: none known.
Pierre Durieux: none known.
Bernard Burnand: none known.
Figures






Update of
-
Computer-generated reminders delivered on paper to healthcare professionals; effects on professional practice and health care outcomes.Cochrane Database Syst Rev. 2012 Dec 12;12:CD001175. doi: 10.1002/14651858.CD001175.pub3. Cochrane Database Syst Rev. 2012. Update in: Cochrane Database Syst Rev. 2017 Jul 06;7:CD001175. doi: 10.1002/14651858.CD001175.pub4. PMID: 23235578 Updated.
Similar articles
-
Computer-generated reminders delivered on paper to healthcare professionals; effects on professional practice and health care outcomes.Cochrane Database Syst Rev. 2012 Dec 12;12:CD001175. doi: 10.1002/14651858.CD001175.pub3. Cochrane Database Syst Rev. 2012. Update in: Cochrane Database Syst Rev. 2017 Jul 06;7:CD001175. doi: 10.1002/14651858.CD001175.pub4. PMID: 23235578 Updated.
-
Manually-generated reminders delivered on paper: effects on professional practice and patient outcomes.Cochrane Database Syst Rev. 2019 Dec 18;12(12):CD001174. doi: 10.1002/14651858.CD001174.pub4. Cochrane Database Syst Rev. 2019. PMID: 31858588 Free PMC article.
-
Patient-mediated interventions to improve professional practice.Cochrane Database Syst Rev. 2018 Sep 11;9(9):CD012472. doi: 10.1002/14651858.CD012472.pub2. Cochrane Database Syst Rev. 2018. PMID: 30204235 Free PMC article.
-
Continuing education meetings and workshops: effects on professional practice and healthcare outcomes.Cochrane Database Syst Rev. 2021 Sep 15;9(9):CD003030. doi: 10.1002/14651858.CD003030.pub3. Cochrane Database Syst Rev. 2021. PMID: 34523128 Free PMC article.
-
Professional, structural and organisational interventions in primary care for reducing medication errors.Cochrane Database Syst Rev. 2017 Oct 4;10(10):CD003942. doi: 10.1002/14651858.CD003942.pub3. Cochrane Database Syst Rev. 2017. PMID: 28977687 Free PMC article.
Cited by
-
Implementation interventions to promote the uptake of evidence-based practices in stroke rehabilitation.Cochrane Database Syst Rev. 2020 Oct 15;10(10):CD012575. doi: 10.1002/14651858.CD012575.pub2. Cochrane Database Syst Rev. 2020. PMID: 33058172 Free PMC article.
-
Implementing advance care planning in heart failure: a qualitative study of primary healthcare professionals.Br J Gen Pract. 2021 Jun 24;71(708):e550-e560. doi: 10.3399/BJGP.2020.0973. Print 2021 Jul. Br J Gen Pract. 2021. PMID: 33947665 Free PMC article.
-
Implementation of national childbirth guidelines in Brazil: barriers and strategies.Rev Panam Salud Publica. 2020 Dec 30;44:e170. doi: 10.26633/RPSP.2020.170. eCollection 2020. Rev Panam Salud Publica. 2020. PMID: 33417646 Free PMC article.
-
Interventions to change the behaviour of health professionals and the organisation of care to promote weight reduction in children and adults with overweight or obesity.Cochrane Database Syst Rev. 2017 Nov 30;11(11):CD000984. doi: 10.1002/14651858.CD000984.pub3. Cochrane Database Syst Rev. 2017. PMID: 29190418 Free PMC article.
-
Multicomponent integrated care for patients with chronic heart failure: systematic review and meta-analysis.ESC Heart Fail. 2023 Apr;10(2):791-807. doi: 10.1002/ehf2.14207. Epub 2022 Nov 14. ESC Heart Fail. 2023. PMID: 36377317 Free PMC article.
References
References to studies included in this review
Barnett 1983 {published data only}
-
- Barnett GO, Winickoff RN, Morgan MM, Zielstorff RD. A computer‐based monitoring system for follow‐up of elevated blood pressure. Medical Care 1983;21(4):400‐9. - PubMed
Becker 1989 {published data only}
-
- Becker DM, Gomez EB, Kaiser DL, Yoshihasi A, Hodge RH Jr. Improving preventive care at a medical clinic: how can the patient help?. American Journal of Preventive Medicine 1989;5(6):353‐9. - PubMed
Binstock 1997 {published data only}
-
- Binstock MA, Geiger AM, Hackett JR, Yao JF. Pap smear outreach: a randomized controlled trial in an HMO. American Journal of Preventive Medicine 1997;13(6):425‐6. - PubMed
Burack 1996 {published data only}
-
- Burack RC, Gimotty PA, George J, Simon MS, Dews P, Moncrease A. The effect of patient and physician reminders on use of screening mammography in a health maintenance organization. Results of a randomized controlled trial. Cancer 1996;78(8):1708‐21. - PubMed
Burack 1998 {published data only}
-
- Burack RC, Gimotty PA, George J, McBride S, Moncrease A, Simon MS, et al. How reminders given to patients and physicians affected pap smear use in a health maintenance organization: results of a randomized controlled trial. Cancer 1998;82(12):2391‐400. - PubMed
Chambers 1989 {published data only}
-
- Chambers CV, Balaban DJ, Carlson BL, Ungemack JA, Grasberger DM. Microcomputer‐generated reminders. Improving the compliance of primary care physicians with mammography screening guidelines. Journal of Family Practice 1989;29(3):273‐80. - PubMed
Chambers 1991 {published data only}
-
- Chambers CV, Balaban DJ, Carlson BL, Grasberger DM. The effect of microcomputer‐generated reminders on influenza vaccination rates in a university‐based family practice center. Journal of the American Board of Family Practice 1991;4(1):19‐26. - PubMed
Dexter 1998 {published data only}
-
- Dexter PR, Wolinsky FD, Gramelspacher GP, Zhou XH, Eckert GJ, Waisburd M, et al. Effectiveness of computer‐generated reminders for increasing discussions about advance directives and completion of advance directive forms. A randomized, controlled trial. Annals of Internal Medicine 1998;128(2):102‐10. - PubMed
Gilutz 2009 {published data only}
-
- Gilutz H, Novack L, Shvartzman P, Zelingher J, Bonneh DY, Henkin Y, et al. Computerized community cholesterol control (4C): meeting the challenge of secondary prevention. Israel Medical Association Journal 2009;11(1):23‐9. [PUBMED: 19344008] - PubMed
Heidenreich 2005 {published data only}
-
- Heidenreich PA, Chacko M, Goldstein MK, Atwood JE. ACE inhibitor reminders attached to echocardiography reports of patients with reduced left ventricular ejection fraction. American Journal of Medicine 2005;118(9):1034‐7. - PubMed
Heidenreich 2007 {published data only}
-
- Heidenreich PA, Gholami P, Sahay A, Massie B, Goldstein MK. Clinical reminders attached to echocardiography reports of patients with reduced left ventricular ejection fraction increase use of beta‐blockers: a randomized trial. Circulation 2007;115(22):2829‐34. - PubMed
Heiman 2004 {published data only}
-
- Heiman H, Bates DW, Fairchild D, Shaykevich S, Lehmann LS. Improving completion of advance directives in the primary care setting: a randomized controlled trial. American Journal of Medicine 2004;117(5):318‐24. - PubMed
Javitt 2005 {published and unpublished data}
-
- Javitt JC, Steinberg G, Locke T, Couch JB, Jacques J, Juster I, et al. Using a claims data‐based sentinel system to improve compliance with clinical guidelines: results of a randomized prospective study. American Journal of Managed Care 2005;11(2):93‐102. - PubMed
Le Breton 2016 {published data only}
-
- Breton J, Ferrat E, Attali C, Bercier S, Corvoisier P, Brixi Z, et al. Effect of reminders mailed to general practitioners on colorectal cancer screening adherence: a cluster‐randomized trial. European journal of cancer prevention : the official journal of the European Cancer Prevention Organisation (ECP) 2016;25(5):380‐7. [PUBMED: 26340058] - PubMed
Lobach 1997 {published data only}
-
- Lobach DF, Hammond WE. Computerized decision support based on a clinical practice guideline improves compliance with care standards. American Journal of Medicine 1997;102(1):89‐98. - PubMed
Majumdar 2007 {published data only}
-
- Majumdar SR, McAlister FA, Tsuyuki RT. A cluster randomized trial to assess the impact of opinion leader endorsed evidence summaries on improving quality of prescribing for patients with chronic cardiovascular disease: rationale and design [ISRCTN26365328]. BMC Cardiovascular Disorders 2005;5(1):17. - PMC - PubMed
-
- Majumdar SR, Tsuyuki RT, McAlister FA. Impact of opinion leader‐endorsed evidence summaries on the quality of prescribing for patients with cardiovascular disease: a randomized controlled trial. American Heart Journal 2007;153(1):22.e1‐8. - PubMed
Mazzuca 1990 {published data only}
-
- Mazzuca SA, Vinicor F, Einterz RM, Tierney WM, Norton JA, Kalasinski LA. Effects of the clinical environment on physicians' response to postgraduate medical education. American Educational Research Journal 1990;27(3):473‐88.
McAlister 2009 {published data only}
-
- McAlister FA, Fradette M, Graham M, Majumdar SR, Ghali WA, Williams R, et al. A randomized trial to assess the impact of opinion leader endorsed evidence summaries on the use of secondary prevention strategies in patients with coronary artery disease: the ESP‐CAD trial protocol [NCT00175240]. Implementation Science 2006;1:11. - PMC - PubMed
McDonald 1976a {published data only}
-
- McDonald CJ. Protocol‐based computer reminders, the quality of care and the non‐perfectability of man. New England Journal of Medicine 1976;295(24):1351‐5. - PubMed
McDonald 1976b {published data only}
-
- McDonald CJ. Use of a computer to detect and respond to clinical events: its effect on clinician behavior. Annals of Internal Medicine 1976;84(2):162‐7. - PubMed
McDonald 1980 {published data only}
-
- McDonald CJ, Wilson GA, McCabe GP Jr. Physician response to computer reminders. JAMA 1980;244(14):1579‐81. - PubMed
McDonald 1984 {published data only}
-
- McDonald CJ, Hui SL, Smith DM, Tierney WM, Cohen SJ, Weinberger M, et al. Reminders to physicians from an introspective computer medical record. A two‐year randomized trial. Annals of Internal Medicine 1984;100(1):130‐8. - PubMed
-
- McDonald CJ, Hui SL, Tierney WM. Effects of computer reminders for influenza vaccination on morbidity during influenza epidemics. MD Computing 1992;9(5):304‐12. - PubMed
McPhee 1989 {published data only}
-
- Bird JA, McPhee SJ, Jenkins C, Fordham D. Three strategies to promote cancer screening. How feasible is wide‐scale implementation?. Medical Care 1990;28(11):1005‐12. - PubMed
-
- Fordham D, McPhee SJ, Bird JA, Rodnick JE, Detmer WM. The Cancer Prevention Reminder System. MD Computing 1990;7(5):289‐95. - PubMed
-
- McPhee SJ, Bird JA, Jenkins CN, Fordham D. Promoting cancer screening. A randomized, controlled trial of three interventions. Archives of Internal Medicine 1989;149(8):1866‐72. - PubMed
Morgan 1978 {published data only}
-
- Morgan M, Studney DR, Barnett GO, Winickoff RN. Computerized concurrent review of prenatal care. QRB. Quality Review Bulletin 1978;4(9):33‐6. - PubMed
Nilasena 1995 {published data only}
Oniki 2003 {published data only}
Ornstein 1991 {published data only}
-
- Ornstein SM, Garr DR, Jenkins RG, Rust PF, Arnon A. Computer‐generated physician and patient reminders. Tools to improve population adherence to selected preventive services. Journal of Family Practice 1991;32(1):82‐90. - PubMed
Rosser 1991 {published data only}
-
- McDowell I, Newell C, Rosser W. A randomized trial of computerized reminders for blood pressure screening in primary care. Medical Care 1989;27(3):297‐305. - PubMed
-
- McDowell I, Newell C, Rosser W. Computerized reminders to encourage cervical screening in family practice. Journal of Family Practice 1989;28(4):420‐4. - PubMed
Rossi 1997 {published data only}
Thomas 1983 {published data only}
-
- Thomas JC, Moore A, Qualls PE. The effect on cost of medical care for patients treated with an automated clinical audit system. Journal of Medical Systems 1983;7(3):307‐13. - PubMed
Tierney 1986 {published data only}
-
- Tierney WM, Hui SL, McDonald CJ. Delayed feedback of physician performance versus immediate reminders to perform preventive care. Effects on physician compliance. Medical Care 1986;24(8):659‐66. - PubMed
Turner 1989 {published data only}
-
- Turner BJ. A controlled trial of strategies to improve delivery of preventive care. Research in medical education:proceedings of the annual Conference. Conference on Research in Medical Education 1987;26:9‐13. - PubMed
-
- Turner BJ, Day SC, Borenstein B. A controlled trial to improve delivery of preventive care: physician or patient reminders?. Journal of General Internal Medicine 1989;4(5):403‐9. - PubMed
Were 2013 {published data only}
White 1984 {published data only}
-
- White KS, Lindsay A, Pryor TA, Brown WF, Walsh K. Application of a computerized medical decision‐making process to the problem of digoxin intoxication. Journal of the American College of Cardiology 1984;4(3):571‐6. - PubMed
Ziemer 2006 {published and unpublished data}
-
- Phillips LS, Hertzberg VS, Cook CB, El‐Kebbi IM, Gallina DL, Ziemer DC, et al. The Improving Primary Care of African Americans with Diabetes (IPCAAD) project: rationale and design. Controlled Clinical Trials 2002;23(5):554‐69. - PubMed
-
- Phillips LS, Ziemer DC, Doyle JP, Barnes CS, Kolm P, Branch WT, et al. An endocrinologist‐supported intervention aimed at providers improves diabetes management in a primary care site: improving primary care of African Americans with diabetes (IPCAAD). Diabetes Care 2005;28(10):2352‐60. - PubMed
-
- Ziemer DC, Doyle JP, Barnes CS, Branch WT Jr, Cook CB, El‐Kebbi IM, et al. An intervention to overcome clinical inertia and improve diabetes mellitus control in a primary care setting: Improving Primary Care of African Americans with Diabetes (IPCAAD). Archives of Internal Medicine 2006;166(5):507‐13. - PubMed
References to studies excluded from this review
Adelman 2013 {published data only}
Alfadda 2011 {published data only}
-
- Alfadda AA, Bin‐Abdulrahman KA, Saad HA, Mendoza CDO, Angkaya‐Bagayawa FF, Yale JF. Effect of an intervention to improve the management of patients with diabetes in primary care practice. Saudi Medical Journal 2011;32(1):36‐40. - PubMed
Anabtawi 2013 {published data only}
Anchala 2012 {published data only}
Barkun 2013 {published data only}
Barnes 2014 {published data only}
Beeckman 2013 {published data only}
-
- Beeckman D, Clays E, Hecke A, Vanderwee K, Schoonhoven L, Verhaeghe S. A multi‐faceted tailored strategy to implement an electronic clinical decision support system for pressure ulcer prevention in nursing homes: a two‐armed randomized controlled trial. Internation Journal of Nursing Studies 2013;50(4):475‐86. - PubMed
Beeler 2014 {published data only}
Belland 2014 {published data only}
-
- Belland L, Rivera‐Reyes L, Genes N, Thum F, Winkel G, Soriano J, et al. The effect of a novel clinical decision support system on pain care for older adults presenting to the emergency department with acute abdominal pain. Annals of Emergency Medicine. 2014; Vol. 64, issue 4:S81.
Beste 2015 {published data only}
-
- Beste LA, Ioannou GN, Yang Y, Chang MF, Ross D, Dominitz JA. Improved surveillance for hepatocellular carcinoma with a primary care‐oriented clinical reminder. Clinical Gastroenterology and Hepatology : the official clinical practice journal of the American Gastroenterological Association 2015;13(1):172‐9. [PUBMED: 24813175] - PubMed
Braun 2013 {published data only}
-
- Braun R, Barandas A, Hancock‐Crear A. Improving access and addressing barriers to HPV vaccination for adolescents and young adults. Contraception. 2013; Vol. 88, issue 2:307.
Campbell 2014 {published data only}
-
- Campbell F, Peleshok J, Yamada J, Krancevic A‐M, Pepper J, Dhaliwal M, et al. Impact of a quality improvement strategy for improving pain outcomes in a pediatric hospital setting. Pain Research and Management. 2014; Vol. 19, issue 3:e31.
Carroll 2013 {published data only}
Chen 2013 {published data only}
-
- Chen YY, Chi MM, Chen YC, Chan YJ, Chou SS, Wang FD. Using a criteria‐based reminder to reduce use of indwelling urinary catheters and decrease urinary tract infections. American Journal of Critical Care 2013; Vol. 22, issue 2:105‐14. - PubMed
Dexheimer 2013 {published data only}
Divinskiy 2015 {published data only}
-
- Divinskiy T, Nemytova E, Liu X, Ajmal S. A quality improvement project increased documentation of advance directives among an older population in a primary care setting. Annual Scientific Meeting of the American Geriatrics Society. 2015:63.
dos Santos 2014 {published data only}
-
- dos Santos MA, Tygesen H, Eriksson H, Herlitz J. Clinical decision support system (CDSS)‐‐effects on care quality. International Journal of Health Care Quality Assurance 2014;27(8):707‐18. - PubMed
Erlingsdottir 2015 {published data only}
-
- Erlingsdottir H, Johannesson A, Asgeirsdottir TL. Can physician laboratory‐test requests be influenced by interventions?. Scandinavian Journal of Clinical and Laboratory Investigation 2015;75(1):18‐26. - PubMed
Federman 2014 {published data only}
-
- Federman DG, Kravetz JD, Lerz KA, Akgun KM, Ruser C, Cain H, et al. Implementation of an electronic clinical reminder to improve rates of lung cancer screening. American Journal of Medicine 2014;127(9):813‐6. - PubMed
Gifford 2013 {published data only}
-
- Gifford WA, Davies BL, Graham ID, Tourangeau A, Woodend AK, Lefebre N. Developing leadership capacity for guideline use: a pilot cluster randomized control trial. Worldviews on Evidence‐Based Nursing 2013;10(1):51‐65. - PubMed
Goldstein 2014 {published data only}
-
- Goldstein NE, Kalman J, Kutner JS, Fromme EK, Hutchinson MD, Lipman HI, et al. A study to improve communication between clinicians and patients with advanced heart failure: Methods and challenges behind the working to improve discussions about defibrillator management trial. Journal of Pain and Symptom Management 2014;48(6):1236‐46. - PMC - PubMed
Green 2014 {published data only}
Gupta 2014 {published data only}
-
- Gupta A, Gholami P, Turakhia MP, Friday K, Heidenreich PA. Clinical reminders to providers of patients with reduced left ventricular ejection fraction increase defibrillator referral: a randomized trial. Circulation Heart Failure 2014;7(1):140‐5. - PubMed
Hendrix 2015 {published data only}
Hye 2014 {published data only}
-
- Hye RJ, Smith AE, Wong GH, Vansomphone SS, Scott RD, Kanter MH. Leveraging the electronic medical record to implement an abdominal aortic aneurysm screening program. Journal of Vascular Surgery 2014;59(6):1535‐42. - PubMed
Jansink 2013 {published data only}
Kennedy 2012 {published data only}
-
- Kennedy CC, Ioannidis G, Giangregorio LM, Adachi JD, Thabane L, Morin SN, et al. An interdisciplinary knowledge translation intervention in long‐term care: study protocol for the vitamin D and osteoporosis study (Original Title; URL links to DARE Abstract) pilot cluster randomized controlled trial. Implementation Science 2012;7:48. - PMC - PubMed
Kousgaard 2013 {published data only}
Lai 2015 {published data only}
-
- Lai CL, Chan HY, Pan YJ, Chen CH. The effectiveness of a computer reminder system for laboratory monitoring of metabolic syndrome in schizophrenic outpatients using second‐generation antipsychotics. Pharmacopsychiatry 2015;48(1):25‐9. - PubMed
Levy 2013 {published data only}
-
- Levy BT, Xu Y, Daly JM, Ely JW. A randomized controlled trial to improve colon cancer screening in rural family medicine: an Iowa Research Network (IRENE) study. Journal of the American Board of Family Medicine 2013;26(5):486‐97. - PubMed
Lusignan 2013 {published data only}
Lynn 2013 {published data only}
-
- Lynn LA, Guerra CE, Ross KM, Holmboe E, Woo K, Heitjan DF, et al. A randomized controlled trial of an evidence‐based toolbox and guide to increase primary care clinicians' rates of colorectal cancer screening in diplomates of the ABIM. Journal of General Internal Medicine. 2013; Vol. 28, issue Suppl 1.
Majumdar 2012 {published data only}
-
- Majumdar SR, McAlister FA, Johnson JA, Bellerose D, Siminoski K, Hanley DA, et al. Interventions to increase osteoporosis treatment in patients with 'incidentally' detected vertebral fractures. American Journal of Medicine 2012;125(9):929‐36. - PubMed
Maximov 2013 {published data only}
-
- Maximov D, Lesnyak O. Implementation of the osteoarthritis clinical guideline: Results of a cluster randomized trial in primary care. Annals of the Rheumatic Diseases. 2013; Vol. 71:307‐8.
McEvoy 2014 {published data only}
McNulty 2014 {published data only}
-
- McNulty CA, Hogan AH, Ricketts EJ, Wallace L, Oliver I, Campbell R, et al. Increasing chlamydia screening tests in general practice: a modified Zelen prospective Cluster Randomised Controlled Trial evaluating a complex intervention based on the Theory of Planned Behaviour. Sexually Transmitted Infections 2014;90(3):188‐94. [PUBMED: 24005256] - PMC - PubMed
Melo 2013 {published data only}
-
- Melo Rodrigues R, Fontes AMS, Cesar Mantese O, Souza Martins R, Tanus Jorge M. Impact of an intervention in the use of sequential antibiotic therapy in a Brazilian university hospital. Revista da Sociedade Brasileira de Medicina Tropical 2013;46(1):50‐4. - PubMed
Neal 2012 {published data only}
-
- Neal JM, Hsiung RL, Mulroy MF, Halpern BB, Dragnich AD, Slee AE. ASRA checklist improves trainee performance during a simulated episode of local anesthetic systemic toxicity. Regional Anesthesia and Pain Medicine 2012;37(1):8‐15. - PubMed
Nguyen 2014 {published data only}
-
- Nguyen MC, Richardson DM, Hardy SG, Cookson RM, Mackenzie RS, Greenberg MR, et al. Computer‐based reminder system effectively impacts physician documentation. American Journal of Emergency Medicine 2014;32(1):104‐6. - PubMed
O'Reilly 2012 {published data only}
Persell 2016 {published data only}
Piazza 2013 {published data only}
-
- Piazza G, Anderson FA, Ortel TL, Cox MJ, Rosenberg DJ, Rahimian S, et al. Randomized trial of physician alerts for thromboprophylaxis after discharge. American Journal of Medicine 2013;126(5):435‐42. - PubMed
Roy 2016 {published data only}
Schwalm 2015 {published data only}
-
- Schwalm JD, Ivers NM, Natarajan MK, Taljaard M, Rao‐Melacini P, Witteman HO, et al. Cluster randomized controlled trial of Delayed Educational Reminders for Long‐term Medication Adherence in ST‐Elevation Myocardial Infarction (DERLA‐STEMI). American Heart Journal 2015;170(5):903‐13. [PUBMED: 26542498] - PubMed
Siersma 2015 {published data only}
-
- Siersma V, Kousgaard MB, Reventlow S, Ertmann R, Felding P, Waldorff FB. The effectiveness of computer reminders versus postal reminders for improving quality assessment for point‐of‐care testing in primary care: a randomized controlled trial. Journal of Evaluation in Clinical Practice 2015;21(1):13‐20. - PubMed
Stockwell 2015 {published data only}
-
- Stockwell MS, Catallozzi M, Camargo S, Ramakrishnan R, Holleran S, Findley SE, et al. Registry‐linked electronic influenza vaccine provider reminders: a cluster‐crossover trial. Pediatrics 2015;135(1):e75‐82. - PubMed
Szilagyi 2015 {published data only}
Tartaglia 2013 {published data only}
-
- Tartaglia KM, Walker C, Heacock A, Kuofie I, Liston B, West J, et al. Antibiotic timeout program: Implementing a hospital stewardship intervention. Journal of General Internal Medicine 2013;28:S429‐30.
Tedja 2014 {published data only}
-
- Tedja R, Hassebroek E, Carrera P, Thakur L, Mielke C, Volkman T, et al. Reducing urinary catheter days and utilization in a chronic ventilator dependent unit: Mayo clinic quality improvement experience. Chest 2014;146:556A.
Teoh 2012 {published data only}
-
- Teoh L, Latif M, Choi P, Wu S, Chan CY, Plowman G, et al. Use of a reminder sticker improves rates of documentation of resuscitation status and the appropriate prescription of venous thromboembolism prophylaxis. New Zealand Medical Journal 2012;125(1357):175‐7. - PubMed
Weiss 2013 {published data only}
Were 2011 {published data only}
-
- Were MC, Shen C, Tierney WM, Mamlin JJ, Biondich PG, Li X, et al. Evaluation of computer‐generated reminders to improve CD4 laboratory monitoring in sub‐Saharan Africa: a prospective comparative study. Journal of the American Medical Informatics Association : JAMIA 2011;18(2):150‐5. [PUBMED: 21252053] - PMC - PubMed
Additional references
Anderson 2007
-
- Anderson JG. Social, ethical and legal barriers to e‐health. International Journal of Medical Informatics 2007;76(5‐6):480‐3. [PUBMED: 17064955] - PubMed
Axt‐Adam 1993
-
- Axt‐Adam P, Wouden JC, Does E. Influencing behavior of physicians ordering laboratory tests: a literature study. Medical Care 1993;31:784‐94. - PubMed
Baker, 2015
Balas 2000
-
- Balas EA, Weingarten S, Garb CT, Blumenthal D, Boren SA, Brown GD. Improving preventive care by prompting physicians. Archives of Internal Medicine 2000;160(3):301‐8. [PUBMED: 10668831] - PubMed
Balas 2004
-
- Balas EA, Krishna S, Kretschmer RA, Cheek TR, Lobach DF, Boren SA. Computerized knowledge management in diabetes care. Medical Care 2004;42(6):610‐21. [PUBMED: 15167329] - PubMed
Baron 2010
-
- Baron RC, Melillo S, Rimer BK, Coates RJ, Kerner J, Habarta N, et al. Intervention to increase recommendation and delivery of screening for breast, cervical, and colorectal cancers by healthcare providers a systematic review of provider reminders. American Journal of Preventive Medicine 2010;38(1):110‐7. [PUBMED: 20117566] - PubMed
Bennett 2003
-
- Bennett JW, Glasziou PP. Computerised reminders and feedback in medication management: a systematic review of randomised controlled trials. Medical Journal of Australia 2003;178(5):217‐22. [PUBMED: 12603185] - PubMed
Biau 2008
-
- Biau DJ, Porcher R, Boutron I. The account for provider and center effects in multicenter interventional and surgical randomized controlled trials is in need of improvement: a review. Journal of Clinical Epidemiology 2008;61(5):435‐9. [PUBMED: 18394535] - PubMed
Buntinx 1993
-
- Buntinx F, Winkens R, Grol R, Knottnerus JA. Influencing diagnostic and preventive performance in ambulatory care by feedback and reminders. A review. Family Practice 1993;10(2):219‐28. - PubMed
Campbell 2007
-
- Campbell MJ, Donner A, Klar N. Developments in cluster randomized trials and Statistics in Medicine. Statistics in Medicine 2007;26(1):2‐19. [PUBMED: 17136746] - PubMed
Craig 2008
Davis 1992
-
- Davis DA, Thomson MA, Oxman AD, Haynes RB. Evidence for the effectiveness of CME. A review of 50 randomized controlled trials. JAMA 1992;268(9):1111‐7. - PubMed
Davis 1995
-
- Davis DA, Thomson MA, Oxman AD, Haynes RB. Changing physician performance. A systematic review of the effect of continuing medical education strategies. JAMA 1995;274(9):700‐5. - PubMed
Dexheimer 2008
EPOC 2015a
-
- Effective Practice, Organisation of Care (EPOC). Suggested risk of bias criteria for EPOC reviews. epoc.cochrane.org/epoc‐specific‐resources‐review‐authors. Oslo: Norwegian Knowledge Centre for the Health Services, (accessed 1 July 2016).
EPOC 2015b
-
- Effective Practice, Organisation of Care (EPOC). What study designs should be included in an EPOC review and what should they be called?. epoc.cochrane.org/epoc‐specific‐resources‐review‐authors. Oslo: Norwegian Knowledge Centre for the Health Services, (accessed 1 July 2016).
EPOC 2015c
-
- Effective Practice, Organisation of Care (EPOC). Worksheets for preparing Summary of Findings tables using GRADE. epoc.cochrane.org/epoc‐specific‐resources‐review‐authors. Oslo: Norwegian Knowledge Centre for the Health Services, (accessed 1 July 2016).
EPOC 2015d
-
- Effective Practice, Organisation of Care (EPOC). What outcomes should be reported in EPOC reviews?. epoc.cochrane.org/epoc‐specific‐resources‐review‐authors. Oslo: Norwegian Knowledge Centre for the Health Services, (accessed 1 July 2016).
Fiander 2015
-
- Fiander M, McGowan J, Grad R, Pluye P, Hannes K, Labrecque M, et al. Interventions to increase the use of electronic health information by healthcare practitioners to improve clinical practice and patient outcomes. Cochrane Database of Systematic Reviews 2015, Issue 3. [DOI: 10.1002/14651858.CD004749.pub3] - DOI - PMC - PubMed
Flodgren 2011
Forsetlund 2009
Gagnon 2009
Garg 2005
-
- Garg AX, Adhikari NK, McDonald H, Rosas‐Arellano MP, Devereaux PJ, Beyene J, et al. Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. JAMA 2005;293(10):1223‐38. [PUBMED: 15755945] - PubMed
Giguère 2012
GRADEpro GDT 2015 [Computer program]
-
- GRADE Working Group, McMaster University. GRADEpro GDT. Version accessed 10 August 2015. Hamilton (ON): GRADE Working Group, McMaster University, 2014.
Grimshaw 2004
-
- Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, et al. Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technology Assessment (Winchester, England) 2004;8(6):iii‐iv, 1‐72. [PUBMED: 14960256] - PubMed
Guyatt 2011
-
- Guyatt GH, Oxman AD, Schunemann HJ, Tugwell P, Knottnerus A. GRADE guidelines: a new series of articles in the Journal of Clinical Epidemiology. Journal of Clinical Epidemiology 2011;64(4):380‐2. [PUBMED: 21185693] - PubMed
Haynes 1987
-
- Haynes RB, Walker CJ. Computer‐aided quality assurance. A critical appraisal. Archives of Internal Medicine 1987;147(7):1297‐301. - PubMed
Higgins 2011
-
- Higgins, JPT, Green, S. Cochrane Handbook for Systematic Reviews of Interventions Version. Version 5.1.0. Cochrane Handbook for Systematic Reviews of Interventions. Chichester: John Wiley & Sons, 2011.
Hoffmann 2014
-
- Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ (Clinical Research ed.) 2014;348:g1687. [PUBMED: 24609605] - PubMed
Hunt 1998
-
- Hunt DL, Haynes RB, Hanna SE, Smith K. Effects of computer‐based clinical decision support systems on physician performance and patient outcomes: a systematic review. JAMA 1998;280(15):1339‐46. [PUBMED: 9794315] - PubMed
Ivers 2012
Jha 2009
-
- Jha AK, DesRoches CM, Campbell EG, Donelan K, Rao SR, Ferris TG, et al. Use of electronic health records in U.S. hospitals. The New England Journal of Medicine 2009;360(16):1628‐38. [PUBMED: 19321858] - PubMed
Johnston 1994
-
- Johnston ME, Langton KB, Haynes RB, Mathieu A. Effects of computer‐based clinical decision support systems on clinician performance and patient outcome. Annals of Internal Medicine 1994;120(2):135‐42. - PubMed
Kahan 2013
Kawamoto 2005
Keogh‐Brown 2007
-
- Keogh‐Brown MR, Bachmann MO, Shepstone L, Hewitt C, Howe A, Ramsay CR, et al. Contamination in trials of educational interventions. Health Technology Assessment (Winchester, England) 2007;11(43):iii, ix‐107. [PUBMED: 17935683] - PubMed
Litzelman 1993
-
- Litzelman DK, Dittus RS, Miller ME, Tierney WM. Requiring physicians to respond to computerized reminders improves their compliance with preventive care protocols. Journal of General Internal Medicine 1993;8(6):311‐7. - PubMed
Mahmud 2010
-
- Mahmud N, Rodriguez J, Nesbit J. A text message‐based intervention to bridge the healthcare communication gap in the rural developing world. Technology and Health Care : official journal of the European Society for Engineering and Medicine 2010;18(2):137‐44. [PUBMED: 20495253] - PubMed
Mandelblatt 1995
-
- Mandelblatt J, Kanetsky PA. Effectiveness of interventions to enhance physician screening for breast cancer. Journal of Family Practice 1995;40(2):162‐71. - PubMed
McDonald 1976
-
- McDonald CJ. Protocol‐based computer reminders, the quality of care and the non‐perfectability of man. New England Journal of Medicine 1976;295(24):1351‐5. - PubMed
Moher 2010
Mohler 2015
Mollon 2009
Morris 2002
Ndiaye 2005
-
- Ndiaye SM, Hopkins DP, Shefer AM, Hinman AR, Briss PA, Rodewald L, et al. Interventions to improve influenza, pneumococcal polysaccharide, and hepatitis B vaccination coverage among high‐risk adults: a systematic review. American Journal of Preventive Medicine 2005;28(5 Suppl):248‐79. [PUBMED: 15894160] - PubMed
O'Brien 2007
-
- O'Brien MA, Rogers S, Jamtvedt G, Oxman AD, Odgaard‐Jensen J, Kristoffersen DT, et al. Educational outreach visits: effects on professional practice and health care outcomes. Cochrane Database of Systematic Reviews 2007, Issue 4. [DOI: 10.1002/14651858.CD000409.pub2; PUBMED: 17943742] - DOI - PMC - PubMed
Ogrinc 2016
Oxman 1995
Pantoja 2014
-
- Pantoja T, Green ME, Grimshaw J, Denig P, Durieux P, Gill P, et al. Manual paper reminders: effects on professional practice and health care outcomes. Cochrane Database of Systematic Reviews 2014, Issue 9. [DOI: 10.1002/14651858.CD001174.pub2; CD001174] - DOI
Pearson 2009
Schedlbauer 2009
Shea 1996
Shiffman 1999
Shojania 2009
Siddiqi 2005
-
- Siddiqi K, Newell J, Robinson M. Getting evidence into practice: what works in developing countries?. International Journal for Quality in Health Care : journal of the International Society for Quality in Health Care ISQua 2005;17(5):447‐54. [PUBMED: 15872024] - PubMed
Stata 2007 [Computer program]
-
- StataCorp. Stata Statistical Software: Release 10. College Station, TX: StataCorp LP, 2007.
Thomas 1999
Tierney 2007
-
- Tierney WM, Rotich JK, Hannan TJ, Siika AM, Biondich PG, Mamlin BW, et al. The AMPATH medical record system: creating, implementing, and sustaining an electronic medical record system to support HIV/AIDS care in western Kenya. Studies in Health Technology and Informatics 2007;129(Pt 1):372‐6. [PUBMED: 17911742] - PubMed
Ukoumunne 1999
Wensing 1994
-
- Wensing M, Grol R. Single and combined strategies for implementing changes in primary care: a literature review. International Journal for Quality in Health Care 1994;6(2):115‐32. - PubMed
References to other published versions of this review
Arditi 2010
Arditi 2012
-
- Arditi C, Rège‐Walther M, Wyatt JC, Durieux P, Burnand B. Computer‐generated reminders delivered on paper to healthcare professionals; effects on professional practice and health care outcomes. Cochrane Database of Systematic Reviews 2012, Issue 12. [DOI: 10.1002/14651858.CD001175.pub3] - DOI - PubMed
Gorman 1998
-
- Gorman P, Redfern C, Liaw T, Carson S, Wyatt JC, Rowe RE, et al. Computer‐generated paper reminders: effects on professional practice and health care outcomes. Cochrane Database of Systematic Reviews 1998, Issue 3. [DOI: 10.1002/14651858.CD001175] - DOI
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources