Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Meta-Analysis
. 2009 Jul 8;2009(3):CD001096.
doi: 10.1002/14651858.CD001096.pub2.

The effects of on-screen, point of care computer reminders on processes and outcomes of care

Kaveh G Shojania  1 , Alison Jennings, Alain Mayhew, Craig R Ramsay, Martin P Eccles, Jeremy Grimshaw
Affiliations
Meta-Analysis

The effects of on-screen, point of care computer reminders on processes and outcomes of care

Kaveh G Shojania et al. Cochrane Database Syst Rev. .

Abstract

Background: The opportunity to improve care by delivering decision support to clinicians at the point of care represents one of the main incentives for implementing sophisticated clinical information systems. Previous reviews of computer reminder and decision support systems have reported mixed effects, possibly because they did not distinguish point of care computer reminders from e-mail alerts, computer-generated paper reminders, and other modes of delivering 'computer reminders'.

Objectives: To evaluate the effects on processes and outcomes of care attributable to on-screen computer reminders delivered to clinicians at the point of care.

Search strategy: We searched the Cochrane EPOC Group Trials register, MEDLINE, EMBASE and CINAHL and CENTRAL to July 2008, and scanned bibliographies from key articles.

Selection criteria: Studies of a reminder delivered via a computer system routinely used by clinicians, with a randomised or quasi-randomised design and reporting at least one outcome involving a clinical endpoint or adherence to a recommended process of care.

Data collection and analysis: Two authors independently screened studies for eligibility and abstracted data. For each study, we calculated the median improvement in adherence to target processes of care and also identified the outcome with the largest such improvement. We then calculated the median absolute improvement in process adherence across all studies using both the median outcome from each study and the best outcome.

Main results: Twenty-eight studies (reporting a total of thirty-two comparisons) were included. Computer reminders achieved a median improvement in process adherence of 4.2% (interquartile range (IQR): 0.8% to 18.8%) across all reported process outcomes, 3.3% (IQR: 0.5% to 10.6%) for medication ordering, 3.8% (IQR: 0.5% to 6.6%) for vaccinations, and 3.8% (IQR: 0.4% to 16.3%) for test ordering. In a sensitivity analysis using the best outcome from each study, the median improvement was 5.6% (IQR: 2.0% to 19.2%) across all process measures and 6.2% (IQR: 3.0% to 28.0%) across measures of medication ordering. In the eight comparisons that reported dichotomous clinical endpoints, intervention patients experienced a median absolute improvement of 2.5% (IQR: 1.3% to 4.2%). Blood pressure was the most commonly reported clinical endpoint, with intervention patients experiencing a median reduction in their systolic blood pressure of 1.0 mmHg (IQR: 2.3 mmHg reduction to 2.0 mmHg increase).

Authors' conclusions: Point of care computer reminders generally achieve small to modest improvements in provider behaviour. A minority of interventions showed larger effects, but no specific reminder or contextual features were significantly associated with effect magnitude. Further research must identify design features and contextual factors consistently associated with larger improvements in provider behaviour if computer reminders are to succeed on more than a trial and error basis.

PubMed Disclaimer

Conflict of interest statement

ME and JG are authors on one included study and three excluded studies in this review. Four authors (AM, ME, CRR, JG) are editors or staff within the Cochrane EPOC Review Group. Editors and staff are required to conduct at least one Cochrane review. This requirement ensures that editors are aware of the processes and commitment needed to conduct reviews. This involvement does not seem to be a source of conflict of interest in the Cochrane EPOC Review Group. Any editor or staff who is a review author is excluded from editorial decisions on the review in which they are contributors.

Figures

1
1
Median effects for process adherence by study feature
2
2
Median effects for process adherence by reminder feature
1.1
1.1. Analysis
Comparison 1: CDSS (+/‐ co‐intervention) vs. Usual care (+/‐ co‐intervention), Outcome 1: All
1.2
1.2. Analysis
Comparison 1: CDSS (+/‐ co‐intervention) vs. Usual care (+/‐ co‐intervention), Outcome 2: Prescription
1.3
1.3. Analysis
Comparison 1: CDSS (+/‐ co‐intervention) vs. Usual care (+/‐ co‐intervention), Outcome 3: Vaccination
1.4
1.4. Analysis
Comparison 1: CDSS (+/‐ co‐intervention) vs. Usual care (+/‐ co‐intervention), Outcome 4: Testing
1.5
1.5. Analysis
Comparison 1: CDSS (+/‐ co‐intervention) vs. Usual care (+/‐ co‐intervention), Outcome 5: Documentation
1.7
1.7. Analysis
Comparison 1: CDSS (+/‐ co‐intervention) vs. Usual care (+/‐ co‐intervention), Outcome 7: Other
See this image and copyright information in PMC

Comment in

References

References to studies included in this review

Abdel‐Kader 2011 {published data only}
    1. Abdel-Kader K, Fischer G S, Li J, Moore C G, Hess R, Unruh M L. Automated clinical reminders for primary care providers in the care of CKD: a small cluster-randomized controlled trial. Am J Kidney Dis 2011;58:894-902. - PMC - PubMed
    1. Arts D L, Abu-Hanna A, Medlock S K, Weert H C. Effectiveness and usage of a decision support system to improve stroke prevention in general practice: A cluster randomized controlled trial. PLoS One 2017;12(2):e0170974. - PMC - PubMed
Ansari 2003 {published data only}
    1. Ansari M, Shlipak M G, Heidenreich P A, Van Ostaeyen D, Pohl E C, Browner W S, et al. Improving guideline adherence: a randomized trial evaluating strategies to increase beta-blocker use in heart failure. Circulation 2003;107:2799-804. - PubMed
Arts 2017 {published data only}
    1. Arts D L, Abu-Hanna A, Medlock S K, Weert H C. Effectiveness and usage of a decision support system to improve stroke prevention in general practice: A cluster randomized controlled trial. PLoS One 2017;12(2):e0170974. - PMC - PubMed
Awdishu 2016 {published data only}
    1. Awdishu L, Coates C R, Lyddane A, Tran K, Daniels C E, Lee J, El-Kareh R. The impact of real-time alerting on appropriate prescribing in kidney disease: a cluster randomized controlled trial. J Am Med Inform Assoc 2016;23(3):609-16. - PMC - PubMed
Baandrup 2010 {published data only}
    1. Baandrup L, Allerup P, Lublin H, Nordentoft M, Peacock L, Glenthoj B. Evaluation of a multifaceted intervention to limit excessive antipsychotic co-prescribing in schizophrenia out-patients. Acta Psychiatr Scand 2010;122:367-74. - PubMed
Baer 2013 {published data only}
    1. Baer H J, Schneider L I, Colditz G A, Dart H, Andry A, Williams D H, et al. Use of a web-based risk appraisal tool for assessing family history and lifestyle factors in primary care. J Gen Intern Med 2013;28:817-24. - PMC - PubMed
Bates 1999 {published data only}
    1. Bates D W, Kuperman G J, Rittenberg E, Teich J M, Fiskio J, Ma'luf N, et al. A randomized trial of a computer-based intervention to reduce utilization of redundant laboratory tests. Am J Med 1999;106:144-50. - PubMed
Beeler 2014 {published data only}
    1. Beeler P E, Eschmann E, Schumacher A, Studt J D, Amann-Vesti B, Blaser J. Impact of electronic reminders on venous thromboprophylaxis after admissions and transfers. J Am Med Inform Assoc 2014;21:e297-303. - PMC - PubMed
Bell 2010 {published data only}
    1. Bell L M, Grundmeier R, Localio R, Zorc J, Fiks A G, Zhang X, et al. Electronic health record-based decision support to improve asthma care: a cluster-randomized trial. Pediatrics 2010;125:e770-7. - PubMed
Bernstein 2017 {published data only}
    1. Bernstein S L, Rosner J, DeWitt M, Tetrault J, Hsiao A L, Dziura J, Sussman S, O'Connor P, Toll B. Design and implementation of decision support for tobacco dependence treatment in an inpatient electronic medical record: a randomized trial. Transl Behav Med 2017;7(2):185-195. - PMC - PubMed
Beste 2015 {published data only}
    1. Beste L A, Ioannou G N, Yang Y, Chang M F, Ross D, Dominitz J A. Improved surveillance for hepatocellular carcinoma with a primary care-oriented clinical reminder. Clin Gastroenterol Hepatol 2015;13:172-9. - PubMed
Boustani 2012 {published data only}
    1. Boustani Malaz A, Campbell Noll L, Khan Babar A, Abernathy Greg, Zawahiri Mohammed, Campbell Tiffany, et al. Enhancing care for hospitalized older adults with cognitive impairment: a randomized controlled trial. Journal of General Internal Medicine 2012;27:561-7. - PMC - PubMed
Chak 2018 {published data only}
    1. Chak E, Taefi A, Li C S, Chen M S Jr, Harris A M, MacDonald S, Bowlus C. Electronic Medical Alerts Increase Screening for Chronic Hepatitis B: A Randomized, Double-Blind, Controlled Trial. Cancer Epidemiol Biomarkers Prev 2018;27(11):1352-1357. - PMC - PubMed
Co 2010 {published data only}
    1. Co J P, Johnson S A, Poon E G, Fiskio J, Rao S R, Van Cleave J, et al. Electronic health record decision support and quality of care for children with ADHD. Pediatrics 2010;126:239-46. - PubMed
Cote 2008a {published data only}
    1. Cote Gregory A, Rice John P, Bulsiewicz William, Norvell John P, Christensen Keri, Bobb Anne, et al. Use of physician education and computer alert to improve targeted use of gastroprotection among NSAID users. American Journal of Gastroenterology 2008;103:1097-103. - PubMed
Cote 2008b {published data only}
    1. Cote G A, Rice J P, Bulsiewicz W, Norvell J P, Christensen K, Bobb A, Postelnick M, Howden C W. Use of physician education and computer alert to improve targeted use of gastroprotection among NSAID users. Am J Gastroenterol 2008;103(5):1097-103. - PubMed
Davis 2007 {published data only}
    1. Davis Robert L, Wright Jeffrey, Chalmers Francie, Levenson Linda, Brown Julie C, Lozano Paula, et al. A cluster randomized clinical trial to improve prescribing patterns in ambulatory pediatrics. PLoS Clinical Trials 2007;2:e25. - PMC - PubMed
Dean 2015 {published data only}
    1. Dean N C, Jones B E, Jones J P, Ferraro J P, Post H B, Aronsky D, Vines C G, Allen T L, Haug P J. Impact of an Electronic Clinical Decision Support Tool for Emergency Department Patients With Pneumonia. Ann Emerg Med 2015;66(5):511-20. - PubMed
Dexter 2001 {published data only}
    1. Dexter P R, Perkins S, Overhage J M, Maharry K, Kohler R B, McDonald C J. A computerized reminder system to increase the use of preventive care for hospitalized patients. N Engl J Med 2001;345:965-70. - PubMed
Diaz 2018 {published data only}
    1. Diaz M C G, Werk L N, Crutchfield J H Jr, Handy L K, Franciosi J P, Dent J, Villanueva R, Antico E, Taylor A, Wysocki T. A Provider-Focused Intervention to Promote Optimal Care of Pediatric Patients With Suspected Elbow Fracture. Pediatr Emerg Care 2018. - PubMed
Diaz 2019 {published data only}
    1. Diaz M C G, Wysocki T, Crutchfield J H Jr, Franciosi J P, Werk L N. Provider-Focused Intervention to Promote Comprehensive Screening for Adolescent Idiopathic Scoliosis by Primary Care Pediatricians. Am J Med Qual 2019:182-188. - PubMed
Downs 2006 {published data only}
    1. Downs Murna, Turner Stephen, Bryans Michelle, Wilcock Jane, Keady John, Levin Enid, et al. Effectiveness of educational interventions in improving detection and management of dementia in primary care: cluster randomised controlled study. BMJ 2006;332:692-6. - PMC - PubMed
Dregan 2014 {published data only}
    1. Dregan A, Staa T P, McDermott L, McCann G, Ashworth M, Charlton J, et al. Point-of-care cluster randomized trial in stroke secondary prevention using electronic health records. Stroke 2014;45:2066-71. - PubMed
Eccles 2002a {published data only}
    1. Eccles MP, McColl E, Steen N, Rousseau N, Grimshaw J, Parkin D, et al. Effect of computerized evidence based guidelines on management of asthma and angina in adults in primary care: cluster randomized controlled trial. BMJ 2002;325:941. - PMC - PubMed
Eccles 2002b {published data only}
    1. Eccles M, McColl E, Steen N, Rousseau N, Grimshaw J, Parkin D, et al. Effect of computerised evidence based guidelines on management of asthma and angina in adults in primary care: cluster randomised controlled trial. BMJ 2002;325:941. - PMC - PubMed
Feder 2011 {published data only}
    1. Feder Gene, Davies Roxane Agnew, Baird Kathleen, Dunne Danielle, Eldridge Sandra, Griffiths Chris, et al. Identification and Referral to Improve Safety (IRIS) of women experiencing domestic violence with a primary care training and support programme: a cluster randomised controlled trial. Lancet 2011;378:1788-95. - PubMed
Field 2009 {published data only}
    1. Field T S, Rochon P, Lee M, Gavendo L, Baril J L, Gurwitz J H. Computerized clinical decision support during medication ordering for long-term care residents with renal insufficiency. J Am Med Inform Assoc 2009;16:480-5. - PMC - PubMed
Fiks 2009 {published data only}
    1. Fiks A G, Hunter K F, Localio A R, Grundmeier R W, Bryant-Stephens T, Luberti A A, et al. Impact of electronic health record-based alerts on influenza vaccination for children with asthma. Pediatrics 2009;124:159-69. - PubMed
Fiks 2013 {published data only}
    1. Fiks Alexander G, Grundmeier Robert W, Mayne Stephanie, Song Lihai, Feemster Kristen, Karavite Dean, et al. Effectiveness of Decision Support for Families, Clinicians, or Both on HPV Vaccine Receipt. Pediatrics 2013;131:1114-24. - PMC - PubMed
Filippi 2003 {published data only}
    1. Filippi A, Sabatini A, Badioli L, Samani F, Mazzaglia G, Catapano A, et al. Effects of an automated electronic reminder in changing the antiplatelet drug-prescribing behavior among Italian general practitioners in diabetic patients: an intervention trial. Diabetes Care 2003;26:1497-500. - PubMed
Flottorp 2002a {published data only}
    1. Flottorp Signe, Oxman Andrew D, Havelsrud Kari, Treweek Shaun, Herrin Jeph. Cluster randomised controlled trial of tailored interventions to improve the management of urinary tract infections in women and sore throat. BMJ 2002;325:367. - PMC - PubMed
Flottorp 2002b  {published data only}
    1. Flottorp S, Oxman A D, Havelsrud K, Treweek S, Herrin J. Cluster randomised controlled trial of tailored interventions to improve the management of urinary tract infections in women and sore throat. BMJ 2002;325(7360):367. - PMC - PubMed
Frank 2004 {published data only}
    1. Frank O, Litt J, Beilby J. Opportunistic electronic reminders. Improving performance of preventive care in general practice. Aust Fam Physician 2004;33:87-90. - PubMed
Gill 2009 {published data only}
    1. Gill J M, Chen Y X, Glutting J J, Diamond J J, Lieberman M I. Impact of decision support in electronic medical records on lipid management in primary care. Popul Health Manag 2009;12:221-6. - PubMed
Gill 2011 {published data only}
    1. Gill J M, Mainous A G 3rd, Koopman R J, Player M S, Everett C J, Chen Y X, et al. Impact of EHR-based clinical decision support on adherence to guidelines for patients on NSAIDs: a randomized controlled trial. Ann Fam Med 2011;9:22-30. - PMC - PubMed
Gonzales 2013 {published data only}
    1. Gonzales Ralph, Anderer Tammy, McCulloch Charles E, Maselli Judith H, Bloom Frederick J Jr, Graf Thomas R, et al. A cluster randomized trial of decision support strategies for reducing antibiotic use in acute bronchitis. JAMA Internal Medicine 2013;173:267-73. - PMC - PubMed
Goud 2009 {published data only}
    1. Goud R, Keizer N F, ter Riet G, Wyatt J C, Hasman A, Hellemans I M, et al. Effect of guideline based computerised decision support on decision making of multidisciplinary teams: cluster randomised trial in cardiac rehabilitation. BMJ 2009;338:b1440. - PMC - PubMed
Guiriguet 2016 {published data only}
    1. Guiriguet C, Munoz-Ortiz L, Buron A, Rivero I, Grau J, Vela-Vallespin C, Vilarrubi M, Torres M, Hernandez C, Mendez-Boo L, Toran P, Caballeria L, Macia F, Castells A. Alerts in electronic medical records to promote a colorectal cancer screening programme: a cluster randomised controlled trial in primary care. Br J Gen Pract 2016;66(648):e483-90. - PMC - PubMed
Gulliford 2014 {published data only}
    1. Gulliford M C, Staa T, Dregan A, McDermott L, McCann G, Ashworth M, et al. Electronic health records for intervention research: a cluster randomized trial to reduce antibiotic prescribing in primary care (eCRT study). Ann Fam Med 2014;12:344-51. - PMC - PubMed
Gupta 2014 {published data only}
    1. Gupta A, Gholami P, Turakhia M P, Friday K, Heidenreich P A. Clinical reminders to providers of patients with reduced left ventricular ejection fraction increase defibrillator referral: a randomized trial. Circ Heart Fail 2014;7:140-5. - PubMed
Gurwitz 2008 {published data only}
    1. Gurwitz Jerry H, Field Terry S, Rochon Paula, Judge James, Harrold Leslie R, Bell Chaim M, et al. Effect of computerized provider order entry with clinical decision support on adverse drug events in the long-term care setting. Journal of the American Geriatrics Society 2008;56:2225-33. - PubMed
Hicks 2008 {published data only}
    1. Hicks L S, Sequist T D, Ayanian J Z, Shaykevich S, Fairchild D G, Orav E J, et al. Impact of computerized decision support on blood pressure management and control: a randomized controlled trial. J Gen Intern Med 2008;23:429-41. - PMC - PubMed
Holt 2010 {published data only}
    1. Holt T A, Thorogood M, Griffiths F, Munday S, Friede T, Stables D. Automated electronic reminders to facilitate primary cardiovascular disease prevention: randomised controlled trial. Br J Gen Pract 2010;60:e137-43. - PMC - PubMed
Holt 2017 {published data only}
    1. Holt T A, Dalton A, Marshall T, Fay M, Qureshi N, Kirkpatrick S, Hislop J, Lasserson D, Kearley K, Mollison J, Yu L M, Hobbs F D, Fitzmaurice D. Automated Software System to Promote Anticoagulation and Reduce Stroke Risk: Cluster-Randomized Controlled Trial. Stroke 2017;48(3):787-790. - PMC - PubMed
Hoye 2013 {published data only}
    1. Hoye S, Gjelstad S, Lindbaek M. Effects on antibiotic dispensing rates of interventions to promote delayed prescribing for respiratory tract infections in primary care. Br J Gen Pract 2013;63:e777-86. - PMC - PubMed
Judge 2006 {published data only}
    1. Judge J, Field T S, DeFlorio M, Laprino J, Auger J, Rochon P, et al. Prescribers' responses to alerts during medication ordering in the long term care setting. J Am Med Inform Assoc 2006;13:385-90. - PMC - PubMed
Karlsson 2018 {published data only}
    1. Karlsson L O, Nilsson S, Bang M, Nilsson L, Charitakis E, Janzon M. A clinical decision support tool for improving adherence to guidelines on anticoagulant therapy in patients with atrial fibrillation at risk of stroke: A cluster-randomized trial in a Swedish primary care setting (the CDS-AF study). PLoS Med 2018;15(3):e1002528. - PMC - PubMed
Kenealy 2005 {published data only}
    1. Kenealy T, Arroll B, Petrie K J. Patients and computers as reminders to screen for diabetes in family practice. Randomized-controlled trial. J Gen Intern Med 2005;20:916-21. - PMC - PubMed
Krall 2004 {published data only}
    1. Krall M A, Traunweiser K, Towery W. Effectiveness of an electronic medical record clinical quality alert prepared by off-line data analysis. Stud Health Technol Inform 2004;107:135-9. - PubMed
Kucher 2005 {published data only}
    1. Kucher N, Koo S, Quiroz R, Cooper J M, Paterno M D, Soukonnikov B, et al. Electronic alerts to prevent venous thromboembolism among hospitalized patients. N Engl J Med 2005;352:969-77. - PubMed
Leibovici 2013 {published data only}
    1. Leibovici L, Kariv G, Paul M. Long-term survival in patients included in a randomized controlled trial of TREAT, a decision support system for antibiotic treatment. J Antimicrob Chemother 2013;68:2664-6. - PubMed
Linder 2009‐1 {published data only}
    1. Linder J A, Schnipper J L, Tsurikova R, Yu T, Volk L A, Melnikas A J, et al. Documentation-based clinical decision support to improve antibiotic prescribing for acute respiratory infections in primary care: a cluster randomised controlled trial. Inform Prim Care 2009;17:231-40. - PubMed
Linder 2009‐2 {published data only}
    1. Linder J A, Rigotti N A, Schneider L I, Kelley J H, Brawarsky P, Haas J S. An electronic health record-based intervention to improve tobacco treatment in primary care: a cluster-randomized controlled trial. Arch Intern Med 2009;169:781-7. - PMC - PubMed
Lo 2009 {published data only}
    1. Lo H G, Matheny M E, Seger D L, Bates D W, Gandhi T K. Impact of non-interruptive medication laboratory monitoring alerts in ambulatory care. J Am Med Inform Assoc 2009;16:66-71. - PMC - PubMed
Locatelli 2009 {published data only}
    1. Locatelli F, Covic A, Macdougall I C, Scherhag A, Wiecek A, Group Orama Study. Effect of computer-assisted European Best Practice Guideline implementation on adherence and target attainment: ORAMA results. J Nephrol 2009;22:662-74. - PubMed
Loo 2011a {published data only}
    1. Loo T S, Davis R B, Lipsitz L A, Irish J, Bates C K, Agarwal K, et al. Electronic medical record reminders and panel management to improve primary care of elderly patients. Arch Intern Med 2011;171:1552-8. - PubMed
Loo 2011b {published data only}
    1. Loo T S, Davis R B, Lipsitz L A, Irish J, Bates C K, Agarwal K, Markson L, Hamel M B. Electronic medical record reminders and panel management to improve primary care of elderly patients. Arch Intern Med 2011;171(17):1552-8. - PubMed
Mann 2016 {published data only}
    1. Mann D M, Palmisano J, Lin J J. A pilot randomized trial of technology-assisted goal setting to improve physical activity among primary care patients with prediabetes. Prev Med Rep 2016;4:107-12. - PMC - PubMed
Martins 2017 {published data only}
    1. Martins C M, da Costa Teixeira A S, Azevedo L F, Sa L M, Santos P A, do Couto M L, da Costa Pereira A M, Hespanhol A A, da Costa Santos C M. The effect of a test ordering software intervention on the prescription of unnecessary laboratory tests - a randomized controlled trial. BMC Med Inform Decis Mak 2017;17(1):20. - PMC - PubMed
Matheny 2008 {published data only}
    1. Matheny M E, Sequist T D, Seger A C, Fiskio J M, Sperling M, Bugbee D, et al. A randomized trial of electronic clinical reminders to improve medication laboratory monitoring. J Am Med Inform Assoc 2008;15:424-9. - PMC - PubMed
Mazzaglia 2016 {published data only}
    1. Mazzaglia G, Piccinni C, Filippi A, Sini G, Lapi F, Sessa E, Cricelli I, Cutroneo P, Trifiro G, Cricelli C, Caputi A P. Effects of a computerized decision support system in improving pharmacological management in high-risk cardiovascular patients: A cluster-randomized open-label controlled trial. Health Informatics J 2016;22(2):232-47. - PubMed
McCowan 2001 {published data only}
    1. McCowan C, Neville R G, Ricketts I W, Warner F C, Hoskins G, Thomas G E. Lessons from a randomized controlled trial designed to evaluate computer decision support software to improve the management of asthma. Med Inform Internet Med 2001;26:191-201. - PubMed
McGinn 2013 {published data only}
    1. McGinn T G, McCullagh L, Kannry J, Knaus M, Sofianou A, Wisnivesky J P, et al. Efficacy of an evidence-based clinical decision support in primary care practices: a randomized clinical trial. JAMA Intern Med 2013;173:1584-91. - PubMed
Meigs 2003 {published data only}
    1. Meigs James B, Cagliero Enrico, Dubey Anil, Murphy-Sheehy Patricia, Gildesgame Catharyn, Chueh Henry, et al. A controlled trial of web-based diabetes disease management: the MGH diabetes primary care improvement project. Diabetes Care 2003;26:750-7. - PubMed
Mertens 2015 {published data only}
    1. Mertens J R, Chi F W, Weisner C M, Satre D D, Ross T B, Allen S, Pating D, Campbell C I, Lu Y W, Sterling S A. Physician versus non-physician delivery of alcohol screening, brief intervention and referral to treatment in adult primary care: the ADVISe cluster randomized controlled implementation trial. Addict Sci Clin Pract 2015;10:26. - PMC - PubMed
Murray 2004 {published data only}
    1. Murray Michael D, Harris Lisa E, Overhage J Marc, Zhou Xiao-Hua, Eckert George J, Smith Faye E, et al. Failure of computerized treatment suggestions to improve health outcomes of outpatients with uncomplicated hypertension: results of a randomized controlled trial. Pharmacotherapy:The Journal of Human Pharmacology & Drug Therapy 2004;24:324-37. - PubMed
Myers 2011a {published data only}
    1. Myers J S, Gojraty S, Yang W, Linsky A, Airan-Javia S, Polomano R C. A randomized-controlled trial of computerized alerts to reduce unapproved medication abbreviation use. J Am Med Inform Assoc 2011;18:17-23. - PMC - PubMed
Myers 2011b {published data only}
    1. Myers J S, Gojraty S, Yang W, Linsky A, Airan-Javia S, Polomano R C. A randomized-controlled trial of computerized alerts to reduce unapproved medication abbreviation use. J Am Med Inform Assoc 2011;18(1):17-23. - PMC - PubMed
Nendaz 2010 {published data only}
    1. Nendaz M R, Chopard P, Lovis C, Kucher N, Asmis L M, Dorffler J, et al. Adequacy of venous thromboprophylaxis in acutely ill medical patients (IMPART): multisite comparison of different clinical decision support systems. Journal of Thrombosis & Haemostasis 2010;8:1230-4. - PubMed
Overhage 1996 {published data only}
    1. Overhage J M, Tierney W M, McDonald C J. Computer reminders to implement preventive care guidelines for hospitalized patients. Arch Intern Med 1996;156:1551-6. - PubMed
Overhage 1997 {published data only}
    1. Overhage J M, Tierney W M, Zhou X H, McDonald C J. A randomized trial of "corollary orders" to prevent errors of omission. J Am Med Inform Assoc 1997;4:364-75. - PMC - PubMed
Palen 2010 {published data only}
    1. Palen T E, Price D W, Snyder A J, Shetterly S M. Computerized alert reduced D-dimer testing in the elderly. Am J Manag Care 2010;16:e267-75. - PubMed
Paul 2006 {published data only}
    1. Paul Mical, Andreassen Steen, Tacconelli Evelina, Nielsen Anders D, Almanasreh Nadja, Frank Uwe, et al. Improving empirical antibiotic treatment using TREAT, a computerized decision support system: cluster randomized trial. Journal of Antimicrobial Chemotherapy 2006;58:1238-45. - PubMed
Peiris 2015 {published data only}
    1. Peiris D, Usherwood T, Panaretto K, Harris M, Hunt J, Redfern J, et al. Effect of a computer-guided, quality improvement program for cardiovascular disease risk management in primary health care: the treatment of cardiovascular risk using electronic decision support cluster-randomized trial. Circ Cardiovasc Qual Outcomes 2015;8:87-95. - PubMed
Persell 2016a {published data only}
    1. Persell S D, Doctor J N, Friedberg M W, Meeker D, Friesema E, Cooper A, Haryani A, Gregory D L, Fox C R, Goldstein N J, Linder J A. Behavioral interventions to reduce inappropriate antibiotic prescribing: a randomized pilot trial. BMC Infect Dis 2016;16:373. - PMC - PubMed
Persell 2016b {published data only}
    1. Persell S D, Doctor J N, Friedberg M W, Meeker D, Friesema E, Cooper A, Haryani A, Gregory D L, Fox C R, Goldstein N J, Linder J A. Behavioral interventions to reduce inappropriate antibiotic prescribing: a randomized pilot trial. BMC Infect Dis 2016;16:373. - PMC - PubMed
Persell 2016c {published data only}
    1. Persell S D, Doctor J N, Friedberg M W, Meeker D, Friesema E, Cooper A, Haryani A, Gregory D L, Fox C R, Goldstein N J, Linder J A. Behavioral interventions to reduce inappropriate antibiotic prescribing: a randomized pilot trial. BMC Infect Dis 2016;16:373. - PMC - PubMed
Persell 2016d {published data only}
    1. Persell S D, Doctor J N, Friedberg M W, Meeker D, Friesema E, Cooper A, Haryani A, Gregory D L, Fox C R, Goldstein N J, Linder J A. Behavioral interventions to reduce inappropriate antibiotic prescribing: a randomized pilot trial. BMC Infect Dis 2016;16:373. - PMC - PubMed
Persell 2016e {published data only}
    1. Persell S D, Doctor J N, Friedberg M W, Meeker D, Friesema E, Cooper A, Haryani A, Gregory D L, Fox C R, Goldstein N J, Linder J A. Behavioral interventions to reduce inappropriate antibiotic prescribing: a randomized pilot trial. BMC Infect Dis 2016;16:373. - PMC - PubMed
Persell 2016f {published data only}
    1. Persell S D, Doctor J N, Friedberg M W, Meeker D, Friesema E, Cooper A, Haryani A, Gregory D L, Fox C R, Goldstein N J, Linder J A. Behavioral interventions to reduce inappropriate antibiotic prescribing: a randomized pilot trial. BMC Infect Dis 2016;16:373. - PMC - PubMed
Peterson 2007 {published data only}
    1. Peterson J F, Rosenbaum B P, Waitman L R, Habermann R, Powers J, Harrell D, et al. Physicians' response to guided geriatric dosing: initial results from a randomized trial. Stud Health Technol Inform 2007;129:1037-40. - PubMed
Player 2010 {published data only}
    1. Player M S, Gill J M, Mainous A G 3rd, Everett C J, Koopman R J, Diamond J J, et al. An electronic medical record-based intervention to improve quality of care for gastro-esophageal reflux disease (GERD) and atypical presentations of GERD. Qual Prim Care 2010;18:223-9. - PubMed
Price 2017 {published data only}
    1. Price M, Davies I, Rusk R, Lesperance M, Weber J. Applying STOPP Guidelines in Primary Care Through Electronic Medical Record Decision Support: Randomized Control Trial Highlighting the Importance of Data Quality. JMIR Med Inform 2017;5(2):e15. - PMC - PubMed
Rothschild 2007 {published data only}
    1. Rothschild Jeffrey M, McGurk Siobhan, Honour Melissa, Lu Linh, McClendon Aubre A, Srivastava Priya, et al. Assessment of education and computerized decision support interventions for improving transfusion practice. Transfusion 2007;47:228-39. - PubMed
Safran 1995 {published data only}
    1. Safran C, Rind DM, Davis RB, Sands DZ, Caraballo E, Rippel K, et al. A clinical trial of a knowledge-based medical record. Medinfo 1995;8 Pt 2:1076-80. - PubMed
Schnipper 2010 {published data only}
    1. Schnipper J L, Linder J A, Palchuk M B, Yu D T, McColgan K E, Volk L A, et al. Effects of documentation-based decision support on chronic disease management. Am J Manag Care 2010;16:SP72-81. - PubMed
Schriefer 2009 {published data only}
    1. Schriefer S P, Landis S E, Turbow D J, Patch S C. Effect of a computerized body mass index prompt on diagnosis and treatment of adult obesity. Fam Med 2009;41:502-7. - PubMed
Sequist 2005 {published data only}
    1. Sequist T D, Gandhi T K, Karson A S, Fiskio J M, Bugbee D, Sperling M, et al. A randomized trial of electronic clinical reminders to improve quality of care for diabetes and coronary artery disease. J Am Med Inform Assoc 2005;12:431-7. - PMC - PubMed
Sequist 2009 {published data only}
    1. Sequist T D, Zaslavsky A M, Marshall R, Fletcher R H, Ayanian J Z. Patient and physician reminders to promote colorectal cancer screening: a randomized controlled trial. Arch Intern Med 2009;169:364-71. - PMC - PubMed
Sequist 2011 {published data only}
    1. Sequist Thomas D, Zaslavsky Alan M, Colditz Graham A, Ayanian John Z. Electronic patient messages to promote colorectal cancer screening: a randomized controlled trial. Archives of Internal Medicine 2011;171:636-41. - PMC - PubMed
Sequist 2018a {published data only}
    1. Sequist T D, Holliday A M, Orav E J, Bates D W, Denker B M. Physician and patient tools to improve chronic kidney disease care. Am J Manag Care 2018;24(4):e107-e114. - PubMed
Sequist 2018b {published data only}
    1. Sequist T D, Holliday A M, Orav E J, Bates D W, Denker B M. Physician and patient tools to improve chronic kidney disease care. Am J Manag Care 2018;24(4):e107-e114. - PubMed
Silbernagel 2016 {published data only}
    1. Silbernagel G, Spirk D, Hager A, Baumgartner I, Kucher N. Electronic Alert System for Improving Stroke Prevention Among Hospitalized Oral-Anticoagulation-Naive Patients With Atrial Fibrillation: A Randomized Trial. J Am Heart Assoc 2016;5(7). - PMC - PubMed
Smith 2012 {published data only}
    1. Smith J R, Noble M J, Musgrave S, Murdoch J, Price G M, Barton G R, et al. The at-risk registers in severe asthma (ARRISA) study: a cluster-randomised controlled trial examining effectiveness and costs in primary care. Thorax 2012;67:1052-60. - PubMed
Spirk 2017 {published data only}
    1. Spirk D, Stuck A K, Hager A, Engelberger R P, Aujesky D, Kucher N. Electronic alert system for improving appropriate thromboprophylaxis in hospitalized medical patients: a randomized controlled trial. J Thromb Haemost 2017;15(11):2138-2146. - PubMed
Stockwell 2015 {published data only}
    1. Stockwell M S, Catallozzi M, Camargo S, Ramakrishnan R, Holleran S, Findley S E, et al. Registry-linked electronic influenza vaccine provider reminders: a cluster-crossover trial. Pediatrics 2015;135:e75-82. - PubMed
Strom 2010 {published data only}
    1. Strom B L, Schinnar R, Aberra F, Bilker W, Hennessy S, Leonard C E, et al. Unintended effects of a computerized physician order entry nearly hard-stop alert to prevent a drug interaction: a randomized controlled trial. Arch Intern Med 2010;170:1578-83. - PubMed
Szilagyi 2015 {published data only}
    1. Szilagyi P G, Serwint J R, Humiston S G, Rand C M, Schaffer S, Vincelli P, et al. Effect of provider prompts on adolescent immunization rates: a randomized trial. Acad Pediatr 2015;15:149-57. - PMC - PubMed
Tamblyn 2003 {published data only}
    1. Tamblyn R, Huang A, Perreault R, Jacques A, Roy D, Hanley J, et al. The medical office of the 21st century (MOXXI): effectiveness of computerized decision-making support in reducing inappropriate prescribing in primary care. CMAJ 2003;169:549-56. - PMC - PubMed
Tamblyn 2010 {published data only}
    1. Tamblyn R, Reidel K, Huang A, Taylor L, Winslade N, Bartlett G, et al. Increasing the detection and response to adherence problems with cardiovascular medication in primary care through computerized drug management systems: a randomized controlled trial. Med Decis Making 2010;30:176-88. - PubMed
Tamblyn 2015 {published data only}
    1. Tamblyn R, Ernst P, Winslade N, Huang A, Grad R, Platt R W, Ahmed S, Moraga T, Eguale T. Evaluating the impact of an integrated computer-based decision support with person-centered analytics for the management of asthma in primary care: a randomized controlled trial. J Am Med Inform Assoc 2015;22(4):773-83. - PMC - PubMed
Tamblyn 2018a {published data only}
    1. Tamblyn R, Winslade N, Qian C J, Moraga T, Huang A. What is in your wallet? A cluster randomized trial of the effects of showing comparative patient out-of-pocket costs on primary care prescribing for uncomplicated hypertension. Implement Sci 2018;13(1):7. - PMC - PubMed
Tamblyn 2018b {published data only}
    1. Tamblyn R, Winslade N, Qian C J, Moraga T, Huang A. What is in your wallet? A cluster randomized trial of the effects of showing comparative patient out-of-pocket costs on primary care prescribing for uncomplicated hypertension. Implement Sci 2018;13(1):7. - PMC - PubMed
Tang 2012 {published data only}
    1. Tang Joyce W, Kushner Robert F, Cameron Kenzie A, Hicks Brent, Cooper Andrew J, Baker David W. Electronic tools to assist with identification and counseling for overweight patients: a randomized controlled trial. Journal of General Internal Medicine 2012;27:933-9. - PMC - PubMed
Taveras 2014 {published data only}
    1. Taveras E M, Marshall R, Horan C M, Gillman M W, Hacker K, Kleinman K P, et al. Improving children's obesity-related health care quality: process outcomes of a cluster-randomized controlled trial. Obesity (Silver Spring) 2014;22:27-31. - PubMed
Taveras 2015a {published data only}
    1. Taveras E M, Marshall R, Kleinman K P, Gillman M W, Hacker K, Horan C M, Smith R L, Price S, Sharifi M, Rifas-Shiman S L, Simon S R. Comparative effectiveness of childhood obesity interventions in pediatric primary care: a cluster-randomized clinical trial. JAMA Pediatr 2015;169(6):535-42. - PubMed
Taveras 2015b {published data only}
    1. Taveras E M, Marshall R, Kleinman K P, Gillman M W, Hacker K, Horan C M, Smith R L, Price S, Sharifi M, Rifas-Shiman S L, Simon S R. Comparative effectiveness of childhood obesity interventions in pediatric primary care: a cluster-randomized clinical trial. JAMA Pediatr 2015;169(6):535-42. - PubMed
Terrell 2009 {published data only}
    1. Terrell K M, Perkins A J, Dexter P R, Hui S L, Callahan C M, Miller D K. Computerized decision support to reduce potentially inappropriate prescribing to older emergency department patients: a randomized, controlled trial. J Am Geriatr Soc 2009;57:1388-94. - PubMed
Terrell 2010 {published data only}
    1. Terrell Kevin M, Perkins Anthony J, Hui Siu L, Callahan Christopher M, Dexter Paul R, Miller Douglas K. Computerized decision support for medication dosing in renal insufficiency: a randomized, controlled trial. Annals of Emergency Medicine 2010;56:623-9. - PubMed
Tierney 2003 {published data only}
    1. Tierney W M, Overhage J M, Murray M D, Harris L E, Zhou X H, Eckert G J, et al. Effects of computerized guidelines for managing heart disease in primary care. J Gen Intern Med 2003;18:967-76. - PMC - PubMed
Tierney 2005 {published data only}
    1. Tierney W M, Overhage J M, Murray M D, Harris L E, Zhou X H, Eckert G J, et al. Can computer-generated evidence-based care suggestions enhance evidence-based management of asthma and chronic obstructive pulmonary disease? A randomized, controlled trial. Health Serv Res 2005;40:477-97. - PMC - PubMed
Trick 2009 {published data only}
    1. Trick W E, Das K, Gerard M N, Charles-Damte M, Murphy G, Benson I, et al. Clinical trial of standing-orders strategies to increase the inpatient influenza vaccination rate. Infect Control Hosp Epidemiol 2009;30:86-8. - PubMed
Van Wyk 2008a {published data only}
    1. Wyk J T, Wijk M A, Sturkenboom M C, Mosseveld M, Moorman P W, Lei J. Electronic alerts versus on-demand decision support to improve dyslipidemia treatment: a cluster randomized controlled trial. Circulation 2008;117:371-8. - PubMed
Van Wyk 2008b {published data only}
    1. Wyk J T, Wijk M A, Sturkenboom M C, Mosseveld M, Moorman P W, Lei J. Electronic alerts versus on-demand decision support to improve dyslipidemia treatment: a cluster randomized controlled trial. Circulation 2008;117(3):371-8. - PubMed
Walker 2010 {published data only}
    1. Walker J, Fairley C K, Walker S M, Gurrin L C, Gunn J M, Pirotta M V, et al. Computer reminders for Chlamydia screening in general practice: a randomized controlled trial. Sex Transm Dis 2010;37:445-50. - PubMed
Wexler 2010 {published data only}
    1. Wexler D J, Shrader P, Burns S M, Cagliero E. Effectiveness of a computerized insulin order template in general medical inpatients with type 2 diabetes: a cluster randomized trial. Diabetes Care 2010;33:2181-3. - PMC - PubMed
Wright 2012 {published data only}
    1. Wright A, Pang J, Feblowitz J C, Maloney F L, Wilcox A R, McLoughlin K S, et al. Improving completeness of electronic problem lists through clinical decision support: a randomized, controlled trial. J Am Med Inform Assoc 2012;19:555-61. - PMC - PubMed
Wu 2018 {published data only}
    1. Wu Y, Chen Y, Li S, Dong W, Liang H, Deng M, Chen Y, Chen S, Liang X. Value of electronic alerts for acute kidney injury in high-risk wards: a pilot randomized controlled trial. Int Urol Nephrol 2018;50(8):1483-1488. - PMC - PubMed
Zanetti 2003 {published data only}
    1. Zanetti G, Flanagan H L Jr, Cohn L H, Giardina R, Platt R. Improvement of intraoperative antibiotic prophylaxis in prolonged cardiac surgery by automated alerts in the operating room. Infect Control Hosp Epidemiol 2003;24:13-6. - PubMed
Zera 2015 {published data only}
    1. Zera C A, Bates D W, Stuebe A M, Ecker J L, Seely E W. Diabetes Screening Reminder for Women With Prior Gestational Diabetes: A Randomized Controlled Trial. Obstet Gynecol 2015;126(1):109-14. - PMC - PubMed

References to studies excluded from this review

Acevedo 2018 {published data only}
    1. Acevedo A, Lee MT, Garnick DW, Horgan CM, Ritter GA, Panas L, et al. Agency-level financial incentives and electronic reminders to improve continuity of care after discharge from residential treatment and detoxification. Drug and alcohol dependence 2018;183:192-200. [PMID: ] - PMC - PubMed
Adelman 2013 {published data only}
    1. Adelman J S, Kalkut G E, Schechter C B, Weiss J M, Berger M A, Reissman S H, et al. Understanding and preventing wrong-patient electronic orders: a randomized controlled trial. J Am Med Inform Assoc 2013;20(2):305-10. - PMC - PubMed
Allen 2016 {published data only}
    1. Allen KD, Yancy WS Jr, Bosworth HB, Coffman CJ, Jeffreys AS, Datta SK, et al. A Combined Patient and Provider Intervention for Management of Osteoarthritis in Veterans: A Randomized Clinical Trial. Annals of internal medicine 2016;164(2):73-83. [PMID: ] - PMC - PubMed
ALMohiza 2016 {published data only}
    1. ALMohiza MA, Sparto PJ, Marchetti GF, Delitto A, Furman JM, Miller DL, et al. A Quality Improvement Project in Balance and Vestibular Rehabilitation and Its Effect on Clinical Outcomes. Journal of neurologic physical therapy : JNPT 2016;40(2):90-9. [PMID: ] - PubMed
Anchala 2015 {published data only}
    1. Anchala R, Kaptoge S, Pant H, Di Angelantonio E, Franco OH, Prabhakaran D. Evaluation of effectiveness and cost-effectiveness of a clinical decision support system in managing hypertension in resource constrained primary health care settings: results from a cluster randomized trial. Journal of the American Heart Association 2015;4(1):e001213. [PMID: ] - PMC - PubMed
Apkon 2005a {published data only}
    1. Apkon M, Mattera J A, Lin Z, Herrin J, Bradley E H, Carbone M, et al. A randomized outpatient trial of a decision-support information technology tool. Arch Intern Med 2005;165(20):2388-94. - PubMed
Åsberg 2010 {published data only}
    1. Åsberg A, Falck P, Undset L H, Dorje C, Holdaas H, Hartmann A, et al. Computer-assisted cyclosporine dosing performs better than traditional dosing in renal transplant recipients: results of a pilot study. Ther Drug Monit 2010;32(2):152-8. - PubMed
Barkun 2013 {published data only}
    1. Barkun A N, Bhat M, Armstrong D, Dawes M, Donner A, Enns R, et al. Effectiveness of disseminating consensus management recommendations for ulcer bleeding: a cluster randomized trial. CMAJ 2013;185(3):E156-66. - PMC - PubMed
Beck 2015 {published data only}
    1. Beck JR, Fung K, Lopez H 2nd, Mongero LB, Argenziano M. Real-time data acquisition and alerts may reduce reaction time and improve perfusionist performance during cardiopulmonary bypass. Perfusion 2015;30(1):41-4. [PMID: ] - PubMed
Beeckman 2013 {published data only}
    1. Beeckman D, Clays E, Van Hecke A, Vanderwee K, Schoonhoven L, Verhaeghe S. A multi-faceted tailored strategy to implement an electronic clinical decision support system for pressure ulcer prevention in nursing homes: a two-armed randomized controlled trial. Int J Nurs Stud 2013;50(4):475-86. - PubMed
Bernacki 2015 {published data only}
    1. Bernacki R, Hutchings M, Vick J, Smith G, Paladino J, Lipsitz S, et al. Development of the Serious Illness Care Program: a randomised controlled trial of a palliative care communication intervention. BMJ open 2015;5(10):e009032. [PMID: ] - PMC - PubMed
Bhardwaja 2011 {published data only}
    1. Bhardwaja B, Carroll N M, Raebel M A, Chester E A, Korner E J, Rocho B E, et al. Improving prescribing safety in patients with renal insufficiency in the ambulatory setting: the Drug Renal Alert Pharmacy (DRAP) program. Pharmacotherapy 2011;31(4):346-56. - PubMed
Bindels 2004 {published data only}
    1. Bindels R, Hasman A, Wersch J W, Talmon J, Winkens R A. Evaluation of an automated test ordering and feedback system for general practitioners in daily practice. Int J Med Inform 2004;73(9-10):705-12. - PubMed
Biswas 2018 {published data only}
    1. Biswas A, Parikh CR, Feldman HI, Garg AX, Latham S, Lin H, et al. Identification of Patients Expected to Benefit from Electronic Alerts for Acute Kidney Injury. Clinical journal of the American Society of Nephrology : CJASN 2018;13(6):842-9. [PMID: ] - PMC - PubMed
Bosworth 2009 {published data only}
    1. Bosworth H B, Olsen M K, Dudley T, Orr M, Goldstein M K, Datta S K, et al. Patient education and provider decision support to control blood pressure in primary care: a cluster randomized trial. Am Heart J 2009;157(3):450-6. - PubMed
Caballero‐Ruiz 2017 {published data only}
    1. Caballero-Ruiz E, Garcia-Saez G, Rigla M, Villaplana M, Pons B, Hernando ME. A web-based clinical decision support system for gestational diabetes: Automatic diet prescription and detection of insulin needs. International journal of medical informatics 2017;102:35-49. [PMID: ] - PubMed
Cannon 2000 {published data only}
    1. Cannon D S, Allen S N. A comparison of the effects of computer and manual reminders on compliance with a mental health clinical practice guideline. J Am Med Inform Assoc 2000;7(2):196-203. - PMC - PubMed
Chien 2017 {published data only}
    1. Chien AT, Lehmann LS, Hatfield LA, Koplan KE, Petty CR, Sinaiko AD, et al. A Randomized Trial of Displaying Paid Price Information on Imaging Study and Procedure Ordering Rates. Journal of general internal medicine 2017;32(4):434-48. [PMID: ] - PMC - PubMed
Clarke 2016 {published data only}
    1. Clarke S, Wilson ML, Terhaar M. Using Clinical Decision Support and Dashboard Technology to Improve Heart Team Efficiency and Accuracy in a Transcatheter Aortic Valve Implantation (TAVI) Program. Studies in health technology and informatics 2016;225:98-102. [PMID: ] - PubMed
Collins 2018 {published data only}
    1. Collins BN, Lepore SJ, Winickoff JP, Nair US, Moughan B, Bryant-Stephens T, et al. An Office-Initiated Multilevel Intervention for Tobacco Smoke Exposure: A Randomized Trial. Pediatrics 2018;141(Suppl 1):S75-86. [PMID: ] - PMC - PubMed
Colpaert 2012 {published data only}
    1. Colpaert K, Hoste E A, Steurbaut K, Benoit D, Van Hoecke S, De Turck F, et al. Impact of real-time electronic alerting of acute kidney injury on therapeutic intervention and progression of RIFLE class. Crit Care Med 2012;40(4):1164-70. - PubMed
Crosson 2012 {published data only}
    1. Crosson J C, Ohman-Strickland P A, Cohen D J, Clark E C, Crabtree B F. Typical electronic health record use in primary care practices and the quality of diabetes care. Ann Fam Med 2012;10(3):221-7. - PMC - PubMed
Curran 2010 {published data only}
    1. Curran K, Nichols E, Xie E, Harper R. An intensive insulinotherapy mobile phone application built on artificial intelligence techniques. J Diabetes Sci Technol 2010;4(1):209-20. - PMC - PubMed
Curtain 2011 {published data only}
    1. Curtain C, Peterson G M, Tenni P, Bindoff I K, Williams M. Outcomes of a decision support prompt in community pharmacy-dispensing software to promote step-down of proton pump inhibitor therapy. Br J Clin Pharmacol 2011;71(5):780-4. - PMC - PubMed
Dekarske 2015 {published data only}
    1. Dekarske BM, Zimmerman CR, Chang R, Grant PJ, Chaffee BW. Increased appropriateness of customized alert acknowledgement reasons for overridden medication alerts in a computerized provider order entry system. International journal of medical informatics 2015;84(12):1085-93. [PMID: ] - PubMed
Dexter 2004 {published data only}
    1. Dexter P R, Perkins S M, Maharry K S, Jones K, McDonald C J. Inpatient computer-based standing orders vs physician reminders to increase influenza and pneumococcal vaccination rates: a randomized trial. JAMA 2004;292(19):2366-71. - PubMed
Dixon 2017 {published data only}
    1. Dixon BE, Boockvar KS. Event Notification in Support of Population Health: The Promise and Challenges from a Randomized Controlled Trial. Studies in health technology and informatics 2017;245:1357. [PMID: ] - PMC - PubMed
Dragan 2015 {published data only}
    1. Dragan IF, Newman M, Stark P, Steffensen B, Karimbux N. Using a Simulated Infobutton Linked to an Evidence-Based Resource to Research Drug-Drug Interactions: A Pilot Study with Third-Year Dental Students. Journal of dental education 2015;79(11):1349-55. [PMID: ] - PubMed
Duffy 2016 {published data only}
    1. Duffy SA, Ronis DL, Ewing LA, Waltje AH, Hall SV, Thomas PL, et al. Implementation of the Tobacco Tactics intervention versus usual care in Trinity Health community hospitals. Implementation science : IS 2016;11(1):147. [PMID: ] - PMC - PubMed
Dumont 2012 {published data only}
    1. Dumont C, Bourguignon C. Effect of a computerized insulin dose calculator on the process of glycemic control. Am J Crit Care 2012;21(2):106-15. - PubMed
Durieux 2000 {published data only}
    1. Durieux P, Nizard R, Ravaud P, Mounier N, Lepage E. A clinical decision support system for prevention of venous thromboembolism: effect on physician behavior. JAMA 2000;283(21):2816-21. - PubMed
Dykes 2010 {published data only}
    1. Dykes P C, Carroll D L, Hurley A, Lipsitz S, Benoit A, Chang F, et al. Fall prevention in acute care hospitals: a randomized trial. JAMA 2010;304(17):1912-8. - PMC - PubMed
Edmiston 2016 {published data only}
    1. Edmiston CE, Krepel CJ, Spencer MP, Ferraz AA, Seabrook GR, Lee CJ, et al. Preadmission Application of 2% Chlorhexidine Gluconate (CHG): Enhancing Patient Compliance While Maximizing Skin Surface Concentrations. Infection control and hospital epidemiology 2016;37(3):254-9. [PMID: ] - PubMed
Eisenstein 2011 {published data only}
    1. Eisenstein E L, Kawamoto K, Anstrom K J, Willis J M, Silvey G M, Johnson F S, et al. Clinical and economic results from a randomized trial of clinical decision support in a rural health network. Stud Health Technol Inform 2011;164:77-81. - PubMed
Elliott 2017 {published data only}
    1. Elliott LS, Henderson JC, Neradilek MB, Moyer NA, Ashcraft KC, Thirumaran RK. Clinical impact of pharmacogenetic profiling with a clinical decision support tool in polypharmacy home health patients: A prospective pilot randomized controlled trial. PloS one 2017;12(2):e0170905. [PMID: ] - PMC - PubMed
Feldstein 2006 {published data only}
    1. Feldstein A, Elmer P J, Smith D H, Herson M, Orwoll E, Chen C, et al. Electronic medical record reminder improves osteoporosis management after a fracture: a randomized, controlled trial. J Am Geriatr Soc 2006;54(3):450-7. - PubMed
Fitzgerald 2011 {published data only}
    1. Fitzgerald M, Cameron P, Mackenzie C, Farrow N, Scicluna P, Gocentas R, et al. Trauma resuscitation errors and computer-assisted decision support. Arch Surg 2011;146(2):218-25. - PubMed
Fitzpatrick 2017 {published data only}
    1. Fitzpatrick SL, Dickins K, Avery E, Ventrelle J, Shultz A, Kishen E, et al. Effect of an obesity best practice alert on physician documentation and referral practices. Translational behavioral medicine 2017;7(4):881-90. [PMID: ] - PMC - PubMed
Flamm 2013 {published data only}
    1. Flamm M, Fritsch G, Hysek M, Klausner S, Entacher K, Panisch S, et al. Quality improvement in preoperative assessment by implementation of an electronic decision support tool. J Am Med Inform Assoc 2013;20(e1):e91-6. - PMC - PubMed
Flanagan 1999 {published data only}
    1. Flanagan J R, Doebbeling B N, Dawson J, Beekmann S. Randomized study of online vaccine reminders in adult primary care. Proc AMIA Symp 1999:755-9. - PMC - PubMed
Foy 2011 {published data only}
    1. Foy R, Eccles M P, Hrisos S, Hawthorne G, Steen N, Gibb I, et al. A cluster randomised trial of educational messages to improve the primary care of diabetes. Implement Sci 2011;6:129. - PMC - PubMed
Freundlich 2013 {published data only}
    1. Freundlich R E, Barnet C S, Mathis M R, Shanks A M, Tremper K K, Kheterpal S. A randomized trial of automated electronic alerts demonstrating improved reimbursable anesthesia time documentation. J Clin Anesth 2013;25(2):110-4. - PubMed
Fricton 2011 {published data only}
    1. Fricton J, Rindal D B, Rush W, Flottemesch T, Vazquez G, Thoele M J, et al. The effect of electronic health records on the use of clinical care guidelines for patients with medically complex conditions. J Am Dent Assoc 2011;142(10):1133-42. - PubMed
Gallagher 2016 {published data only}
    1. Gallagher J, O'Sullivan D, McCarthy S, Gillespie P, Woods N, O'Mahony D, et al. Structured Pharmacist Review of Medication in Older Hospitalised Patients: A Cost-Effectiveness Analysis. Drugs & aging 2016;33(4):285-94. [PMID: ] - PubMed
Goetz 2013 {published data only}
    1. Goetz M B, Hoang T, Knapp H, Burgess J, Fletcher M D, Gifford A L, et al. Central implementation strategies outperform local ones in improving HIV testing in Veterans Healthcare Administration facilities. J Gen Intern Med 2013;28(10):1311-7. - PMC - PubMed
Grace 2011 {published data only}
    1. Grace S L, Russell K L, Reid R D, Oh P, Anand S, Rush J, et al. Effect of cardiac rehabilitation referral strategies on utilization rates: a prospective, controlled study. Arch Intern Med 2011;171(3):235-41. - PubMed
Hagiwara 2013 {published data only}
    1. Hagiwara M A, Sjoqvist B A, Lundberg L, Suserud B O, Henricson M, Jonsson A. Decision support system in prehospital care: a randomized controlled simulation study. Am J Emerg Med 2013;31(1):145-53. - PubMed
Hains 2012 {published data only}
    1. Hains I M, Ward R L, Pearson S A. Implementing a web-based oncology protocol system in Australia: evaluation of the first 3 years of operation. Intern Med J 2012;42(1):57-64. - PubMed
Harpole 1997 {published data only}
    1. Harpole L H, Khorasani R, Fiskio J, Kuperman G J, Bates D W. Automated evidence-based critiquing of orders for abdominal radiographs: impact on utilization and appropriateness. J Am Med Inform Assoc 1997;4(6):511-21. - PMC - PubMed
Heiman 2004 {published data only}
    1. Heiman H, Bates D W, Fairchild D, Shaykevich S, Lehmann L S. Improving completion of advance directives in the primary care setting: a randomized controlled trial. Am J Med 2004;117(5):318-24. - PubMed
Herasevich 2011 {published data only}
    1. Herasevich V, Pieper M S, Pulido J, Gajic O. Enrollment into a time sensitive clinical study in the critical care setting: results from computerized septic shock sniffer implementation. J Am Med Inform Assoc 2011;18(5):639-44. - PMC - PubMed
Holmes 2015 {published data only}
    1. Holmes J F, Freilich J, Taylor S L, Buettner D. Electronic alerts for triage protocol compliance among emergency department triage nurses: a randomized controlled trial. Nurs Res 2015;64(3):226-30. - PMC - PubMed
Hooper 2012 {published data only}
    1. Hooper M H, Weavind L, Wheeler A P, Martin J B, Gowda S S, Semler M W, et al. Randomized trial of automated, electronic monitoring to facilitate early detection of sepsis in the intensive care unit*. Crit Care Med 2012;40(7):2096-101. - PMC - PubMed
Humphrey 2011 {published data only}
    1. Humphrey L L, Shannon J, Partin M R, O'Malley J, Chen Z, Helfand M. Improving the follow-up of positive hemoccult screening tests: an electronic intervention. J Gen Intern Med 2011;26(7):691-7. - PMC - PubMed
Ignatov 2016 {published data only}
    1. Ignatov PN, Lutomski JE. Quantitative cardiotocography to improve fetal assessment during labor: a preliminary randomized controlled trial. European journal of obstetrics, gynecology, and reproductive biology 2016;205:91-7. [PMID: ] - PubMed
James 1993 {published data only}
    1. James A H, Britt R P. Prospective comparative study of computer programs used for management of warfarin. J Clin Pathol 1993;46(8):781. - PMC - PubMed
James 2015 {published data only}
    1. James MT, Garg AX. Acute kidney injury: Do electronic alerts for AKI improve outcomes? Nature reviews. Nephrology 2015;11(6):322-3. [PMID: ] - PubMed
Johnson 2010 {published data only}
    1. Johnson K B, Ho Y X, Cala C M, Davison C. Showing Your Work: Impact of annotating electronic prescriptions with decision support results. J Biomed Inform 2010;43(2):321-5. - PubMed
Keitel 2017 {published data only}
    1. Keitel K, Kagoro F, Samaka J, Masimba J, Said Z, Temba H, et al. A novel electronic algorithm using host biomarker point-of-care tests for the management of febrile illnesses in Tanzanian children (e-POCT): A randomized, controlled non-inferiority trial. PLoS medicine 2017;14(10):e1002411. [PMID: ] - PMC - PubMed
Kim 2017 {published data only}
    1. Kim JM, Rivera M, Persing N, Bundy DG, Psoter KJ, Ghazarian SR, et al. Electronic Immunization Alerts and Spillover Effects on Other Preventive Care. Clinical pediatrics 2017;56(9):811-20. [PMID: ] - PubMed
Kollef 2014 {published data only}
    1. Kollef M H, Chen Y, Heard K, LaRossa G N, Lu C, Martin N R, et al. A randomized trial of real-time automated clinical deterioration alerts sent to a rapid response team. J Hosp Med 2014;9(7):424-9. - PMC - PubMed
Kostopoulou 2015 {published data only}
    1. Kostopoulou O, Lionis C, Angelaki A, Ayis S, Durbaba S, Delaney BC. Early diagnostic suggestions improve accuracy of family physicians: a randomized controlled trial in Greece. Family practice 2015;32(3):323-8. [PMID: ] - PubMed
Kralj 2003 {published data only}
    1. Kralj B, Iverson D, Hotz K, Ashbury F D. The impact of computerized clinical reminders on physician prescribing behavior: evidence from community oncology practice. Am J Med Qual 2003;18(5):197-203. - PubMed
Kuhn 2015 {published data only}
    1. Kuhn L, Reeves K, Taylor Y, Tapp H, McWilliams A, Gunter A, et al. Planning for Action: The Impact of an Asthma Action Plan Decision Support Tool Integrated into an Electronic Health Record (EHR) at a Large Health Care System. Journal of the American Board of Family Medicine : JABFM 2015;28(3):382-93. [PMID: ] - PubMed
Kurian 2009 {published data only}
    1. Kurian B T, Trivedi M H, Grannemann B D, Claassen C A, Daly E J, Sunderajan P. A computerized decision support system for depression in primary care. Prim Care Companion J Clin Psychiatry 2009;11(4):140-6. - PMC - PubMed
Lee 2009 {published data only}
    1. Lee N J, Chen E S, Currie L M, Donovan M, Hall E K, Jia H, et al. The effect of a mobile clinical decision support system on the diagnosis of obesity and overweight in acute and primary care encounters. ANS Adv Nurs Sci 2009;32(3):211-21. - PubMed
Lee 2016 {published data only}
    1. Lee P, Liu JC, Hsieh MH, Hao WR, Tseng YT, Liu SH, et al. Cloud-based BP system integrated with CPOE improves self-management of the hypertensive patients: A randomized controlled trial. Computer methods and programs in biomedicine 2016;132:105-13. [PMID: ] - PubMed
Luders 2010 {published data only}
    1. Luders S, Schrader J, Schmieder R E, Smolka W, Wegscheider K, Bestehorn K. Improvement of hypertension management by structured physician education and feedback system: cluster randomized trial. Eur J Cardiovasc Prev Rehabil 2010;17(3):271-9. - PubMed
Luna 2017 {published data only}
    1. Luna DR, Rizzato Lede DA, Rubin L, Otero CM, Ortiz JM, Garcia MG, et al. User-Centered Design Improves the Usability of Drug-Drug Interaction Alerts: A Validation Study in the Real Scenario. Studies in health technology and informatics 2017;245:1085-9. [PMID: ] - PubMed
Magnus 2012 {published data only}
    1. Magnus M, Herwehe J, Gruber D, Wilbright W, Shepard E, Abrams A, et al. Improved HIV-related outcomes associated with implementation of a novel public health information exchange. Int J Med Inform 2012;81(10):E30-8. - PubMed
Mainous 2013 {published data only}
    1. Mainous A G 3rd, Lambourne C A, Nietert P J. Impact of a clinical decision support system on antibiotic prescribing for acute respiratory infections in primary care: quasi-experimental trial. J Am Med Inform Assoc 2013;20(2):317-24. - PMC - PubMed
Mann 2011 {published data only}
    1. Mann E A, Jones J A, Wolf S E, Wade C E. Computer decision support software safely improves glycemic control in the burn intensive care unit: a randomized controlled clinical study. J Burn Care Res 2011;32(2):246-55. - PMC - PubMed
Manns 2012 {published data only}
    1. Manns B, Tonelli M, Culleton B, Faris P, McLaughlin K, Chin R, et al. A cluster randomized trial of an enhanced eGFR prompt in chronic kidney disease. Clin J Am Soc Nephrol 2012;7(4):565-72. - PMC - PubMed
Martens 2007 {published data only}
    1. Martens J D, Weijden T, Severens J L, Clercq P A, Bruijn D P, Kester A D, et al. The effect of computer reminders on GPs' prescribing behaviour: a cluster-randomised trial. Int J Med Inform 2007;76 Suppl 3:S403-16. - PubMed
Martí 2017 {published data only}
    1. Martí I R, Allepuz A, Palomar G R, Font F O, Cera M S. Impact of an intervention on the prescription of aliskiren after new evidence on safety reported. Pharmacoepidemiology and drug safety 2017;26(1):91-6. [PMID: ] - PubMed
Martinez 2018 {published data only}
    1. Martinez B, Ixen EC, Hall-Clifford R, Juarez M, Miller AC, Francis A, et al. mHealth intervention to improve the continuum of maternal and perinatal care in rural Guatemala: a pragmatic, randomized controlled feasibility trial. Reproductive health 2018;15(1):120. [PMID: ] - PMC - PubMed
Mayne 2014 {published data only}
    1. Mayne SL, duRivage NE, Feemster KA, Localio AR, Grundmeier RW, Fiks AG. Effect of decision support on missed opportunities for human papillomavirus vaccination. American journal of preventive medicine 2014;47(6):734-44. [PMID: ] - PMC - PubMed
McAvoy 2013 {published data only}
    1. McAvoy B R. Computer-generated reminders influence professional practice. Br J Gen Pract 2013;63(611):316. - PMC - PubMed
McCormick 2016 {published data only}
    1. McCormick PJ, Levin MA, Lin HM, Sessler DI, Reich DL. Effectiveness of an Electronic Alert for Hypotension and Low Bispectral Index on 90-day Postoperative Mortality: A Prospective, Randomized Trial. Anesthesiology 2016;125(6):1113-20. [PMID: ] - PubMed
McDonald 1992 {published data only}
    1. McDonald C J, Hui S L, Tierney W M. Effects of computer reminders for influenza vaccination on morbidity during influenza epidemics. MD Comput 1992;9(5):304-12. - PubMed
McGreevey 2013 {published data only}
    1. McGreevey J D 3rd. Order sets in electronic health records: principles of good practice. Chest 2013;143(1):228-35. - PubMed
McGregor 2006 {published data only}
    1. McGregor J C, Weekes E, Forrest G N, Standiford H C, Perencevich E N, Furuno J P, et al. Impact of a computerized clinical decision support system on reducing inappropriate antimicrobial use: a randomized controlled trial. J Am Med Inform Assoc 2006;13(4):378-84. - PMC - PubMed
Mehta 2016 {published data only}
    1. Mehta R, Radhakrishnan NS, Warring CD, Jain A, Fuentes J, Dolganiuc A, et al. The Use of Evidence-Based, Problem-Oriented Templates as a Clinical Decision Support in an Inpatient Electronic Health Record System. Applied clinical informatics 2016;7(3):790-802. [PMID: ] - PMC - PubMed
Montgomery 2000 {published data only}
    1. Montgomery A A, Fahey T, Peters T J, MacIntosh C, Sharp D J. Evaluation of computer based clinical decision support system and risk chart for management of hypertension in primary care: randomised controlled trial. BMJ 2000;320(7236):686-90. - PMC - PubMed
Muth 2018 {published data only}
    1. Muth C, Uhlmann L, Haefeli WE, Rochon J, den Akker M, Perera R, et al. Effectiveness of a complex intervention on Prioritising Multimedication in Multimorbidity (PRIMUM) in primary care: results of a pragmatic cluster randomised controlled trial. BMJ open 2018;8(2):e017740. [PMID: ] - PMC - PubMed
Nieuwlaat 2012 {published data only}
    1. Nieuwlaat R, Hubers L M, Spyropoulos A C, Eikelboom J W, Connolly B J, Van Spall H G, et al. Randomised comparison of a simple warfarin dosing algorithm versus a computerised anticoagulation management system for control of warfarin maintenance therapy. Thromb Haemost 2012;108(6):1228-35. - PubMed
Ornstein 1991 {published data only}
    1. Ornstein S M, Garr D R, Jenkins R G, Rust P F, Arnon A. Computer-generated physician and patient reminders. Tools to improve population adherence to selected preventive services. J Fam Pract 1991;32(1):82-90. - PubMed
Palen 2006 {published data only}
    1. Palen T E, Raebel M, Lyons E, Magid D M. Evaluation of laboratory monitoring alerts within a computerized physician order entry system for medication orders. Am J Manag Care 2006;12(7):389-95. - PubMed
Pang 2015 {published data only}
    1. Pang C L, Chanouzas D, Thomas M, Baharani J. Improving Acute Kidney Injury (AKI) outcomes through the use of automated electronic alerts. Eur J Intern Med 2015;26(1):73. - PubMed
Panjasawatwong 2015 {published data only}
    1. Panjasawatwong K, Sessler DI, Stapelfeldt WH, Mayers DB, Mascha EJ, Yang D, et al. A Randomized Trial of a Supplemental Alarm for Critically Low Systolic Blood Pressure. Anesthesia and analgesia 2015;121(6):1500-7. [PMID: ] - PubMed
Peremans 2010 {published data only}
    1. Peremans L, Rethans J J, Verhoeven V, Coenen S, Debaene L, Meulemans H, et al. Empowering patients or general practitioners? A randomised clinical trial to improve quality in reproductive health care in Belgium. Eur J Contracept Reprod Health Care 2010;15(4):280-9. - PubMed
Pielmeier 2012 {published data only}
    1. Pielmeier U, Rousing M L, Andreassen S, Nielsen B S, Haure P. Decision support for optimized blood glucose control and nutrition in a neurotrauma intensive care unit: preliminary results of clinical advice and prediction accuracy of the Glucosafe system. J Clin Monit Comput 2012;26(4):319-28. - PubMed
Poller 1993 {published data only}
    1. Poller L, Wright D, Rowlands M. Prospective comparative study of computer programs used for management of warfarin. J Clin Pathol 1993;46(4):299-303. - PMC - PubMed
Raebel 2007 {published data only}
    1. Raebel M A, Charles J, Dugan J, Carroll N M, Korner E J, Brand D W, et al. Randomized trial to improve prescribing safety in ambulatory elderly patients. J Am Geriatr Soc 2007;55(7):977-85. - PubMed
Raja 2015 {published data only}
    1. Raja AS, Ip IK, Dunne RM, Schuur JD, Mills AM, Khorasani R. Effects of Performance Feedback Reports on Adherence to Evidence-Based Guidelines in Use of CT for Evaluation of Pulmonary Embolism in the Emergency Department: A Randomized Trial. AJR. American journal of roentgenology 2015;205(5):936-40. [PMID: ] - PubMed
Rapoport 2018 {published data only}
    1. Rapoport MJ, Zucchero Sarracini C, Kiss A, Lee L, Byszewski A, Seitz DP, et al. Computer-Based Driving in Dementia Decision Tool With Mail Support: Cluster Randomized Controlled Trial. Journal of medical Internet research 2018;20(5):e194. [PMID: ] - PMC - PubMed
Rathlev 2016 {published data only}
    1. Rathlev N, Almomen R, Deutsch A, Smithline H, Li H, Visintainer P. Randomized Controlled Trial of Electronic Care Plan Alerts and Resource Utilization by High Frequency Emergency Department Users with Opioid Use Disorder. The western journal of emergency medicine 2016;17(1):28-34. [PMID: ] - PMC - PubMed
Reeve 2008 {published data only}
    1. Reeve J F, Tenni P C, Peterson G M. An electronic prompt in dispensing software to promote clinical interventions by community pharmacists: a randomized controlled trial. Br J Clin Pharmacol 2008;65(3):377-85. - PMC - PubMed
Ribeiro‐Vaz 2012 {published data only}
    1. Ribeiro-Vaz I, Santos C, da Costa-Pereira A, Cruz-Correia R. Promoting spontaneous adverse drug reaction reporting in hospitals using a hyperlink to the online reporting form: an ecological study in Portugal. Drug Saf 2012;35(5):387-94. - PubMed
Robbins 2012 {published data only}
    1. Robbins G K, Lester W, Johnson K L, Chang Y, Estey G, Surrao D, et al. Efficacy of a clinical decision-support system in an HIV practice: a randomized trial. Ann Intern Med 2012;157(11):757-66. - PMC - PubMed
Rodriguez‐Aldrete 2016 {published data only}
    1. Rodriguez-Aldrete D, Sivanesan E, Banks S, Mavarez A, Arheart K, Eber S, et al. Recurrent Visual Electronic Hand Hygiene Reminders in the Anesthesia Work Area. Infection control and hospital epidemiology 2016;37(7):872-4. [PMID: ] - PubMed
Rood 2005 {published data only}
    1. Rood E, Bosman R J, Spoel J I, Taylor P, Zandstra D F. Use of a computerized guideline for glucose regulation in the intensive care unit improved both guideline adherence and glucose regulation. J Am Med Inform Assoc 2005;12(2):172-80. - PMC - PubMed
Roumie 2006 {published data only}
    1. Roumie C L, Elasy T A, Greevy R, Griffin M R, Liu X, Stone W J, et al. Improving blood pressure control through provider education, provider alerts, and patient education: a cluster randomized trial. Ann Intern Med 2006;145(3):165-75. - PubMed
Roy 2009 {published data only}
    1. Roy P M, Durieux P, Gillaizeau F, Legall C, Armand-Perroux A, Martino L, et al. A computerized handheld decision-support system to improve pulmonary embolism diagnosis: a randomized trial. Ann Intern Med 2009;151(10):677-86. - PubMed
Roy 2016 {published data only}
    1. Roy PM, Rachas A, Meyer G, Le Gal G, Durieux P, El Kouri D, et al. Multifaceted Intervention to Prevent Venous Thromboembolism in Patients Hospitalized for Acute Medical Illness: A Multicenter Cluster-Randomized Trial. PloS one 2016;11(5):e0154832. [PMID: ] - PMC - PubMed
Safran 1993 {published data only}
    1. Safran C, Rind D M, Davis R M, Currier J, Ives D, Sands D Z, et al. An electronic medical record that helps care for patients with HIV infection. Proc Annu Symp Comput Appl Med Care 1993:224-8. - PMC - PubMed
Schnipper 2010‐2 {published data only}
    1. Schnipper J L, Liang C L, Ndumele C D, Pendergrass M L. Effects of a computerized order set on the inpatient management of hyperglycemia: a cluster-randomized controlled trial. Endocr Pract 2010;16(2):209-18. - PubMed
Schwarz 2012 {published data only}
    1. Schwarz E B, Parisi S M, Handler S M, Koren G, Cohen E D, Shevchik G J, et al. Clinical decision support to promote safe prescribing to women of reproductive age: a cluster-randomized trial. J Gen Intern Med 2012;27(7):831-8. - PMC - PubMed
Shelley 2015 {published data only}
    1. Shelley D, VanDevanter N, Cleland CC, Nguyen L, Nguyen N. Implementing tobacco use treatment guidelines in community health centers in Vietnam. Implementation science : IS 2015;10:142. [PMID: ] - PMC - PubMed
Silva 2013 {published data only}
    1. Silva B M, Rodrigues J J, Canelo F, Lopes I C, Zhou L. A data encryption solution for mobile health apps in cooperation environments. J Med Internet Res 2013;15(4):e66. - PMC - PubMed
Simon 2006 {published data only}
    1. Simon S R, Smith D H, Feldstein A C, Perrin N, Yang X, Zhou Y, et al. Computerized prescribing alerts and group academic detailing to reduce the use of potentially inappropriate medications in older people. J Am Geriatr Soc 2006;54(6):963-8. - PubMed
Skinner 2015 {published data only}
    1. Skinner CS, Halm EA, Bishop WP, Ahn C, Gupta S, Farrell D, et al. Impact of Risk Assessment and Tailored versus Nontailored Risk Information on Colorectal Cancer Testing in Primary Care: A Randomized Controlled Trial. Cancer epidemiology, biomarkers & prevention : a publication of the American Association for Cancer Research, cosponsored by the American Society of Preventive Oncology 2015;24(10):1523-30. [PMID: ] - PMC - PubMed
Slok 2016 {published data only}
    1. Slok AH, Kotz D, Breukelen G, Chavannes NH, Rutten-van Molken MP, Kerstjens HA, et al. Effectiveness of the Assessment of Burden of COPD (ABC) tool on health-related quality of life in patients with COPD: a cluster randomised controlled trial in primary and hospital care. BMJ open 2016;6(7):e011519. [PMID: ] - PMC - PubMed
Strom 2010‐2 {published data only}
    1. Strom B L, Schinnar R, Bilker W, Hennessy S, Leonard C E, Pifer E. Randomized clinical trial of a customized electronic alert requiring an affirmative response compared to a control group receiving a commercial passive CPOE alert: NSAID--warfarin co-prescribing as a test case. J Am Med Inform Assoc 2010;17(4):411-5. - PMC - PubMed
Sundaram 2009 {published data only}
    1. Sundaram V, Lazzeroni L C, Douglass L R, Sanders G D, Tempio P, Owens D K. A randomized trial of computer-based reminders and audit and feedback to improve HIV screening in a primary care setting. Int J STD AIDS 2009;20(8):527-33. - PubMed
Suresh 2018 {published data only}
    1. Suresh S, Saladino RA, Fromkin J, Heineman E, McGinn T, Richichi R, et al. Integration of physical abuse clinical decision support into the electronic health record at a Tertiary Care Children's Hospital. Journal of the American Medical Informatics Association : JAMIA 2018;25(7):833-40. [PMID: ] - PMC - PubMed
Tamblyn 2008 {published data only}
    1. Tamblyn R, Huang A, Taylor L, Kawasumi Y, Bartlett G, Grad R, et al. A randomized trial of the effectiveness of on-demand versus computer-triggered drug decision support in primary care. J Am Med Inform Assoc 2008;15(4):430-8. - PMC - PubMed
Tamblyn 2012 {published data only}
    1. Tamblyn R, Eguale T, Buckeridge D L, Huang A, Hanley J, Reidel K, et al. The effectiveness of a new generation of computerized drug alerts in reducing the risk of injury from drug side effects: a cluster randomized trial. J Am Med Inform Assoc 2012;19(4):635-43. - PMC - PubMed
Thomas 2004 {published data only}
    1. Thomas H V, Lewis G, Watson M, Bell T, Lyons I, Lloyd K, et al. Computerised patient-specific guidelines for management of common mental disorders in primary care: a randomised controlled trial. Br J Gen Pract 2004;54(508):832-7. - PMC - PubMed
Thomas 2018 {published data only}
    1. Thomas KEH, Kisely S, Urrego F. Electronic Heath Record Prompts May Increase Screening for Secondhand Smoke Exposure. Clinical pediatrics 2018;57(1):27-30. [PMID: ] - PubMed
Tollitt 2018 {published data only}
    1. Tollitt J, Flanagan E, McCorkindale S, Glynn-Atkins S, Emmett L, Darby D, et al. Improved management of acute kidney injury in primary care using e-alerts and an educational outreach programme. Family practice 2018;35(6):684-9. [PMID: ] - PubMed
Tsai 2016 {published data only}
    1. Tsai CY, Wang SH, Hsu MH, Li YC. Do false positive alerts in naive clinical decision support system lead to false adoption by physicians? A randomized controlled trial. Computer methods and programs in biomedicine 2016;132:83-91. [PMID: ] - PubMed
van Doormaal 2009 {published data only}
    1. Doormaal J E, den Bemt P M, Zaal R J, Egberts A C, Lenderink B W, Kosterink J G, et al. The influence that electronic prescribing has on medication errors and preventable adverse drug events: an interrupted time-series study. J Am Med Inform Assoc 2009;16(6):816-25. - PMC - PubMed
van Wijk 2001 {published data only}
    1. Wijk M A, Lei J, Mosseveld M, Bohnen A M, Bemmel J H. Assessment of decision support for blood test ordering in primary care. a randomized trial. Ann Intern Med 2001;134(4):274-81. - PubMed
Weiss 2013 {published data only}
    1. Weiss C H, Dibardino D, Rho J, Sung N, Collander B, Wunderink R G. A clinical trial comparing physician prompting with an unprompted automated electronic checklist to reduce empirical antibiotic utilization. Crit Care Med 2013;41(11):2563-9. - PMC - PubMed
Welch 2015 {published data only}
    1. Welch G, Zagarins S E, Santiago-Kelly P, Rodriguez Z, Bursell S E, Rosal M C, et al. An internet-based diabetes management platform improves team care and outcomes in an urban Latino population. Diabetes Care 2015;38(4):561-7. - PMC - PubMed
Were 2011 {published data only}
    1. Were M C, Shen C, Tierney W M, Mamlin J J, Biondich P G, Li X, et al. Evaluation of computer-generated reminders to improve CD4 laboratory monitoring in sub-Saharan Africa: a prospective comparative study. J Am Med Inform Assoc 2011;18(2):150-5. - PMC - PubMed
Williams 2010 {published data only}
    1. Williams E C, Achtmeyer C E, Kivlahan D R, Greenberg D, Merrill J O, Wickizer T M, et al. Evaluation of an electronic clinical reminder to facilitate brief alcohol-counseling interventions in primary care. J Stud Alcohol Drugs 2010;71(5):720-5. - PMC - PubMed
Williams 2011 {published data only}
    1. Williams M, Peterson G M, Tenni P C, Bindoff I K, Curtain C, Hughes J, et al. Drug-related problems detected in Australian Community Pharmacies: The PROMISe Trial. Ann Pharmacother 2011;45(9):1067-76. - PubMed
Wilson 2015 {published data only}
    1. Wilson FP, Shashaty M, Testani J, Aqeel I, Borovskiy Y, Ellenberg SS, et al. Automated, electronic alerts for acute kidney injury: a single-blind, parallel-group, randomised controlled trial. Lancet (London, England) 2015;385(9981):1966-74. [PMID: ] - PMC - PubMed
Wipfli 2016 {published data only}
    1. Wipfli R, Ehrler F, Bediang G, Betrancourt M, Lovis C. How Regrouping Alerts in Computerized Physician Order Entry Layout Influences Physicians' Prescription Behavior: Results of a Crossover Randomized Trial. JMIR human factors 2016;3(1):e15. [PMID: ] - PMC - PubMed
Woller 2018 {published data only}
    1. Woller SC, Stevens SM, Evans RS, Wray D, Christensen J, Aston VT, et al. Electronic alerts, comparative practitioner metrics, and education improve thromboprophylaxis and reduce venous thrombosis in community hospitals. Research and practice in thrombosis and haemostasis 2018;2(3):481-9. [PMID: ] - PMC - PubMed
Zhu 2018 {published data only}
    1. Zhu X, Wong FKY, Wu CLH. Development and evaluation of a nurse-led hypertension management model: A randomized controlled trial. International journal of nursing studies 2018;77:171-8. [PMID: ] - PubMed
Ziemer 2006 {published data only}
    1. Ziemer D C, Doyle J P, Barnes C S, Branch W T Jr, Cook C B, El-Kebbi I M, et al. An intervention to overcome clinical inertia and improve diabetes mellitus control in a primary care setting: Improving Primary Care of African Americans with Diabetes (IPCAAD) 8. Arch Intern Med 2006;166(5):507-13. - PubMed

References to studies awaiting assessment

Christakis 2001 {published data only}
    1. Christakis DA, Zimmerman FJ, Wright JA, Garrison MM, Rivara FP, Davis RL. A randomized controlled trial of point-of-care evidence to improve the antibiotic prescribing practices for otitis media in children. Pediatrics 2001;107:E15. - PubMed
Christakis 2001a {published data only}
    1. Christakis D A, Zimmerman F J, Wright J A, Garrison M M, Rivara F P, Davis R L. A randomized controlled trial of point-of-care evidence to improve the antibiotic prescribing practices for otitis media in children. Pediatrics 2001;107:E15. - PubMed
Durieux 2000 ‐ classified, excluded {published data only}
    1. Durieux P, Nizard R, Ravaud P, Mounier N, Lepage E. A clinical decision support system for prevention of venous thromboembolism: effect on physician behaviour. JAMA 2000;283:2816-21. - PubMed
Forrest 2013 {published data only}
    1. Forrest C B, Fiks A G, Bailey L C, Localio R, Grundmeier R W, Richards T, et al. Improving adherence to otitis media guidelines with clinical decision support and physician feedback. Pediatrics 2013;131:e1071-81. - PubMed
Fortuna 2009 {published data only}
    1. Fortuna R J, Zhang F, Ross-Degnan D, Campion F X, Finkelstein J A, Kotch J B, et al. Reducing the prescribing of heavily marketed medications: a randomized controlled trial. J Gen Intern Med 2009;24:897-903. - PMC - PubMed
Kralj 2003 ‐ classified, excluded {published data only}
    1. Kralj B, Iverson D, Hotz K, Ashbury FD. The impact of computerized clinical reminders on physician prescribing behavior: evidence from community oncology practice. American Journal of Medical Quality 2003;18:197-203. - PubMed
Plaza 2005 {published data only}
    1. Plaza V, Cobos A, Ignacio-García JM, Molina J, Bergoñón S, García-Alonso F, et al. Cost-effectiveness of an intervention based on the Global Initiative for Asthma (GINA) recommendations using a computerized clinical decision support system: a physicians randomized trial [Coste-efectividad de una intervención basada en las recomendaciones de la Global INitiative for Asthma (GINA), mediante un sistema informatizado de apoyo a la decisión clínica: un ensayo con aleatorización de médicos]. Medicina Clínica 2005;124(6):201-6. - PubMed
Roumie 2006 ‐ classified, excluded {published data only}
    1. Roumie CL, Elasy TA, Greevy R, Griffin MR, Liu X, Stone WJ, Wallston KA, et al. Improving blood pressure control through provider education, provider alerts, and patient education: a cluster randomized trial. Annals of Internal Medicine 2006;145:165-75. - PubMed
Sales 2008 {published data only}
    1. Sales A, Helfrich C, Ho P M, Hedeen A, Plomondon M E, Li Y F, et al. Implementing electronic clinical reminders for lipid management in patients with ischemic heart disease in the veterans health administration: QUERI Series. Implement Sci 2008;3:28. - PMC - PubMed
Tape 1993 {published data only}
    1. Tape TG, Campbell JR. Computerized medical records and preventive health care: success depends on many factors. American Journal of Medicine 1993;94:619-25. - PubMed

Additional references

EPOC 2008
    1. Cochrane Effective Practice and Organisation of Care Group. EPOC-specific resources for review authors. The Cochrane Collaboration, 2008. Available from http://www.epoc.cochrane.org/en/handsearchers.html (accessed 25 July 2008).
Grimshaw 2003
    1. Grimshaw J, McAuley LM, Bero LA, Grilli R, Oxman AD, Ramsay C, et al. Systematic reviews of the effectiveness of quality improvement strategies and programmes. Quality and Safety in Health Care 2003;12:298-303. - PMC - PubMed
Grimshaw 2004
    1. Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, et al. Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technology Assessment 2004;8:iii-iv, 1-72. - PubMed
Kawamoto 2005
    1. Kawamoto K, Houlihan CA, Balas EA, Lobach DF. Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success. BMJ 2005;330:765. - PMC - PubMed
Shojania 2004a
    1. Shojania KG, McDonald KM, Wachter RM, Owens DK. Closing the quality gap: a critical analysis of quality improvement strategies. Vol. 1: Series Overview and Methodology. Rockville, MD: Agency for Healthcare Research and Quality, August 2004. [AHRQ Publication NO. 04-0051-1] - PubMed
Shojania 2004b
    1. Shojania KG, Ranji S, Shaw LK, et al. Closing the quality gap: a critical analysis of quality improvement strategies. Vol. 2: Diabetes Mellitus Care. Rockville, MD: Agency for Healthcare Research and Quality, September 2004. [AHRQ Publication No. 04-0051-2] - PubMed
Shojania 2005
    1. Shojania KG, Grimshaw JM. Evidence-based quality improvement: the state of the science. Health Affairs (Millwood) 2005;24:138-50. - PubMed
Shojania 2006
    1. Shojania KG, Ranji SR, McDonald KM, Grimshaw JM, Sundaram V, Rushakoff RJ, et al. Effects of quality improvement strategies for type 2 diabetes on glycemic control: a meta-regression analysis. JAMA 2006;296:427-40. - PubMed

MeSH terms