Usability of a perioperative medication-related clinical decision support software application: a randomized controlled trial
- PMID: 35575780
- PMCID: PMC9277651
- DOI: 10.1093/jamia/ocac035
Usability of a perioperative medication-related clinical decision support software application: a randomized controlled trial
Abstract
Objective: We developed a comprehensive, medication-related clinical decision support (CDS) software prototype for use in the operating room. The purpose of this study was to compare the usability of the CDS software to the current standard electronic health record (EHR) medication administration and documentation workflow.
Materials and methods: The primary outcome was the time taken to complete all simulation tasks. Secondary outcomes were the total number of mouse clicks and the total distance traveled on the screen in pixels. Forty participants were randomized and assigned to complete 7 simulation tasks in 1 of 2 groups: (1) the CDS group (n = 20), who completed tasks using the CDS and (2) the Control group (n = 20), who completed tasks using the standard medication workflow with retrospective manual documentation in our anesthesia information management system. Blinding was not possible. We video- and audio-recorded the participants to capture quantitative data (time on task, mouse clicks, and pixels traveled on the screen) and qualitative data (think-aloud verbalization).
Results: The CDS group mean total task time (402.2 ± 85.9 s) was less than the Control group (509.8 ± 103.6 s), with a mean difference of 107.6 s (95% confidence interval [CI], 60.5-179.5 s, P < .001). The CDS group used fewer mouse clicks (26.4 ± 4.5 clicks) than the Control group (56.0 ± 15.0 clicks) with a mean difference of 29.6 clicks (95% CI, 23.2-37.6, P < .001). The CDS group had fewer pixels traveled on the computer monitor (59.5 ± 20.0 thousand pixels) than the Control group (109.3 ± 40.8 thousand pixels) with a mean difference of 49.8 thousand pixels (95% CI, 33.0-73.7, P < .001).
Conclusions: The perioperative medication-related CDS software prototype substantially outperformed standard EHR workflow by decreasing task time and improving efficiency and quality of care in a simulation setting.
Keywords: anesthesia; clinical decision support systems; drug safety; randomized controlled trial; usability testing.
© The Author(s) 2022. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For permissions, please email: journals.permissions@oup.com.
Similar articles
-
Integrating usability testing and think-aloud protocol analysis with "near-live" clinical simulations in evaluating clinical decision support.Int J Med Inform. 2012 Nov;81(11):761-72. doi: 10.1016/j.ijmedinf.2012.02.009. Epub 2012 Mar 27. Int J Med Inform. 2012. PMID: 22456088
-
Usability testing of Avoiding Diabetes Thru Action Plan Targeting (ADAPT) decision support for integrating care-based counseling of pre-diabetes in an electronic health record.Int J Med Inform. 2014 Sep;83(9):636-47. doi: 10.1016/j.ijmedinf.2014.05.002. Epub 2014 May 23. Int J Med Inform. 2014. PMID: 24981988 Free PMC article.
-
Usability Testing of a Complex Clinical Decision Support Tool in the Emergency Department: Lessons Learned.JMIR Hum Factors. 2015 Sep 10;2(2):e14. doi: 10.2196/humanfactors.4537. JMIR Hum Factors. 2015. PMID: 27025540 Free PMC article.
-
Electronic Health Record-Integrated Clinical Decision Support for Clinicians Serving Populations Facing Health Care Disparities: Literature Review.Yearb Med Inform. 2022 Aug;31(1):184-198. doi: 10.1055/s-0042-1742518. Epub 2022 Dec 4. Yearb Med Inform. 2022. PMID: 36463877 Free PMC article. Review.
-
Design of decision support interventions for medication prescribing.Int J Med Inform. 2013 Jun;82(6):492-503. doi: 10.1016/j.ijmedinf.2013.02.003. Epub 2013 Mar 13. Int J Med Inform. 2013. PMID: 23490305 Review.
Cited by
-
A Multiyear Survey Evaluating Clinician Electronic Health Record Satisfaction.Appl Clin Inform. 2023 Aug;14(4):632-643. doi: 10.1055/s-0043-1770900. Epub 2023 Aug 16. Appl Clin Inform. 2023. PMID: 37586414 Free PMC article.
-
Improving Adherence to Evidence-based Practice for Uncomplicated UTI in a Pediatric Emergency Department.Pediatr Qual Saf. 2023 May 22;8(3):e654. doi: 10.1097/pq9.0000000000000654. eCollection 2023 May-Jun. Pediatr Qual Saf. 2023. PMID: 38571736 Free PMC article.
-
Investigating Older Adults' Perceptions of AI Tools for Medication Decisions: Vignette-Based Experimental Survey.J Med Internet Res. 2024 Dec 16;26:e60794. doi: 10.2196/60794. J Med Internet Res. 2024. PMID: 39680885 Free PMC article.
-
Usability assessments in clinical decision support systems.North Clin Istanb. 2025 Jun 19;12(3):372-377. doi: 10.14744/nci.2024.22316. eCollection 2025. North Clin Istanb. 2025. PMID: 40843327 Free PMC article.
-
Opportunities of AI-powered applications in anesthesiology to enhance patient safety.Int Anesthesiol Clin. 2024 Apr 1;62(2):26-33. doi: 10.1097/AIA.0000000000000437. Epub 2024 Feb 13. Int Anesthesiol Clin. 2024. PMID: 38348838 Free PMC article. No abstract available.
References
-
- Barker KN, Flynn EA, Pepper GA. Observation method of detecting medication errors. Am J Health Syst Pharm 2002; 59 (23): 2314–6. - PubMed
-
- Kaushal R, Bates DW, Landrigan C, et al. Medication errors and adverse drug events in pediatric inpatients. JAMA 2001; 285 (16): 2114–20. - PubMed
-
- Lazarou J, Pomeranz BH, Corey PN. Incidence of adverse drug reactions in hospitalized patients: a meta-analysis of prospective studies. JAMA 1998; 279 (15): 1200–5. - PubMed