Accuracy and Safety of AI-Enabled Scribe Technology: Instrument Validation Study
- PMID: 39869899
- PMCID: PMC11811668
- DOI: 10.2196/64993
Accuracy and Safety of AI-Enabled Scribe Technology: Instrument Validation Study
Abstract
Artificial intelligence-enabled ambient digital scribes may have many potential benefits, yet results from our study indicate that there are errors that must be evaluated to mitigate safety risks.
Keywords: AI; AI scribe technology; AI-enabled scribe technology; accuracy; ambient digital scribe; ambient scribe; artificial intelligence; dialogue script; digital scribe; doctor-patient communication; doctor-patient relationship; patient engagement; patient safety; patient-clinician; patient-clinician communication; safety; scribe; scribe technology.
©Joshua Biro, Jessica L Handley, Nathan K Cobb, Varsha Kottamasu, Jeffrey Collins, Seth Krevat, Raj M Ratwani. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 27.01.2025.
Conflict of interest statement
Conflicts of Interest: None declared.
References
-
- Tierney AA, Gayre G, Hoberman B, Mattern B, Ballesca M, Kipnis P, Liu V, Lee K. Ambient artificial intelligence scribes to alleviate the burden of clinical documentation. NEJM Catalyst. 2024 Feb 21;5(3):692–694. doi: 10.1056/CAT.23.0404. - DOI
-
- van Buchem MM, Kant IMJ, King L, Kazmaier J, Steyerberg EW, Bauer MP. Impact of a digital scribe system on clinical documentation time and quality: usability study. JMIR AI. 2024 Sep 23;3:e60020. doi: 10.2196/60020. https://ai.jmir.org/2024//e60020/ v3i1e60020 - DOI - PMC - PubMed
-
- Seth P, Carretas R, Rudzicz F. The utility and implications of ambient scribes in primary care. JMIR AI. 2024 Oct 04;3:e57673. doi: 10.2196/57673. https://ai.jmir.org/2024//e57673/ v3i1e57673 - DOI - PMC - PubMed
-
- van Buchem MM, Boosman H, Bauer MP, Kant IMJ, Cammel SA, Steyerberg EW. The digital scribe in clinical practice: a scoping review and research agenda. NPJ Digit Med. 2021 Mar 26;4(1):57. doi: 10.1038/s41746-021-00432-5. https://doi.org/10.1038/s41746-021-00432-5 10.1038/s41746-021-00432-5 - DOI - DOI - PMC - PubMed
-
- Biden JR. Executive order on the safe, secure, and trustworthy development and use of artificial intelligence. The White House. 2023. [2025-01-07]. https://www.whitehouse.gov/briefing-room/presidential-actions/2023/10/30...
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
