Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2023 Dec 1;118(12):2276-2279.
doi: 10.14309/ajg.0000000000002397. Epub 2023 Jul 10.

Evaluation of the Potential Utility of an Artificial Intelligence Chatbot in Gastroesophageal Reflux Disease Management

Jacqueline B Henson  1 , Jeremy R Glissen Brown  1 , Joshua P Lee  1 , Amit Patel  1   2 , David A Leiman  1   3
Affiliations

Evaluation of the Potential Utility of an Artificial Intelligence Chatbot in Gastroesophageal Reflux Disease Management

Jacqueline B Henson et al. Am J Gastroenterol. .

Abstract

Introduction: Artificial intelligence chatbots could serve as an information resource for patients and a tool for clinicians. Their ability to respond appropriately to questions regarding gastroesophageal reflux disease is unknown.

Methods: Twenty-three prompts regarding gastroesophageal reflux disease management were submitted to ChatGPT, and responses were rated by 3 gastroenterologists and 8 patients.

Results: ChatGPT provided largely appropriate responses (91.3%), although with some inappropriateness (8.7%) and inconsistency. Most responses (78.3%) contained at least some specific guidance. Patients considered this a useful tool (100%).

Discussion: ChatGPT's performance demonstrates the potential for this technology in health care, although also its limitations in its current state.

PubMed Disclaimer

Conflict of interest statement

Potential competing interests: JRGB has served as a consultant for Medtronic. The other authors disclose no relevant conflicts of interest.

Figures

Figure 1.
Figure 1.
Appropriateness (A) and specificity (B) of ChatGPT responses to prompts regarding GERD management, overall and by category.
Figure 2.
Figure 2.
Patient comprehension (A) and perceived usefulness (B) of ChatGPT responses to prompts regarding GERD management, overall and by category.
See this image and copyright information in PMC

References

    1. El-Serag HB, Sweet S, Winchester CC, Dent J. Update on the epidemiology of gastro-oesophageal reflux disease: a systematic review. Gut. 2014;63(6):871–880. - PMC - PubMed
    1. Gyawali CP, Kahrilas PJ, Savarino E, et al. Modern diagnosis of GERD: the Lyon Consensus. Gut. 2018;67(7):1351–1362. - PMC - PubMed
    1. Introducing ChatGPT. Accessed March 29, 2023. https://openai.com/blog/chatgpt
    1. Kung TH, Cheatham M, Medenilla A, et al. Performance of ChatGPT on USMLE: Potential for AI-assisted medical education using large language models. PLOS Digit Health. 2023;2(2):e0000198. - PMC - PubMed
    1. Rogers B, Samanta S, Ghobadi K, et al. Artificial intelligence automates and augments baseline impedance measurements from pH-impedance studies in gastroesophageal reflux disease. J Gastroenterol. 2021;56(1):34–41. - PubMed

Publication types