Accuracy of ChatGPT in Common Gastrointestinal Diseases: Impact for Patients and Providers

Abstract

Since its release in 2022, Chat Generative Pre-Trained Transformer (ChatGPT) became the most rapidly expanding consumer software application in history,¹ and its role in medicine is underscored by its potential to enhance patient education and physician-patient communication. Previous studies in gastroenterology and hepatology have focused primarily on the earlier Generative Pre-Trained Transformer 3 (GPT-3) model, with none investigating ChatGPT's ability to generate supportive references for its responses, or its applicability as a physician educational tool.^2-6 Our study evaluated the accuracy of the more recent ChatGPT, powered by GPT-4, in addressing frequently asked questions by patients on irritable bowel syndrome (IBS), inflammatory bowel disease (IBD), colonoscopy and colorectal cancer (CRC) screening, questions on CRC screening from a physician perspective, and reference generation and suitability.