Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2024 Mar;94(3):353-355.
doi: 10.1111/ans.18834. Epub 2023 Dec 22.

Evaluation of a chat GPT generated patient information leaflet about laparoscopic cholecystectomy

Elizabeth Lockie  1   2 , Julian Choi  1   3
Affiliations

Evaluation of a chat GPT generated patient information leaflet about laparoscopic cholecystectomy

Elizabeth Lockie et al. ANZ J Surg. 2024 Mar.

Abstract

Background: Artificial intelligence is increasingly being used in all aspects of life in information compilation and writing, and this includes healthcare. This study aimed to evaluate a Chat GPT generated patient information leaflet (PIL) against a surgeon generated version, in order to explore a potential application of this artificial intelligence language processing model.

Methods: Cross-sectional study, undertaken May to June 2023, asking two cohorts (patients and doctors) to complete a questionnaire evaluating a Chat GPT generated PIL and a surgeon generated PIL about laparoscopic cholecystectomy. The patients were having laparoscopic cholecystectomy at large private Hospital in Melbourne, Australia, and doctors were recruited from this hospital and a public quaternary hospital in Melbourne, Australia. The study included a convenience sample of 28 patients and 16 doctors. The main outcome measure was a questionnaire (maximum score out of 8) based on validated evaluation instrument for PILs.

Results: The study recruited 28 patients and 15 doctors to complete the questionnaire. The Chat GPT and surgeon generated PILs were scored similarly by patients (median 8 for both PIL; mean 7.5 for Chat GPT PIL vs. 7.1 for surgeon PIL). Doctors also scored both versions similarly, with slightly higher scores for Chat GPT over surgeon version (median 7 vs. 6; mean 6.7 vs. 5.6, respectively).

Conclusions: The Chat GPT generated PIL was assessed as being as good or slightly better than the surgeon generated version. This study shows that PIL are a feasible application of AI language processing models.

Keywords: artificial intelligence; general surgery; patient information; surgical education.

PubMed Disclaimer

References

    1. Sallam M. Chat GPT utility in healthcare education, research and practice: systematic review on the promising perspectives and valid concerns. Healthcare (Basel) 2023; 11: 887.
    1. Moult B, Franck L, Brady H. Ensuring quality information for patients: development and preliminary validation of a new instrument of improve the quality of written health care information. Health Expect. 2004; 7: 165-175.
    1. Australian Medical Association. Automated Decision Making and AI Regulation; AMA Submission to the Prime Minister and Cabinet Consultation on Positioning Australia as the Leader in Digital Economy Regulation [PDF on Internet]. Canberra: Australian Medical Association; 2022. [Cited 3 July 2023.] Available from URL: https://www.ama.com.au/sites/default/files/2022-06/AMA%20Submission%20to....

LinkOut - more resources