Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2024 Dec 24:26:e59843.
doi: 10.2196/59843.

Large Language Models May Help Patients Understand Peer-Reviewed Scientific Articles About Ophthalmology: Development and Usability Study

Reza Kianian #  1 , Deyu Sun #  1 , William Rojas-Carabali #  2   3   4 , Rupesh Agrawal #  2   3   4 , Edmund Tsui #  1
Affiliations

Large Language Models May Help Patients Understand Peer-Reviewed Scientific Articles About Ophthalmology: Development and Usability Study

Reza Kianian et al. J Med Internet Res. .

Abstract

Background: Adequate health literacy has been shown to be important for the general health of a population. To address this, it is recommended that patient-targeted medical information is written at a sixth-grade reading level. To make well-informed decisions about their health, patients may want to interact directly with peer-reviewed open access scientific articles. However, studies have shown that such text is often written with highly complex language above the levels that can be comprehended by the general population. Previously, we have published on the use of large language models (LLMs) in easing the readability of patient-targeted health information on the internet. In this study, we continue to explore the advantages of LLMs in patient education.

Objective: This study aimed to explore the use of LLMs, specifically ChatGPT (OpenAI), to enhance the readability of peer-reviewed scientific articles in the field of ophthalmology.

Methods: A total of 12 open access, peer-reviewed papers published by the senior authors of this study (ET and RA) were selected. Readability was assessed using the Flesch-Kincaid Grade Level and Simple Measure of Gobbledygook tests. ChatGPT 4.0 was asked "I will give you the text of a peer-reviewed scientific paper. Considering that the recommended readability of the text is 6th grade, can you simplify the following text so that a layperson reading this text can fully comprehend it? - Insert Manuscript Text -". Appropriateness was evaluated by the 2 uveitis-trained ophthalmologists. Statistical analysis was performed in Microsoft Excel.

Results: ChatGPT significantly lowered the readability and length of the selected papers from 15th to 7th grade (P<.001) while generating responses that were deemed appropriate by expert ophthalmologists.

Conclusions: LLMs show promise in improving health literacy by enhancing the accessibility of peer-reviewed scientific articles and allowing the general population to interact directly with medical literature.

Keywords: ChatGPT; LLMs; artificial intelligence; health literacy; large language models; medical information; ophthalmology; patient education; peer review; readability; uveitis.

PubMed Disclaimer

Conflict of interest statement

Conflicts of Interest: ET is a consultant for Kowa, Cylite, Oculis, and Eyepoint Pharmaceuticals.

References

    1. Benjamin RM. Improving health by improving health literacy. Public Health Rep. 2010;125(6):784–5. doi: 10.1177/003335491012500602. https://europepmc.org/abstract/MED/21121221 - DOI - PMC - PubMed
    1. Rooney MK, Santiago G, Perni S, Horowitz DP, McCall AR, Einstein AJ, Jagsi R, Golden DW. Readability of patient education materials from high-impact medical journals: a 20-year analysis. J Patient Exp. 2021;8:2374373521998847. doi: 10.1177/2374373521998847. https://journals.sagepub.com/doi/abs/10.1177/2374373521998847?url_ver=Z3... 10.1177_2374373521998847 - DOI - PMC - PubMed
    1. Berkman ND, Sheridan SL, Donahue KE, Halpern DJ, Crotty K. Low health literacy and health outcomes: an updated systematic review. Ann Intern Med. 2011 Jul 19;155(2):97–107. doi: 10.7326/0003-4819-155-2-201107190-00005.155/2/97 - DOI - PubMed
    1. Coughlin SS, Vernon M, Hatzigeorgiou C, George V. Health literacy, social determinants of health, and disease prevention and control. J Environ Health Sci. 2020;6(1):1–10. https://europepmc.org/abstract/MED/33604453 3061 - PMC - PubMed
    1. Abu-Heija A, Shatta M, Ajam M, Abu-Heija U, Imran N, Levine D. Quantitative readability assessment of the internal medicine online patient information on Annals.org. Cureus. 2019 Mar 06;11(3):e4184. doi: 10.7759/cureus.4184. https://europepmc.org/abstract/MED/31106084 - DOI - PMC - PubMed

Publication types

LinkOut - more resources