Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2024 Sep 21:18:2647-2655.
doi: 10.2147/OPTH.S480222. eCollection 2024.

Comparing the Ability of Google and ChatGPT to Accurately Respond to Oculoplastics-Related Patient Questions and Generate Customized Oculoplastics Patient Education Materials

Samuel A Cohen  1 , Nikhita Yadlapalli  2 , Jonathan D Tijerina  3 , Chrisfouad R Alabiad  3 , Jessica R Chang  4 , Benyam Kinde  5 , Nicholas R Mahoney  6 , Kelsey A Roelofs  1 , Julie A Woodward  7 , Andrea L Kossler  5
Affiliations

Comparing the Ability of Google and ChatGPT to Accurately Respond to Oculoplastics-Related Patient Questions and Generate Customized Oculoplastics Patient Education Materials

Samuel A Cohen et al. Clin Ophthalmol. .

Abstract

Purpose: To compare the accuracy and readability of responses to oculoplastics patient questions provided by Google and ChatGPT. Additionally, to assess the ability of ChatGPT to create customized patient education materials.

Methods: We executed a Google search to identify the 3 most frequently asked patient questions (FAQs) related to 10 oculoplastics conditions. FAQs were entered into both the Google search engine and the ChatGPT tool and responses were recorded. Responses were graded for readability using five validated readability indices and for accuracy by six oculoplastics surgeons. ChatGPT was instructed to create patient education materials at various reading levels for 8 oculoplastics procedures. The accuracy and readability of ChatGPT-generated procedural explanations were assessed.

Results: ChatGPT responses to patient FAQs were written at a significantly higher average grade level than Google responses (grade 15.6 vs 10.0, p < 0.001). ChatGPT responses (93% accuracy) were significantly more accurate (p < 0.001) than Google responses (78% accuracy) and were preferred by expert panelists (79%). ChatGPT accurately explained oculoplastics procedures at an above average reading level. When instructed to rewrite patient education materials at a lower reading level, grade level was reduced by approximately 4 (15.7 vs 11.7, respectively, p < 0.001) without sacrificing accuracy.

Conclusion: ChatGPT has the potential to provide patients with accurate information regarding their oculoplastics conditions. ChatGPT may also be utilized by oculoplastic surgeons as an accurate tool to provide customizable patient education for patients with varying health literacy. A better understanding of oculoplastics conditions and procedures amongst patients can lead to informed eye care decisions.

Keywords: ChatGPT; accuracy; google; oculoplastics; readability.

PubMed Disclaimer

Conflict of interest statement

The authors declare no conflicts of interest.

Similar articles

See all similar articles

Cited by

References

    1. Finney Rutten LJ, Blake KD, Greenberg-Worisek AJ, Allen SV, Moser RP, Hesse BW. Online health information seeking among us adults: measuring progress toward a healthy people 2020 objective. Public Health Rep. 2019;134(6):617–625. doi:10.1177/0033354919874074 - DOI - PMC - PubMed
    1. Drees J Google receives more than 1 billion health questions every day. 2019. Available from: https://www.beckershospitalreview.com/healthcare-information-technology/.... Accessed February 20, 2024.
    1. Cohen SA, Fisher AC, Pershing S. Analysis of the readability and accountability of online patient education materials related to glaucoma diagnosis and treatment. Clin Ophthalmol. 2023;17:779–788. doi:10.2147/OPTH.S401492 - DOI - PMC - PubMed
    1. Cohen SA, Tijerina JD, Kossler A. The readability and accountability of online patient education materials related to common oculoplastics diagnoses and treatments. Semin Ophthalmol. 2023;38(4):387–393. doi:10.1080/08820538.2022.2158039 - DOI - PubMed
    1. Cohen SA, Pershing S. Readability and accountability of online patient education materials for common retinal diseases. Ophthalmol Retina. 2022;6(7):641–643. doi:10.1016/j.oret.2022.03.015 - DOI - PMC - PubMed

LinkOut - more resources