Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2025 May 7;32(1):45.
doi: 10.1186/s12929-025-01131-z.

Impact of large language model (ChatGPT) in healthcare: an umbrella review and evidence synthesis

Usman Iqbal  1   2 , Afifa Tanweer  3 , Annisa Ristya Rahmanti  4   5 , David Greenfield  6 , Leon Tsung-Ju Lee  7   8   9 , Yu-Chuan Jack Li  10   11   12
Affiliations

Impact of large language model (ChatGPT) in healthcare: an umbrella review and evidence synthesis

Usman Iqbal et al. J Biomed Sci. .

Abstract

Background: The emergence of Artificial Intelligence (AI), particularly Chat Generative Pre-Trained Transformer (ChatGPT), a Large Language Model (LLM), in healthcare promises to reshape patient care, clinical decision-making, and medical education. This review aims to synthesise research findings to consolidate the implications of ChatGPT integration in healthcare and identify research gaps.

Main body: The umbrella review was conducted following Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. The Cochrane Library, PubMed, Scopus, Web of Science, and Google Scholar were searched from inception until February 2024. Due to the heterogeneity of the included studies, no quantitative analysis was performed. Instead, information was extracted, summarised, synthesised, and presented in a narrative form. Two reviewers undertook title, abstract, and full text screening independently. The methodological quality and overall rating of the included reviews were assessed using the A Measurement Tool to Assess systematic Reviews (AMSTAR-2) checklist. The review examined 17 studies, comprising 15 systematic reviews and 2 meta-analyses, on ChatGPT in healthcare, revealing diverse focuses. The AMSTAR-2 assessment identified 5 moderate and 12 low-quality reviews, with deficiencies like study design justification and funding source reporting. The most reported theme that emerged was ChatGPT's use in disease diagnosis or clinical decision-making. While 82.4% of studies focused on its general usage, 17.6% explored unique topics like its role in medical examinations and conducting systematic reviews. Among these, 52.9% targeted general healthcare, with 41.2% focusing on specific domains like radiology, neurosurgery, gastroenterology, public health dentistry, and ophthalmology. ChatGPT's use for manuscript review or writing was mentioned in 17.6% of reviews. Promising applications include enhancing patient care and clinical decision-making, though ethical, legal, and accuracy concerns require cautious integration.

Conclusion: We summarise the identified areas in reviews regarding ChatGPT's transformative impact in healthcare, highlighting patient care, decision-making, and medical education. Emphasising the importance of ethical regulations and the involvement of policymakers, we urge further investigation to ensure the reliability of ChatGPT and to promote trust in healthcare and research.

Keywords: ChatGPT; Large language models (LLMs); Consumer health; Evidence synthesis; Generative AI; Healthcare; Medical research; Medical education; Patient care; Reviews.

PubMed Disclaimer

Conflict of interest statement

Declarations. Ethics approval and consent to participate: Not applicable. Consent for publication: Not applicable. Competing interests: The authors declare that they have no competing interests.

Figures

Fig. 1
Fig. 1
PRISMA flow diagram representing the inclusion of systematic reviews and meta-analysis
See this image and copyright information in PMC

Similar articles

See all similar articles

Cited by

References

    1. Ashraf H, Ashfaq H. The role of ChatGPT in medical research: progress and limitations. Ann Biomed Eng. 2023. 10.1007/s10439-023-03311-0. - PubMed
    1. Bagde H, Dhopte A, Alam MK, Basri R. A systematic review and meta-analysis on ChatGPT and its utilization in medical and dental research. Heliyon. 2023;9(12): e23050. 10.1016/j.heliyon.2023.e23050. - PMC - PubMed
    1. Bečulić H, Begagić E, Skomorac R, Mašović A, Selimović E, Pojskić M. 2024. ChatGPT’s contributions to the evolution of neurosurgical practice and education: A systematic review of benefits, concerns and limitations. Medicinski Glasnik Ljekarske Komore Zenicko-Dobojskog Kantona. 10.17392/1661-23 - PubMed
    1. Bera K, O’Connor G, Jiang S, Tirumani SH, Ramaiya N. Analysis of ChatGPT publications in radiology: literature so far. Curr Probl Diagn Radiol. 2024;53(2):215–25. 10.1067/j.cpradiol.2023.10.013. - PubMed
    1. Bugaj M, Kliestik T, Lăzăroiu G. Generative artificial intelligence-based diagnostic algorithms in disease risk detection, in personalized and targeted healthcare procedures, and in patient care safety and quality. Contemp Read Law Soc Justice. 2023;15(1):9–26.

Publication types