Bibliometric top ten healthcare-related ChatGPT publications in the first ChatGPT anniversary
- PMID: 39280327
- PMCID: PMC11391998
- DOI: 10.52225/narra.v4i2.917
Bibliometric top ten healthcare-related ChatGPT publications in the first ChatGPT anniversary
Abstract
Since its public release on November 30, 2022, ChatGPT has shown promising potential in diverse healthcare applications despite ethical challenges, privacy issues, and possible biases. The aim of this study was to identify and assess the most influential publications in the field of ChatGPT utility in healthcare using bibliometric analysis. The study employed an advanced search on three databases, Scopus, Web of Science, and Google Scholar, to identify ChatGPT-related records in healthcare education, research, and practice between November 27 and 30, 2023. The ranking was based on the retrieved citation count in each database. The additional alternative metrics that were evaluated included (1) Semantic Scholar highly influential citations, (2) PlumX captures, (3) PlumX mentions, (4) PlumX social media and (5) Altmetric Attention Scores (AASs). A total of 22 unique records published in 17 different scientific journals from 14 different publishers were identified in the three databases. Only two publications were in the top 10 list across the three databases. Variable publication types were identified, with the most common being editorial/commentary publications (n=8/22, 36.4%). Nine of the 22 records had corresponding authors affiliated with institutions in the United States (40.9%). The range of citation count varied per database, with the highest range identified in Google Scholar (1019-121), followed by Scopus (242-88), and Web of Science (171-23). Google Scholar citations were correlated significantly with the following metrics: Semantic Scholar highly influential citations (Spearman's correlation coefficient ρ=0.840, p<0.001), PlumX captures (ρ=0.831, p<0.001), PlumX mentions (ρ=0.609, p=0.004), and AASs (ρ=0.542, p=0.009). In conclusion, despite several acknowledged limitations, this study showed the evolving landscape of ChatGPT utility in healthcare. There is an urgent need for collaborative initiatives by all stakeholders involved to establish guidelines for ethical, transparent, and responsible use of ChatGPT in healthcare. The study revealed the correlation between citations and alternative metrics, highlighting its usefulness as a supplement to gauge the impact of publications, even in a rapidly growing research field.
Keywords: ChatGPT in healthcare; bibliometric analysis; citation metric; generative AI in healthcare; publication impact.
© 2024 The Author(s).
Conflict of interest statement
The authors declare that there are no conflicts of interest.
Figures

Similar articles
-
Assessing the Dissemination of COVID-19 Articles Across Social Media With Altmetric and PlumX Metrics: Correlational Study.J Med Internet Res. 2021 Jan 14;23(1):e21408. doi: 10.2196/21408. J Med Internet Res. 2021. Retraction in: J Med Internet Res. 2022 Aug 10;24(8):e41544. doi: 10.2196/41544. PMID: 33406049 Free PMC article. Retracted.
-
THE ASSOCIATION BETWEEN ALTMETRIC, PLUMX METRICS AND CITATION COUNT OF PUBLICATIONS: A CROSS-SECTIONAL STUDY AMONG TOP CHILD AND ADOLESCENT PSYCHIATRY JOURNALS.Psychiatr Danub. 2023 Summer;35(2):220-225. doi: 10.24869/psyd.2023.220. Psychiatr Danub. 2023. PMID: 37480309
-
Croatian Medical Journal citation score in Web of Science, Scopus, and Google Scholar.Croat Med J. 2010 Apr;51(2):99-103. doi: 10.3325/cmj.2010.51.99. Croat Med J. 2010. PMID: 20401951 Free PMC article.
-
A Bibliometric Analysis of the Rise of ChatGPT in Medical Research.Med Sci (Basel). 2023 Sep 17;11(3):61. doi: 10.3390/medsci11030061. Med Sci (Basel). 2023. PMID: 37755165 Free PMC article. Review.
-
The 100 top-cited publications in psoriatic arthritis: a bibliometric analysis.Int J Dermatol. 2019 Sep;58(9):1023-1034. doi: 10.1111/ijd.14261. Epub 2018 Oct 12. Int J Dermatol. 2019. PMID: 30315571 Review.
Cited by
-
Human versus Artificial Intelligence: ChatGPT-4 Outperforming Bing, Bard, ChatGPT-3.5 and Humans in Clinical Chemistry Multiple-Choice Questions.Adv Med Educ Pract. 2024 Sep 20;15:857-871. doi: 10.2147/AMEP.S479801. eCollection 2024. Adv Med Educ Pract. 2024. PMID: 39319062 Free PMC article.
-
ChatGPT Performance in Diagnostic Clinical Microbiology Laboratory-Oriented Case Scenarios.Cureus. 2023 Dec 16;15(12):e50629. doi: 10.7759/cureus.50629. eCollection 2023 Dec. Cureus. 2023. PMID: 38107211 Free PMC article.
-
A multinational study on the factors influencing university students' attitudes and usage of ChatGPT.Sci Rep. 2024 Jan 23;14(1):1983. doi: 10.1038/s41598-024-52549-8. Sci Rep. 2024. PMID: 38263214 Free PMC article.
-
Chinese generative AI models (DeepSeek and Qwen) rival ChatGPT-4 in ophthalmology queries with excellent performance in Arabic and English.Narra J. 2025 Apr;5(1):e2371. doi: 10.52225/narra.v5i1.2371. Epub 2025 Apr 8. Narra J. 2025. PMID: 40352182 Free PMC article.
References
-
- Gruetzemacher R, Whittlestone J.. The transformative potential of artificial intelligence. Futures 2022;135:102884.
-
- Mijwil M, Doshi R, Hiran K, et al. . The effect of human-computer interaction on new applications by exploring the use case of ChatGPT in healthcare services. In: Hiran KK, Doshi R, Patel M, editors. Modern technology in healthcare and medical education: Blockchain, IoT, AR, and VR. Hershey, PA:IGI Global;2024.
MeSH terms
LinkOut - more resources
Full Text Sources