ChatGPT passing USMLE shines a spotlight on the flaws of medical education

Amarachi B Mbakwe¹, Ismini Lourentzou¹, Leo Anthony Celi^{2

3

4}, Oren J Mechanic^{5

6

7}, Alon Dagan⁸

Affiliations

¹ Department of Computer Science, Virginia Tech, Blacksburg, Virginia, United States of America.
² Institute for Medical Engineering and Science, Massachusetts Institute of Technology, Cambridge, Massachusetts, United States of America.
³ Department of Medicine, Beth Israel Deaconess Medical Center, Beth Israel Deaconess Medical Center, Boston, Massachusetts, United States of America.
⁴ Department of Biostatistics, Harvard T.H. Chan School of Public Health, Boston, Massachusetts, United States of America.
⁵ eMed Digital Healthcare, Miami, Florida, United States of America.
⁶ Department of Emergency Medicine, Mount Sinai Medical Center, Miami Beach, Florida, United States of America.
⁷ Department of Emergency Medicine and Critical Care, Herbert Wertheim College of Medicine at Florida International University, Miami, Florida, United States of America.
⁸ Department of Emergency Medicine, Beth Israel Deaconess Medical Center, Boston, Massachusetts, United States of America.

Editorial

Amarachi B Mbakwe et al. PLOS Digit Health. 2023.

. 2023 Feb 9;2(2):e0000205.

doi: 10.1371/journal.pdig.0000205. eCollection 2023 Feb.

Amarachi B Mbakwe¹, Ismini Lourentzou¹, Leo Anthony Celi^{2

3

4}, Oren J Mechanic^{5

6

7}, Alon Dagan⁸

¹ Department of Computer Science, Virginia Tech, Blacksburg, Virginia, United States of America.
² Institute for Medical Engineering and Science, Massachusetts Institute of Technology, Cambridge, Massachusetts, United States of America.
³ Department of Medicine, Beth Israel Deaconess Medical Center, Beth Israel Deaconess Medical Center, Boston, Massachusetts, United States of America.
⁴ Department of Biostatistics, Harvard T.H. Chan School of Public Health, Boston, Massachusetts, United States of America.
⁵ eMed Digital Healthcare, Miami, Florida, United States of America.
⁶ Department of Emergency Medicine, Mount Sinai Medical Center, Miami Beach, Florida, United States of America.
⁷ Department of Emergency Medicine and Critical Care, Herbert Wertheim College of Medicine at Florida International University, Miami, Florida, United States of America.
⁸ Department of Emergency Medicine, Beth Israel Deaconess Medical Center, Boston, Massachusetts, United States of America.

No abstract available

Conflict of interest statement

Leo Anthony Celi is the Editor-in Chief of PLOS Digital Health.

1. Varanasi Lakshmi. ChatGPT is on its way to becoming a virtual doctor, lawyer, and business analyst. Here’s a list of advanced exams the AI bot has passed so far. Businessinsider. 2023. Available from: https://www.businessinsider.com/list-here-are-the-exams-chatgpt-has-pass...
1. Kung TH, Cheatham M, Medenilla A, Sillos C, De Leon L, Elepaño C, et al.. (2023) Performance of ChatGPT on USMLE: Potential for AI-assisted medical education using large language models. PLOS Digit Health 2(2): e0000198. doi: 10.1371/journal.pdig.0000198 - DOI - PMC - PubMed
1. United States Medical Licensing Examination (USMLE). Available from: https://www.usmle.org/
1. Data shows racial disparities in Alzheimer’s disease diagnosis between black and white research study participants. National institute of health 2021. Available from: https://www.nia.nih.gov/news/data-shows-racial-disparities-alzheimers-di...
1. Chicago pd predictive policing heat list. THE VERGE 2021. Available from: https://www.theverge.com/c/22444020/chicago-pd-predictive-policing-heat-...