Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2023 Sep 1;177(9):977-979.
doi: 10.1001/jamapediatrics.2023.2373.

Performance of a Large Language Model on Practice Questions for the Neonatal Board Examination

Kristyn Beam  1 , Puneet Sharma  2 , Bhawesh Kumar  3 , Cindy Wang  4 , Dara Brodsky  1 , Camilia R Martin  5 , Andrew Beam  6
Affiliations

Performance of a Large Language Model on Practice Questions for the Neonatal Board Examination

Kristyn Beam et al. JAMA Pediatr. .
No abstract available

Plain language summary

This Diagnostic/Prognostic Study evaluates the performance of a large language model in generating answers to practice questions for the neonatal-perinatal board examination.

PubMed Disclaimer

Conflict of interest statement

Conflict of Interest Disclosures: None reported.

References

    1. Schulman J, Zoph B, Kim C, et al. . ChatGPT: optimizing language models for dialogue. OpenAI . Published November 30, 2022. Accessed February 28, 2023. https://chat.openai.com
    1. Levine DM, Tuwani R, Kompa B, et al. . The diagnostic and triage accuracy of the gpt-3 artificial intelligence model. medRxiv. Published online February 1, 2023. doi:10.1101/2023.01.30.23285067 - DOI - PubMed
    1. Kung TH, Cheatham M, Medinilla A, et al. . Performance of ChatGPT on USMLE: potential for AI-assisted medical education using large language models. PLOS Digit Health. 2023;2(2):e0000198. doi:10.1371/journal.pdig.0000198 - DOI - PMC - PubMed
    1. Morton S, Ehret D, Ghanta S, Sajti E, Walsh B. In: Brodsky D, Martin CR, eds. Neonatology Review: Q & A. 3rd ed. Lulu; 2015.
    1. Singhal K, Azizi S, Tu T, et al. . Large language models encode clinical knowledge. arXiv. Published online December 26, 2022. https://arxiv.org/abs/2212.13138

Publication types