Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2023 Jun 1;6(6):e2317517.
doi: 10.1001/jamanetworkopen.2023.17517.

Evaluating Artificial Intelligence Responses to Public Health Questions

John W Ayers  1   2 , Zechariah Zhu  1 , Adam Poliak  3 , Eric C Leas  1   4 , Mark Dredze  5 , Michael Hogarth  6   7 , Davey M Smith  2   7
Affiliations

Evaluating Artificial Intelligence Responses to Public Health Questions

John W Ayers et al. JAMA Netw Open. .
No abstract available

Plain language summary

This cross-sectional study analyzes the quality of ChatGPT responses to public health questions.

PubMed Disclaimer

Conflict of interest statement

Conflict of Interest Disclosures: Dr Ayers reported owning equity in Health Watcher and Good Analytics outside the submitted work. Dr Leas reported receiving consulting fees from Good Analytics outside the submitted work. Dr Dredze reported receiving personal fees from Bloomberg LP and Good Analytics outside the submitted work. Dr Hogarth reported being an advisor to and owning equity in LifeLink. Dr Smith reported receiving grants from the National Institutes of Health; receiving consulting fees from Pharma Holdings, Bayer Pharmaceuticals, Evidera, Linear Therapies, and Vx Biosciences; and owning stock options in Model Medicines and FluxErgy outside the submitted work. No other disclosures were reported.

References

    1. Miner AS, Milstein A, Schueller S, Hegde R, Mangurian C, Linos E. Smartphone-based conversational agents and responses to questions about mental health, interpersonal violence, and physical health. JAMA Intern Med. 2016;176(5):619-625. doi:10.1001/jamainternmed.2016.0400 - DOI - PMC - PubMed
    1. Nobles AL, Leas EC, Caputi TL, Zhu SH, Strathdee SA, Ayers JW. Responses to addiction help-seeking from Alexa, Siri, Google Assistant, Cortana, and Bixby intelligent virtual assistants. NPJ Digit Med. 2020;3(1):11. doi:10.1038/s41746-019-0215-9 - DOI - PMC - PubMed
    1. Ayers JW, Poliak A, Dredze M, et al. . Comparing physician and artificial intelligence chatbot responses to patient questions posted to a public social media forum. JAMA Intern Med. Published online April 28, 2023. doi:10.1001/jamainternmed.2023.1838 - DOI - PMC - PubMed
    1. Smith EA, Senter RJ. Automated readability index. 6570th Aerospace Medical Research Laboratory; 1967 AMRL technical report 66-220. Accessed April 28, 2023. https://apps.dtic.mil/sti/pdfs/AD0667273.pdf - PubMed
    1. Ayers JW, Nobles AL, Dredze M. Media trends for the Substance Abuse and Mental Health Services Administration 800-662-HELP addiction treatment referral services after a celebrity overdose. JAMA Intern Med. 2019;179(3):441-442. doi:10.1001/jamainternmed.2018.6562 - DOI - PMC - PubMed

Publication types