Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Review
. 2021 May:67:103358.
doi: 10.1016/j.ebiom.2021.103358. Epub 2021 May 4.

Ensuring that biomedical AI benefits diverse populations

James Zou  1 , Londa Schiebinger  2
Affiliations
Review

Ensuring that biomedical AI benefits diverse populations

James Zou et al. EBioMedicine. 2021 May.

Abstract

Artificial Intelligence (AI) can potentially impact many aspects of human health, from basic research discovery to individual health assessment. It is critical that these advances in technology broadly benefit diverse populations from around the world. This can be challenging because AI algorithms are often developed on non-representative samples and evaluated based on narrow metrics. Here we outline key challenges to biomedical AI in outcome design, data collection and technology evaluation, and use examples from precision health to illustrate how bias and health disparity may arise in each stage. We then suggest both short term approaches-more diverse data collection and AI monitoring-and longer term structural changes in funding, publications, and education to address these challenges.

Keywords: Artificial intelligence; Gender; Genetic ancestry; Health disparities; Health policy; Machine learning; Race/ethnicity; Sex.

PubMed Disclaimer

Conflict of interest statement

Declaration of Competing Interest The authors have nothing to disclose.

References

    1. Tran BX, Vu GT, Ha GH. Global evolution of research in artificial intelligence in health and medicine: a bibliometric study. J Clin Med. 2019;8(3):360. - PMC - PubMed
    1. Krause J, Gulshan V, Rahimy E. Grader variability and the importance of reference standards for evaluating machine learning models for diabetic retinopathy. Ophthalmology. 2018;125(8):1264–1272. - PubMed
    1. Haque A, Milstein A, Fei-Fei L. Illuminating the dark spaces of healthcare with ambient intelligence. Nature. 2020;585(7824):193–202. - PubMed
    1. Hannun AY, Rajpurkar P, Haghpanahi M, Tison GH, Bourn C, Turakhia MP, Ng AY. Cardiologist-level arrhythmia detection and classification in ambulatory electrocardiograms using a deep neural network. Nat Med. 2019;25(1):65. - PMC - PubMed
    1. Colvonen PJ, DeYoung PN, Bosompra NO, Owens RL. Limiting racial disparities and bias for wearable devices in health science research. Sleep. 2020 - PMC - PubMed

LinkOut - more resources