Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2022 Jun 28;11(1):132.
doi: 10.1186/s13643-022-01984-7.

Exponential growth of systematic reviews assessing artificial intelligence studies in medicine: challenges and opportunities

Thilo von Groote #  1 , Narges Ghoreishi #  2 , Maria Björklund  3 , Christian Porschen  4 , Livia Puljak  5
Affiliations

Exponential growth of systematic reviews assessing artificial intelligence studies in medicine: challenges and opportunities

Thilo von Groote et al. Syst Rev. .

Abstract

The evidence-based medicine (EBM) movement is stepping up its efforts to assess medical artificial intelligence (AI) and data science studies. Since 2017, there has been a marked increase in the number of published systematic reviews that assess medical AI studies. Increasingly, data from observational studies are used in systematic reviews of medical AI studies. Assessment of risk of bias is especially important in medical AI studies to detect possible "AI bias".

Keywords: Artificial intelligence; Evidence-based medicine; Systematic reviews.

PubMed Disclaimer

Conflict of interest statement

The authors declare that they have no competing interests.

Figures

Fig. 1
Fig. 1
Medical articles on artificial intelligence (AI), systematic reviews overall, and systematic reviews specifically investigating medical AI studies as a percentage of published articles overall; indexed per year in PubMed and EMBASE, from 2000 to 2021. Supplementary file 1 reports search strategies and software used to retrieve and analyze these records. Supplementary file 2 reports tabular results of the search
Fig. 2
Fig. 2
Medical AI systematic reviews in terms of content: containing a meta-analysis, containing observational studies, and containing randomized controlled studies as a percentage of published articles overall; indexed per year in PubMed and EMBASE, from 2000 to 2021
See this image and copyright information in PMC

References

    1. Topol EJ. High-performance medicine: the convergence of human and artificial intelligence. Nat Med. 2019;25(1):44–56. doi: 10.1038/s41591-018-0300-7. - DOI - PubMed
    1. Meskó B, Görög M. A short guide for medical professionals in the era of artificial intelligence. NPJ Digit Med. 2020;3(1):126. doi: 10.1038/s41746-020-00333-z. - DOI - PMC - PubMed
    1. Ioannidis JPA. Meta-research: why research on research matters. PLoS Biol. 2018;16(3):e2005468. doi: 10.1371/journal.pbio.2005468. - DOI - PMC - PubMed
    1. Challen R, Denny J, Pitt M, Gompels L, Edwards T, Tsaneva-Atanasova K. Artificial intelligence, bias and clinical safety. BMJ Qual Saf. 2019;28(3):231. doi: 10.1136/bmjqs-2018-008370. - DOI - PMC - PubMed
    1. DeBrusk C. The risk of machine-learning bias (and how to prevent it). MIT Sloan Manag Rev. 2018.

Publication types

LinkOut - more resources