Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2021;36(3):705-713.
doi: 10.1007/s00146-020-01085-w. Epub 2020 Oct 22.

Artificial intelligence in medicine and the disclosure of risks

Maximilian Kiener  1
Affiliations

Artificial intelligence in medicine and the disclosure of risks

Maximilian Kiener. AI Soc. 2021.

Abstract

This paper focuses on the use of 'black box' AI in medicine and asks whether the physician needs to disclose to patients that even the best AI comes with the risks of cyberattacks, systematic bias, and a particular type of mismatch between AI's implicit assumptions and an individual patient's background situation. Pace current clinical practice, I argue that, under certain circumstances, these risks do need to be disclosed. Otherwise, the physician either vitiates a patient's informed consent or violates a more general obligation to warn him about potentially harmful consequences. To support this view, I argue, first, that the already widely accepted conditions in the evaluation of risks, i.e. the 'nature' and 'likelihood' of risks, speak in favour of disclosure and, second, that principled objections against the disclosure of these risks do not withstand scrutiny. Moreover, I also explain that these risks are exacerbated by pandemics like the COVID-19 crisis, which further emphasises their significance.

Keywords: Artificial intelligence; COVID-19; Informed consent; Medical disclosure; Risks.

PubMed Disclaimer

Conflict of interest statement

Conflict of interestThe author declares that they have no competing of interest.

Similar articles

See all similar articles

Cited by

See all "Cited by" articles

References

    1. Aczon M, Ledbetter D, Ho L, Gunny A, Flynn A, Williams J, Wetzel R (2017) Dynamic mortality risk predictions in pediatric critical care using recurrent neural networks. arXiv preprint arXiv:170106675
    1. Adadi A, Berrada M. Peeking inside the black-box: a survey on explainable artificial intelligence (XAI) IEEE Access. 2018;6:52138–52160. doi: 10.1109/access.2018.2870052. - DOI
    1. Argaw ST, Bempong N-E, Eshaya-Chauvin B, Flahault A. The state of research on cyberattacks against hospitals and available best practice recommendations: a scoping review. BMC Med Inform Decis Mak. 2019;19:1–11. doi: 10.1186/s12911-018-0724-5. - DOI - PMC - PubMed
    1. Arshadi K, Salem M, Collins J, Yuan JS, Chakrabarti D. DeepMalaria: artificial intelligence driven discovery of potent antiplasmodials. Front Pharmacol. 2020;10:1526. doi: 10.3389/fphar.2019.01526. - DOI - PMC - PubMed
    1. Bates DW, Saria S, Ohno-Machado L, Shah A, Escobar G. Big data in health care: using analytics to identify and manage high-risk and high-cost patients. Health Aff. 2014;33:1123–1131. doi: 10.1377/hlthaff.2014.0041. - DOI - PubMed
Legal Cases
    1. Montgomery v Lanarkshire Health Board (2015) UKSC 11
    1. Gilmartin v Weinreb (1999) 735 A.2d 620 (N.J. Super. Ct. App. Div.)
    1. Battenfeld v Gregory (1991) 589 A.2d 1059 (N.J. Super.)
    1. Jones v Papp (1989) 782 S.W.2d 236 (Tex. App.)
    1. Barclay v Campbell (1987) 683 S.W.2d 498 (Tex. App.)

LinkOut - more resources