Foresight for ethical AI
- PMID: 37547230
- PMCID: PMC10399218
- DOI: 10.3389/frai.2023.1143907
Foresight for ethical AI
Abstract
There is growing expectation that artificial intelligence (AI) developers foresee and mitigate harms that might result from their creations; however, this is exceptionally difficult given the prevalence of emergent behaviors that occur when integrating AI into complex sociotechnical systems. We argue that Naturalistic Decision Making (NDM) principles, models, and tools are well-suited to tackling this challenge. Already applied in high-consequence domains, NDM tools such as the premortem, and others, have been shown to uncover a reasonable set of risks of underlying factors that would lead to ethical harms. Such NDM tools have already been used to develop AI that is more trustworthy and resilient, and can help avoid unintended consequences of AI built with noble intentions. We present predictive policing algorithms as a use case, highlighting various factors that led to ethical harms and how NDM tools could help foresee and mitigate such harms.
Keywords: artificial intelligence; ethics; foresight; naturalistic decision making; policy; premortem.
Copyright © 2023 The MITRE Corporation.
Conflict of interest statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
-
- Alikhademi K., Drobina E., Prioleau D., Richardson B., Purves D., Gilbert J. E., et al. . (2021). A review of predictive policing from the perspective of fairness. Artif. Intell. Law 30, 1–17. 10.1007/s10506-021-09286-4 - DOI
-
- Asaro P. M. (2019). AI ethics in predictive policing: from models of threat to ethics of care. IEEE Technol. Soc. Mag. 38, 40–53. 10.1109/MTS.2019.2915154 - DOI
-
- Bettin B., Steelman K., Wallace C., Pontious D., Veinott E. (2022). Identifying and addressing risks in the early design of a sociotechnical system through premortem. Proc. 2022 HFES 66th Ann. Meet. 66, 1514–1518. 10.1177/1071181322661307 - DOI
-
- Blasch E., Sung J., Nguyen T. (2021). Multisource ai scorecard table for system evaluation. arXiv. [preprint] 2102.03985. 10.48550/arXiv.2102.03985 - DOI
LinkOut - more resources
Full Text Sources
