Machine behaviour
- PMID: 31019318
- DOI: 10.1038/s41586-019-1138-y
Machine behaviour
Abstract
Machines powered by artificial intelligence increasingly mediate our social, cultural, economic and political interactions. Understanding the behaviour of artificial intelligence systems is essential to our ability to control their actions, reap their benefits and minimize their harms. Here we argue that this necessitates a broad scientific research agenda to study machine behaviour that incorporates and expands upon the discipline of computer science and includes insights from across the sciences. We first outline a set of questions that are fundamental to this emerging field and then explore the technical, legal and institutional constraints on the study of machine behaviour.
Comment in
-
Machine behaviour is old wine in new bottles.Nature. 2019 Oct;574(7777):176. doi: 10.1038/d41586-019-03002-8. Nature. 2019. PMID: 31595073 No abstract available.
References
-
- Simon, H. A. The Sciences of the Artificial (MIT Press, Cambridge, 1969). Simon asks whether there can be a science of the ‘artificial’ that produces knowledge about artificial objects and phenomena.
-
- Milner, R. A modal characterisation of observable machine-behaviour. In Trees in Algebra and Programming, 6th Colloquium 25–34 (Springer, 1981). In this invited lecture, Robin Milner outlines the idea of studying machine behaviour using formal logic.
-
- Thomaz, A. L. & Breazeal, C. Teachable robots: understanding human teaching behavior to build more effective robot learners. Artif. Intell. 172, 716–737 (2008).
-
- Stone, P. et al. Artificial Intelligence and Life in 2030. One Hundred Year Study on Artificial Intelligence: Report of the 2015–2016 Study Panel https://ai100.stanford.edu/2016-report (Stanford University, 2016).
-
- O’Neil, C. Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy (Broadway Books, 2016). This book articulates some of the risks posed by the uncritical use of algorithms in society and provides motivation for the study of machine behaviour.