Managing extreme AI risks amid rapid progress

Yoshua Bengio¹, Geoffrey Hinton^{2

3}, Andrew Yao⁴, Dawn Song⁵, Pieter Abbeel⁵, Trevor Darrell⁵, Yuval Noah Harari⁶, Ya-Qin Zhang⁷, Lan Xue⁸, Shai Shalev-Shwartz⁹, Gillian Hadfield^{3

10

11}, Jeff Clune^{3

12}, Tegan Maharaj^{3

11

13}, Frank Hutter^{14

15}, Atılım Güneş Baydin¹⁶, Sheila McIlraith^{2

3

11}, Qiqi Gao¹⁷, Ashwin Acharya¹⁸, David Krueger¹⁹, Anca Dragan⁵, Philip Torr²⁰, Stuart Russell⁵, Daniel Kahneman²¹, Jan Brauner^{16

18}, Sören Mindermann^{1

16}

Affiliations

¹ Mila-Quebec AI Institute, Université de Montréal, Montreal, QC, Canada.
² Department of Computer Science, University of Toronto, Toronto, ON, Canada.
³ Vector Institute, Toronto, ON, Canada.
⁴ Institute for Interdisciplinary Information Sciences, Tsinghua University, Beijing, China.
⁵ Department of Electrical Engineering and Computer Science, University of California, Berkeley, Berkeley, CA, USA.
⁶ Department of History, The Hebrew University of Jerusalem, Jerusalem, Israel.
⁷ Institute for AI Industry Research (AIR), Tsinghua University, Beijing, China.
⁸ Institute for AI International Governance, Tsinghua University, Beijing, China.
⁹ School of Computer Science and Engineering, The Hebrew University of Jerusalem, Jerusalem, Israel.
¹⁰ Faculty of Law, University of Toronto, Toronto, ON, Canada.
¹¹ Schwartz Reisman Institute for Technology and Society, University of Toronto, Toronto, ON, Canada.
¹² Computer Science Department, University of British Columbia, Vancouver, BC, Canada.
¹³ Faculty of Information, University of Toronto, Toronto, ON, Canada.
¹⁴ ELLIS Institute Tübingen, Tübingen, Germany.
¹⁵ Department of Computer Science, University of Freiburg, Freiburg, Germany.
¹⁶ Department of Computer Science, University of Oxford, Oxford, UK.
¹⁷ Institute of Political Science, East China University of Political Science and Law, Shanghai, China.
¹⁸ RAND Corporation, Santa Monica, CA, USA.
¹⁹ Department of Engineering, University of Cambridge, Cambridge, UK.
²⁰ Department of Engineering Science, University of Oxford, Oxford, UK.
²¹ School of Public and International Affairs, Princeton University, Princeton, NJ, USA.

PMID: 38768279
DOI: 10.1126/science.adn0117

Managing extreme AI risks amid rapid progress

Yoshua Bengio et al. Science. 2024.

. 2024 May 24;384(6698):842-845.

doi: 10.1126/science.adn0117. Epub 2024 May 20.

Authors

Affiliations

¹ Mila-Quebec AI Institute, Université de Montréal, Montreal, QC, Canada.
² Department of Computer Science, University of Toronto, Toronto, ON, Canada.
³ Vector Institute, Toronto, ON, Canada.
⁴ Institute for Interdisciplinary Information Sciences, Tsinghua University, Beijing, China.
⁵ Department of Electrical Engineering and Computer Science, University of California, Berkeley, Berkeley, CA, USA.
⁶ Department of History, The Hebrew University of Jerusalem, Jerusalem, Israel.
⁷ Institute for AI Industry Research (AIR), Tsinghua University, Beijing, China.
⁸ Institute for AI International Governance, Tsinghua University, Beijing, China.
⁹ School of Computer Science and Engineering, The Hebrew University of Jerusalem, Jerusalem, Israel.
¹⁰ Faculty of Law, University of Toronto, Toronto, ON, Canada.
¹¹ Schwartz Reisman Institute for Technology and Society, University of Toronto, Toronto, ON, Canada.
¹² Computer Science Department, University of British Columbia, Vancouver, BC, Canada.
¹³ Faculty of Information, University of Toronto, Toronto, ON, Canada.
¹⁴ ELLIS Institute Tübingen, Tübingen, Germany.
¹⁵ Department of Computer Science, University of Freiburg, Freiburg, Germany.
¹⁶ Department of Computer Science, University of Oxford, Oxford, UK.
¹⁷ Institute of Political Science, East China University of Political Science and Law, Shanghai, China.
¹⁸ RAND Corporation, Santa Monica, CA, USA.
¹⁹ Department of Engineering, University of Cambridge, Cambridge, UK.
²⁰ Department of Engineering Science, University of Oxford, Oxford, UK.
²¹ School of Public and International Affairs, Princeton University, Princeton, NJ, USA.

PMID: 38768279
DOI: 10.1126/science.adn0117

Abstract

Preparation requires technical research and development, as well as adaptive, proactive governance.

PubMed Disclaimer

Comment in

Artificial intelligence for neurodiversity.
Li LZ, Yang P. Li LZ, et al. BMJ. 2024 Jul 3;386:q1384. doi: 10.1136/bmj.q1384. BMJ. 2024. PMID: 38960624 No abstract available.

References

LinkOut - more resources

Full Text Sources
- Atypon
- Ovid Technologies, Inc.

Save citation to file

Email citation

Add to Collections

Add to My Bibliography

Your saved search

Create a file for external citation management software

Your RSS Feed

Managing extreme AI risks amid rapid progress

Affiliations

Managing extreme AI risks amid rapid progress

Authors

Affiliations

Abstract

Comment in

References

LinkOut - more resources

Full Text Sources