AGI Safety Literature Review

AGI Safety Literature Review

Tom Everitt, Gary Lea, Marcus Hutter

Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence
Survey track. Pages 5441-5449. https://doi.org/10.24963/ijcai.2018/768

The development of Artificial General Intelligence (AGI) promises to be a major event. Along with its many potential benefits, it also raises serious safety concerns. The intention of this paper is to provide an easily accessible and up-to-date collection of references for the emerging field of AGI safety. A significant number of safety problems for AGI have been identified. We list these, and survey recent research on solving them. We also cover works on how best to think of AGI from the limited knowledge we have today, predictions for when AGI will first be created, and what will happen after its creation. Finally, we review the current public policy on AGI.
Keywords:
Machine Learning: Reinforcement Learning
Multidisciplinary Topics and Applications: Philosophical and Ethical Issues
Humans and AI: Ethical Issues in AI