{"type":"ScholarlyArticle","title":"Responsible Autonomy","authors":[{"name":"Virginia Dignum","slug":"virginia-dignum","given":"Virginia","family":"Dignum","affiliation":"Delft University of Technology"}],"abstract":"As intelligent systems are increasingly making decisions that directly affect society, perhaps the most important upcoming research direction in AI is to rethink the ethical implications of their actions. Means are needed to integrate moral, societal and legal values with technological developments in AI, both during the design process as well as part of the deliberation algorithms employed by these systems. In this paper, we describe leading ethics theories and propose alternative ways to ensure ethical behavior by artificial systems.  \r\nGiven that ethics are dependent on the socio-cultural context and are often only implicit in deliberation processes, methodologies are needed to elicit the values held by designers and stakeholders, and to make these explicit leading to better understanding and trust on artificial autonomous systems.","doi":"10.24963/ijcai.2017/655","url":"https://ijcai.org/proceedings/2017/655","pdf":"https://ijcai.org/proceedings/2017/0655.pdf","markdown":"https://ijcai.org/proceedings/2017/655.md","bibtex":"https://ijcai.org/proceedings/2017/bibtex/655","volume":{"slug":"2017","title":"Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2017","url":"https://ijcai.org/proceedings/2017/","year":2017,"location":"Melbourne, Australia","dates":"19-25 August 2017","editors":"Carles Sierra","isbn":"978-0-9992411-0-3","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2017"},"section":"AI and autonomy track","track":"AI and autonomy track","number":655,"pages":{"first":4698,"last":4704},"keywords":["Social: Challenges","Philosophical: Concepts","Technical: Models"],"videos":[],"references":[{"position":1,"raw":"[Aldewereld et al., 2010] Huib Aldewereld, S. Álvarez- Napagao, F. Dignum, and J. Vázquez-Salceda. Making norms concrete. In AAMAS'10, pages 807-814, 2010.","title":"Making norms concrete","authors":"S Huib Aldewereld, F Álvarez-Napagao, J Dignum, Vázquez-Salceda","year":"2010","venue":"AAMAS'10","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Allen et al., 2005] C. Allen, I. Smit, and W. Wallach. Ar- tificial morality: Top-down, bottom-up, and hybrid ap- proaches. Ethics and Information Technology, 7(3):149- 155, 2005.","title":"Artificial morality: Top-down, bottom-up, and hybrid approaches","authors":"C Allen, I Smit, W Wallach","year":"2005","venue":"Ethics and Information Technology","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Binmore, 2005] Ken Binmore. Natural justice. Oxford Uni- versity Press, 2005.","title":"Natural justice","authors":"Ken Binmore","year":"2005","venue":null,"doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Björklund, 2003] Fredrik Björklund. Differences in the jus- tification of choices in moral dilemmas: Effects of gen- der, time pressure and dilemma seriousness. Scandinavian Journal of Psychology, 44(5):459-466, 2003.","title":"Differences in the justification of choices in moral dilemmas: Effects of gender, time pressure and dilemma seriousness","authors":"Fredrik Björklund, Björklund","year":"2003","venue":"Scandinavian Journal of Psychology","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Boella et al., 2006] Guido Boella, L. Van Der Torre, and H. Verhagen. Introduction to normative multiagent sys- tems. Computational & Mathematical Organization The- ory, 12(2-3):71-79, 2006.","title":"Introduction to normative multiagent systems","authors":"Guido Boella, L Van Der Torre, H Verhagen","year":"2006","venue":"Computational & Mathematical Organization Theory","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Bonnefon et al., 2016] Jean-Franc ¸ois Bonnefon, Azim Shariff, and Iyad Rahwan. The social dilemma of autonomous vehicles. Science, 352(6293):1573-1576, 2016.","title":"Jean-Franc ¸ois Bonnefon, Azim Shariff, and Iyad Rahwan. The social dilemma of autonomous vehicles","authors":"Bonnefon","year":"2016","venue":"Science","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Bryson and Kime, 2011] Joanna Bryson and Philip Kime. Just an artifact: why machines are perceived as moral agents. In IJCAI'11, pages 1641-1646, 2011.","title":"Just an artifact: why machines are perceived as moral agents","authors":"Joanna Bryson, Philip Kime","year":"2011","venue":"IJCAI'11","doi":null,"url":null,"internal_url":"/proceedings/2011/276"},{"position":8,"raw":"[Conci et al., 2012] Mario Conci, Virginia Dignum, Dirk Heylen, and Jonas Beskow. Roadmap for casa (computer as social actors) technologies. final report EIT ICT labs activity RIHA 12124, 2012.","title":"Roadmap for casa (computer as social actors) technologies","authors":"Mario Conci, Virginia Dignum, Dirk Heylen, Jonas Beskow","year":"2012","venue":"EIT ICT labs activity","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Conte et al., 1998] Rosaria Conte, C. Castelfranchi, and F. Dignum. Autonomous norm acceptance. In Interna- tional Workshop on Agent Theories, Architectures, and Languages, pages 99-112. Springer, 1998.","title":"Autonomous norm acceptance","authors":"Rosaria Conte, C Castelfranchi, F Dignum","year":"1998","venue":"International Workshop on Agent Theories, Architectures, and Languages","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Cranefield et al., 2017] Stephen Cranefield, M. Winikoff, V. Dignum, and F. Dignum. No pizza for you: Value-based plan selection in bdi agents, 2017.","title":"No pizza for you: Value-based plan selection in bdi agents","authors":"M Stephen Cranefield, V Winikoff, F Dignum, Dignum","year":"2017","venue":null,"doi":null,"url":null,"internal_url":"/proceedings/2017/26"},{"position":11,"raw":"[Floridi and Sanders, 2004] Luciano Floridi and J. Sanders. On the morality of artificial agents. Minds and machines, 14(3):349-379, 2004.","title":"On the morality of artificial agents","authors":"Luciano Floridi, J Sanders","year":"2004","venue":"Minds and machines","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Foot, 1967] Philippa Foot. The problem of abortion and the doctrine of double effect. 1967.","title":"Philippa Foot. The problem of abortion and the doctrine of double effect","authors":"Foot","year":"1967","venue":null,"doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Friedman et al., 2006] Batya Friedman, Peter Kahn, and Alan Borning. Value sensitive design and information systems. Advances in Management Information Systems, 6:348 -372, 2006.","title":"Value sensitive design and information systems","authors":"Batya Friedman, Peter Kahn, Alan Borning","year":"2006","venue":"Advances in Management Information Systems","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Gigerenzer, 2010] Gerd Gigerenzer. Moral satisficing: Re- thinking moral behavior as bounded rationality. Topics in cognitive science, 2(3):528-554, 2010.","title":"Moral satisficing: Rethinking moral behavior as bounded rationality","authors":"Gerd Gigerenzer, Gigerenzer","year":"2010","venue":"Topics in cognitive science","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Graham et al., 2011] Jesse Graham, Brian Nosek, Jonathan Haidt, Ravi Iyer, Spassena Koleva, and Peter Ditto. Map- ping the moral domain. Journal of personality and social psychology, 101(2):366, 2011.","title":"Mapping the moral domain","authors":"Jesse Graham, Brian Nosek, Jonathan Haidt, Ravi Iyer, Spassena Koleva, Peter Ditto","year":"2011","venue":"Journal of personality and social psychology","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Hofstede and Hofstede, 2001] Gert Hofstede and G. Hofst- ede. Culture's consequences: Comparing values, behav- iors, institutions and organizations. Sage, 2001.","title":"Hofstede. Culture's consequences: Comparing values, behaviors, institutions and organizations","authors":"Hofstede Hofstede","year":"2001","venue":null,"doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Lay et al., 2011] Ken Lay, O. C. Ferrell, and L. Ferrell. The responsibility and accountability of ceos: The last inter- view with ken lay. Journal of Business Ethics, 100(2):209- 219, 2011.","title":"The responsibility and accountability of ceos: The last interview with ken lay","authors":"Ken Lay, O C Ferrell, L Ferrell","year":"2011","venue":"Journal of Business Ethics","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Li et al., 2014] Wenchao Li, Dorsa Sadigh, Shankar Sastry, and Sanjit Seshia. Synthesis for Human-in-the-Loop Con- trol Systems, pages 470-484. Springer, 2014.","title":"Synthesis for Human-in-the-Loop Control Systems","authors":"Wenchao Li, Dorsa Sadigh, Shankar Sastry, Sanjit Seshia","year":"2014","venue":null,"doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Malle et al., 2015] Bertram Malle, Matthias Scheutz, Thomas Arnold, John Voiklis, and Corey Cusimano. Sac- rifice one for the good of many?: People apply different moral norms to human and robot agents. In Proc. 10th ACM/IEEE Int. Conf. on Human-Robot Interaction, pages 117-124. ACM, 2015.","title":"Sacrifice one for the good of many?: People apply different moral norms to human and robot agents","authors":"Bertram Malle, Matthias Scheutz, Thomas Arnold, John Voiklis, Corey Cusimano","year":"2015","venue":"Proc. 10th ACM/IEEE Int. Conf. on Human-Robot Interaction","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Misener and Shladover, 2006] James Misener and S. Shladover. Path investigations in vehicle-roadside cooperation and safety: A foundation for safety and vehicle-infrastructure integration research. In Intelligent Transportation Systems Conference, 2006, pages 9-16. IEEE, 2006.","title":"Path investigations in vehicle-roadside cooperation and safety: A foundation for safety and vehicle-infrastructure integration research","authors":"James Misener, S Shladover","year":"2006","venue":"Intelligent Transportation Systems Conference","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Modgil and Prakken, 2013] Sanjay Modgil and Henry Prakken. A general account of argumentation with preferences. Artificial Intelligence, 195:361-397, 2013.","title":"A general account of argumentation with preferences","authors":"Prakken Modgil, Sanjay Modgil, Henry Prakken","year":"2013","venue":"Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Russell and Norvig, 2009] Stuart Russell and P Norvig. Ar- tificial Intelligence: A Modern Approach. Pearson Educa- tion, 3rd edition, 2009.","title":"Artificial Intelligence: A Modern Approach","authors":"Stuart Russell, P Norvig","year":"2009","venue":null,"doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Schwartz, 2006a] Shalom Schwartz. An Overview Basic Human Values: Theory, Methods, and Applications Intro- duction to the Values Theory. Jerusalem Hebrew Univer- sity, 2006.","title":"Shalom Schwartz","authors":"Schwartz","year":"2006","venue":"An Overview Basic Human Values: Theory, Methods, and Applications Introduction to the Values Theory","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Schwartz, 2006b] Shalom Schwartz. A theory of cultural value orientations: Explication and applications. Compar- ative sociology, 5(2):137-182, 2006.","title":"A theory of cultural value orientations: Explication and applications","authors":"Shalom Schwartz, Schwartz","year":"2006","venue":"Comparative sociology","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Searle, 2010] John Searle. Making the social world: The structure of human civilization. Oxford UP, 2010.","title":"John Searle. Making the social world: The structure of human civilization","authors":"Searle","year":"2010","venue":null,"doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Sen, 2004] Amartya Sen. Elements of a theory of human rights. Philosophy & Public Affairs, 32(4):315-356, 2004.","title":"Amartya Sen. Elements of a theory of human rights","authors":"Sen","year":"2004","venue":"Philosophy & Public Affairs","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[van de Poel, 2013] Ibo van de Poel. Translating Values into Design Requirements, pages 253-266. Springer Nether- lands, Dordrecht, 2013.","title":"Ibo van de Poel. Translating Values into Design Requirements","authors":"Poel Van De","year":"2013","venue":null,"doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[van den Hoven, 2005] Jeroen van den Hoven. Design for values and values for design. Information Age +, Journal of the Australian Computer Society, 7(2):4-7, 2005.","title":"Design for values and values for design. Information Age +","authors":"Van Den Hoven ; Jeroen Van Den Hoven","year":"2005","venue":"Journal of the Australian Computer Society","doi":null,"url":null,"internal_url":null},{"position":29,"raw":"[Verdiesen et al., 2016] Ilse Verdiesen, Martijn Cligge, Jan Timmermans, Lennart Segers, Virginia Dignum, and Jeroen van den Hoven. MOOD: Massive open online de- liberation platform a practical application. In 1st Workshop on Ethics in the Design of Intelligent Agents, pages 6-11, 2016.","title":"MOOD: Massive open online deliberation platform a practical application","authors":"Ilse Verdiesen, Martijn Cligge, Jan Timmermans, Lennart Segers, Virginia Dignum, Jeroen Van Den Hoven","year":"2016","venue":"1st Workshop on Ethics in the Design of Intelligent Agents","doi":null,"url":null,"internal_url":null},{"position":30,"raw":"[Wallach and Allen, 2008] Wendall Wallach and Collin Allen. Moral machines: Teaching robots right from wrong. Oxford University Press, 2008.","title":"Moral machines: Teaching robots right from wrong","authors":"Allen ; Wallach, Wendall Wallach, Collin Allen","year":"2008","venue":null,"doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}