{"type":"ScholarlyArticle","title":"Norm Deviation in Multiagent Systems: A Foundation for Responsible Autonomy","authors":[{"name":"Amika M. Singh","slug":"amika-m-singh","given":"Amika M.","family":"Singh","affiliation":"Harvard Law School"},{"name":"Munindar P. Singh","slug":"munindar-p-singh","given":"Munindar P.","family":"Singh","affiliation":"North Carolina State University"}],"abstract":"The power of norms in both human societies and sociotechnical systems arises from the facts that (1) societal norms, including laws and policies, characterize acceptable behavior in high-level terms and (2) they are not hard controls and can be deviated from. Thus, the design of responsibly autonomous agents faces an essential tension: these agents must both (1) respect applicable norms and (2) deviate from those norms when blindly following them may lead to diminished outcomes.\r\n\r\nWe propose a conceptual foundation for norm deviation. As a guiding framework, we adopt Habermas's theory of communicative action comprising objective, subjective, and practical validity claims regarding the suitability of deviation. \r\nOur analysis thus goes beyond previous studies of norm deviation and yields reasoning guidelines uniting norms and values by which to develop responsible agents.","doi":"10.24963/ijcai.2023/33","url":"https://ijcai.org/proceedings/2023/33","pdf":"https://ijcai.org/proceedings/2023/0033.pdf","markdown":"https://ijcai.org/proceedings/2023/33.md","bibtex":"https://ijcai.org/proceedings/2023/bibtex/33","volume":{"slug":"2023","title":"Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2023","url":"https://ijcai.org/proceedings/2023/","year":2023,"location":"Macao, SAR","dates":"19-25 August 2023","editors":"Edith Elkind","isbn":"978-1-956792-03-4","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2023"},"section":"Agent-based and Multi-agent Systems","track":"Main Track","number":33,"pages":{"first":289,"last":297},"keywords":["Agent-based and Multi-agent Systems: MAS: Normative systems"],"videos":[],"references":[{"position":1,"raw":"[Aydogan et al., 2021] Reyhan Aydogan, Özgür Kafalı, Furkan Arslan, Catholijn M. Jonker, and Munindar P. Singh. NOVA: Value-based negotiation of norms. ACM Transactions on Intelligent Systems and Technology (TIST), 12(4):45:1-45:29, August 2021.","title":"NOVA: Value-based negotiation of norms","authors":"Reyhan Aydogan, Özgür Kafalı, Furkan Arslan, Catholijn M Jonker, Munindar P Singh","year":"2021","venue":"ACM Transactions on Intelligent Systems and Technology (TIST)","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[BBC, 2022] BBC. Tesla adds chill and assertive self- driving modes, January 2022. https://www.bbc.com/news/ technology-59939536. Accessed 2023-01-16.","title":"BBC. Tesla adds chill and assertive selfdriving modes","authors":"Bbc","year":"2022","venue":null,"doi":null,"url":"https://www.bbc.com/news/technology-59939536","internal_url":null},{"position":3,"raw":"[Bohman and Rehg, 2017] James Bohman and William Rehg. Jürgen Habermas. In Edward N. Zalta, editor, The Stanford Encyclopedia of Philosophy. 2017.","title":"The Stanford Encyclopedia of Philosophy","authors":"Rehg Bohman","year":"2017","venue":"The Stanford Encyclopedia of Philosophy","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Bresciani et al., 2004] Paolo Bresciani, Anna Perini, Paolo Giorgini, Fausto Giunchiglia, and John Mylopoulos. Tro- pos: An agent-oriented software development methodol- ogy. Journal of Autonomous Agents and Multi-Agent Sys- tems (JAAMAS), 8(3):203-236, May 2004.","title":"Tropos: An agent-oriented software development methodology","authors":"Paolo Bresciani, Anna Perini, Paolo Giorgini, Fausto Giunchiglia, John Mylopoulos","year":"2004","venue":"Journal of Autonomous Agents and Multi-Agent Systems (JAAMAS)","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[California, 1976] California. Tarasoff v. Regents of Univ. of California, 551 P.2d 334, 1976. Supreme Court of Calif. [Canada, 1989] Canada. Andrews v. Law Society of British Columbia 1 S.C.R. 143, 1989. Supreme Court of Canada.","title":null,"authors":"California","year":"1976","venue":null,"doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Chopra and Singh, 2016] Amit K. Chopra and Munindar P. Singh. From Social Machines to Social Protocols. In Proc. WWW Conference, pages 903-914, Montréal, April 2018.","title":"From Social Machines to Social Protocols","authors":"K Amit, Munindar P Chopra, Singh","year":"2018","venue":"Proc. WWW Conference","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Chopra and Singh, 2018] Amit K. Chopra and Munindar P. Singh. Sociotechnical systems and ethics in the large. In Proc. AAAI/ACM Conference on Artificial Intelligence, Ethics, and Society (AIES), pages 48-53, February 2018.","title":"Sociotechnical systems and ethics in the large","authors":"K Amit, Munindar P Chopra, Singh","year":"2018","venue":"Proc. AAAI/ACM Conference on Artificial Intelligence, Ethics, and Society (AIES)","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Cranefield et al., 2017] Stephen Cranefield, Michael Winikoff, Virginia Dignum, and Frank Dignum. No pizza for you: Value-based plan selection in BDI agents. In Proc. 26th IJCAI, pages 178-184, Melbourne, 2017.","title":"No pizza for you: Value-based plan selection in BDI agents","authors":"Stephen Cranefield, Michael Winikoff, Virginia Dignum, Frank Dignum","year":"2017","venue":"Proc. 26th IJCAI","doi":null,"url":null,"internal_url":"/proceedings/2017/26"},{"position":9,"raw":"[Dastani et al., 2018] Mehdi Dastani, Paolo Torroni, and Neil Yorke-Smith. Monitoring norms. Knowledge Engi- neering Review, 33:e25, December 2018.","title":"Monitoring norms","authors":"Mehdi Dastani, Paolo Torroni, Neil Yorke-Smith","year":"2018","venue":"Knowledge Engineering Review","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Dell'Anna et al., 2020] Davide Dell'Anna, Mehdi Dastani, and Fabiano Dalpiaz. Runtime revision of sanctions in normative multi-agent systems. Journal of Autonomous Agents and Multi-Agent Systems (JAAMAS), 34(2):43:1- 43:54, June 2020.","title":"Runtime revision of sanctions in normative multi-agent systems","authors":"Davide Dell'anna, Mehdi Dastani, Fabiano Dalpiaz","year":"2020","venue":"Journal of Autonomous Agents and Multi-Agent Systems (JAAMAS)","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Dubljević et al., 2022] Veljko Dubljević, Sean Douglas, Jovan Milojevich, Nirav Ajmeri, William A. Bauer, George F. List, and Munindar P. Singh. Moral and so- cial ramifications of autonomous vehicles. Behaviour & Information Technology, 42, April 2022.","title":"Moral and social ramifications of autonomous vehicles","authors":"Veljko Dubljević, Sean Douglas, Jovan Milojevich, Nirav Ajmeri, William A Bauer, George F List, Munindar P Singh","year":"2022","venue":"Behaviour & Information Technology","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Dworkin, 1988] Ronald Dworkin. Law's Empire. Harvard University Press, Cambridge, Massachusetts, 1988.","title":"Law's Empire","authors":"Ronald Dworkin","year":"1988","venue":null,"doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[England & Wales, 2001] England & Wales. Re A (con- joined twins) [2001] 2 WLR 480, September 2001. Court of Appeal of England and Wales. Falcone et al., 2013]","title":"England & Wales. Re A (conjoined twins)","authors":null,"year":"2001","venue":"WLR","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"Rino Falcone, Cristiano Castelfranchi, Henrique Lopes Cardoso, Andrew J. I. Jones, and Eugénio Oliveira. Norms and trust. In Sascha Ossowski, editor, Agreement Technologies, pages 387-408. Springer, 2013.","title":"Norms and trust","authors":"Rino Falcone, Cristiano Castelfranchi, Henrique Lopes Cardoso, J I Andrew, Eugénio Jones, Oliveira","year":"2013","venue":"Agreement Technologies","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Finnis, 2003] John M. Finnis. Law and what I truly should decide. The American Journal of Jurisprudence, 48(1):107-129, June 2003.","title":"Law and what I truly should decide","authors":"John M Finnis","year":"2003","venue":"The American Journal of Jurisprudence","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Flanagan, 1954] John C. Flanagan. The critical incident technique. Psychological Bulletin, 51(4):327-358, July 1954.","title":"The critical incident technique","authors":"John C Flanagan","year":"1954","venue":"Psychological Bulletin","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Freeman, 2021] James B. Freeman. Walton on ethical ar- gumentation. Journal of Applied Logics: The IfCoLog Journal of Logics and their Applications, 8(1):124-144, February 2021.","title":"Walton on ethical argumentation","authors":"James B Freeman","year":"2021","venue":"Journal of Applied Logics: The IfCoLog Journal of Logics and their Applications","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"Jürgen Habermas. The Theory of Commu- nicative Action, volumes 1 and 2. Polity Press, Cambridge, UK, 1984.","title":"The Theory of Communicative Action","authors":"Jürgen Habermas","year":"1984","venue":null,"doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Hohfeld, 1919] Wesley Newcomb Hohfeld. Fundamental Legal Conceptions as Applied in Judicial Reasoning and other Legal Essays. Yale University Press, New Haven, Connecticut, 1919. A 1919 printing of articles from 1913.","title":"Fundamental Legal Conceptions as Applied in Judicial Reasoning and other Legal Essays","authors":"Wesley Hohfeld, Hohfeld Newcomb","year":"1919","venue":null,"doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Kafalı et al., 2020] Özgür Kafalı, Nirav Ajmeri, and Munindar P. Singh. DESEN: Specification of sociotechni- cal systems via patterns of regulation and control. ACM Transactions on Software Engineering and Methodology (TOSEM), 29(1):7:1-7:50, February 2020.","title":"DESEN: Specification of sociotechnical systems via patterns of regulation and control","authors":"Özgür Kafalı, Nirav Ajmeri, Munindar P Singh","year":"2020","venue":"ACM Transactions on Software Engineering and Methodology (TOSEM)","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Kökciyan and Yolum, 2022] Nadin Kökciyan and Pinar Yolum. Taking situation-based privacy decisions: Pri- vacy assistants working with humans. In Proc. 31st IJCAI, pages 703-709, Vienna, July 2022.","title":"Taking situation-based privacy decisions: Privacy assistants working with humans","authors":"Nadin Kökciyan, Pinar Yolum","year":"2022","venue":"Proc. 31st IJCAI","doi":null,"url":null,"internal_url":"/proceedings/2022/99"},{"position":22,"raw":"[Kola et al., 2020] Ilir Kola, Myrthe L. Tielman, Catholijn M. Jonker, and M. Birna van Riemsdijk. Predicting the priority of social situations for personal assistant agents. In Proc. PRIMA, LNCS 12568, pages 231-247, Nagoya, Japan, November 2020. Springer.","title":"Predicting the priority of social situations for personal assistant agents","authors":"Ilir Kola, L Myrthe, Catholijn M Tielman, M Jonker, Birna Van Riemsdijk","year":"2020","venue":"Proc. PRIMA, LNCS","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Liscio et al., 2022] Enrico Liscio, Michiel van der Meer, Luciano Cavalcante Siebert, Catholijn M. Jonker, and Pradeep K. Murukannaiah. What values should an agent align with? An empirical comparison of general and context-specific values. Journal of Autonomous Agents and Multi-Agent Systems (JAAMAS), 36(1):23, 2022.","title":"What values should an agent align with? An empirical comparison of general and context-specific values","authors":"Enrico Liscio, Luciano Cavalcante Michiel Van Der Meer, Catholijn M Siebert, Pradeep K Jonker, Murukannaiah","year":"2022","venue":"Journal of Autonomous Agents and Multi-Agent Systems (JAAMAS)","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Montes and Sierra, 2021] Nieves Montes and Carles Sierra. Value-guided synthesis of parametric normative systems. In Proc. 20th AAMAS, pages 907-915, Online, May 2021.","title":"Value-guided synthesis of parametric normative systems","authors":"Nieves Montes, Carles Sierra","year":"2021","venue":"Proc. 20th AAMAS","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Murukannaiah et al., 2020] Pradeep K. Murukannaiah, Ni- rav Ajmeri, Catholijn M. Jonker, and Munindar P. Singh. New foundations of ethical multiagent systems. In Proc. 19th AAMAS, pages 1706-1710, Auckland, May 2020. IFAAMAS. Blue Sky Ideas Track.","title":"New foundations of ethical multiagent systems","authors":"K Pradeep, Nirav Murukannaiah, Catholijn M Ajmeri, Munindar P Jonker, Singh","year":"2020","venue":"Proc. 19th AAMAS","doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Nardin et al., 2016] Luis G. Nardin, Tina Balke-Visser, Ni- rav Ajmeri, Anup K. Kalia, Jaime S. Sichman, and Munin- dar P. Singh. Classifying sanctions and designing a con- ceptual sanctioning process model for socio-technical sys- tems. Knowledge Engineering Review (KER), 31(2):142- 166, March 2016.","title":"Classifying sanctions and designing a conceptual sanctioning process model for socio-technical systems","authors":"Luis G Nardin, Tina Balke-Visser, Nirav Ajmeri, Anup K Kalia, Jaime S Sichman, Munindar P Singh","year":"2016","venue":"Knowledge Engineering Review (KER)","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Rokeach, 1973] Milton Rokeach. The Nature of Human Val- ues. Free Press, New York, 1973.","title":"The Nature of Human Values","authors":"Milton Rokeach","year":"1973","venue":null,"doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[dos Santos et al., 2017] Jéssica Soares dos Santos, Jean de Oliveira Zahn, Eduardo Augusto Silvestre, Viviane Tor- res da Silva, and Wamberto Weber Vasconcelos. Detec- tion and resolution of normative conflicts in multi-agent systems: A literature survey. Journal of Autonomous Agents and Multi-Agent Systems (JAAMAS), 31(6):1236- 1282, November 2017.","title":"Detection and resolution of normative conflicts in multi-agent systems: A literature survey","authors":"Jéssica Soares Dos Santos, Jean De Oliveira Zahn, Eduardo Augusto Silvestre, Viviane Torres Da Silva, Wamberto Weber Vasconcelos","year":"2017","venue":"Journal of Autonomous Agents and Multi-Agent Systems (JAAMAS)","doi":null,"url":null,"internal_url":null},{"position":29,"raw":"[Savarimuthu et al., 2008] Bastin Tony Roy Savarimuthu, Maryam Purvis, Martin K. Purvis, and Stephen Crane- field. Social norm emergence in virtual agent societies. In Declarative Agent Languages and Technologies VI: Re- vised Selected and Invited Papers, LNCS 5397, pages 18- 28, Estoril, Portugal, May 2008. Springer.","title":"Social norm emergence in virtual agent societies","authors":"Bastin Tony, Roy Savarimuthu, Maryam Purvis, Martin K Purvis, Stephen Cranefield","year":"2008","venue":"Declarative Agent Languages and Technologies VI: Revised Selected and Invited Papers","doi":null,"url":null,"internal_url":null},{"position":30,"raw":"[Schafheitle et al., 2020] Simon Schafheitle, Antoinette Weibel, Nadine Meidert, and Dirk Leuffen. The road to trust. A vignette study on the determinants of citizens' trust in the European Commission. Journal of Common Market Studies (JCMS), 58(2):256-275, March 2020.","title":"The road to trust. A vignette study on the determinants of citizens' trust in the European Commission","authors":"Simon Schafheitle, Antoinette Weibel, Nadine Meidert, Dirk Leuffen","year":"2020","venue":"Journal of Common Market Studies (JCMS)","doi":null,"url":null,"internal_url":null},{"position":31,"raw":"[Schwartz, 2012] Shalom H. Schwartz. An overview of the Schwartz theory of basic values. Online Readings in Psy- chology and Culture, 2(1):3-20, December 2012.","title":"An overview of the Schwartz theory of basic values","authors":"Shalom H Schwartz","year":"2012","venue":"Online Readings in Psychology and Culture","doi":null,"url":null,"internal_url":null},{"position":32,"raw":"[SCOTUS, 1971] SCOTUS. Clay v. United States: 403","title":"SCOTUS. Clay v","authors":"Scotus","year":"1971","venue":null,"doi":null,"url":null,"internal_url":null},{"position":33,"raw":"U.S. 698, June 1971. Supreme Court of the United States. [SCOTUS, 1977] SCOTUS. Nat'l Socialist Party of Am. v. Vill. of Skokie, 432 U.S. 43, June 1977. Supreme Court of the United States.","title":"Supreme Court of the United States. [SCOTUS","authors":"U S","year":"1971","venue":"SCOTUS. Nat'l Socialist Party of Am. v. Vill. of Skokie","doi":null,"url":null,"internal_url":null},{"position":34,"raw":"[SCOTUS, 1996] SCOTUS. Jaffee v. Redmond, 518 U.S. 1, June 1996. Supreme Court of the United States.","title":"SCOTUS. Jaffee v. Redmond","authors":"Scotus","year":"1996","venue":null,"doi":null,"url":null,"internal_url":null},{"position":35,"raw":"[SCOTUS, 2018] SCOTUS. Masterpiece Cakeshop, Ltd. v. Colorado Civil Rights Comm'n 138 S. Ct. 1719, June 2018. Supreme Court of the United States.","title":"SCOTUS. Masterpiece Cakeshop, Ltd. v. Colorado Civil Rights Comm'n 138 S","authors":"Scotus","year":"1719","venue":null,"doi":null,"url":null,"internal_url":null},{"position":36,"raw":"[Serramia et al., 2018] Marc Serramia, Maite López- Sánchez, Juan A. Rodríguez-Aguilar, Manel Rodríguez, Michael Wooldridge, Javier Morales, and Carlos Ansótegui. Moral values in norm decision making. In Proc. 17th AAMAS, pages 1294-1302, Stockholm, 2018.","title":"Moral values in norm decision making","authors":"Marc Serramia, Maite López-Sánchez, Juan A Rodríguez-Aguilar, Manel Rodríguez, Michael Wooldridge, Javier Morales, Carlos Ansótegui","year":"2018","venue":"Proc. 17th AAMAS","doi":null,"url":null,"internal_url":null},{"position":37,"raw":"[Shah et al., 2021] Vedarsh Shah, Zedong Peng, Ganesh Malla, and Nan Niu. Towards norm classification: An ini- tial analysis of HIPAA breaches. In Proc. 29th IEEE In- ternational Requirements Engineering Conference Work- shops, pages 415-420, Notre Dame, Indiana, 2021.","title":"Towards norm classification: An initial analysis of HIPAA breaches","authors":"Shah","year":"2021","venue":"Proc. 29th IEEE International Requirements Engineering Conference Workshops","doi":null,"url":null,"internal_url":null},{"position":38,"raw":"[Shams et al., 2020] Zohreh Shams, Marina De Vos, Nir Oren, and Julian A. Padget. Argumentation-based reasoning about plans, maintenance goals, and norms. ACM Transactions on Autonomous and Adaptive Systems (TAAS), 14(3):9:1-9:39, March 2020.","title":"Argumentation-based reasoning about plans, maintenance goals, and norms","authors":"Zohreh Shams, Marina De Vos, Nir Oren, Julian A Padget","year":"2020","venue":"ACM Transactions on Autonomous and Adaptive Systems (TAAS)","doi":null,"url":null,"internal_url":null},{"position":39,"raw":"[Singh and Singh, 2023] Amika M. Singh and Munindar P. Singh. Wasabi: A conceptual model for trustworthy artifi- cial intelligence. IEEE Computer, 56(2):20-28, February 2023.","title":"Wasabi: A conceptual model for trustworthy artificial intelligence","authors":"Singh, M Singh ; Amika, Munindar P Singh, Singh","year":"2023","venue":"IEEE Computer","doi":null,"url":null,"internal_url":null},{"position":40,"raw":"[Singh, 1991] Munindar P. Singh. Group ability and struc- ture. In Yves Demazeau and Jean-Pierre Müller, edi- tors, Decentralized Artificial Intelligence, Volume 2, pages 127-145. Elsevier/North-Holland, Amsterdam, 1991.","title":"Group ability and structure","authors":"P Munindar, Singh","year":"1991","venue":"edi-tors, Decentralized Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":41,"raw":"[Singh, 2013] Munindar P. Singh. Norms as a basis for gov- erning sociotechnical systems. ACM Transactions on In- telligent Systems and Technology (TIST), 5(1):21:1-21:23, December 2013.","title":"Norms as a basis for governing sociotechnical systems","authors":"P Munindar, Singh","year":"2013","venue":"ACM Transactions on Intelligent Systems and Technology (TIST)","doi":null,"url":null,"internal_url":null},{"position":42,"raw":"[Singh, 2022] Munindar P. Singh. Consent as a foun- dation for responsible autonomy. Proc. 36th AAAI, 36(11):12301-12306, February 2022. Blue Sky Track. [","title":"Consent as a foundation for responsible autonomy","authors":"P Munindar, Singh","year":"2022","venue":"Proc. 36th AAAI","doi":null,"url":null,"internal_url":null},{"position":43,"raw":"[NHTSA, 2022] NHTSA. Part 573 Safety Recall Report. Recall 22V-037. January 2022. Tesla rolling stop recall.","title":"NHTSA. Part 573 Safety Recall Report","authors":"Nhtsa","year":"2022","venue":null,"doi":null,"url":null,"internal_url":null},{"position":44,"raw":"[Telang et al., 2021] Pankaj R. Telang, Munindar P. Singh, and Neil Yorke-Smith. Maintenance of social com- mitments in multiagent systems. Proc. 35th AAAI, 35(13):11369-11377, February 2021.","title":"Maintenance of social commitments in multiagent systems","authors":"R Pankaj, Telang, P Munindar, Neil Singh, Yorke-Smith","year":"2021","venue":"Proc. 35th AAAI","doi":null,"url":null,"internal_url":null},{"position":45,"raw":"[Thoreau, 1848] Henry David Thoreau. On the Duty of Civil Disobedience. Lerner Publishing, Minneapolis, 1848. 2020 reprinting.","title":"On the Duty of Civil Disobedience","authors":"Henry David, Thoreau","year":"1848","venue":null,"doi":null,"url":null,"internal_url":null},{"position":46,"raw":"[Tubella et al., 2019] Andrea Aler Tubella, Andreas Theodorou, Frank Dignum, and Virginia Dignum. Gov- ernance by glass-box: Implementing transparent moral bounds for AI behaviour. In Proc. 28th IJCAI, pages 5787-5793, Macau, August 2019.","title":"Governance by glass-box: Implementing transparent moral bounds for AI behaviour","authors":"Andrea Aler Tubella, Andreas Theodorou, Frank Dignum, Virginia Dignum","year":"2019","venue":"Proc. 28th IJCAI","doi":null,"url":null,"internal_url":"/proceedings/2019/802"},{"position":47,"raw":"[Vermont, 1910] Vermont. Ploof v. Putnam, 83 Vt. 494, February 1910. Supreme Court of Vermont.","title":"Vermont. Ploof v. Putnam","authors":"Vermont","year":"1910","venue":null,"doi":null,"url":null,"internal_url":null},{"position":48,"raw":"[Von Wright, 1963] Georg Henrik Von Wright. Norm and Action: A Logical Enquiry. International Library of Phi- losophy and Scientific Method. Humanities Press, New York, 1963.","title":"Norm and Action: A Logical Enquiry","authors":"Von Wright, ;, Georg Henrik, Von Wright","year":"1963","venue":"International Library of Philosophy and Scientific Method","doi":null,"url":null,"internal_url":null},{"position":49,"raw":"[Walton et al., 2008] Douglas N. Walton, Chris Reed, and Fabrizio Macagno. Argumentation Schemes. Cambridge University Press, Cambridge, UK, 2008.","title":"Argumentation Schemes","authors":"Douglas N Walton, Chris Reed, Fabrizio Macagno","year":"2008","venue":null,"doi":null,"url":null,"internal_url":null},{"position":50,"raw":"[Weisbach, 1999] David A. Weisbach. Line drawing doc- trine and efficiency in the tax law. Cornell Law Review, 84(6):1627-1681, September 1999.","title":"Line drawing doctrine and efficiency in the tax law","authors":"David A Weisbach","year":"1999","venue":"Cornell Law Review","doi":null,"url":null,"internal_url":null},{"position":51,"raw":"[Wolff, 1998] Robert Paul Wolff. In Defense of Anarchism. University of California Press, Oakland, California, 1998.","title":"Defense of Anarchism","authors":"Robert Paul, Wolff","year":"1998","venue":null,"doi":null,"url":null,"internal_url":null},{"position":52,"raw":"[Woodgate and Ajmeri, 2022] Jessica Woodgate and Nirav Ajmeri. Macro ethics for governing equitable sociotech- nical systems. In Proc. 21st AAMAS, pages 1824-1828, Auckland, May 2022. IFAAMAS.","title":"Macro ethics for governing equitable sociotechnical systems","authors":"Jessica Woodgate, Nirav Ajmeri","year":"2022","venue":"Proc. 21st AAMAS","doi":null,"url":null,"internal_url":null},{"position":53,"raw":"[Yazdanpanah et al., 2021a] Vahid Yazdanpanah, Enrico H. Gerding, Sebastian Stein, Corina Cîrstea, m. c. schraefel, Timothy J. Norman, and Nicholas R. Jennings. Different forms of responsibility in multiagent systems. IEEE Inter- net Computing (IC), 25(6):15-22, November 2021.","title":"Different forms of responsibility in multiagent systems","authors":"Yazdanpanah","year":"2021","venue":"IEEE Internet Computing (IC)","doi":null,"url":null,"internal_url":null},{"position":54,"raw":"[Yazdanpanah et al., 2021b] Vahid Yazdanpanah, Enrico H. Gerding, Sebastian Stein, Mehdi Dastani, Catholijn M. Jonker, and Timothy J. Norman. Responsibility research for trustworthy autonomous systems. In Proc. 20th AA- MAS, pages 57-62, May 2021. Blue Sky Ideas Track. [Young, 2001] Iris Marion Young. Activist challenges to de- liberative democracy. Political Theory, 29(5):670-690, October 2001.","title":"Iris Marion Young. Activist challenges to deliberative democracy","authors":"Yazdanpanah","year":"2001","venue":"Proc. 20th AA-MAS","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}