{"type":"ScholarlyArticle","title":"Achieving Coordination in Multi-Agent Systems by Stable Local Conventions under Community Networks","authors":[{"name":"Shuyue Hu","slug":"shuyue-hu","given":"Shuyue","family":"Hu","affiliation":"Department of Computer Science and Engineering The Chinese University of Hong Kong Hong Kong , China"},{"name":"Ho-fung Leung","slug":"ho-fung-leung","given":"Ho-fung","family":"Leung","affiliation":"Department of Computer Science and Engineering The Chinese University of Hong Kong Hong Kong , China"}],"abstract":"Recently, the study of social conventions has attracted much attention in the literature. We notice that a type of interesting phenomena, local convention phenomena, may also exist in certain multi-agent systems. When agents are partitioned into compact communities, different local conventions emerge in different communities. In this paper, we provide a definition for local conventions, and propose two metrics measuring their strength and diversity. In our experimental study, we show that agents can achieve coordination via establishing diverse stable local conventions, which indicates a practical way to solve coordination problems other than the traditional global convention emergence. Moreover, we find that with smaller community sizes, denser connections and fewer available actions, diverse local conventions emerge in shorter time.","doi":"10.24963/ijcai.2017/659","url":"https://ijcai.org/proceedings/2017/659","pdf":"https://ijcai.org/proceedings/2017/0659.pdf","markdown":"https://ijcai.org/proceedings/2017/659.md","bibtex":"https://ijcai.org/proceedings/2017/bibtex/659","volume":{"slug":"2017","title":"Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2017","url":"https://ijcai.org/proceedings/2017/","year":2017,"location":"Melbourne, Australia","dates":"19-25 August 2017","editors":"Carles Sierra","isbn":"978-0-9992411-0-3","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2017"},"section":"AI and autonomy track","track":"AI and autonomy track","number":659,"pages":{"first":4731,"last":4737},"keywords":["Philosophical: Norms"],"videos":[],"references":[{"position":1,"raw":"[Brandes et al., 2003] Ulrik Brandes, Marco Gaertler, and Dorothea Wagner. Experiments on graph clustering al- gorithms. In European Symposium on Algorithms, pages 568-579. Springer, 2003.","title":"Experiments on graph clustering algorithms","authors":"Brandes","year":"2003","venue":"European Symposium on Algorithms","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Cialdini and Trost, 1998] Robert B Cialdini and Melanie R Trost. Social influence: Social norms, conformity and compliance. McGraw-Hill, 1998.","title":"Social influence: Social norms, conformity and compliance","authors":"B Robert, Melanie R Cialdini, Trost","year":"1998","venue":null,"doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Delgado, 2002] Jordi Delgado. Emergence of social con- ventions in complex networks. Artificial Intelligence, 141(1):171-185, 2002.","title":"Emergence of social conventions in complex networks","authors":"Jordi Delgado, Delgado","year":"2002","venue":"Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Epstein, 2001] Joshua M Epstein. Learning to be thought- less: Social norms and individual computation. Computa- tional Economics, 18(1):9-24, 2001.","title":"Learning to be thoughtless: Social norms and individual computation","authors":"Joshua M Epstein","year":"2001","venue":"Computational Economics","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Fortunato, 2010] Santo Fortunato. Community detection in graphs. Physics Reports, 486(3):75-174, 2010.","title":"Santo Fortunato. Community detection in graphs","authors":"Fortunato","year":"2010","venue":"Physics Reports","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Girvan and Newman, 2002] Michelle Girvan and Mark EJ Newman. Community structure in social and biological networks. Proceedings of the National Academy of Sci- ences, 99(12):7821-7826, 2002.","title":"Community structure in social and biological networks","authors":"Michelle Girvan, Mark Ej Newman","year":"2002","venue":"Proceedings of the National Academy of Sciences","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Griffiths and Luck, 2010] Nathan Griffiths and Michael Luck. Norm emergence in tag-based cooperation. page 80, 2010.","title":"Norm emergence in tag-based cooperation","authors":"Luck Griffiths, Nathan Griffiths, Michael Luck","year":"2010","venue":null,"doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Hao and Leung, 2013] Jianye Hao and Ho-fung Leung. The dynamics of reinforcement social learning in cooperative multiagent systems. In Proceedings of the 23rd Inter- national Joint Conferences on Artificial Intelligence, vol- ume 13, pages 184-190, 2013.","title":"The dynamics of reinforcement social learning in cooperative multiagent systems","authors":"Leung Hao, Jianye Hao, Ho-Fung Leung","year":"2013","venue":"Proceedings of the 23rd International Joint Conferences on Artificial Intelligence","doi":null,"url":null,"internal_url":"/proceedings/2013/37"},{"position":9,"raw":"[Hasan et al., 2014] Mohammad R Hasan, Sherief Abdallah, and Anita Raja. Topology aware convention emergence. In Proceedings of the 2014 international conference on Autonomous agents and multi-agent systems, pages 1593- 1594. International Foundation for Autonomous Agents and Multiagent Systems, 2014.","title":"Topology aware convention emergence","authors":"Sherief Mohammad R Hasan, Anita Abdallah, Raja","year":"2014","venue":"Proceedings of the 2014 international conference on Autonomous agents and multi-agent systems","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Kittock, 1993] James E Kittock. Emergent conventions and the structure of multi-agent systems. In 1993 lectures in Complex Systems: the Proceedings of the Complex Sys- tems Summer School, 1993.","title":"Emergent conventions and the structure of multi-agent systems","authors":"James E Kittock","year":"1993","venue":"lectures in Complex Systems: the Proceedings of the Complex Systems Summer School","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Lancichinetti et al., 2010] Andrea Lancichinetti, Mikko Kivelä, Jari Saramäki, and Santo Fortunato. Characteriz- ing the community structure of complex networks. PloS one, 5(8):e11976, 2010.","title":"Characterizing the community structure of complex networks","authors":"Andrea Lancichinetti, Mikko Kivelä, Jari Saramäki, Santo Fortunato","year":"2010","venue":"PloS one","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Marchant et al., 2015] James Marchant, Nathan Griffiths, and Matthew Leeke. Convention emergence and influence in dynamic topologies. In Proceedings of the 2015 Inter- national Conference on Autonomous Agents and Multia- gent Systems, pages 1785-1786, 2015.","title":"Convention emergence and influence in dynamic topologies","authors":"Marchant","year":"2015","venue":"Proceedings of the 2015 International Conference on Autonomous Agents and Multiagent Systems","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Mukherjee et al., 2008] Partha Mukherjee, Sandip Sen, and Stéphane Airiau. Norm emergence under constrained in- teractions in diverse societies. In Proceedings of the 7th International Joint Conference on Autonomous Agents and Multiagent systems-Volume 2, pages 779-786, 2008.","title":"Norm emergence under constrained interactions in diverse societies","authors":"Partha Mukherjee, Sandip Sen, Stéphane Airiau","year":"2008","venue":"Proceedings of the 7th International Joint Conference on Autonomous Agents and Multiagent systems","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Pujol et al., 2005] Josep M Pujol, Jordi Delgado, Ramon Sangüesa, and Andreas Flache. The role of clustering on the emergence of efficient social conventions. In Proceed- ings of the 19th International Joint Conference on Artifi- cial Intelligence, pages 965-970, 2005.","title":"The role of clustering on the emergence of efficient social conventions","authors":"Jordi Josep M Pujol, Ramon Delgado, Andreas Sangüesa, Flache","year":"2005","venue":"Proceedings of the 19th International Joint Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":"/proceedings/2005/159"},{"position":15,"raw":"[Savarimuthu and Cranefield, 2011] Bastin Tony Roy Savarimuthu and Stephen Cranefield. Norm creation, spreading and emergence: A survey of simulation models of norms in multi-agent systems. Multiagent and Grid Systems, 7(1):21-54, 2011.","title":"Norm creation, spreading and emergence: A survey of simulation models of norms in multi-agent systems","authors":"Bastin Tony, Roy Savarimuthu, Stephen Cranefield","year":"2011","venue":"Multiagent and Grid Systems","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Sen and Airiau, 2007] Sandip Sen and Stéphane Airiau. Emergence of norms through social learning. In Proceed- ings of 20th International Joint Conferences on Artificial Intelligence, volume 1507, page 1512, 2007.","title":"Emergence of norms through social learning","authors":"Sandip Sen, Stéphane Airiau","year":"2007","venue":"Proceedings of 20th International Joint Conferences on Artificial Intelligence","doi":null,"url":null,"internal_url":"/proceedings/2007/243"},{"position":17,"raw":"[Sen and Sen, 2010] Onkur Sen and Sandip Sen. Effects of social network topology and options on norm emergence. In Coordination, Organizations, Institutions and Norms in Agent Systems, pages 211-222. Springer, 2010.","title":"Onkur Sen and Sandip Sen. Effects of social network topology and options on norm emergence","authors":"Sen Sen","year":"2010","venue":"Coordination, Organizations, Institutions and Norms in Agent Systems","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Shannon, 2001] Claude Elwood Shannon. A mathemati- cal theory of communication. ACM SIGMOBILE Mo- bile Computing and Communications Review, 5(1):3-55, 2001.","title":"A mathematical theory of communication","authors":"Claude Elwood, Shannon","year":"2001","venue":"ACM SIGMOBILE Mobile Computing and Communications Review","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Shibusawa and Sugawara, 2014] Ryosuke Shibusawa and Toshiharu Sugawara. Norm emergence via influential weight propagation in complex networks. In Network In- telligence Conference (ENIC), 2014 European, pages 30- 37. IEEE, 2014.","title":"Norm emergence via influential weight propagation in complex networks","authors":"Sugawara Shibusawa, Ryosuke Shibusawa, Toshiharu Sugawara","year":"2014","venue":"Network Intelligence Conference (ENIC), 2014 European","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Shoham and Tennenholtz, 1992] Yoav Shoham and Moshe Tennenholtz. Emergent conventions in multi-agent sys- tems: Initial experimental results and observations. KR- 92, pages 225-231, 1992.","title":"Emergent conventions in multi-agent systems: Initial experimental results and observations","authors":"Tennenholtz Shoham, Yoav Shoham, Moshe Tennenholtz","year":"1992","venue":null,"doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Ullmann-Margalit, 2015] Edna Ullmann-Margalit. The emergence of norms, volume 11. Oxford University Press, USA, 2015.","title":"Edna Ullmann-Margalit. The emergence of norms","authors":"Ullmann-Margalit","year":"2015","venue":null,"doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Villatoro et al., 2009] Daniel Villatoro, Sandip Sen, and Jordi Sabater-Mir. Topology and memory effect on convention emergence. In Proceedings of the 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology-Volume 02, pages 233-240, 2009.","title":"Topology and memory effect on convention emergence","authors":"Daniel Villatoro, Sandip Sen, Jordi Sabater-Mir","year":"2009","venue":"Proceedings of the 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Villatoro et al., 2011] Daniel Villatoro, Jordi Sabater-Mir, and Sandip Sen. Social instruments for robust convention emergence. In Proceedings of the 22nd International Joint Conferences on Artificial Intelligence, volume 11, pages 420-425, 2011.","title":"Social instruments for robust convention emergence","authors":"Daniel Villatoro, Jordi Sabater-Mir, Sandip Sen","year":"2011","venue":"Proceedings of the 22nd International Joint Conferences on Artificial Intelligence","doi":null,"url":null,"internal_url":"/proceedings/2011/78"},{"position":24,"raw":"[Watkins and Dayan, 1992] Christopher JCH Watkins and Peter Dayan. Q-learning. Machine Learning, 8(3-4):279- 292, 1992.","title":"Q-learning","authors":"Jch Christopher, Peter Watkins, Dayan","year":"1992","venue":"Machine Learning","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Wooldridge and Jennings, 1995] Michael Wooldridge and Nicholas R Jennings. Intelligent agents: Theory and prac- tice. The knowledge engineering review, 10(02):115-152, 1995.","title":"Intelligent agents: Theory and practice","authors":"Michael Wooldridge, Nicholas R Jennings","year":"1995","venue":"The knowledge engineering review","doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Yu et al., 2013] Chao Yu, Minjie Zhang, Fenghui Ren, and Xudong Luo. Emergence of social norms through collec- tive learning in networked agent societies. In Proceed- ings of the 2013 International Conference on Autonomous Agents and Multiagent Systems, pages 475-482, 2013.","title":"Emergence of social norms through collective learning in networked agent societies","authors":"Chao Yu, Minjie Zhang, Fenghui Ren, Xudong Luo","year":"2013","venue":"Proceedings of the 2013 International Conference on Autonomous Agents and Multiagent Systems","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}