{"type":"ScholarlyArticle","title":"Fostering Cooperation in Structured Populations Through Local and Global Interference Strategies","authors":[{"name":"The Anh Han","slug":"the-anh-han","given":"The Anh","family":"Han","affiliation":"School of Computing, Media and the Arts , Teesside University"},{"name":"Simon Lynch","slug":"simon-lynch","given":"Simon","family":"Lynch","affiliation":"School of Computing, Media and the Arts , Teesside University"},{"name":"Long Tran-Thanh","slug":"long-tran-thanh","given":"Long","family":"Tran-Thanh","affiliation":"School of Electronics and Computer Science , University of Southampton; Instituto Superior Tecnico , Universidade de Lisboa"},{"name":"Francisco C. Santos","slug":"francisco-c-santos","given":"Francisco C.","family":"Santos","affiliation":"INESC-ID and"}],"abstract":"We study the situation of an exogenous decision-maker aiming to encourage a population of autonomous, self-regarding agents to follow a desired behaviour at a minimal cost. The primary goal is therefore to reach an efficient trade-off between pushing the agents to achieve the desired configuration while minimising the total investment. To this end, we test several interference paradigms resorting to simulations of agents facing a cooperative dilemma in a spatial arrangement. We systematically analyse and compare interference strategies rewarding local or global behavioural patterns.  Our results show that taking into account the neighbourhood's local properties, such as its level of cooperativeness, can lead to a significant improvement regarding cost efficiency while guaranteeing high levels of cooperation. As such, we argue that local interference strategies are more efficient than global ones in fostering cooperation in a population of autonomous agents.","doi":"10.24963/ijcai.2018/40","url":"https://ijcai.org/proceedings/2018/40","pdf":"https://ijcai.org/proceedings/2018/0040.pdf","markdown":"https://ijcai.org/proceedings/2018/40.md","bibtex":"https://ijcai.org/proceedings/2018/bibtex/40","volume":{"slug":"2018","title":"Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2018","url":"https://ijcai.org/proceedings/2018/","year":2018,"location":"Stockholm","dates":"13-19 July 2018","editors":"Jérôme Lang","isbn":"978-0-9992411-2-7","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2018"},"section":"Agent-based and Multi-agent Systems","track":"Main track","number":40,"pages":{"first":289,"last":295},"keywords":["Agent-based and Multi-agent Systems: Agent Societies","Agent-based and Multi-agent Systems: Agent-Based Simulation and Emergence"],"videos":[],"references":[{"position":1,"raw":"[Aadithya et al., 2011] K. V. Aadithya, T. P. Michalak, and N. R. Jennings. Representation of coalitional games with algebraic de- cision diagrams. In AAMAS '11, Taipei, Taiwan, May 2-6, 2011, Volume 1-3, pages 1121-1122, 2011.","title":"Representation of coalitional games with algebraic decision diagrams","authors":"K V Aadithya, T P Michalak, N R Jennings","year":"2011","venue":"AAMAS '11","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Aziz et al., 2010] H. Aziz, F. Brandt, and P. Harrenstein. Mono- tone cooperative games and their threshold versions. In AAMAS '10, pages 1107-1114, 2010.","title":"Monotone cooperative games and their threshold versions","authors":"H Aziz, F Brandt, P Harrenstein","year":"2010","venue":"AAMAS '10","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Bachrach et al., 2009] Y. Bachrach, E. Elkind, R. Meir, D. Pasech- nik, M. Zuckerman, J. Rothe, and J. Rosenschein. The cost of stability in coalitional games. In Algorithmic Game Theory, vol- ume 5814 of LNCS, pages 122-134. 2009.","title":"The cost of stability in coalitional games","authors":"Y Bachrach, E Elkind, R Meir, D Pasechnik, M Zuckerman, J Rothe, J Rosenschein","year":"2009","venue":"Algorithmic Game Theory","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Ding et al., 2013] W. Ding, T. Qin, X.-D. Zhang, and T.-Y. Liu. Multi-armed bandit with budget constraint and variable costs. In AAAI '13, pages 232-238, 2013.","title":"Multi-armed bandit with budget constraint and variable costs","authors":"W Ding, T Qin, X.-D Zhang, T.-Y Liu","year":"2013","venue":"AAAI '13","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Duong and Han, 2015] Manh Hong Duong and The Anh Han. On the expected number of equilibria in a multi-player multi-strategy evolutionary game. Dynamic Games and Applications, pages 1- 23, 2015.","title":"On the expected number of equilibria in a multi-player multi-strategy evolutionary game","authors":"Han ; Duong, Hong Manh, The Duong, Han Anh","year":"2015","venue":"Dynamic Games and Applications","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Endriss et al., 2011] U. Endriss, S. Kraus, J. Lang, and M. Wooldridge. Incentive engineering for boolean games. IJCAI '11, pages 2602-2607, 2011.","title":"Incentive engineering for boolean games","authors":"U Endriss, S Kraus, J Lang, M Wooldridge","year":"2011","venue":"IJCAI '11","doi":null,"url":null,"internal_url":"/proceedings/2011/433"},{"position":7,"raw":"[Franks et al., 2013] H. Franks, N. Griffiths, and A. Jhumka. Ma- nipulating convention emergence using influencer agents. Jour- nal of Autonomous Agents and Multi-Agent Systems (JAAMAS), 26(3):315-353, 2013.","title":"Manipulating convention emergence using influencer agents","authors":"H Franks, N Griffiths, A Jhumka","year":"2013","venue":"Journal of Autonomous Agents and Multi-Agent Systems","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Franks et al., 2014] H. Franks, N. Griffiths, and S. S. Anand. Learning agent influence in mas with complex social networks. Journal of Autonomous Agents and Multi-Agent Systems (JAA- MAS), 28(5):836-866, 2014.","title":"Learning agent influence in mas with complex social networks","authors":"H Franks, N Griffiths, S S Anand","year":"2014","venue":"Journal of Autonomous Agents and Multi-Agent Systems (JAA-MAS)","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Guha and Munagala, 2007] S. Guha and K. Munagala. Approxi- mation algorithms for budgeted learning problems. STOC '07, pages 104-113, 2007.","title":"Approximation algorithms for budgeted learning problems","authors":"S Guha, K Munagala","year":"2007","venue":"STOC '07","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Han et al., 2014] The Anh Han, Long Tran-Thanh, and Nicholas R Jennings. The cost of interference in evolving systems. In The 17th International Workshop on Coordination, Organisations, Institutions and Norms (COIN 2014), 2014.","title":"The cost of interference in evolving systems","authors":"Han","year":"2014","venue":"The 17th International Workshop on Coordination, Organisations, Institutions and Norms","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Han et al., 2015] The Anh Han, Long Tran-Thanh, and Nicholas R Jennings. The cost of interference in evolving multiagent sys- tems. In AAMAS'2015, pages 1719-1720, 2015.","title":"The cost of interference in evolving multiagent systems","authors":"Han","year":"2015","venue":"AAMAS'2015","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Han et al., 2017a] The Anh Han, Luís Moniz Pereira, and Tom Lenaerts. Evolution of commitment and level of participation in public goods games. Autonomous Agents and Multi-Agent Sys- tems, 31(3):561-583, 2017.","title":"Evolution of commitment and level of participation in public goods games","authors":"Han","year":"2017","venue":"Autonomous Agents and Multi-Agent Systems","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Han et al., 2017b] The Anh Han, Luís Moniz Pereira, Luis A Martinez-Vaquero, and Tom Lenaerts. Centralized vs. person- alized commitments and their influence on cooperation in group interactions. In AAAI, pages 2999-3005, 2017.","title":"Centralized vs. personalized commitments and their influence on cooperation in group interactions","authors":"Han","year":"2017","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Han, 2016] The Anh Han. Emergence of social punishment and cooperation through prior commitments. In AAAI'2016, pages 2494-2500, Phoenix, Arizona, USA, 2016.","title":"Emergence of social punishment and cooperation through prior commitments","authors":"; Han, Anh The, Han","year":"2016","venue":"AAAI'2016","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Harrenstein et al., 2014] P. Harrenstein, P. Turrini, and M. Wooldridge. Hard and soft equilibria in boolean games. In AAMAS '14, pages 845-852, 2014.","title":"Hard and soft equilibria in boolean games","authors":"P Harrenstein, P Turrini, M Wooldridge","year":"2014","venue":"AAMAS '14","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Levin, 2000] Simon A Levin. Multiple scales and the maintenance of biodiversity. Ecosystems, 3(6):498-506, 2000.","title":"Multiple scales and the maintenance of biodiversity","authors":"Levin Simon","year":"2000","venue":"Ecosystems","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Levit et al., 2013] V. Levit, T. Grinshpoun, A. Meisels, and A. L. C. Bazzan. Taxation search in boolean games. In AA- MAS '13, Saint Paul, MN, USA, May 6-10, 2013, pages 183-190, 2013.","title":"Taxation search in boolean games","authors":"V Levit, T Grinshpoun, A Meisels, A L C Bazzan","year":"2013","venue":"AA-MAS '13","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Madani et al., 2004] O. Madani, D. J. Lizotte, and R. Greiner. The budgeted multi-armed bandit problem. ICOLT '04, pages 643- 645, 2004.","title":"The budgeted multi-armed bandit problem","authors":"O Madani, D J Lizotte, R Greiner","year":"2004","venue":"ICOLT","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Nowak and May, 1992] Martin A Nowak and Robert M May. Evo- lutionary games and spatial chaos. Nature, 359(6398):826-829, 1992.","title":"Evolutionary games and spatial chaos","authors":"A Martin, Robert M Nowak, May","year":"1992","venue":"Nature","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Nowak and Sigmund, 2005] M. A. Nowak and K. Sigmund. Evo- lution of indirect reciprocity. Nature, 437(1291-1298), 2005.","title":"Evolution of indirect reciprocity","authors":"M A Nowak, K Sigmund","year":"2005","venue":"Nature","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Raghunandan and Subramanian, 2012] M. A. Raghunandan and C. A. Subramanian. Sustaining cooperation on networks: an an- alytical study based on evolutionary game theory. In AAMAS'12, pages 913-920, 2012.","title":"Sustaining cooperation on networks: an analytical study based on evolutionary game theory","authors":"M A Raghunandan, C A Subramanian","year":"2012","venue":"AAMAS'12","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Rand et al., 2013] David G. Rand, Corina E. Tarnita, Hisashi Oht- suki, and Martin A. Nowak. Evolution of fairness in the one- shot anonymous ultimatum game. Proc. Natl. Acad. Sci. USA, 110:2581-2586, 2013.","title":"Evolution of fairness in the oneshot anonymous ultimatum game","authors":"David G Rand, Corina E Tarnita, Hisashi Ohtsuki, Martin A Nowak","year":"2013","venue":"Proc. Natl. Acad. Sci","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Rand et al., 2014] David G Rand, Martin A Nowak, James H Fowler, and Nicholas A Christakis. Static network structure can stabilize human cooperation. Proc Natl Acad Sci USA, 111(48):17093-17098, 2014.","title":"Static network structure can stabilize human cooperation","authors":"Martin A David G Rand, James H Nowak, Nicholas A Fowler, Christakis","year":"2014","venue":"Proc Natl Acad Sci","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Sahraei et al., 2014] B. R. Sahraei, H. Bou-Ammar, D. Bloember- gen, K. Tuyls, and G. Weiss. Evolution of cooperation in arbitrary complex networks. In AAMAS '14, Paris, France, May 5-9, 2014, pages 677-684, 2014.","title":"Evolution of cooperation in arbitrary complex networks","authors":"B R Sahraei, H Bou-Ammar, D Bloembergen, K Tuyls, G Weiss","year":"2014","venue":"AAMAS '14","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Santos et al., 2006] F. C. Santos, J. M. Pacheco, and T. Lenaerts. Evolutionary dynamics of social dilemmas in structured hetero- geneous populations. Proc Natl Acad Sci USA, 103:3490-3494, 2006.","title":"Evolutionary dynamics of social dilemmas in structured heterogeneous populations","authors":"F C Santos, J M Pacheco, T Lenaerts","year":"2006","venue":"Proc Natl Acad Sci","doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Santos et al., 2008] F. C. Santos, M. D. Santos, and J. M. Pacheco. Social diversity promotes the emergence of cooperation in public goods games. Nature, 454(7201):213, 2008.","title":"Social diversity promotes the emergence of cooperation in public goods games","authors":"F C Santos, M D Santos, J M Pacheco","year":"2008","venue":"Nature","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Sigmund et al., 2001] K. Sigmund, C. Hauert, and M. Nowak. Re- ward and punishment. Proc. Natl Acad Sci USA, 98(19):10757- 10762, 2001.","title":"Reward and punishment","authors":"K Sigmund, C Hauert, M Nowak","year":"2001","venue":"Proc. Natl Acad Sci","doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[Sigmund et al., 2010] Karl Sigmund, Hannelore De Silva, Arne Traulsen, and Christoph Hauert. Social learning promotes in- stitutions for governing the commons. Nature, 466(7308):861, 2010.","title":"Social learning promotes institutions for governing the commons","authors":"Karl Sigmund, Hannelore De Silva, Arne Traulsen, Christoph Hauert","year":"2010","venue":"Nature","doi":null,"url":null,"internal_url":null},{"position":29,"raw":"[Szabó and Fath, 2007] György Szabó and Gabor Fath. Evolution- ary games on graphs. Physics reports, 446(4-6):97-216, 2007.","title":"Evolutionary games on graphs","authors":"Fath Szabó","year":"2007","venue":"Physics reports","doi":null,"url":null,"internal_url":null},{"position":30,"raw":"[Tran-Thanh et al., 2012] L. Tran-Thanh, A. Chapman, A. Rogers, and N. R. Jennings. Knapsack based optimal policies for budget- limited multi-armed bandits. AAAI '12, pages 1134-1140, 2012.","title":"Knapsack based optimal policies for budgetlimited multi-armed bandits","authors":"L Tran-Thanh, A Chapman, A Rogers, N R Jennings","year":"2012","venue":"AAAI '12","doi":null,"url":null,"internal_url":null},{"position":31,"raw":"[Traulsen and Nowak, 2006] A. Traulsen and M. A. Nowak. Evo- lution of cooperation by multilevel selection. Proc Natl Acad Sci USA, 103(29):10952, 2006.","title":"Evolution of cooperation by multilevel selection","authors":"A Traulsen, M A Nowak","year":"2006","venue":"Proc Natl Acad Sci","doi":null,"url":null,"internal_url":null},{"position":32,"raw":"[Traulsen et al., 2006] A. Traulsen, M. A. Nowak, and J. M. Pacheco. Stochastic dynamics of invasion and fixation. Phys Rev E, 74(1):011909, 2006.","title":"Stochastic dynamics of invasion and fixation","authors":"A Traulsen, M A Nowak, J M Pacheco","year":"2006","venue":"Phys Rev E","doi":null,"url":null,"internal_url":null},{"position":33,"raw":"[Tuyls and Parsons, 2007] K. Tuyls and S. Parsons. What evolu- tionary game theory tells us about multiagent learning. Artificial Intelligence, 171(7):406-416, 2007.","title":"What evolutionary game theory tells us about multiagent learning","authors":"K Tuyls, S Parsons","year":"2007","venue":"Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":34,"raw":"[Vasconcelos et al., 2013] V. V. Vasconcelos, F. C. Santos, and J. M Pacheco. A bottom-up institutional approach to cooperative gov- ernance of risky commons. Nature Climate Change, 3(9):797- 801, 2013.","title":"A bottom-up institutional approach to cooperative governance of risky commons","authors":"V V Vasconcelos, F C Santos, J M Pacheco","year":"2013","venue":"Nature Climate Change","doi":null,"url":null,"internal_url":null},{"position":35,"raw":"[Wooldridge, 2012] M. Wooldridge. Bad equilibria (and what to do about them). ECAI '12, pages 6-11, 2012.","title":"Bad equilibria (and what to do about them)","authors":"M Wooldridge","year":"2012","venue":"ECAI '12","doi":null,"url":null,"internal_url":null},{"position":36,"raw":"[Zisis et al., 2015] Ioannis Zisis, Sibilla Di Guida, The Anh Han, Georg Kirchsteiger, and Tom Lenaerts. Generosity motivated by acceptance -evolutionary analysis of an anticipation games. Sci- entific reports, 5(18076), 2015.","title":"Generosity motivated by acceptance -evolutionary analysis of an anticipation games","authors":"Ioannis Zisis, Sibilla Di Guida, Anh The, Georg Han, Tom Kirchsteiger, Lenaerts","year":"2015","venue":"Scientific reports","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}