{"type":"ScholarlyArticle","title":"Monte-Carlo Tree Search for Scalable Coalition Formation","authors":[{"name":"Feng Wu","slug":"feng-wu","given":"Feng","family":"Wu","affiliation":"School of Computer Science and Technology , University of Science and Technology of China"},{"name":"Sarvapali D. Ramchurn","slug":"sarvapali-d-ramchurn","given":"Sarvapali D.","family":"Ramchurn","affiliation":"School of Electronics and Computer Science , University of Southampton"}],"abstract":"We propose a novel algorithm based on Monte-Carlo tree search for the problem of coalition structure generation (CSG). Specifically, we find the optimal solution by sampling the coalition structure graph and incrementally expanding a search tree, which represents the partial space that has been searched. We prove that our algorithm is complete and converges to the optimal given sufficient number of iterations. Moreover, it is anytime and can scale to large CSG problems with many agents. Experimental results on six common CSG benchmark problems and a disaster response domain confirm the advantages of our approach comparing to the state-of-the-art methods.","doi":"10.24963/ijcai.2020/57","url":"https://ijcai.org/proceedings/2020/57","pdf":"https://ijcai.org/proceedings/2020/0057.pdf","markdown":"https://ijcai.org/proceedings/2020/57.md","bibtex":"https://ijcai.org/proceedings/2020/bibtex/57","volume":{"slug":"2020","title":"Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2020","url":"https://ijcai.org/proceedings/2020/","year":2020,"location":"Yokohama","dates":"January 2021 (postponed from 11-17 July 2020)","editors":"Christian Bessiere","isbn":"978-0-9992411-6-5","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2020"},"section":"Agent-based and Multi-agent Systems","track":"Main track","number":57,"pages":{"first":407,"last":413},"keywords":["Agent-based and Multi-agent Systems: Coordination and Cooperation","Agent-based and Multi-agent Systems: Cooperative Games"],"videos":[{"label":"Video","url":"https://videos.ijcai20.org/25677/file_25677.m3u8","length_sec":274,"provider":"hls"}],"references":[{"position":1,"raw":"[Auer et al., 2002] Peter Auer, Nicolo Cesa-Bianchi, and Paul Fischer. Finite-time analysis of the multiarmed bandit problem. Machine learning, 47(2-3):235-256, 2002.","title":"Finite-time analysis of the multiarmed bandit problem","authors":"Auer","year":"2002","venue":"Machine learning","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Bistaffa et al., 2017] Filippo Bistaffa, Alessandro Farinelli, Georgios Chalkiadakis, and Sarvapali D Ramchurn. A co- operative game-theoretic approach to the social rideshar- ing problem. Artificial Intelligence, 246:86-117, 2017.","title":"A cooperative game-theoretic approach to the social ridesharing problem","authors":"Filippo Bistaffa, Alessandro Farinelli, Georgios Chalkiadakis, Sarvapali D Ramchurn","year":"2017","venue":"Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Browne et al., 2012] Cameron B Browne, Edward Powley, Daniel Whitehouse, Simon M Lucas, et al. A survey of monte carlo tree search methods. IEEE Trans. on Compu- tational Intelligence and AI in games, 4(1):1-43, 2012.","title":"A survey of monte carlo tree search methods","authors":"Edward Cameron B Browne, Daniel Powley, Simon M Whitehouse, Lucas","year":"2012","venue":"IEEE Trans. on Computational Intelligence and AI in games","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Cruz et al., 2017] Francisco Cruz, Antonio Espinosa, Juan C Moure, Jesus Cerquides, et al. Coalition structure generation problems: optimization and parallelization of the idp algorithm in multicore systems. Concurrency and computation, 29(5):e3969, 2017.","title":"Coalition structure generation problems: optimization and parallelization of the idp algorithm in multicore systems","authors":"Cruz","year":"2017","venue":"Concurrency and computation","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Dang and Jennings, 2004] Viet Dung Dang and Nicholas R Jennings. Generating coalition structures with finite bound from the optimal guarantees. In Proc. of AAMAS, pages 564-571, 2004.","title":"Generating coalition structures with finite bound from the optimal guarantees","authors":"Jennings ; ] Dang, Dung Viet, Nicholas R Dang, Jennings","year":"2004","venue":"Proc. of AAMAS","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Di Mauro et al., 2010] Nicola Di Mauro, Teresa MA Basile, Stefano Ferilli, and Floriana Esposito. Coalition structure generation with grasp. In Proc. of Int'l Conf. on Artif. In- tel.: Methodology, Systems, and Applications, pages 111- 120, 2010.","title":"Coalition structure generation with grasp","authors":"Nicola Di, Mauro, Teresa Ma Basile, Stefano Ferilli, Floriana Esposito","year":"2010","venue":"Proc. of Int'l Conf. on Artif. Intel.: Methodology, Systems, and Applications","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Farinelli et al., 2013] Alessandro Farinelli, Manuele Bicego, Sarvapali D Ramchurn, and Mauro Zucchelli. C-link: A hierarchical clustering approach to large-scale near-optimal coalition formation. In Proc. of IJCAI, pages 106-112, 2013.","title":"C-link: A hierarchical clustering approach to large-scale near-optimal coalition formation","authors":"Alessandro Farinelli, Manuele Bicego, Mauro Sarvapali D Ramchurn, Zucchelli","year":"2013","venue":"Proc. of IJCAI","doi":null,"url":null,"internal_url":"/proceedings/2013/27"},{"position":8,"raw":"[Farinelli et al., 2017] Alessandro Farinelli, Manuele Bicego, Filippo Bistaffa, and Sarvapali D Ramchurn. A hierarchical clustering approach to large-scale near- optimal coalition formation with quality guarantees. Engineering Applications of Artificial Intelligence, 59:170-185, 2017.","title":"A hierarchical clustering approach to large-scale nearoptimal coalition formation with quality guarantees","authors":"Alessandro Farinelli, Manuele Bicego, Filippo Bistaffa, Sarvapali D Ramchurn","year":"2017","venue":"Engineering Applications of Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Keinänen, 2009] Helena Keinänen. Simulated annealing for multi-agent coalition formation. In KES Int'l Symposium on Agent and Multi-Agent Systems, pages 30-39, 2009.","title":"Helena Keinänen. Simulated annealing for multi-agent coalition formation","authors":"Keinänen","year":"2009","venue":"KES Int'l Symposium on Agent and Multi-Agent Systems","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Kocsis and Szepesvári, 2006] Levente Kocsis and Csaba Szepesvári. Bandit based monte-carlo planning. In Proc. of ECAI, pages 282-293, 2006.","title":"Bandit based monte-carlo planning","authors":"Szepesvári Kocsis, Levente Kocsis, Csaba Szepesvári","year":"2006","venue":"Proc. of ECAI","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Larson and Sandholm, 2000] Kate S Larson and Tuomas W Sandholm. Anytime coalition structure generation: an av- erage case study. J. of Exper. & Theoretical Artif. Intel., 12(1):23-42, 2000.","title":"Anytime coalition structure generation: an average case study","authors":"S Kate, Tuomas W Larson, Sandholm","year":"2000","venue":"J. of Exper. & Theoretical Artif. Intel","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Michalak et al., 2016] Tomasz Michalak, Talal Rahwan, Edith Elkind, Michael Wooldridge, and Nicholas R Jen- nings. A hybrid exact algorithm for complete set parti- tioning. Artificial Intelligence, 230:14-50, 2016.","title":"A hybrid exact algorithm for complete set partitioning","authors":"Tomasz Michalak, Talal Rahwan, Edith Elkind, Michael Wooldridge, Nicholas R Jennings","year":"2016","venue":"Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Pawłowski et al., 2014] Krzysztof Pawłowski, Karol Ku- rach, Kim Svensson, Sarvapali Ramchurn, et al. Coalition structure generation with the graphics processing unit. In Proc. of AAMAS, pages 293-300, 2014.","title":"Coalition structure generation with the graphics processing unit","authors":"Krzysztof Pawłowski, Karol Kurach, Kim Svensson, Sarvapali Ramchurn","year":"2014","venue":"Proc. of AAMAS","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Rahwan et al., 2007] Talal Rahwan, Sarvapali D Ramchurn, Viet Dung Dang, Andrea Giovannucci, and Nicholas R Jennings. Anytime optimal coalition structure generation. In Proc. of AAAI, pages 1184-1190, 2007.","title":"Anytime optimal coalition structure generation","authors":"Rahwan","year":"2007","venue":"Proc. of AAAI","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Rahwan et al., 2009] Talal Rahwan, Sarvapali D Ramchurn, Nicholas R Jennings, et al. An anytime algorithm for op- timal coalition structure generation. Journal of Artificial Intelligence Research, 34:521-567, 2009.","title":"An anytime algorithm for optimal coalition structure generation","authors":"Talal Rahwan, Nicholas R Sarvapali D Ramchurn, Jennings","year":"2009","venue":"Journal of Artificial Intelligence Research","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Rahwan et al., 2011] Talal Rahwan, Tomasz P Michalak, Edith Elkind, Piotr Faliszewski, Jacek Sroka, et al. Con- strained coalition formation. In Proc. of AAAI, volume 11, pages 719-725, 2011.","title":"Constrained coalition formation","authors":"Talal Rahwan, P Tomasz, Edith Michalak, Piotr Elkind, Jacek Faliszewski, Sroka","year":"2011","venue":"Proc. of AAAI","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Rahwan et al., 2012] Talal Rahwan, Tomasz Michalak, and Nicholas Jennings. A hybrid algorithm for coalition struc- ture generation. In Proc. of AAAI, 2012.","title":"A hybrid algorithm for coalition structure generation","authors":"Tomasz Talal Rahwan, Nicholas Michalak, Jennings","year":"2012","venue":"Proc. of AAAI","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Rahwan et al., 2015] Talal Rahwan, Tomasz P Michalak, Michael Wooldridge, and Nicholas R Jennings. Coali- tion structure generation: A survey. Artificial Intelligence, 229:139-174, 2015.","title":"Coalition structure generation: A survey","authors":"Talal Rahwan, P Tomasz, Michael Michalak, Nicholas R Wooldridge, Jennings","year":"2015","venue":"Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Ramchurn et al., 2015] Sarvapali D. Ramchurn, Feng Wu, Joel E. Fischer, Steven Reece, Wenchao Jiang, et al. Human-agent collaboration for disaster response. Jour- nal of Autonomous Agents and Multi-Agent Systems, 30(1):82-111, 2015.","title":"Human-agent collaboration for disaster response","authors":"D Sarvapali, Feng Ramchurn, Joel E Wu, Steven Fischer, Wenchao Reece, Jiang","year":"2015","venue":"Journal of Autonomous Agents and Multi-Agent Systems","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Ramchurn et al., 2016] Sarvapali D Ramchurn, Trung Dong Huynh, Feng Wu, Yukki Ikuno, Jack Flann, Luc Moreau, et al. A disaster response system based on human-agent collectives. Journal of Artificial Intelligence Research, 57:661-708, 2016.","title":"A disaster response system based on human-agent collectives","authors":"Trung Sarvapali D Ramchurn, Dong Huynh, Feng Wu, Yukki Ikuno, Jack Flann, Luc Moreau","year":"2016","venue":"Journal of Artificial Intelligence Research","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Sandholm et al., 1999] Tuomas Sandholm, Kate Larson, Martin Andersson, Onn Shehory, and Fernando Tohmé. Coalition structure generation with worst case guarantees. Artificial Intelligence, 111(1-2):209-238, 1999.","title":"Coalition structure generation with worst case guarantees","authors":"Sandholm","year":"1999","venue":"Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Sen and Dutta, 2000] Sandip Sen and Partha Sarathi Dutta. Searching for optimal coalition structures. In Proc. of AA- MAS, pages 287-292. IEEE, 2000.","title":"Searching for optimal coalition structures","authors":"Sandip Sen, Partha Sarathi, Dutta","year":"2000","venue":"Proc. of AA-MAS","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Service and Adams, 2010] Travis Service and Julie Adams. Approximate coalition structure generation. In Proc. of AAAI, 2010.","title":"Approximate coalition structure generation","authors":"Travis Service, Julie Adams","year":"2010","venue":"Proc. of AAAI","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Service and Adams, 2011] Travis C. Service and Julie A Adams. Coalition formation for task allocation: Theory and algorithms. JAAMAS, 22(2):225-248, 2011.","title":"Coalition formation for task allocation: Theory and algorithms","authors":"Travis C Service, Julie A Adams","year":"2011","venue":"JAAMAS","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Shehory and Kraus, 1998] Onn Shehory and Sarit Kraus. Methods for task allocation via agent coalition formation. Artificial intelligence, 101(1):165-200, 1998.","title":"Onn Shehory and Sarit Kraus. Methods for task allocation via agent coalition formation","authors":"Kraus Shehory","year":"1998","venue":"Artificial intelligence","doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Silver et al., 2016] David Silver, Aja Huang, Chris J Maddi- son, Arthur Guez, Laurent Sifre, et al. Mastering the game of go with deep neural networks and tree search. Nature, 529(7587):484, 2016.","title":"Mastering the game of go with deep neural networks and tree search","authors":"David Silver, Aja Huang, Chris J Maddison, Arthur Guez, Laurent Sifre","year":"2016","venue":"Nature","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Yeh, 1986] D Yun Yeh. A dynamic programming approach to the complete set partitioning problem. BIT Numerical Mathematics, 26(4):467-474, 1986.","title":"A dynamic programming approach to the complete set partitioning problem","authors":"Yun Yeh","year":"1986","venue":"BIT Numerical Mathematics","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}