{"type":"ScholarlyArticle","title":"AI-Olympics: Exploring the Generalization of Agents through Open Competitions","authors":[{"name":"Chen Wang","slug":"chen-wang","given":"Chen","family":"Wang","affiliation":"Institute of Automation , Chinese Academy of Sciences"},{"name":"Yan Song","slug":"yan-song","given":"Yan","family":"Song","affiliation":"Institute of Automation , Chinese Academy of Sciences"},{"name":"Shuai Wu","slug":"shuai-wu","given":"Shuai","family":"Wu","affiliation":"Nanjing Artificial Intelligence Research of IA"},{"name":"Sa Wu","slug":"sa-wu","given":"Sa","family":"Wu","affiliation":"Institute of Automation , Chinese Academy of Sciences"},{"name":"Ruizhi Zhang","slug":"ruizhi-zhang","given":"Ruizhi","family":"Zhang","affiliation":"Institute of Automation , Chinese Academy of Sciences"},{"name":"Shu Lin","slug":"shu-lin","given":"Shu","family":"Lin","affiliation":"Institute of Automation , Chinese Academy of Sciences"},{"name":"Haifeng Zhang","slug":"haifeng-zhang","given":"Haifeng","family":"Zhang","affiliation":"Institute of Automation , Chinese Academy of Sciences; Nanjing Artificial Intelligence Research of IA; School of Artificial Intelligence , University of Chinese Academy of Sciences"}],"abstract":"Between 2021 and 2023, AI-Olympics---a series of online AI competitions, was hosted by the online evaluation platform Jidi in collaboration with the IJCAI committee. In these competitions, an agent is required to accomplish diverse sports tasks in a two-dimensional continuous world, while competing against an opponent. This paper provides a brief overview of the competition series and highlights notable findings. We aim to contribute insights to the field of multi-agent decision-making and explore the generalization of agents through engineering efforts.","doi":"10.24963/ijcai.2024/1040","url":"https://ijcai.org/proceedings/2024/1040","pdf":"https://ijcai.org/proceedings/2024/1040.pdf","markdown":"https://ijcai.org/proceedings/2024/1040.md","bibtex":"https://ijcai.org/proceedings/2024/bibtex/1040","volume":{"slug":"2024","title":"Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2024","url":"https://ijcai.org/proceedings/2024/","year":2024,"location":"Jeju, Korea","dates":"3-9 August 2024","editors":"Kate Larson","isbn":"978-1-956792-04-1","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2024"},"section":"Demo Track","track":"Demo Track","number":1040,"pages":{"first":8820,"last":8823},"keywords":["Agent-based and Multi-agent Systems: MAS: Agent-based simulation and emergence","Agent-based and Multi-agent Systems: MAS: Multi-agent planning","Agent-based and Multi-agent Systems: MAS: Engineering methods, platforms, languages and tools"],"videos":[],"references":[{"position":1,"raw":"[Agapiou et al., 2022] John P Agapiou, Alexander Sasha Vezhnevets, Edgar A Duéñez-Guzmán, Jayd Matyas, Yi- ran Mao, Peter Sunehag, Raphael Köster, Udari Mad- hushani, Kavya Kopparapu, Ramona Comanescu, et al. Melting pot 2.0. arXiv preprint arXiv:2211.13746, 2022.","title":"Melting pot 2.0","authors":"Alexander John P Agapiou, Sasha Vezhnevets, Edgar A Duéñez-Guzmán, Jayd Matyas, Yiran Mao, Peter Sunehag, Raphael Köster, Udari Madhushani, Kavya Kopparapu, Ramona Comanescu","year":"2022","venue":null,"doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Cai et al., 2017] Han Cai, Kan Ren, Weinan Zhang, Klean- this Malialis, Jun Wang, Yong Yu, and Defeng Guo. Real- time bidding by reinforcement learning in display adver- tising. Proceedings of the Tenth ACM International Con- ference on Web Search and Data Mining, 2017.","title":"Realtime bidding by reinforcement learning in display advertising","authors":"Han Cai, Kan Ren, Weinan Zhang, Kleanthis Malialis, Jun Wang, Yong Yu, Defeng Guo","year":"2017","venue":"Proceedings of the Tenth ACM International Conference on Web Search and Data Mining","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Csató, 2013] László Csató. Ranking by pairwise compar- isons for swiss-system tournaments. Central European Journal of Operations Research, 21:783-803, 2013.","title":"László Csató. Ranking by pairwise comparisons for swiss-system tournaments","authors":"Csató","year":"2013","venue":"Central European Journal of Operations Research","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Gorsane et al., 2022] Rihab Gorsane, Omayma Mahjoub, Ruan John de Kock, Roland Dubb, Siddarth Singh, and Arnu Pretorius. Towards a standardised performance eval- uation protocol for cooperative marl. Advances in Neural Information Processing Systems, 35:5510-5521, 2022.","title":"Towards a standardised performance evaluation protocol for cooperative marl","authors":"Rihab Gorsane, Omayma Mahjoub, Ruan John De Kock, Roland Dubb, Siddarth Singh, Arnu Pretorius","year":"2022","venue":"Advances in Neural Information Processing Systems","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Kirk et al., 2023] Robert Kirk, Amy Zhang, Edward Grefenstette, and Tim Rocktäschel. A survey of zero-shot generalisation in deep reinforcement learning. Journal of Artificial Intelligence Research, 76:201-264, 2023.","title":"A survey of zero-shot generalisation in deep reinforcement learning","authors":"Robert Kirk, Amy Zhang, Edward Grefenstette, Tim Rocktäschel","year":"2023","venue":"Journal of Artificial Intelligence Research","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Kober et al., 2013] Jens Kober, J. Andrew Bagnell, and Jan Peters. Reinforcement learning in robotics: A survey. The International Journal of Robotics Research, 32:1238 -1274, 2013.","title":"Reinforcement learning in robotics: A survey","authors":"Jens Kober, J Andrew Bagnell, Jan Peters","year":"2013","venue":"The International Journal of Robotics Research","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Leibo et al., 2021] Joel Z Leibo, Edgar A Dueñez-Guzman, Alexander Vezhnevets, John P Agapiou, Peter Sunehag, Raphael Koster, Jayd Matyas, Charlie Beattie, Igor Mor- datch, and Thore Graepel. Scalable evaluation of multi- agent reinforcement learning with melting pot. In Interna- tional conference on machine learning, pages 6187-6199.","title":"Scalable evaluation of multiagent reinforcement learning with melting pot","authors":"Edgar A Joel Z Leibo, Alexander Dueñez-Guzman, John P Vezhnevets, Peter Agapiou, Raphael Sunehag, Jayd Koster, Charlie Matyas, Igor Beattie, Thore Mordatch, Graepel","year":null,"venue":"International conference on machine learning","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"PMLR, 2021.","title":null,"authors":"Pmlr","year":"2021","venue":null,"doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Oh et al., 2017] Junhyuk Oh, Satinder Singh, Honglak Lee, and Pushmeet Kohli. Zero-shot task generalization with multi-task deep reinforcement learning. In International Conference on Machine Learning, pages 2661-2670.","title":"Zero-shot task generalization with multi-task deep reinforcement learning","authors":"Oh","year":"2017","venue":"International Conference on Machine Learning","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"PMLR, 2017.","title":null,"authors":"Pmlr","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Packer et al., 2018] Charles Packer, Katelyn Gao, Jernej Kos, Philipp Krähenbühl, Vladlen Koltun, and Dawn Song. Assessing generalization in deep reinforcement learning. arXiv preprint arXiv:1810.12282, 2018.","title":"Assessing generalization in deep reinforcement learning","authors":"Charles Packer, Katelyn Gao, Jernej Kos, Philipp Krähenbühl, Vladlen Koltun, Dawn Song","year":"2018","venue":null,"doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Schrittwieser et al., 2019] Julian Schrittwieser, Ioannis Antonoglou, Thomas Hubert, Karen Simonyan, L. Sifre, Simon Schmitt, Arthur Guez, Edward Lockhart, Demis Hassabis, Thore Graepel, Timothy P. Lillicrap, and David Silver. Mastering atari, go, chess and shogi by planning with a learned model. Nature, 588 7839:604-609, 2019.","title":"Mastering atari, go, chess and shogi by planning with a learned model","authors":"Julian Schrittwieser, Ioannis Antonoglou, Thomas Hubert, Karen Simonyan, L Sifre, Simon Schmitt, Arthur Guez, Edward Lockhart, Demis Hassabis, Thore Graepel, Timothy P Lillicrap, David Silver","year":"2019","venue":"Nature","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Shinde, 2021] Piyush N Shinde. Pygame: Develop games using python. International Journal for Research in Ap- plied Science and Engineering Technology, 2021.","title":"Pygame: Develop games using python","authors":"N Piyush, Shinde","year":"2021","venue":"International Journal for Research in Applied Science and Engineering Technology","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Shorten and Khoshgoftaar, 2019] Connor Shorten and Taghi M Khoshgoftaar. A survey on image data augmen- tation for deep learning. Journal of big data, 6(1):1-48, 2019.","title":"A survey on image data augmentation for deep learning","authors":"Connor Shorten, M Taghi, Khoshgoftaar","year":"2019","venue":"Journal of big data","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Silver et al., 2016] David Silver, Aja Huang, Chris J Maddi- son, Arthur Guez, Laurent Sifre, George Van Den Driess- che, Julian Schrittwieser, Ioannis Antonoglou, Veda Pan- neershelvam, Marc Lanctot, et al. Mastering the game of go with deep neural networks and tree search. nature, 529(7587):484-489, 2016.","title":"Mastering the game of go with deep neural networks and tree search","authors":"David Silver, Aja Huang, Chris J Maddison, Arthur Guez, Laurent Sifre, George Van Den, Marc Driessche, Lanctot","year":"2016","venue":"nature","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Silver et al., 2017] David Silver, Julian Schrittwieser, Karen Simonyan, Ioannis Antonoglou, Aja Huang, Arthur Guez, Thomas Hubert, Lucas Baker, Matthew Lai, Adrian Bolton, et al. Mastering the game of go without human knowledge. nature, 550(7676):354-359, 2017.","title":"Mastering the game of go without human knowledge","authors":"David Silver, Julian Schrittwieser, Karen Simonyan, Ioannis Antonoglou, Aja Huang, Arthur Guez, Thomas Hubert, Lucas Baker, Matthew Lai, Adrian Bolton","year":"2017","venue":"nature","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Song et al., 2024] Yan Song, He Jiang, Zheng Tian, Haifeng Zhang, Yingping Zhang, Jiangcheng Zhu, Zonghong Dai, Weinan Zhang, and Jun Wang. An empirical study on google research football multi-agent scenarios. Machine Intelligence Research, pages 1-22, 2024.","title":"An empirical study on google research football multi-agent scenarios","authors":"Yan Song, He Jiang, Zheng Tian, Haifeng Zhang, Yingping Zhang, Jiangcheng Zhu, Zonghong Dai, Weinan Zhang, Jun Wang","year":"2024","venue":"Machine Intelligence Research","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}