{"type":"ScholarlyArticle","title":"Social Motivation for Modelling Other Agents under Partial Observability in Decentralised Training","authors":[{"name":"Dung Nguyen","slug":"dung-nguyen","given":"Dung","family":"Nguyen","affiliation":"Applied Artificial Intelligence Institute (A I 2 ), Deakin University , Geelong , Australia"},{"name":"Hung Le","slug":"hung-le","given":"Hung","family":"Le","affiliation":"Applied Artificial Intelligence Institute (A I 2 ), Deakin University , Geelong , Australia"},{"name":"Kien Do","slug":"kien-do","given":"Kien","family":"Do","affiliation":"Applied Artificial Intelligence Institute (A I 2 ), Deakin University , Geelong , Australia"},{"name":"Svetha Venkatesh","slug":"svetha-venkatesh","given":"Svetha","family":"Venkatesh","affiliation":"Applied Artificial Intelligence Institute (A I 2 ), Deakin University , Geelong , Australia"},{"name":"Truyen Tran","slug":"truyen-tran","given":"Truyen","family":"Tran","affiliation":"Applied Artificial Intelligence Institute (A I 2 ), Deakin University , Geelong , Australia"}],"abstract":"Understanding other agents is a key challenge in constructing artificial social agents. Current works focus on centralised training, wherein agents are allowed to know all the information about others and the environmental state during training. In contrast, this work studies decentralised training, wherein agents must learn the model of other agents in order to cooperate with them under partially-observable conditions, even during training, i.e. learning agents are myopic. The intrinsic motivation for artificial agents is modelled on the concept of human social motivation that entices humans to meet and understand each other, especially when experiencing a utility loss. Our intrinsic motivation encourages agents to stay near each other to obtain better observations and construct a model of others. They do so when their model of other agents is poor, or the overall task performance is bad during the learning phase. This simple but effective method facilitates the processes of modelling others, resulting in an improvement of the performance in cooperative tasks significantly. Our experiments demonstrate that the socially-motivated agent can model others better and promote cooperation across different tasks.","doi":"10.24963/ijcai.2023/454","url":"https://ijcai.org/proceedings/2023/454","pdf":"https://ijcai.org/proceedings/2023/0454.pdf","markdown":"https://ijcai.org/proceedings/2023/454.md","bibtex":"https://ijcai.org/proceedings/2023/bibtex/454","volume":{"slug":"2023","title":"Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2023","url":"https://ijcai.org/proceedings/2023/","year":2023,"location":"Macao, SAR","dates":"19-25 August 2023","editors":"Edith Elkind","isbn":"978-1-956792-03-4","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2023"},"section":"Machine Learning","track":"Main Track","number":454,"pages":{"first":4082,"last":4090},"keywords":["Machine Learning: ML: Deep reinforcement learning","Agent-based and Multi-agent Systems: MAS: Other"],"videos":[],"references":[{"position":1,"raw":"[Albrecht and Stone, 2018] Stefano V Albrecht and Peter Stone. Autonomous agents modelling other agents: A comprehensive survey and open problems. Artificial In- telligence, 258:66-95, 2018.","title":"Autonomous agents modelling other agents: A comprehensive survey and open problems","authors":"V Stefano, Peter Albrecht, Stone","year":"2018","venue":"Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Barto, 2013] Andrew G Barto. Intrinsic motivation and re- inforcement learning. In Intrinsically motivated learning in natural and artificial systems, pages 17-47. Springer, 2013.","title":"Intrinsic motivation and reinforcement learning","authors":"G Andrew, Barto","year":"2013","venue":"Intrinsically motivated learning in natural and artificial systems","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Bellemare et al., 2016] Marc Bellemare, Sriram Srinivasan, Georg Ostrovski, Tom Schaul, David Saxton, and Remi Munos. Unifying count-based exploration and intrinsic motivation. NIPS, 29, 2016.","title":"Unifying count-based exploration and intrinsic motivation","authors":"Marc Bellemare, Sriram Srinivasan, Georg Ostrovski, Tom Schaul, David Saxton, Remi Munos","year":"2016","venue":"NIPS","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Berlyne, 1966] Daniel E Berlyne. Curiosity and explora- tion: Animals spend much of their time seeking stimuli whose significance raises problems for psychology. Sci- ence, 153(3731):25-33, 1966.","title":"Curiosity and exploration: Animals spend much of their time seeking stimuli whose significance raises problems for psychology","authors":"Daniel E Berlyne","year":"1966","venue":"Science","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Breazeal, 2004] Cynthia Breazeal. Designing sociable ro- bots. MIT press, 2004.","title":"Designing sociable robots","authors":"Cynthia Breazeal","year":"2004","venue":null,"doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Chitnis et al., 2019] Rohan Chitnis, Shubham Tulsiani, Saurabh Gupta, and Abhinav Gupta. Intrinsic motivation for encouraging synergistic behavior. In ICLR, 2019. [Christianos et al., 2020]","title":"Intrinsic motivation for encouraging synergistic behavior","authors":"Rohan Chitnis, Shubham Tulsiani, Saurabh Gupta, Abhinav Gupta","year":"2019","venue":"ICLR","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"Filippos Christianos, Lukas Schäfer, and Stefano V Albrecht. Shared experience actor-critic for multi-agent reinforcement learning. In NeurIPS, 2020.","title":"Shared experience actor-critic for multi-agent reinforcement learning","authors":"Filippos Christianos, Lukas Schäfer, Stefano V Albrecht","year":"2020","venue":"NeurIPS","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[de Witt et al., 2020] Christian Schroeder de Witt, Tarun Gupta, Denys Makoviichuk, Viktor Makoviychuk, Philip HS Torr, Mingfei Sun, and Shimon Whiteson. Is independent learning all you need in the Starcraft multi-agent challenge? arXiv preprint arXiv:2011.09533, 2020.","title":"Christian Schroeder de Witt","authors":"De Witt","year":"2020","venue":null,"doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Du et al., 2019] Yali Du, Lei Han, Meng Fang, Ji Liu, Tian- hong Dai, and Dacheng Tao. Liir: Learning individual intrinsic reward in multi-agent reinforcement learning. NeurIPS, 32, 2019.","title":"Liir: Learning individual intrinsic reward in multi-agent reinforcement learning","authors":"Yali Du, Lei Han, Meng Fang, Ji Liu, Tianhong Dai, Dacheng Tao","year":"2019","venue":"NeurIPS","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Eccles et al., 2019] Tom Eccles, Edward Hughes, János Kramár, Steven Wheelwright, and Joel Z Leibo. Learning reciprocity in complex sequential social dilemmas. arXiv preprint arXiv:1903.08082, 2019.","title":"Learning reciprocity in complex sequential social dilemmas","authors":"Eccles","year":"2019","venue":null,"doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Fayad and Ibrahim, 2021] Ammar Fayad and Majd Ibrahim. Influence-based reinforcement learning for intrinsically-motivated agents. arXiv preprint arXiv:2108.12581, 2021.","title":"Influence-based reinforcement learning for intrinsically-motivated agents","authors":"Ammar Fayad, Majd Ibrahim","year":"2021","venue":null,"doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Griesinger and Livingston Jr, 1973] Donald W Griesinger and James W Livingston Jr. Toward a model of interper- sonal motivation in experimental games. Behavioral sci- ence, 18(3):173-188, 1973.","title":"Toward a model of interpersonal motivation in experimental games","authors":"W Donald, James W Griesinger, Livingston","year":"1973","venue":"Behavioral science","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Gu et al., 2021] Pengjie Gu, Mengchen Zhao, Jianye Hao, and Bo An. Online ad hoc teamwork under partial observ- ability. In ICLR, 2021.","title":"Online ad hoc teamwork under partial observability","authors":"Gu","year":"2021","venue":"ICLR","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[He et al., 2016] He He, Jordan Boyd-Graber, Kevin Kwok, and Hal Daumé III. Opponent modeling in deep reinforce- ment learning. In ICML, pages 1804-1813. PMLR, 2016.","title":"Opponent modeling in deep reinforcement learning","authors":"He","year":"2016","venue":"ICML","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Hernandez-Leal et al., 2019] Pablo Hernandez-Leal, Bilal Kartal, and Matthew E Taylor. Agent modeling as aux- iliary task for deep reinforcement learning. In Proceed- ings of the AAAI conference on AI and interactive digital entertainment, volume 15, pages 31-37, 2019.","title":"Agent modeling as auxiliary task for deep reinforcement learning","authors":"Hernandez-Leal","year":"2019","venue":"Proceedings of the AAAI conference on AI and interactive digital entertainment","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Hughes et al., 2018] Edward Hughes, Joel Z Leibo, Mat- thew Phillips, Karl Tuyls, Edgar Dueñez-Guzman, Ant- onio García Castañeda, Iain Dunning, Tina Zhu, Kevin McKee, Raphael Koster, et al. Inequity aversion improves cooperation in intertemporal social dilemmas. NeurIPS, 31, 2018.","title":"Inequity aversion improves cooperation in intertemporal social dilemmas","authors":"Edward Hughes, Joel Z Leibo, Matthew Phillips, Karl Tuyls, Edgar Dueñez-Guzman, Antonio García Castañeda, Iain Dunning, Tina Zhu, Kevin Mckee, Raphael Koster","year":"2018","venue":"NeurIPS","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Hussenot et al., 2021] Léonard Hussenot, Robert Dadashi, Matthieu Geist, and Olivier Pietquin. Show me the way: Intrinsic motivation from demonstrations. In AAMAS, pages 620-628, 2021.","title":"Show me the way: Intrinsic motivation from demonstrations","authors":"Léonard Hussenot, Robert Dadashi, Matthieu Geist, Olivier Pietquin","year":"2021","venue":"AAMAS","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Iqbal and Sha, 2019] Shariq Iqbal and Fei Sha. Actor- attention-critic for multi-agent reinforcement learning. In ICML, pages 2961-2970. PMLR, 2019.","title":"Actorattention-critic for multi-agent reinforcement learning","authors":"Shariq Iqbal, Fei Sha","year":"2019","venue":"ICML","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Jaques et al., 2019] Natasha Jaques, Angeliki Lazar- idou, Edward Hughes, Caglar Gulcehre, Pedro Ortega, DJ Strouse, Joel Z Leibo, and Nando De Freitas. Social influence as intrinsic motivation for multi-agent deep reinforcement learning. In ICML, pages 3040-3049.","title":"Social influence as intrinsic motivation for multi-agent deep reinforcement learning","authors":"Natasha Jaques, Angeliki Lazaridou, Edward Hughes, Caglar Gulcehre, Pedro Ortega, Joel Z Strouse, Nando De Leibo, Freitas","year":null,"venue":"ICML","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"PMLR, 2019.","title":null,"authors":"Pmlr","year":"2019","venue":null,"doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Khan et al., 2018] Md Mohiuddin Khan, Kathryn Kas- marik, and Michael Barlow. Toward computational mo- tivation for multi-agent systems and swarms. Frontiers in Robotics and AI, 5:134, 2018.","title":"Toward computational motivation for multi-agent systems and swarms","authors":"Kathryn Md Mohiuddin Khan, Michael Kasmarik, Barlow","year":"2018","venue":"Frontiers in Robotics and AI","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Lerer and Peysakhovich, 2017] Adam Lerer and Alexander Peysakhovich. Maintaining cooperation in complex social dilemmas using deep reinforcement learning. arXiv pre- print arXiv:1707.01068, 2017.","title":"Maintaining cooperation in complex social dilemmas using deep reinforcement learning","authors":"Peysakhovich Lerer, Adam Lerer, Alexander Peysakhovich","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Liebrand and McClintock, 1988] Wim BG Liebrand and Charles G McClintock. The ring measure of social val- ues: A computerized procedure for assessing individual differences in information processing and social value ori- entation. European journal of personality, 2(3):217-230, 1988.","title":"The ring measure of social values: A computerized procedure for assessing individual differences in information processing and social value orientation","authors":"Mcclintock ; Wim Bg Liebrand, Charles G Liebrand, Mcclintock","year":"1988","venue":"European journal of personality","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Lowe et al., 2017] Ryan Lowe, Yi I Wu, Aviv Tamar, Jean Harb, OpenAI Pieter Abbeel, and Igor Mordatch. Multi- agent actor-critic for mixed cooperative-competitive envir- onments. NIPS, 30, 2017.","title":"Multiagent actor-critic for mixed cooperative-competitive environments","authors":"Ryan Lowe, Yi I Wu, Aviv Tamar, Jean Harb, Pieter Openai, Igor Abbeel, Mordatch","year":"2017","venue":"NIPS","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Ma et al., 2022] Zixian Ma, Rose E Wang, Li Fei-Fei, Mi- chael S Bernstein, and Ranjay Krishna. Elign: Expectation alignment as a multi-agent intrinsic reward. In NeurIPS, 2022.","title":"Elign: Expectation alignment as a multi-agent intrinsic reward","authors":"Zixian Ma, Rose E Wang, Li Fei-Fei, Michael S Bernstein, Ranjay Krishna","year":"2022","venue":"NeurIPS","doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[McKee et al., 2020] Kevin R McKee, Ian Gemp, Brian McWilliams, Edgar A Duèñez-Guzmán, Edward Hughes, and Joel Z Leibo. Social diversity and social preferences in mixed-motive reinforcement learning. In AAMAS, pages 869-877, 2020.","title":"Social diversity and social preferences in mixed-motive reinforcement learning","authors":"Ian Kevin R Mckee, Brian Gemp, Edgar A Mcwilliams, Edward Duèñez-Guzmán, Joel Z Hughes, Leibo","year":"2020","venue":"AAMAS","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Meyer and Wilson, 1991] Jean-Arcady Meyer and Stew- art W Wilson. A possibility for implementing curiosity and boredom in model-building neural controllers. MIT Press, 1991.","title":"A possibility for implementing curiosity and boredom in model-building neural controllers","authors":"Wilson ; Meyer, Arcady Meyer, Stewart W Wilson","year":"1991","venue":"Jean","doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[Mordatch and Abbeel, 2018] Igor Mordatch and Pieter Ab- beel. Emergence of grounded compositional language in multi-agent populations. In AAAI, volume 32, 2018.","title":"Igor Mordatch and Pieter Abbeel. Emergence of grounded compositional language in multi-agent populations","authors":"Abbeel Mordatch","year":"2018","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":29,"raw":"[Murphy and Ackermann, 2014] Ryan O Murphy and Kurt A Ackermann. Social value orientation: Theoretical and measurement issues in the study of social preferences. Personality and Social Psychology Review, 18(1):13-41, 2014.","title":"Social value orientation: Theoretical and measurement issues in the study of social preferences","authors":"O Ryan, Kurt A Murphy, Ackermann","year":"2014","venue":"Personality and Social Psychology Review","doi":null,"url":null,"internal_url":null},{"position":30,"raw":"[Ndousse et al., 2021] Kamal K Ndousse, Douglas Eck, Sergey Levine, and Natasha Jaques. Emergent social learning via multi-agent reinforcement learning. In ICML, pages 7991-8004. PMLR, 2021.","title":"Emergent social learning via multi-agent reinforcement learning","authors":"Douglas Kamal K Ndousse, Sergey Eck, Natasha Levine, Jaques","year":"2021","venue":"ICML","doi":null,"url":null,"internal_url":null},{"position":31,"raw":"[Oudeyer and Kaplan, 2009] Pierre-Yves Oudeyer and Fre- deric Kaplan. What is intrinsic motivation? A typology of computational approaches. Frontiers in neurorobotics, page 6, 2009.","title":"What is intrinsic motivation? A typology of computational approaches","authors":"Kaplan ; Pierre-Yves Oudeyer, Frederic Oudeyer, Kaplan","year":"2009","venue":"Frontiers in neurorobotics","doi":null,"url":null,"internal_url":null},{"position":32,"raw":"[Papoudakis and Albrecht, 2020] Georgios Papoudakis and Stefano V Albrecht. Variational autoencoders for op- ponent modeling in multi-agent systems. arXiv preprint arXiv:2001.10829, 2020.","title":"Variational autoencoders for opponent modeling in multi-agent systems","authors":"Georgios Papoudakis, Stefano V Albrecht","year":"2020","venue":null,"doi":null,"url":null,"internal_url":null},{"position":33,"raw":"[Papoudakis et al., 2021] Georgios Papoudakis, Filippos Christianos, and Stefano Albrecht. Agent modelling under partial observability for deep reinforcement learning. NeurIPS, 34:19210-19222, 2021.","title":"Agent modelling under partial observability for deep reinforcement learning","authors":"Georgios Papoudakis, Filippos Christianos, Stefano Albrecht","year":"2021","venue":"NeurIPS","doi":null,"url":null,"internal_url":null},{"position":34,"raw":"[Pathak et al., 2017] Deepak Pathak, Pulkit Agrawal, Alexei A Efros, and Trevor Darrell. Curiosity-driven exploration by self-supervised prediction. In ICML, pages 2778-2787. PMLR, 2017.","title":"Curiosity-driven exploration by self-supervised prediction","authors":"Deepak Pathak, Pulkit Agrawal, Alexei A Efros, Trevor Darrell","year":"2017","venue":"ICML","doi":null,"url":null,"internal_url":null},{"position":35,"raw":"[Pittman and Pittman, 1980] Thane S Pittman and Nancy L Pittman. Deprivation of control and the attribution process. Journal of Personality and Social Psychology, 39(3):377, 1980.","title":"Deprivation of control and the attribution process","authors":"S Thane, Nancy L Pittman, Pittman","year":"1980","venue":"Journal of Personality and Social Psychology","doi":null,"url":null,"internal_url":null},{"position":36,"raw":"[Qu et al., 2019] Chao Qu, Shie Mannor, Huan Xu, Yuan Qi, Le Song, and Junwu Xiong. Value propagation for decent- ralized networked deep multi-agent reinforcement learn- ing. NeurIPS, 32, 2019.","title":"Value propagation for decentralized networked deep multi-agent reinforcement learning","authors":"Chao Qu, Shie Mannor, Huan Xu, Yuan Qi, Le Song, Junwu Xiong","year":"2019","venue":"NeurIPS","doi":null,"url":null,"internal_url":null},{"position":37,"raw":"[Rabinowitz et al., 2018] Neil Rabinowitz, Frank Perbet, Francis Song, Chiyuan Zhang, SM Ali Eslami, and Mat- thew Botvinick. Machine theory of mind. In ICML, pages 4218-4227. PMLR, 2018.","title":"Machine theory of mind","authors":"Neil Rabinowitz, Frank Perbet, Francis Song, Chiyuan Zhang, S M Ali Eslami, Matthew Botvinick","year":"2018","venue":"ICML","doi":null,"url":null,"internal_url":null},{"position":38,"raw":"[Raileanu et al., 2018] Roberta Raileanu, Emily Denton, Ar- thur Szlam, and Rob Fergus. Modeling others using one- self in multi-agent reinforcement learning. In ICML, pages 4257-4266. PMLR, 2018.","title":"Modeling others using oneself in multi-agent reinforcement learning","authors":"Roberta Raileanu, Emily Denton, Arthur Szlam, Rob Fergus","year":"2018","venue":"ICML","doi":null,"url":null,"internal_url":null},{"position":39,"raw":"[Schmidhuber, 1990] Jürgen Schmidhuber. Making the world differentiable: On using fully recurrent self- supervised neural networks for dynamic reinforcement learning and planning in non-stationary environments. In- stitut für Informatik, Technische Universität München. Technical Report FKI-126, 90, 1990.","title":"Making the world differentiable: On using fully recurrent selfsupervised neural networks for dynamic reinforcement learning and planning in non-stationary environments","authors":"Jürgen Schmidhuber","year":"1990","venue":null,"doi":null,"url":null,"internal_url":null},{"position":40,"raw":"[Schwarting et al., 2019] Wilko Schwarting, Alyssa Pier- son, Javier Alonso-Mora, Sertac Karaman, and Daniela Rus. Social behavior for autonomous vehicles. PNAS, 116(50):24972-24978, 2019.","title":"Social behavior for autonomous vehicles","authors":"Wilko Schwarting, Alyssa Pierson, Javier Alonso-Mora, Sertac Karaman, Daniela Rus","year":"2019","venue":"PNAS","doi":null,"url":null,"internal_url":null},{"position":41,"raw":"[Swann et al., 1981] William B Swann, Blair Stephenson, and Thane S Pittman. Curiosity and control: On the de- terminants of the search for social knowledge. Journal of Personality and Social Psychology, 40(4):635, 1981.","title":"Curiosity and control: On the determinants of the search for social knowledge","authors":"Blair William B Swann, Thane S Stephenson, Pittman","year":"1981","venue":"Journal of Personality and Social Psychology","doi":null,"url":null,"internal_url":null},{"position":42,"raw":"[Tan, 1993] Ming Tan. Multi-agent reinforcement learning: Independent vs. cooperative agents. In ICML, pages 330- 337, 1993.","title":"Multi-agent reinforcement learning: Independent vs. cooperative agents","authors":"Ming Tan","year":"1993","venue":"ICML","doi":null,"url":null,"internal_url":null},{"position":43,"raw":"[Tang et al., 2017] Haoran Tang, Rein Houthooft, Davis Foote, Adam Stooke, OpenAI Xi Chen, Yan Duan, John Schulman, Filip DeTurck, and Pieter Abbeel. # explor- ation: A study of count-based exploration for deep rein- forcement learning. NIPS, 30, 2017.","title":"# exploration: A study of count-based exploration for deep reinforcement learning","authors":"Haoran Tang, Rein Houthooft, Davis Foote, Adam Stooke, Openai Xi Chen, Yan Duan, John Schulman, Filip Deturck, Pieter Abbeel","year":"2017","venue":"NIPS","doi":null,"url":null,"internal_url":null},{"position":44,"raw":"[Tomasello, 2009] Michael Tomasello. Why we cooperate. MIT press, 2009.","title":"Why we cooperate","authors":"Michael Tomasello","year":"2009","venue":null,"doi":null,"url":null,"internal_url":null},{"position":45,"raw":"[Wang et al., 2019] Tonghan Wang, Jianhao Wang, Yi Wu, and Chongjie Zhang. Influence-based multi-agent explor- ation. In ICLR, 2019.","title":"Influence-based multi-agent exploration","authors":"Wang","year":"2019","venue":"ICLR","doi":null,"url":null,"internal_url":null},{"position":46,"raw":"[Wen et al., 2021] Ying Wen, Yaodong Yang, and Jun Wang. Modelling bounded rationality in multi-agent interactions by generalized recursive reasoning. In IJCAI, pages 414- 421, 2021.","title":"Modelling bounded rationality in multi-agent interactions by generalized recursive reasoning","authors":"Ying Wen, Yaodong Yang, Jun Wang","year":"2021","venue":"IJCAI","doi":null,"url":null,"internal_url":"/proceedings/2020/58"},{"position":47,"raw":"[White, 1959] Robert W White. Motivation reconsidered: the concept of competence. Psychological review, 66(5):297, 1959.","title":"Motivation reconsidered: the concept of competence","authors":"Robert W White","year":"1959","venue":"Psychological review","doi":null,"url":null,"internal_url":null},{"position":48,"raw":"[Yoo et al., 2022] Byunghyun Yoo, Devarani Devi Ningom- bam, Sungwon Yi, Hyun Woo Kim, Euisok Chung, Ran Han, and Hwa Jeon Song. A novel and efficient influence- seeking exploration in deep multiagent reinforcement learning. IEEE Access, 10:47741-47753, 2022.","title":"A novel and efficient influenceseeking exploration in deep multiagent reinforcement learning","authors":"Yoo","year":"2022","venue":"IEEE Access","doi":null,"url":null,"internal_url":null},{"position":49,"raw":"[Zhang et al., 2018] Kaiqing Zhang, Zhuoran Yang, Han Liu, Tong Zhang, and Tamer Basar. Fully decentral- ized multi-agent reinforcement learning with networked agents. In ICML, pages 5872-5881. PMLR, 2018.","title":"Fully decentralized multi-agent reinforcement learning with networked agents","authors":"Zhang","year":"2018","venue":"ICML","doi":null,"url":null,"internal_url":null},{"position":50,"raw":"[Zhang et al., 2021] Minghao Zhang, Pingcheng Jian, Yi Wu, Huazhe Xu, and Xiaolong Wang. Dair: Dis- entangled attention intrinsic regularization for safe and efficient bimanual manipulation. arXiv preprint arXiv:2106.05907, 2021.","title":"Dair: Disentangled attention intrinsic regularization for safe and efficient bimanual manipulation","authors":"Minghao Zhang, Pingcheng Jian, Yi Wu, Huazhe Xu, Xiaolong Wang","year":"2021","venue":null,"doi":null,"url":null,"internal_url":null},{"position":51,"raw":"[Zheng et al., 2021] Lulu Zheng, Jiarui Chen, Jianhao Wang, Jiamin He, Yujing Hu, Yingfeng Chen, Changjie Fan, Yang Gao, and Chongjie Zhang. Episodic multi-agent reinforcement learning with curiosity-driven exploration. NeurIPS, 34:3757-3769, 2021.","title":"Episodic multi-agent reinforcement learning with curiosity-driven exploration","authors":"Lulu Zheng, Jiarui Chen, Jianhao Wang, Jiamin He, Yujing Hu, Yingfeng Chen, Changjie Fan, Yang Gao, Chongjie Zhang","year":"2021","venue":"NeurIPS","doi":null,"url":null,"internal_url":null},{"position":52,"raw":"[Zintgraf et al., 2019] Luisa Zintgraf, Kyriacos Shiarlis, Maximilian Igl, Sebastian Schulze, Yarin Gal, Katja Hof- mann, and Shimon Whiteson. Varibad: A very good method for bayes-adaptive deep reinforcement learning via meta-learning. In ICLR, 2019.","title":"Varibad: A very good method for bayes-adaptive deep reinforcement learning via meta-learning","authors":"Luisa Zintgraf, Kyriacos Shiarlis, Maximilian Igl, Sebastian Schulze, Yarin Gal, Katja Hofmann, Shimon Whiteson","year":"2019","venue":"ICLR","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}