{"type":"ScholarlyArticle","title":"Large Decision Models","authors":[{"name":"Weinan Zhang","slug":"weinan-zhang","given":"Weinan","family":"Zhang","affiliation":"University"}],"abstract":"Over recent decades, sequential decision-making tasks are mostly tackled with expert systems and reinforcement learning. However, these methods are still incapable of being generalizable enough to solve new tasks at a low cost. In this article, we discuss a novel paradigm that leverages Transformer-based sequence models to tackle decision-making tasks, named large decision models. Starting from offline reinforcement learning scenarios, early attempts demonstrate that sequential modeling methods can be applied to train an effective policy given sufficient expert trajectories. When the sequence model goes large, its generalization ability over a variety of tasks and fast adaptation to new tasks has been observed, which is highly potential to enable the agent to achieve artificial general intelligence for sequential decision-making in the near future.","doi":"10.24963/ijcai.2023/808","url":"https://ijcai.org/proceedings/2023/808","pdf":"https://ijcai.org/proceedings/2023/0808.pdf","markdown":"https://ijcai.org/proceedings/2023/808.md","bibtex":"https://ijcai.org/proceedings/2023/bibtex/808","volume":{"slug":"2023","title":"Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2023","url":"https://ijcai.org/proceedings/2023/","year":2023,"location":"Macao, SAR","dates":"19-25 August 2023","editors":"Edith Elkind","isbn":"978-1-956792-03-4","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2023"},"section":"Early Career","track":"Early Career","number":808,"pages":{"first":7062,"last":7067},"keywords":["EC: Reinforcement Learning","EC: Multiagent Systems"],"videos":[],"references":[{"position":1,"raw":"[Achterberg and Wunderling, 2013] Tobias Achterberg and Roland Wunderling. Mixed integer programming: Ana- lyzing 12 years of progress. Facets of Combinatorial Op- timization: Festschrift for Martin Grötschel, pages 449- 481, 2013.","title":"Mixed integer programming: Analyzing 12 years of progress","authors":"Wunderling Achterberg, Tobias Achterberg, Roland Wunderling","year":"2013","venue":"Facets of Combinatorial Optimization: Festschrift for Martin Grötschel","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Billard and Kragic, 2019] Aude Billard and Danica Kragic. Trends and challenges in robot manipulation. Science, 364(6446):eaat8414, 2019.","title":"Aude Billard and Danica Kragic. Trends and challenges in robot manipulation","authors":"Kragic Billard","year":"2019","venue":"Science","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Bohanec and Rajkovic, 1990] Marko Bohanec and V Ra- jkovic. Expert system for decision making. Sistemica, 1(1):145-157, 1990.","title":"Marko Bohanec and V Rajkovic. Expert system for decision making","authors":"Rajkovic Bohanec","year":"1990","venue":"Sistemica","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Brown and Sandholm, 2019] Noam Brown and Tuomas Sandholm. Superhuman ai for multiplayer poker. Science, 365(6456):885-890, 2019.","title":"Noam Brown and Tuomas Sandholm. Superhuman ai for multiplayer poker","authors":"Sandholm Brown","year":"2019","venue":"Science","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Brown et al., 2020] Tom Brown, Benjamin Mann, Nick Ry- der, Melanie Subbiah, Jared D Kaplan, Prafulla Dhari- wal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. Language models are few-shot learners. Advances in neural information processing sys- tems, 33:1877-1901, 2020.","title":"Language models are few-shot learners","authors":"Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell","year":"2020","venue":"Advances in neural information processing systems","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Chen et al., 2020] Xinyue Chen, Zijian Zhou, Zheng Wang, Che Wang, Yanqiu Wu, and Keith Ross. Bail: Best- action imitation learning for batch deep reinforcement learning. Advances in Neural Information Processing Sys- tems, 33:18353-18363, 2020.","title":"Bail: Bestaction imitation learning for batch deep reinforcement learning","authors":"Xinyue Chen, Zijian Zhou, Zheng Wang, Che Wang, Yanqiu Wu, Keith Ross","year":"2020","venue":"Advances in Neural Information Processing Systems","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Chen et al., 2021] Lili Chen, Kevin Lu, Aravind Ra- jeswaran, Kimin Lee, Aditya Grover, Misha Laskin, Pieter Abbeel, Aravind Srinivas, and Igor Mordatch. Decision transformer: Reinforcement learning via sequence model- ing. Advances in neural information processing systems, 34:15084-15097, 2021.","title":"Decision transformer: Reinforcement learning via sequence modeling","authors":"Lili Chen, Kevin Lu, Aravind Rajeswaran, Kimin Lee, Aditya Grover, Misha Laskin, Pieter Abbeel, Aravind Srinivas, Igor Mordatch","year":"2021","venue":"Advances in neural information processing systems","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Churchill et al., 2012] David Churchill, Abdallah Saffidine, and Michael Buro. Fast heuristic search for rts game com- bat scenarios. In Proceedings of the AAAI conference on artificial intelligence and interactive digital entertain- ment, volume 8, pages 112-117, 2012.","title":"Fast heuristic search for rts game combat scenarios","authors":"David Churchill, Abdallah Saffidine, Michael Buro","year":"2012","venue":"Proceedings of the AAAI conference on artificial intelligence and interactive digital entertainment","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Driess et al., 2023] Danny Driess, Fei Xia, Mehdi S. M. Sajjadi, Corey Lynch, Aakanksha Chowdhery, Brian Ichter, Ayzaan Wahid, Jonathan Tompson, Quan Vuong, Tianhe Yu, Wenlong Huang, Yevgen Chebotar, Pierre Ser- manet, Daniel Duckworth, Sergey Levine, Vincent Van- houcke, Karol Hausman, Marc Toussaint, Klaus Greff, Andy Zeng, Igor Mordatch, and Pete Florence. Palm- e: An embodied multimodal language model. In arXiv preprint arXiv:2303.03378, 2023.","title":"Palme: An embodied multimodal language model","authors":"Danny Driess, Fei Xia, S M Mehdi, Corey Sajjadi, Aakanksha Lynch, Brian Chowdhery, Ayzaan Ichter, Jonathan Wahid, Quan Tompson, Tianhe Vuong, Wenlong Yu, Yevgen Huang, Pierre Chebotar, Daniel Sermanet, Sergey Duckworth, Vincent Levine, Karol Vanhoucke, Marc Hausman, Klaus Toussaint, Andy Greff, Igor Zeng, Pete Mordatch, Florence","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[He et al., 2016] Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. Deep residual learning for image recog- nition. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 770-778, 2016.","title":"Deep residual learning for image recognition","authors":"He","year":"2016","venue":"Proceedings of the IEEE conference on computer vision and pattern recognition","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Janner et al., 2021] Michael Janner, Qiyang Li, and Sergey Levine. Offline reinforcement learning as one big se- quence modeling problem. Advances in neural informa- tion processing systems, 34:1273-1286, 2021.","title":"Offline reinforcement learning as one big sequence modeling problem","authors":"Michael Janner, Qiyang Li, Sergey Levine","year":"2021","venue":"Advances in neural information processing systems","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Jin et al., 2018] Junqi Jin, Chengru Song, Han Li, Kun Gai, Jun Wang, and Weinan Zhang. Real-time bidding with multi-agent reinforcement learning in display advertising. In Proceedings of the 27th ACM international conference on information and knowledge management, pages 2193- 2201, 2018.","title":"Real-time bidding with multi-agent reinforcement learning in display advertising","authors":"Jin","year":"2018","venue":"Proceedings of the 27th ACM international conference on information and knowledge management","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Kenton and Toutanova, 2019] Jacob Devlin Ming- Wei Chang Kenton and Lee Kristina Toutanova. Bert: Pre-training of deep bidirectional transformers for lan- guage understanding. In Proceedings of NAACL-HLT, pages 4171-4186, 2019.","title":"Bert: Pre-training of deep bidirectional transformers for language understanding","authors":"Jacob Devlin, Ming-Wei Chang, Kenton, Lee Kristina, Toutanova","year":"2019","venue":"Proceedings of NAACL-HLT","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Lai et al., 2022] Hang Lai, Weinan Zhang, Xialin He, Chen Yu, Zheng Tian, Yong Yu, and Jun Wang. Sim-to- real transfer for quadrupedal locomotion via terrain trans- former. arXiv preprint arXiv:2212.07740, 2022.","title":"Sim-toreal transfer for quadrupedal locomotion via terrain transformer","authors":"Hang Lai, Weinan Zhang, Xialin He, Chen Yu, Zheng Tian, Yong Yu, Jun Wang","year":"2022","venue":null,"doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Lee et al., 2020] Joonho Lee, Jemin Hwangbo, Lorenz Wellhausen, Vladlen Koltun, and Marco Hutter. Learning quadrupedal locomotion over challenging terrain. Science robotics, 5(47):eabc5986, 2020.","title":"Learning quadrupedal locomotion over challenging terrain","authors":"Lee","year":"2020","venue":"Science robotics","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Li et al., 2019] Minne Li, Zhiwei Qin, Yan Jiao, Yaodong Yang, Jun Wang, Chenxi Wang, Guobin Wu, and Jieping Ye. Efficient ridesharing order dispatching with mean field multi-agent reinforcement learning. In The world wide web conference, pages 983-994, 2019.","title":"Efficient ridesharing order dispatching with mean field multi-agent reinforcement learning","authors":"Minne Li, Zhiwei Qin, Yan Jiao, Yaodong Yang, Jun Wang, Chenxi Wang, Guobin Wu, Jieping Ye","year":"2019","venue":"The world wide web conference","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Liang et al., 2022] Jacky Liang, Wenlong Huang, Fei Xia, Peng Xu, Karol Hausman, Brian Ichter, Pete Florence, and Andy Zeng. Code as policies: Language model programs for embodied control. arXiv preprint arXiv:2209.07753, 2022.","title":"Code as policies: Language model programs for embodied control","authors":"Jacky Liang, Wenlong Huang, Fei Xia, Peng Xu, Karol Hausman, Brian Ichter, Pete Florence, Andy Zeng","year":"2022","venue":null,"doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Liu et al., 2022] Minghuan Liu, Menghui Zhu, and Weinan Zhang. Goal-conditioned reinforcement learning: Prob- lems and solutions. IJCAI, 2022.","title":"Goal-conditioned reinforcement learning: Problems and solutions","authors":"Liu","year":"2022","venue":null,"doi":null,"url":null,"internal_url":"/proceedings/2022/770"},{"position":19,"raw":"[Lowe et al., 2017] Ryan Lowe, Yi I Wu, Aviv Tamar, Jean Harb, OpenAI Pieter Abbeel, and Igor Mordatch. Multi- agent actor-critic for mixed cooperative-competitive envi- ronments. Advances in neural information processing sys- tems, 30, 2017.","title":"Multiagent actor-critic for mixed cooperative-competitive environments","authors":"Ryan Lowe, Yi I Wu, Aviv Tamar, Jean Harb, Pieter Openai, Igor Abbeel, Mordatch","year":"2017","venue":"Advances in neural information processing systems","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Meng et al., 2021] Linghui Meng, Muning Wen, Yaodong Yang, Chenyang Le, Xiyun Li, Weinan Zhang, Ying Wen, Haifeng Zhang, Jun Wang, and Bo Xu. Offline pre- trained multi-agent decision transformer: One big se- quence model conquers all starcraftii tasks. arXiv preprint arXiv:2112.02845, 2021.","title":"Offline pretrained multi-agent decision transformer: One big sequence model conquers all starcraftii tasks","authors":"Linghui Meng, Muning Wen, Yaodong Yang, Chenyang Le, Xiyun Li, Weinan Zhang, Ying Wen, Haifeng Zhang, Jun Wang, Bo Xu","year":"2021","venue":null,"doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Mnih et al., 2015] Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Andrei A Rusu, Joel Veness, Marc G Belle- mare, Alex Graves, Martin Riedmiller, Andreas K Fidje- land, Georg Ostrovski, et al. Human-level control through deep reinforcement learning. nature, 518(7540):529-533, 2015.","title":"Human-level control through deep reinforcement learning","authors":"Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Andrei A Rusu, Joel Veness, Marc G Bellemare, Alex Graves, Martin Riedmiller, Andreas K Fidjeland, Georg Ostrovski","year":"2015","venue":"nature","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Munemasa et al., 2018] Isshu Munemasa, Yuta Tomo- matsu, Kunioki Hayashi, and Tomohiro Takagi. Deep re- inforcement learning for recommender systems. In 2018 international conference on information and communica- tions technology (icoiact), pages 226-233. IEEE, 2018.","title":"Isshu Munemasa, Yuta Tomo","authors":"Munemasa","year":"2018","venue":"2018 international conference on information and communications technology (icoiact)","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Park et al., 2023] Joon Sung Park, Joseph C O'Brien, Car- rie J Cai, Meredith Ringel Morris, Percy Liang, and Michael S Bernstein. Generative agents: Interac- tive simulacra of human behavior. arXiv preprint arXiv:2304.03442, 2023.","title":"Generative agents: Interactive simulacra of human behavior","authors":"Sung Joon, Park, C O' Joseph, Carrie J Brien, Meredith Ringel Cai, Percy Morris, Michael S Liang, Bernstein","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Peng et al., 2019] Xue Bin Peng, Aviral Kumar, Grace Zhang, and Sergey Levine. Advantage-weighted regres- sion: Simple and scalable off-policy reinforcement learn- ing. arXiv preprint arXiv:1910.00177, 2019.","title":"Advantage-weighted regression: Simple and scalable off-policy reinforcement learning","authors":"Xue Bin Peng, Aviral Kumar, Grace Zhang, Sergey Levine","year":"2019","venue":null,"doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Phillips-Wren and Jain, 2006] Gloria Phillips-Wren and Lakhmi Jain. Artificial intelligence for decision mak- ing. In Knowledge-Based Intelligent Information and Engineering Systems: 10th International Conference, KES 2006, Bournemouth, UK, October 9-11, 2006. Proceedings, Part II 10, pages 531-536. Springer, 2006.","title":"Artificial intelligence for decision making","authors":"Jain Phillips-Wren, Gloria Phillips-Wren, Lakhmi Jain","year":"2006","venue":"Knowledge-Based Intelligent Information and Engineering Systems: 10th International Conference, KES 2006","doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Radford et al., 2019] Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, et al. Language models are unsupervised multitask learners. OpenAI blog, 1(8):9, 2019.","title":"Language models are unsupervised multitask learners","authors":"Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever","year":"2019","venue":"OpenAI blog","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Reed et al., 2022] Scott Reed, Konrad Zolna, Emilio Parisotto, Sergio Gomez Colmenarejo, Alexander Novikov, Gabriel Barth-Maron, Mai Gimenez, Yury Sulsky, Jackie Kay, Jost Tobias Springenberg, et al. A generalist agent. arXiv preprint arXiv:2205.06175, 2022.","title":"A generalist agent","authors":"Scott Reed, Konrad Zolna, Emilio Parisotto, Sergio Gomez Colmenarejo, Alexander Novikov, Gabriel Barth-Maron, Mai Gimenez, Yury Sulsky, Jackie Kay, Jost Tobias Springenberg","year":"2022","venue":null,"doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[Schaeffer and Van den Herik, 2002] Jonathan Schaeffer and H Jaap Van den Herik. Games, computers, and artificial intelligence. Artificial intelligence, 134(1-2):1-7, 2002.","title":"Games, computers, and artificial intelligence","authors":"Van Schaeffer, Jonathan Den Herik, H Jaap Schaeffer, Van Den, Herik","year":"2002","venue":"Artificial intelligence","doi":null,"url":null,"internal_url":null},{"position":29,"raw":"[Schubert and others, 2023] Ingmar Schubert et al. A gen- eralist dynamics model for control. arXiv preprint arXiv:2305.10912, 2023.","title":"Ingmar Schubert et al. A generalist dynamics model for control","authors":"Others Schubert","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":30,"raw":"[Schulman et al., 2017] John Schulman, Filip Wolski, Pra- fulla Dhariwal, Alec Radford, and Oleg Klimov. Prox- imal policy optimization algorithms. arXiv preprint arXiv:1707.06347, 2017.","title":"Proximal policy optimization algorithms","authors":"John Schulman, Filip Wolski, Prafulla Dhariwal, Alec Radford, Oleg Klimov","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":31,"raw":"[Schwarting et al., 2019] Wilko Schwarting, Alyssa Pierson, Javier Alonso-Mora, Sertac Karaman, and Daniela Rus. Social behavior for autonomous vehicles. Proceedings of the National Academy of Sciences, 116(50):24972-24978, 2019.","title":"Social behavior for autonomous vehicles","authors":"Wilko Schwarting, Alyssa Pierson, Javier Alonso-Mora, Sertac Karaman, Daniela Rus","year":"2019","venue":"Proceedings of the National Academy of Sciences","doi":null,"url":null,"internal_url":null},{"position":32,"raw":"[Silver et al., 2016] David Silver, Aja Huang, Chris J Maddi- son, Arthur Guez, Laurent Sifre, George Van Den Driess- che, Julian Schrittwieser, Ioannis Antonoglou, Veda Pan- neershelvam, Marc Lanctot, et al. Mastering the game of go with deep neural networks and tree search. nature, 529(7587):484-489, 2016.","title":"Mastering the game of go with deep neural networks and tree search","authors":"David Silver, Aja Huang, Chris J Maddison, Arthur Guez, Laurent Sifre, George Van Den, Marc Driessche, Lanctot","year":"2016","venue":"nature","doi":null,"url":null,"internal_url":null},{"position":33,"raw":"[Srivastava et al., 2019] Rupesh Kumar Srivastava, Pranav Shyam, Filipe Mutz, Wojciech Jaśkowski, and Jürgen Schmidhuber. Training agents using upside-down rein- forcement learning. arXiv preprint arXiv:1912.02877, 2019.","title":"Training agents using upside-down reinforcement learning","authors":"Rupesh Kumar Srivastava, Pranav Shyam, Filipe Mutz, Wojciech Jaśkowski, Jürgen Schmidhuber","year":"2019","venue":null,"doi":null,"url":null,"internal_url":null},{"position":34,"raw":"[Sutton and Barto, 2018] Richard S Sutton and Andrew G Barto. Reinforcement learning: An introduction. MIT press, 2018.","title":"Reinforcement learning: An introduction","authors":"S Richard, Andrew G Sutton, Barto","year":"2018","venue":null,"doi":null,"url":null,"internal_url":null},{"position":35,"raw":"[Team et al., 2023] Adaptive Agent Team, Jakob Bauer, Kate Baumli, Satinder Baveja, Feryal Behbahani, Avishkar Bhoopchand, Nathalie Bradley-Schmieg, Michael Chang, Natalie Clay, Adrian Collister, et al. Human-timescale adaptation in an open-ended task space. arXiv preprint arXiv:2301.07608, 2023.","title":"Human-timescale adaptation in an open-ended task space","authors":"Team","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":36,"raw":"[Vemprala et al., 2023] Sai Vemprala, Rogerio Bonatti, Arthur Bucker, and Ashish Kapoor. Chatgpt for robotics: Design principles and model abilities. Microsoft Technical Report, 2023.","title":"Chatgpt for robotics: Design principles and model abilities","authors":"Vemprala","year":"2023","venue":null,"doi":null,"url":null,"internal_url":null},{"position":37,"raw":"[Vinyals et al., 2019] Oriol Vinyals, Igor Babuschkin, Jun- young Chung, Michael Mathieu, Max Jaderberg, Woj- ciech M Czarnecki, Andrew Dudzik, Aja Huang, Petko Georgiev, Richard Powell, et al. Alphastar: Mastering the real-time strategy game starcraft ii. DeepMind blog, 2:20, 2019.","title":"Alphastar: Mastering the real-time strategy game starcraft ii","authors":"Oriol Vinyals, Igor Babuschkin, Junyoung Chung, Michael Mathieu, Max Jaderberg, Wojciech M Czarnecki, Andrew Dudzik, Aja Huang, Petko Georgiev, Richard Powell","year":"2019","venue":"DeepMind blog","doi":null,"url":null,"internal_url":null},{"position":38,"raw":"[Wang et al., 2020] Ziyu Wang, Alexander Novikov, Kon- rad Zolna, Josh S Merel, Jost Tobias Springenberg, Scott E Reed, Bobak Shahriari, Noah Siegel, Caglar Gul- cehre, Nicolas Heess, et al. Critic regularized regres- sion. Advances in Neural Information Processing Systems, 33:7768-7778, 2020.","title":"Critic regularized regression","authors":"Ziyu Wang, Alexander Novikov, Konrad Zolna, Josh S Merel, Jost Tobias Springenberg, Scott E Reed, Bobak Shahriari, Noah Siegel, Caglar Gulcehre, Nicolas Heess","year":"2020","venue":"Advances in Neural Information Processing Systems","doi":null,"url":null,"internal_url":null},{"position":39,"raw":"[Wen et al., 2022a] Muning Wen, Jakub Kuba, Runji Lin, Weinan Zhang, Ying Wen, Jun Wang, and Yaodong Yang. Multi-agent reinforcement learning is a sequence model- ing problem. Advances in Neural Information Processing Systems, 35:16509-16521, 2022.","title":"Multi-agent reinforcement learning is a sequence modeling problem","authors":"Wen","year":"2022","venue":"Advances in Neural Information Processing Systems","doi":null,"url":null,"internal_url":null},{"position":40,"raw":"[Wen et al., 2022b] Ying Wen, Ziyu Wan, Ming Zhou, Sh- ufang Hou, Zhe Cao, Chenyang Le, Jingxiao Chen, Zheng Tian, Weinan Zhang, and Jun Wang. On realiza- tion of intelligent decision-making in the real world: A foundation decision model perspective. arXiv preprint arXiv:2212.12669, 2022.","title":"On realization of intelligent decision-making in the real world: A foundation decision model perspective","authors":"Wen","year":"2022","venue":null,"doi":null,"url":null,"internal_url":null},{"position":41,"raw":"[Ye et al., 2020] Deheng Ye, Zhao Liu, Mingfei Sun, Bei Shi, Peilin Zhao, Hao Wu, Hongsheng Yu, Shaojie Yang, Xipeng Wu, Qingwei Guo, et al. Mastering complex con- trol in moba games with deep reinforcement learning. In Proceedings of the AAAI Conference on Artificial Intelli- gence, volume 34, pages 6672-6679, 2020.","title":"Mastering complex control in moba games with deep reinforcement learning","authors":"Ye","year":"2020","venue":"Proceedings of the AAAI Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":42,"raw":"[Yu et al., 2021] Chao Yu, Jiming Liu, Shamim Nemati, and Guosheng Yin. Reinforcement learning in healthcare: A survey. ACM Computing Surveys (CSUR), 55(1):1-36, 2021.","title":"Reinforcement learning in healthcare: A survey","authors":"Chao Yu, Jiming Liu, Shamim Nemati, Guosheng Yin","year":"2021","venue":"ACM Computing Surveys (CSUR)","doi":null,"url":null,"internal_url":null},{"position":43,"raw":"[Yu et al., 2022] Chen Yu, Weinan Zhang, Hang Lai, Zheng Tian, Laurent Kneip, and Jun Wang. Multi-embodiment legged robot control as a sequence modeling problem. arXiv preprint arXiv:2212.09078, 2022.","title":"Multi-embodiment legged robot control as a sequence modeling problem","authors":"Chen Yu, Weinan Zhang, Hang Lai, Zheng Tian, Laurent Kneip, Jun Wang","year":"2022","venue":null,"doi":null,"url":null,"internal_url":null},{"position":44,"raw":"[Yu, 2018] Yang Yu. Towards sample efficient reinforcement learning. In IJCAI, pages 5739-5743, 2018.","title":"Towards sample efficient reinforcement learning","authors":"Yang Yu","year":"2018","venue":"IJCAI","doi":null,"url":null,"internal_url":"/proceedings/2018/820"}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}