{"type":"ScholarlyArticle","title":"Interactive Learning and Decision Making: Foundations, Insights & Challenges","authors":[{"name":"Frans A. Oliehoek","slug":"frans-a-oliehoek","given":"Frans A.","family":"Oliehoek","affiliation":"Delft University of Technology , The Netherlands; University of Liverpool , United Kingdom"}],"abstract":"Designing \"teams of intelligent agents that successfully coordinate and learn about their complex environments inhabited by other agents (such as humans)\" is one of the major goals of AI, and it is the challenge that I aim to address in my research. In this paper I give an overview of some of the foundations, insights and challenges in this field of Interactive Learning and Decision Making.","doi":"10.24963/ijcai.2018/813","url":"https://ijcai.org/proceedings/2018/813","pdf":"https://ijcai.org/proceedings/2018/0813.pdf","markdown":"https://ijcai.org/proceedings/2018/813.md","bibtex":"https://ijcai.org/proceedings/2018/bibtex/813","volume":{"slug":"2018","title":"Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2018","url":"https://ijcai.org/proceedings/2018/","year":2018,"location":"Stockholm","dates":"13-19 July 2018","editors":"Jérôme Lang","isbn":"978-0-9992411-2-7","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2018"},"section":"Early Career","track":"Early Career","number":813,"pages":{"first":5703,"last":5708},"keywords":["Agent-based and Multi-agent Systems: Multi-agent Planning","Planning and Scheduling: Planning under Uncertainty","Machine Learning: Reinforcement Learning","Agent-based and Multi-agent Systems: Multi-agent Learning"],"videos":[],"references":[{"position":1,"raw":"[Amato and Oliehoek, 2015] Christopher Amato and Frans A. Oliehoek. Scalable planning and learning for multiagent POMDPs. In AAAI, 2015.","title":"Scalable planning and learning for multiagent POMDPs","authors":"Christopher Amato, Frans A Oliehoek","year":"2015","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Arora et al., 2017] Sanjeev Arora, Rong Ge, Yingyu Liang, Tengyu Ma, and Yi Zhang. Generalization and equilibrium in generative adversarial nets. In ICML, 2017.","title":"Generalization and equilibrium in generative adversarial nets","authors":"Sanjeev Arora, Rong Ge, Yingyu Liang, Tengyu Ma, Yi Zhang","year":"2017","venue":"ICML","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Becker et al., 2003] Raphen Becker, Shlomo Zilberstein, Victor Lesser, and Claudia V. Goldman. Transition-independent decen- tralized Markov decision processes. In AAMAS, 2003.","title":"Transition-independent decentralized Markov decision processes","authors":"Becker","year":"2003","venue":"AAMAS","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Bellman, 1957] Richard Bellman. A Markovian decision process. Journal of Mathematics and Mechanics, 6(5), 1957.","title":"A Markovian decision process","authors":"Richard Bellman","year":"1957","venue":"Journal of Mathematics and Mechanics","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Bernstein et al., 2000] Daniel S. Bernstein, Shlomo Zilberstein, and Neil Immerman. The complexity of decentralized control of Markov decision processes. In UAI, 2000.","title":"The complexity of decentralized control of Markov decision processes","authors":"S Daniel, Shlomo Bernstein, Neil Zilberstein, Immerman","year":"2000","venue":"UAI","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Bertsekas, 2007] Dimitri P. Bertsekas. Dynamic Programming and Optimal Control, volume II. Athena Scientific, 3rd edition, 2007.","title":"Dynamic Programming and Optimal Control","authors":"Dimitri P Bertsekas","year":"2007","venue":null,"doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Boutilier et al., 1999] Craig Boutilier, Thomas Dean, and Steve Hanks. Decision-theoretic planning: Structural assumptions and computational leverage. JAIR, 11, 1999.","title":"Decision-theoretic planning: Structural assumptions and computational leverage","authors":"Craig Boutilier, Thomas Dean, Steve Hanks","year":"1999","venue":"JAIR","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Boutilier, 1996] Craig Boutilier. Planning, learning and coordina- tion in multiagent decision processes. In Theoretical Aspects of Rationality and Knowledge, 1996.","title":"Planning, learning and coordination in multiagent decision processes","authors":"Craig Boutilier","year":"1996","venue":"Theoretical Aspects of Rationality and Knowledge","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Claes et al., 2015] Daniel Claes, Philipp Robbel, Frans A. Oliehoek, Daniel Hennes, Karl Tuyls, and Wiebe Van der Hoek. Effective approximations for multi-robot coordination in spa- tially distributed tasks. In AAMAS, 2015.","title":"Effective approximations for multi-robot coordination in spatially distributed tasks","authors":"Daniel Claes, Philipp Robbel, Frans A Oliehoek, Daniel Hennes, Karl Tuyls, Wiebe Van Der Hoek","year":"2015","venue":"AAMAS","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Claes et al., 2017] Daniel Claes, Frans A. Oliehoek, Hendrik Baier, and Karl Tuyls. Decentralised online planning for multi- robot warehouse commisioning. In AAMAS, 2017.","title":"Decentralised online planning for multirobot warehouse commisioning","authors":"Claes","year":"2017","venue":"AAMAS","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Dibangoye et al., 2013] Jilles S. Dibangoye, Christopher Amato, Olivier Buffet, and François Charpillet. Optimally solving Dec- POMDPs as continuous-state MDPs. In IJCAI, 2013.","title":"Optimally solving Dec-POMDPs as continuous-state MDPs","authors":"S Jilles, Christopher Dibangoye, Olivier Amato, François Buffet, Charpillet","year":"2013","venue":"IJCAI","doi":null,"url":null,"internal_url":"/proceedings/2013/25"},{"position":12,"raw":"[Foerster et al., 2018] Jakob Foerster, Gregory Farquhar, Tri- antafyllos Afouras, Nantas Nardelli, and Shimon Whiteson. Counterfactual multi-agent policy gradients. In AAAI, 2018.","title":"Counterfactual multi-agent policy gradients","authors":"Jakob Foerster, Gregory Farquhar, Triantafyllos Afouras, Nantas Nardelli, Shimon Whiteson","year":"2018","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Gmytrasiewicz and Doshi, 2005] Piotr J. Gmytrasiewicz and Prashant Doshi. A framework for sequential planning in multi-agent settings. JAIR, 24, 2005.","title":"A framework for sequential planning in multi-agent settings","authors":"Piotr J Gmytrasiewicz, Prashant Doshi","year":"2005","venue":"JAIR","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Goldman and Zilberstein, 2003] Claudia V. Goldman and Shlomo Zilberstein. Optimizing information exchange in cooperative multi-agent systems. In AAMAS, 2003.","title":"Optimizing information exchange in cooperative multi-agent systems","authors":"Claudia V Goldman, Shlomo Zilberstein","year":"2003","venue":"AAMAS","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Goodfellow et al., 2014] Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. Generative adversarial nets. In NIPS 27, 2014.","title":"Generative adversarial nets","authors":"Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, Yoshua Bengio","year":"2014","venue":"NIPS 27","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Guestrin et al., 2002a] Carlos Guestrin, Daphne Koller, and Ronald Parr. Multiagent planning with factored MDPs. In NIPS 14, 2002.","title":"Multiagent planning with factored MDPs","authors":"Guestrin","year":"2002","venue":"NIPS 14","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Guestrin et al., 2002b] Carlos Guestrin, Michail Lagoudakis, and Ronald Parr. Coordinated reinforcement learning. In ICML, 2002.","title":"Coordinated reinforcement learning","authors":"Guestrin","year":"2002","venue":"ICML","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Guestrin et al., 2003] Carlos Guestrin, Daphne Koller, Ronald Parr, and Shobha Venkataraman. Efficient solution algorithms for factored MDPs. JAIR, 19, 2003.","title":"Efficient solution algorithms for factored MDPs","authors":"Carlos Guestrin, Daphne Koller, Ronald Parr, Shobha Venkataraman","year":"2003","venue":"JAIR","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Hansen et al., 2004] Eric A. Hansen, Daniel S. Bernstein, and Shlomo Zilberstein. Dynamic programming for partially observ- able stochastic games. In AAAI, 2004.","title":"Dynamic programming for partially observable stochastic games","authors":"Eric A Hansen, Daniel S Bernstein, Shlomo Zilberstein","year":"2004","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Irissappane et al., 2016] Athirai Irissappane, Frans A. Oliehoek, and Jie Zhang. A scalable framework to choose sellers in e- marketplaces using POMDPs. In AAAI, 2016.","title":"A scalable framework to choose sellers in emarketplaces using POMDPs","authors":"Irissappane","year":"2016","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Kaelbling et al., 1996] Leslie Pack Kaelbling, Michael Littman, and Andrew Moore. Reinforcement learning: A survey. JAIR, 4:237-285, 1996.","title":"Reinforcement learning: A survey","authors":"Kaelbling","year":"1996","venue":"JAIR","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Kaelbling et al., 1998] Leslie Pack Kaelbling, Michael L. Littman, and Anthony R. Cassandra. Planning and acting in partially ob- servable stochastic domains. AIJ, 101(1-2), 1998.","title":"Planning and acting in partially observable stochastic domains","authors":"Leslie Pack Kaelbling, Michael L Littman, Anthony R Cassandra","year":"1998","venue":"AIJ","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Katt et al., 2017] Sammie Katt, Frans A. Oliehoek, and Christo- pher Amato. Learning in POMDPs with Monte Carlo tree search. In ICML, 2017.","title":"Learning in POMDPs with Monte Carlo tree search","authors":"Sammie Katt, Frans A Oliehoek, Christopher Amato","year":"2017","venue":"ICML","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Kok and Vlassis, 2006] Jelle R. Kok and Nikos Vlassis. Collabo- rative multiagent reinforcement learning by payoff propagation. JMLR, 7, 2006.","title":"Collaborative multiagent reinforcement learning by payoff propagation","authors":"R Jelle, Nikos Kok, Vlassis","year":"2006","venue":"JMLR","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Koller and Parr, 1999] Daphne Koller and Ronald Parr. Comput- ing factored value functions for policies in structured MDPs. In IJCAI, 1999.","title":"Computing factored value functions for policies in structured MDPs","authors":"Parr Koller, Daphne Koller, Ronald Parr","year":"1999","venue":"IJCAI","doi":null,"url":null,"internal_url":"/proceedings/1999/189"},{"position":26,"raw":"[Kuyer et al., 2008] Lior Kuyer, Shimon Whiteson, Bram Bakker, and Nikos Vlassis. Multiagent reinforcement learning for urban traffic control using coordination graphs. In ECML, 2008.","title":"Multiagent reinforcement learning for urban traffic control using coordination graphs","authors":"Lior Kuyer, Shimon Whiteson, Bram Bakker, Nikos Vlassis","year":"2008","venue":"ECML","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Littman, 1997] Michael L. Littman. Probabilistic propositional planning: Representations and complexity. In AAAI, 1997.","title":"Probabilistic propositional planning: Representations and complexity","authors":"L Michael, Littman","year":"1997","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[MacDermed and Isbell, 2013] Liam C. MacDermed and Charles Isbell. Point based value iteration with optimal belief compres- sion for Dec-POMDPs. In NIPS, 2013.","title":"Point based value iteration with optimal belief compression for Dec-POMDPs","authors":"Liam C Macdermed, Charles Isbell","year":"2013","venue":"NIPS","doi":null,"url":null,"internal_url":null},{"position":29,"raw":"[Messias et al., 2011] João V. Messias, Matthijs Spaan, and Pe- dro U. Lima. Efficient offline communication policies for fac- tored multiagent POMDPs. In NIPS 24, 2011.","title":"Efficient offline communication policies for factored multiagent POMDPs","authors":"V João, Matthijs Messias, Pedro U Spaan, Lima","year":"2011","venue":"NIPS","doi":null,"url":null,"internal_url":null},{"position":30,"raw":"[Mnih et al., 2013] Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Alex Graves, Ioannis Antonoglou, Daan Wierstra, and Martin Riedmiller. Playing Atari with deep reinforcement learn- ing. arXiv preprint arXiv:1312.5602, 2013.","title":"Playing Atari with deep reinforcement learning","authors":"Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Alex Graves, Ioannis Antonoglou, Daan Wierstra, Martin Riedmiller","year":"2013","venue":null,"doi":null,"url":null,"internal_url":null},{"position":31,"raw":"[Nair et al., 2005] Ranjit Nair, Pradeep Varakantham, Milind Tambe, and Makoto Yokoo. Networked distributed POMDPs: A synthesis of distributed constraint optimization and POMDPs. In AAAI, 2005.","title":"Networked distributed POMDPs: A synthesis of distributed constraint optimization and POMDPs","authors":"Ranjit Nair, Pradeep Varakantham, Milind Tambe, Makoto Yokoo","year":"2005","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":32,"raw":"[Nayyar et al., 2011] Ashutosh Nayyar, Aditya Mahajan, and De- mosthenis Teneketzis. Optimal control strategies in delayed shar- ing information structures. IEEE Transactions on Automatic Control, 56(7), 2011.","title":"Optimal control strategies in delayed sharing information structures","authors":"Ashutosh Nayyar, Aditya Mahajan, Demosthenis Teneketzis","year":"2011","venue":"IEEE Transactions on Automatic Control","doi":null,"url":null,"internal_url":null},{"position":33,"raw":"[Oliehoek and Amato, 2014a] Frans A. Oliehoek and Christopher Amato. Best response Bayesian reinforcement learning for mul- tiagent systems with state uncertainty. In Multi-Agent Sequential Decision Making in Uncertain Domains, 2014.","title":"Best response Bayesian reinforcement learning for multiagent systems with state uncertainty","authors":"Oliehoek, Frans A Amato, Christopher Oliehoek, Amato","year":"2014","venue":"Multi-Agent Sequential Decision Making in Uncertain Domains","doi":null,"url":null,"internal_url":null},{"position":34,"raw":"[Oliehoek and Amato, 2014b] Frans A. Oliehoek and Christopher Amato. Dec-POMDPs as non-observable MDPs. IAS technical report IAS-UVA-14-01, Intelligent Systems Lab, University of Amsterdam, 2014.","title":"Dec-POMDPs as non-observable MDPs","authors":"Oliehoek, Frans A Amato, Christopher Oliehoek, Amato","year":"2014","venue":null,"doi":null,"url":null,"internal_url":null},{"position":35,"raw":"[Oliehoek and Amato, 2016] Frans A. Oliehoek and Christopher Amato. A Concise Introduction to Decentralized POMDPs. Springer Briefs in Intelligent Systems. Springer, 2016.","title":"A Concise Introduction to Decentralized POMDPs","authors":"Frans A Oliehoek, Christopher Amato","year":"2016","venue":"Springer Briefs in Intelligent Systems","doi":null,"url":null,"internal_url":null},{"position":36,"raw":"[Oliehoek et al., 2008a] Frans A. Oliehoek, Matthijs T. J. Spaan, and Nikos Vlassis. Optimal and approximate Q-value functions for decentralized POMDPs. JAIR, 32, 2008.","title":"Optimal and approximate Q-value functions for decentralized POMDPs","authors":"Oliehoek","year":"2008","venue":"JAIR","doi":null,"url":null,"internal_url":null},{"position":37,"raw":"[Oliehoek et al., 2008b] Frans A. Oliehoek, Matthijs T. J. Spaan, Shimon Whiteson, and Nikos Vlassis. Exploiting locality of in- teraction in factored Dec-POMDPs. In AAMAS, 2008.","title":"Exploiting locality of interaction in factored Dec-POMDPs","authors":"Oliehoek","year":"2008","venue":"AAMAS","doi":null,"url":null,"internal_url":null},{"position":38,"raw":"[Oliehoek et al., 2012] Frans A. Oliehoek, Stefan Witwicki, and Leslie P. Kaelbling. Influence-based abstraction for multiagent systems. In AAAI, 2012.","title":"Influence-based abstraction for multiagent systems","authors":"Frans A Oliehoek, Stefan Witwicki, Leslie P Kaelbling","year":"2012","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":39,"raw":"[Oliehoek et al., 2013a] Frans A. Oliehoek, Matthijs T. J. Spaan, Christopher Amato, and Shimon Whiteson. Incremental clus- tering and expansion for faster optimal planning in decentralized POMDPs. JAIR, 46, 2013.","title":"Incremental clustering and expansion for faster optimal planning in decentralized POMDPs","authors":"Oliehoek","year":"2013","venue":"JAIR","doi":null,"url":null,"internal_url":null},{"position":40,"raw":"[Oliehoek et al., 2013b] Frans A. Oliehoek, Shimon Whiteson, and Matthijs T. J. Spaan. Approximate solutions for factored Dec- POMDPs with many agents. In AAMAS, 2013.","title":"Approximate solutions for factored Dec-POMDPs with many agents","authors":"Oliehoek","year":"2013","venue":"AAMAS","doi":null,"url":null,"internal_url":null},{"position":41,"raw":"[Oliehoek et al., 2015] Frans A. Oliehoek, Matthijs T. J. Spaan, and Stefan Witwicki. Factored upper bounds for multiagent planning problems under uncertainty with non-factored value functions. In IJCAI, 2015.","title":"Factored upper bounds for multiagent planning problems under uncertainty with non-factored value functions","authors":"Frans A Oliehoek, T J Matthijs, Stefan Spaan, Witwicki","year":"2015","venue":"IJCAI","doi":null,"url":null,"internal_url":"/proceedings/2015/235"},{"position":42,"raw":"[Oliehoek et al., 2017] Frans A. Oliehoek, Rahul Savani, José Gallego-Posada, Elise Van der Pol, Edwin D. De Jong, and Roderich Groß. GANGs: Generative Adversarial Network Games. ArXiv e-prints, 2017.","title":"GANGs: Generative Adversarial Network Games","authors":"Frans A Oliehoek, Rahul Savani, José Gallego-Posada, Elise Van Der Pol, Edwin D De Jong, Roderich Groß","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":43,"raw":"[Oliehoek, 2010] Frans A. Oliehoek. Value-Based Planning for Teams of Agents in Stochastic Partially Observable Environ- ments. PhD thesis, University of Amsterdam, 2010.","title":"Value-Based Planning for Teams of Agents in Stochastic Partially Observable Environments","authors":"Frans A Oliehoek","year":"2010","venue":null,"doi":null,"url":null,"internal_url":null},{"position":44,"raw":"[Oliehoek, 2013] Frans A. Oliehoek. Sufficient plan-time statistics for decentralized POMDPs. In IJCAI, 2013.","title":"Sufficient plan-time statistics for decentralized POMDPs","authors":"Frans A Oliehoek","year":"2013","venue":"IJCAI","doi":null,"url":null,"internal_url":"/proceedings/2013/53"},{"position":45,"raw":"[Panella and Gmytrasiewicz, 2014] Alessandro Panella and Piotr Gmytrasiewicz. Learning policies of agents in partially observ- able domains using Bayesian nonparametric methods. In Multi- Agent Sequential Decision Making in Uncertain Domains, 2014.","title":"Learning policies of agents in partially observable domains using Bayesian nonparametric methods","authors":"Alessandro Panella, Piotr Gmytrasiewicz","year":"2014","venue":"Multi-Agent Sequential Decision Making in Uncertain Domains","doi":null,"url":null,"internal_url":null},{"position":46,"raw":"[Papadimitriou and Tsitsiklis, 1987] Christos H. Papadimitriou and John N. Tsitsiklis. The complexity of Markov decision processes. Mathematics of Operations Research, 12(3), 1987.","title":"The complexity of Markov decision processes","authors":"Christos H Papadimitriou, John N Tsitsiklis","year":"1987","venue":"Mathematics of Operations Research","doi":null,"url":null,"internal_url":null},{"position":47,"raw":"[Peshkin et al., 2000] Leonid Peshkin, Kee-Eung Kim, Nicolas Meuleau, and Leslie P. Kaelbling. Learning to cooperate via pol- icy search. In UAI, 2000.","title":"Learning to cooperate via policy search","authors":"Leonid Peshkin, Kee-Eung Kim, Nicolas Meuleau, Leslie P Kaelbling","year":"2000","venue":"UAI","doi":null,"url":null,"internal_url":null},{"position":48,"raw":"[Pfrommer, 2016] Julius Pfrommer. Graphical partially observable monte-carlo planning. In Learning, Inference and Control of Multi-Agent Systems, 2016.","title":"Julius Pfrommer. Graphical partially observable monte-carlo planning","authors":"Pfrommer","year":"2016","venue":"Learning, Inference and Control of Multi-Agent Systems","doi":null,"url":null,"internal_url":null},{"position":49,"raw":"[Puterman, 1994] Martin L. Puterman. Markov Decision Processes. Wiley, 1994.","title":"Markov Decision Processes","authors":"Martin L Puterman","year":"1994","venue":null,"doi":null,"url":null,"internal_url":null},{"position":50,"raw":"[Pynadath and Tambe, 2002] David V. Pynadath and Milind Tambe. The communicative multiagent team decision problem: Analyzing teamwork theories and models. JAIR, 16:389-423, 2002.","title":"The communicative multiagent team decision problem: Analyzing teamwork theories and models","authors":"David V Pynadath, Milind Tambe","year":"2002","venue":"JAIR","doi":null,"url":null,"internal_url":null},{"position":51,"raw":"[Rashid et al., 2018] Tabish Rashid, Mikayel Samvelyan, Christian Schroeder de Witt, Gregory Farquhar, Jakob Foerster, and Shi- mon Whiteson. QMIX: Monotonic Value Function Factorisation for Deep Multi-Agent Reinforcement Learning. ArXiv e-prints, 2018.","title":"QMIX: Monotonic Value Function Factorisation for Deep Multi-Agent Reinforcement Learning","authors":"Tabish Rashid, Mikayel Samvelyan, Christian Schroeder De Witt, Gregory Farquhar, Jakob Foerster, Shimon Whiteson","year":"2018","venue":null,"doi":null,"url":null,"internal_url":null},{"position":52,"raw":"[Robbel et al., 2016] Philipp Robbel, Frans A. Oliehoek, and Mykel J. Kochenderfer. Exploiting anonymity in approximate linear programming: Scaling to large multiagent MDPs. In AAAI, 2016.","title":"Exploiting anonymity in approximate linear programming: Scaling to large multiagent MDPs","authors":"Philipp Robbel, Frans A Oliehoek, Mykel J Kochenderfer","year":"2016","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":53,"raw":"[Ross et al., 2011] Stéphane Ross, Joelle Pineau, Brahim Chaib- draa, and Pierre Kreitmann. A Bayesian approach for learning and planning in partially observable Markov decision processes. JMLR, 12, 2011.","title":"A Bayesian approach for learning and planning in partially observable Markov decision processes","authors":"Stéphane Ross, Joelle Pineau, Brahim Chaibdraa, Pierre Kreitmann","year":"2011","venue":"JMLR","doi":null,"url":null,"internal_url":null},{"position":54,"raw":"[Scharpff et al., 2016] Joris Scharpff, Diederik M. Roijers, Frans A. Oliehoek, Matthijs T. J. Spaan, and Mathijs de Weerdt. Solv- ing transition-independent multi-agent MDPs with sparse inter- actions. In AAAI, 2016.","title":"Solving transition-independent multi-agent MDPs with sparse interactions","authors":"Joris Scharpff, M Diederik, Frans A Roijers, Oliehoek, T J Matthijs, Mathijs Spaan, Weerdt De","year":"2016","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":55,"raw":"[Sunehag et al., 2018] Peter Sunehag, Guy Lever, Audrunas Gruslys, Wojciech Marian Czarnecki, Vinícius Flores Zambaldi, Max Jaderberg, Marc Lanctot, Nicolas Sonnerat, Joel Z. Leibo, Karl Tuyls, and Thore Graepel. Value-decomposition networks for cooperative multi-agent learning. In AAMAS, 2018.","title":"Value-decomposition networks for cooperative multi-agent learning","authors":"Peter Sunehag, Guy Lever, Audrunas Gruslys, Wojciech, Marian Czarnecki, Vinícius Flores Zambaldi, Max Jaderberg, Marc Lanctot, Nicolas Sonnerat, Joel Z Leibo, Karl Tuyls, Thore Graepel","year":"2018","venue":"AAMAS","doi":null,"url":null,"internal_url":null},{"position":56,"raw":"[Van der Pol and Oliehoek, 2016] Elise Van der Pol and Frans A. Oliehoek. Coordinated deep reinforcement learners for traffic light control. In Learning, Inference and Control of Multi-Agent Systems, 2016.","title":"Coordinated deep reinforcement learners for traffic light control","authors":"Pol Van Der, Elise Oliehoek, Frans A Van Der Pol, Oliehoek","year":"2016","venue":"Learning, Inference and Control of Multi-Agent Systems","doi":null,"url":null,"internal_url":null},{"position":57,"raw":"[Varakantham et al., 2007] Pradeep Varakantham, Janusz Marecki, Yuichi Yabu, Milind Tambe, and Makoto Yokoo. Letting loose a SPIDER on a network of POMDPs: Generating quality guaran- teed policies. In AAMAS, 2007.","title":"Letting loose a SPIDER on a network of POMDPs: Generating quality guaranteed policies","authors":"Pradeep Varakantham, Janusz Marecki, Yuichi Yabu, Milind Tambe, Makoto Yokoo","year":"2007","venue":"AAMAS","doi":null,"url":null,"internal_url":null},{"position":58,"raw":"[Varakantham et al., 2014] Pradeep Varakantham, Yossiri Adulyasak, and Patrick Jaillet. Decentralized stochastic planning with anonymity in interactions. In AAAI, 2014.","title":"Decentralized stochastic planning with anonymity in interactions","authors":"Pradeep Varakantham, Yossiri Adulyasak, Patrick Jaillet","year":"2014","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":59,"raw":"[Wiggers et al., 2016] Auke J. Wiggers, Frans A. Oliehoek, and Diederik M. Roijers. Structure in the value function of two-player zero-sum games of incomplete information. In ECAI, 2016.","title":"Structure in the value function of two-player zero-sum games of incomplete information","authors":"J Auke, Frans A Wiggers, Diederik M Oliehoek, Roijers","year":"2016","venue":"ECAI","doi":null,"url":null,"internal_url":null},{"position":60,"raw":"[Witwicki and Durfee, 2010] Stefan J. Witwicki and Edmund H. Durfee. Influence-based policy abstraction for weakly-coupled Dec-POMDPs. In ICAPS, 2010.","title":"Influence-based policy abstraction for weakly-coupled Dec-POMDPs","authors":"Stefan J Witwicki, Edmund H Durfee","year":"2010","venue":"ICAPS","doi":null,"url":null,"internal_url":null},{"position":61,"raw":"[Witwicki et al., 2012] Stefan Witwicki, Frans A. Oliehoek, and Leslie P. Kaelbling. Heuristic search of multiagent influence space. In AAMAS, 2012.","title":"Heuristic search of multiagent influence space","authors":"Stefan Witwicki, Frans A Oliehoek, Leslie P Kaelbling","year":"2012","venue":"AAMAS","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}