Proceedings

Lifting Techniques for Sequential Decision Making and Probabilistic Inference (Extended Abstract)

Download BibTeX Cite

Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence. Pages 3972-3972.

© 2016 International Joint Conferences on Artificial Intelligence

Abstract

Many traditional AI algorithms fail to scale as the size of state space increases exponentially with the number of features. One way to reduce computation in such scenarios is to reduce the problem size by grouping symmetric states together and then running the algorithm on the reduced problem. The focus of this work is to exploit symmetry in problems of sequential decision making and probabilistic inference. Our recent work- ASAP-UCT defines new State-Action Pair (SAP) symmetries in Markov Decision Processes. We also apply these SAP symmetries in Monte Carlo Tree Search (MCTS) framework. In probabilistic inference, we expand the notion of unconditional symmetries to contextual symmetries and apply them in Markov Chain Monte Carlo (MCMC) methods. In future, we plan to explore interesting links in symmetry exploitation in different problems and aim to develop a generic symmetry based framework.

  1. [Anand et al., 2015a] Ankit Anand, Aditya Grover, Mausam, and Parag Singla. ASAP-UCT: Abstraction of State-Action Pairs in UCT. In IJCAI, 2015. IJCAI
  2. [Anand et al., 2015b] Ankit Anand, Aditya Grover, Mausam, and Parag Singla. A Novel Abstraction Framework for Online Planning. In AAMAS, 2015.
  3. [Anand et al., 2016a] Ankit Anand, Aditya Grover, Mausam, and Parag Singla. Contextual Symmetries in Probabilistic Graphical Models. In IJCAI, 2016. IJCAI
  4. [Anand et al., 2016b] Ankit Anand, Ritesh Noothigattu, Mausam, and Parag Singla. OGA-UCT: On-the-Go Ab- stractions in UCT. In ICAPS, 2016.
  5. [Li et al., 2006] Lihong Li, Thomas J Walsh, and Michael L Littman. Towards a Unified Theory of State Abstraction for MDPs. In ISAIM, 2006.
  6. [Mihalkova and Getoor, 2011] Lilyana Mihalkova and Lise Getoor. Lifted graphical models: A survey. CoRR, abs/1107.4966, 2011.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards