{"type":"ScholarlyArticle","title":"Optimally Solving Dec-POMDPs as Continuous-State MDPs","authors":[{"name":"Jilles Steeve Dibangoye","slug":"jilles-steeve-dibangoye","given":"Jilles Steeve","family":"Dibangoye","affiliation":""},{"name":"Christopher Amato","slug":"christopher-amato","given":"Christopher","family":"Amato","affiliation":""},{"name":"Olivier Buffet","slug":"olivier-buffet","given":"Olivier","family":"Buffet","affiliation":""},{"name":"François Charpillet","slug":"francois-charpillet","given":"François","family":"Charpillet","affiliation":""}],"abstract":"Optimally solving decentralized partially observable Markov decision processes (Dec-POMDPs) is a hard combinatorial problem. Current algorithms search through the space of full histories for each agent. Because of the doubly exponential growth in the number of policies in this space as the planning horizon increases, these methods quickly become intractable. However, in real world problems, computing policies over the full history space is often unnecessary. True histories experienced by the agents often lie near a structured, low-dimensional manifold embedded into the history space. We show that by transforming a Dec-POMDP into a continuous-state MDP, we are able to find and exploit these low-dimensional representations. Using this novel transformation, we can then apply powerful techniques for solving POMDPs and continuous-state MDPs. By combining a general search algorithm and dimension reduction based on feature selection, we introduce a novel approach to optimally solve problems with significantly longer planning horizons than previous methods.","doi":null,"url":"https://ijcai.org/proceedings/2013/25","pdf":"https://ijcai.org/proceedings/2013/0025.pdf","markdown":"https://ijcai.org/proceedings/2013/25.md","bibtex":"https://ijcai.org/proceedings/2013/bibtex/25","volume":{"slug":"2013","title":"Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2013","url":"https://ijcai.org/proceedings/2013/","year":2013,"location":"Beijing, China","dates":"3–9 August 2013","editors":"Francesca Rossi","isbn":"978-1-57735-633-2","publisher":"AAAI Press / International Joint Conferences on Artificial Intelligence","doi_prefix":""},"section":null,"track":"","number":25,"pages":{"first":90,"last":95},"keywords":[],"videos":[],"references":[],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}