{"type":"ScholarlyArticle","title":"Scaling Up Optimal Heuristic Search in Dec-POMDPs via Incremental Expansion","authors":[{"name":"Matthijs T. J. Spaan","slug":"matthijs-t-j-spaan","given":"Matthijs T. J.","family":"Spaan","affiliation":""},{"name":"Frans A. Oliehoek","slug":"frans-a-oliehoek","given":"Frans A.","family":"Oliehoek","affiliation":""},{"name":"Christopher Amato","slug":"christopher-amato","given":"Christopher","family":"Amato","affiliation":""}],"abstract":"Planning under uncertainty for multiagent systems can be formalized as a decentralized partially observable Markov decision process. We advance the state of the art for optimal solution of this model, building on the Multiagent A* heuristic search method. A key insight is that we can avoid the full expansion of a search node that generates a number of children that is doubly exponential in the node's depth. Instead, we incrementally expand the children only when a next child might have the highest heuristic value. We target a subsequent bottleneck by introducing a more memory-efficient representation for our heuristic functions. Proof is given that the resulting algorithm is correct and experiments demonstrate a significant speedup over the state of the art, allowing for optimal solutions over longer horizons for many benchmark problems.","doi":"10.5591/978-1-57735-516-8/IJCAI11-338","url":"https://ijcai.org/proceedings/2011/338","pdf":"https://ijcai.org/proceedings/2011/0338.pdf","markdown":"https://ijcai.org/proceedings/2011/338.md","bibtex":"https://ijcai.org/proceedings/2011/bibtex/338","volume":{"slug":"2011","title":"Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2011","url":"https://ijcai.org/proceedings/2011/","year":2011,"location":"Barcelona, Catalonia, Spain","dates":"16–22 July 2011","editors":"Toby Walsh","isbn":"978-1-57735-512-0; 978-1-57735-513-7; 978-1-57735-514-4; 978-1-57735-515-1; 978-1-57735-516-8","publisher":"AAAI Press/International Joint Conferences on Artificial Intelligence","doi_prefix":""},"section":null,"track":"","number":338,"pages":{"first":2027,"last":2031},"keywords":[],"videos":[],"references":[],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}