{"type":"ScholarlyArticle","title":"Nested Monte-Carlo Search","authors":[{"name":"Tristan Cazenave","slug":"tristan-cazenave","given":"Tristan","family":"Cazenave","affiliation":"Université Paris-Dauphine Paris , France"}],"abstract":"Many problems have a huge state space and no good heuristic to order moves so as to guide the search toward the best positions. Random games can be used to score positions and evaluate their interest. Random games can also be improved using random games to choose a move to try at each step of a game. Nested Monte-Carlo Search addresses the problem of guiding the search toward better states when there is no available heuristic. It uses nested levels of random games in order to guide the search. The algorithm is studied theoretically on simple abstract problems and applied successfully to three different games: Morpion Solitaire, SameGame and 16x16 Sudoku.Tristan Cazenave","doi":null,"url":"https://ijcai.org/proceedings/2009/83","pdf":"https://ijcai.org/proceedings/2009/0083.pdf","markdown":"https://ijcai.org/proceedings/2009/83.md","bibtex":"https://ijcai.org/proceedings/2009/bibtex/83","volume":{"slug":"2009","title":"Proceedings of the Twenty-First International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2009","url":"https://ijcai.org/proceedings/2009/","year":2009,"location":"Pasadena, California, USA","dates":"","editors":"Hiroaki Kitano","isbn":"","publisher":"International Joint Conferences on Artificial Intelligence","doi_prefix":""},"section":null,"track":"","number":83,"pages":{"first":456,"last":460},"keywords":[],"videos":[],"references":[{"position":1,"raw":"[Bjarnason et al., 2007] R. Bjarnason, P. Tadepalli, and A. Fern. Searching solitaire in real time. ICGA Journal, 30(3):131-142, 2007.","title":"Searching solitaire in real time","authors":"R Bjarnason, P Tadepalli, A Fern","year":"2007","venue":"ICGA Journal","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Cazenave, 2007] T. Cazenave. Reflexive monte-carlo search. In Computer Games Workshop, pages 165-173, Amsterdam, The Netherlands, 2007.","title":"Reflexive monte-carlo search","authors":"T Cazenave","year":"2007","venue":"Computer Games Workshop","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Demaine et al., 2006] E. D. Demaine, M. L. Demaine, A. Langerman, and S. Langerman. Morpion solitaire. The- ory Comput. Syst., 39(3):439-453, 2006.","title":"Morpion solitaire","authors":"E D Demaine, M L Demaine, A Langerman, S Langerman","year":"2006","venue":"Theory Comput. Syst","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Gelly and Silver, 2007] S. Gelly and D. Silver. Combining online and offline knowledge in UCT. In ICML 2007, pages 273-280, 2007.","title":"Combining online and offline knowledge in UCT","authors":"S Gelly, D Silver","year":"2007","venue":"ICML 2007","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Kendall et al., 2008] G. Kendall, A. Parkes, and K. Spo- erer. A survey of NP-complete puzzles. ICGA Journal, 31(1):13-34, 2008.","title":"A survey of NP-complete puzzles","authors":"G Kendall, A Parkes, K Spoerer","year":"2008","venue":"ICGA Journal","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Schadd et al., 2008] M. P. D. Schadd, M. H. M. Winands, H. J. van den Herik, G. Chaslot, and J. W. H. M. Uiterwijk. Single-player monte-carlo tree search. In Computers and Games, volume 5131 of Lecture Notes in Computer Sci- ence, pages 1-12. Springer, 2008.","title":"Single-player monte-carlo tree search","authors":"M P D Schadd, M H M Winands, H J Van Den Herik, G Chaslot, J W H M Uiterwijk","year":"2008","venue":"Computers and Games","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Tesauro and Galperin, 1996] G. Tesauro and G. Galperin. On-line policy improvement using monte-carlo search. In Advances in Neural Information Processing Systems 9, pages 1068-1074, Cambridge, MA, 1996. MIT Press.","title":"On-line policy improvement using monte-carlo search","authors":"G Tesauro, G Galperin","year":"1996","venue":"Advances in Neural Information Processing Systems","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Yan et al., 2005] X. Yan, P. Diaconis, P. Rusmevichientong, and B. Van Roy. Solitaire: Man versus machine. In Advances in Neural Information Processing Systems 17, pages 1553-1560, Cambridge, MA, 2005. MIT Press.","title":"Solitaire: Man versus machine","authors":"Yan","year":"2005","venue":"Advances in Neural Information Processing Systems","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}