{"type":"ScholarlyArticle","title":"Super-Human AI for Strategic Reasoning: Beating Top Pros in Heads-Up No-Limit Texas Hold'em","authors":[{"name":"Tuomas Sandholm","slug":"tuomas-sandholm","given":"Tuomas","family":"Sandholm","affiliation":"Carnegie Mellon University , Computer Science Department , Pittsburgh , PA , USA,; and Strategic Machine, Inc. , Pittsburgh , PA , USA"}],"abstract":"Poker has been a challenge problem in AI and game theory for decades. As a game of imperfect information it involves obstacles not present in games like chess and Go, and requires totally different techniques. No program had been able to beat top players in large poker games. Until now! In January 2017, our AI, Libratus, beat a team of four top specialist professionals in heads-up no-limit Texas hold'em, which has 10^161 decision points. This game is the main benchmark challenge for imperfect-information game solving. Libratus is the only AI that has beat top humans at this game. Libratus is powered by new algorithms in each of its three main modules:\r\n1. computing blueprint (approximate Nash equilibrium) strategies before the event,\r\n2. novel nested endgame solving during play, and\r\n3. fixing its own strategy to play even closer to equilibrium based on what holes the opponents have been able to identify and exploit.\r\nThese domain-independent algorithms have potential applicability to a variety of real-world imperfect-information games such as negotiation, business strategy, cybersecurity, physical security, military applications, strategic pricing, product portfolio planning, certain areas of finance, auctions, political campaigns, and steering biological adaptation and evolution, for example, for medical treatment planning.","doi":"10.24963/ijcai.2017/4","url":"https://ijcai.org/proceedings/2017/4","pdf":"https://ijcai.org/proceedings/2017/0004.pdf","markdown":"https://ijcai.org/proceedings/2017/4.md","bibtex":"https://ijcai.org/proceedings/2017/bibtex/4","volume":{"slug":"2017","title":"Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2017","url":"https://ijcai.org/proceedings/2017/","year":2017,"location":"Melbourne, Australia","dates":"19-25 August 2017","editors":"Carles Sierra","isbn":"978-0-9992411-0-3","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2017"},"section":"Invited Speakers","track":"Invited Speakers","number":4,"pages":{"first":24,"last":25},"keywords":["Multidisciplinary Topics and Applications: Computer Games","Knowledge Representation, Reasoning, and Logic: Game Theory","Agent-based and Multi-agent Systems: Noncooperative Games"],"videos":[],"references":[],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}