Policy Space Response Oracles: A Survey

Policy Space Response Oracles: A Survey

Ariyan Bighashdel, Yongzhao Wang, Stephen McAleer, Rahul Savani, Frans A. Oliehoek

Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence
Survey Track. Pages 7951-7961. https://doi.org/10.24963/ijcai.2024/880

Game theory provides a mathematical way to study the interaction between multiple decision makers. However, classical game-theoretic analysis is limited in scalability due to the large number of strategies, precluding direct application to more complex scenarios. This survey provides a comprehensive overview of a framework for large games, known as Policy Space Response Oracles (PSRO), which holds promise to improve scalability by focusing attention on sufficient subsets of strategies. We first motivate PSRO and provide historical context. We then focus on the strategy exploration problem for PSRO: the challenge of assembling effective subsets of strategies that still represent the original game well with minimum computational cost. We survey current research directions for enhancing the efficiency of PSRO, and explore the applications of PSRO across various domains. We conclude by discussing open questions and future research.
Keywords:
Agent-based and Multi-agent Systems: General
Game Theory and Economic Paradigms: General
Game Theory and Economic Paradigms: GTEP: Noncooperative games