{"type":"ScholarlyArticle","title":"Stochastic Market Games","authors":[{"name":"Kyrill Schmid","slug":"kyrill-schmid","given":"Kyrill","family":"Schmid","affiliation":""},{"name":"Lenz Belzner","slug":"lenz-belzner","given":"Lenz","family":"Belzner","affiliation":""},{"name":"Robert Müller","slug":"robert-muller","given":"Robert","family":"Müller","affiliation":""},{"name":"Johannes Tochtermann","slug":"johannes-tochtermann","given":"Johannes","family":"Tochtermann","affiliation":""},{"name":"Claudia Linnhoff-Popien","slug":"claudia-linnhoff-popien","given":"Claudia","family":"Linnhoff-Popien","affiliation":""}],"abstract":"Some of the most relevant future applications of multi-agent systems like autonomous driving or factories as a service display mixed-motive scenarios, where agents might have conflicting goals. In these settings agents are likely to learn undesirable outcomes in terms of cooperation under independent learning, such as overly greedy behavior. Motivated from real world societies, in this work we propose to utilize market forces to provide incentives for agents to become cooperative. As demonstrated in an iterated version of the Prisoner's Dilemma, the proposed market formulation can change the dynamics of the game to consistently learn cooperative policies. Further we evaluate our approach in spatially and temporally extended settings for varying numbers of agents. We empirically find that the presence of markets can improve both the overall result and agent individual returns via their trading activities.","doi":"10.24963/ijcai.2021/54","url":"https://ijcai.org/proceedings/2021/54","pdf":"https://ijcai.org/proceedings/2021/0054.pdf","markdown":"https://ijcai.org/proceedings/2021/54.md","bibtex":"https://ijcai.org/proceedings/2021/bibtex/54","volume":{"slug":"2021","title":"Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2021","url":"https://ijcai.org/proceedings/2021/","year":2021,"location":"Montreal","dates":"19-27 August 2021","editors":"Prof. Zhi-Hua Zhou","isbn":"978-0-9992411-9-6","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2021"},"section":"Agent-based and Multi-agent Systems","track":"Main Track","number":54,"pages":{"first":384,"last":390},"keywords":["Agent-based and Multi-agent Systems: Agent Societies","Agent-based and Multi-agent Systems: Agent-Based Simulation and Emergence","Agent-based and Multi-agent Systems: Coordination and Cooperation"],"videos":[],"references":[],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}