Modelling the Dynamics of Regret Minimization in Large Agent Populations: a Master Equation Approach

Zhen Wang, Chunjiang Mu, Shuyue Hu, Chen Chu, Xuelong Li

Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence

Main Track. Pages 534-540.

https://doi.org/10.24963/ijcai.2022/76

PDF BibTeX Video

Abstract

Understanding the learning dynamics in multiagent systems is an important and challenging task. Past research on multi-agent learning mostly focuses on two-agent settings. In this paper, we consider the scenario in which a population of infinitely many agents apply regret minimization in repeated symmetric games. We propose a new formal model based on the master equation approach in statistical physics to describe the evolutionary dynamics in the agent population. Our model takes the form of a partial differential equation, which describes how the probability distribution of regret evolves over time. Through experiments, we show that our theoretical results are consistent with the agent-based simulation results.

Keywords

  • Agent-based and Multi-agent Systems: Multi-agent Learning
  • Agent-based and Multi-agent Systems: Agent-Based Simulation and Emergence
Welcome Future Conferences AI Journal Division IJCAI Proceedings Travel Grant Program IJCAI Awards