Learning Behaviors in Agents Systems with Interactive Dynamic Influence Diagrams

Conroy, Ross; Zeng, Yifeng; Cavazza, Marc; Chen, Yingke

Learning Behaviors in Agents Systems with Interactive Dynamic Influence Diagrams

Ross Conroy, Yifeng Zeng, Marc Cavazza, Yingke Chen

Download BibTeX Cite

Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence. Main Track. Pages 39-44.

Abstract

Interactive dynamic influence diagrams(I-DIDs) are a well recognized decision model that explicitly considers how multiagent interaction affects individual decision making. To predict behavior of other agents, I-DIDs require models of the other agents to be known ahead of time and manually encoded. This becomes a barrier to I-DID applications in a human-agent interaction setting, such as development of intelligent non-player characters(NPCs) in real-time strategy(RTS) games, where models of other agents or human players are often inaccessible to domain experts. In this paper, we use automatic techniques for learning behavior of other agents from replay data in RTS games. We propose a learning algorithm with improvement over existing work by building a full profile of agent behavior. This is the first time that data-driven learning techniques are embedded into the I-DID decision making framework. We evaluate the performance of our approach on two test cases.

Ross Conroy, Yifeng Zeng, Marc Cavazza, and Yingke Chen. 2015. Learning Behaviors in Agents Systems with Interactive Dynamic Influence Diagrams. In Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence, IJCAI-15. IJCAI, 39–44. https://ijcai.org/proceedings/2015/13

@inproceedings{ijcai2015p13,
  title     = {Learning Behaviors in Agents Systems with Interactive Dynamic Influence Diagrams},
  author    = {Conroy, Ross and Zeng, Yifeng and Cavazza, Marc and Chen, Yingke},
  booktitle = {Proceedings of the Twenty-Fourth International Joint Conference on
               Artificial Intelligence, {IJCAI-15}},
  publisher = {International Joint Conferences on Artificial Intelligence},
  editor    = {Qiang Yang and Michael Wooldridge},
  pages     = {39--44},
  year      = {2015},
  month     = {7},
  note      = {Main Track},
  url       = {https://ijcai.org/proceedings/2015/13},
}

TY  - CPAPER
TI  - Learning Behaviors in Agents Systems with Interactive Dynamic Influence Diagrams
AU  - Conroy, Ross
AU  - Zeng, Yifeng
AU  - Cavazza, Marc
AU  - Chen, Yingke
T2  - Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence, IJCAI-15
PB  - International Joint Conferences on Artificial Intelligence
PY  - 2015
SP  - 39
EP  - 44
UR  - https://ijcai.org/proceedings/2015/13
ER  -