Approximating Value Equivalence in Interactive Dynamic Influence Diagrams Using Behavioral Coverage

Conroy, Ross; Zeng, Yifeng; Tang, Jing

Approximating Value Equivalence in Interactive Dynamic Influence Diagrams Using Behavioral Coverage

Download BibTeX Cite

Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence. Pages 201-206.

Abstract

Interactive dynamic influence diagrams~(I-DIDs) provide an explicit way of modeling how a subject agent solves decision making problems in the presence of other agents in a common setting. To optimize its decisions, the subject agent needs to predict the other agents' behavior, that is generally obtained by solving their candidate models. This becomes extremely difficult since the model space may be rather large, and grows when the other agents act and observe over the time. A recent proposal for solving I-DIDs lies in a concept of value equivalence (VE) that shows potential advances on significantly reducing the model space. In this paper, we establish a principled framework to implement the VE techniques and propose an approximate method to compute VE of candidate models. The development offers ample opportunity of exploiting VE to further improve the scalability of I-DID solutions. We theoretically analyze properties of the approximate techniques and show empirical results in multiple problem domains.

Ross Conroy, Yifeng Zeng, and Jing Tang. 2016. Approximating Value Equivalence in Interactive Dynamic Influence Diagrams Using Behavioral Coverage. In Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, IJCAI-16. IJCAI, 201–206. https://ijcai.org/proceedings/2016/36

@inproceedings{ijcai2016p36,
  title     = {Approximating Value Equivalence in Interactive Dynamic Influence Diagrams Using Behavioral Coverage},
  author    = {Conroy, Ross and Zeng, Yifeng and Tang, Jing},
  booktitle = {Proceedings of the Twenty-Fifth International Joint Conference on
               Artificial Intelligence, {IJCAI-16}},
  publisher = {AAAI Press / International Joint Conferences on Artificial Intelligence},
  editor    = {Subbarao Kambhampati},
  pages     = {201--206},
  year      = {2016},
  month     = {7},
  url       = {https://ijcai.org/proceedings/2016/36},
}

TY  - CPAPER
TI  - Approximating Value Equivalence in Interactive Dynamic Influence Diagrams Using Behavioral Coverage
AU  - Conroy, Ross
AU  - Zeng, Yifeng
AU  - Tang, Jing
T2  - Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, IJCAI-16
PB  - AAAI Press / International Joint Conferences on Artificial Intelligence
PY  - 2016
SP  - 201
EP  - 206
UR  - https://ijcai.org/proceedings/2016/36
ER  -