DCOPs Meet the Real World: Exploring Unknown Reward Matrices with Applications to Mobile Sensor Networks

Jain, Manish; Taylor, Matthew E.; Tambe, Milind; Yokoo, Makoto

DCOPs Meet the Real World: Exploring Unknown Reward Matrices with Applications to Mobile Sensor Networks

Manish Jain, Matthew E. Taylor, Milind Tambe, Makoto Yokoo

Download BibTeX Cite

Proceedings of the Twenty-First International Joint Conference on Artificial Intelligence. Pages 181-185.

Abstract

Buoyed by recent successes in the area of distributed constraint optimization problems (DCOPs), this paper addresses challenges faced when applying DCOPs to real-world domains. Three fundamental challenges must be addressed for a class of real-world domains, requiring novel DCOP algorithms. First, agents may not know the payoff matrix and must explore the environment to determine rewards associated with variable settings. Second, agents may need to maximize total accumulated reward rather than instantaneous final reward. Third, limited time horizons disallow exhaustive exploration of the environment. We propose and implement a set of novel algorithms that combine decision-theoretic exploration approaches with DCOP-mandated coordination. In addition to simulation results, we implement these algorithms on robots, deploying DCOPs on a distributed mobile sensor network.Manish Jain, Matthew Taylor, Milind Tambe, Makoto Yokoo

Manish Jain, Matthew E. Taylor, Milind Tambe, and Makoto Yokoo. 2009. DCOPs Meet the Real World: Exploring Unknown Reward Matrices with Applications to Mobile Sensor Networks. In Proceedings of the Twenty-First International Joint Conference on Artificial Intelligence, IJCAI-09. IJCAI, 181–185. https://ijcai.org/proceedings/2009/40

@inproceedings{ijcai2009p40,
  title     = {DCOPs Meet the Real World: Exploring Unknown Reward Matrices with Applications to Mobile Sensor Networks},
  author    = {Jain, Manish and Taylor, Matthew E. and Tambe, Milind and Yokoo, Makoto},
  booktitle = {Proceedings of the Twenty-First International Joint Conference on
               Artificial Intelligence, {IJCAI-09}},
  publisher = {International Joint Conferences on Artificial Intelligence},
  editor    = {Hiroaki Kitano},
  pages     = {181--185},
  year      = {2009},
  url       = {https://ijcai.org/proceedings/2009/40},
}

TY  - CPAPER
TI  - DCOPs Meet the Real World: Exploring Unknown Reward Matrices with Applications to Mobile Sensor Networks
AU  - Jain, Manish
AU  - Taylor, Matthew E.
AU  - Tambe, Milind
AU  - Yokoo, Makoto
T2  - Proceedings of the Twenty-First International Joint Conference on Artificial Intelligence, IJCAI-09
PB  - International Joint Conferences on Artificial Intelligence
PY  - 2009
SP  - 181
EP  - 185
UR  - https://ijcai.org/proceedings/2009/40
ER  -