---
title: "Online Planning for Ad Hoc Autonomous Agent Teams"
authors:
  - "Feng Wu"
  - "Shlomo Zilberstein"
  - "Xiaoping Chen"
doi: "10.5591/978-1-57735-516-8/IJCAI11-081"
url: "https://ijcai.org/proceedings/2011/81"
pdf: "https://ijcai.org/proceedings/2011/0081.pdf"
venue: "Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence"
year: 2011
pages: "439-444"
track: ""
keywords:
---

# Online Planning for Ad Hoc Autonomous Agent Teams

Feng Wu, Shlomo Zilberstein, Xiaoping Chen

*Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence*, pages 439-444. DOI: [10.5591/978-1-57735-516-8/IJCAI11-081](https://doi.org/10.5591/978-1-57735-516-8/IJCAI11-081)

## Abstract

We propose a novel online planning algorithm for ad hoc team settings — challenging situations in which an agent must collaborate with unknown teammates without prior coordination. Our approach is based on constructing and solving a series of stage games, and then using biased adaptive play to choose actions. The utility function in each stage game is estimated via Monte-Carlo tree search using the UCT algorithm. We establish analytically the convergence of the algorithm and show that it performs well in a variety of ad hoc team domains.