Learning Policies for Embodied Virtual Agents through Demonstration

Dinerstein, Jonathan; Egbert, Parris K.; Ventura, Dan

Learning Policies for Embodied Virtual Agents through Demonstration

Jonathan Dinerstein, Parris K. Egbert, Dan Ventura

Download BibTeX Cite

Proceedings of the Twentieth International Joint Conference on Artificial Intelligence. Pages 1257-1261.

Abstract

Although many powerful AI and machine learning techniques exist, it remains difficult to quickly create AI for embodied virtual agents that produces visually lifelike behavior. This is important for applications (e.g., games, simulators, interactive displays) where an agent must behave in a manner that appears human-like. We present a novel technique for learning reactive policies that mimic demonstrated human behavior. The user demonstrates the desired behavior by dictating the agent's actions during an interactive animation. Later, when the agent is to behave autonomously, the recorded data is generalized to form a continuous state-to-action mapping. Combined with an appropriate animation algorithm (e.g., motion capture), the learned policies realize stylized and natural-looking agent behavior. We empirically demonstrate the efficacy of our technique for quickly producing policies which result in lifelike virtual agent behavior.

Jonathan Dinerstein, Parris K. Egbert, and Dan Ventura. 2007. Learning Policies for Embodied Virtual Agents through Demonstration. In Proceedings of the Twentieth International Joint Conference on Artificial Intelligence, IJCAI-07. IJCAI, 1257–1261. https://ijcai.org/proceedings/2007/203

@inproceedings{ijcai2007p203,
  title     = {Learning Policies for Embodied Virtual Agents through Demonstration},
  author    = {Dinerstein, Jonathan and Egbert, Parris K. and Ventura, Dan},
  booktitle = {Proceedings of the Twentieth International Joint Conference on
               Artificial Intelligence, {IJCAI-07}},
  publisher = {International Joint Conferences on Artificial Intelligence},
  editor    = {Ramon López de Mántaras},
  pages     = {1257--1261},
  year      = {2007},
  url       = {https://ijcai.org/proceedings/2007/203},
}

TY  - CPAPER
TI  - Learning Policies for Embodied Virtual Agents through Demonstration
AU  - Dinerstein, Jonathan
AU  - Egbert, Parris K.
AU  - Ventura, Dan
T2  - Proceedings of the Twentieth International Joint Conference on Artificial Intelligence, IJCAI-07
PB  - International Joint Conferences on Artificial Intelligence
PY  - 2007
SP  - 1257
EP  - 1261
UR  - https://ijcai.org/proceedings/2007/203
ER  -