Proceedings

Autonomously Learning an Action Hierarchy Using a Learned Qualitative State Representation

Jonathan Mugan, Benjamin Kuipers

Download BibTeX Cite

Proceedings of the Twenty-First International Joint Conference on Artificial Intelligence. Pages 1175-1179.

Abstract

There has been intense interest in hierarchical reinforcement learning as a way to make Markov decision process planning more tractable, but there has been relatively little work on autonomously learning the hierarchy, especially in continuous domains. In this paper we present a method for learning a hierarchy of actions in a continuous environment. Our approach is to learn a qualitative representation of the continuous environment and then to define actions to reach qualitative states. Our method learns one or more options to perform each action. Each option is learned by first learning a dynamic Bayesian network (DBN). We approach this problem from a developmental robotics perspective. The agent receives no extrinsic reward and has no external direction for what to learn. We evaluate our work using a simulation with realistic physics that consists of a robot playing with blocks at a table.Jonathan Mugan, Benjamin Kuipers

Jonathan Mugan, and Benjamin Kuipers. 2009. Autonomously Learning an Action Hierarchy Using a Learned Qualitative State Representation. In Proceedings of the Twenty-First International Joint Conference on Artificial Intelligence, IJCAI-09. IJCAI, 1175–1179. https://ijcai.org/proceedings/2009/198
Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards