Proceedings

Bayesian Inverse Reinforcement Learning

Deepak Ramachandran, Eyal Amir

Download BibTeX Cite

Proceedings of the Twentieth International Joint Conference on Artificial Intelligence. Pages 2586-2590.

Abstract

Inverse Reinforcement Learning (IRL) is the problem of learning the reward function underlying a Markov Decision Process given the dynamics of the system and the behaviour of an expert. IRL is motivated by situations where knowledge of the rewards is a goal by itself (as in preference elicitation) and by the task of apprenticeship learning (learning policies from an expert). In this paper we show how to combine prior knowledge and evidence from the expert's actions to derive a probability distribution over the space of reward functions. We present efficient algorithms that find solutions for the reward learning and apprenticeship learning tasks that generalize well over these distributions. Experimental results show strong improvement for our methods over previous heuristic-based approaches.

Deepak Ramachandran, and Eyal Amir. 2007. Bayesian Inverse Reinforcement Learning. In Proceedings of the Twentieth International Joint Conference on Artificial Intelligence, IJCAI-07. IJCAI, 2586–2590. https://ijcai.org/proceedings/2007/416
Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards