Proceedings

An Experts Algorithm for Transfer Learning

Download BibTeX Cite

Proceedings of the Twentieth International Joint Conference on Artificial Intelligence. Pages 1065-1069.

Abstract

A long-lived agent continually faces new tasks in its environment. Such an agent may be able to use knowledge learned in solving earlier tasks to produce candidate policies for its current task. There may, however, be multiple reasonable policies suggested by prior experience, and the agent must choose between them potentially without any a priori knowledge about their applicability to its current situation. We present an experts algorithm for efficiently choosing amongst candidate policies in solving an unknown Markov decision process task. We conclude with the results of experiments on two domains in which we generate candidate policies from solutions to related tasks and use our experts algorithm to choose amongst them.

Erik Talvitie, and Satinder Singh. 2007. An Experts Algorithm for Transfer Learning. In Proceedings of the Twentieth International Joint Conference on Artificial Intelligence, IJCAI-07. IJCAI, 1065–1069. https://ijcai.org/proceedings/2007/172
Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards