{"type":"ScholarlyArticle","title":"General Game Learning Using Knowledge Transfer","authors":[{"name":"Bikramjit Banerjee","slug":"bikramjit-banerjee","given":"Bikramjit","family":"Banerjee","affiliation":""},{"name":"Peter Stone","slug":"peter-stone","given":"Peter","family":"Stone","affiliation":""}],"abstract":"We present a reinforcement learning game player that can interact with a General Game Playing system and transfer knowledge learned in one game to expedite learning in many other games. We use the technique of value-function transfer where general features are extracted from the state space of a previous game and matched with the completely different state space of a new game. To capture the underlying similarity of vastly disparate state spaces arising from different games, we use a game-tree lookahead structure for features. We show that such feature-based value function transfer learns superior policies faster than a reinforcement learning agent that does not use knowledge transfer. Furthermore, knowledge transfer using lookahead features can capture opponent-specific value-functions, i.e. can exploit an opponent's weaknesses to learn faster than a reinforcement learner that uses lookahead with minimax (pessimistic) search against the same opponent.","doi":null,"url":"https://ijcai.org/proceedings/2007/107","pdf":"https://ijcai.org/proceedings/2007/0107.pdf","markdown":"https://ijcai.org/proceedings/2007/107.md","bibtex":"https://ijcai.org/proceedings/2007/bibtex/107","volume":{"slug":"2007","title":"Proceedings of the Twentieth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2007","url":"https://ijcai.org/proceedings/2007/","year":2007,"location":"Hyderabad, India","dates":"","editors":"Ramon López de Mántaras","isbn":"","publisher":"International Joint Conferences on Artificial Intelligence","doi_prefix":""},"section":null,"track":"","number":107,"pages":{"first":672,"last":676},"keywords":[],"videos":[],"references":[],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}