{"type":"ScholarlyArticle","title":"Automatic State Abstraction from Demonstration","authors":[{"name":"Luis C. Cobo","slug":"luis-c-cobo","given":"Luis C.","family":"Cobo","affiliation":""},{"name":"Peng Zang","slug":"peng-zang","given":"Peng","family":"Zang","affiliation":""},{"name":"Charles Lee Isbell Jr.","slug":"charles-lee-isbell-jr","given":"Charles Lee Isbell","family":"Jr.","affiliation":""},{"name":"Andrea Lockerd Thomaz","slug":"andrea-lockerd-thomaz","given":"Andrea Lockerd","family":"Thomaz","affiliation":""}],"abstract":"Learning from Demonstration (LfD) is a popular technique for building decision-making agents from human help. Traditional LfD methods use demonstrations as training examples for supervised learning, but complex tasks can require more examples than is practical to obtain. We present Abstraction from Demonstration (AfD), a novel form of LfD that uses demonstrations to infer state abstractions and reinforcement learning (RL) methods in those abstract state spaces to build a policy. Empirical results show that AfD is greater than an order of magnitude more sample efficient than jus tusing demonstrations as training examples, and exponentially faster than RL alone.","doi":"10.5591/978-1-57735-516-8/IJCAI11-211","url":"https://ijcai.org/proceedings/2011/211","pdf":"https://ijcai.org/proceedings/2011/0211.pdf","markdown":"https://ijcai.org/proceedings/2011/211.md","bibtex":"https://ijcai.org/proceedings/2011/bibtex/211","volume":{"slug":"2011","title":"Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2011","url":"https://ijcai.org/proceedings/2011/","year":2011,"location":"Barcelona, Catalonia, Spain","dates":"16–22 July 2011","editors":"Toby Walsh","isbn":"978-1-57735-512-0; 978-1-57735-513-7; 978-1-57735-514-4; 978-1-57735-515-1; 978-1-57735-516-8","publisher":"AAAI Press/International Joint Conferences on Artificial Intelligence","doi_prefix":""},"section":null,"track":"","number":211,"pages":{"first":1243,"last":1247},"keywords":[],"videos":[],"references":[],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}