{"type":"ScholarlyArticle","title":"Relational Knowledge with Predictive State Representations","authors":[{"name":"David Wingate","slug":"david-wingate","given":"David","family":"Wingate","affiliation":""},{"name":"Vishal Soni","slug":"vishal-soni","given":"Vishal","family":"Soni","affiliation":""},{"name":"Britton Wolfe","slug":"britton-wolfe","given":"Britton","family":"Wolfe","affiliation":""},{"name":"Satinder Singh","slug":"satinder-singh","given":"Satinder","family":"Singh","affiliation":""}],"abstract":"Most work on Predictive Representations of State (PSRs) has focused on learning and planning in unstructured domains (for example, those represented by flat POMDPs). This paper extends PSRs to represent relational knowledge about domains, so that they can use policies that generalize across different tasks, capture knowledge that ignores irrelevant attributes of objects, and represent policies in a way that is independent of the size of the state space. Using a blocks world domain, we show how generalized predictions about the future can compactly capture relations between objects, which in turn can be used to naturally specify relational-style options and policies. Because our representation is expressed solely in terms of actions and observations, it has extensive semantics which are statistics about observable quantities.","doi":null,"url":"https://ijcai.org/proceedings/2007/328","pdf":"https://ijcai.org/proceedings/2007/0328.pdf","markdown":"https://ijcai.org/proceedings/2007/328.md","bibtex":"https://ijcai.org/proceedings/2007/bibtex/328","volume":{"slug":"2007","title":"Proceedings of the Twentieth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2007","url":"https://ijcai.org/proceedings/2007/","year":2007,"location":"Hyderabad, India","dates":"","editors":"Ramon López de Mántaras","isbn":"","publisher":"International Joint Conferences on Artificial Intelligence","doi_prefix":""},"section":null,"track":"","number":328,"pages":{"first":2035,"last":2039},"keywords":[],"videos":[],"references":[],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}