Incrementally Grounding Expressions for Spatial Relations between Objects

Incrementally Grounding Expressions for Spatial Relations between Objects

Tiago Mota, Mohan Sridharan

Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence
Main track. Pages 1928-1934. https://doi.org/10.24963/ijcai.2018/266

Recognizing, reasoning about, and providing understandable descriptions of spatial relations between objects is an important task for robots interacting with humans. This paper describes an architecture for incrementally learning and revising the grounding of spatial relations between objects. Answer Set Prolog, a declarative language, is used to represent and reason with incomplete knowledge that includes prepositional spatial relations between scene objects. A generic grounding of prepositions for spatial relations, human input (when available), and non-monotonic logical inference, are used to infer spatial relations between 3D point clouds in given scenes, incrementally acquiring a specialized metric grounding of the prepositions and the relative confidence associated with each grounding. The architecture is evaluated on a benchmark dataset of tabletop images and on complex simulated scenes of furniture.
Keywords:
Knowledge Representation and Reasoning: Geometric, Spatial, and Temporal Reasoning
Robotics: Human Robot Interaction
Robotics: Learning in Robotics