Incrementally Grounding Expressions for Spatial Relations between Objects

Tiago Mota, Mohan Sridharan

Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence

Main track. Pages 1928-1934.

https://doi.org/10.24963/ijcai.2018/266

PDF BibTeX

Abstract

Recognizing, reasoning about, and providing understandable descriptions of spatial relations between objects is an important task for robots interacting with humans. This paper describes an architecture for incrementally learning and revising the grounding of spatial relations between objects. Answer Set Prolog, a declarative language, is used to represent and reason with incomplete knowledge that includes prepositional spatial relations between scene objects. A generic grounding of prepositions for spatial relations, human input (when available), and non-monotonic logical inference, are used to infer spatial relations between 3D point clouds in given scenes, incrementally acquiring a specialized metric grounding of the prepositions and the relative confidence associated with each grounding. The architecture is evaluated on a benchmark dataset of tabletop images and on complex simulated scenes of furniture.

Keywords

  • Knowledge Representation and Reasoning: Geometric, Spatial, and Temporal Reasoning
  • Robotics: Human Robot Interaction
  • Robotics: Learning in Robotics
Welcome Future Conferences AI Journal Division IJCAI Proceedings Travel Grant Program IJCAI Awards