Proceedings

Teaching Robots through Situated Interactive Dialogue and Visual Demonstrations

Jose L. Part, Oliver Lemon

Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence

Doctoral Consortium. Pages 5201-5202.

https://doi.org/10.24963/ijcai.2017/760

PDF BibTeX

Abstract

The ability to quickly adapt to new environments and incorporate new knowledge is of great importance for robots operating in unstructured environments and interacting with non-expert users. This paper reports on our current progress in tackling this problem. We propose the development of a framework for teaching robots to perform tasks using natural language instructions, visual demonstrations and interactive dialogue. Moreover, we present a module for learning objects incrementally and on-the-fly that would enable robots to ground referents in the natural language instructions and reason about the state of the world.

Keywords

  • Artificial Intelligence: artificial intelligence
  • Artificial Intelligence: knowledge representation
  • Artificial Intelligence: natural language processing
  • Artificial Intelligence: robotics
Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards