Aesop: A Visual Storytelling Platform for Conversational AI

Aesop: A Visual Storytelling Platform for Conversational AI

Tim Meo, Aswin Raghavan, David A. Salter, Alex Tozzo, Amir Tamrakar, Mohamed Amer

Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence

We present a new collaborative visual storytelling platform, Aesop, for direction and animation. Aesop consists of a language parser, human gesture monitoring, composition graphs, dialogue state manager, and an interactive 3D animation software. Aesop thus enables 3D spatial and temporal reasoning which are both essential for storytelling. Our key innovation is to enable conversational AI using both verbal and non-verbal communication, which enables research in language, vision, and planning.
Keywords:
Knowledge Representation, Reasoning, and Logic: Geometric, Spatial, and Temporal Reasoning
Multidisciplinary Topics and Applications: Human-Computer Interaction
Natural Language Processing: Dialogue
Natural Language Processing: NLP Applications and Tools