---
title: "A Plot Understanding System on Reference to Both Image and Language"
authors:
  - "Norihiro Abe"
  - "Itsuya Soga"
  - "Saburo Tsuji"
doi: ""
url: "https://ijcai.org/proceedings/1981/18"
pdf: "https://ijcai.org/proceedings/1981/0018.pdf"
venue: "Proceedings of the Seventh International Joint Conference on Artificial Intelligence"
year: 1981
pages: "77-83"
track: "Natural Language"
keywords:
---

# A Plot Understanding System on Reference to Both Image and Language

Norihiro Abe, Itsuya Soga, Saburo Tsuji

*Proceedings of the Seventh International Joint Conference on Artificial Intelligence*, pages 77-83.

## Abstract

In tl\is paper, a. system is described tl\a.t ca.n understand a. plot of a. story on reference to botl\ ima.te and linguistic information. As input, a. series of line drawings witl\ colors and narrations in Entlisl\ concerning to tl\ese drawings a.re given to tl\e system. It searches tl\e objects suggested to be in tl\e scene by tl\e narrations, finding relations among tl\em, ma.kinll tl\e world model by usinll its world knowledte. Its refernce to tl\ose drawings makes it easy for system to ana.lize complicated structures in tl\e narration sentences sucl\ a.s tl\ose of prepositions, and tuides tl\e process rea.soninll about tl\e CD representation usinll rules and demons. At the end of tl\is paper, a result on QA will be sl\own