Proceedings

A Plot Understanding System on Reference to Both Image and Language

Download BibTeX Cite

Proceedings of the Seventh International Joint Conference on Artificial Intelligence. Natural Language. Pages 77-83.

© 1981 International Joint Conferences on Artificial Intelligence

Abstract

In tl\is paper, a. system is described tl\a.t ca.n understand a. plot of a. story on reference to botl\ ima.te and linguistic information. As input, a. series of line drawings witl\ colors and narrations in Entlisl\ concerning to tl\ese drawings a.re given to tl\e system. It searches tl\e objects suggested to be in tl\e scene by tl\e narrations, finding relations among tl\em, ma.kinll tl\e world model by usinll its world knowledte. Its refernce to tl\ose drawings makes it easy for system to ana.lize complicated structures in tl\e narration sentences sucl\ a.s tl\ose of prepositions, and tuides tl\e process rea.soninll about tl\e CD representation usinll rules and demons. At the end of tl\is paper, a result on QA will be sl\own

  1. * R)~RESENTATIONS ** ll 108,\Q =P= PTRANS -o-OBAQ -D-OlPL liiHEREll 2l IOBAQ =P= Pfi'RANS -0-API'LF.51 -R-OUilll OBAQll 3l (($POSl APPLE! ON TREE! +.723:J29E+08 +.264331E••00l 4l (I *I'OSl APPLI!:2 ON TIU:E I + . 21U1823E+00 + . 23B853E+00l :Jl <<*POSl APPLE3 ON l~EI +.43:J294E+00 +.:J63694E+OOl 61 «*POSl APPLE51 ON TREEll 7) ( 084Q = P= A TRANS -0-STONE I -D-Olllllll OBAQ) = R= < 12l l 121 <OBAQ =P= SMOVE -0-STONE! -D-(lllllllll ::<I'Lll =E= <71 •RI= 16 =R= ( 18 23 26 3lll 13) <<*POSl APPLE! ON TIU:El +.71~169E+88 +.271~42E+OOl 141 ( < *I'OSl APPLE2 ON TREt:t + . 26~62:JE+88 +. 245{)96E+80l l~l ((*POSl APPLES! ON TREEll 161 <OBAQ =P= PROPEL -0-APPLE3 -D-((+.177382E+03 +.137341E+83 +.977839E+80l <+ . 196673E+03 +. 173271E+03 +.62060:JE+08ll -1-121 171 <<*POSl APPJ.E3 CONTACT OBAQ + . I09574E+OI +.7437:JOE+08l 161 <OBAQ =P= ATHANS -0-APPLE3 -D-(lllllllll OHAQl =E= ( 12) =R= 123 26 31ll 19l <<*POSl APPLE! ON TllEEI +.743055E+00 + . 265100E+00l 201 <<*POSl APPLE2 ON TREE! +.312:J00E+00 +.244966E+00l 21 l ( < *POSl APPLE:J I ON TR):Et l 221 <<*PSSl HOUSEl OHAQl 231 IOBAQ =P= Pl~S -0-APPLE3 -D-(lllllllll HOUSEl) -1-24 =E• ( 12 16ll 241 <OBAQ =P= PTRANS -0-OBAQ -D-(lllllllll HOUSEill 2:Jl <OBAQ =P= PTRANS -0-OBAQ -D-llllllllll I INSIDE HOUSEilll 26l IOBAQ =P= PTRANS -0-APPLE3 -D-llllllllll liiPLl =E= < 12 16ll 271 <<*POSl APPLE3 ON TABLEt +.456522E+00 -.215909E+00l 261 <OJIRO =P• PTRANS -0-OJIRO -D-(lllllllll OBAQl -1-29l 29l <OBAQ =P= PROPEL -0 -VOICE-D-<OBAQ OJIROll 301 I<*POSl APPLE3 ON TABLEt) 31l <OBAQ =P= ATRANS -0-APPLE3 -R-<OBAQ OJIROl =E= ( 12 16ll 321 <OJJRO =P= INGEST -0-APPLE3 -D-<MOUTH STO~CRll References (I )R.Schank : Conceptual lnf ormation Processing, North- Holland Publishing Co .Ltd. 1975
  2. W.lehnert : H•1man and Comp!'latlonal Question Answeri ng, Congnltive Scler.ce I, 47-74(1977)
  3. E.Charniak : Toward a Model of Children's St o r y Comprehension, AITR-2666, MIT, ( 1972)
  4. J .Carbonell : Toward s a Process Model of Hum an Personality Traits, Artificial Intelligence 15 , 49-74 ( 1980)
  5. R.Schank : Controling Inference, Artlflcall Intelligence 12 , 273-297 ( 1979)
  6. R .WIIensky : Why Jhon Married Mal'y : Under r tand i~g Stories Involving Recurring Goals, Cognitive Science 2, 235-267 (1978)
  7. D .Waltz, l.Bogge ss: Visual Analog RepresentatiCin > for Natural language Understanding, 6th-IJCAI, 926-034( 1979)
  8. S . TsuJI,S.Kuroda and A.Morizono : A Simple CJrloon Fi lm Understanding System, 5th-IJCAI, 609-610 ( 1977)
  9. S . TsuJI ,M.O sada a'ld M. Yachlda: Three Dimen sional Mov e- ment Analysis of Dynamic Images, 6th-IJCAI , 896-90 I ( 1979)

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards