Proceedings

Generating Explanatory Captions for Information Graphics

Download BibTeX Cite

Proceedings of the Fourteenth International Joint Conference on Artificial Intelligence. Natural Language. Pages 1276-1282.

© 1995 International Joint Conferences on Artificial Intelligence

Abstract

Graphical presentations can be used to communicate information in relational data sets succinctly and effectively. However, novel graphical presentations about numerous attributes and their relationships are often difficult to understand completely until explained. Automatically generated graphical presentations must therefore either be limited to simple, conventional ones, or risk incomprehensibility. One way of alleviating this problem is to design graphical presentation systems that can work in conjunction with a natural language generator to produce "explanatory captions." This paper presents three strategies for generating explanatory captions to accompany information graphics based on : ( 1) a representation of the structure of the graphical presentation (2) a framework for identifying the perceptual complexity of graphical elements, and (3) the structure of the data expressed in the graphic. We describe an implemented system and illustrate how it is used to generate explanatory captions for a range of graphics from a data set about real estate transactions in Pittsburgh

  1. [Casner, 1991] Steven Casner. A task-analytic approach to the automated design of graphic presentations.ACM Trans - actions on Graphics, 10(2): 111-15l , Aprill991.
  2. [Dale, 1992] Robert Dale. Generatin[!, Referrin[!, Expres• sions. ACL-MIT Series in Natural Language Processing. The MIT Press, 1992.
  3. [Elhadad, 1992] Michael Elhadad. Using Argumentation to Control Lexical Choice: A Fun ctional Un!fication Imple- mentation. PhD thesis, Columbia Univ., New York, NY, 1992.
  4. [Feiner and McKeown, 1993] Steven K. Feiner and Kath- leen R. McKeown. Automating the Generation of Coordi - nated Multimedia Explanations. In Maybury [ 1993], pages 117-138.
  5. [Grosz eta!., 1995] Barbara J. Grosz, Aravind K. Joshi , and Scott Weinstein. Centering: A Framework for Modelling the Local Coherence of Discourse. TR 95-01 , IRCS , Univ. of Pennsylvania, Jan. 1995.
  6. [Mackinlay, 1986] Jock D. Mackinlay. Automating the de- sign of graphical presentations of relational information. ACM Transactions on Graphics , 5(2) : 110-141 , April 1986.
  7. [Marks, 1991] J. Marks . Automating the Design of Network Diagrams. PhD thesis, Harvard Univ., Dept. of Computer Science, 1991.
  8. [Maybury, 1993] Mark T. Maybury, editor. Intelligent Mul - timedia Interfaces. MIT Press, Menlo Park, CA, 1993.
  9. [Moore and Paris, 1993] Johanna D. Moore and Cecile L. Paris. Planning Text for Advisory Dialogues : Capturing Intentional and Rhetorical Information. Computational Linguistics, 19(4):65 1-694, December 1993.
  10. [Moore, 1995] Johanna D. Moore. Participating in Explana- tory Dialogues: Interpreting and Responding to Questions in Context. MIT Press, Cambridge, MA, 1995.
  11. [Nugent, 1983] Gwen C. Nugent. Deaf students ' learning from captioned instruction: The relationship between the visual and caption display. Journal of Special Education , 17(2):227-234, 1983 .
  12. [Roth and Hefley, 1993] Steven F. Roth and William E. Hefley. Intelligent Multimedia Presentation Systems: Re- search and Principles. In Maybury [1993] , pages 13-58.
  13. [Roth and Mattis , 1990] Steven F. Roth and Joe Mattis. Data characterization for intelligent graphics presentation. In Proc. CHI '90, pages 193-200, New Orleans, LA., 1990. ACM/SIGCHI.
  14. [Roth et at., 1994] Steven F. Roth , John Kolojejchick, Joe Mattis, and Jade Goldstein. Interactive graphic design using automatic presentation knowledge. In Proc. CH/'94, Boston, MA , 1994. ACM/SIGCHI.
  15. [Schmid, 1983] Calvin F. Schmid. Statistical Graphics: De- sign Principles and Practices. John Wiley and Sons, 1983.
  16. [Wahlster et at., 1993] Wolfgang Wahlster, Elisabeth Andre, W. Finkler, H. J. Profitlich, and Thomas Rist. Plan-based integration of natural-language and graphics generation. An(ficial Intelligence, 63( 12):387-427, October 1993.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards