Proceedings

LADDER: A Language to Describe Drawing, Display, and Editing in Sketch Recognition

Download BibTeX Cite

Proceedings of the Eighteenth International Joint Conference on Artificial Intelligence. Pages 461-466.

© 2003 International Joint Conferences on Artificial Intelligence

Abstract

We have created LADDER, the first language to describe how sketched diagrams in a domain are drawn, displayed, and edited. The difficulty in creating such a language is choosing a set of predefined entities that is broad enough to support a wide range of domains, while remaining narrow enough to be comprehensible. The language consists of predefined shapes, constraints, editing behaviors, and display methods, as well as a syntax for specifying a domain description sketch grammar and extending the language, ensuring that shapes and shape groups from many domains can be described. The language allows shapes to be built hierarchically (e.g., an arrow is built out of three lines), and includes the concept of "abstract shapes", analogous to abstract classes in an object oriented language. Shape groups describe how multiple domain shapes interact and can provide the sketch recognition system with information to be used in top-down recognition. Shape groups can also be used to describe "chain-reaction" editing commands that effect multiple shapes at once. To test th at recognition is feasible using this language, we have built a simple domain-independent sketch recognition system that parses the domain descriptions and generates the code necessary to recognize the shapes.

  1. [Alvarado eta!., 2002] C Alvarado, M Oltmans, and R Davis. A framework for multi-domain sketch recognition. AAAI Spring Symposium on Sketch Understanding, pages 1-8, March 25-27 2002. [Bimber eta/., 2000]
  2. Bimber, LM Encamao, and A Stork. A multi-layered architecture for sketch-based interaction within vir- tual environments. Computer and Graphics, 2000.
  3. [Booch eta/., 1998] G Booch, J Rumbaugh, and I Jacobson. The Unified Modeling Language User Guide. Addison-Wesley, Read- ing, MA, 1998.
  4. [Caetano eta/., 2002] A Caetano, N Goulart, M Fonseca, and J Jorge. Javasketchit: Issues in sketching the look of user inter- faces. AAAI Spring Symposium on Sketch Understanding, 2002.
  5. [Friedman-Hill, 1995] E Friedman-Hill. Jess, the rule engine for the java platform. http:/ lherzberg.ca.sandia.gov/jess/, 1995. Link
  6. [Gips, 1999] J Gips. Computer implementation of shape grammars. NSF/MIT Workshop on Shape Computation, 1999.
  7. [Gross and Do, 1996] MD Gross and EYL Do. Demonstrating the electronic cocktail napkin: a paper-like interface for early design. ACM Conference on Human Factors in Computing, pages 5--{) 1996. ,
  8. [Hunt and McGlashan, 2002] A Hunt and S McGlashan. Speech recognition grammar specification version 1.0, w3c candidate re- comentation. http://www.w3 .org/TR!speech-grammar, 26 June 2002. Link
  9. [Jacob eta/., 1999] RJK Jacob, L Deligiannidis, and S Morrison. A software model and specification language for non-WIMP user interfaces. ACM Transactions on Computer-Human Interaction, 6(1):1-46, 1999.
  10. [Mahoney and Fromherz, 2002] N Mahoney and MPJ Fromherz. Three main concerns in sketch recognition and an approach to ad- dressing them. AAAI Spring Symposium on Sketch Understand- ing, pages 105-112, March 25-27 2002.
  11. [Sezgin eta!., 2001] TM Sezgin, T Stahovich, and R Davis. Sketch based interfaces: Early processing for sketch understanding. Per- ceptive User Interfaces Workshop, 2001.
  12. [Sez~in, 2002] M Sezgin. Generating domain specific sketch recog- mzers from object descriptions. MIT Student Oxygen Workshop, 2002.
  13. [Stiny and Gips, 1972] G Stiny and J Gips. Shape grammars and the generative specification of painting and sculpture. Informa- tion Processing, pages 1460-1465, 1972.
  14. [Veselova, 2002] Veselova. Perceptually based learning of shape descriptions from one example. MIT Student Oxygen Workshop 2002. ' Zue eta/., 1990]
  15. V Zue, J Glass, M Phillips, and S Seneff. The mit speech recognition system: phonological modeling and lexical access. 1990 International Conference on Acoustics, Speech and Signal Processing, pages 49-52, March 25-27 1990.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards