Sketch Recognition via Part-based Hierarchical Analogical Learning

Kezhen Chen, Ken Forbus, Balaji Vasan Srinivasan, Niyati Chhaya, Madeline Usher

Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence

Main Track. Pages 2967-2974.

https://doi.org/10.24963/ijcai.2023/331

PDF BibTeX

Abstract

Sketch recognition has been studied for decades, but it is far from solved. Drawing styles are highly variable across people and adapting to idiosyncratic visual expressions requires data-efficient learning. Explainability also matters, so that users can see why a system got confused about something. This paper introduces a novel part-based approach for sketch recognition, based on hierarchical analogical learning, a new method to apply analogical learning to qualitative representations. Given a sketched object, our system automatically segments it into parts and constructs multi-level qualitative representations of them. Our approach performs analogical generalization at multiple levels of part descriptions and uses coarse-grained results to guide interpretation at finer levels. Experiments on the Berlin TU dataset and the Coloring Book Objects dataset show that the system can learn explainable models in a data-efficient manner.

Keywords

  • Humans and AI: HAI: Cognitive modeling
  • Knowledge Representation and Reasoning: KRR: Case-based reasoning
  • Knowledge Representation and Reasoning: KRR: Qualitative, geometric, spatial, and temporal reasoning
Welcome Future Conferences AI Journal Division IJCAI Proceedings Travel Grant Program IJCAI Awards