Improving Information Extraction from Images with Learned Semantic Models

Stephan Baier, Yunpu Ma, Volker Tresp

Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence

Best Sister Conferences. Pages 5214-5218.

https://doi.org/10.24963/ijcai.2018/724

PDF BibTeX

Abstract

Many applications require an understanding of an image that goes beyond the simple detection and classification of its objects. In particular, a great deal of semantic information is carried in the relationships between objects. We have previously shown, that the combination of a visual model and a statistical semantic prior model can improve on the task of mapping images to their associated scene description. In this paper, we review the model and compare it to a novel conditional multi-way model for visual relationship detection, which does not include an explicitly trained visual prior model. We also discuss potential relationships between the proposed methods and memory models of the human brain.

Keywords

  • Machine Learning: Machine Learning
  • Natural Language Processing: Information Extraction
Welcome Future Conferences AI Journal Division IJCAI Proceedings Travel Grant Program IJCAI Awards