{"type":"ScholarlyArticle","title":"Control Structures for Incorporating Picture-Specific Context in Image Interpretation","authors":[{"name":"Rajiv Chopra","slug":"rajiv-chopra","given":"Rajiv","family":"Chopra","affiliation":""},{"name":"Rohini K. Srihari","slug":"rohini-k-srihari","given":"Rohini K.","family":"Srihari","affiliation":""}],"abstract":"This paper describes an efficient control mechanism for incorporating picture-specific context in the task of image interpretation. Although other knowledge-based vision systems use general domain context in reducing the computational burden of image interpretation, to our knowledge, this is the first effort in exploring picture-specific collateral information. We assume that constraints on the picture are generated from a natural language understanding module which processes descriptive text accompanying the pictures. We have developed a unified framework for exploiting these constraints both in the object location and identification (labeling) stage. In particular, we describe a technique for incorporating constrained search in context-based vision. Finally, we demonstrate the effectiveness of this approach in PICTION, a system that uses captions to label human faces in newspaper photographs.","doi":null,"url":"https://ijcai.org/proceedings/1995/7","pdf":"https://ijcai.org/proceedings/1995/0007.pdf","markdown":"https://ijcai.org/proceedings/1995/7.md","bibtex":"https://ijcai.org/proceedings/1995/bibtex/7","volume":{"slug":"1995","title":"Proceedings of the Fourteenth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 1995","url":"https://ijcai.org/proceedings/1995/","year":1995,"location":"Montréal, Québec, Canada","dates":"","editors":"Chris S. Mellish","isbn":"","publisher":"International Joint Conferences on Artificial Intelligence","doi_prefix":""},"section":"Action and Perception","track":"Action and Perception","number":7,"pages":{"first":50,"last":54},"keywords":[],"videos":[],"references":[],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}