{"type":"ScholarlyArticle","title":"Building a Visual Semantics Aware Object Hierarchy","authors":[{"name":"Xiaolei Diao","slug":"xiaolei-diao","given":"Xiaolei","family":"Diao","affiliation":"DISI , University of Trento , Italy"}],"abstract":"The semantic gap is defined as the difference between the linguistic representations of the same concept, which usually leads to misunderstanding between individuals with different knowledge backgrounds. Since linguistically annotated images are extensively used for training machine learning models, semantic gap problem (SGP) also results in inevitable bias on image annotations and further leads to poor performance on current computer vision tasks. To address this problem, we propose a novel unsupervised method to build visual semantics aware object hierarchy, aiming to get a classification model by learning from pure-visual information and to dissipate the bias of linguistic representations caused by SGP. Our intuition in this paper comes from real-world knowledge representation where concepts are hierarchically organized, and each concept can be described by a set of features rather than a linguistic annotation, namely visual semantic. The evaluation consists of two parts, firstly we apply the constructed hierarchy on the object recognition task and then we compare our visual hierarchy and existing lexical hierarchies to show the validity of our method. The preliminary results reveal the efficiency and potential of our proposed method.","doi":"10.24963/ijcai.2022/826","url":"https://ijcai.org/proceedings/2022/826","pdf":"https://ijcai.org/proceedings/2022/0826.pdf","markdown":"https://ijcai.org/proceedings/2022/826.md","bibtex":"https://ijcai.org/proceedings/2022/bibtex/826","volume":{"slug":"2022","title":"Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2022","url":"https://ijcai.org/proceedings/2022/","year":2022,"location":"Vienna","dates":"23-29 July 2022","editors":"Luc De Raedt","isbn":"978-1-956792-00-3","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2022"},"section":"Doctoral Consortium","track":"Doctoral Consortium","number":826,"pages":{"first":5847,"last":5848},"keywords":["Computer Vision (CV): General"],"videos":[],"references":[{"position":1,"raw":"[Caron et al., 2019] Mathilde Caron, Piotr Bojanowski, Julien Mairal, and Armand Joulin. Unsupervised pre- training of image features on non-curated data. In IEEE/CVF ICCV, pages 2959-2968, 2019.","title":"Unsupervised pretraining of image features on non-curated data","authors":"Mathilde Caron, Piotr Bojanowski, Julien Mairal, Armand Joulin","year":"2019","venue":"IEEE/CVF ICCV","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Giunchiglia et al., 2021] Fausto Giunchiglia, Luca Ercu- liani, and Andrea Passerini. Towards visual semantics. Springer Nature Computer Science, 2(446), 2021.","title":"Towards visual semantics","authors":"Fausto Giunchiglia, Luca Erculiani, Andrea Passerini","year":"2021","venue":"Springer Nature Computer Science","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Giunchiglia et al., 2022] Fausto Giunchiglia, Mayukh Bagchi, and Xiaolei Diao. Visual ground truth con- struction as faceted classification. arXiv preprint arXiv:2202.08512, 2022.","title":"Visual ground truth construction as faceted classification","authors":"Fausto Giunchiglia, Mayukh Bagchi, Xiaolei Diao","year":"2022","venue":null,"doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Miller, 1995] George A Miller. Wordnet: a lexical database for english. Communications of the ACM, 38(11):39-41, 1995.","title":"Wordnet: a lexical database for english","authors":"George A Miller","year":"1995","venue":"Communications of the ACM","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Smeulders et al., 2000] Arnold WM Smeulders, Marcel Worring, Simone Santini, Amarnath Gupta, and Ramesh Jain. Content-based image retrieval at the end of the early years. IEEE Transactions on pattern analysis and machine intelligence, 22(12):1349-1380, 2000.","title":"Content-based image retrieval at the end of the early years","authors":"W M Arnold, Marcel Smeulders, Simone Worring, Amarnath Santini, Ramesh Gupta, Jain","year":"2000","venue":"IEEE Transactions on pattern analysis and machine intelligence","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}