{"type":"ScholarlyArticle","title":"Relation Extraction Using Supervision from Topic Knowledge of Relation Labels","authors":[{"name":"Haiyun Jiang","slug":"haiyun-jiang","given":"Haiyun","family":"Jiang","affiliation":"Shanghai Key Laboratory of Data Science , School of Computer Science , Fudan University , China"},{"name":"Li Cui","slug":"li-cui","given":"Li","family":"Cui","affiliation":"School of Data Science , Fudan University , Shanghai , China"},{"name":"Zhe Xu","slug":"zhe-xu","given":"Zhe","family":"Xu","affiliation":"Shanghai Key Laboratory of Data Science , School of Computer Science , Fudan University , China"},{"name":"Deqing Yang","slug":"deqing-yang","given":"Deqing","family":"Yang","affiliation":"School of Data Science , Fudan University , Shanghai , China"},{"name":"Jindong Chen","slug":"jindong-chen","given":"Jindong","family":"Chen","affiliation":"Shanghai Key Laboratory of Data Science , School of Computer Science , Fudan University , China"},{"name":"Chenguang Li","slug":"chenguang-li","given":"Chenguang","family":"Li","affiliation":"Shanghai Key Laboratory of Data Science , School of Computer Science , Fudan University , China"},{"name":"Jingping Liu","slug":"jingping-liu","given":"Jingping","family":"Liu","affiliation":"Shanghai Key Laboratory of Data Science , School of Computer Science , Fudan University , China"},{"name":"Jiaqing Liang","slug":"jiaqing-liang","given":"Jiaqing","family":"Liang","affiliation":"Shanghai Key Laboratory of Data Science , School of Computer Science , Fudan University , China"},{"name":"Chao Wang","slug":"chao-wang","given":"Chao","family":"Wang","affiliation":"Shanghai Key Laboratory of Data Science , School of Computer Science , Fudan University , China"},{"name":"Yanghua Xiao","slug":"yanghua-xiao","given":"Yanghua","family":"Xiao","affiliation":"Shanghai Key Laboratory of Data Science , School of Computer Science , Fudan University , China; Shanghai Institute of Intelligent Electronics & Systems , Shanghai , China"},{"name":"Wei Wang","slug":"wei-wang","given":"Wei","family":"Wang","affiliation":"Shanghai Key Laboratory of Data Science , School of Computer Science , Fudan University , China; Shanghai Institute of Intelligent Electronics & Systems , Shanghai , China"}],"abstract":"Explicitly exploring the semantics of a relation is significant for high-accuracy relation extraction, which is, however, not fully studied in previous work.\r\n\tIn this paper, we mine the topic knowledge of a relation to explicitly represent the semantics of this relation, and model relation extraction as a matching problem.\r\n\tThat is, the matching score between a sentence and a candidate relation is predicted for an entity pair.\r\n\tTo this end, we propose a deep matching network to precisely model the semantic similarity between a sentence-relation pair.\r\n\tBesides, the topic knowledge also allows us to derive the importance information of samples as well as two knowledge-guided negative sampling strategies in the training process.\r\n\tWe conduct extensive experiments to evaluate the proposed framework and observe improvements in AUC of 11.5% and max F1 of 5.4% over the baselines with state-of-the-art performance.","doi":"10.24963/ijcai.2019/698","url":"https://ijcai.org/proceedings/2019/698","pdf":"https://ijcai.org/proceedings/2019/0698.pdf","markdown":"https://ijcai.org/proceedings/2019/698.md","bibtex":"https://ijcai.org/proceedings/2019/bibtex/698","volume":{"slug":"2019","title":"Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2019","url":"https://ijcai.org/proceedings/2019/","year":2019,"location":"Macao","dates":"10-16 August 2019","editors":"Sarit Kraus","isbn":"978-0-9992411-4-1","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2019"},"section":"Natural Language Processing","track":"Main track","number":698,"pages":{"first":5024,"last":5030},"keywords":["Natural Language Processing: Knowledge Extraction","Natural Language Processing: Information Extraction","Natural Language Processing: Natural Language Processing"],"videos":[],"references":[{"position":1,"raw":"[Alfonseca et al., 2012] Enrique Alfonseca, Katja Filippova, Jean Yves Delort, and Guillermo Garrido. Pattern learning for relation extraction with a hierarchical topic model. In Meeting of the Association for Computational Linguistics: Short Papers, 2012.","title":"Pattern learning for relation extraction with a hierarchical topic model","authors":"Enrique Alfonseca, Katja Filippova, Jean Yves Delort, Guillermo Garrido","year":"2012","venue":"Meeting of the Association for Computational Linguistics: Short Papers","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Alicante and Corazza, 2011] Anita Alicante and Anna Corazza. Barrier features for classification of semantic relations. In Proceedings of the International Conference Recent Advances in Natural Language Processing 2011, pages 509-514, 2011.","title":"Barrier features for classification of semantic relations","authors":"Alicante, Corazza, Anita Alicante, Anna Corazza","year":"2011","venue":"Proceedings of the International Conference Recent Advances in Natural Language Processing","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Bunescu and Mooney, 2005] Razvan C Bunescu and Ray- mond J Mooney. A shortest path dependency kernel for relation extraction. In Proceedings of the conference on human language technology and empirical methods in nat- ural language processing, pages 724-731. Association for Computational Linguistics, 2005.","title":"A shortest path dependency kernel for relation extraction","authors":"C Razvan, Raymond J Bunescu, Mooney","year":"2005","venue":"Proceedings of the conference on human language technology and empirical methods in natural language processing","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Chang et al., 2011] Wang Chang, James Fan, Aditya Kalyanpur, and David Gondek. Relation extraction with relation topics. In Conference on Empirical Methods in Natural Language Processing, 2011.","title":"Relation extraction with relation topics","authors":"Wang Chang, James Fan, Aditya Kalyanpur, David Gondek","year":"2011","venue":"Conference on Empirical Methods in Natural Language Processing","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Feng et al., 2018] Jun Feng, Minlie Huang, Li Zhao, Yang Yang, and Xiaoyan Zhu. Reinforcement learning for re- lation classification from noisy data. In Proceedings of AAAI, 2018.","title":"Reinforcement learning for relation classification from noisy data","authors":"Jun Feng, Minlie Huang, Li Zhao, Yang Yang, Xiaoyan Zhu","year":"2018","venue":"Proceedings of AAAI","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[GuoDong et al., 2005] Zhou GuoDong, Su Jian, Zhang Jie, and Zhang Min. Exploring various knowledge in relation extraction. In Proceedings of the 43rd annual meeting on association for computational linguistics, pages 427-434. Association for Computational Linguistics, 2005.","title":"Exploring various knowledge in relation extraction","authors":"Zhou Guodong, Su Jian, Zhang Jie, Zhang Min","year":"2005","venue":"Proceedings of the 43rd annual meeting on association for computational linguistics","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Hoffmann and Zhang, 2011] Raphael Hoffmann and Con- gle Zhang. Knowledge-based weak supervision for infor- mation extraction of overlapping relations. In Proceedings of the 49th Annual Meeting of the Association for Compu- tational Linguistics, pages 541-550. Association for Com- putational Linguistics, 2011.","title":"Knowledge-based weak supervision for information extraction of overlapping relations","authors":"Zhang Hoffmann, Raphael Hoffmann, Congle Zhang","year":"2011","venue":"Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Ji et al., 2017] Guoliang Ji, Kang Liu, Shizhu He, Jun Zhao, et al. Distant supervision for relation extraction with sentence-level attention and entity descriptions. In AAAI, pages 3060-3066, 2017.","title":"Distant supervision for relation extraction with sentence-level attention and entity descriptions","authors":"Guoliang Ji, Kang Liu, Shizhu He, Jun Zhao","year":"2017","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Jiang et al., 2016] Xiaotian Jiang, Quan Wang, Peng Li, and Bin Wang. Relation extraction with multi-instance multi-label convolutional neural networks. In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics, pages 1471-1480, 2016.","title":"Relation extraction with multi-instance multi-label convolutional neural networks","authors":"Xiaotian Jiang, Quan Wang, Peng Li, Bin Wang","year":"2016","venue":"Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Kusner et al., 2015] Matt Kusner, Yu Sun, Nicholas Kolkin, and Kilian Weinberger. From word embeddings to docu- ment distances. In International Conference on Machine Learning, pages 957-966, 2015.","title":"From word embeddings to document distances","authors":"Matt Kusner, Yu Sun, Nicholas Kolkin, Kilian Weinberger","year":"2015","venue":"International Conference on Machine Learning","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Lin et al., 2016] Yankai Lin, Shiqi Shen, Zhiyuan Liu, Huanbo Luan, and Maosong Sun. Neural relation extrac- tion with selective attention over instances. In Proceedings of the 54th Annual Meeting of the Association for Compu- tational Linguistics, volume 1, pages 2124-2133, 2016.","title":"Neural relation extraction with selective attention over instances","authors":"Lin","year":"2016","venue":"Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Mintz et al., 2009] Mike Mintz, Steven Bills, Rion Snow, and Dan Jurafsky. Distant supervision for relation ex- traction without labeled data. In Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL, pages 1003-1011. Association for Computational Linguistics, 2009.","title":"Distant supervision for relation extraction without labeled data","authors":"Mike Mintz, Steven Bills, Rion Snow, Dan Jurafsky","year":"2009","venue":"Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Nguyen and Nguyen, 2019] Tien Thanh Nguyen and Thi Thu Thuy Nguyen. Multi-label classification via label cor- relation and first order feature dependance in a data stream. Pattern Recognition, 90:35-51, 2019.","title":"Multi-label classification via label correlation and first order feature dependance in a data stream","authors":"Nguyen ; Nguyen, Thanh Tien, Thi Nguyen, Thuy Thu, Nguyen","year":"2019","venue":"Pattern Recognition","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Riedel et al., 2010] Sebastian Riedel, Limin Yao, and An- drew McCallum. Modeling relations and their mentions without labeled text. In Joint European Conference on Ma- chine Learning and Knowledge Discovery in Databases, pages 148-163. Springer, 2010.","title":"Modeling relations and their mentions without labeled text","authors":"Sebastian Riedel, Limin Yao, Andrew Mccallum","year":"2010","venue":"Joint European Conference on Machine Learning and Knowledge Discovery in Databases","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Rocktäschel et al., 2015] Tim Rocktäschel, Sameer Singh, and Sebastian Riedel. Injecting logical background knowl- edge into embeddings for relation extraction. In Proceed- ings of the 2015 Conference of the North American Chap- ter of the Association for Computational Linguistics, pages 1119-1129, 2015.","title":"Injecting logical background knowledge into embeddings for relation extraction","authors":"Tim Rocktäschel, Sameer Singh, Sebastian Riedel","year":"2015","venue":"Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Shen et al., 2018] Tao Shen, Tianyi Zhou, Guodong Long, Jing Jiang, and Chengqi Zhang. Bi-directional block self- attention for fast and memory-efficient sequence model- ing. arXiv preprint arXiv:1804.00857, 2018.","title":"Bi-directional block selfattention for fast and memory-efficient sequence modeling","authors":"Tao Shen, Tianyi Zhou, Guodong Long, Jing Jiang, Chengqi Zhang","year":"2018","venue":null,"doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Vaswani et al., 2017] Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. Attention is all you need. In Advances in Neural Information Processing Sys- tems, pages 5998-6008, 2017.","title":"Attention is all you need","authors":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, Illia Polosukhin","year":"2017","venue":"Advances in Neural Information Processing Systems","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Wu et al., 2017] Yi Wu, David Bamman, and Stuart Russell. Adversarial training for relation extraction. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pages 1778-1783, 2017.","title":"Adversarial training for relation extraction","authors":"Yi Wu, David Bamman, Stuart Russell","year":"2017","venue":"Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Zeng et al., 2014] Daojian Zeng, Kang Liu, Siwei Lai, Guangyou Zhou, and Jun Zhao. Relation classification via convolutional deep neural network. In Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics, pages 2335-2344, 2014.","title":"Relation classification via convolutional deep neural network","authors":"Daojian Zeng, Kang Liu, Siwei Lai, Guangyou Zhou, Jun Zhao","year":"2014","venue":"Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Zeng et al., 2015] Daojian Zeng, Kang Liu, Yubo Chen, and Jun Zhao. Distant supervision for relation extraction via piecewise convolutional neural networks. In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, pages 1753-1762, 2015.","title":"Distant supervision for relation extraction via piecewise convolutional neural networks","authors":"Daojian Zeng, Kang Liu, Yubo Chen, Jun Zhao","year":"2015","venue":"Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Zheng et al., 2017] Suncong Zheng, Feng Wang, Hongyun Bao, Yuexing Hao, Peng Zhou, and Bo Xu. Joint ex- traction of entities and relations based on a novel tagging scheme. arXiv preprint arXiv:1706.05075, 2017.","title":"Joint extraction of entities and relations based on a novel tagging scheme","authors":"Suncong Zheng, Feng Wang, Hongyun Bao, Yuexing Hao, Peng Zhou, Bo Xu","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Zhu et al., 2018] Wenhao Zhu, Tengjun Yao, Jianyue Ni, Baogang Wei, and Zhiguo Lu. Dependency-based siamese long short-term memory network for learning sentence representations. PloS one, 13(3):e0193919, 2018.","title":"Dependency-based siamese long short-term memory network for learning sentence representations","authors":"Wenhao Zhu, Tengjun Yao, Jianyue Ni, Baogang Wei, Zhiguo Lu","year":"2018","venue":"PloS one","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}