{"type":"ScholarlyArticle","title":"PasCore: A Chinese Overlapping Relation Extraction Model Based on Global Pointer Annotation Strategy","authors":[{"name":"Peng Wang","slug":"peng-wang","given":"Peng","family":"Wang","affiliation":"School of Computer Science and Engineering , Southeast University"},{"name":"Jiafeng Xie","slug":"jiafeng-xie","given":"Jiafeng","family":"Xie","affiliation":"School of Computer Science and Engineering , Southeast University"},{"name":"Xiye Chen","slug":"xiye-chen","given":"Xiye","family":"Chen","affiliation":"Nanjing University of Finance & Economics"},{"name":"Guozheng Li","slug":"guozheng-li","given":"Guozheng","family":"Li","affiliation":"School of Computer Science and Engineering , Southeast University"},{"name":"Wei Li","slug":"wei-li","given":"Wei","family":"Li","affiliation":"Beijing Institute of Computer Technology and Application"}],"abstract":"Recent work for extracting relations from texts has achieved excellent performance. However, existing studies mainly focus on simple relation extraction, these methods perform not well on overlapping triple problem because the tags of shared entities would conflict with each other.  Especially, overlapping entities are common and indispensable in Chinese. To address this issue, this paper proposes PasCore, which utilizes a global pointer annotation strategy for overlapping relation extraction in Chinese. PasCore first obtains the sentence vector via general pre-training model encoder, and uses classifier to predicate relations. Subsequently, it uses global pointer annotation strategy for head entity annotation, which uses global tags to label the start and end positions of the entities. Finally, PasCore integrates the relation, head entity and its type to mark the tail entity. Furthermore, PasCore performs conditional layer normalization to fuse features, which connects all stages and greatly enriches the association between relations and entities. Experimental results on both Chinese and English real-world datasets demonstrate that PasCore outperforms strong baselines on relation extraction and, especially, shows superior performance on overlapping relation extraction.","doi":"10.24963/ijcai.2023/579","url":"https://ijcai.org/proceedings/2023/579","pdf":"https://ijcai.org/proceedings/2023/0579.pdf","markdown":"https://ijcai.org/proceedings/2023/579.md","bibtex":"https://ijcai.org/proceedings/2023/bibtex/579","volume":{"slug":"2023","title":"Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2023","url":"https://ijcai.org/proceedings/2023/","year":2023,"location":"Macao, SAR","dates":"19-25 August 2023","editors":"Edith Elkind","isbn":"978-1-956792-03-4","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2023"},"section":"Natural Language Processing","track":"Main Track","number":579,"pages":{"first":5215,"last":5223},"keywords":["Natural Language Processing: NLP: Information extraction","Data Mining: DM: Knowledge graphs and knowledge base completion"],"videos":[],"references":[{"position":1,"raw":"[Bekoulis et al., 2018] Giannis Bekoulis, Johannes Deleu, Thomas Demeester, and et al. Joint entity recognition and relation extraction as a multi-head selection problem. Ex- pert Systems with Applications, 114(12):34-45, 2018.","title":"Joint entity recognition and relation extraction as a multi-head selection problem","authors":"Giannis Bekoulis, Johannes Deleu, Thomas Demeester","year":"2018","venue":"Expert Systems with Applications","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Devlin et al., 2018] Jacob Devlin, Ming-Wei Chang, Ken- ton Lee, and Kristina Toutanova. Bert: Pre-training of deep bidirectional transformers for language understand- ing. arXiv preprint arXiv:1810.04805, 2018.","title":"Bert: Pre-training of deep bidirectional transformers for language understanding","authors":"Jacob Devlin, Ming-Wei Chang, Kenton Lee, Kristina Toutanova","year":"2018","venue":null,"doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Fu et al., 2019] Tsujui Fu, Penghsuan Li, and Weiyun Ma. Graphrel: Modeling text as relational graphs for joint en- tity and relation extraction. In Proceedings of the 57th Annual Meeting of the Association for Computational Lin- guistics, pages 1409-1418, 2019.","title":"Graphrel: Modeling text as relational graphs for joint entity and relation extraction","authors":"Fu","year":"2019","venue":"Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Hoffmann et al., 2011] Raphael Hoffmann, Congle Zhang, Xiao Ling, and et al. Knowledge-based weak supervision for information extraction of overlapping relations. In Pro- ceedings of the 49th Annual Meeting of the Association for Computational Linguistics, pages 541-550, 2011.","title":"Knowledge-based weak supervision for information extraction of overlapping relations","authors":"Raphael Hoffmann, Congle Zhang, Xiao Ling","year":"2011","venue":"Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Hogan et al., 2020] Aidan Hogan, Eva Blomqvist, Michael Cochez, and et al. Knowledge graphs. arxiv, abs/2003.02320, 2020.","title":"Knowledge graphs","authors":"Aidan Hogan, Eva Blomqvist, Michael Cochez","year":"2020","venue":null,"doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Li and Ji, 2014] Qi Li and Heng Ji. Incremental joint ex- traction of entity mentions and relations. In Proceedings of the 52nd Annual Meeting of the Association for Compu- tational Linguistics, pages 402-412, 2014.","title":"Incremental joint extraction of entity mentions and relations","authors":"Ji ; ] Qi Li, Heng Li, Ji","year":"2014","venue":"Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Lin et al., 2016] Yankai Lin, Shiqi Shen, Zhiyuan Liu, and et al. Neural relation extraction with selective attention over instances. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, pages 2124-2133, 2016.","title":"Neural relation extraction with selective attention over instances","authors":"Lin","year":"2016","venue":"Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Liu et al., 2018] Tianyi Liu, Xinsong Zhang, Wanhao Zhou, and et al. Neural relation extraction via inner-sentence noise reduction and transfer learning. In Proceedings of the 56th Conference on Empirical Methods in Natural Language Processing, pages 2195-2204, 2018.","title":"Neural relation extraction via inner-sentence noise reduction and transfer learning","authors":"Tianyi Liu, Xinsong Zhang, Wanhao Zhou","year":"2018","venue":"Proceedings of the 56th Conference on Empirical Methods in Natural Language Processing","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Loshchilov and Hutter, 2018] Ilya Loshchilov and Frank Hutter. Decoupled weight decay regularization. arxiv, abs/1711.05101, 2018.","title":"Ilya Loshchilov and Frank Hutter. Decoupled weight decay regularization","authors":"Hutter Loshchilov","year":"2018","venue":null,"doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Miwa and Bansal, 2016] Makoto Miwa and Mohit Bansal. End-to-end relation extraction using lstms on sequences and tree structures. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, pages 1105-1116, 2016.","title":"End-to-end relation extraction using lstms on sequences and tree structures","authors":"Bansal Miwa, Makoto Miwa, Mohit Bansal","year":"2016","venue":"Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Mohammed et al., 2018] Salman Mohammed, Peng Shi, and Jimmy Lin. Strong baselines for simple question an- swering over knowledge graphs with and without neural networks. In Proceedings of the 16th North American Chapter of the Association for Computational Linguistics, pages 291-296, 2018.","title":"Strong baselines for simple question answering over knowledge graphs with and without neural networks","authors":"Salman Mohammed, Peng Shi, Jimmy Lin","year":"2018","venue":"Proceedings of the 16th North American Chapter of the Association for Computational Linguistics","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Ren et al., 2021] Feiliang Ren, Longhui Zhang, Shujuan Yin, Xiaofeng Zhao, Shilei Liu, Bochao Li, and Yaduo Liu. A novel global feature-oriented relational triple ex- traction model based on table filling. In Proceedings of the 2021 Conference on Empirical Methods in Natural Lan- guage Processing, pages 2646-2656, Online and Punta Cana, Dominican Republic, November 2021. Association for Computational Linguistics.","title":"A novel global feature-oriented relational triple extraction model based on table filling","authors":"Ren","year":"2021","venue":"Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Riedel et al., 2010] Sebastian Riedel, Limin Yao, and An- drew McCallum. Modeling relations and their mentions without labeled text. Machine Learning and Knowledge Discovery in Databases, 6323(3):148-163, 2010.","title":"Modeling relations and their mentions without labeled text","authors":"Sebastian Riedel, Limin Yao, Andrew Mccallum","year":"2010","venue":"Machine Learning and Knowledge Discovery in Databases","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Su et al., 2017] Yu Su, Honglei Liu, Semih Yavuz, and et al. Global relation embedding for relation extraction. In Pro- ceedings of the 55th Annual Meeting of the Association for Computational Linguistics, pages 820-830, 2017.","title":"Global relation embedding for relation extraction","authors":"Yu Su, Honglei Liu, Semih Yavuz","year":"2017","venue":"Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Su et al., 2022] Jianlin Su, Ahmed Murtadha, Shengfeng Pan, Jing Hou, Jun Sun, Wanwei Huang, Bo Wen, and Yunfeng Liu. Global pointer: Novel efficient span-based approach for named entity recognition. arXiv preprint arXiv:2208.03054, 2022.","title":"Global pointer: Novel efficient span-based approach for named entity recognition","authors":"Jianlin Su, Ahmed Murtadha, Shengfeng Pan, Jing Hou, Jun Sun, Wanwei Huang, Bo Wen, Yunfeng Liu","year":"2022","venue":null,"doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Sun et al., 2019] Yu Sun, Shuohuan Wang, Yukun Li, and et al. Ernie: Enhanced representation through knowledge integration. arxiv, abs/1904.09223, 2019.","title":"Ernie: Enhanced representation through knowledge integration","authors":"Yu Sun, Shuohuan Wang, Yukun Li","year":"2019","venue":null,"doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Tan et al., 2019] Zhen Tan, Xiang Zhao, Wei Wang, and et al. Jointly extracting multiple triplets with multilayer translation constraints. In Proceedings of the 33rd Associ- ation for the Advance of Artificial Intelligence Conference on Artificial Intelligence, pages 7080-7087, 2019.","title":"Jointly extracting multiple triplets with multilayer translation constraints","authors":"Zhen Tan, Xiang Zhao, Wei Wang","year":"2019","venue":"Proceedings of the 33rd Association for the Advance of Artificial Intelligence Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Wang et al., 2016] Linlin Wang, Zhu Cao, Gerard De Melo, and et al. Relation classification via multi-level attention cnns. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, pages 1298- 1307, 2016.","title":"Relation classification via multi-level attention cnns","authors":"Linlin Wang, Zhu Cao, Gerard De Melo","year":"2016","venue":"Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Wang et al., 2018] Shaolei Wang, Yue Zhang, Wanxiang Che, and et al. Joint extraction of entities and relations based on a novel graph scheme. In Proceedings of the 27th International Joint Conference on Artificial Intelligence, pages 4461-4467, 2018.","title":"Joint extraction of entities and relations based on a novel graph scheme","authors":"Wang","year":"2018","venue":"Proceedings of the 27th International Joint Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":"/proceedings/2018/620"},{"position":20,"raw":"[Wang et al., 2019] Xiang Wang, Xiangnan He, Yixin Cao, and et al. Kgat: knowledge graph attention network for recommendation. In Proceedings of the 25th ACM SIGKDD Conference on Knowledge Discovery and Data Mining International Conference, pages 950-958, 2019.","title":"Kgat: knowledge graph attention network for recommendation","authors":"Xiang Wang, Xiangnan He, Yixin Cao","year":"2019","venue":"Proceedings of the 25th ACM SIGKDD Conference on Knowledge Discovery and Data Mining International Conference","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Wang et al., 2020] Yucheng Wang, Bowen Yu, Yueyang Zhang, and et al. Tplinker: Single-stage joint extraction of entities and relations through token pair linking. In Pro- ceedings of the 28th International Conference on Compu- tational Linguistics, pages 1572-1582, 2020.","title":"Tplinker: Single-stage joint extraction of entities and relations through token pair linking","authors":"Yucheng Wang, Bowen Yu, Yueyang Zhang","year":"2020","venue":"Proceedings of the 28th International Conference on Computational Linguistics","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Wei et al., 2020] Zhepei Wei, Jianlin Su, Yue Wang, and et al. A novel cascade binary tagging framework for rela- tional triple extraction. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 1476-1488, 2020.","title":"A novel cascade binary tagging framework for relational triple extraction","authors":"Wei","year":"2020","venue":"Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Yu et al., 2020] Bowen Yu, Zhenyu Zhang, Xiaobo Shu, and et al. Joint extraction of entities and relations based on a novel decomposition strategy. In Proceedings of the 24th European Conference on Artificial Intelligence, pages 2282-2289, 2020.","title":"Joint extraction of entities and relations based on a novel decomposition strategy","authors":"Bowen Yu, Zhenyu Zhang, Xiaobo Shu","year":"2020","venue":"Proceedings of the 24th European Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Zeng et al., 2014] Daojian Zeng, Kang Liu, Siwei Lai, and et al. Relation classification via convolutional deep neural network. In Proceedings of the 25th International Con- ference on Computational Linguistics, pages 2335-2344, 2014.","title":"Relation classification via convolutional deep neural network","authors":"Zeng","year":"2014","venue":"Proceedings of the 25th International Conference on Computational Linguistics","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Zeng et al., 2018] Xiangrong Zeng, Daojian Zeng, Shizhu He, and et al. Extracting relational facts by an end-to-end neural model with copy mechanism. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, pages 506-514, 2018.","title":"Extracting relational facts by an end-to-end neural model with copy mechanism","authors":"Xiangrong Zeng, Daojian Zeng, Shizhu He","year":"2018","venue":"Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics","doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Zeng et al., 2019] Xiangrong Zeng, Shizhu He, Daojian Zeng, and et al. Learning the extraction order of multiple relational facts in a sentence with reinforcement learning. In Proceedings of the 57th Conference on Empirical Meth- ods in Natural Language Processing and the 9th Interna- tional Joint Conference on Natural Language Processing, pages 367-377, 2019.","title":"Learning the extraction order of multiple relational facts in a sentence with reinforcement learning","authors":"Xiangrong Zeng, Shizhu He, Daojian Zeng","year":"2019","venue":"Proceedings of the 57th Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Zheng et al., 2017] Suncong Zheng, Feng Wang, Hongyun Bao, and et al. Joint extraction of entities and relations based on a novel tagging scheme. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, pages 1227-1236, 2017.","title":"Joint extraction of entities and relations based on a novel tagging scheme","authors":"Zheng","year":"2017","venue":"Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics","doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[Zhong et al., 2019] Peixiang Zhong, Di Wang, and Chun- yan Miao. Knowledge-enriched transformer for emo- tion detection in textual conversations. arXiv preprint arXiv:1909.10681, 2019.","title":"Knowledge-enriched transformer for emotion detection in textual conversations","authors":"Peixiang Zhong, Di Wang, Chunyan Miao","year":"2019","venue":null,"doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}