{"type":"ScholarlyArticle","title":"Improving Cross-Domain Performance for Relation Extraction via Dependency Prediction and Information Flow Control","authors":[{"name":"Amir Pouran Ben Veyseh","slug":"amir-pouran-ben-veyseh","given":"Amir","family":"Pouran Ben Veyseh","affiliation":"Department of Computer and Information Science , University of Oregon , OR , USA"},{"name":"Thien Nguyen","slug":"thien-nguyen","given":"Thien","family":"Nguyen","affiliation":"Department of Computer and Information Science , University of Oregon , OR , USA"},{"name":"Dejing Dou","slug":"dejing-dou","given":"Dejing","family":"Dou","affiliation":"Department of Computer and Information Science , University of Oregon , OR , USA"}],"abstract":"Relation Extraction (RE) is one of the fundamental tasks in Information Extraction and Natural Language Processing. Dependency trees have been shown to be a very useful source of information for this task. The current deep learning models for relation extraction has mainly exploited this dependency information by guiding their computation along the structures of the dependency trees. One potential problem with this approach is it might prevent the models from capturing important context information beyond syntactic structures and cause the poor cross-domain generalization. This paper introduces a novel method to use dependency trees in RE for deep learning models that jointly predicts dependency and semantics relations. We also propose a new mechanism to control the information flow in the model based on the input entity mentions. Our extensive experiments on benchmark datasets show that the proposed model outperforms the existing methods for RE significantly.","doi":"10.24963/ijcai.2019/716","url":"https://ijcai.org/proceedings/2019/716","pdf":"https://ijcai.org/proceedings/2019/0716.pdf","markdown":"https://ijcai.org/proceedings/2019/716.md","bibtex":"https://ijcai.org/proceedings/2019/bibtex/716","volume":{"slug":"2019","title":"Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2019","url":"https://ijcai.org/proceedings/2019/","year":2019,"location":"Macao","dates":"10-16 August 2019","editors":"Sarit Kraus","isbn":"978-0-9992411-4-1","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2019"},"section":"Natural Language Processing","track":"Main track","number":716,"pages":{"first":5153,"last":5159},"keywords":["Machine Learning: Deep Learning","Natural Language Processing: Information Extraction"],"videos":[],"references":[{"position":1,"raw":"[Bunescu and Mooney, 2005] Razvan C Bunescu and Ray- mond J Mooney. A shortest path dependency kernel for relation extraction. In EMNLP, 2005.","title":"A shortest path dependency kernel for relation extraction","authors":"C Razvan, Raymond J Bunescu, Mooney","year":"2005","venue":"EMNLP","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Chan and Roth, 2010] Yee S. Chan and Dan Roth. Ex- ploiting background knowledge for relation extraction. In COLING, 2010.","title":"Exploiting background knowledge for relation extraction","authors":"Yee S Chan, Dan Roth","year":"2010","venue":"COLING","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Fu et al., 2017] Lisheng Fu, Thien Huu Nguyen, Bonan Min, and Ralph Grishman. Domain adaptation for rela- tion extraction with domain adversarial neural network. In IJCNLP, 2017.","title":"Domain adaptation for relation extraction with domain adversarial neural network","authors":"Lisheng Fu, Thien Huu Nguyen, Bonan Min, Ralph Grishman","year":"2017","venue":"IJCNLP","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Fu et al., 2018] Lisheng Fu, Bonan Min, Thien Huu Nguyen, and Ralph Grishman. A case study on learn- ing a unified encoder of relations. In Proceedings of the 4th Workshop on Noisy User-generated Text (W-NUT) at EMNLP 2018, 2018.","title":"A case study on learning a unified encoder of relations","authors":"Lisheng Fu, Bonan Min, Thien Huu Nguyen, Ralph Grishman","year":"2018","venue":"Proceedings of the 4th Workshop on Noisy User-generated Text (W-NUT) at EMNLP 2018","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Gormley et al., 2015] Matthew R Gormley, Mo Yu, and Mark Dredze. Improved relation extraction with feature- rich compositional embedding models. EMNLP, 2015.","title":"Improved relation extraction with featurerich compositional embedding models","authors":"Mo Matthew R Gormley, Mark Yu, Dredze","year":"2015","venue":"EMNLP","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Hendrickx et al., 2010] Iris Hendrickx, Su Nam Kim, Zor- nitsa Kozareva, Preslav Nakov, Diarmuid Ó Séaghdha, Se- bastian Padó, Marco Pennacchiotti, Lorenza Romano, and Stan Szpakowicz. Semeval-2010 task 8: Multi-way clas- sification of semantic relations between pairs of nominals. In Proceedings of SEW-2009, 2010.","title":"Semeval-2010 task 8: Multi-way classification of semantic relations between pairs of nominals","authors":"Hendrickx","year":"2010","venue":"Proceedings of SEW-2009","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Liu et al., 2015] Yang Liu, Furu Wei, Sujian Li, Heng Ji, Ming Zhou, and Houfeng Wang. A dependency-based neural network for relation classification. In ACL, 2015.","title":"A dependency-based neural network for relation classification","authors":"Yang Liu, Furu Wei, Sujian Li, Heng Ji, Ming Zhou, Houfeng Wang","year":"2015","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Miwa and Bansal, 2016] Makoto Miwa and Mohit Bansal. End-to-end relation extraction using lstms on sequences and tree structures. ACL, 2016.","title":"End-to-end relation extraction using lstms on sequences and tree structures","authors":"Bansal Miwa, Makoto Miwa, Mohit Bansal","year":"2016","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Nguyen and Grishman, 2014] Thien Huu Nguyen and Ralph Grishman. Employing word representations and regularization for domain adaptation of relation extraction. In ACL, 2014.","title":"Employing word representations and regularization for domain adaptation of relation extraction","authors":"Grishman ; Nguyen, Huu Thien, Ralph Nguyen, Grishman","year":"2014","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Nguyen and Grishman, 2015a] Thien Huu Nguyen and Ralph Grishman. Relation extraction: Perspective from convolutional neural networks. In The NAACL Workshop on Vector Space Modeling for NLP (VSM), 2015a.","title":"Relation extraction: Perspective from convolutional neural networks","authors":"Grishman Nguyen, Huu Thien, Ralph Nguyen, Grishman","year":"2015","venue":"The NAACL Workshop on Vector Space Modeling for NLP (VSM)","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Nguyen and Grishman, 2016] Thien Huu Nguyen and Ralph Grishman. Combining neural networks and log- linear models to improve relation extraction. Proceedings of IJCAI Workshop on Deep Learning for Artificial Intelligence, 2016.","title":"Combining neural networks and loglinear models to improve relation extraction","authors":"Grishman ; Nguyen, Huu Thien, Ralph Nguyen, Grishman","year":"2016","venue":"Proceedings of IJCAI Workshop on Deep Learning for Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Nguyen and Nguyen, 2018b] Minh Nguyen and Thien Huu Nguyen. Who is killed by police: Introducing supervised attention for hierarchical lstms. In Proceedings of COL- ING, 2018b.","title":"Who is killed by police: Introducing supervised attention for hierarchical lstms","authors":"Nguyen Nguyen, Minh Nguyen, Thien Huu Nguyen","year":"2018","venue":"Proceedings of COL-ING","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Nguyen et al., 2015b] Thien Huu Nguyen, Barbara Plank, and Ralph Grishman. Semantic representations for domain adaptation: A case study on the tree kernel-based method for relation extraction. In ACL-IJCNLP, 2015b.","title":"Semantic representations for domain adaptation: A case study on the tree kernel-based method for relation extraction","authors":"Nguyen","year":"2015","venue":"ACL-IJCNLP","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Plank and Moschitti, 2013] Barbara Plank and Alessandro Moschitti. Embedding semantic similarity in tree kernels for domain adaptation of relation extraction. In ACL, 2013.","title":"Embedding semantic similarity in tree kernels for domain adaptation of relation extraction","authors":"Barbara Plank, Alessandro Moschitti","year":"2013","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Shi et al., 2018] Ge Shi, Chong Feng, Lifu Huang, Boliang Zhang, Heng Ji, Lejian Liao, and Heyan Huang. Genre separation network with adversarial training for cross- genre relation extraction. In EMNLP, 2018.","title":"Genre separation network with adversarial training for crossgenre relation extraction","authors":"Ge Shi, Chong Feng, Lifu Huang, Boliang Zhang, Heng Ji, Lejian Liao, Heyan Huang","year":"2018","venue":"EMNLP","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Strubell et al., 2018] Emma Strubell, Patrick Verga, Daniel Andor, David Weiss, and Andrew McCallum. Linguistically-informed self-attention for semantic role labeling. In EMNLP, 2018.","title":"Linguistically-informed self-attention for semantic role labeling","authors":"Emma Strubell, Patrick Verga, Daniel Andor, David Weiss, Andrew Mccallum","year":"2018","venue":"EMNLP","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Sun et al., 2011] Ang Sun, Ralph Grishman, and Satoshi Sekine. Semi-supervised relation extraction with large- scale word clustering. In ACL, 2011.","title":"Semi-supervised relation extraction with largescale word clustering","authors":"Ang Sun, Ralph Grishman, Satoshi Sekine","year":"2011","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Vaswani et al., 2017] Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Ł ukasz Kaiser, and Illia Polosukhin. Attention is all you need. In NIPS, 2017.","title":"Attention is all you need","authors":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Ł Ukasz Kaiser, Illia Polosukhin","year":"2017","venue":"NIPS","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Wang et al., 2016a] Linlin Wang, Zhu Cao, Gerard de Melo, and Zhiyuan Liu. Relation classification via multi-level attention cnns. In ACL, 2016.","title":"Relation classification via multi-level attention cnns","authors":"Wang","year":"2016","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Wang et al., 2016b] Linlin Wang, Zhu Cao, Gerard de Melo, and Zhiyuan Liu. Relation classification via multi-level attention cnns. In EMNLP, 2016.","title":"Relation classification via multi-level attention cnns","authors":"Wang","year":"2016","venue":"EMNLP","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Xu et al., 2015a] Yan Xu, Lili Mou, Ge Li, Yunchuan Chen, Hao Peng, and Zhi Jin. Classifying relations via long short term memory networks along shortest dependency paths. In EMNLP, 2015.","title":"Classifying relations via long short term memory networks along shortest dependency paths","authors":"Xu","year":"2015","venue":"EMNLP","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Xu et al., 2015b] Yan Xu, Lili Mou, Ge Li, Yunchuan Chen, Hao Peng, and Zhi Jin. Classifying relations via long short term memory networks along shortest dependency paths. In EMNLP, 2015.","title":"Classifying relations via long short term memory networks along shortest dependency paths","authors":"Xu","year":"2015","venue":"EMNLP","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Yu et al., 2015] Mo Yu, Matthew R Gormley, and Mark Dredze. Combining word embeddings and feature embed- dings for fine-grained relation extraction. In NAACL-HLT, 2015.","title":"Combining word embeddings and feature embeddings for fine-grained relation extraction","authors":"Mo Yu, Matthew R Gormley, Mark Dredze","year":"2015","venue":"NAACL-HLT","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Zeng et al., 2014] Daojian Zeng, Kang Liu, Siwei Lai, Guangyou Zhou, and Jun Zhao. Relation classification via convolutional deep neural network. In COLING, 2014.","title":"Relation classification via convolutional deep neural network","authors":"Daojian Zeng, Kang Liu, Siwei Lai, Guangyou Zhou, Jun Zhao","year":"2014","venue":"COLING","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Zhang et al., 2017] Yuhao Zhang, Victor Zhong, Danqi Chen, Gabor Angeli, and Christopher D Manning. Position-aware attention and supervised data improve slot filling. In Proceedings of EMNLP, pages 35-45, 2017.","title":"Position-aware attention and supervised data improve slot filling","authors":"Yuhao Zhang, Victor Zhong, Danqi Chen, Gabor Angeli, Christopher D Manning","year":"2017","venue":"Proceedings of EMNLP","doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Zhang et al., 2018] Yuhao Zhang, Peng Qi, and Christo- pher D Manning. Graph convolution over pruned depen- dency trees improves relation extraction. In EMNLP, 2018.","title":"Graph convolution over pruned dependency trees improves relation extraction","authors":"Yuhao Zhang, Peng Qi, Christopher D Manning","year":"2018","venue":"EMNLP","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Zhou et al., 2005] Guodong Zhou, Jian Su, Jie Zhang, and Min Zhang. Exploring various knowledge in relation ex- traction. In ACL, 2005.","title":"Exploring various knowledge in relation extraction","authors":"Guodong Zhou, Jian Su, Jie Zhang, Min Zhang","year":"2005","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[Zhou et al., 2016] Peng Zhou, Wei Shi, Jun Tian, Zhenyu Qi, Bingchen Li, Hongwei Hao, and Bo Xu. Attention- based bidirectional long short-term memory networks for relation classification. In ACL, 2016.","title":"Attentionbased bidirectional long short-term memory networks for relation classification","authors":"Peng Zhou, Wei Shi, Jun Tian, Zhenyu Qi, Bingchen Li, Hongwei Hao, Bo Xu","year":"2016","venue":"ACL","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}