{"type":"ScholarlyArticle","title":"Incorporating Structural Information for Better Coreference Resolution","authors":[{"name":"Fang Kong","slug":"fang-kong","given":"Fang","family":"Kong","affiliation":"Institute of Artificial Intelligence , Soochow University , China; Laboratory for Natural Language Processing , Soochow University , China; School of Computer Science and Technology , Soochow University , China"},{"name":"Fu Jian","slug":"fu-jian","given":"Fu","family":"Jian","affiliation":"Laboratory for Natural Language Processing , Soochow University , China; School of Computer Science and Technology , Soochow University , China"}],"abstract":"Coreference resolution plays an important role in text understanding. In the literature, various neural approaches have been proposed and achieved considerable success. However, structural information, which has been proven useful in coreference resolution, has been largely ignored in previous neural approaches. In this paper, we focus on effectively incorporating structural information to neural coreference resolution from three aspects. Firstly, nodes in the parse trees are employed as a constraint to filter out impossible text spans (i.e., mention candidates) in reducing the computational complexity. Secondly, contextual information is encoded in the traversal node sequence instead of the word sequence to better capture hierarchical information for text span representation. Lastly, additional structural features (e.g., the path, siblings, degrees, category of the current node) are encoded to enhance the mention representation. Experimentation on the data-set of the CoNLL 2012 Shared Task shows the effectiveness of our proposed approach in incorporating structural information into neural coreference resolution.","doi":"10.24963/ijcai.2019/700","url":"https://ijcai.org/proceedings/2019/700","pdf":"https://ijcai.org/proceedings/2019/0700.pdf","markdown":"https://ijcai.org/proceedings/2019/700.md","bibtex":"https://ijcai.org/proceedings/2019/bibtex/700","volume":{"slug":"2019","title":"Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2019","url":"https://ijcai.org/proceedings/2019/","year":2019,"location":"Macao","dates":"10-16 August 2019","editors":"Sarit Kraus","isbn":"978-0-9992411-4-1","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2019"},"section":"Natural Language Processing","track":"Main track","number":700,"pages":{"first":5039,"last":5045},"keywords":["Natural Language Processing: Natural Language Processing","Natural Language Processing: Discourse"],"videos":[],"references":[{"position":1,"raw":"[Al-Rfou et al., 2013] Rami Al-Rfou, Bryan Perozzi, and Steven Skiena. Polyglot: Distributed word representa- tions for multilingual nlp. In Proceedings of the 7th Con- ference on Computational Natural Language Learning, pages 183-192, 2013.","title":"Polyglot: Distributed word representations for multilingual nlp","authors":"Rami Al-Rfou, Bryan Perozzi, Steven Skiena","year":"2013","venue":"Proceedings of the 7th Conference on Computational Natural Language Learning","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Clark and Manning, 2016a] Kevin Clark and Christo- pher D. Manning. Deep reinforcement learning for mention-ranking coreference models. In Proceedings of EMNLP-2016, 2016.","title":"Deep reinforcement learning for mention-ranking coreference models","authors":"Clark, Manning, Kevin Clark, Christopher D Manning","year":"2016","venue":"Proceedings of EMNLP-2016","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Clark and Manning, 2016b] Kevin Clark and Christo- pher D. Manning. Improving coreference resolution by learning entity-level distributed representations. In Proceedings of ACL-2016, August 2016.","title":"Improving coreference resolution by learning entity-level distributed representations","authors":"Clark, Manning, Kevin Clark, Christopher D Manning","year":"2016","venue":"Proceedings of ACL-2016","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Gal and Ghahramani, 2016] Yarin Gal and Zoubin Ghahra- mani. Dropout as a bayesian approximation: Representing model uncertainty in deep learning. In International Con- ference on Machine Learning, pages 1050-1059, 2016.","title":"Yarin Gal and Zoubin Ghahramani. Dropout as a bayesian approximation: Representing model uncertainty in deep learning","authors":"Ghahramani Gal","year":"2016","venue":"International Conference on Machine Learning","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Hobbs, 1978] J. R. Hobbs. Resolving pronoun references. Lingua, 44(4):311-338, 1978.","title":"Resolving pronoun references","authors":"J R Hobbs","year":"1978","venue":"Lingua","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Kong and Zhou, 2012] Fang Kong and Guodong Zhou. Pro- noun resolution in english and chinese languages based on tree kernel. Journal of Software, 23(5):1085-1099, 2012.","title":"Pronoun resolution in english and chinese languages based on tree kernel","authors":"Zhou Kong, Fang Kong, Guodong Zhou","year":"2012","venue":"Journal of Software","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Kummerfeld and Klein, 2013] Jonathan K. Kummerfeld and Dan Klein. Error-driven analysis of challenges in coreference resolution. In Proceedings of EMNLP-2013, 2013.","title":"Error-driven analysis of challenges in coreference resolution","authors":"Jonathan K Kummerfeld, Dan Klein","year":"2013","venue":"Proceedings of EMNLP-2013","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Lappin and Leass, 1994] Shalom Lappin and Herbert J. Le- ass. An algorithm for pronominal anaphora resolution. Computational Linguistics, 20(4), 1994.","title":"An algorithm for pronominal anaphora resolution","authors":"Shalom Lappin, Herbert J Leass","year":"1994","venue":"Computational Linguistics","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Lee et al., 2013] Heeyoung Lee, Angel Chang, Yves Peirs- man, Nathanael Chambers, Mihai Surdeanu, and Dan Ju- rafsky. Deterministic coreference resolution based on entity-centric, precision-ranked rules. Computational Lin- guistics, 39(4), 2013.","title":"Deterministic coreference resolution based on entity-centric, precision-ranked rules","authors":"Lee","year":"2013","venue":"Computational Linguistics","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Lee et al., 2017] Kenton Lee, Luheng He, Mike Lewis, and Luke Zettlemoyer. End-to-end neural coreference resolu- tion. In Proceedings of EMNLP-2017, 2017.","title":"End-to-end neural coreference resolution","authors":"Kenton Lee, Luheng He, Mike Lewis, Luke Zettlemoyer","year":"2017","venue":"Proceedings of EMNLP-2017","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Lee et al., 2018] Kenton Lee, Luheng He, and Luke Zettle- moyer. Higher-order coreference resolution with coarse- to-fine inference. In Proceedings of NAACL-2018 Volume 2 (Short Papers), 2018.","title":"Higher-order coreference resolution with coarseto-fine inference","authors":"Kenton Lee, Luheng He, Luke Zettlemoyer","year":"2018","venue":"Proceedings of NAACL-2018","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Liu et al., 2017] Rui Liu, Junjie Hu, Wei Wei, Zi Yang, and Eric Nyberg. Structural embedding of syntactic trees for machine comprehension. In Proceedings of EMNLP-2017, 2017.","title":"Structural embedding of syntactic trees for machine comprehension","authors":"Rui Liu, Junjie Hu, Wei Wei, Zi Yang, Eric Nyberg","year":"2017","venue":"Proceedings of EMNLP-2017","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Luo and Glass, 2018] Hongyin Luo and Jim Glass. Learn- ing word representations with cross-sentence dependency for end-to-end co-reference resolution. In Proceedings of EMNLP-2018, 2018.","title":"Learning word representations with cross-sentence dependency for end-to-end co-reference resolution","authors":"Glass Luo, Hongyin Luo, Jim Glass","year":"2018","venue":"Proceedings of EMNLP-2018","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Luong et al., 2015] Thang Luong, Hieu Pham, and Christo- pher D Manning. Effective approaches to attention-based neural machine translation. In Proceedings of EMNLP- 2015, pages 1412-1421, 2015.","title":"Effective approaches to attention-based neural machine translation","authors":"Thang Luong, Hieu Pham, Christopher D Manning","year":"2015","venue":"Proceedings of EMNLP-2015","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Ng and Cardie, 2002] Vincent Ng and Claire Cardie. Im- proving machine learning approaches to coreference reso- lution. In Proceedings of ACL-2002, 2002.","title":"Improving machine learning approaches to coreference resolution","authors":"Cardie Ng, Vincent Ng, Claire Cardie","year":"2002","venue":"Proceedings of ACL-2002","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Pennington et al., 2014] Jeffrey Pennington, Richard Socher, and Christopher Manning. Glove: Global vectors for word representation. In Proceedings of EMNLP-2014, pages 1532-1543, 2014.","title":"Glove: Global vectors for word representation","authors":"Jeffrey Pennington, Richard Socher, Christopher Manning","year":"2014","venue":"Proceedings of EMNLP-2014","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Peters et al., 2018] Matthew Peters, Mark Neumann, Mohit Iyyer, Matt Gardner, Christopher Clark, Kenton Lee, and Luke Zettlemoyer. Deep contextualized word representa- tions. In Proceedings of NAACL-2018, 2018.","title":"Deep contextualized word representations","authors":"Matthew Peters, Mark Neumann, Mohit Iyyer, Matt Gardner, Christopher Clark, Kenton Lee, Luke Zettlemoyer","year":"2018","venue":"Proceedings of NAACL-2018","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Pradhan et al., 2012] Sameer Pradhan, Alessandro Mos- chitti, Nianwen Xue, Olga Uryupina, and Yuchen Zhang. Conll-2012 shared task: Modeling multilingual unre- stricted coreference in ontonotes. In EMNLP-CoNLL- 2012, pages 1-40, 2012.","title":"Conll-2012 shared task: Modeling multilingual unrestricted coreference in ontonotes","authors":"Alessandro Sameer Pradhan, Nianwen Moschitti, Olga Xue, Yuchen Uryupina, Zhang","year":"2012","venue":"EMNLP-CoNLL-2012","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Qiu et al., 2018] Yuanyuan Qiu, Hongzheng Li, Shen Li, Yingdi Jiang, Renfen Hu, and Lijiao Yang. Revisiting correlations between intrinsic and extrinsic evaluations of word embeddings. In Chinese Computational Linguistics and Natural Language Processing Based on Naturally An- notated Big Data, pages 209-221. 2018.","title":"Revisiting correlations between intrinsic and extrinsic evaluations of word embeddings","authors":"Yuanyuan Qiu, Hongzheng Li, Shen Li, Yingdi Jiang, Renfen Hu, Lijiao Yang","year":"2018","venue":"Chinese Computational Linguistics and Natural Language Processing Based on Naturally Annotated Big Data","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Soon et al., 2001] Wee Meng Soon, Daniel Chung Yong Lim, and Hwee Tou Ng. A machine learning approach to coreference resolution of noun phrases. Computational Linguistics, 27(4), 2001.","title":"A machine learning approach to coreference resolution of noun phrases","authors":"Wee Meng, Soon, Daniel Chung, Yong Lim, Hwee Tou Ng","year":"2001","venue":"Computational Linguistics","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Turian et al., 2010] Joseph Turian, Lev Ratinov, and Yoshua Bengio. Word representations: a simple and general method for semi-supervised learning. In Proceedings of ACL-2010, pages 384-394, 2010.","title":"Word representations: a simple and general method for semi-supervised learning","authors":"Turian","year":"2010","venue":"Proceedings of ACL-2010","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Tymoshenko et al., 2017] Kateryna Tymoshenko, Daniele Bonadiman, and Alessandro Moschitti. Ranking kernels for structures and embeddings: A hybrid preference and classification model. In Proceedings of EMNLP-2017, 2017.","title":"Ranking kernels for structures and embeddings: A hybrid preference and classification model","authors":"Kateryna Tymoshenko, Daniele Bonadiman, Alessandro Moschitti","year":"2017","venue":"Proceedings of EMNLP-2017","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Wiseman et al., 2015] Sam Wiseman, Alexander M. Rush, Stuart Shieber, and Jason Weston. Learning anaphoricity and antecedent ranking features for coreference resolution. In Proceedings of ACL-IJCNLP-2015, 2015.","title":"Learning anaphoricity and antecedent ranking features for coreference resolution","authors":"Sam Wiseman, Alexander M Rush, Stuart Shieber, Jason Weston","year":"2015","venue":"Proceedings of ACL-IJCNLP-2015","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Wiseman et al., 2016] Sam Wiseman, Alexander M. Rush, and Stuart M. Shieber. Learning global features for coref- erence resolution. In Proceedings of NAACL-2016, 2016.","title":"Learning global features for coreference resolution","authors":"Sam Wiseman, Alexander M Rush, Stuart M Shieber","year":"2016","venue":"Proceedings of NAACL-2016","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Yang et al., 2004] Xiaofeng Yang, Jian Su, Guodong Zhou, and Chew-Lim Tan. Improving pronoun resolution by incorporating coreferential information of candidates. In Proceedings of ACL-2004, 2004.","title":"Improving pronoun resolution by incorporating coreferential information of candidates","authors":"Xiaofeng Yang, Jian Su, Guodong Zhou, Chew-Lim Tan","year":"2004","venue":"Proceedings of ACL-2004","doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Zhang et al., 2018] Rui Zhang, Cicero Nogueira dos Santos, Michihiro Yasunaga, Bing Xiang, and Dragomir Radev. Neural coreference resolution with deep biaffine attention by joint mention detection and mention clustering. In Pro- ceedings of ACL-2018 (Volume 2: Short Papers), 2018.","title":"Neural coreference resolution with deep biaffine attention by joint mention detection and mention clustering","authors":"Rui Zhang, Cicero Nogueira Dos Santos, Michihiro Yasunaga, Bing Xiang, Dragomir Radev","year":"2018","venue":"Proceedings of ACL-2018","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Zhu et al., 2018] Xunjie Zhu, Tingfeng Li, and Gerard de Melo. Exploring semantic properties of sentence em- beddings. In Proceedings of ACL-2018 (Volume 2: Short Papers), 2018.","title":"Exploring semantic properties of sentence embeddings","authors":"Zhu","year":"2018","venue":"Proceedings of ACL-2018","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}