{"type":"ScholarlyArticle","title":"Robust Multilingual Named Entity Recognition with Shallow Semi-supervised Features (Extended Abstract)","authors":[{"name":"Rodrigo Agerri","slug":"rodrigo-agerri","given":"Rodrigo","family":"Agerri","affiliation":"IXA NLP Group , University of the Basque Country UPV/EHU , Donostia-San Sebastián"},{"name":"German Rigau","slug":"german-rigau","given":"German","family":"Rigau","affiliation":"IXA NLP Group , University of the Basque Country UPV/EHU , Donostia-San Sebastián"}],"abstract":"We present a multilingual Named Entity Recognition approach based on a robust and general set of features across languages and datasets. Our system combines shallow local information with clustering semi-supervised features induced on large amounts of unlabeled text. Understanding via empiricalexperimentation how to effectively combine various types of clustering features allows us to seamlessly export our system to other datasets and languages. The result is a simple but highly competitive system which obtains state of the art results across five languages and twelve datasets. The results are reported on standard shared task evaluation data such as CoNLL for English, Spanish and Dutch. Furthermore, and despite the lack of linguistically motivated features, we also report best results for languages such as Basque and German. In addition, we demonstrate that our method also obtains very competitive results even when the amount of supervised data is cut by half, alleviating the dependency on manually annotated data. Finally, the results show that our emphasis on clustering features is crucial to develop robust out-of-domain models. The system and models are freely available to facilitate its use and guarantee the reproducibility of results.","doi":"10.24963/ijcai.2017/703","url":"https://ijcai.org/proceedings/2017/703","pdf":"https://ijcai.org/proceedings/2017/0703.pdf","markdown":"https://ijcai.org/proceedings/2017/703.md","bibtex":"https://ijcai.org/proceedings/2017/bibtex/703","volume":{"slug":"2017","title":"Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2017","url":"https://ijcai.org/proceedings/2017/","year":2017,"location":"Melbourne, Australia","dates":"19-25 August 2017","editors":"Carles Sierra","isbn":"978-0-9992411-0-3","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2017"},"section":"Journal track","track":"Journal track","number":703,"pages":{"first":4965,"last":4969},"keywords":["Natural Language Processing: Natural Language Processing","Natural Language Processing: Information Extraction","Natural Language Processing: Natural Language Semantics"],"videos":[],"references":[{"position":1,"raw":"[Alegria et al., 2006] Iñaki Alegria, Olatz Arregi, Nerea Ezeiza, and Izaskun Fernández. Lessons from the devel- opment of a named entity recognizer for Basque. Proce- samiento del lenguaje natural, 36:25-37, 2006.","title":"Lessons from the development of a named entity recognizer for Basque","authors":"Alegria","year":"2006","venue":"Procesamiento del lenguaje natural","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Benikova et al., 2014] Darina Benikova, Chris Biemann, Max Kisselew, and Sebastian Padó. Germeval 2014 named entity recognition shared task: Companion paper. In Pro- ceedings of the GermEval 2014 Named Entity Recognition Shared Task, KONVENS 2014, pages 104-113, 2014.","title":"Germeval 2014 named entity recognition shared task: Companion paper","authors":"Darina Benikova, Chris Biemann, Max Kisselew, Sebastian Padó","year":"2014","venue":"Proceedings of the GermEval 2014 Named Entity Recognition Shared Task","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Benikova et al., 2015] Darina Benikova, Seid Muhie Yi- mam, Prabhakaran Santhanam, and Chris Biemann. Ger- maner: Free open german named entity recognition tool. In Proceedings of the International Conference of the Ger- man Society for Computational Linguistics and Language Technology (GSCL-2015), pages 31-38, 2015.","title":"Germaner: Free open german named entity recognition tool","authors":"Darina Benikova, Seid Muhie Yimam, Prabhakaran Santhanam, Chris Biemann","year":"2015","venue":"Proceedings of the International Conference of the German Society for Computational Linguistics and Language Technology (GSCL-2015)","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Brown et al., 1992] Peter F Brown, Peter V Desouza, Robert L Mercer, Vincent J Della Pietra, and Jenifer C Lai. Class-based n-gram models of natural language. Compu- tational linguistics, 18(4):467-479, 1992.","title":"Class-based n-gram models of natural language","authors":"Peter V Peter F Brown, Robert L Desouza, Vincent J Mercer, Pietra Della, Jenifer C Lai","year":"1992","venue":"Computational linguistics","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Carreras et al., 2002] Xavier Carreras, Lluis Marquez, and Lluis Padro. Named entity extraction using AdaBoost. In Proceedings of the 6th conference on Natural language learning-Volume 20, pages 1-4, 2002.","title":"Named entity extraction using AdaBoost","authors":"Carreras","year":"2002","venue":"Proceedings of the 6th conference on Natural language learning","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Chinchor and Marsh, 1998] Nancy Chinchor and Elaine Marsh. Muc-7 information extraction task definition. In Proceeding of the Seventh Message Understanding Con- ference (MUC-7), Appendices, 1998.","title":"Muc-7 information extraction task definition","authors":"Marsh ; Chinchor, Nancy Chinchor, Elaine Marsh","year":"1998","venue":"Proceeding of the Seventh Message Understanding Conference (MUC-7), Appendices","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Clark and Curran, 2003] Stephen Clark and James Curran. Language Independent NER using a Maximum Entropy Tagger. In Proceedings of the Seventh Conference on Nat- ural Language Learning (CoNLL-03), pages 164-167, Ed- monton, Canada, 2003.","title":"Language Independent NER using a Maximum Entropy Tagger","authors":"Clark, Curran, Stephen Clark, James Curran","year":"2003","venue":"Proceedings of the Seventh Conference on Natural Language Learning (CoNLL-03)","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Clark, 2003] Alexander Clark. Combining distributional and morphological information for part of speech induc- tion. In Proceedings of the tenth conference on European chapter of the Association for Computational Linguistics- Volume 1, pages 59-66. Association for Computational Linguistics, 2003.","title":"Combining distributional and morphological information for part of speech induction","authors":"Alexander Clark","year":"2003","venue":"Proceedings of the tenth conference on European chapter of the Association for Computational Linguistics","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Collins, 2002] Michael Collins. Discriminative training methods for hidden markov models: Theory and experi- ments with perceptron algorithms. In Proceedings of the ACL-02 conference on Empirical methods in natural lan- guage processing-Volume 10, pages 1-8, 2002.","title":"Discriminative training methods for hidden markov models: Theory and experiments with perceptron algorithms","authors":"Michael Collins","year":"2002","venue":"Proceedings of the ACL-02 conference on Empirical methods in natural language processing","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Desmet and Hoste, 2014] Bart Desmet and Véronique Hoste. Fine-grained dutch named entity recognition. Language resources and evaluation, 48(2):307-343, 2014.","title":"Fine-grained dutch named entity recognition","authors":"Hoste Desmet, Bart Desmet, Véronique Hoste","year":"2014","venue":"Language resources and evaluation","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Faruqui et al., 2010] Manaal Faruqui, Sebastian Padó, and Maschinelle Sprachverarbeitung. Training and evaluating a german named entity recognizer with semantic gener- alization. In Proceedings of KONVENS, pages 129-133, 2010.","title":"Manaal Faruqui, Sebastian Padó, and Maschinelle Sprachverarbeitung. Training and evaluating a german named entity recognizer with semantic generalization","authors":"Faruqui","year":"2010","venue":"Proceedings of KONVENS","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Hänig et al., 2014] Christian Hänig, Stefan Bordag, and Stefan Thomas. Modular classifier ensemble architec- ture for named entity recognition on low resource systems. Proceedings of the KONVENS Germ-Eval Shared Task on Named Entity Recognition, Hildesheim, Germany, 2014.","title":"Modular classifier ensemble architecture for named entity recognition on low resource systems","authors":"Hänig","year":"2014","venue":"Proceedings of the KONVENS Germ-Eval Shared Task on Named Entity Recognition","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Lample et al., 2016] Guillaume Lample, Miguel Balles- teros, Sandeep Subramanian, Kazuya Kawakami, and Chris Dyer. Neural architectures for named entity recog- nition. In Proceedings of the 2016 Conference of the North American Chapter of the Association for Com- putational Linguistics: Human Language Technologies (NAACL-2016), pages 260-270, 2016.","title":"Neural architectures for named entity recognition","authors":"Guillaume Lample, Miguel Ballesteros, Sandeep Subramanian, Kazuya Kawakami, Chris Dyer","year":"2016","venue":"Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-2016)","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Ma and Hovy, 2016] Xuezhe Ma and Eduard Hovy. End-to- end sequence labeling via bi-directional lstm-cnns-crf. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (ACL-2016), pages 1064- 1074, 2016.","title":"Xuezhe Ma and Eduard Hovy. End-toend sequence labeling via bi-directional lstm-cnns-crf","authors":"Hovy Ma","year":"2016","venue":"Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (ACL-2016)","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Mikolov et al., 2013] Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S Corrado, and Jeff Dean. Distributed rep- resentations of words and phrases and their composition- ality. In Advances in Neural Information Processing Sys- tems, pages 3111-3119, 2013.","title":"Distributed representations of words and phrases and their compositionality","authors":"Mikolov","year":"2013","venue":"Advances in Neural Information Processing Systems","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Minard et al., 2016] Anne-Lyse Minard, Manuela Sper- anza, Ruben Urizar, Begoña Altuna, Marieke van Erp, An- neleen Schoen, and Chantal van Son. MEANTIME, the NewsReader Multilingual Event and Time Corpus. In Pro- ceedings of LREC 2016, 2016.","title":"MEANTIME, the NewsReader Multilingual Event and Time Corpus","authors":"Anne-Lyse Minard, Manuela Speranza, Ruben Urizar, Begoña Altuna, Marieke Van Erp, Anneleen Schoen, Chantal Van Son","year":"2016","venue":"Proceedings of LREC 2016","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Nothman et al., 2013] Joel Nothman, Nicky Ringland, Will Radford, Tara Murphy, and James R Curran. Learning multilingual named entity recognition from wikipedia. Ar- tificial Intelligence, 194:151-175, 2013.","title":"Learning multilingual named entity recognition from wikipedia","authors":"Joel Nothman, Nicky Ringland, Will Radford, Tara Murphy, James R Curran","year":"2013","venue":"Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Passos et al., 2014] Alexandre Passos, Vineet Kumar, and Andrew McCallum. Lexicon infused phrase embeddings for named entity resolution. In Proceedings of the Eigh- teenth Conference on Computational Natural Language Learning, pages 78-86, Ann Arbor, Michigan, June 2014. Association for Computational Linguistics.","title":"Lexicon infused phrase embeddings for named entity resolution","authors":"Alexandre Passos, Vineet Kumar, Andrew Mccallum","year":"2014","venue":"Proceedings of the Eighteenth Conference on Computational Natural Language Learning","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Ratinov and Roth, 2009] L. Ratinov and D. Roth. Design challenges and misconceptions in named entity recogni- tion. In Proceedings of the Thirteenth Conference on Com- putational Natural Language Learning, pages 147-155, 2009.","title":"Design challenges and misconceptions in named entity recognition","authors":"L Ratinov, D Roth","year":"2009","venue":"Proceedings of the Thirteenth Conference on Computational Natural Language Learning","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Taulé et al., 2008] Mariona Taulé, Maria Antònia Martí, and Marta Recasens. AnCora: Multilevel Annotated Cor- pora for Catalan and Spanish. In Proceedings of LREC 2008, pages 96-101, 2008.","title":"AnCora: Multilevel Annotated Corpora for Catalan and Spanish","authors":"Mariona Taulé, Maria Antònia Martí, Marta Recasens","year":"2008","venue":"Proceedings of LREC 2008","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Tjong Kim Sang, 2002] Erik F. Tjong Kim Sang. Intro- duction to the CoNLL-2002 shared task: Language- independent named entity recognition. In Proceedings of CoNLL-2002, pages 155-158. Taipei, Taiwan, 2002.","title":"Introduction to the CoNLL-2002 shared task: Languageindependent named entity recognition","authors":"Tjong Kim, Sang ; ] Erik, F Tjong, Kim Sang","year":"2002","venue":"Proceedings of CoNLL-2002","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Turian et al., 2010] Joseph Turian, Lev-Arie Ratinov, and Yoshua Bengio. Word representations: A simple and gen- eral method for semi-supervised learning. In Proceedings of the 48th Annual Meeting of the Association for Com- putational Linguistics, pages 384-394, Uppsala, Sweden, July 2010. Association for Computational Linguistics.","title":"Word representations: A simple and general method for semi-supervised learning","authors":"Turian","year":"2010","venue":"Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}