{"type":"ScholarlyArticle","title":"Early Discovery of Emerging Entities in Microblogs","authors":[{"name":"Satoshi Akasaki","slug":"satoshi-akasaki","given":"Satoshi","family":"Akasaki","affiliation":"The University of Tokyo"},{"name":"Naoki Yoshinaga","slug":"naoki-yoshinaga","given":"Naoki","family":"Yoshinaga","affiliation":"Institute of Industrial Science , the University of Tokyo"},{"name":"Masashi Toyoda","slug":"masashi-toyoda","given":"Masashi","family":"Toyoda","affiliation":"Institute of Industrial Science , the University of Tokyo"}],"abstract":"Keeping up to date on emerging entities that appear every day is indispensable for various applications, such as social-trend analysis and marketing research. Previous studies have attempted to detect unseen entities that are not registered in a particular knowledge base as emerging entities and consequently find non-emerging entities since the absence of entities in knowledge bases does not guarantee their emergence. We therefore introduce a novel task of discovering truly emerging entities when they have just been introduced to the public through microblogs and propose an effective method based on time-sensitive distant supervision, which exploits distinctive early-stage contexts of emerging entities. \r\nExperimental results with a large-scale Twitter archive show that the proposed method achieves 83.2% precision of the top 500 discovered emerging entities, which outperforms baselines based on unseen entity recognition with burst detection.\r\nBesides notable emerging entities, our method can discover massive long-tail and homographic emerging entities.\r\nAn evaluation of relative recall shows that the method detects 80.4% emerging entities newly registered in Wikipedia; 92.8% of them are discovered earlier than their registration in Wikipedia, and the average lead-time is more than one year (578 days).","doi":"10.24963/ijcai.2019/678","url":"https://ijcai.org/proceedings/2019/678","pdf":"https://ijcai.org/proceedings/2019/0678.pdf","markdown":"https://ijcai.org/proceedings/2019/678.md","bibtex":"https://ijcai.org/proceedings/2019/bibtex/678","volume":{"slug":"2019","title":"Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2019","url":"https://ijcai.org/proceedings/2019/","year":2019,"location":"Macao","dates":"10-16 August 2019","editors":"Sarit Kraus","isbn":"978-0-9992411-4-1","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2019"},"section":"Natural Language Processing","track":"Main track","number":678,"pages":{"first":4882,"last":4889},"keywords":["Natural Language Processing: Natural Language Processing","Natural Language Processing: Named Entities","Natural Language Processing: Information Extraction"],"videos":[],"references":[{"position":1,"raw":"[Akbik et al., 2019] Alan Akbik, Tanja Bergmann, and Roland Vollgraf. Pooled contextualized embeddings for named entity recognition. In Proceedings of the 2019 An- nual Conference of the North American Chapter of the Association for Computational Linguistics: Human Lan- guage Technologies (NAACL-HLT), pages 724-728, 2019.","title":"Pooled contextualized embeddings for named entity recognition","authors":"Alan Akbik, Tanja Bergmann, Roland Vollgraf","year":"2019","venue":"Proceedings of the 2019 Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Brambilla et al., 2017] Marco Brambilla, Stefano Ceri, Emanuele Della Valle, Riccardo Volonterio, and Fe- lix Xavier Acero Salazar. Extracting emerging knowledge from social media. In Proceedings of the 26th Interna- tional Conference on World Wide Web (WWW), pages 795- 804, 2017.","title":"Extracting emerging knowledge from social media","authors":"Marco Brambilla, Stefano Ceri, Emanuele Della Valle, Riccardo Volonterio, Felix Xavier, Acero Salazar","year":"2017","venue":"Proceedings of the 26th International Conference on World Wide Web (WWW)","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Brown et al., 1992] Peter F Brown, Peter V Desouza, Robert L Mercer, Vincent J Della Pietra, and Jenifer C Lai. Class-based n-gram models of natural language. Compu- tational linguistics, 18(4):467-479, 1992.","title":"Class-based n-gram models of natural language","authors":"Peter V Peter F Brown, Robert L Desouza, Vincent J Mercer, Pietra Della, Jenifer C Lai","year":"1992","venue":"Computational linguistics","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Culotta and McCallum, 2004] Aron Culotta and Andrew McCallum. Confidence estimation for information ex- traction. In Proceedings of the 5th Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technolo- gies (NAACL-HLT), pages 109-112, 2004.","title":"Confidence estimation for information extraction","authors":"Mccallum Culotta, Aron Culotta, Andrew Mccallum","year":"2004","venue":"Proceedings of the 5th Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Derczynski et al., 2017] Leon Derczynski, Eric Nichols, Marieke van Erp, and Nut Limsopatham. Results of the WNUT2017 shared task on novel and emerging entity recognition. In Proceedings of the 3rd Workshop on Noisy User-generated Text (WNUT), pages 140-147, 2017.","title":"Results of the WNUT2017 shared task on novel and emerging entity recognition","authors":"Leon Derczynski, Eric Nichols, Marieke Van Erp, Nut Limsopatham","year":"2017","venue":"Proceedings of the 3rd Workshop on Noisy User-generated Text (WNUT)","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Färber et al., 2016] Michael Färber, Achim Rettinger, and Boulos Asmar. On emerging entity detection. In Proceed- ings of the 20th International Conference on Knowledge Engineering and Knowledge Management (EKAW), pages 223-238, 2016.","title":"On emerging entity detection","authors":"Michael Färber, Achim Rettinger, Boulos Asmar","year":"2016","venue":"Proceedings of the 20th International Conference on Knowledge Engineering and Knowledge Management (EKAW)","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Fleiss and Cohen, 1973] Joseph L Fleiss and Jacob Cohen. The equivalence of weighted kappa and the intraclass cor- relation coefficient as measures of reliability. Educational and psychological measurement, 33(3):613-619, 1973.","title":"The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability","authors":"Cohen ; Fleiss, L Joseph, Jacob Fleiss, Cohen","year":"1973","venue":"Educational and psychological measurement","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Graus et al., 2018] David Graus, Daan Odijk, and Maarten de Rijke. The birth of collective memories: Analyzing emerging entities in text streams. Journal of the Associa- tion for Information Science and Technology, 69(6):773- 786, 2018.","title":"The birth of collective memories: Analyzing emerging entities in text streams","authors":"David Graus, Daan Odijk, Maarten De Rijke","year":"2018","venue":"Journal of the Association for Information Science and Technology","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Hoffart et al., 2014] Johannes Hoffart, Yasemin Altun, and Gerhard Weikum. Discovering emerging entities with am- biguous names. In Proceedings of the 23rd International Conference on World Wide Web (WWW), pages 385-396, 2014.","title":"Discovering emerging entities with ambiguous names","authors":"Hoffart","year":"2014","venue":"Proceedings of the 23rd International Conference on World Wide Web (WWW)","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Lafferty et al., 2001] John D. Lafferty, Andrew McCallum, and Fernando C. N. Pereira. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In Proceedings of the 18th International Conference on Machine Learning (ICML), pages 282-289, 2001.","title":"Conditional random fields: Probabilistic models for segmenting and labeling sequence data","authors":"John D Lafferty, Andrew Mccallum, Fernando C N Pereira","year":"2001","venue":"Proceedings of the 18th International Conference on Machine Learning (ICML)","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Lample et al., 2016] Guillaume Lample, Miguel Balles- teros, Sandeep Subramanian, Kazuya Kawakami, and Chris Dyer. Neural architectures for named entity recog- nition. In Proceedings of the 15th Annual Conference of the North American Chapter of the Association for Com- putational Linguistics: Human Language Technologies (NAACL-HLT), pages 260-270, 2016.","title":"Neural architectures for named entity recognition","authors":"Guillaume Lample, Miguel Ballesteros, Sandeep Subramanian, Kazuya Kawakami, Chris Dyer","year":"2016","venue":"Proceedings of the 15th Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[McCallum, 2002] Andrew Kachites McCallum. Mal- let: A machine learning for language toolkit. http://mallet.cs.umass.edu, 2002.","title":"Mallet: A machine learning for language toolkit","authors":"Andrew Kachites, Mccallum","year":null,"venue":null,"doi":null,"url":"http://mallet.cs.umass.edu,2002","internal_url":null},{"position":13,"raw":"[Miller et al., 2004] Scott Miller, Jethran Guinness, and Alex Zamanian. Name tagging with word clusters and discrim- inative training. In Proceedings of the 5th Annual Confer- ence of the North American Chapter of the Association for Computational Linguistics: Human Language Technolo- gies (NAACL-HLT), pages 337-342, 2004.","title":"Name tagging with word clusters and discriminative training","authors":"Scott Miller, Jethran Guinness, Alex Zamanian","year":"2004","venue":"Proceedings of the 5th Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT)","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Mintz et al., 2009] Mike Mintz, Steven Bills, Rion Snow, and Dan Jurafsky. Distant supervision for relation ex- traction without labeled data. In Proceedings of the Joint Conference of the 47th Annual Meeting of the Association for Computational Linguistics and the 4th International Joint Conference on Natural Language Processing (ACL- IJCNLP), pages 1003-1011, 2009.","title":"Distant supervision for relation extraction without labeled data","authors":"Mike Mintz, Steven Bills, Rion Snow, Dan Jurafsky","year":"2009","venue":"Proceedings of the Joint Conference of the 47th Annual Meeting of the Association for Computational Linguistics and the 4th International Joint Conference on Natural Language Processing (ACL-IJCNLP)","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Nakashole et al., 2013] Ndapandula Nakashole, Tomasz Tylenda, and Gerhard Weikum. Fine-grained semantic typing of emerging entities. In Proceedings of the 51st Annual Meeting of the Association for Computational Lin- guistics (ACL), pages 1488-1497, 2013.","title":"Ndapandula Nakashole, Tomasz Tylenda, and Gerhard Weikum. Fine-grained semantic typing of emerging entities","authors":"Nakashole","year":"2013","venue":"Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (ACL)","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Pennington et al., 2014] Jeffrey Pennington, Richard Socher, and Christopher Manning. Glove: Global vectors for word representation. In Proceedings of the 19th Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 1532-1543, 2014.","title":"Glove: Global vectors for word representation","authors":"Jeffrey Pennington, Richard Socher, Christopher Manning","year":"2014","venue":"Proceedings of the 19th Conference on Empirical Methods in Natural Language Processing (EMNLP)","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Ratinov and Roth, 2009] Lev Ratinov and Dan Roth. De- sign challenges and misconceptions in named entity recog- nition. In Proceedings of the 13th Conference on Compu- tational Natural Language Learning (CoNLL), pages 147- 155, 2009.","title":"Lev Ratinov and Dan Roth. Design challenges and misconceptions in named entity recognition","authors":"Roth Ratinov","year":"2009","venue":"Proceedings of the 13th Conference on Computational Natural Language Learning (CoNLL)","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Wu et al., 2016] Zhaohui Wu, Yang Song, and C Lee Giles. Exploring multiple feature spaces for novel entity discov- ery. In Proceedings of the 30th AAAI Conference on Arti- ficial Intelligence (AAAI), pages 3073-3079, 2016.","title":"Exploring multiple feature spaces for novel entity discovery","authors":"Zhaohui Wu, Yang Song, C Lee Giles","year":"2016","venue":"Proceedings of the 30th AAAI Conference on Artificial Intelligence (AAAI)","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Yang et al., 2018] Jie Yang, Shuailong Liang, and Yue Zhang. Design challenges and misconceptions in neu- ral sequence labeling. In Proceedings of the 27th Inter- national Conference on Computational Linguistics (COL- ING), pages 3879-3889, 2018.","title":"Design challenges and misconceptions in neural sequence labeling","authors":"Jie Yang, Shuailong Liang, Yue Zhang","year":"2018","venue":"Proceedings of the 27th International Conference on Computational Linguistics (COL-ING)","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}