{"type":"ScholarlyArticle","title":"Inferring Temporal Knowledge for Near-Periodic Recurrent Events","authors":[{"name":"Dinesh Raghu","slug":"dinesh-raghu","given":"Dinesh","family":"Raghu","affiliation":"IIT Delhi , New Delhi , India; IBM Research , New Delhi , India"},{"name":"Surag Nair","slug":"surag-nair","given":"Surag","family":"Nair","affiliation":"Stanford University , Stanford , CA , USA"},{"name":"Mausam","slug":"mausam","given":"","family":"Mausam","affiliation":"IIT Delhi , New Delhi , India"}],"abstract":"We define the novel problem of extracting and predicting occurrence dates for a class of recurrent events -- events that are held periodically as per a near-regular schedule (e.g., conferences, film festivals, sport championships). Knowledge-bases such as Freebase contain a large number of such recurring events, but they also miss substantial information regarding specific event instances and their occurrence dates. We develop a temporal extraction and inference engine to fill in the missing dates as well as to predict their future occurrences. Our engine performs joint inference over several knowledge sources -- (1) information about an event instance and its date extracted from text by our temporal extractor, (2) information about the typical schedule (e.g., ``every second week of June\") for a recurrent event extracted by our schedule extractor, and (3) known dates for other instances of the same event. The output of our system is a representation for the event schedule and an occurrence date for each event instance. We find that our system beats humans in predicting future occurrences of recurrent events by significant margins. We release our code and system output for further research.","doi":"10.24963/ijcai.2018/598","url":"https://ijcai.org/proceedings/2018/598","pdf":"https://ijcai.org/proceedings/2018/0598.pdf","markdown":"https://ijcai.org/proceedings/2018/598.md","bibtex":"https://ijcai.org/proceedings/2018/bibtex/598","volume":{"slug":"2018","title":"Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2018","url":"https://ijcai.org/proceedings/2018/","year":2018,"location":"Stockholm","dates":"13-19 July 2018","editors":"Jérôme Lang","isbn":"978-0-9992411-2-7","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2018"},"section":"Natural Language Processing","track":"Main track","number":598,"pages":{"first":4301,"last":4308},"keywords":["Natural Language Processing: Information Extraction","Natural Language Processing: Natural Language Processing"],"videos":[],"references":[{"position":1,"raw":"[Adel et al., 2016] Heike Adel, Benjamin Roth, and Hinrich Schutze. Comparing convolutional neural networks to tra- ditional models for slot filling. In HLT-NAACL, 2016.","title":"Comparing convolutional neural networks to traditional models for slot filling","authors":"Heike Adel, Benjamin Roth, Hinrich Schutze","year":"2016","venue":"HLT-NAACL","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Bethard and Martin, 2006] Steven Bethard and James H. Martin. Identification of event mentions and their semantic class. In Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing, EMNLP '06, pages 146-154, Stroudsburg, PA, USA, 2006. Association for Computational Linguistics.","title":"Identification of event mentions and their semantic class","authors":"Steven Bethard, James H Martin","year":"2006","venue":"Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing, EMNLP '06","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Chang and Manning, 2012] Angel X. Chang and Christo- pher D. Manning. Sutime: A library for recognizing and normalizing time expressions. In In LREC, 2012.","title":"Sutime: A library for recognizing and normalizing time expressions","authors":"Angel X Chang, Christopher D Manning","year":"2012","venue":"LREC","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Craswell, 2009] Nick Craswell. Mean reciprocal rank. In Encyclopedia of Database Systems, 2009.","title":"Mean reciprocal rank","authors":"Nick Craswell","year":"2009","venue":"Encyclopedia of Database Systems","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Do et al., 2012] Quang Xuan Do, Wei Lu, and Dan Roth. Joint inference for event timeline construction. In Pro- ceedings of the 2012 Joint Conference on Empirical Meth- ods in Natural Language Processing and Computational Natural Language Learning, pages 677-687. Association for Computational Linguistics, 2012.","title":"Joint inference for event timeline construction","authors":"Xuan Quang, Wei Do, Dan Lu, Roth","year":"2012","venue":"Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Foley et al., 2015] John Foley, Michael Bendersky, and Vanja Josifovski. Learning to extract local events from the web. In Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Infor- mation Retrieval, SIGIR '15, pages 423-432, New York, NY, USA, 2015. ACM.","title":"Learning to extract local events from the web","authors":"Foley","year":"2015","venue":"Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR '15","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Intxaurrondo et al., 2015] Ander Intxaurrondo, Eneko Agirre, Oier Lopez de Lacalle, and Mihai Surdeanu. Diamonds in the rough: Event extraction from imperfect microblog data. In HLT-NAACL, 2015.","title":"Diamonds in the rough: Event extraction from imperfect microblog data","authors":"Eneko Ander Intxaurrondo, Oier Agirre, Mihai Lopez De Lacalle, Surdeanu","year":"2015","venue":"HLT-NAACL","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Ji et al., 2014] Heng Ji, Taylor Cassidy, Qi Li, and Suzanne Tamang. Tackling representation, annotation and classifi- cation challenges for temporal knowledge base population. Knowl. Inf. Syst., 41(3):611-646, December 2014.","title":"Tackling representation, annotation and classification challenges for temporal knowledge base population","authors":"Ji Heng, Taylor Cassidy, Qi Li, Suzanne Tamang","year":"2014","venue":"Knowl. Inf. Syst","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Konovalov et al., 2017] Alexander Konovalov, Benjamin Strauss, Alan Ritter, and Brendan O'Connor. Learning to extract events from knowledge base revisions. In Proceed- ings of the 26th International Conference on World Wide Web, WWW '17, pages 1007-1014, Republic and Canton of Geneva, Switzerland, 2017. International World Wide Web Conferences Steering Committee.","title":"Learning to extract events from knowledge base revisions","authors":"Alexander Konovalov, Benjamin Strauss, Alan Ritter, Brendan O' Connor","year":"2017","venue":"Proceedings of the 26th International Conference on World Wide Web, WWW '17","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Kunneman and Van den Bosch, 2015] Florian Kunneman and Antal Van den Bosch. Automatically identifying periodic social events from twitter. In Proceedings of the International Conference Recent Advances in Natural Language Processing, pages 320-328, 2015.","title":"Automatically identifying periodic social events from twitter","authors":"Kunneman, Florian Van Den Bosch ;, Antal Kunneman, Van Den, Bosch","year":"2015","venue":"Proceedings of the International Conference Recent Advances in Natural Language Processing","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Kuzey et al., 2014] Erdal Kuzey, Jilles Vreeken, and Ger- hard Weikum. A fresh look on knowledge bases: Dis- tilling named events from news. In Proceedings of the 23rd ACM International Conference on Conference on In- formation and Knowledge Management, CIKM '14, pages 1689-1698, New York, NY, USA, 2014. ACM.","title":"A fresh look on knowledge bases: Distilling named events from news","authors":"Erdal Kuzey, Jilles Vreeken, Gerhard Weikum","year":"2014","venue":"Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management, CIKM '14","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Manning et al., 2014] Christopher D. Manning, Mihai Sur- deanu, John Bauer, Jenny Finkel, Steven J. Bethard, and David McClosky. The Stanford CoreNLP natural lan- guage processing toolkit. In Association for Computa- tional Linguistics (ACL) System Demonstrations, pages 55-60, 2014.","title":"The Stanford CoreNLP natural language processing toolkit","authors":"D Christopher, Mihai Manning, John Surdeanu, Jenny Bauer, Steven J Finkel, David Bethard, Mcclosky","year":"2014","venue":"Association for Computational Linguistics (ACL) System Demonstrations","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Patwardhan and Riloff, 2009] Siddharth Patwardhan and Ellen Riloff. A unified model of phrasal and sentential evidence for information extraction. In Proceedings of the 2009 Conference on Empirical Methods in Natural Lan- guage Processing: Volume 1 -Volume 1, EMNLP '09, pages 151-160, Stroudsburg, PA, USA, 2009. Association for Computational Linguistics.","title":"A unified model of phrasal and sentential evidence for information extraction","authors":"Siddharth Patwardhan, Ellen Riloff","year":"2009","venue":"Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Pustejovsky et al., 2003] James Pustejovsky, José M. Castaño, Robert Ingria, Roser Sauri, Robert J. Gaizauskas, Andrea Setzer, Graham Katz, and Dragomir R. Radev. Timeml: Robust specification of event and temporal expressions in text. In Mark T. Maybury, editor, New Directions in Question Answering, pages 28-34. AAAI Press, 2003.","title":"Timeml: Robust specification of event and temporal expressions in text","authors":"James Pustejovsky, M José, Robert Castaño, Roser Ingria, Robert J Sauri, Andrea Gaizauskas, Graham Setzer, Dragomir R Katz, Radev","year":"2003","venue":"New Directions in Question Answering","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Reschke et al., 2014] Kevin Reschke, Martin Jankowiak, Mihai Surdeanu, Christopher Manning, and Daniel Juraf- sky. Event extraction using distant supervision. In Pro- ceedings of the Ninth International Conference on Lan- guage Resources and Evaluation (LREC'14). European Language Resources Association (ELRA), may 2014.","title":"Event extraction using distant supervision","authors":"Kevin Reschke, Martin Jankowiak, Mihai Surdeanu, Christopher Manning, Daniel Jurafsky","year":"2014","venue":"Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14). European Language Resources Association (ELRA)","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Ritter et al., 2012] Alan Ritter, Mausam, Oren Etzioni, and Sam Clark. Open domain event extraction from twitter. In Proceedings of the 18th ACM SIGKDD International Con- ference on Knowledge Discovery and Data Mining, KDD '12, pages 1104-1112, New York, NY, USA, 2012. ACM.","title":"Open domain event extraction from twitter","authors":"Alan Ritter, Oren Mausam, Sam Etzioni, Clark","year":"2012","venue":"Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD '12","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Sandhaus, 2008] E. Sandhaus. The New York Times Anno- tated Corpus. Linguistic Data Consortium, Philadelphia, 6(12), 2008.","title":"The New York Times Annotated Corpus. Linguistic Data Consortium","authors":"E Sandhaus","year":"2008","venue":null,"doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Surdeanu and Ji, 2014] Mihai Surdeanu and Heng Ji. Overview of the english slot filling track at the tac2014 knowledge base population evaluation. 2014.","title":"Overview of the english slot filling track at the tac2014 knowledge base population evaluation","authors":"Mihai Surdeanu, Heng Ji","year":"2014","venue":null,"doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Surdeanu et al., 2011] Mihai Surdeanu, Sonal Gupta, John Bauer, David McClosky, Angel X Chang, Valentin I Spitkovsky, and Christopher D Manning. Stanford's distantly-supervised slot-filling system. In TAC, 2011.","title":"Stanford's distantly-supervised slot-filling system","authors":"Mihai Surdeanu, Sonal Gupta, John Bauer, David Mcclosky, X Angel, Valentin I Chang, Christopher D Spitkovsky, Manning","year":"2011","venue":"TAC","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Surdeanu, 2013] Mihai Surdeanu. Overview of the tac2013 knowledge base population evaluation: English slot filling and temporal slot filling. In TAC, 2013.","title":"Mihai Surdeanu. Overview of the tac2013 knowledge base population evaluation: English slot filling and temporal slot filling","authors":"Surdeanu","year":"2013","venue":"TAC","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Talukdar et al., 2012] Partha Pratim Talukdar, Derry Wi- jaya, and Tom Mitchell. Coupled temporal scoping of rela- tional facts. In Proceedings of the fifth ACM international conference on Web search and data mining, pages 73-82. ACM, 2012.","title":"Coupled temporal scoping of relational facts","authors":"Partha Pratim Talukdar, Derry Wijaya, Tom Mitchell","year":"2012","venue":"Proceedings of the fifth ACM international conference on Web search and data mining","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Verhagen et al., 2007] Marc Verhagen, Robert Gaizauskas, Frank Schilder, Mark Hepple, Graham Katz, and James Pustejovsky. Semeval-2007 task 15: Tempeval temporal relation identification. In Proceedings of the 4th Interna- tional Workshop on Semantic Evaluations, SemEval '07, pages 75-80, Stroudsburg, PA, USA, 2007. Association for Computational Linguistics.","title":"Semeval-2007 task 15: Tempeval temporal relation identification","authors":"Marc Verhagen, Robert Gaizauskas, Frank Schilder, Mark Hepple, Graham Katz, James Pustejovsky","year":"2007","venue":"Proceedings of the 4th International Workshop on Semantic Evaluations, SemEval '07","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Zhang et al., 2015] Congle Zhang, Stephen Soderland, and Daniel Weld. Exploiting parallel news streams for unsu- pervised event extraction. Transactions of the Association for Computational Linguistics, 3:117-129, 2015.","title":"Exploiting parallel news streams for unsupervised event extraction","authors":"Zhang","year":"2015","venue":"Transactions of the Association for Computational Linguistics","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}