{"type":"ScholarlyArticle","title":"News Across Languages - Cross-Lingual Document Similarity and Event Tracking (Extended Abstract)","authors":[{"name":"Jan Rupnik","slug":"jan-rupnik","given":"Jan","family":"Rupnik","affiliation":"Artificial Intelligence Laboratory , Jožef Stefan Institute , Jamova cesta 39 , 1000 Ljubljana , Slovenia"},{"name":"Andrej Muhič","slug":"andrej-muhic","given":"Andrej","family":"Muhič","affiliation":"Artificial Intelligence Laboratory , Jožef Stefan Institute , Jamova cesta 39 , 1000 Ljubljana , Slovenia"},{"name":"Gregor Leban","slug":"gregor-leban","given":"Gregor","family":"Leban","affiliation":"Artificial Intelligence Laboratory , Jožef Stefan Institute , Jamova cesta 39 , 1000 Ljubljana , Slovenia"},{"name":"Blaž Fortuna","slug":"blaz-fortuna","given":"Blaž","family":"Fortuna","affiliation":"Artificial Intelligence Laboratory , Jožef Stefan Institute , Jamova cesta 39 , 1000 Ljubljana , Slovenia"},{"name":"Marko Grobelnik","slug":"marko-grobelnik","given":"Marko","family":"Grobelnik","affiliation":"Artificial Intelligence Laboratory , Jožef Stefan Institute , Jamova cesta 39 , 1000 Ljubljana , Slovenia"}],"abstract":"In today's world, we follow news which is distributed globally. Significant events are reported by different sources and in different languages. In this work, we address the problem of tracking of events in a large multilingual stream. Within a recently developed system Event Registry we examine two aspects of this problem: how to compare articles in different languages and how to link collections of articles in different languages which refer to the same event. Building on previous work, we show there are methods which scale well and can compute a meaningful similarity between articles from languages with little or no direct overlap in the training data.Using this capability, we then propose an approach to link clusters of articles across languages which represent the same event.","doi":"10.24963/ijcai.2017/720","url":"https://ijcai.org/proceedings/2017/720","pdf":"https://ijcai.org/proceedings/2017/0720.pdf","markdown":"https://ijcai.org/proceedings/2017/720.md","bibtex":"https://ijcai.org/proceedings/2017/bibtex/720","volume":{"slug":"2017","title":"Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2017","url":"https://ijcai.org/proceedings/2017/","year":2017,"location":"Melbourne, Australia","dates":"19-25 August 2017","editors":"Carles Sierra","isbn":"978-0-9992411-0-3","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2017"},"section":"Journal track","track":"Journal track","number":720,"pages":{"first":5050,"last":5054},"keywords":["Natural Language Processing: NLP Applications and Tools","Natural Language Processing: Sentiment Analysis and Text Mining"],"videos":[],"references":[{"position":1,"raw":"[Brank et al., 2014] Janez Brank, Gregor Leban, and Marko Grobelnik. A high-performance multithreaded approach for clustering a stream of documents. In Proceedings of the 17th International Multiconference Information Soci- ety 2014, Volume E, Ljubljana, Slovenia, pages 5-8, 2014.","title":"A high-performance multithreaded approach for clustering a stream of documents","authors":"Janez Brank, Gregor Leban, Marko Grobelnik","year":"2014","venue":"Proceedings of the 17th International Multiconference Information Society 2014","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Deerwester et al., 1990] S. Deerwester, S. T. Dumais, T. K. Landauer, G. W. Furnas, and R. A. Harshman. Indexing by latent semantic analysis. Journal of the American Society for Information Science, 41(6):391-407, 1990.","title":"Indexing by latent semantic analysis","authors":"S Deerwester, S T Dumais, T K Landauer, G W Furnas, R A Harshman","year":"1990","venue":"Journal of the American Society for Information Science","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Hotelling, 1935] Harold Hotelling. The most predictable criterion. Journal of educational Psychology, 26(2):139, 1935.","title":"Harold Hotelling. The most predictable criterion","authors":"Hotelling","year":"1935","venue":"Journal of educational Psychology","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Kettenring, 1971] Jon R. Kettenring. Canonical analysis of several sets of variables. Biometrika, 58:433-45, 1971.","title":"Canonical analysis of several sets of variables","authors":"Jon R Kettenring","year":"1971","venue":"Biometrika","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Leban et al., 2014a] Gregor Leban, Blaz Fortuna, Janez Brank, and Marko Grobelnik. Cross-lingual detection of world events from news articles. In Proceedings of the 13th International Semantic Web Conference, pages 21- 24, Riva del Garda -Trentino, Italy, 2014.","title":"Cross-lingual detection of world events from news articles","authors":"Leban","year":"2014","venue":"Proceedings of the 13th International Semantic Web Conference","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Leban et al., 2014b] Gregor Leban, Blaz Fortuna, Janez Brank, and Marko Grobelnik. Event registry: Learning about world events from news. In Proceedings of the Com- panion Publication of the 23rd International Conference on World Wide Web Companion, WWW Companion '14, pages 107-110, Seoul, Republic of Korea, 2014. Interna- tional World Wide Web Conferences Steering Committee. [Levandowsky and Winter, 1971]","title":"Event registry: Learning about world events from news","authors":"Leban","year":"1971","venue":"Proceedings of the Companion Publication of the 23rd International Conference on World Wide Web Companion, WWW Companion '14","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"Michael Levandowsky and David Winter. Distance between sets. Nature, 234(5323):34-35, 11 1971.","title":"Distance between sets","authors":"Michael Levandowsky, David Winter","year":"1971","venue":"Nature","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Milne and Witten, 2008] David Milne and Ian H. Witten. Learning to link with wikipedia. In Proceedings of the 17th ACM Conference on Information and Knowledge Management, CIKM '08, pages 509-518, New York, NY, USA, 2008. ACM.","title":"Learning to link with wikipedia","authors":"David Milne, Ian H Witten","year":"2008","venue":"Proceedings of the 17th ACM Conference on Information and Knowledge Management, CIKM '08","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Muhič et al., 2012] Andrej Muhič, Jan Rupnik, and Primož Škraba. Cross-lingual document similarity. In Information Technology Interfaces (ITI), Proceedings of the ITI 2012 34th International Conference on, pages 387-392, Cavtat / Dubrovnik, Croatia, 2012. IEEE.","title":"Andrej Muhič, Jan Rupnik, and Primož Škraba. Cross-lingual document similarity","authors":"Muhič","year":"2012","venue":"Information Technology Interfaces (ITI), Proceedings of the ITI 2012 34th International Conference on","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Rupnik et al., 2011a] Jan Rupnik, Andrej Muhic, and Pri- moz Skraba. Low-rank approximations for large, multi- lingual data. Low Rank Approximation and Sparse Rep- resentation, Neural Information Processing Systems 2011 Workshop, 2011.","title":"Low-rank approximations for large, multilingual data","authors":"Rupnik","year":"2011","venue":"Neural Information Processing Systems 2011 Workshop","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Rupnik et al., 2011b] Jan Rupnik, Andrej Muhic, and Pri- moz Skraba. Spanning spaces: Learning cross-lingual similarities. Beyond Mahalanobis: Supervised Large- Scale Learning of Similarity, Neural Information Process- ing Systems 2011 Workshop, 2011.","title":"Spanning spaces: Learning cross-lingual similarities. Beyond Mahalanobis: Supervised Large-Scale Learning of Similarity","authors":"Rupnik","year":"2011","venue":"Neural Information Processing Systems 2011 Workshop","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Rupnik et al., 2012] Jan Rupnik, Andrej Muhic, and Primoz Skraba. Multilingual document retrieval through hub lan- guages. In Proceedings of the 15th Multiconference on In- formation Society 2012 (IS-2012), pages 201-204, Ljubl- jana, Slovenia, 2012.","title":"Multilingual document retrieval through hub languages","authors":"Rupnik","year":"2012","venue":"Proceedings of the 15th Multiconference on Information Society 2012 (IS-2012)","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Rupnik et al., 2016] Jan Rupnik, Andrej Muhič, Gregor Leban, Primož Škraba, Blaž Fortuna, and Marko Grobel- nik. News Across Languages -Cross-Lingual Document Similarity and Event Tracking. Journal of Artificial Intel- ligence Research, JAIR, 55:283 -316, 2016.","title":"News Across Languages -Cross-Lingual Document Similarity and Event Tracking","authors":"Rupnik","year":"2016","venue":"Journal of Artificial Intelligence Research","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Salton and Buckley, 1988] Gerard Salton and Christopher Buckley. Term-weighting approaches in automatic text re- trieval. volume 24, pages 513-523. Elsevier, 1988.","title":"Term-weighting approaches in automatic text retrieval","authors":"Buckley Salton, Gerard Salton, Christopher Buckley","year":"1988","venue":null,"doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Shawe-Taylor and Cristianini, 2004] John Shawe-Taylor and Nello Cristianini. Kernel Methods for Pattern Analysis. Cambridge University Press, 2004.","title":"Kernel Methods for Pattern Analysis","authors":"John Shawe, - Taylor, Nello Cristianini","year":"2004","venue":null,"doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Trampuš and Novak, 2012] Mitja Trampuš and Blaž Novak. The internals of an aggregated web news feed. In Proceed- ings of 15th Multiconference on Information Society 2012 (IS-2012), pages 221-224, Ljubljana, Slovenia, 2012.","title":"Mitja Trampuš and Blaž Novak. The internals of an aggregated web news feed","authors":"Novak Trampuš","year":"2012","venue":"Proceedings of 15th Multiconference on Information Society 2012 (IS-2012)","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Zhang and Rettinger, 2014a] Lei Zhang and Achim Ret- tinger. Semantic annotation, analysis and comparison: A multilingual and cross-lingual text analytics toolkit. In Proceedings of the Demonstrations at the 14th Conference of the European Chapter of the Association for Compu- tational Linguistics (EACL 2014), pages 13-16, Gothen- burg, Sweden, April 2014. Association for Computational Linguistics.","title":"Semantic annotation, analysis and comparison: A multilingual and cross-lingual text analytics toolkit","authors":"Rettinger Zhang, Lei Zhang, Achim Rettinger","year":"2014","venue":"Proceedings of the Demonstrations at the 14th Conference of the European Chapter of the Association for Computational Linguistics (EACL 2014)","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Zhang and Rettinger, 2014b] Lei Zhang and Achim Ret- tinger. X-lisa: Cross-lingual semantic annotation. Pro- ceedings of the Very Large Data Bases (VLDB) Endow- ment, 7(13):1693-1696, August 2014.","title":"X-lisa: Cross-lingual semantic annotation. Proceedings of the Very Large Data Bases","authors":"Rettinger Zhang, Lei Zhang, Achim Rettinger","year":"2014","venue":"VLDB) Endowment","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}