{"type":"ScholarlyArticle","title":"Anchors Selection for Cross-lingual Embedding Alignment through Time","authors":[{"name":"Filippo Pallucchini","slug":"filippo-pallucchini","given":"Filippo","family":"Pallucchini","affiliation":"Dept of Statistics and Quantitative Methods , University of Milan-Bicocca"}],"abstract":"In recent years, vector representations of words have proven to be extremely useful across a wide range of NLP applications. Because of the broad interest in the topic, it became essential to answer the following question: is it possible to align different embeddings, in order to compare terms belonging to different vector spaces and their relations? While embedding alignment received considerable attention in the literature, how to find the best anchors for this process is still an open problem; in this paper, we propose an unsupervised, automatic method to select words belonging to different corpora that are close from a semantic point of view, and can be used as anchors for aligning their respective embedding spaces.","doi":"10.24963/ijcai.2022/836","url":"https://ijcai.org/proceedings/2022/836","pdf":"https://ijcai.org/proceedings/2022/0836.pdf","markdown":"https://ijcai.org/proceedings/2022/836.md","bibtex":"https://ijcai.org/proceedings/2022/bibtex/836","volume":{"slug":"2022","title":"Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2022","url":"https://ijcai.org/proceedings/2022/","year":2022,"location":"Vienna","dates":"23-29 July 2022","editors":"Luc De Raedt","isbn":"978-1-956792-00-3","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2022"},"section":"Doctoral Consortium","track":"Doctoral Consortium","number":836,"pages":{"first":5867,"last":5868},"keywords":["Speech & Natural Language Processing (SNLP): General"],"videos":[],"references":[{"position":1,"raw":"[Artetxe et al., 2017] Mikel Artetxe, Gorka Labaka, and Eneko Agirre. Learning bilingual word embeddings with (almost) no bilingual data. In ACL, pages 451-462, 2017.","title":"Learning bilingual word embeddings with (almost) no bilingual data","authors":"Mikel Artetxe, Gorka Labaka, Eneko Agirre","year":"2017","venue":"ACL","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Devlin et al., 2018] Jacob Devlin, Ming-Wei Chang, Ken- ton Lee, and Kristina Toutanova. Bert: Pre-training of deep bidirectional transformers for language understand- ing. arXiv:1810.04805, 2018.","title":"Bert: Pre-training of deep bidirectional transformers for language understanding","authors":"Jacob Devlin, Ming-Wei Chang, Kenton Lee, Kristina Toutanova","year":"2018","venue":null,"doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Dinu et al., 2014] Georgiana Dinu, Angeliki Lazaridou, and Marco Baroni. Improving zero-shot learning by mitigating the hubness problem. arXiv:1412.6568, 2014.","title":"Improving zero-shot learning by mitigating the hubness problem","authors":"Georgiana Dinu, Angeliki Lazaridou, Marco Baroni","year":"2014","venue":null,"doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Kulkarni et al., 2015] Vivek Kulkarni, Rami Al-Rfou, Bryan Perozzi, and Steven Skiena. Statistically significant detection of linguistic change. In WWW '15, pages 625-635, 2015.","title":"Statistically significant detection of linguistic change","authors":"Vivek Kulkarni, Rami Al-Rfou, Bryan Perozzi, Steven Skiena","year":"2015","venue":"WWW '15","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Mikolov et al., 2013] Tomas Mikolov, Quoc V Le, and Ilya Sutskever. Exploiting similarities among languages for machine translation. arXiv, 2013.","title":"and Ilya Sutskever. Exploiting similarities among languages for machine translation","authors":"Mikolov","year":"2013","venue":null,"doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Peirsman and Padó, 2010] Yves Peirsman and Sebastian Padó. Cross-lingual induction of selectional preferences with bilingual vector spaces. In NAACL, pages 921-929, 2010.","title":"Yves Peirsman and Sebastian Padó. Cross-lingual induction of selectional preferences with bilingual vector spaces","authors":"Padó Peirsman","year":"2010","venue":"NAACL","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Pennington et al., 2014] Jeffrey Pennington, Richard Socher, and Christopher D Manning. Glove: Global vectors for word representation. In EMNLP, pages 1532-1543, 2014.","title":"Glove: Global vectors for word representation","authors":"Jeffrey Pennington, Richard Socher, Christopher D Manning","year":"2014","venue":"EMNLP","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Ruder et al., 2019] Sebastian Ruder, Ivan Vulić, and Anders Søgaard. A survey of cross-lingual word embedding mod- els. JAIR, 65:569-631, 2019.","title":"A survey of cross-lingual word embedding models","authors":"Sebastian Ruder, Ivan Vulić, Anders Søgaard","year":"2019","venue":"JAIR","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}