{"type":"ScholarlyArticle","title":"Lightweight Random Indexing for Polylingual Text Classification (Extended Abstract)","authors":[{"name":"Alejandro Moreo Fernández","slug":"alejandro-moreo-fernandez","given":"Alejandro Moreo","family":"Fernández","affiliation":"Istituto di Scienza e Tecnologie dell'Informazione , Consiglio Nazionale delle Ricerche"},{"name":"Andrea Esuli","slug":"andrea-esuli","given":"Andrea","family":"Esuli","affiliation":"Istituto di Scienza e Tecnologie dell'Informazione , Consiglio Nazionale delle Ricerche"},{"name":"Fabrizio Sebastiani","slug":"fabrizio-sebastiani","given":"Fabrizio","family":"Sebastiani","affiliation":"Istituto di Scienza e Tecnologie dell'Informazione , Consiglio Nazionale delle Ricerche"}],"abstract":"Polylingual Text Classification (PLC) is a supervised learning task that consists of assigning class labels to documents written in different languages, assuming that a representative set of training documents is available for each language. This scenario is more and more frequent, given the large quantity of multilingual platforms and communities emerging on the Internet. In this work we analyse some important methods proposed in the literature that are machine-translation-free and dictionary-free, and we propose a particular configuration of the Random Indexing method (that we dub Lightweight Random Indexing). We show that it outperforms all compared algorithms and also displays a significantly reduced computational cost.","doi":"10.24963/ijcai.2018/801","url":"https://ijcai.org/proceedings/2018/801","pdf":"https://ijcai.org/proceedings/2018/0801.pdf","markdown":"https://ijcai.org/proceedings/2018/801.md","bibtex":"https://ijcai.org/proceedings/2018/bibtex/801","volume":{"slug":"2018","title":"Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2018","url":"https://ijcai.org/proceedings/2018/","year":2018,"location":"Stockholm","dates":"13-19 July 2018","editors":"Jérôme Lang","isbn":"978-0-9992411-2-7","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2018"},"section":"Journal track","track":"Journal track","number":801,"pages":{"first":5642,"last":5646},"keywords":["Machine Learning: Multi-instance;Multi-label;Multi-view learning","Natural Language Processing: Text Classification"],"videos":[],"references":[{"position":1,"raw":"[Achlioptas, 2001] Dimitris Achlioptas. Database-friendly random projections. In Proceedings of the 20th ACM Sym- posium on Principles of Database Systems (PODS 2001), pages 274-281, Santa Barbara, US, 2001.","title":"Database-friendly random projections","authors":"Dimitris Achlioptas","year":"2001","venue":"Proceedings of the 20th ACM Symposium on Principles of Database Systems (PODS 2001)","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Amini et al., 2009] Massih-Reza Amini, Nicolas Usunier, and Cyril Goutte. Learning from multiple partially ob- served views; An application to multilingual text catego- rization. In Proceedings of the 23rd Annual Conference on Neural Information Processing Systems (NIPS 2009), pages 28-36, Vancouver, CA, 2009.","title":"Learning from multiple partially observed views; An application to multilingual text categorization","authors":"Massih-Reza Amini, Nicolas Usunier, Cyril Goutte","year":"2009","venue":"Proceedings of the 23rd Annual Conference on Neural Information Processing Systems (NIPS 2009)","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Bel et al., 2003] Nuria Bel, Cornelis H. Koster, and Marta Villegas. Cross-lingual text categorization. In Proceed- ings of the 7th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2003), pages 126-139, Trondheim, NO, 2003.","title":"Cross-lingual text categorization","authors":"Nuria Bel, H Cornelis, Marta Koster, Villegas","year":"2003","venue":"Proceedings of the 7th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2003)","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Deerwester et al., 1990] Scott C. Deerwester, Susan T Du- mais, Thomas K. Landauer, George W. Furnas, and Richard A. Harshman. Indexing by latent semantic analy- sis. Journal of the American Society for Information Sci- ence, 41(6):391-407, 1990.","title":"Indexing by latent semantic analysis","authors":"C Scott, Susan T Deerwester, Thomas K Dumais, George W Landauer, Richard A Furnas, Harshman","year":"1990","venue":"Journal of the American Society for Information Science","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Dumais et al., 1997] Susan T. Dumais, Todd A. Letsche, Michael L. Littman, and Thomas K. Landauer. Automatic cross-language retrieval using latent semantic indexing. In Working Notes of the AAAI Spring Symposium on Cross- language Text and Speech Retrieval, pages 18-24, Stan- ford, US, 1997.","title":"Automatic cross-language retrieval using latent semantic indexing","authors":"Susan T Dumais, Todd A Letsche, Michael L Littman, Thomas K Landauer","year":"1997","venue":"Working Notes of the AAAI Spring Symposium on Crosslanguage Text and Speech Retrieval","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Esuli et al., 2017] Andrea Esuli, Tiziano Fagni, and Alejan- dro Moreo Fernández. Jatecs an open-source java text categorization system. arXiv preprint arXiv:1706.06802, 2017.","title":"Jatecs an open-source java text categorization system","authors":"Andrea Esuli, Tiziano Fagni, Alejandro Moreo Fernández","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Fradkin and Madigan, 2003] Dmitriy Fradkin and David Madigan. Experiments with random projections for ma- chine learning. In Proceedings of the 9th ACM Interna- tional Conference on Knowledge Discovery and Data Min- ing (KDD 2003), pages 517-522, Washington, US, 2003.","title":"Experiments with random projections for machine learning","authors":"Dmitriy Fradkin, David Madigan","year":"2003","venue":"Proceedings of the 9th ACM International Conference on Knowledge Discovery and Data Mining (KDD 2003)","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[García Adeva et al., 2005] Juan José García Adeva, Rafael A. Calvo, and Diego López de Ipińa. Multilingual approaches to text categorisation. European Journal for the Informatics Professional, 5(3):43-51, 2005.","title":"Juan José García Adeva, Rafael A. Calvo, and Diego López de Ipińa. Multilingual approaches to text categorisation","authors":"García Adeva","year":"2005","venue":"European Journal for the Informatics Professional","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Gliozzo and Strapparava, 2005] Alfio Gliozzo and Carlo Strapparava. Cross-language text categorization by acquir- ing multilingual domain models from comparable corpora. In Proceedings of the ACL Workshop on Building and Us- ing Parallel Texts, pages 9-16, Ann Arbor, US, 2005.","title":"Alfio Gliozzo and Carlo Strapparava. Cross-language text categorization by acquiring multilingual domain models from comparable corpora","authors":"Strapparava Gliozzo","year":"2005","venue":"Proceedings of the ACL Workshop on Building and Using Parallel Texts","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Johnson et al., 1986] William B. Johnson, Joram Linden- strauss, and Gideon Schechtman. Extensions of Lipschitz maps into Banach spaces. Israel Journal of Mathematics, 54(2):129-138, 1986.","title":"Extensions of Lipschitz maps into Banach spaces","authors":"William B Johnson, Joram Lindenstrauss, Gideon Schechtman","year":"1986","venue":"Israel Journal of Mathematics","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Kanerva et al., 2000] Pentti Kanerva, Jan Kristofersson, and Anders Holst. Random indexing of text samples for latent semantic analysis. In Proceedings of the 22nd An- nual Conference of the Cognitive Science Society, pages 1036-1037, Philadelphia, US, 2000.","title":"Random indexing of text samples for latent semantic analysis","authors":"Kanerva","year":"2000","venue":"Proceedings of the 22nd Annual Conference of the Cognitive Science Society","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Moreo Fernández et al., 2016] Alejandro Moreo Fernández, Andrea Esuli, and Fabrizio Se- bastiani. Lightweight random indexing for polylingual text classification. Journal of Artificial Intelligence Research, 57:151-185, 2016.","title":"Lightweight random indexing for polylingual text classification","authors":"Moreo Fernández","year":"2016","venue":"Journal of Artificial Intelligence Research","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Nastase and Strapparava, 2013] Vivi Nastase and Carlo Strapparava. Bridging languages through etymology: The case of cross-language text categorization. In Proceedings of the 51st Annual Meeting of the Association for Com- putational Linguistics (ACL 2013), pages 651-659, Sofia, BL, 2013.","title":"Vivi Nastase and Carlo Strapparava. Bridging languages through etymology: The case of cross-language text categorization","authors":"Strapparava Nastase","year":"2013","venue":"Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics (ACL 2013)","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Papadimitriou et al., 1998] Christos H. Papadimitriou, Hisao Tamaki, Prabhakar Raghavan, and Santosh Vem- pala. Latent semantic indexing: A probabilistic analysis. In Proceedings of the 17th ACM Symposium on Principles of Database Systems (PODS 1998), pages 159-168, Seattle, US, 1998.","title":"Latent semantic indexing: A probabilistic analysis","authors":"Christos H Papadimitriou, Hisao Tamaki, Prabhakar Raghavan, Santosh Vempala","year":"1998","venue":"Proceedings of the 17th ACM Symposium on Principles of Database Systems (PODS 1998)","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Sahlgren and Cöster, 2004] Magnus Sahlgren and Rickard Cöster. Using bag-of-concepts to improve the performance of support vector machines in text categorization. In Pro- ceedings of the 20th International Conference on Compu- tational Linguistics (COLING 2004), Geneva, CH, 2004.","title":"Using bag-of-concepts to improve the performance of support vector machines in text categorization","authors":"Cöster Sahlgren, Magnus Sahlgren, Rickard Cöster","year":"2004","venue":"Proceedings of the 20th International Conference on Computational Linguistics (COLING 2004)","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Sahlgren and Karlgren, 2005] Magnus Sahlgren and Jussi Karlgren. Automatic bilingual lexicon acquisition using random indexing of parallel corpora. Natural Language Engineering, 11(3):327-341, 2005.","title":"Automatic bilingual lexicon acquisition using random indexing of parallel corpora","authors":"Karlgren Sahlgren, Magnus Sahlgren, Jussi Karlgren","year":"2005","venue":"Natural Language Engineering","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Sahlgren, 2001] Magnus Sahlgren. Vector-based semantic analysis: Representing word meanings based on random labels. In Proceedings of the ESSLLI Workshop on Seman- tic Knowledge Acquistion and Categorization, Helsinki, FI, 2001.","title":"Vector-based semantic analysis: Representing word meanings based on random labels","authors":"Magnus Sahlgren, Sahlgren","year":"2001","venue":"Proceedings of the ESSLLI Workshop on Semantic Knowledge Acquistion and Categorization","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Sahlgren, 2005] Magnus Sahlgren. An introduction to ran- dom indexing. In Proceedings of the Workshop on Meth- ods and Applications of Semantic Indexing, Copenhagen, DK, 2005.","title":"An introduction to random indexing","authors":"Magnus Sahlgren, Sahlgren","year":"2005","venue":"Proceedings of the Workshop on Methods and Applications of Semantic Indexing","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Vinokourov et al., 2002] Alexei Vinokourov, John Shawe- Taylor, and Nello Cristianini. Inferring a semantic repre- sentation of text via cross-language correlation analysis. In Proceedings of the 16th Annual Conference on Neural In- formation Processing Systems (NIPS 2002), pages 1473- 1480, Vancouver, CA, 2002.","title":"Inferring a semantic representation of text via cross-language correlation analysis","authors":"Alexei Vinokourov, John Shawe-Taylor, Nello Cristianini","year":"2002","venue":"Proceedings of the 16th Annual Conference on Neural Information Processing Systems (NIPS 2002)","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Wei et al., 2011] Chih-Ping Wei, Yen-Ting Lin, and Christopher C. Yang. Cross-lingual text categorization: Conquering language boundaries in globalized envi- ronments. Information Processing and Management, 47(5):786-804, 2011.","title":"Cross-lingual text categorization: Conquering language boundaries in globalized environments","authors":"Chih-Ping Wei, Yen-Ting Lin, Christopher C Yang","year":"2011","venue":"Information Processing and Management","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Wei et al., 2014] Chih-Ping Wei, Chin-Sheng Yang, Ching- Hsien Lee, Huihua Shi, and Christopher C. Yang. Exploit- ing poly-lingual documents for improving text categoriza- tion effectiveness. Decision Support Systems, 57:64-76, 2014.","title":"Exploiting poly-lingual documents for improving text categorization effectiveness","authors":"Chih-Ping Wei, Chin-Sheng Yang, Ching-Hsien Lee, Huihua Shi, Christopher C Yang","year":"2014","venue":"Decision Support Systems","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Xiao and Guo, 2013] Min Xiao and Yuhong Guo. A novel two-step method for cross-language representation learn- ing. In Proceedings of the 27th Annual Conference on Neural Information Processing Systems (NIPS 2013), pages 1259-1267, Lake Tahoe, US, 2013.","title":"A novel two-step method for cross-language representation learning","authors":"Xiao, Guo ; ] Min, Xiao, Yuhong Guo","year":"2013","venue":"Proceedings of the 27th Annual Conference on Neural Information Processing Systems (NIPS 2013)","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}