Cross-Lingual Dataless Classification for Many Languages
Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence. Pages 2901-2906.
Abstract
Dataless text classification [Chang et al., 2008] is a classification paradigm which maps documents into a given label space without requiring any annotated training data. This paper explores a cross-lingual variant of this paradigm, where documents in multiple languages are classified into an English label space. We use CLESA (cross-lingual explicit semantic analysis) to embed both foreign language documents and an English label space into a shared semantic space, and select the best label(s) for a document using the similarity between the corresponding semantic representations. We illustrate our approach by experimenting with classifying documents in 88 different languages into the same English label space. In particular, we show that CLESA is better than using a monolingual ESA on the target foreign language and translating the English labels into that language. Moreover, the evaluation on two benchmarks, TED and RCV2, showed that cross-lingual dataless classification outperforms supervised learning methods when a large collection of annotated documents is not available.
@inproceedings{ijcai2016p412,
title = {Cross-Lingual Dataless Classification for Many Languages},
author = {Song, Yangqiu and Upadhyay, Shyam and Peng, Haoruo and Roth, Dan},
booktitle = {Proceedings of the Twenty-Fifth International Joint Conference on
Artificial Intelligence, {IJCAI-16}},
publisher = {AAAI Press / International Joint Conferences on Artificial Intelligence},
editor = {Subbarao Kambhampati},
pages = {2901--2906},
year = {2016},
month = {7},
url = {https://ijcai.org/proceedings/2016/412},
}
TY - CPAPER TI - Cross-Lingual Dataless Classification for Many Languages AU - Song, Yangqiu AU - Upadhyay, Shyam AU - Peng, Haoruo AU - Roth, Dan T2 - Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, IJCAI-16 PB - AAAI Press / International Joint Conferences on Artificial Intelligence PY - 2016 SP - 2901 EP - 2906 UR - https://ijcai.org/proceedings/2016/412 ER -Copied
Machine-readable versions of this paper, for tools and AI agents: