Proceedings

Concept Labeling: Building Text Classifiers with Minimal Supervision

Download BibTeX Cite

Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence. Pages 1225-1229.

https://doi.org/10.5591/978-1-57735-516-8/IJCAI11-208

© 2011 International Joint Conferences on Artificial Intelligence

Abstract

The rapid construction of supervised text classification models is becoming a pervasive need across many modern applications. To reduce human-labeling bottlenecks, many new statistical paradigms (e.g., active, semi-supervised, transfer and multi-task learning) have been vigorously pursued in recent literature with varying degrees of empirical success. Concurrently, the emergence of Web 2.0 platforms in the last decade has enabled a world-wide, collaborative human effort to construct a massive ontology of concepts with very rich, detailed and accurate descriptions. In this paper we propose a new framework to extract supervisory information from such ontologies and complement it with a shift in human effort from direct labeling of examples in the domain of interest to the much more efficient identification of concept-class associations. Through empirical studies on text categorization problems using the Wikipedia ontology, we show that this shift allows very high-quality models to be immediately induced at virtually no cost.

  1. [Attenberg and Provost, 2010] J. Attenberg and F. Provost. Why label when you can search?: alternatives to active learning for applying human resources to build classifi- cation models under extreme class imbalance. In KDD, 2010.
  2. [Banerjee, 2007] S. Banerjee. Boosting inductive transfer for text classification using Wikipedia. ICMLA, 2007.
  3. [Belkin et al., 2004] M. Belkin, I. Matveeva, and P. Niyogi. Regularization and semi-supervised learning on large graphs. In COLT, 2004.
  4. [Bickel et al., 2009] S. Bickel, M. Brückner, and T. Schef- fer. Discriminative learning under covariate shift. JMLR, 10:2137-2155, December 2009.
  5. [Blitzer et al., 2007] J. Blitzer, M. Dredze, and F. Pereira. Biographies, bollywood, boom-boxes and blenders: Do- main adaptation for sentiment classification. In ACL, 2007.
  6. [Chapelle et al., 2005] O. Chapelle, B. Schoelkopf, and A. Zien. Semi-supervised Learning. MIT Press, Cam- bridge, Massachusetts, 2005.
  7. [Druck et al., 2008] G. Druck, G. Mann, and A. McCallum. Learning from labeled features using generalized expecta- tion criteria. In SIGIR, 2008.
  8. [Ferragina and Scaiella, 2010] P. Ferragina and U. Scaiella. Tagme: on-the-fly annotation of short text fragments (by Wikipedia entities). In CIKM, 2010.
  9. [Gabrilovich and Markovitch, 2006] E. Gabrilovich and S. Markovitch. Overcoming the brittleness bottleneck using Wikipedia: enhancing text categorization with encyclopedic knowledge. In AAAI, 2006.
  10. [Gupta and Ratinovf, 2008] R. Gupta and L. Ratinovf. Text categorization with knowledge transfer from heteroge- neous data sources. In AAAI, 2008.
  11. [Janik and Kochut, 2008] M. Janik and K. J. Kochut. Wikipedia in action: Ontological knowledge in text cat- egorization. Intl. Conf. on Semantic Computing, 2008.
  12. [Joachims, 1999] T. Joachims. Transductive inference for text classification using support vector machines. In ICML, June 1999.
  13. [Melville et al., 2009] P. Melville, V. Sindhwani, and R. Lawrence. Social media analytics: Channeling the power of the blogosphere for marketing insight. In Proc. of the Workshop on Information in Networks, 2009.
  14. [Scott and Matwin, 1998] S. Scott and S. Matwin. Text clas- sification using wordnet hypernyms. In Workshop on usage of WordNet in NLP Systems (COLING-ACL '98), pages 45-51, August 1998.
  15. [Settles, 2009] B. Settles. Active learning literature survey. Computer Sciences Technical Report 1648, University of Wisconsin-Madison, 2009.
  16. [Wang and Domeniconi, 2008] P. Wang and C. Domeniconi. Building semantic kernels for text classification using Wikipedia. KDD, pages 713-721, 2008.
  17. [Zhou et al., 2005] D. Zhou, J. Huang, and B. Schoelkopf. Learning from labeled and unlabeled data on a directed graph. In ICML, 2005.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards