Proceedings

Context-Dependent Conceptualization

Download BibTeX Cite

Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence. Pages 2654-2660.

© 2013 International Joint Conferences on Artificial Intelligence

Abstract

Conceptualization seeks to map a short text (i.e., a word or a phrase) to a set of concepts as a mechanism of understanding text. Most of prior research in conceptualization uses human-crafted knowledge bases that map instances to concepts. Such approaches to conceptualization have the limitation that the mappings are not context sensitive. To overcome this limitation, we propose a framework in which we harness the power of a probabilistic topic model which inherently captures the semantic relations between words. By combining latent Dirichlet allocation, a widely used topic model with Probase, a large-scale probabilistic knowledge base, we develop a corpus-based framework for context-dependent conceptualization. Through this simple but powerful framework, we improve conceptualization and enable a wide range of applications that rely on semantic understanding of short texts, including frame element prediction, word similarity in context, ad-query similarity, and query similarity.

  1. [Baker et al., 1998] C.F. Baker, C.J. Fillmore, and J.B. Lowe. The berkeley framenet project. In Proceedings of the 36th Annual Meeting of the Association for Compu- tational Linguistics and 17th International Conference on Computational Linguistics-Volume 1, pages 86-90. Asso- ciation for Computational Linguistics, 1998.
  2. [Blei et al., 2003] D.M. Blei, A.Y. Ng, and M.I. Jordan. La- tent dirichlet allocation. The Journal of Machine Learning Research, 3:993-1022, 2003.
  3. [Boyd-Graber et al., 2007] J. Boyd-Graber, D. Blei, and X. Zhu. A topic model for word sense disambiguation. In Proceedings of the 2007 Joint Conference on Empiri- cal Methods in Natural Language Processing and Com- putational Natural Language Learning (EMNLP-CoNLL), pages 1024-1033, 2007.
  4. [Cambria et al., 2013] E. Cambria, Y. Song, H. Wang, and N. Howard. Semantic multi-dimensional scaling for open- domain sentiment analysis. IEEE Intelligent Systems, 2013.
  5. [Chemudugunta et al., 2008] C. Chemudugunta, A. Hol- loway, P. Smyth, and M. Steyvers. Modeling documents by combining semantic concepts with unsupervised statis- tical learning. The Semantic Web-ISWC 2008, pages 229- 244, 2008.
  6. [Finkelstein et al., 2001] L. Finkelstein, E. Gabrilovich, Y. Matias, E. Rivlin, Z. Solan, G. Wolfman, and E. Ruppin. Placing search in context: The concept revisited. In Pro- ceedings of the 10th International Conference on World Wide Web, pages 406-414. ACM, 2001.
  7. [Fürstenau and Lapata, 2009] H. Fürstenau and M. Lapata. Semi-supervised semantic role labeling. In Proc. of EACL, 2009.
  8. [Gildea and Jurafsky, 2002] D. Gildea and D. Jurafsky. Au- tomatic labeling of semantic roles. Computational Lin- guistics, 28(3):245-288, 2002.
  9. [Griffiths and Steyvers, 2004] T.L. Griffiths and M. Steyvers. Finding scientific topics. Proceedings of the National Academy of Sciences of the United States of America, 101:5228-5235, 2004.
  10. [Hua et al., 2013] Wen Hua, Yangqiu Song, Haixun Wang, and Xiaofang Zhou. Wen hua, yangqiu song, haixun wang, xiaofang zhou. In WSDM, 2013.
  11. [Huang et al., 2012] Eric H. Huang, Richard Socher, Christopher D. Manning, and Andrew Y. Ng. Improving word representations via global context and multiple word prototypes. In Proceedings of the Association for Computational Linguistics 2012 Conference (ACL '12), Jeju, Republic of Korea, July 2012.
  12. [Joachims, 2002] T. Joachims. Optimizing search engines using clickthrough data. In Proceedings of the eighth ACM SIGKDD International Conference on Knowledge Discov- ery and Data Mining, pages 133-142. ACM, 2002.
  13. [Manning et al., 2008] C.D. Manning, P. Raghavan, and H. Schütze. Introduction to Information Retrieval, vol- ume 1. Cambridge University Press Cambridge, 2008.
  14. [Song et al., 2011] Y. Song, H. Wang, Z. Wang, H. Li, and W. Chen. Short text conceptualization using a probabilis- tic knowledgebase. In Proceedings of the Twenty-Second international joint conference on Artificial Intelligence, pages 2330-2336. AAAI Press, 2011. IJCAI
  15. [Wang et al., 2012] Jingjing Wang, Haixun Wang, Zhongyuan Wang, and Kenny Zhu. Understanding tables on the web. In International Conference on Conceptual Modeling, 2012.
  16. [Wu et al., 2012] W. Wu, H. Li, H. Wang, and K.Q. Zhu. Probase: A probabilistic taxonomy for text understanding. In Proceedings of the 2012 International Conference on Management of Data, pages 481-492. ACM, 2012.
  17. [Yao et al., 2009] Limin Yao, David Mimno, and Andrew McCallum. Efficient methods for topic model inference on streaming document collections. In Proceedings of the 15th ACM SIGKDD international conference on Knowl- edge discovery and data mining, pages 937-946. ACM, 2009.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards