Effective Representing of Information Network by Variational Autoencoder

Effective Representing of Information Network by Variational Autoencoder

Hang Li, Haozheng Wang, Zhenglu Yang, Haochen Liu

Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence
Main track. Pages 2103-2109. https://doi.org/10.24963/ijcai.2017/292

Network representation is the basis of many applications and of extensive interest in various fields, such as information retrieval, social network analysis, and recommendation systems. Most previous methods for network representation only consider the incomplete aspects of a problem, including link structure, node information, and partial integration. The present study proposes a deep network representation model that seamlessly integrates the text information and structure of a network. Our model captures highly non-linear relationships between nodes and complex features of a network by exploiting the variational autoencoder (VAE), which is a deep unsupervised generation algorithm. We also merge the representation learned with a paragraph vector model and that learned with the VAE to obtain the network representation that preserves both structure and text information. We conduct comprehensive empirical experiments on benchmark datasets and find our model performs better than state-of-the-art techniques by a large margin.
Keywords:
Machine Learning: Data Mining
Machine Learning: Deep Learning
Machine Learning: Structured Learning
Natural Language Processing: Text Classification