{"type":"ScholarlyArticle","title":"Dynamic Network Embedding : An Extended Approach for Skip-gram based Network Embedding","authors":[{"name":"Lun Du","slug":"lun-du","given":"Lun","family":"Du","affiliation":"Peking University"},{"name":"Yun Wang","slug":"yun-wang","given":"Yun","family":"Wang","affiliation":"Peking University"},{"name":"Guojie Song","slug":"guojie-song","given":"Guojie","family":"Song","affiliation":"Peking University"},{"name":"Zhicong Lu","slug":"zhicong-lu","given":"Zhicong","family":"Lu","affiliation":"Peking University"},{"name":"Junshan Wang","slug":"junshan-wang","given":"Junshan","family":"Wang","affiliation":"Peking University"}],"abstract":"Network embedding, as an approach to learn low-dimensional representations of vertices, has been proved extremely useful in many applications. Lots of state-of-the-art network embedding methods based on Skip-gram framework are efficient and effective. However, these methods mainly focus on the static network embedding and cannot naturally generalize to the dynamic environment. In this paper, we propose a stable dynamic embedding framework with high efficiency. It is an extension for the Skip-gram based network embedding methods, which can keep the optimality of the objective in the Skip-gram based methods in theory. Our model can not only generalize to the new vertex representation, but also update the most affected original vertex representations during the evolvement of the network. Multi-class classification on three real-world networks demonstrates that, our model can update the vertex representations efficiently and achieve the performance of retraining simultaneously. Besides, the visualization experimental result illustrates that, our model is capable of avoiding the embedding space drifting.","doi":"10.24963/ijcai.2018/288","url":"https://ijcai.org/proceedings/2018/288","pdf":"https://ijcai.org/proceedings/2018/0288.pdf","markdown":"https://ijcai.org/proceedings/2018/288.md","bibtex":"https://ijcai.org/proceedings/2018/bibtex/288","volume":{"slug":"2018","title":"Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2018","url":"https://ijcai.org/proceedings/2018/","year":2018,"location":"Stockholm","dates":"13-19 July 2018","editors":"Jérôme Lang","isbn":"978-0-9992411-2-7","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2018"},"section":"Machine Learning","track":"Main track","number":288,"pages":{"first":2086,"last":2092},"keywords":["Machine Learning Applications: Networks","Machine Learning: Unsupervised Learning"],"videos":[],"references":[{"position":1,"raw":"[Belkin and Niyogi, 2001] Mikhail Belkin and Partha Niyogi. Laplacian eigenmaps and spectral techniques for embedding and clustering. pages 585-591, 2001.","title":"Laplacian eigenmaps and spectral techniques for embedding and clustering","authors":"Niyogi Belkin, Mikhail Belkin, Partha Niyogi","year":"2001","venue":null,"doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Cao et al., 2015] Shaosheng Cao, Wei Lu, and Qiongkai Xu. Grarep: Learning graph representations with global structural information. In ACM International on Confer- ence on Information and Knowledge Management, pages 891-900, 2015.","title":"Grarep: Learning graph representations with global structural information","authors":"Cao","year":"2015","venue":"ACM International on Conference on Information and Knowledge Management","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Cao et al., 2016] Shaosheng Cao, Wei Lu, and Qiongkai Xu. Deep neural networks for learning graph represen- tations. In Association for the Advancement of Artificial Intelligence Conference, pages 1145-1152, 2016.","title":"Deep neural networks for learning graph representations","authors":"Cao","year":"2016","venue":"Association for the Advancement of Artificial Intelligence Conference","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Cui et al., 2017] P. Cui, X. Wang, J. Pei, and W. Zhu. A Survey on Network Embedding. ArXiv e-prints, Novem- ber 2017.","title":"A Survey on Network Embedding","authors":"P Cui, X Wang, J Pei, W Zhu","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Grover and Leskovec, 2016] Aditya Grover and Jure Leskovec. node2vec: Scalable feature learning for networks. Knowledge Discovery and Data mining, pages 855-864, 2016.","title":"Aditya Grover and Jure Leskovec. node2vec: Scalable feature learning for networks","authors":"Leskovec Grover","year":"2016","venue":"Knowledge Discovery and Data mining","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Hamilton et al., 2017] Will Hamilton, Zhitao Ying, and Jure Leskovec. Inductive representation learning on large graphs. In Advances in Neural Information Processing Systems, pages 1025-1035, 2017.","title":"Inductive representation learning on large graphs","authors":"Hamilton","year":"2017","venue":"Advances in Neural Information Processing Systems","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[He et al., 2012] Xinran He, Guojie Song, Wei Chen, and Qingye Jiang. Influence blocking maximization in social networks under the competitive linear threshold model. pages 463-474, 2012.","title":"Influence blocking maximization in social networks under the competitive linear threshold model","authors":"He","year":"2012","venue":null,"doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Henderson et al., 2012] Keith Henderson, Brian Gallagher, Tina Eliassi-Rad, Hanghang Tong, Sugato Basu, Leman Akoglu, Danai Koutra, Christos Faloutsos, and Lei Li. Rolx:structural role extraction & mining in large graphs. In ACM Knowledge Discovery and Data Mining, pages 1231-1239, 2012.","title":"Rolx:structural role extraction & mining in large graphs","authors":"Keith Henderson, Brian Gallagher, Tina Eliassi-Rad, Hanghang Tong, Sugato Basu, Leman Akoglu, Danai Koutra, Christos Faloutsos, Lei Li","year":"2012","venue":"ACM Knowledge Discovery and Data Mining","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Kipf and Welling, 2016] Thomas N. Kipf and Max Welling. Semi-supervised classification with graph convolutional networks. CoRR, abs/1609.02907, 2016.","title":"Semi-supervised classification with graph convolutional networks","authors":"Thomas N Kipf, Max Welling","year":"2016","venue":null,"doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Levy and Goldberg, 2014] Omer Levy and Yoav Goldberg. Neural word embedding as implicit matrix factorization. In Advances in neural information processing systems, pages 2177-2185, 2014.","title":"Neural word embedding as implicit matrix factorization","authors":"Goldberg Levy, Omer Levy, Yoav Goldberg","year":"2014","venue":"Advances in neural information processing systems","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Li et al., 2015] Yujia Li, Daniel Tarlow, Marc Brockschmidt, and Richard S. Zemel. Gated graph sequence neural networks. CoRR, abs/1511.05493, 2015.","title":"Gated graph sequence neural networks","authors":"Yujia Li, Daniel Tarlow, Marc Brockschmidt, Richard S Zemel","year":"2015","venue":null,"doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Li et al., 2017] Jundong Li, Harsh Dani, Xia Hu, Jiliang Tang, Yi Chang, and Huan Liu. Attributed network em- bedding for learning in a dynamic environment. CoRR, abs/1706.01860, 2017.","title":"Attributed network embedding for learning in a dynamic environment","authors":"Jundong Li, Harsh Dani, Xia Hu, Jiliang Tang, Yi Chang, Huan Liu","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Ma et al., 2018] Jianxin Ma, Peng Cui, and Wenwu Zhu. Depthlgp: Learning embeddings of out-of-sample nodes in dynamic networks. In Association for the Advancement of Artificial Intelligence Conference, pages 1-9, 2018.","title":"Depthlgp: Learning embeddings of out-of-sample nodes in dynamic networks","authors":"Jianxin Ma, Peng Cui, Wenwu Zhu","year":"2018","venue":"Association for the Advancement of Artificial Intelligence Conference","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Mikolov et al., 2013] Tomas Mikolov, Ilya Sutskever, Kai Chen, Gregory S Corrado, and Jeffrey Dean. Distributed representations of words and phrases and their composi- tionality. Neural Information Processing Systems, pages 3111-3119, 2013.","title":"Distributed representations of words and phrases and their compositionality","authors":"Mikolov","year":"2013","venue":"Neural Information Processing Systems","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Perozzi et al., 2014] Bryan Perozzi, Rami Alrfou, and Steven Skiena. Deepwalk: online learning of social repre- sentations. Knowledge Discovery and Data mining, pages 701-710, 2014.","title":"Deepwalk: online learning of social representations","authors":"Bryan Perozzi, Rami Alrfou, Steven Skiena","year":"2014","venue":"Knowledge Discovery and Data mining","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Ribeiro et al., 2017] Leonardo F.R. Ribeiro, Pedro H.P. Saverese, and Daniel R. Figueiredo. Struc2vec: Learn- ing node representations from structural identity. In ACM Knowledge Discovery and Data Mining, pages 385-394, 2017.","title":"Struc2vec: Learning node representations from structural identity","authors":"F R Leonardo, Ribeiro, H P Pedro, Daniel R Saverese, Figueiredo","year":"2017","venue":"ACM Knowledge Discovery and Data Mining","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Rushing et al., 2005] John Rushing, Udaysankar Nair, Udaysankar Nair, Ron Welch, Ron Welch, and Hong Lin. Adam: a data mining toolkit for scientists and engineers. Computers and Geosciences, 31(5):607-618, 2005.","title":"Adam: a data mining toolkit for scientists and engineers","authors":"John Rushing, Udaysankar Nair, Udaysankar Nair, Ron Welch, Ron Welch, Hong Lin","year":"2005","venue":"Computers and Geosciences","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Song et al., 2015] Guojie Song, Xiabing Zhou, Yu Wang, and Kunqing Xie. Influence maximization on large-scale mobile social network: A divide-and-conquer method. IEEE Transactions on Parallel and Distributed Systems, 26(5):1379-1392, 2015.","title":"Influence maximization on large-scale mobile social network: A divide-and-conquer method","authors":"Song","year":"2015","venue":"IEEE Transactions on Parallel and Distributed Systems","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Tang et al., 2015] Jian Tang, Meng Qu, Mingzhe Wang, Ming Zhang, Jun Yan, and Qiaozhu Mei. Line: Large- scale information network embedding. In International Conference on World Wide Web, pages 1067-1077, 2015.","title":"Line: Largescale information network embedding","authors":"Jian Tang, Meng Qu, Mingzhe Wang, Ming Zhang, Jun Yan, Qiaozhu Mei","year":"2015","venue":"International Conference on World Wide Web","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Traud et al., 2012] Amanda L. Traud, Peter J. Mucha, and Mason A. Porter. Social structure of facebook networks. Social Science Electronic Publishing, 391(16):4165-4180, 2012.","title":"Social structure of facebook networks","authors":"Amanda L Traud, Peter J Mucha, Mason A Porter","year":"2012","venue":"Social Science Electronic Publishing","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Wang et al., 2016] Daixin Wang, Peng Cui, and Wenwu Zhu. Structural deep network embedding. In ACM Knowl- edge Discovery and Data Mining, pages 1225-1234, 2016.","title":"Structural deep network embedding","authors":"Wang","year":"2016","venue":"ACM Knowledge Discovery and Data Mining","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Zachary, 1977] Wayne W Zachary. An information flow model for conflict and fission in small groups. Journal of anthropological research, 33(4):452-473, 1977.","title":"An information flow model for conflict and fission in small groups","authors":"Zachary Wayne","year":"1977","venue":"Journal of anthropological research","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Zhang et al., 2017] Ziwei Zhang, Peng Cui, Jian Pei, Xiao Wang, and Wenwu Zhu. Timers: Error-bounded svd restart on dynamic networks. In Association for the Advancement of Artificial Intelligence Conference, pages 1-8, 2017.","title":"Timers: Error-bounded svd restart on dynamic networks","authors":"Ziwei Zhang, Peng Cui, Jian Pei, Xiao Wang, Wenwu Zhu","year":"2017","venue":"Association for the Advancement of Artificial Intelligence Conference","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Zhou et al., 2018] Lekui Zhou, Yang Yang, Xiang Ren, Fei Wu, and Yueting Zhuang. Dynamic network embedding by modeling triadic closure process. In Association for the Advancement of Artificial Intelligence Conference, 2018.","title":"Dynamic network embedding by modeling triadic closure process","authors":"Lekui Zhou, Yang Yang, Xiang Ren, Fei Wu, Yueting Zhuang","year":"2018","venue":"Association for the Advancement of Artificial Intelligence Conference","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Zhu et al., 2018] Dingyuan Zhu, Peng Cui, Ziwei Zhang, Jian Pei, and Wenwu Zhu. High-order proximity preserved embedding for dynamic networks. IEEE Transactions on Knowledge & Data Engineering, PP(99):1-1, 2018.","title":"High-order proximity preserved embedding for dynamic networks","authors":"Dingyuan Zhu, Peng Cui, Ziwei Zhang, Jian Pei, Wenwu Zhu","year":"2018","venue":"IEEE Transactions on Knowledge & Data Engineering","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}