{"type":"ScholarlyArticle","title":"Adversarially Regularized Graph Autoencoder for Graph Embedding","authors":[{"name":"Shirui Pan","slug":"shirui-pan","given":"Shirui","family":"Pan","affiliation":"Centre for Artificial Intelligence , FEIT , University of Technology Sydney , Australia"},{"name":"Ruiqi Hu","slug":"ruiqi-hu","given":"Ruiqi","family":"Hu","affiliation":"Centre for Artificial Intelligence , FEIT , University of Technology Sydney , Australia"},{"name":"Guodong Long","slug":"guodong-long","given":"Guodong","family":"Long","affiliation":"Centre for Artificial Intelligence , FEIT , University of Technology Sydney , Australia"},{"name":"Jing Jiang","slug":"jing-jiang","given":"Jing","family":"Jiang","affiliation":"Centre for Artificial Intelligence , FEIT , University of Technology Sydney , Australia"},{"name":"Lina Yao","slug":"lina-yao","given":"Lina","family":"Yao","affiliation":"School of Computer Science and Engineering , University of New South Wales , Australia"},{"name":"Chengqi Zhang","slug":"chengqi-zhang","given":"Chengqi","family":"Zhang","affiliation":"Centre for Artificial Intelligence , FEIT , University of Technology Sydney , Australia"}],"abstract":"Graph embedding is an effective method to represent graph data in a low dimensional space for graph analytics.  Most existing embedding algorithms typically focus on preserving the topological structure or minimizing the reconstruction errors of graph data,  but they have mostly ignored the data distribution of the latent codes from the graphs, which often results in inferior embedding in  real-world  graph data. In this paper, we propose a novel adversarial graph embedding framework for graph data. The framework encodes the topological structure and node content in a graph to a compact representation, on which a decoder is trained to reconstruct the graph structure. Furthermore, the latent representation is enforced to match a prior distribution via an adversarial training scheme. To learn a robust embedding,  two variants of adversarial approaches,  adversarially regularized graph autoencoder (ARGA) and adversarially regularized variational graph autoencoder (ARVGA), are developed. Experimental studies on real-world graphs validate our design and demonstrate that our algorithms outperform baselines by a wide margin in link prediction,  graph clustering, and graph visualization tasks.","doi":"10.24963/ijcai.2018/362","url":"https://ijcai.org/proceedings/2018/362","pdf":"https://ijcai.org/proceedings/2018/0362.pdf","markdown":"https://ijcai.org/proceedings/2018/362.md","bibtex":"https://ijcai.org/proceedings/2018/bibtex/362","volume":{"slug":"2018","title":"Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2018","url":"https://ijcai.org/proceedings/2018/","year":2018,"location":"Stockholm","dates":"13-19 July 2018","editors":"Jérôme Lang","isbn":"978-0-9992411-2-7","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2018"},"section":"Machine Learning","track":"Main track","number":362,"pages":{"first":2609,"last":2615},"keywords":["Machine Learning Applications: Networks","Machine Learning: Data Mining","Machine Learning: Unsupervised Learning"],"videos":[],"references":[{"position":1,"raw":"[Cai et al., 2017] Hongyun Cai, Vincent W Zheng, and Kevin Chang. A comprehensive survey of graph em- bedding: Problems, techniques and applications. arXiv preprint arXiv:1709.07604, 2017.","title":"A comprehensive survey of graph embedding: Problems, techniques and applications","authors":"Hongyun Cai, Vincent W Zheng, Kevin Chang","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Cao et al., 2016] Shaosheng Cao, Wei Lu, and Qiongkai Xu. Deep neural networks for learning graph represen- tations. In AAAI, pages 1145-1152, 2016.","title":"Deep neural networks for learning graph representations","authors":"Cao","year":"2016","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Chang and Blei, 2009] Jonathan Chang and David Blei. Re- lational topic models for document networks. In Artificial Intelligence and Statistics, pages 81-88, 2009.","title":"Relational topic models for document networks","authors":"Chang, Blei, Jonathan Chang, David Blei","year":"2009","venue":"Artificial Intelligence and Statistics","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Cui et al., 2017] Peng Cui, Xiao Wang, Jian Pei, and Wenwu Zhu. A survey on network embedding. arXiv preprint arXiv:1711.08752, 2017.","title":"A survey on network embedding","authors":"Peng Cui, Xiao Wang, Jian Pei, Wenwu Zhu","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Dai et al., 2017] Quanyu Dai, Qiang Li, Jian Tang, and Dan Wang. Adversarial network embedding. arXiv preprint arXiv:1711.07838, 2017.","title":"Adversarial network embedding","authors":"Quanyu Dai, Qiang Li, Jian Tang, Dan Wang","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Donahue et al., 2016] Jeff Donahue, Philipp Krähenbühl, and Trevor Darrell. Adversarial feature learning. arXiv preprint arXiv:1605.09782, 2016.","title":"Adversarial feature learning","authors":"Jeff Donahue, Philipp Krähenbühl, Trevor Darrell","year":"2016","venue":null,"doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Goodfellow et al., 2014] Ian Goodfellow, Jean Pouget- Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. Gen- erative adversarial nets. In NIPS, pages 2672-2680, 2014.","title":"Generative adversarial nets","authors":"Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, Yoshua Bengio","year":"2014","venue":"NIPS","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Grover and Leskovec, 2016] Aditya Grover and Jure Leskovec. node2vec: Scalable feature learning for networks. In SIGKDD, pages 855-864. ACM, 2016.","title":"Aditya Grover and Jure Leskovec. node2vec: Scalable feature learning for networks","authors":"Leskovec Grover","year":"2016","venue":"SIGKDD","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Kipf and Welling, 2016] Thomas N Kipf and Max Welling. Variational graph auto-encoders. NIPS, 2016.","title":"Variational graph auto-encoders","authors":"N Thomas, Max Kipf, Welling","year":"2016","venue":"NIPS","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Kipf and Welling, 2017] Thomas N Kipf and Max Welling. Semi-supervised classification with graph convolutional networks. In ICLR, pages 1-14, 2017.","title":"Semi-supervised classification with graph convolutional networks","authors":"N Thomas, Max Kipf, Welling","year":"2017","venue":"ICLR","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Makhzani et al., 2015] Alireza Makhzani, Jonathon Shlens, Navdeep Jaitly, Ian Goodfellow, and Brendan Frey. Ad- versarial autoencoders. arXiv:1511.05644, 2015.","title":"Adversarial autoencoders","authors":"Alireza Makhzani, Jonathon Shlens, Navdeep Jaitly, Ian Goodfellow, Brendan Frey","year":"2015","venue":null,"doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Ou et al., 2016] Mingdong Ou, Peng Cui, Jian Pei, Ziwei Zhang, and Wenwu Zhu. Asymmetric transitivity preserv- ing graph embedding. In KDD, pages 1105-1114, 2016.","title":"Asymmetric transitivity preserving graph embedding","authors":"Mingdong Ou, Peng Cui, Jian Pei, Ziwei Zhang, Wenwu Zhu","year":"2016","venue":"KDD","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Pan et al., 2016a] Shirui Pan, Jia Wu, Xingquan Zhu, Chengqi Zhang, and Yu S Philip. Joint structure feature exploration and regularization for multi-task graph classi- fication. TKDE, 28(3):715-728, 2016.","title":"Joint structure feature exploration and regularization for multi-task graph classification","authors":"Pan","year":"2016","venue":"TKDE","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Pan et al., 2016b] Shirui Pan, Jia Wu, Xingquan Zhu, Chengqi Zhang, and Yang Wang. Tri-party deep network representation. In IJCAI, pages 1895-1901, 2016.","title":"Tri-party deep network representation","authors":"Pan","year":"2016","venue":"IJCAI","doi":null,"url":null,"internal_url":"/proceedings/2016/271"},{"position":15,"raw":"[Perozzi et al., 2014] Bryan Perozzi, Rami Al-Rfou, and Steven Skiena. Deepwalk: Online learning of social rep- resentations. In SIGKDD, pages 701-710. ACM, 2014.","title":"Deepwalk: Online learning of social representations","authors":"Bryan Perozzi, Rami Al-Rfou, Steven Skiena","year":"2014","venue":"SIGKDD","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Qiu et al., 2017] Jiezhong Qiu, Yuxiao Dong, Hao Ma, Jian Li, Kuansan Wang, and Jie Tang. Network embedding as matrix factorization: Unifying deepwalk, line, pte, and node2vec. arXiv preprint arXiv:1710.02971, 2017.","title":"Network embedding as matrix factorization: Unifying deepwalk","authors":"Qiu","year":"2017","venue":"line, pte, and node2vec","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Radford et al., 2015] Alec Radford, Luke Metz, and Soumith Chintala. Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv preprint arXiv:1511.06434, 2015.","title":"Unsupervised representation learning with deep convolutional generative adversarial networks","authors":"Radford","year":"2015","venue":null,"doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Tang and Liu, 2011] Lei Tang and Huan Liu. Leverag- ing social media networks for classification. DMKD, 23(3):447-478, 2011.","title":"Leveraging social media networks for classification","authors":"Liu ; ] Lei Tang, Huan Tang, Liu","year":"2011","venue":"DMKD","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Tang et al., 2015] Jian Tang, Meng Qu, Mingzhe Wang, Ming Zhang, Jun Yan, and Qiaozhu Mei. LINE: large- scale information network embedding. In WWW, pages 1067-1077, 2015.","title":"LINE: largescale information network embedding","authors":"Jian Tang, Meng Qu, Mingzhe Wang, Ming Zhang, Jun Yan, Qiaozhu Mei","year":"2015","venue":"WWW","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Tian et al., 2014] Fei Tian, Bin Gao, Qing Cui, Enhong Chen, and Tie-Yan Liu. Learning deep representations for graph clustering. In AAAI, pages 1293-1299, 2014.","title":"Learning deep representations for graph clustering","authors":"Bin Fei Tian, Qing Gao, Enhong Cui, Tie-Yan Chen, Liu","year":"2014","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Van Der Maaten, 2014] Laurens Van Der Maaten. Ac- celerating t-sne using tree-based algorithms. JMLR, 15(1):3221-3245, 2014.","title":"Accelerating t-sne using tree-based algorithms","authors":"Laurens Van Der Maaten, Van Der Maaten","year":"2014","venue":"JMLR","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Wang et al., 2016] Daixin Wang, Peng Cui, and Wenwu Zhu. Structural deep network embedding. In SIGKDD, pages 1225-1234. ACM, 2016.","title":"Structural deep network embedding","authors":"Wang","year":"2016","venue":"SIGKDD","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Wang et al., 2017a] Chun Wang, Shirui Pan, Guodong Long, Xingquan Zhu, and Jing Jiang. Mgae: Marginalized graph autoencoder for graph clustering. In CIKM, pages 889-898. ACM, 2017.","title":"Mgae: Marginalized graph autoencoder for graph clustering","authors":"Wang","year":"2017","venue":"CIKM","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Wang et al., 2017b] Xiao Wang, Peng Cui, Jing Wang, Jian Pei, Wenwu Zhu, and Shiqiang Yang. Community preserv- ing network embedding. In AAAI, pages 203-209, 2017.","title":"Community preserving network embedding","authors":"Wang","year":"2017","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Wang et al., 2017c] Zhitao Wang, Chengyao Chen, and Wenjie Li. Predictive network representation learning for link prediction. In SIGIR, pages 969-972. ACM, 2017.","title":"Predictive network representation learning for link prediction","authors":"Wang","year":"2017","venue":"SIGIR","doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Xia et al., 2014] Rongkai Xia, Yan Pan, Lei Du, and Jian Yin. Robust multi-view spectral clustering via low-rank and sparse decomposition. In AAAI, pages 2149-2155, 2014.","title":"Robust multi-view spectral clustering via low-rank and sparse decomposition","authors":"Xia","year":"2014","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Yang et al., 2015] Cheng Yang, Zhiyuan Liu, Deli Zhao, Maosong Sun, and Edward Y Chang. Network represen- tation learning with rich text information. In IJCAI, pages 2111-2117, 2015.","title":"Network representation learning with rich text information","authors":"Cheng Yang, Zhiyuan Liu, Deli Zhao, Maosong Sun, Edward Y Chang","year":"2015","venue":"IJCAI","doi":null,"url":null,"internal_url":"/proceedings/2015/299"},{"position":28,"raw":"[Zhang et al., 2017a] Daokun Zhang, Jie Yin, Xingquan Zhu, and Chengqi Zhang. Network representation learn- ing: A survey. arXiv preprint arXiv:1801.05852, 2017.","title":"Network representation learning: A survey","authors":"Zhang","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":29,"raw":"[Zhang et al., 2017b] Daokun Zhang, Jie Yin, Xingquan Zhu, and Chengqi Zhang. User profile preserving social network embedding. In IJCAI, pages 3378-3384, 2017.","title":"User profile preserving social network embedding","authors":"Zhang","year":"2017","venue":"IJCAI","doi":null,"url":null,"internal_url":"/proceedings/2017/472"}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}