{"type":"ScholarlyArticle","title":"Semi-supervised Learning over Heterogeneous Information Networks by Ensemble of Meta-graph Guided Random Walks","authors":[{"name":"He Jiang","slug":"he-jiang","given":"He","family":"Jiang","affiliation":"Department of CSE , HKUST , Hong Kong ,"},{"name":"Yangqiu Song","slug":"yangqiu-song","given":"Yangqiu","family":"Song","affiliation":"Department of CSE , HKUST , Hong Kong ,"},{"name":"Chenguang Wang","slug":"chenguang-wang","given":"Chenguang","family":"Wang","affiliation":"IBM Research - Almaden , USA,"},{"name":"Ming Zhang","slug":"ming-zhang","given":"Ming","family":"Zhang","affiliation":"School of EECS , Peking University , China,"},{"name":"Yizhou Sun","slug":"yizhou-sun","given":"Yizhou","family":"Sun","affiliation":"Department of CS , UCLA , USA."}],"abstract":"Heterogeneous information networks (HINs) is a general representation of many real world applications. The difference between HIN and traditional homogeneous graphs is that the nodes and edges in HIN are with types. Then in the many applications, we need to consider the types to make the approach more semantically meaningful. For the applications that annotation is expensive, on natural way is to consider semi-supervised learning over HIN. In this paper, we present a semi-supervised learning algorithm constrained by the types of HINs. We first decompose the original HIN into several semantically meaningful sub-graphs based the meta-graphs composed of entity and relation types. Then we perform random walk over the sub-graphs to propagate the labels from labeled data to unlabeled data. After we obtain all the labels propagated by different trials of random walk guided by meta-graphs, we use an ensemble algorithm to vote for the final labeling results. We use two public available datasets, 20-newsgroups and RCV1 datasets to test our algorithm. Experimental results show that our algorithm is better than the traditional semi-supervised learning algorithms for HINs. One particular by-product of this work is that we show that previous random walk approach guided by meta-paths can be non-stationary, which is the major reason we propose a meta-graph guide random walk for semi-supervised learning over HINs.","doi":"10.24963/ijcai.2017/270","url":"https://ijcai.org/proceedings/2017/270","pdf":"https://ijcai.org/proceedings/2017/0270.pdf","markdown":"https://ijcai.org/proceedings/2017/270.md","bibtex":"https://ijcai.org/proceedings/2017/bibtex/270","volume":{"slug":"2017","title":"Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2017","url":"https://ijcai.org/proceedings/2017/","year":2017,"location":"Melbourne, Australia","dates":"19-25 August 2017","editors":"Carles Sierra","isbn":"978-0-9992411-0-3","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2017"},"section":"Machine Learning A-R","track":"Main track","number":270,"pages":{"first":1944,"last":1950},"keywords":["Natural Language Processing: Text Classification","Machine Learning: Semi-Supervised Learning"],"videos":[],"references":[{"position":1,"raw":"[Bangcharoensap et al., 2016] Phiradet Bangcharoensap, Tsuyoshi Murata, Hayato Kobayashi, and Nobuyuki Shimizu. Transductive classification on heterogeneous information networks with edge betweenness-based normalization. In WSDM, pages 437-446, 2016.","title":"Transductive classification on heterogeneous information networks with edge betweenness-based normalization","authors":"Bangcharoensap","year":"2016","venue":"WSDM","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Benson et al., 2016] Austin R. Benson, David F. Gleich, and Lek- Heng Lim. The spacey random walk: a stochastic process for higher-order data. CoRR, abs/1602.02102, 2016.","title":"The spacey random walk: a stochastic process for higher-order data","authors":"Austin R Benson, David F Gleich, Lek-Heng Lim","year":"2016","venue":null,"doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Brand, 2005] Matthew Brand. A random walks perspective on maximizing satisfaction and profit. In SDM, pages 12-19, 2005.","title":"A random walks perspective on maximizing satisfaction and profit","authors":"Matthew Brand","year":"2005","venue":"SDM","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Chapelle et al., 2006] Olivier Chapelle, Bernhard Schölkopf, and Alexander Zien, editors. Semi-Supervised Learning. MIT Press, 2006.","title":"Semi-Supervised Learning","authors":null,"year":"2006","venue":null,"doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Dawid and Skene, 1979] Alexander Philip Dawid and Allan M Skene. Maximum likelihood estimation of observer error-rates using the em algorithm. Applied statistics, pages 20-28, 1979.","title":"Maximum likelihood estimation of observer error-rates using the em algorithm","authors":"Skene Dawid, Alexander Philip, Dawid, Allan M Skene","year":"1979","venue":"Applied statistics","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Denny, 2012] Joshua C. Denny. Chapter 13: Mining electronic health records in the genomics era. PLoS Computational Biology, 8(12), 2012.","title":"Chapter 13: Mining electronic health records in the genomics era","authors":"Joshua C Denny","year":"2012","venue":"PLoS Computational Biology","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Fang et al., 2016] Yuan Fang, Wenqing Lin, Vincent Wenchen Zheng, Min Wu, Kevin Chen-Chuan Chang, and Xiaoli Li. Se- mantic proximity search on graphs with metagraph-based learn- ing. In ICDE, pages 277-288, 2016.","title":"Semantic proximity search on graphs with metagraph-based learning","authors":"Yuan Fang, Wenqing Lin, Vincent Wenchen Zheng, Min Wu, Kevin Chen-Chuan, Chang, Xiaoli Li","year":"2016","venue":"ICDE","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Ham et al., 2004] Jihun Ham, Daniel D. Lee, Sebastian Mika, and Bernhard Schölkopf. A kernel view of the dimensionality reduction of manifolds. In ICML, 2004.","title":"A kernel view of the dimensionality reduction of manifolds","authors":"Jihun Ham, Daniel D Lee, Sebastian Mika, Bernhard Schölkopf","year":"2004","venue":"ICML","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Haveliwala, 2003] Taher H. Haveliwala. Topic-sensitive pagerank: A context-sensitive ranking algorithm for web search. IEEE Trans. Knowl. Data Eng., 15(4):784-796, 2003.","title":"Topic-sensitive pagerank: A context-sensitive ranking algorithm for web search","authors":"H Taher, Haveliwala","year":"2003","venue":"IEEE Trans. Knowl. Data Eng","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[He et al., 2006] Xiaofei He, Deng Cai, and Partha Niyogi. Lapla- cian score for feature selection. In NIPS, pages 507-514. 2006.","title":"Laplacian score for feature selection","authors":"Xiaofei He, Deng Cai, Partha Niyogi","year":"2006","venue":"NIPS","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Huang et al., 2016] Zhipeng Huang, Yudian Zheng, Reynold Cheng, Yizhou Sun, Nikos Mamoulis, and Xiang Li. Meta struc- ture: Computing relevance in large heterogeneous information networks. In SIGKDD, pages 1595-1604, 2016.","title":"Meta structure: Computing relevance in large heterogeneous information networks","authors":"Zhipeng Huang, Yudian Zheng, Reynold Cheng, Yizhou Sun, Nikos Mamoulis, Xiang Li","year":"2016","venue":"SIGKDD","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Ipeirotis et al., 2010] Panagiotis G. Ipeirotis, Foster Provost, and Jing Wang. Quality management on amazon mechanical turk. In KDD Workshop on Human Computation, pages 64-67, 2010.","title":"Quality management on amazon mechanical turk","authors":"G Panagiotis, Foster Ipeirotis, Jing Provost, Wang","year":"2010","venue":"KDD Workshop on Human Computation","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Jeh and Widom, 2003] Glen Jeh and Jennifer Widom. Scaling personalized web search. In WWW, pages 271-279, 2003.","title":"Scaling personalized web search","authors":"Widom Jeh, Glen Jeh, Jennifer Widom","year":"2003","venue":"WWW","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Ji et al., 2010] Ming Ji, Yizhou Sun, Marina Danilevsky, Jiawei Han, and Jing Gao. Graph regularized transductive classification on heterogeneous information networks. In ECML/PKDD, pages 570-586, 2010.","title":"Graph regularized transductive classification on heterogeneous information networks","authors":"Ming Ji, Yizhou Sun, Marina Danilevsky, Jiawei Han, Jing Gao","year":"2010","venue":"ECML/PKDD","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Kleinberg, 1998] Jon M. Kleinberg. Authoritative sources in a hyperlinked environment. In SODA, pages 668-677, 1998.","title":"Authoritative sources in a hyperlinked environment","authors":"Jon M Kleinberg","year":"1998","venue":"SODA","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Kong et al., 2013] Xiangnan Kong, Jiawei Zhang, and Philip S. Yu. Inferring anchor links across multiple heterogeneous social networks. In CIKM, pages 179-188, 2013.","title":"Inferring anchor links across multiple heterogeneous social networks","authors":"Kong","year":"2013","venue":"CIKM","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Lang, 1995] Ken Lang. Newsweeder: Learning to filter netnews. In ICML, pages 331-339, 1995.","title":"Newsweeder: Learning to filter netnews","authors":"Lang ;, Ken Lang","year":"1995","venue":"ICML","doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Lao and Cohen, 2010] Ni Lao and William W. Cohen. Relational retrieval using a combination of path-constrained random walks. Machine Learning, 81(1):53-67, 2010.","title":"Relational retrieval using a combination of path-constrained random walks","authors":"Ni Lao, William W Cohen","year":"2010","venue":"Machine Learning","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Lewis et al., 2004] David D Lewis, Yiming Yang, Tony G Rose, and Fan Li. RCV1: A new benchmark collection for text categorization research. JMLR, 5:361-397, 2004.","title":"RCV1: A new benchmark collection for text categorization research","authors":"Yiming David D Lewis, Tony G Yang, Fan Rose, Li","year":"2004","venue":"JMLR","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Li et al., 2016] Xiang Li, Ben Kao, Yudian Zheng, and Zhipeng Huang. On transductive classification in heterogeneous informa- tion networks. In CIKM, pages 811-820, 2016.","title":"On transductive classification in heterogeneous information networks","authors":"Xiang Li, Ben Kao, Yudian Zheng, Zhipeng Huang","year":"2016","venue":"CIKM","doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[London and Getoor, 2014] Ben London and Lise Getoor. Col- lective classification of network data. In Data Classification: Algorithms and Applications, pages 399-416. 2014.","title":"Collective classification of network data","authors":"Getoor London, Ben London, Lise Getoor","year":"2014","venue":"Data Classification: Algorithms and Applications","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Page et al., 1999] Lawrence Page, Sergey Brin, Rajeev Motwani, and Terry Winograd. The pagerank citation ranking: Bringing order to the web. Technical Report 1999-66, Stanford InfoLab, Nov. 1999.","title":"The pagerank citation ranking: Bringing order to the web","authors":"Lawrence Page, Sergey Brin, Rajeev Motwani, Terry Winograd","year":"1999","venue":null,"doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Sheng et al., 2008] Victor S Sheng, Foster Provost, and Panagio- tis G Ipeirotis. Get another label? improving data quality and data mining using multiple, noisy labelers. In KDD, pages 614- 622, 2008.","title":"Get another label? improving data quality and data mining using multiple, noisy labelers","authors":"Foster Victor S Sheng, Panagiotis G Provost, Ipeirotis","year":"2008","venue":"KDD","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Sun and Han, 2012] Yizhou Sun and Jiawei Han. Mining hetero- geneous information networks: principles and methodologies. Synthesis Lectures on Data Mining and Knowledge Discovery, 3(2):1-159, 2012.","title":"Mining heterogeneous information networks: principles and methodologies","authors":"Han ; Sun, Yizhou Sun, Jiawei Han","year":"2012","venue":"Synthesis Lectures on Data Mining and Knowledge Discovery","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Sun et al., 2011] Yizhou Sun, Jiawei Han, Xifeng Yan, Philip S. Yu, and Tianyi Wu. Pathsim: Meta path-based top-k similarity search in heterogeneous information networks. PVLDB, pages 992-1003, 2011.","title":"Pathsim: Meta path-based top-k similarity search in heterogeneous information networks","authors":"Yizhou Sun, Jiawei Han, Xifeng Yan, Philip S Yu, Tianyi Wu","year":"2011","venue":"PVLDB","doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Sun et al., 2012] Yizhou Sun, Brandon Norick, Jiawei Han, Xifeng Yan, Philip S. Yu, and Xiao Yu. Integrating meta-path selection with user-guided object clustering in heterogeneous information networks. In KDD, pages 1348-1356, 2012.","title":"Integrating meta-path selection with user-guided object clustering in heterogeneous information networks","authors":"Yizhou Sun, Brandon Norick, Jiawei Han, Xifeng Yan, Philip S Yu, Xiao Yu","year":"2012","venue":"KDD","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Wan et al., 2015] Mengting Wan, Yunbo Ouyang, Lance M. Ka- plan, and Jiawei Han. Graph regularized meta-path based trans- ductive regression in heterogeneous information network. In SDM, pages 918-926, 2015.","title":"Graph regularized meta-path based transductive regression in heterogeneous information network","authors":"Wan","year":"2015","venue":"SDM","doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[Wang et al., 2015a] Chenguang Wang, Yangqiu Song, Ahmed El- Kishky, Dan Roth, Ming Zhang, and Jiawei Han. Incorporating world knowledge to document clustering via heterogeneous in- formation networks. In KDD, pages 1215-1224, 2015.","title":"Incorporating world knowledge to document clustering via heterogeneous information networks","authors":"Wang","year":"2015","venue":"KDD","doi":null,"url":null,"internal_url":null},{"position":29,"raw":"[Wang et al., 2015b] Chenguang Wang, Yangqiu Song, Haoran Li, Ming Zhang, and Jiawei Han. Knowsim: A document similarity measure on structured heterogeneous information networks. In ICDM, pages 1015-1020, 2015.","title":"Knowsim: A document similarity measure on structured heterogeneous information networks","authors":"Wang","year":"2015","venue":"ICDM","doi":null,"url":null,"internal_url":null},{"position":30,"raw":"[Wang et al., 2016] Chenguang Wang, Yangqiu Song, Haoran Li, Ming Zhang, and Jiawei Han. Text classification with heteroge- neous information network kernels. In AAAI, pages 2130-2136, 2016.","title":"Text classification with heterogeneous information network kernels","authors":"Chenguang Wang, Yangqiu Song, Haoran Li, Ming Zhang, Jiawei Han","year":"2016","venue":"AAAI","doi":null,"url":null,"internal_url":null},{"position":31,"raw":"[Zhou and Schölkopf, 2004] Dengyong Zhou and Bernhard Schölkopf. Learning from labeled and unlabeled data using random walks. In Pattern Recognition, 26th DAGM Symposium, August 30 -September 1, 2004, Tübingen, Germany, Proceedings, pages 237-244, 2004.","title":"Learning from labeled and unlabeled data using random walks","authors":"Schölkopf Zhou, Dengyong Zhou, Bernhard Schölkopf","year":"2004","venue":"Pattern Recognition, 26th DAGM Symposium","doi":null,"url":null,"internal_url":null},{"position":32,"raw":"[Zhou et al., 2003] Dengyong Zhou, Olivier Bousquet, Thomas Navin Lal, Jason Weston, and Bernhard Schölkopf. Learning with local and global consistency. In NIPS, pages 321-328, 2003.","title":"Learning with local and global consistency","authors":"Dengyong Zhou, Olivier Bousquet, Thomas Navin Lal, Jason Weston, Bernhard Schölkopf","year":"2003","venue":"NIPS","doi":null,"url":null,"internal_url":null},{"position":33,"raw":"[Zhu et al., 2003] Xiaojin Zhu, Zoubin Ghahramani, and John D. Lafferty. Semi-supervised learning using gaussian fields and harmonic functions. In ICML, pages 912-919, 2003.","title":"Semi-supervised learning using gaussian fields and harmonic functions","authors":"Xiaojin Zhu, Zoubin Ghahramani, John D Lafferty","year":"2003","venue":"ICML","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}