{"type":"ScholarlyArticle","title":"High-Order Co-Clustering via Strictly Orthogonal and Symmetric L1-Norm Nonnegative Matrix Tri-Factorization","authors":[{"name":"Kai Liu","slug":"kai-liu","given":"Kai","family":"Liu","affiliation":"Department of Computer Science , Colorado School of Mines , Golden , CO 80401 , U.S.A."},{"name":"Hua Wang","slug":"hua-wang","given":"Hua","family":"Wang","affiliation":"Department of Computer Science , Colorado School of Mines , Golden , CO 80401 , U.S.A."}],"abstract":"Different to traditional clustering methods that deal with one single type of data, High-Order Co- Clustering (HOCC) aims to cluster multiple types of data simultaneously by utilizing the inter- or/and intra-type relationships across different data types.  In existing HOCC methods, data points routinely enter the objective functions with squared residual errors. As a result, outlying data samples can dominate the objective functions, which may lead to incorrect clustering results. Moreover, existing methods usually suffer from soft clustering, where the probabilities to different groups can be very close. In this paper, we propose an L1 -norm symmetric nonnegative matrix tri-factorization method to solve the HOCC problem. Due to the orthogonal constraints and the symmetric L1 -norm formulation in our new objective, conventional auxiliary function approach no longer works. Thus we derive the solution algorithm using the alternating direction method of multipliers. Extensive experiments have been conducted on a real world data set, in which promising empirical results, including less time consumption, strictly orthogonal membership matrix, lower local minima etc., have demonstrated the effectiveness of our proposed method.","doi":"10.24963/ijcai.2018/340","url":"https://ijcai.org/proceedings/2018/340","pdf":"https://ijcai.org/proceedings/2018/0340.pdf","markdown":"https://ijcai.org/proceedings/2018/340.md","bibtex":"https://ijcai.org/proceedings/2018/bibtex/340","volume":{"slug":"2018","title":"Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2018","url":"https://ijcai.org/proceedings/2018/","year":2018,"location":"Stockholm","dates":"13-19 July 2018","editors":"Jérôme Lang","isbn":"978-0-9992411-2-7","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2018"},"section":"Machine Learning","track":"Main track","number":340,"pages":{"first":2454,"last":2460},"keywords":["Machine Learning: Clustering","Machine Learning Applications: Applications of Unsupervised Learning","Machine Learning: Unsupervised Learning"],"videos":[],"references":[{"position":1,"raw":"[Bertsekas, 1996] Dimitri P Bertsekas. Constrained opti- mization and Lagrange multiplier methods. Academic press, 1996.","title":"Constrained optimization and Lagrange multiplier methods","authors":"Dimitri P Bertsekas","year":"1996","venue":null,"doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Boyd et al., 2011] Stephen Boyd, Neal Parikh, Eric Chu, Borja Peleato, and Jonathan Eckstein. Distributed opti- mization and statistical learning via the alternating direc- tion method of multipliers. Foundations and Trends R in Machine Learning, 3(1):1-122, 2011.","title":"Distributed optimization and statistical learning via the alternating direction method of multipliers","authors":"Stephen Boyd, Neal Parikh, Eric Chu, Borja Peleato, Jonathan Eckstein","year":"2011","venue":"Foundations and Trends R in Machine Learning","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Cai et al., 2011] Deng Cai, Xiaofei He, Jiawei Han, and Thomas S Huang. Graph regularized nonnegative ma- trix factorization for data representation. IEEE Trans- actions on Pattern Analysis and Machine Intelligence, 33(8):1548-1560, 2011.","title":"Graph regularized nonnegative ma-trix factorization for data representation","authors":"Deng Cai, Xiaofei He, Jiawei Han, Thomas S Huang","year":"2011","venue":"IEEE Transactions on Pattern Analysis and Machine Intelligence","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Ding et al., 2006] Chris Ding, Tao Li, Wei Peng, and Hae- sun Park. Orthogonal nonnegative matrix t-factorizations for clustering. In Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining, pages 126-135. ACM, 2006.","title":"Orthogonal nonnegative matrix t-factorizations for clustering","authors":"Chris Ding, Tao Li, Wei Peng, Haesun Park","year":"2006","venue":"Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[Huang et al., 2014] Jin Huang, Feiping Nie, Heng Huang, and Chris Ding. Robust manifold nonnegative matrix fac- torization. ACM Transactions on Knowledge Discovery from Data (TKDD), 8(3):11, 2014.","title":"Robust manifold nonnegative matrix factorization","authors":"Jin Huang, Feiping Nie, Heng Huang, Chris Ding","year":"2014","venue":"ACM Transactions on Knowledge Discovery from Data (TKDD)","doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Kong et al., 2011] Deguang Kong, Chris Ding, and Heng Huang. Robust nonnegative matrix factorization using l21- norm. In Proceedings of the 20th ACM international con- ference on Information and knowledge management, pages 673-682. ACM, 2011.","title":"Robust nonnegative matrix factorization using l21norm","authors":"Kong","year":"2011","venue":"Proceedings of the 20th ACM international conference on Information and knowledge management","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Lee and Seung, 2001] Daniel D Lee and H Sebastian Se- ung. Algorithms for non-negative matrix factorization. In Advances in neural information processing systems, pages 556-562, 2001.","title":"Algorithms for non-negative matrix factorization","authors":"D Daniel, H Lee, Seung Sebastian","year":"2001","venue":"Advances in neural information processing systems","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Lin, 2007] Chih-Jen Lin. Projected gradient methods for nonnegative matrix factorization. Neural computation, 19(10):2756-2779, 2007.","title":"Projected gradient methods for nonnegative matrix factorization","authors":"Chih-Jen Lin","year":"2007","venue":"Neural computation","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Liu and Wang, 2015] Kai Liu and Hua Wang. Robust multi- relational clustering via l1-norm symmetric nonnegative matrix factorization. In ACL (2), pages 397-401, 2015.","title":"Robust multirelational clustering via l1-norm symmetric nonnegative matrix factorization","authors":"Kai Liu, Hua Wang","year":"2015","venue":"ACL (2)","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Long et al., 2006] Bo Long, Zhongfei Mark Zhang, Xi- aoyun Wu, and Philip S Yu. Spectral clustering for multi- type relational data. In Proceedings of the 23rd interna- tional conference on Machine learning, pages 585-592. ACM, 2006.","title":"Spectral clustering for multitype relational data","authors":"Bo Long, Zhongfei Mark Zhang, Xiaoyun Wu, Philip S Yu","year":"2006","venue":"Proceedings of the 23rd international conference on Machine learning","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Maas et al., 2011] Andrew L Maas, Raymond E Daly, Pe- ter T Pham, Dan Huang, Andrew Y Ng, and Christo- pher Potts. Learning word vectors for sentiment analy- sis. In Proceedings of the 49th annual meeting of the as- sociation for computational linguistics: Human language technologies-volume 1, pages 142-150. Association for Computational Linguistics, 2011.","title":"Learning word vectors for sentiment analysis","authors":"Raymond E Andrew L Maas, Peter T Daly, Dan Pham, Andrew Y Huang, Christopher Ng, Potts","year":"2011","venue":"Proceedings of the 49th annual meeting of the association for computational linguistics: Human language technologies","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Wang et al., 2011a] Hua Wang, Heng Huang, and Chris Ding. Simultaneous clustering of multi-type relational data via symmetric nonnegative matrix tri-factorization. In Proceedings of the 20th ACM International Conference on Information and Knowledge Management (ACM CIKM 2011), pages 279-284. ACM, 2011.","title":"Simultaneous clustering of multi-type relational data via symmetric nonnegative matrix tri-factorization","authors":"Wang","year":"2011","venue":"Proceedings of the 20th ACM International Conference on Information and Knowledge Management (ACM CIKM 2011)","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Wang et al., 2011b] Hua Wang, Feiping Nie, Heng Huang, and Chris Ding. Nonnegative matrix tri-factorization based high-order co-clustering and its fast implementation. In The 11th IEEE International Conference on Data Min- ing series (ICDM 2011), pages 774-783. IEEE, 2011.","title":"Nonnegative matrix tri-factorization based high-order co-clustering and its fast implementation","authors":"Wang","year":"2011","venue":"The 11th IEEE International Conference on Data Mining series (ICDM 2011)","doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Wang et al., 2013] Hua Wang, Feiping Nie, and Heng Huang. Multi-view clustering and feature learning via structured sparsity. In International Conference on Ma- chine Learning (ICML 2013), pages 352-360, 2013.","title":"Multi-view clustering and feature learning via structured sparsity","authors":"Hua Wang, Feiping Nie, Heng Huang","year":"2013","venue":"International Conference on Machine Learning (ICML 2013)","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Xu et al., 2003] Wei Xu, Xin Liu, and Yihong Gong. Doc- ument clustering based on non-negative matrix factoriza- tion. In Proceedings of the 26th annual international ACM SIGIR conference on Research and development in infor- maion retrieval, pages 267-273. ACM, 2003.","title":"Document clustering based on non-negative matrix factorization","authors":"Wei Xu, Xin Liu, Yihong Gong","year":"2003","venue":"Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Yeung and Ruzzo, 2001] Ka Yee Yeung and Walter L Ruzzo. Details of the adjusted rand index and clustering algorithms, supplement to the paper an empirical study on principal component analysis for clustering gene expres- sion data. Bioinformatics, 17(9):763-774, 2001.","title":"Details of the adjusted rand index and clustering algorithms, supplement to the paper an empirical study on principal component analysis for clustering gene expression data","authors":"Ruzzo ; ] Yeung, Yee Ka, Walter L Yeung, Ruzzo","year":"2001","venue":"Bioinformatics","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}