{"type":"ScholarlyArticle","title":"Lifelong Multi-view Spectral Clustering","authors":[{"name":"Hecheng Cai","slug":"hecheng-cai","given":"Hecheng","family":"Cai","affiliation":"College of Computer Science , Sichuan University , Chengdu , China"},{"name":"Yuze Tan","slug":"yuze-tan","given":"Yuze","family":"Tan","affiliation":"College of Computer Science , Sichuan University , Chengdu , China"},{"name":"Shudong Huang","slug":"shudong-huang","given":"Shudong","family":"Huang","affiliation":"College of Computer Science , Sichuan University , Chengdu , China"},{"name":"Jiancheng Lv","slug":"jiancheng-lv","given":"Jiancheng","family":"Lv","affiliation":"College of Computer Science , Sichuan University , Chengdu , China"}],"abstract":"In recent years, spectral clustering has become a well-known and effective algorithm in machine learning. However, traditional spectral clustering algorithms are designed for single-view data and fixed task setting. This can become a limitation when dealing with new tasks in a sequence, as it requires accessing previously learned tasks. Hence it leads to high storage consumption, especially for multi-view datasets. In this paper, we address this limitation by introducing a lifelong multi-view clustering framework. Our approach uses view-specific knowledge libraries to capture intra-view knowledge across different tasks. Specifically, we propose two types of libraries: an orthogonal basis library that stores cluster centers in consecutive tasks, and a feature embedding library that embeds feature relations shared among correlated tasks. When a new clustering task is coming, the knowledge is iteratively transferred from libraries to encode the new task, and knowledge libraries are updated according to the online update formulation. Meanwhile, basis libraries of different views are further fused into a consensus library with adaptive weights. Experimental results show that our proposed method outperforms other competitive clustering methods on multi-view datasets by a large margin.","doi":"10.24963/ijcai.2023/388","url":"https://ijcai.org/proceedings/2023/388","pdf":"https://ijcai.org/proceedings/2023/0388.pdf","markdown":"https://ijcai.org/proceedings/2023/388.md","bibtex":"https://ijcai.org/proceedings/2023/bibtex/388","volume":{"slug":"2023","title":"Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence","short_title":"IJCAI 2023","url":"https://ijcai.org/proceedings/2023/","year":2023,"location":"Macao, SAR","dates":"19-25 August 2023","editors":"Edith Elkind","isbn":"978-1-956792-03-4","publisher":"International Joint Conferences on Artificial Intelligence Organization","doi_prefix":"10.24963/ijcai.2023"},"section":"Machine Learning","track":"Main Track","number":388,"pages":{"first":3488,"last":3496},"keywords":["Machine Learning: ML: Clustering","Machine Learning: ML: Multi-view learning"],"videos":[],"references":[{"position":1,"raw":"[Ammar et al., 2015] Haitham Bou Ammar, Rasul Tutunov, and Eric Eaton. Safe policy search for lifelong reinforce- ment learning with sublinear regret. In International Con- ference on Machine Learning, pages 2361-2369. PMLR, 2015.","title":"Safe policy search for lifelong reinforcement learning with sublinear regret","authors":"Haitham Bou Ammar, Rasul Tutunov, Eric Eaton","year":"2015","venue":"International Conference on Machine Learning","doi":null,"url":null,"internal_url":null},{"position":2,"raw":"[Argyriou et al., 2008] Andreas Argyriou, Theodoros Evge- niou, and Massimiliano Pontil. Convex multi-task feature learning. Machine Learning, 73(3):243-272, 2008.","title":"Convex multi-task feature learning","authors":"Andreas Argyriou, Theodoros Evgeniou, Massimiliano Pontil","year":"2008","venue":"Machine Learning","doi":null,"url":null,"internal_url":null},{"position":3,"raw":"[Cao et al., 2015] Xiaochun Cao, Changqing Zhang, Huazhu Fu, Si Liu, and Hua Zhang. Diversity-induced multi-view subspace clustering. In Proceedings of the IEEE Confer- ence on Computer Vision and Pattern recognition, pages 586-594, 2015.","title":"Diversity-induced multi-view subspace clustering","authors":"Xiaochun Cao, Changqing Zhang, Huazhu Fu, Si Liu, Hua Zhang","year":"2015","venue":"Proceedings of the IEEE Conference on Computer Vision and Pattern recognition","doi":null,"url":null,"internal_url":null},{"position":4,"raw":"[Chahhou et al., 2014] Mohamed Chahhou, Lahcen Moumoun, Mohamed El Far, and Taoufiq Gadi. Seg- mentation of 3d meshes usingp-spectral clustering. IEEE Transactions on Pattern Analysis and Machine Intelligence, 36(8):1687-1693, 2014.","title":"Segmentation of 3d meshes usingp-spectral clustering","authors":"Mohamed Chahhou, Lahcen Moumoun, Mohamed El Far, Taoufiq Gadi","year":"2014","venue":"IEEE Transactions on Pattern Analysis and Machine Intelligence","doi":null,"url":null,"internal_url":null},{"position":5,"raw":"[De Lange et al., 2019] Matthias De Lange, Rahaf Aljundi, Marc Masana, Sarah Parisot, Xu Jia, Ales Leonardis, Gre- gory Slabaugh, and Tinne Tuytelaars. Continual learning: A comparative study on how to defy forgetting in classi- fication tasks. arXiv preprint arXiv:1909.08383, 2(6):2, 2019.","title":"Continual learning: A comparative study on how to defy forgetting in classification tasks","authors":"Matthias De Lange, Rahaf Aljundi, Marc Masana, Sarah Parisot, Xu Jia, Ales Leonardis, Gregory Slabaugh, Tinne Tuytelaars","year":"2019","venue":null,"doi":null,"url":null,"internal_url":null},{"position":6,"raw":"[Huang et al., 2019] Shudong Huang, Zhao Kang, Ivor W Tsang, and Zenglin Xu. Auto-weighted multi-view clus- tering via kernelized graph learning. Pattern Recognition, 88:174-184, 2019.","title":"Auto-weighted multi-view clustering via kernelized graph learning","authors":"Shudong Huang, Zhao Kang, Ivor W Tsang, Zenglin Xu","year":"2019","venue":"Pattern Recognition","doi":null,"url":null,"internal_url":null},{"position":7,"raw":"[Huang et al., 2021] Shudong Huang, Ivor W Tsang, Zenglin Xu, and Jiancheng Lv. Measuring diversity in graph learning: a unified framework for structured multi-view clustering. IEEE Transactions on Knowledge and Data Engineering, 34(12):5869-5883, 2021.","title":"Measuring diversity in graph learning: a unified framework for structured multi-view clustering","authors":"Huang","year":"2021","venue":"IEEE Transactions on Knowledge and Data Engineering","doi":null,"url":null,"internal_url":null},{"position":8,"raw":"[Janani and Vijayarani, 2019] R Janani and S Vijayarani. Text document clustering using spectral clustering algo- rithm with particle swarm optimization. Expert Systems with Applications, 134:192-200, 2019.","title":"Text document clustering using spectral clustering algorithm with particle swarm optimization","authors":"R Janani, Vijayarani","year":"2019","venue":"Expert Systems with Applications","doi":null,"url":null,"internal_url":null},{"position":9,"raw":"[Jiang and Chung, 2012] Wenhao Jiang and Fu-lai Chung. Transfer spectral clustering. In Joint European Confer- ence on Machine Learning and Knowledge Discovery in Databases, pages 789-803. Springer, 2012.","title":"Transfer spectral clustering","authors":"Chung ; Jiang, Wenhao Jiang, Fu-Lai Chung","year":"2012","venue":"Joint European Conference on Machine Learning and Knowledge Discovery in Databases","doi":null,"url":null,"internal_url":null},{"position":10,"raw":"[Kirkpatrick et al., 2017] James Kirkpatrick, Razvan Pas- canu, Neil Rabinowitz, Joel Veness, Guillaume Des- jardins, Andrei A Rusu, Kieran Milan, John Quan, Tiago Ramalho, Agnieszka Grabska-Barwinska, et al. Overcom- ing catastrophic forgetting in neural networks. Proceed- ings of the National Academy of Sciences, 114(13):3521- 3526, 2017.","title":"Overcoming catastrophic forgetting in neural networks","authors":"James Kirkpatrick, Razvan Pascanu, Neil Rabinowitz, Joel Veness, Guillaume Desjardins, Andrei A Rusu, Kieran Milan, John Quan, Tiago Ramalho, Agnieszka Grabska-Barwinska","year":"2017","venue":"Proceedings of the National Academy of Sciences","doi":null,"url":null,"internal_url":null},{"position":11,"raw":"[Kuang et al., 2012] Da Kuang, Chris Ding, and Haesun Park. Symmetric nonnegative matrix factorization for graph clustering. In Proceedings of the 2012 SIAM In- ternational Conference on Data Mining, pages 106-117.","title":"Symmetric nonnegative matrix factorization for graph clustering","authors":"Da Kuang, Chris Ding, Haesun Park","year":null,"venue":"Proceedings of the 2012 SIAM International Conference on Data Mining","doi":null,"url":null,"internal_url":null},{"position":12,"raw":"[Kumar et al., 2011] Abhishek Kumar, Piyush Rai, and Hal Daume. Co-regularized multi-view spectral clustering. Advances in Neural Information Processing Systems, 24, 2011.","title":"Co-regularized multi-view spectral clustering","authors":"Kumar","year":"2011","venue":"Advances in Neural Information Processing Systems","doi":null,"url":null,"internal_url":null},{"position":13,"raw":"[Lin et al., 2019] Qingjian Lin, Ruiqing Yin, Ming Li, Hervé Bredin, and Claude Barras. Lstm based similarity mea- surement with spectral clustering for speaker diarization. arXiv preprint arXiv:1907.10393, 2019.","title":"Lstm based similarity measurement with spectral clustering for speaker diarization","authors":"Lin","year":"2019","venue":null,"doi":null,"url":null,"internal_url":null},{"position":14,"raw":"[Lin et al., 2021] Xiaochang Lin, Jiewen Guan, Bilian Chen, and Yifeng Zeng. Unsupervised feature selection via or- thogonal basis clustering and local structure preserving. IEEE Transactions on Neural Networks and Learning Sys- tems, 2021.","title":"Unsupervised feature selection via orthogonal basis clustering and local structure preserving","authors":"Lin","year":"2021","venue":"IEEE Transactions on Neural Networks and Learning Systems","doi":null,"url":null,"internal_url":null},{"position":15,"raw":"[Liu et al., 2016] Qian Liu, Bing Liu, Yuanlin Zhang, Doo Soon Kim, and Zhiqiang Gao. Improving opinion aspect extraction using semantic similarity and aspect as- sociations. In Thirtieth AAAI Conference on Artificial In- telligence, 2016.","title":"Improving opinion aspect extraction using semantic similarity and aspect associations","authors":"Qian Liu, Bing Liu, Yuanlin Zhang, Doo, Soon Kim, Zhiqiang Gao","year":"2016","venue":"Thirtieth AAAI Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":16,"raw":"[Manton, 2002] Jonathan H Manton. Optimization algo- rithms exploiting unitary constraints. IEEE transactions on signal processing, 50(3):635-650, 2002.","title":"Optimization algorithms exploiting unitary constraints","authors":"Jonathan H Manton","year":"2002","venue":"IEEE transactions on signal processing","doi":null,"url":null,"internal_url":null},{"position":17,"raw":"[Masana et al., 2020] Marc Masana, Xialei Liu, Bartlomiej Twardowski, Mikel Menta, Andrew D Bagdanov, and Joost van de Weijer. Class-incremental learning: survey and performance evaluation on image classification. arXiv preprint arXiv:2010.15277, 2020.","title":"Class-incremental learning: survey and performance evaluation on image classification","authors":"Marc Masana, Xialei Liu, Bartlomiej Twardowski, Mikel Menta, Andrew D Bagdanov, Joost Van De Weijer","year":"2020","venue":null,"doi":null,"url":null,"internal_url":null},{"position":18,"raw":"[Mitchell et al., 2018] Tom Mitchell, William Cohen, Este- vam Hruschka, Partha Talukdar, Bishan Yang, Justin Bet- teridge, Andrew Carlson, Bhavana Dalvi, Matt Gardner, Bryan Kisiel, et al. Never-ending learning. Communica- tions of the ACM, 61(5):103-115, 2018.","title":"Never-ending learning","authors":"Tom Mitchell, William Cohen, Estevam Hruschka, Partha Talukdar, Bishan Yang, Justin Betteridge, Andrew Carlson, Bhavana Dalvi, Matt Gardner, Bryan Kisiel","year":"2018","venue":"Communications of the ACM","doi":null,"url":null,"internal_url":null},{"position":19,"raw":"[Ng et al., 2001] Andrew Ng, Michael Jordan, and Yair Weiss. On spectral clustering: Analysis and an algorithm. Advances in Neural Information Processing Systems, 14, 2001.","title":"On spectral clustering: Analysis and an algorithm","authors":"Andrew Ng, Michael Jordan, Yair Weiss","year":"2001","venue":"Advances in Neural Information Processing Systems","doi":null,"url":null,"internal_url":null},{"position":20,"raw":"[Nguyen et al., 2017] Cuong V Nguyen, Yingzhen Li, Thang D Bui, and Richard E Turner. Variational contin- ual learning. arXiv preprint arXiv:1710.10628, 2017.","title":"Variational continual learning","authors":"Yingzhen Cuong V Nguyen, Thang D Li, Richard E Bui, Turner","year":"2017","venue":null,"doi":null,"url":null,"internal_url":null},{"position":21,"raw":"[Nie et al., 2017] Feiping Nie, Guohao Cai, and Xuelong Li. Multi-view clustering and semi-supervised classification with adaptive neighbours. In Thirty-first AAAI Conference on Artificial Intelligence, 2017.","title":"Multi-view clustering and semi-supervised classification with adaptive neighbours","authors":"Nie","year":"2017","venue":"Thirty-first AAAI Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":22,"raw":"[Nie et al., 2018] Feiping Nie, Lai Tian, and Xuelong Li. Multiview clustering via adaptively weighted procrustes. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & data mining, pages 2022-2030, 2018.","title":"Multiview clustering via adaptively weighted procrustes","authors":"Nie","year":"2018","venue":"Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & data mining","doi":null,"url":null,"internal_url":null},{"position":23,"raw":"[Ruvolo and Eaton, 2013] Paul Ruvolo and Eric Eaton. Ella: An efficient lifelong learning algorithm. In International Conference on Machine Learning, pages 507-515. PMLR, 2013.","title":"Ella: An efficient lifelong learning algorithm","authors":"Eaton ; ] Ruvolo, Ruvolo Paul, Eric Eaton","year":"2013","venue":"International Conference on Machine Learning","doi":null,"url":null,"internal_url":null},{"position":24,"raw":"[Shi and Malik, 2000] Jianbo Shi and Jitendra Malik. Nor- malized cuts and image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(8):888- 905, 2000.","title":"Normalized cuts and image segmentation","authors":"Jianbo Shi, Jitendra Malik","year":"2000","venue":"IEEE Transactions on Pattern Analysis and Machine Intelligence","doi":null,"url":null,"internal_url":null},{"position":25,"raw":"[Sun et al., 2018] Gan Sun, Yang Cong, and Xiaowei Xu. Active lifelong learning with\" watchdog\". In Proceed- ings of the AAAI Conference on Artificial Intelligence, vol- ume 32, 2018.","title":"Active lifelong learning with\" watchdog","authors":"Gan Sun, Yang Cong, Xiaowei Xu","year":"2018","venue":"Proceedings of the AAAI Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":26,"raw":"[Sun et al., 2020a] Gan Sun, Yang Cong, Qianqian Wang, Jun Li, and Yun Fu. Lifelong spectral clustering. In Pro- ceedings of the AAAI Conference on Artificial Intelligence, volume 34, pages 5867-5874, 2020.","title":"Lifelong spectral clustering","authors":"Sun","year":"2020","venue":"Proceedings of the AAAI Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null},{"position":27,"raw":"[Sun et al., 2020b] Gan Sun, Yang Cong, Qianqian Wang, Bineng Zhong, and Yun Fu. Representative task self- selection for flexible clustered lifelong learning. IEEE Transactions on Neural Networks and Learning Systems, 2020.","title":"Representative task selfselection for flexible clustered lifelong learning","authors":"Sun","year":"2020","venue":"IEEE Transactions on Neural Networks and Learning Systems","doi":null,"url":null,"internal_url":null},{"position":28,"raw":"[Thrun and Mitchell, 1995] Sebastian Thrun and Tom M Mitchell. Lifelong robot learning. Robotics and Au- tonomous Systems, 15(1-2):25-46, 1995.","title":"Lifelong robot learning","authors":"Mitchell ; Thrun, Sebastian Thrun, Tom M Mitchell","year":"1995","venue":"Robotics and Autonomous Systems","doi":null,"url":null,"internal_url":null},{"position":29,"raw":"[Wang et al., 2018] Qi Wang, Zequn Qin, Feiping Nie, and Xuelong Li. Spectral embedded adaptive neighbors clus- tering. IEEE Transactions on Neural Networks and Learn- ing Systems, 30(4):1265-1271, 2018.","title":"Spectral embedded adaptive neighbors clustering","authors":"Qi Wang, Zequn Qin, Feiping Nie, Xuelong Li","year":"2018","venue":"IEEE Transactions on Neural Networks and Learning Systems","doi":null,"url":null,"internal_url":null},{"position":30,"raw":"[Xu et al., 2013] Chang Xu, Dacheng Tao, and Chao Xu. A survey on multi-view learning. arXiv preprint arXiv:1304.5634, 2013.","title":"A survey on multi-view learning","authors":"Chang Xu, Dacheng Tao, Chao Xu","year":"2013","venue":null,"doi":null,"url":null,"internal_url":null},{"position":31,"raw":"[Yang et al., 2014] Yang Yang, Zhigang Ma, Yi Yang, Feip- ing Nie, and Heng Tao Shen. Multitask spectral clustering by exploring intertask correlation. IEEE Transactions on Cybernetics, 45(5):1083-1094, 2014.","title":"Multitask spectral clustering by exploring intertask correlation","authors":"Yang Yang, Zhigang Ma, Yi Yang, Feiping Nie, Heng Tao Shen","year":"2014","venue":"IEEE Transactions on Cybernetics","doi":null,"url":null,"internal_url":null},{"position":32,"raw":"[Zhang and Yang, 2021] Yu Zhang and Qiang Yang. A sur- vey on multi-task learning. IEEE Transactions on Knowl- edge and Data Engineering, 2021.","title":"A survey on multi-task learning","authors":"Yu Zhang, Qiang Yang","year":"2021","venue":"IEEE Transactions on Knowledge and Data Engineering","doi":null,"url":null,"internal_url":null},{"position":33,"raw":"[Zhang et al., 2016] Xianchao Zhang, Xiaotong Zhang, and Han Liu. Self-adapted multi-task clustering. In IJCAI, pages 2357-2363, 2016.","title":"Self-adapted multi-task clustering","authors":"Zhang","year":"2016","venue":"IJCAI","doi":null,"url":null,"internal_url":"/proceedings/2016/336"},{"position":34,"raw":"[Zhang et al., 2018a] Changqing Zhang, Huazhu Fu, Qinghua Hu, Xiaochun Cao, Yuan Xie, Dacheng Tao, and Dong Xu. Generalized latent multi-view subspace clustering. IEEE Transactions on Pattern Analysis and Machine Intelligence, 42(1):86-99, 2018.","title":"Generalized latent multi-view subspace clustering","authors":"Zhang","year":"2018","venue":"IEEE Transactions on Pattern Analysis and Machine Intelligence","doi":null,"url":null,"internal_url":null},{"position":35,"raw":"[Zhang et al., 2018b] Xiaotong Zhang, Xianchao Zhang, Han Liu, and Xinyue Liu. Partially related multi-task clus- tering. IEEE Transactions on Knowledge and Data Engi- neering, 30(12):2367-2380, 2018.","title":"Partially related multi-task clustering","authors":"Zhang","year":"2018","venue":"IEEE Transactions on Knowledge and Data Engineering","doi":null,"url":null,"internal_url":null},{"position":36,"raw":"[Zhao et al., 2017] Jing Zhao, Xijiong Xie, Xin Xu, and Shiliang Sun. Multi-view learning overview: Recent progress and new challenges. Information Fusion, 38:43- 54, 2017.","title":"Multi-view learning overview: Recent progress and new challenges","authors":"Jing Zhao, Xijiong Xie, Xin Xu, Shiliang Sun","year":"2017","venue":"Information Fusion","doi":null,"url":null,"internal_url":null},{"position":37,"raw":"[Zhong and Pun, 2022] Guo Zhong and Chi-Man Pun. Local learning-based multi-task clustering. Knowledge-Based Systems, 255:109798, 2022.","title":"Local learning-based multi-task clustering","authors":"Guo Zhong, Chi-Man Pun","year":"2022","venue":"Knowledge-Based Systems","doi":null,"url":null,"internal_url":null},{"position":38,"raw":"[Zhou and Burges, 2007] Dengyong Zhou and Christo- pher JC Burges. Spectral clustering and transductive learning with multiple views. In Proceedings of the 24th International Conference on Machine Learning, pages 1159-1166, 2007.","title":"Dengyong Zhou and Christopher JC Burges. Spectral clustering and transductive learning with multiple views","authors":"Burges Zhou","year":"2007","venue":"Proceedings of the 24th International Conference on Machine Learning","doi":null,"url":null,"internal_url":null},{"position":39,"raw":"[Zhu et al., 2018] Xiaofeng Zhu, Shichao Zhang, Wei He, Rongyao Hu, Cong Lei, and Pengfei Zhu. One-step multi- view spectral clustering. IEEE Transactions on Knowledge and Data Engineering, 31(10):2022-2034, 2018.","title":"One-step multiview spectral clustering","authors":"Xiaofeng Zhu, Shichao Zhang, Wei He, Rongyao Hu, Cong Lei, Pengfei Zhu","year":"2018","venue":"IEEE Transactions on Knowledge and Data Engineering","doi":null,"url":null,"internal_url":null},{"position":40,"raw":"[Zong et al., 2018] Linlin Zong, Xianchao Zhang, Xinyue Liu, and Hong Yu. Weighted multi-view spectral clus- tering based on spectral perturbation. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 32, 2018.","title":"Weighted multi-view spectral clustering based on spectral perturbation","authors":"Linlin Zong, Xianchao Zhang, Xinyue Liu, Hong Yu","year":"2018","venue":"Proceedings of the AAAI Conference on Artificial Intelligence","doi":null,"url":null,"internal_url":null}],"license_note":"Copyright International Joint Conferences on Artificial Intelligence."}