Efficient Multi-view Unsupervised Feature Selection with Adaptive Structure Learning and Inference

Efficient Multi-view Unsupervised Feature Selection with Adaptive Structure Learning and Inference

Chenglong Zhang, Yang Fang, Xinyan Liang, Han Zhang, Peng Zhou, Xingyu Wu, Jie Yang, Bingbing Jiang, Weiguo Sheng

Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence
Main Track. Pages 5443-5452. https://doi.org/10.24963/ijcai.2024/602

As data with diverse representations become high-dimensional, multi-view unsupervised feature selection has been an important learning paradigm. Generally, existing methods encounter the following challenges: (i) traditional solutions either concatenate different views or introduce extra parameters to weight them, affecting the performance and applicability; (ii) emphasis is typically placed on graph construction, yet disregarding the clustering information of data; (iii) exploring the similarity structure of all samples from the original features is suboptimal and extremely time-consuming. To solve this dilemma, we propose an efficient multi-view unsupervised feature selection (EMUFS) to construct bipartite graphs between samples and anchors. Specifically, a parameter-free manner is devised to collaboratively fuse the membership matrices and graphs to learn the compatible structure information across all views, naturally balancing different views. Moreover, EMUFS leverages the similarity relations of data in the feature subspace induced by l2,0-norm to dynamically update the graph. Accordingly, the cluster information of anchors can be accurately propagated to samples via the graph structure and further guide feature selection, enhancing the quality of selected features and the computational costs in solution processes. A convergent optimization is developed to solve the formulated problem, and experiments demonstrate the effectiveness and efficiency of EMUFS.
Keywords:
Machine Learning: ML: Multi-view learning
Machine Learning: ML: Clustering
Machine Learning: ML: Feature extraction, selection and dimensionality reduction
Machine Learning: ML: Unsupervised learning