Simple Contrastive Multi-View Clustering with Data-Level Fusion

Simple Contrastive Multi-View Clustering with Data-Level Fusion

Caixuan Luo, Jie Xu, Yazhou Ren, Junbo Ma, Xiaofeng Zhu

Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence
Main Track. Pages 4697-4705. https://doi.org/10.24963/ijcai.2024/519

Previous deep multi-view clustering methods usually design un-shared encoders to explore the cluster information among multi-view data, but they are difficult to customize the encoders for individual views and easily increase information loss. To address these issues, we propose a simple yet effective contrastive multi-view clustering framework. Specifically, different from using feature-level fusion in previous methods, we first propose a data-level fusion method to fuse multi-view information, which produces a fused data to replace all views and thus avoids customizing networks for different views. Then, we simulate the data noise and unavailability in multiple views to design two kinds of data augmentation for the fused data, making a shared encoder with simple contrastive learning to learn robust features and achieve the interaction across views. As a result, our method is a general framework and we base on it to conduct feature clustering and end-to-end clustering. Extensive experiments demonstrate that our method can explore the discriminative information in multi-view data and achieve superior clustering performance.
Keywords:
Machine Learning: ML: Multi-view learning
Machine Learning: ML: Clustering
Machine Learning: ML: Multi-modal learning
Machine Learning: ML: Self-supervised Learning