ABSTRACT
Ensemble clustering has shown its promising ability in fusing multiple base clusterings into a probably better and more robust clustering result. Typically, the co-association matrix based ensemble clustering methods attempt to integrate multiple connective matrices from base clusterings by weighted fusion to acquire a common graph representation. However, few of them are aware of the potential noise or corruption from the common representation by direct integration of different connective matrices with distinct cluster structures, and further consider the mutual information propagation between the input observations. In this paper, we propose a Graph Tensor Learning based Ensemble Clustering (GTLEC) method to refine multiple connective matrices by the substantial rank recovery and graph tensor learning. Within this framework, each input connective matrix is dexterously refined to approximate a graph structure by obeying the theoretical rank constraint with an adaptive weight coefficient. Further, we stack multiple refined connective matrices into a three-order tensor to extract their higher-order similarities via graph tensor learning, where the mutual information propagation across different graph matrices will also be promoted. Extensive experiments on several challenging datasets have confirmed the superiority of GTLEC compared with the state-of-the-art.
Supplemental Material
- Mansheng Chen, Tuo Liu, Chang-Dong Wang, Dong Huang, and Jian-Huang Lai. 2022. Adaptively-weighted Integral Space for Fast Multiview Clustering. In The 30th ACM International Conference on Multimedia. 3774--3782.Google Scholar
- Mansheng Chen, Chang-Dong Wang, and Jian-Huang Lai. 2023. Low-Rank Tensor Based Proximity Learning for Multi-View Clustering. IEEE Trans. Knowl. Data Eng., Vol. 35, 5 (2023), 5076--5090.Google ScholarDigital Library
- Zhiqiang Fu, Yao Zhao, Dongxia Chang, Yiming Wang, Jie Wen, Xingxing Zhang, and Guodong Guo. 2022. One-step Low-Rank Representation for Clustering. In The 30th ACM International Conference on Multimedia. 2220--2228.Google Scholar
- Dong Huang, Ding-Hua Chen, Xiangji Chen, Chang-Dong Wang, and Jian-Huang Lai. 2022a. DeepCluE: Enhanced Image Clustering via Multi-layer Ensembles in Deep Neural Networks. CoRR (2022).Google Scholar
- Dong Huang, Jianhuang Lai, and Chang-Dong Wang. 2016a. Ensemble clustering using factor graph. Pattern Recognit., Vol. 50 (2016), 131--142.Google ScholarDigital Library
- Dong Huang, Jian-Huang Lai, and Chang-Dong Wang. 2016b. Robust Ensemble Clustering Using Probability Trajectories. IEEE Trans. Knowl. Data Eng., Vol. 28, 5 (2016), 1312--1326.Google ScholarDigital Library
- Dong Huang, Chang-Dong Wang, Jian-Huang Lai, and Chee Keong Kwoh. 2022c. Toward Multidiversified Ensemble Clustering of High-Dimensional Data: From Subspaces to Metrics and Beyond. IEEE Trans. Cybern., Vol. 52, 11 (2022), 12231--12244.Google ScholarCross Ref
- Dong Huang, Chang-Dong Wang, and Jian-Huang Lai. 2018. Locally Weighted Ensemble Clustering. IEEE Trans. Cybern., Vol. 48, 5 (2018), 1460--1473.Google ScholarCross Ref
- Dong Huang, Chang-Dong Wang, and Jian-Huang Lai. 2022b. Fast Multi-view Clustering via Ensembles: Towards Scalability, Superiority, and Simplicity. CoRR (2022).Google Scholar
- Dong Huang, Chang-Dong Wang, Hongxing Peng, Jianhuang Lai, and Chee-Keong Kwoh. 2021. Enhanced Ensemble Clustering via Fast Propagation of Cluster-Wise Similarities. IEEE Trans. Syst. Man Cybern. Syst., Vol. 51, 1 (2021), 508--520.Google ScholarCross Ref
- Yuheng Jia, Sam Kwong, Junhui Hou, and Wenhui Wu. 2018. Convex Constrained Clustering with Graph-Laplacian Pca. In 2018 IEEE International Conference on Multimedia and Expo. 1--6.Google Scholar
- Yuheng Jia, Hui Liu, Junhui Hou, and Qingfu Zhang. 2021. Clustering Ensemble Meets Low-rank Tensor Approximation. In Thirty-Fifth AAAI Conference on Artificial Intelligence. 7970--7978.Google Scholar
- Yuheng Jia, Sirui Tao, Ran Wang, and Yongheng Wang. 2022. Ensemble Clustering via Co-association Matrix Self-enhancement. CoRR, Vol. abs/2205.05937 (2022). [arXiv]2205.05937Google Scholar
- Misha Elena Kilmer, Karen S. Braman, Ning Hao, and Randy C. Hoover. 2013. Third-Order Tensors as Operators on Matrices: A Theoretical and Computational Framework with Applications in Imaging. SIAM J. Matrix Anal. Appl., Vol. 34, 1 (2013), 148--172.Google ScholarDigital Library
- Feijiang Li, Yuhua Qian, and Jieting Wang. 2021. GoT: a Growing Tree Model for Clustering Ensemble. In Thirty-Fifth AAAI Conference on Artificial Intelligence. 8349--8356.Google ScholarCross Ref
- Feijiang Li, Yuhua Qian, Jieting Wang, Chuangyin Dang, and Liping Jing. 2019. Clustering ensemble based on sample's stability. Artif. Intell., Vol. 273 (2019), 37--55.Google ScholarDigital Library
- Xingfeng Li, Zhenwen Ren, Quansen Sun, and Zhi Xu. 2023 a. Auto-weighted tensor schatten p-norm for robust multi-view graph clustering. Pattern Recognition, Vol. 134 (2023), 109083.Google ScholarDigital Library
- Xingfeng Li, Yinghui Sun, Quansen Sun, and Zhenwen Ren. 2023 b. Consensus Cluster Center Guided Latent Multi-Kernel Clustering. IEEE Transactions on Circuits and Systems for Video Technology, Vol. 33, 6 (2023), 2864--2876.Google ScholarDigital Library
- Xingfeng Li, Yinghui Sun, Quansen Sun, Zhenwen Ren, and Yuan Sun. 2023 c. Cross-view Graph Matching guided Anchor Alignment for incomplete multi-view clustering. Information Fusion (2023), 101941.Google Scholar
- Hongfu Liu, Junjie Wu, Tongliang Liu, Dacheng Tao, and Yun Fu. 2017. Spectral Ensemble Clustering via Weighted K-Means: Theoretical and Practical Evidence. IEEE Trans. Knowl. Data Eng., Vol. 29, 5 (2017), 1129--1143.Google ScholarDigital Library
- Canyi Lu, Jiashi Feng, Zhouchen Lin, Tao Mei, and Shuicheng Yan. 2019. Subspace Clustering by Block Diagonal Representation. IEEE Trans. Pattern Anal. Mach. Intell., Vol. 41, 2 (2019), 487--501.Google ScholarDigital Library
- Andrew Y. Ng, Michael I. Jordan, and Yair Weiss. 2001. On Spectral Clustering: Analysis and an algorithm. In Advances in Neural Information Processing Systems. 849--856.Google Scholar
- Feiping Nie, Jing Li, and Xuelong Li. 2017. Self-weighted Multiview Clustering with Multiple Graphs. In Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence. 2564--2570.Google ScholarCross Ref
- Feiping Nie, Xiaoqian Wang, Michael I. Jordan, and Heng Huang. 2016. The Constrained Laplacian Rank Algorithm for Graph-Based Clustering. In Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence. 1969--1976.Google ScholarCross Ref
- Zhihao Peng, Hui Liu, Yuheng Jia, and Junhui Hou. 2021. Attention-driven Graph Clustering Network. In ACM Multimedia Conference. 935--943.Google Scholar
- Zhenwen Ren, Quansen Sun, and Dong Wei. 2021. Multiple Kernel Clustering with Kernel k-Means Coupled Graph Tensor Learning. In Thirty-Fifth AAAI Conference on Artificial Intelligence. 9411--9418.Google ScholarCross Ref
- Zhenwen Ren, Quansen Sun, Bin Wu, Xiaoqian Zhang, and Wenzhu Yan. 2020. Learning Latent Low-Rank and Sparse Embedding for Robust Image Feature Extraction. IEEE Trans. Image Process., Vol. 29 (2020), 2094--2107.Google ScholarCross Ref
- Yuan Sun, Zhenwen Ren, Peng Hu, Dezhong Peng, and Xu Wang. 2023. Hierarchical Consensus Hashing for Cross-Modal Retrieval. IEEE Transactions on Multimedia (2023).Google ScholarDigital Library
- Zhiqiang Tao, Hongfu Liu, and Yun Fu. 2017a. Simultaneous Clustering and Ensemble. In Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence. 1546--1552.Google ScholarCross Ref
- Zhiqiang Tao, Hongfu Liu, Jun Li, Zhaowen Wang, and Yun Fu. 2019. Adversarial Graph Embedding for Ensemble Clustering. In Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence. 3562--3568.Google ScholarCross Ref
- Zhiqiang Tao, Hongfu Liu, Sheng Li, Zhengming Ding, and Yun Fu. 2017b. From Ensemble Clustering to Multi-View Clustering. In Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence. 2843--2849.Google ScholarCross Ref
- René Vidal. 2011. Subspace clustering. IEEE Signal Processing Magazine, Vol. 28, 2 (2011), 52--68.Google ScholarCross Ref
- Chang-Dong Wang, Jian-Huang Lai, Ching Y. Suen, and Jun-Yong Zhu. 2013. Multi-Exemplar Affinity Propagation. IEEE Trans. Pattern Anal. Mach. Intell., Vol. 35, 9 (2013), 2223--2237.Google ScholarDigital Library
- Chang-Dong Wang, Jian-Huang Lai, and Jun-Yong Zhu. 2012. Graph-Based Multiprototype Competitive Learning and Its Applications. IEEE Trans. Syst. Man Cybern. Part C, Vol. 42, 6 (2012), 934--946.Google ScholarDigital Library
- Luqing Wang, Junwei Luo, Hongjun Wang, and Tianrui Li. 2022. Markov clustering ensemble. Knowl. Based Syst., Vol. 251 (2022), 109196.Google ScholarDigital Library
- Yuan Xie, Dacheng Tao, Wensheng Zhang, Yan Liu, Lei Zhang, and Yanyun Qu. 2018. On Unifying Multi-view Self-Representations for Clustering by Tensor Multi-rank Minimization. Int. J. Comput. Vis., Vol. 126, 11 (2018), 1157--1179.Google ScholarDigital Library
- Zhiwen Yu, Daxing Wang, Xianbing Meng, and C. L. Philip Chen. 2022. Clustering Ensemble Based on Hybrid Multiview Clustering. IEEE Trans. Cybern., Vol. 52, 7 (2022), 6518--6530.Google ScholarCross Ref
- Mimi Zhang. 2022. Weighted clustering ensemble: A review. Pattern Recognit., Vol. 124 (2022), 108428.Google ScholarDigital Library
- Caiming Zhong, Lianyu Hu, Xiaodong Yue, Ting Luo, Qiang Fu, and Haiyong Xu. 2019. Ensemble clustering based on evidence extracted from the co-association matrix. Pattern Recognit., Vol. 92 (2019), 93--106.Google ScholarDigital Library
- Jie Zhou, Hongchan Zheng, and Lulu Pan. 2019. Ensemble clustering based on dense representation. Neurocomputing, Vol. 357 (2019), 66--76.Google ScholarDigital Library
- Peng Zhou, Liang Du, Xinwang Liu, Yi-Dong Shen, Mingyu Fan, and Xuejun Li. 2021a. Self-Paced Clustering Ensemble. IEEE Trans. Neural Networks Learn. Syst., Vol. 32, 4 (2021), 1497--1511.Google ScholarCross Ref
- Peng Zhou, Liang Du, Yi-Dong Shen, and Xuejun Li. 2021b. Tri-level Robust Clustering Ensemble with Multiple Graph Learning. In Thirty-Fifth AAAI Conference on Artificial Intelligence. 11125--11133.Google Scholar
- Peng Zhou, Xia Wang, Liang Du, and Xuejun Li. 2022. Clustering ensemble via structured hypergraph learning. Inf. Fusion, Vol. 78 (2022), 171--179.Google ScholarDigital Library
Index Terms
- On Regularizing Multiple Clusterings for Ensemble Clustering by Graph Tensor Learning
Recommendations
Ensemble-Initialized k-Means Clustering
ICMLC '19: Proceedings of the 2019 11th International Conference on Machine Learning and ComputingAs one of the most classical clustering techniques, the k-means clustering has been widely used in various areas over the past few decades. Despite its significant success, there are still several challenging issues in the k-means clustering research, ...
Multi-view Ensemble Clustering via Low-rank and Sparse Decomposition: From Matrix to Tensor
As a significant extension of classical clustering methods, ensemble clustering first generates multiple basic clusterings and then fuses them into one consensus partition by solving a problem concerning graph partition with respect to the co-association ...
Ensemble Clustering by Noise-Aware Graph Decomposition
ICIT '18: Proceedings of the 6th International Conference on Information Technology: IoT and Smart CityEnsemble clustering has recently emerged as a powerful tool for aggregating multiple clustering results into a probably better and more robust clustering result. While many ensemble clustering techniques have been developed in recent years, there is ...
Comments