Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3581783.3612313acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

On Regularizing Multiple Clusterings for Ensemble Clustering by Graph Tensor Learning

Published:27 October 2023Publication History

ABSTRACT

Ensemble clustering has shown its promising ability in fusing multiple base clusterings into a probably better and more robust clustering result. Typically, the co-association matrix based ensemble clustering methods attempt to integrate multiple connective matrices from base clusterings by weighted fusion to acquire a common graph representation. However, few of them are aware of the potential noise or corruption from the common representation by direct integration of different connective matrices with distinct cluster structures, and further consider the mutual information propagation between the input observations. In this paper, we propose a Graph Tensor Learning based Ensemble Clustering (GTLEC) method to refine multiple connective matrices by the substantial rank recovery and graph tensor learning. Within this framework, each input connective matrix is dexterously refined to approximate a graph structure by obeying the theoretical rank constraint with an adaptive weight coefficient. Further, we stack multiple refined connective matrices into a three-order tensor to extract their higher-order similarities via graph tensor learning, where the mutual information propagation across different graph matrices will also be promoted. Extensive experiments on several challenging datasets have confirmed the superiority of GTLEC compared with the state-of-the-art.

Skip Supplemental Material Section

Supplemental Material

MM23-fp2722.mp4

mp4

28.4 MB

References

  1. Mansheng Chen, Tuo Liu, Chang-Dong Wang, Dong Huang, and Jian-Huang Lai. 2022. Adaptively-weighted Integral Space for Fast Multiview Clustering. In The 30th ACM International Conference on Multimedia. 3774--3782.Google ScholarGoogle Scholar
  2. Mansheng Chen, Chang-Dong Wang, and Jian-Huang Lai. 2023. Low-Rank Tensor Based Proximity Learning for Multi-View Clustering. IEEE Trans. Knowl. Data Eng., Vol. 35, 5 (2023), 5076--5090.Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Zhiqiang Fu, Yao Zhao, Dongxia Chang, Yiming Wang, Jie Wen, Xingxing Zhang, and Guodong Guo. 2022. One-step Low-Rank Representation for Clustering. In The 30th ACM International Conference on Multimedia. 2220--2228.Google ScholarGoogle Scholar
  4. Dong Huang, Ding-Hua Chen, Xiangji Chen, Chang-Dong Wang, and Jian-Huang Lai. 2022a. DeepCluE: Enhanced Image Clustering via Multi-layer Ensembles in Deep Neural Networks. CoRR (2022).Google ScholarGoogle Scholar
  5. Dong Huang, Jianhuang Lai, and Chang-Dong Wang. 2016a. Ensemble clustering using factor graph. Pattern Recognit., Vol. 50 (2016), 131--142.Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Dong Huang, Jian-Huang Lai, and Chang-Dong Wang. 2016b. Robust Ensemble Clustering Using Probability Trajectories. IEEE Trans. Knowl. Data Eng., Vol. 28, 5 (2016), 1312--1326.Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Dong Huang, Chang-Dong Wang, Jian-Huang Lai, and Chee Keong Kwoh. 2022c. Toward Multidiversified Ensemble Clustering of High-Dimensional Data: From Subspaces to Metrics and Beyond. IEEE Trans. Cybern., Vol. 52, 11 (2022), 12231--12244.Google ScholarGoogle ScholarCross RefCross Ref
  8. Dong Huang, Chang-Dong Wang, and Jian-Huang Lai. 2018. Locally Weighted Ensemble Clustering. IEEE Trans. Cybern., Vol. 48, 5 (2018), 1460--1473.Google ScholarGoogle ScholarCross RefCross Ref
  9. Dong Huang, Chang-Dong Wang, and Jian-Huang Lai. 2022b. Fast Multi-view Clustering via Ensembles: Towards Scalability, Superiority, and Simplicity. CoRR (2022).Google ScholarGoogle Scholar
  10. Dong Huang, Chang-Dong Wang, Hongxing Peng, Jianhuang Lai, and Chee-Keong Kwoh. 2021. Enhanced Ensemble Clustering via Fast Propagation of Cluster-Wise Similarities. IEEE Trans. Syst. Man Cybern. Syst., Vol. 51, 1 (2021), 508--520.Google ScholarGoogle ScholarCross RefCross Ref
  11. Yuheng Jia, Sam Kwong, Junhui Hou, and Wenhui Wu. 2018. Convex Constrained Clustering with Graph-Laplacian Pca. In 2018 IEEE International Conference on Multimedia and Expo. 1--6.Google ScholarGoogle Scholar
  12. Yuheng Jia, Hui Liu, Junhui Hou, and Qingfu Zhang. 2021. Clustering Ensemble Meets Low-rank Tensor Approximation. In Thirty-Fifth AAAI Conference on Artificial Intelligence. 7970--7978.Google ScholarGoogle Scholar
  13. Yuheng Jia, Sirui Tao, Ran Wang, and Yongheng Wang. 2022. Ensemble Clustering via Co-association Matrix Self-enhancement. CoRR, Vol. abs/2205.05937 (2022). [arXiv]2205.05937Google ScholarGoogle Scholar
  14. Misha Elena Kilmer, Karen S. Braman, Ning Hao, and Randy C. Hoover. 2013. Third-Order Tensors as Operators on Matrices: A Theoretical and Computational Framework with Applications in Imaging. SIAM J. Matrix Anal. Appl., Vol. 34, 1 (2013), 148--172.Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Feijiang Li, Yuhua Qian, and Jieting Wang. 2021. GoT: a Growing Tree Model for Clustering Ensemble. In Thirty-Fifth AAAI Conference on Artificial Intelligence. 8349--8356.Google ScholarGoogle ScholarCross RefCross Ref
  16. Feijiang Li, Yuhua Qian, Jieting Wang, Chuangyin Dang, and Liping Jing. 2019. Clustering ensemble based on sample's stability. Artif. Intell., Vol. 273 (2019), 37--55.Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Xingfeng Li, Zhenwen Ren, Quansen Sun, and Zhi Xu. 2023 a. Auto-weighted tensor schatten p-norm for robust multi-view graph clustering. Pattern Recognition, Vol. 134 (2023), 109083.Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Xingfeng Li, Yinghui Sun, Quansen Sun, and Zhenwen Ren. 2023 b. Consensus Cluster Center Guided Latent Multi-Kernel Clustering. IEEE Transactions on Circuits and Systems for Video Technology, Vol. 33, 6 (2023), 2864--2876.Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Xingfeng Li, Yinghui Sun, Quansen Sun, Zhenwen Ren, and Yuan Sun. 2023 c. Cross-view Graph Matching guided Anchor Alignment for incomplete multi-view clustering. Information Fusion (2023), 101941.Google ScholarGoogle Scholar
  20. Hongfu Liu, Junjie Wu, Tongliang Liu, Dacheng Tao, and Yun Fu. 2017. Spectral Ensemble Clustering via Weighted K-Means: Theoretical and Practical Evidence. IEEE Trans. Knowl. Data Eng., Vol. 29, 5 (2017), 1129--1143.Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Canyi Lu, Jiashi Feng, Zhouchen Lin, Tao Mei, and Shuicheng Yan. 2019. Subspace Clustering by Block Diagonal Representation. IEEE Trans. Pattern Anal. Mach. Intell., Vol. 41, 2 (2019), 487--501.Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Andrew Y. Ng, Michael I. Jordan, and Yair Weiss. 2001. On Spectral Clustering: Analysis and an algorithm. In Advances in Neural Information Processing Systems. 849--856.Google ScholarGoogle Scholar
  23. Feiping Nie, Jing Li, and Xuelong Li. 2017. Self-weighted Multiview Clustering with Multiple Graphs. In Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence. 2564--2570.Google ScholarGoogle ScholarCross RefCross Ref
  24. Feiping Nie, Xiaoqian Wang, Michael I. Jordan, and Heng Huang. 2016. The Constrained Laplacian Rank Algorithm for Graph-Based Clustering. In Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence. 1969--1976.Google ScholarGoogle ScholarCross RefCross Ref
  25. Zhihao Peng, Hui Liu, Yuheng Jia, and Junhui Hou. 2021. Attention-driven Graph Clustering Network. In ACM Multimedia Conference. 935--943.Google ScholarGoogle Scholar
  26. Zhenwen Ren, Quansen Sun, and Dong Wei. 2021. Multiple Kernel Clustering with Kernel k-Means Coupled Graph Tensor Learning. In Thirty-Fifth AAAI Conference on Artificial Intelligence. 9411--9418.Google ScholarGoogle ScholarCross RefCross Ref
  27. Zhenwen Ren, Quansen Sun, Bin Wu, Xiaoqian Zhang, and Wenzhu Yan. 2020. Learning Latent Low-Rank and Sparse Embedding for Robust Image Feature Extraction. IEEE Trans. Image Process., Vol. 29 (2020), 2094--2107.Google ScholarGoogle ScholarCross RefCross Ref
  28. Yuan Sun, Zhenwen Ren, Peng Hu, Dezhong Peng, and Xu Wang. 2023. Hierarchical Consensus Hashing for Cross-Modal Retrieval. IEEE Transactions on Multimedia (2023).Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Zhiqiang Tao, Hongfu Liu, and Yun Fu. 2017a. Simultaneous Clustering and Ensemble. In Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence. 1546--1552.Google ScholarGoogle ScholarCross RefCross Ref
  30. Zhiqiang Tao, Hongfu Liu, Jun Li, Zhaowen Wang, and Yun Fu. 2019. Adversarial Graph Embedding for Ensemble Clustering. In Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence. 3562--3568.Google ScholarGoogle ScholarCross RefCross Ref
  31. Zhiqiang Tao, Hongfu Liu, Sheng Li, Zhengming Ding, and Yun Fu. 2017b. From Ensemble Clustering to Multi-View Clustering. In Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence. 2843--2849.Google ScholarGoogle ScholarCross RefCross Ref
  32. René Vidal. 2011. Subspace clustering. IEEE Signal Processing Magazine, Vol. 28, 2 (2011), 52--68.Google ScholarGoogle ScholarCross RefCross Ref
  33. Chang-Dong Wang, Jian-Huang Lai, Ching Y. Suen, and Jun-Yong Zhu. 2013. Multi-Exemplar Affinity Propagation. IEEE Trans. Pattern Anal. Mach. Intell., Vol. 35, 9 (2013), 2223--2237.Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Chang-Dong Wang, Jian-Huang Lai, and Jun-Yong Zhu. 2012. Graph-Based Multiprototype Competitive Learning and Its Applications. IEEE Trans. Syst. Man Cybern. Part C, Vol. 42, 6 (2012), 934--946.Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Luqing Wang, Junwei Luo, Hongjun Wang, and Tianrui Li. 2022. Markov clustering ensemble. Knowl. Based Syst., Vol. 251 (2022), 109196.Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Yuan Xie, Dacheng Tao, Wensheng Zhang, Yan Liu, Lei Zhang, and Yanyun Qu. 2018. On Unifying Multi-view Self-Representations for Clustering by Tensor Multi-rank Minimization. Int. J. Comput. Vis., Vol. 126, 11 (2018), 1157--1179.Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Zhiwen Yu, Daxing Wang, Xianbing Meng, and C. L. Philip Chen. 2022. Clustering Ensemble Based on Hybrid Multiview Clustering. IEEE Trans. Cybern., Vol. 52, 7 (2022), 6518--6530.Google ScholarGoogle ScholarCross RefCross Ref
  38. Mimi Zhang. 2022. Weighted clustering ensemble: A review. Pattern Recognit., Vol. 124 (2022), 108428.Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Caiming Zhong, Lianyu Hu, Xiaodong Yue, Ting Luo, Qiang Fu, and Haiyong Xu. 2019. Ensemble clustering based on evidence extracted from the co-association matrix. Pattern Recognit., Vol. 92 (2019), 93--106.Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Jie Zhou, Hongchan Zheng, and Lulu Pan. 2019. Ensemble clustering based on dense representation. Neurocomputing, Vol. 357 (2019), 66--76.Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Peng Zhou, Liang Du, Xinwang Liu, Yi-Dong Shen, Mingyu Fan, and Xuejun Li. 2021a. Self-Paced Clustering Ensemble. IEEE Trans. Neural Networks Learn. Syst., Vol. 32, 4 (2021), 1497--1511.Google ScholarGoogle ScholarCross RefCross Ref
  42. Peng Zhou, Liang Du, Yi-Dong Shen, and Xuejun Li. 2021b. Tri-level Robust Clustering Ensemble with Multiple Graph Learning. In Thirty-Fifth AAAI Conference on Artificial Intelligence. 11125--11133.Google ScholarGoogle Scholar
  43. Peng Zhou, Xia Wang, Liang Du, and Xuejun Li. 2022. Clustering ensemble via structured hypergraph learning. Inf. Fusion, Vol. 78 (2022), 171--179.Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. On Regularizing Multiple Clusterings for Ensemble Clustering by Graph Tensor Learning

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      MM '23: Proceedings of the 31st ACM International Conference on Multimedia
      October 2023
      9913 pages
      ISBN:9798400701085
      DOI:10.1145/3581783

      Copyright © 2023 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 27 October 2023

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Acceptance Rates

      Overall Acceptance Rate995of4,171submissions,24%

      Upcoming Conference

      MM '24
      MM '24: The 32nd ACM International Conference on Multimedia
      October 28 - November 1, 2024
      Melbourne , VIC , Australia
    • Article Metrics

      • Downloads (Last 12 months)202
      • Downloads (Last 6 weeks)20

      Other Metrics

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader