Contrastive Consistency and Attentive Complementarity for Deep Multi-View Subspace Clustering
Source abstract
Abstract
Deep multi-view subspace clustering (DMVSC) based on self-expression has attracted increasing attention due to its outstanding performance and nonlinear application. However, most existing methods neglect that view-private meaningless information or noise may interfere with the learning of self-expression, which may lead to the degeneration of clustering performance. In this paper, we propose a novel framework of Contrastive Consistency and Attentive Complementarity (CCAC) for DMVsSC. CCAC aligns all the self-expressions of multiple views and fuses them based on their discrimination, so that it can effectively explore consistent and complementary information for achieving precise clustering. Specifically, the view-specific self-expression is learned by a self-expression layer embedded into the auto-encoder network for each view. To guarantee consistency across views and reduce the effect of view-private information or noise, we align all the view-specific self-expressions by contrastive learning. The aligned self-expressions are assigned adaptive weights by channel attention mechanism according to their discrimination. Then they are fused by convolution kernel to obtain consensus self-expression with maximum complementarity of multiple views. Extensive experimental results on four benchmark datasets and one large-scale dataset of the CCAC method outperform other state-of-the-art methods, demonstrating its clustering effectiveness.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Face and Expression Recognition · Video Surveillance and Tracking Methods · Advanced Computing and Algorithms
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (48)
Show source-provided references
1. Reddy · Data Clustering · 2018 · 8710.1201/9781315373515-4 ↗
2. Density-based clustering
3. Incremental interval type-2 fuzzy clustering of data streams using single pass method10.3390/s20113210 ↗
4. Semi-supervised multi-view deep discriminant representation learning10.1109/TPAMI.2020.2973634 ↗
5. Brain tumor segmentation using multi-view attention based ensemble network10.32604/cmc.2022.024316 ↗
6. Multi-view clustering via deep matrix factorization and partition alignment
7. Multi-view clustering via label-embedded regularized NMF with dual-graph constraints10.1016/j.neucom.2023.126521 ↗
8. GMC: Graph-based multi-view clustering10.1109/TKDE.2019.2903810 ↗
9. Robust and optimal neighborhood graph learning for multi-view clustering10.1016/j.ins.2023.02.089 ↗
10. Robust energy preserving embedding for multi-view subspace clustering10.1016/j.knosys.2020.106489 ↗
11. Scalable one-stage multi-view subspace clustering with dictionary learning10.1016/j.knosys.2022.110092 ↗
12. Multiple kernel subspace clustering with local structural graph and low-rank consensus kernel learning10.1016/j.knosys.2019.105040 ↗
13. Trade-off between efficiency and effectiveness: A late fusion multi-view clustering algorithm10.32604/cmc.2021.013389 ↗
14. Consistent and diverse multi-view subspace clustering with structure constraint10.1016/j.patcog.2021.108196 ↗
15. Robust multi-view subspace clustering based on consensus representation and orthogonal diversity10.1016/j.neunet.2022.03.009 ↗
16. Deep multi-view subspace clustering with unified and discriminative learning10.1109/TMM.2020.3025666 ↗
17. Multi-scale deep multi-view subspace clustering with self-weighting fusion and structure preserving10.1016/j.eswa.2022.119031 ↗
18. Multi-level feature learning for contrastive multi-view clustering
19. Ji · Advances in Neural Information Processing Systems · 2017 · 30
20. Deep multimodal subspace clustering networks10.1109/JSTSP.2018.2875385 ↗
21. Deep self-supervised t-SNE for multi-modal subspace llustering
22. Self-supervised deep multi-view subspace clustering
23. Attentive multi-view deep subspace clustering net10.1016/j.neucom.2021.01.011 ↗
24. P. Zhu, B. Hui, C. Zhang, D. Du, L. Wen et al., “Multi-view deep subspace clustering networks,” arXiv preprint arXiv:1908.01978, 2019.
25. Self-guided deep multi-view subspace clustering network
26. Self-supervised information bottleneck for deep multi-view subspace clustering10.1109/TIP.2023.3246802 ↗
27. Contrastive representation learning: A framework and review10.1109/ACCESS.2020.3031549 ↗
28. Contrastive multiview coding
29. Reconsidering representation alignment for multi-view clustering
30. On the effects of self-supervision and contrastive alignment in deep multi-view clustering
31. Deep contrastive multi-view subspace clustering
32. A clustering-guided contrastive fusion for multi-view representation learning
33. GCFAgg: Global and cross-view feature aggregation for multi-view clustering
34. CCR-Net: Consistent contrastive representation network for multi-view clustering10.1016/j.ins.2023.118937 ↗
35. Squeeze-and-excitation networks
36. Robust recovery of subspace structures by low-rank representation10.1109/TPAMI.2012.88 ↗
37. Diversity-induced multi-view subspace clustering
38. Low-rank tensor constrained multiview subspace clustering
39. Multiview clustering via adaptively weighted procrustes
40. On unifying multi-view self-representations for clustering by tensor multi-rank minimization10.1007/s11263-018-1086-2 ↗
41. Essential tensor learning for multi-view spectral clustering10.1109/TIP.2019.2916740 ↗
42. Multiview subspace clustering via tensorial t-product representation10.1109/TNNLS.2018.2851444 ↗
43. Generalized latent multi-view subspace clustering10.1109/TPAMI.2018.2877660 ↗
44. Multi-view clustering in latent embedding space10.1609/aaai.v34i04.5756 ↗
45. Tensor robust principal component analysis with a new tensor nuclear norm10.1109/TPAMI.2019.2891760 ↗
46. CDIMC-net: Cognitive deep incomplete multi-view clustering network
47. Semi-supervised structured subspace learning for multi-view clustering10.1109/TIP.2021.3128325 ↗
48. Elastic multi-view subspace clustering with pairwise and high-order correlations