Kernel Block Diagonal Representation Subspace Clustering with Similarity Preservation
Source abstract
Abstract
Subspace clustering methods based on the low-rank and sparse model are effective strategies for high-dimensional data clustering. However, most existing low-rank and sparse methods with self-expression can only deal with linear structure data effectively, but they cannot handle data with complex nonlinear structure well. Although kernel subspace clustering methods can efficiently deal with nonlinear structure data, some similarity information between samples may be lost when the original data are reconstructed in the kernel space. Moreover, these kernel subspace clustering methods may not obtain an affinity matrix with an optimal block diagonal structure. In this paper, we propose a novel subspace clustering method termed kernel block diagonal representation subspace clustering with similarity preservation (KBDSP). KBDSP contains three contributions: (1) an affinity matrix with block diagonal structure is generated by introducing a block diagonal representation term; (2) a similarity-preserving regularizer is constructed and embedded into our model by minimizing the discrepancy between inner products of original data and inner products of reconstructed data in the kernel space, which better preserve the similarity information between original data; (3) the KBDSP model is proposed by integrating the block diagonal representation term and similarity-preserving regularizer into the kernel self-expressing frame. The optimization of our proposed model is solved efficiently by utilizing the alternating direction method of multipliers (ADMM). Experimental results on nine datasets demonstrate the effectiveness of the proposed method.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Face and Expression Recognition · Remote Sensing and Land Use · Remote-Sensing Image Classification
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
College of Science, Xi’an Shiyou University, Xi’an 710065, China
Funding
Natural Science Basic Research Plan in Shaanxi Province · Key Research and Development Project of Shaanxi Province
References (42)
Show source-provided references
1. Structured Sparse Subspace Clustering: A Joint Affinity Learning and Subspace Clustering Framework10.1109/TIP.2017.2691557 ↗
2. Automatic subspace clustering of high dimensional data for data mining applications
3. Enforced block diagonal subspace clustering with closed form solution10.1016/j.patcog.2022.108791 ↗
4. Global and local structure preserving nonnegative subspace clustering10.1016/j.patcog.2023.109388 ↗
5. Kernelized transformed subspace clustering with geometric weights for non-linear manifolds10.1016/j.neucom.2022.11.077 ↗
6. Estimation of subspace arrangements with applications in modeling and segmenting mixed data10.1137/060655523 ↗
7. Multi-scale hybrid linear models for lossy image representation10.1109/TIP.2006.882016 ↗
8. Sparse subspace clustering: Algorithm, theory, and applications10.1109/TPAMI.2013.57 ↗
9. Self-learning for face clustering10.1016/j.patcog.2018.02.008 ↗
10. Ho, J., Yang, M.H., Lim, J., Lee, K.C., and Kriegman, D. (2003, January 18–20). Clustering appearances of objects under varying illumination conditions. Proceedings of the 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Madison, WI, USA.
11. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography10.1145/358669.358692 ↗
12. Generalized principal component analysis (GPCA)10.1109/TPAMI.2005.244 ↗
13. Subspace clustering by block diagonal representation10.1109/TPAMI.2018.2794348 ↗
14. Robust kernel low-rank representation10.1109/TNNLS.2015.2472284 ↗
15. Sekmen, A., Koku, B., Parlaktuna, M., Abdul-Malek, A., and Vanamala, N. (2017, January 11–14). Unsupervised deep learning for subspace clustering, in: Big Data (Big Data). Proceedings of the 2017 IEEE International Conference on IEEE, Boston, MA, USA.10.1109/BigData.2017.8258156 ↗
16. Ng, A.Y., Jordan, M.I., and Weiss, Y. (2002, January 9–14). On spectral clustering: Analysis and an algorithm. Proceedings of the Advances in Neural Information Processing Systems, Vancouver, BC, Canada.
17. Robust recovery of subspace structures by low-rank representation10.1109/TPAMI.2012.88 ↗
18. Lu, C.-Y., Min, H., Zhao, Z.-Q., Zhu, L., Huang, D.-S., and Yan, S. (2012, January 7–13). Robust and efficient subspace segmentation via least squares regression. Proceedings of the European Conference on Computer Vision, Florence, Italy.10.1007/978-3-642-33786-4_26 ↗
19. Luo, D., Nie, F., Ding, C., and Huang, H. (2011, January 5–9). Multi-subspace representation and discovery. Proceedings of the Joint European Conference Machine Learning and Knowledge Discovery in Databases, Athens, Greece.10.1007/978-3-642-23783-6_26 ↗
20. Lu, C., Feng, J., Lin, Z., and Yan, S. (2013, January 1–8). Correlation adaptive subspace segmentation by trace lasso. Proceedings of the IEEE International Conference on Computer Vision, Sydney, NSW, Australia.10.1109/ICCV.2013.170 ↗
21. Feng, J., Lin, Z., Xu, H., and Yan, S. (2014, January 23–28). Robust subspace segmentation with block diagonal prior. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.10.1109/CVPR.2014.482 ↗
22. Similarity learning of manifold data10.1109/TCYB.2014.2359984 ↗
23. The manifold ways of perception10.1126/science.290.5500.2268 ↗
24. Kernel-driven similarity learning10.1016/j.neucom.2017.06.005 ↗
25. Ji, P., Reid, I., Garg, R., and Li, H. (2017). Adaptive low-rank kernel subspace clustering. arXiv.
26. Adaptive low-rank kernel block diagonal representation subspace clustering10.1007/s10489-021-02396-1 ↗
27. Wang, J., Saligrama, V., and Castañón, D.A. (2011, January 28–30). Structural similarity and distance in learning. Proceedings of the 2011 49th Annual Allerton Conference on Communication, Control, and Computing (Allerton), Monticello, IL, USA.10.1109/Allerton.2011.6120242 ↗
28. Patel, V.M., Van Nguyen, H., and Vidal, R. (2013, January 1–8). Latent space sparse subspace clustering. Proceedings of the IEEE International Conference on Computer Vision, Sydney, NSW, Australia.10.1109/ICCV.2013.35 ↗
29. Patel, V.M., and Vidal, R. (2014, January 27–30). Kernel sparse subspace clustering. Proceedings of the 2014 IEEE International Conference on Image Processing (ICIP), Paris, France.10.1109/ICIP.2014.7025576 ↗
30. Kernel low rank representation for face recognition10.1016/j.neucom.2014.12.051 ↗
31. Haeffele, B., Young, E., and Vidal, R. (2014, January 21–26). Structured low-rank matrix factorization: Optimality, algorithm, and applications to image processing. Proceedings of the International Conference on Machine Learning, Beijing, China.
32. Similarity Learning via Kernel Preserving Embedding10.1609/aaai.v33i01.33014057 ↗
33. Nonlinear dimensionality reduction by locally linear embedding10.1126/science.290.5500.2323 ↗
34. Clustering with similarity preserving10.1016/j.neucom.2019.07.086 ↗
35. Deep Subspace Clustering10.1109/TNNLS.2020.2968848 ↗
36. Structure Learning with Similarity Preserving10.1016/j.neunet.2020.05.030 ↗
37. Joint correntropy metric weighting and block diagonal regularizer for robust multiple kernel subspace clustering10.1016/j.ins.2019.05.063 ↗
38. Robust multiple kernel subspace clustering with block diagonal representation and low-rank consensus kernel10.1016/j.knosys.2021.107243 ↗
39. Discriminative block diagonal representation learning for image recognition10.1109/TNNLS.2017.2712801 ↗
40. Implicit block diagonal low-rank representation10.1109/TIP.2017.2764262 ↗
41. Block diagonal representation learning for robust subspace clustering10.1016/j.ins.2020.03.103 ↗
42. On a theorem of Wey1 concerning eigenvalues of linear transformations I10.1073/pnas.35.11.652 ↗