Multiscale and Auto-Tuned Semi-Supervised Deep Subspace Clustering and Its Application in Brain Tumor Clustering
Source abstract
Abstract
In this paper, we introduce a novel Multi-scale and Auto-tuned Semi-supervised Deep Subspace Clustering (MAS-DSC) algorithm, aimed at addressing the challenges of deep subspace clustering in high-dimensional real-world data, particularly in the field of medical imaging. Traditional deep subspace clustering algorithms, which are mostly unsupervised, are limited in their ability to effectively utilize the inherent prior knowledge in medical images. Our MAS-DSC algorithm incorporates a semi-supervised learning framework that uses a small amount of labeled data to guide the clustering process, thereby enhancing the discriminative power of the feature representations. Additionally, the multi-scale feature extraction mechanism is designed to adapt to the complexity of medical imaging data, resulting in more accurate clustering performance. To address the difficulty of hyperparameter selection in deep subspace clustering, this paper employs a Bayesian optimization algorithm for adaptive tuning of hyperparameters related to subspace clustering, prior knowledge constraints, and model loss weights. Extensive experiments on standard clustering datasets, including ORL, Coil20, and Coil100, validate the effectiveness of the MAS-DSC algorithm. The results show that with its multi-scale network structure and Bayesian hyperparameter optimization, MAS-DSC achieves excellent clustering results on these datasets. Furthermore, tests on a brain tumor dataset demonstrate the robustness of the algorithm and its ability to leverage prior knowledge for efficient feature extraction and enhanced clustering performance within a semi-supervised learning framework.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Brain Tumor Detection and Classification · Advanced Computing and Algorithms · Face and Expression Recognition
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (59)
Show source-provided references
1. An easy-to-hard learning paradigm for multiple classes and multiple labels
2. Masked face recognition dataset and application10.1109/TBIOM.2023.3242085 ↗
3. Learning meta face recognition in unseen domains
4. Sentiment analysis of comment texts based on BiLSTM10.1109/ACCESS.2019.2909919 ↗
5. Unsupervised segmentation of natural images via lossy data compression10.1016/j.cviu.2007.07.005 ↗
6. Segmentation of multivariate mixed data via lossy data coding and compression10.1109/TPAMI.2007.1085 ↗
7. Motion segmentation by subspace separation and model selection
8. Sparse subspace clustering
9. Clustering appearances of objects under varying illumination conditions
10. Sparse subspace clustering: Algorithm, theory, and applications10.1109/TPAMI.2013.57 ↗
11. Unsupervised deep embedding for clustering analysis
12. Discriminatively boosted image clustering with fully convolutional auto-encoders10.1016/j.patcog.2018.05.019 ↗
13. Deep clustering via joint convolutional autoencoder embedding and relative entropy minimization
14. CNN-based joint clustering and representation learning with feature drift compensation for large-scale image data10.1109/TMM.2017.2745702 ↗
15. Deep subspace clustering networks
16. CBTRUS statistical report: Primary brain and other central nervous system tumors diagnosed in the United States in 2014–201810.1093/neuonc/noab200 ↗
17. Differentiating glioblastoma multiforme from brain metastases using multidimensional radiomics features derived from MRI and multiple machine learning models10.1155/2022/2016006 ↗
18. Deep residual learning for image recognition
19. Going deeper with convolutions
20. Y. Ren et al., “Deep clustering: A comprehensive survey,” 2022. Accessed: April 17, 2024. [Online]. Available: https://arxiv.org/pdf/2210.04142.pdf
21. Treatment of brain metastases10.1200/JCO.2015.60.9503 ↗
22. European Association for Neuro-Oncology (EANO) guideline on the diagnosis and treatment of adult astrocytic and oligodendroglial gliomas10.1016/S1470-2045(17)30194-8 ↗
23. Robust recovery of subspace structures by low-rank representation10.1109/TPAMI.2012.88 ↗
24. Structured sparse subspace clustering: A unified optimization framework
25. Subspace clustering for high dimensional data: A review10.1145/1007730.1007731 ↗
26. Towards K-means-friendly spaces: Simultaneous deep learning and clustering
27. Deep auto-encoder based clustering10.3233/IDA-140709 ↗
28. Hierarchical hashing learning for image set classification10.1109/TIP.2023.3251025 ↗
29. Pseudo-supervised deep subspace clustering10.1109/TIP.2021.3079800 ↗
30. Cross-view graph matching guided anchor alignment for incomplete multi-view clustering10.1016/j.inffus.2023.101941 ↗
31. Deep variational clustering framework for self-labeling large-scale medical images
32. A feature space learning model based on semi-supervised clustering
33. Self-weighted multiple kernel learning for graph-based clustering and semi-supervised classification
34. Very deep convolutional networks for large-scale image recognition
35. Rethinking the inception architecture for computer vision
36. Transfer learning for medical image classification: A literature review10.1186/s12880-022-00793-7 ↗
37. Multimodal and multiscale deep neural networks for the early diagnosis of Alzheimer’s disease using structural MR and FDG-PET images10.1038/s41598-018-22871-z ↗
38. R. K. Srivastava, K. Greff, and J. Schmidhuber, “Highway networks,” 2015. Accessed: Apr. 18, 2024. [Online]. Available: https://arxiv.org/pdf/1505.00387.pdf
39. ResNet and its application to medical image processing: Research progress and challenges10.1016/j.cmpb.2023.107660 ↗
40. Densely connected convolutional networks
41. Densely connected convolutional networks for detection of atrial fibrillation from short single-lead ECG recordings10.1016/j.jelectrocard.2018.08.008 ↗
42. Image super-resolution with densely connected convolutional networks10.1007/s10489-018-1234-y ↗
43. A fast grid search method in support vector regression forecasting time series
44. Random search for hyper-parameter optimization
45. Evolutionary ensembles with negative correlation learning10.1109/4235.887237 ↗
46. S. Hansen, “Using deep Q-learning to control optimization hyperparameters,” 2016. Accessed: Apr. 18, 2024. [Online]. Available: https://arxiv.org/pdf/1602.04062.pdf
47. Algorithms for hyper-parameter optimization
48. Bayesian optimization with expensive integrands10.1137/19M1303125 ↗
49. Parameterisation of a stochastic model for human face identification
50. Nene · Technical Report No. CUCS-006-96 · 1996
51. The Hungarian method for the assignment problem10.1002/nav.3800020109 ↗
52. D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” 2014. Accessed: April 18, 2024. [Online]. Available: https://arxiv.org/pdf/1412.6980.pdf
53. Low rank subspace clustering (LRSC)10.1016/j.patrec.2013.08.006 ↗
54. Kernel sparse subspace clustering
55. Scalable sparse subspace clustering by orthogonal matching pursuit
56. Efficient dense subspace clustering
57. Deep subspace clustering10.1109/TNNLS.2020.2968848 ↗
58. Deep self-representative subspace clustering network10.1016/j.patcog.2021.108041 ↗
59. Adaptive attribute and structure subspace clustering network10.1109/TIP.2022.3171421 ↗