A Frequency Domain Kernel Function-Based Manifold Dimensionality Reduction and Its Application for Graph-Based Semi-Supervised Classification
Source abstract
Abstract
With the increasing demand for high-resolution images, handling high-dimensional image data has become a key aspect of intelligence algorithms. One effective approach is to preserve the high-dimensional manifold structure of the data and find the accurate mappings in a lower-dimensional space. However, various non-sparse, high-energy occlusions in real-world images can lead to erroneous calculations of sample relationships, invalidating the existing distance-based manifold dimensionality reduction techniques. Many types of noise are difficult to capture and filter in the original domain but can be effectively separated in the frequency domain. Inspired by this idea, a novel approach is proposed in this paper, which obtains the high-dimensional manifold structure according to the correlationships between data points in the frequency domain and accurately maps it to a lower-dimensional space, named Frequency domain-based Manifold Dimensionality Reduction (FMDR). In FMDR, samples are first transformed into frequency domains. Then, interference is filtered based on the distribution in the frequency domain, thereby emphasizing discriminative features. Subsequently, an innovative kernel function is proposed for measuring the similarities between samples according to the correlationships in the frequency domain. With the assistance of these correlationships, a graph structure can be constructed and utilized to find the mapping in a low-dimensional space. To further demonstrate the effectiveness of the proposed algorithm, FMDR is employed for the semi-supervised classification problems in this paper. Experiments using public image datasets indicate that, compared to baseline algorithms and state-of-the-art methods, our approach achieves superior recognition performance. Even with very few labeled data, the advantages of FMDR are still maintained. The effectiveness of FMDR in dimensionality reduction and feature extraction of images makes it widely applicable in fields such as image processing and image recognition.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Face and Expression Recognition · Image Retrieval and Classification Techniques · Advanced Image and Video Retrieval Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Integrated Circuits, Guangdong University of Technology, Guangzhou 510006, China
School of Automation, Guangdong University of Technology, Guangzhou 510006, China
School of Biomedical and Phamaceutical Sicences, Guangdong University of Technology, Guangzhou 510006, China
School of Advanced Manufacturing, Guangdong University of Technology, Jieyang 515200, China
Funding
Key-Area Research and Development Program of Guangdong Province
References (40)
Show source-provided references
1. Toward a Quantitative Survey of Dimension Reduction Techniques10.1109/TVCG.2019.2944182 ↗
2. Object detection in optical remote sensing images: A survey and a new benchmark10.1016/j.isprsjprs.2019.11.023 ↗
3. Köppen, M. (2000, January 4–18). The curse of dimensionality. Proceedings of the 5th Online World Conference on Soft Computing in Industrial Applications (WSC5), Online.
4. Comparison of dimensionality reduction techniques for multi-variable spatiotemporal flow fields10.1016/j.oceaneng.2023.116421 ↗
5. Zeng, C., Xia, S., Wang, Z., and Wan, X. (2023). Multi-Channel Representation Learning Enhanced Unfolding Multi-Scale Compressed Sensing Network for High Quality Image Reconstruction. Entropy, 25.10.3390/e25121579 ↗
6. Vieira Sobrinho, J.L., Teles Vieira, F.H., and Assis Cardoso, A. (2024). Two-Stage Dimensionality Reduction for Social Media Engagement Classification. Appl. Sci., 14.10.3390/app14031269 ↗
7. Al-khassaweneh, M., Bronakowski, M., and Al-Sharoa, E. (2023). Multivariate and Dimensionality-Reduction-Based Machine Learning Techniques for Tumor Classification of RNA-Seq Data. Appl. Sci., 13.10.3390/app132312801 ↗
8. Barkalov, K., Shtanyuk, A., and Sysoyev, A. (2022). A Fast kNN Algorithm Using Multiple Space-Filling Curves. Entropy, 24.10.3390/e24060767 ↗
9. Li, J., Li, Y., and Li, C. (2024). Dual-Graph-Regularization Constrained Nonnegative Matrix Factorization with Label Discrimination for Data Clustering. Mathematics, 12.10.3390/math12010096 ↗
10. González-Díaz, Y., Martínez-Trinidad, J.F., Carrasco-Ochoa, J.A., and Lazo-Cortés, M.S. (2024). An Algorithm for Computing All Rough Set Constructs for Dimensionality Reduction. Mathematics, 12.10.3390/math12010090 ↗
11. Heidarian Dehkordi, R., Candiani, G., Nutini, F., Carotenuto, F., Gioli, B., Cesaraccio, C., and Boschetti, M. (2024). Towards an Improved High-Throughput Phenotyping Approach: Utilizing MLRA and Dimensionality Reduction Techniques for Transferring Hyperspectral Proximal-Based Model to Airborne Images. Remote Sens., 16.10.3390/rs16030492 ↗
12. Yao, C., Zheng, L., Feng, L., Yang, F., Guo, Z., and Ma, M. (2023). A Collaborative Superpixelwise Autoencoder for Unsupervised Dimension Reduction in Hyperspectral Images. Remote Sens., 15.10.3390/rs15174211 ↗
13. Islam, M.R., Siddiqa, A., Ibn Afjal, M., Uddin, M.P., and Ulhaq, A. (2023). Hyperspectral Image Classification via Information Theoretic Dimension Reduction. Remote Sens., 15.10.3390/rs15041147 ↗
14. Linear discriminant analysis: A detailed tutorial10.3233/AIC-170729 ↗
15. Principal component analysis10.1038/s43586-022-00184-w ↗
16. Block-sparse RPCA for salient motion detection10.1109/TPAMI.2014.2314663 ↗
17. Shi, S., Xu, Y., Xu, X., Mo, X., and Ding, J. (2023). A Preprocessing Manifold Learning Strategy Based on t-Distributed Stochastic Neighbor Embedding. Entropy, 25.10.3390/e25071065 ↗
18. Li, H., Cui, J., Zhang, X., Han, Y., and Cao, L. (2022). Dimensionality Reduction and Classification of Hyperspectral Remote Sensing Image Feature Extraction. Remote Sens., 14.10.3390/rs14184579 ↗
19. Das, S., Routray, A., and Deb, A.K. (2018). Fast Semi-Supervised Unmixing of Hyperspectral Image by Mutual Coherence Reduction and Recursive PCA. Remote Sens., 10.10.3390/rs10071106 ↗
20. Wright, J., Ganesh, A., Rao, S., Peng, Y., and Ma, Y. (2009). Robust principal component analysis: Exact recovery of corrupted low-rank matrices via convex optimization. Advances in Neural Information Processing Systems, Neural Information Processing Systems.
21. A global geometric framework for nonlinear dimensionality reduction10.1126/science.290.5500.2319 ↗
22. Nonlinear dimensionality reduction by locally linear embedding10.1126/science.290.5500.2323 ↗
23. Laplacian eigenmaps for dimensionality reduction and data representation10.1162/089976603321780317 ↗
24. A frequency domain-based machine learning architecture for short-term wave height forecasting10.1016/j.oceaneng.2023.115844 ↗
25. Stuchi, J.A., Angeloni, M.A., Pereira, R.F., Boccato, L., Folego, G., Prado, P.V.S., and Attux, R.R.F. (2017, January 25–28). Improving image classification with frequency domain layers for feature extraction. Proceedings of the 2017 IEEE 27th International Workshop on Machine Learning for Signal Processing (MLSP), Tokyo, Japan.10.1109/MLSP.2017.8168168 ↗
26. Song, W., Zhang, X., Chen, Y., Xu, H., Wang, L., and Wang, Y. (2024). Dimensionality Reduction and Research of Hyperspectral Remote Sensing Images Based on Manifold Learning. Preprints, 2024011274.10.20944/preprints202401.1274.v1 ↗
27. Contrastive Learning Dimensionality Reduction Method Based on Manifold Learning10.56028/aetr.9.1.522.2024 ↗
28. Dual-Path Attention Network for Compressed Sensing Image Reconstruction10.1109/TIP.2020.3023629 ↗
29. Xiaojin, Z. (2003, January 23–24). Semi-supervised learning using gaussian fields and harmonic functions. Proceedings of the International Conference on Machine Learning, Los Angeles, CA, USA.
30. Zheng, J. (2023). Targeted Image Reconstruction by Sampling Pre-trained Diffusion Model. Intelligent Systems and Applications, Proceedings of the Intelligent Systems Conference, Amsterdam, The Netherlands, 7–8 September 2023, Springer.
31. Ji, P., Reid, I., Garg, R., Li, H., and Salzmann, M. (2017). Adaptive low-rank kernel subspace clustering. arXiv.
32. Martinez, A., and Benavente, R. (1998). The AR Face Database: CVC Technical Report, 24, CVC.
33. Eigenfaces vs. fisherfaces: Recognition using class specific linear projection10.1109/34.598228 ↗
34. From few to many: Illumination cone models for face recognition under variable lighting and pose10.1109/34.927464 ↗
35. Chang, Y., and Liu, H. (2011, January 27–29). Semi-supervised classification algorithm based on the KNN. Proceedings of the 2011 IEEE 3rd International Conference on Communication Software and Networks, Xi’an, China.10.1109/ICCSN.2011.6014376 ↗
36. Semi-supervised k-means++10.1080/00949655.2017.1327588 ↗
37. Shahid, N., Kalofolias, V., Bresson, X., Bronstein, M., and Vandergheynst, P. (2015, January 7–13). Robust principal component analysis on graphs. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.10.1109/ICCV.2015.322 ↗
38. Lee, D., and Seung, H.S. (2000). Algorithms for non-negative matrix factorization. Advances in Neural Information Processing Systems, Neural Information Processing Systems.
39. Semi-supervised non-negative matrix tri-factorization with adaptive neighbors and block-diagonal learning10.1016/j.engappai.2023.106043 ↗
40. Ye, F., Chen, C., and Zheng, Z. (2018, January 22–26). Deep autoencoder-like nonnegative matrix factorization for community detection. Proceedings of the 27th ACM International Conference on Information and Knowledge Management, Turin, Italy.10.1145/3269206.3271697 ↗