A Multi-Scale Unsupervised Feature Extraction Network with Structured Layer-Wise Decomposition
Source abstract
Abstract
Recent developments in deep learning have underscored prizing effective feature extraction in scenarios with limited or unlabeled data. This study introduces a novel unsupervised multi-scale feature extraction framework based on a multi-branch auto-encoder architecture. The proposed method decomposes input images into smooth, detailed and residual components, using variational loss functions to ensure that each branch captures distinct and non-overlapping representations. This decomposition enhances the information richness of input data while preserving its structural integrity, making it especially beneficial for grayscale or low-resolution images. Experimental results on classification and image segmentation tasks show that the proposed method enhances model performance by enriching input representations. Its architecture is scalable and adaptable, making it applicable to a wide range of machine learning tasks beyond image classification and segmentation. These findings highlight the proposed method’s utility as a robust, general-purpose solution for unsupervised feature extraction and multi-scale representation learning.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Anomaly Detection Techniques and Applications · Face and Expression Recognition · Image Retrieval and Classification Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Computer Engineering, Ankara Yıldırım Beyazıt University, Ankara 06010, Türkiye
Department of Computer Engineering, National Defense University, Ankara 06654, Türkiye
References (53)
Show source-provided references
1. Chen, L., Li, S., Bai, Q., Yang, J., Jiang, S., and Miao, Y. (2021). Review of Image Classification Algorithms Based on Convolutional Neural Networks. Remote Sens., 13.10.3390/rs13224712 ↗
2. Multiscale Representation Learning for Image Classification: A Survey10.1109/TAI.2021.3135248 ↗
3. Methods for Image Denoising Using Convolutional Neural Network: A Review10.1007/s40747-021-00428-4 ↗
4. Object Detection in 20 Years: A Survey10.1109/JPROC.2023.3238524 ↗
5. Li, Z., Wang, Y., Zhang, N., Zhang, Y., Zhao, Z., Xu, D., Ben, G., and Gao, Y. (2022). Deep Learning-Based Object Detection Techniques for Remote Sensing Images: A Survey. Remote Sens., 14.10.3390/rs14102385 ↗
6. Yu, Y., Wang, C., Fu, Q., Kou, R., Huang, F., Yang, B., Yang, T., and Gao, M. (2023). Techniques and Challenges of Image Segmentation: A Review. Electronics, 12.10.3390/electronics12051199 ↗
7. Image Segmentation Using Deep Learning: A Survey
8. Artificial Intelligence for Decision Support Systems in the Field of Operations Research: Review and Future Scope of Research10.1007/s10479-020-03856-6 ↗
9. Nguyen, Q.-T., Tran, T.N., Heuchenne, C., and Tran, K.P. (2022). Decision Support Systems for Anomaly Detection with the Applications in Smart Manufacturing: A Survey and Perspective. Machine Learning and Probabilistic Graphical Models for Decision Support Systems, CRC Press.10.1201/9781003189886-3 ↗
10. Transformers in Medical Imaging: A Survey10.1016/j.media.2023.102802 ↗
11. Pinto-Coelho, L. (2023). How Artificial Intelligence Is Shaping Medical Imaging Technology: A Survey of Innovations and Applications. Bioengineering, 10.10.20944/preprints202311.1366.v1 ↗
12. A Survey on Human Face Expression Recognition Techniques10.1016/j.jksuci.2018.09.002 ↗
13. Understanding Deep Learning Techniques for Recognition of Human Emotions Using Facial Expressions: A Comprehensive Survey10.1109/TIM.2023.3243661 ↗
14. Aleissaee, A.A., Kumar, A., Anwer, R.M., Khan, S., Cholakkal, H., Xia, G.-S., and Khan, F.S. (2023). Transformers in Remote Sensing: A Survey. Remote Sens., 15.10.3390/rs15071860 ↗
15. Janga, B., Asamani, G.P., Sun, Z., and Cristea, N. (2023). A Review of Practical AI for Remote Sensing in Earth Sciences. Remote Sens., 15.10.3390/rs15164112 ↗
16. Dalal, N., and Triggs, B. (2005, January 20–25). Histograms of Oriented Gradients for Human Detection. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), San Diego, CA, USA.
17. Burger, W., and Burge, M.J. (2022). Scale-Invariant Feature Transform (SIFT). Digital Image Processing: An Algorithmic Introduction, Springer International Publishing.10.1007/978-3-031-05744-1_25 ↗
18. Gabor Filter-Based Edge Detection10.1016/0031-3203(92)90121-X ↗
19. Gaussian Filters for Nonlinear Filtering Problems10.1109/9.855552 ↗
20. A Neighbourhood Feature-Based Local Binary Pattern for Texture Classification10.1007/s00371-023-03041-3 ↗
21. A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospects10.1109/TNNLS.2021.3084827 ↗
22. A Survey of Transformers10.1016/j.aiopen.2022.10.001 ↗
23. Pinheiro Cinelli, L., Araújo Marins, M., Barros da Silva, E.A., and Lima Netto, S. (2021). Variational Autoencoder. Variational Methods for Machine Learning with Applications to Deep Networks, Springer International Publishing.10.1007/978-3-030-70679-1 ↗
24. Liu, H., Li, I., Liang, Y., Sun, D., Yang, Y., and Yang, H. (2024, January 28–30). Research on Deep Learning Model of Feature Extraction Based on Convolutional Neural Network. Proceedings of the 2024 IEEE 2nd International Conference on Image Processing and Computer Applications (ICIPCA), Shenyang, China.10.1109/ICIPCA61593.2024.10709168 ↗
25. MRFE-CNN: Multi-Route Feature Extraction Model for Breast Tumor Segmentation in Mammograms Using a Convolutional Neural Network10.1007/s10479-022-04755-8 ↗
26. Convolutional Neural Networks for Texture Feature Extraction: Applications to Leaf Disease Classification in Precision Agriculture10.1109/ACCESS.2021.3131002 ↗
27. Multiscale Superpixelwise Prophet Model for Noise-Robust Feature Extraction in Hyperspectral Images
28. Traffic Sign Detection Based on Multi-Scale Feature Extraction and Cascade Feature Fusion10.1007/s11227-022-04670-6 ↗
29. Extended Feature Pyramid Network for Small Object Detection10.1109/TMM.2021.3074273 ↗
30. Multiscale Feature Extraction and Fusion of Image and Text in VQA10.1007/s44196-023-00233-6 ↗
31. Lei, D., Ran, G., Zhang, L., and Li, W. (2022). A Spatiotemporal Fusion Method Based on Multiscale Feature Extraction and Spatial Channel Attention Mechanism. Remote Sens., 14.10.3390/rs14030461 ↗
32. Attention-Guided Feature Extraction and Multiscale Feature Fusion 3D ResNet for Automated Pulmonary Nodule Detection10.1109/ACCESS.2022.3182104 ↗
33. A Residual Multi-Scale Feature Extraction Network with Hybrid Loss for Low-Dose Computed Tomography Image Denoising10.1007/s11760-023-02809-3 ↗
34. Learning a Deep Multi-Scale Feature Ensemble and an Edge-Attention Guidance for Image Fusion10.1109/TCSVT.2021.3056725 ↗
35. SR-RDFAN-LOG: Arbitrary-Scale Logging Image Super-Resolution Reconstruction Based on Residual Dense Feature Aggregation10.1016/j.geoen.2024.213042 ↗
36. Multiscale-Multichannel Feature Extraction and Classification through One-Dimensional Convolutional Neural Network for Speech Emotion Recognition10.1016/j.specom.2023.103010 ↗
37. EMANet: An Ancient Text Detection Method Based on Enhanced-EfficientNet and Multi-Dimensional Scale Fusion10.1109/JIOT.2024.3423667 ↗
38. MEF-UNet: An End-to-End Ultrasound Image Segmentation Algorithm Based on Multi-Scale Feature Extraction and Fusion10.1016/j.compmedimag.2024.102370 ↗
39. Zhong, Y., Chen, T., Zhong, D., and Liu, X. (2024). Vessel Segmentation in Fundus Images with Multi-Scale Feature Extraction and Disentangled Representation. Appl. Sci., 14.10.3390/app14125039 ↗
40. Zhang, C., Zhang, Y., and Lin, H. (2023). Multi-Scale Feature Interaction Network for Remote Sensing Change Detection. Remote Sens., 15.10.3390/rs15112880 ↗
41. Sheng, H., Zhang, Y., Zhang, W., Wei, S., Xu, M., and Muhammad, Y. (2024). ME-FCN: A Multi-Scale Feature-Enhanced Fully Convolutional Network for Building Footprint Extraction. Remote Sens., 16.10.3390/rs16224305 ↗
42. Unsupervised Remote Sensing Image Retrieval Using Probabilistic Latent Semantic Hashing
43. Multi-Scale and Multi-Direction Feature Extraction Network for Hyperspectral and LiDAR Classification10.1109/JSTARS.2024.3400872 ↗
44. Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep Learning, MIT Press.
45. Nonlinear Total Variation Based Noise Removal Algorithms10.1016/0167-2789(92)90242-F ↗
46. Loss Functions for Image Restoration with Neural Networks10.1109/TCI.2016.2644865 ↗
47. Krizhevsky, A., Nair, V., and Hinton, G. (2009). CIFAR-10, Technical Report; Canadian Institute for Advanced Research.
48. Armato, S.G., McLennan, G., Bidaut, L., McNitt-Gray, M.F., Meyer, C.R., Reeves, A.P., Zhao, B., Aberle, D.R., Henschke, C.I., and Hoffman, E.A. (2025, June 15). Data From LIDC-IDRI [Data set]. The Cancer Imaging Archive, Available online: https://www.cancerimagingarchive.net/collection/lidc-idri/.
49. Kaggle (2025, June 15). Finding Lungs in CT Data. Available online: https://www.kaggle.com/datasets/kmader/finding-lungs-in-ct-data/data.
50. Liu, H., Brailsford, T., and Bull, L. (2024, January 17–19). ResNet18 Performance: Impact of Network Depth and Image Resolution on Image Classification. Proceedings of the 2024 8th International Conference on Advances in Artificial Intelligence, London, UK.10.1145/3704137.3704173 ↗
51. Koonce, B. (2021). ResNet 50. Convolutional Neural Networks with Swift for TensorFlow: Image Recognition and Dataset Categorization, Apress.10.1007/978-1-4842-6168-2 ↗
52. Dong, K., Zhou, C., Ruan, Y., and Li, Y. (2020, January 18–20). MobileNetV2 Model for Image Classification. Proceedings of the 2020 2nd International Conference on Information Technology and Computer Application (ITCA), Guangzhou, China.10.1109/ITCA52113.2020.00106 ↗
53. U-Net: Convolutional Networks for Biomedical Image Segmentation