journal article·2025-10-16Open access

Optuna-Optimized Pythagorean Fuzzy Deep Neural Network: A Novel Framework for Uncertainty-Aware Image Classification

Asli Kaya Karakutuk, Ozer Ozdemir, Sevil Senturk

Applied Sciences· Volume 15· Issue 20

Abstract

By using Geographic Information Systems, satellite imagery from remote sensing techniques provides quantitative and qualitative data about Earth’s natural and human elements. However, the direct use of raw imagery may prevent the accurate identification of the spectral and temporal characteristics of the target objects. To obtain meaningful results from these data, the object and surface features in the image must be classified correctly. In this context, this study develops a new deep learning approach that includes hyperparameter optimization that considers uncertainty factors when classifying satellite imagery. In the proposed approach, a hybrid architecture called CNN-Pythagorean Fuzzy Deep Neural Network (PFDNN) is developed by combining the ability of convolutional neural networks (CNN) to reveal expressive features with the ability of Pythagorean fuzzy set (PFS) theory to predict uncertainty. In addition, to further improve the model’s success, the hyperparameters are automatically optimized using Optuna. In the experiments conducted on the EuroSAT RGB dataset, the CNN+PFDNN+Optuna model achieved 0.9696 ± 0.0037 accuracy and a macro-AUC value of 0.9983, outperforming other methods such as DNN, FDNN, PFDNN and VGG16+PFDNN. Including the Pythagorean fuzzy layer in the system provided about 13.05% higher accuracy than conventional fuzzy systems. These results show that integrating the Pythagorean fuzzy set approach into deep learning models contributes to more effective management of uncertainties in remote sensing data and that hyperparameter optimization significantly impacts model performance.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Fuzzy Logic and Control Systems

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Office of the Rector, Eskisehir Technical University, 2 Eylul Campus, 26555 Eskisehir, Türkiye

Department of Statistics, Eskisehir Technical University, Yunus Emre Campus, 26470 Eskisehir, Türkiye

References (55)

Show source-provided references
1. A survey of image classification methods and techniques for improving classification performance10.1080/01431160600746456 ↗
2. Exploring the use of Google Earth imagery and object-based methods in land use/cover mapping10.3390/rs5116026 ↗
3. Multi-class geospatial object detection and geographic image classification based on collection of part detectors10.1016/j.isprsjprs.2014.10.002 ↗
4. Transferring deep convolutional neural networks for the scene classification of high-resolution remote sensing imagery10.3390/rs71114680 ↗
5. Deep learning in remote sensing: A comprehensive review and list of resources10.1109/MGRS.2017.2762307 ↗
6. Random Forest in remote sensing: A review of applications and future directions10.1016/j.isprsjprs.2016.01.011 ↗
7. İmge sınıflandırması için yeni öznitelik çıkarım yöntemi: Add-Tda algısal özet fonksiyonu tabanlı evrişimsel sinir ağ (Add-TdaEsa)
8. Deep learning in remote sensing applications: A meta-analysis and review10.1016/j.isprsjprs.2019.04.015 ↗
9. Transfer learning with convolutional neural networks for classification of remote sensing images10.4316/AECE.2023.04004 ↗
10. Huo, Y., Gang, S., and Guan, C. (2023). FCIHMRT: Feature Cross-Layer Interaction Hybrid Method Based on Res2Net and Transformer for Remote Sensing Scene Classification. Electronics, 12.10.3390/electronics12204362 ↗
11. Pythagorean fuzzy C-means algorithm for image segmentation10.1002/int.22339 ↗
12. Akiba, T., Sano, S., Yanase, T., Ohta, T., and Koyama, M. (2019, January 4–8). Optuna: A next-generation hyperparameter optimization framework. Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, New York, NY, USA.10.1145/3292500.3330701 ↗
13. Derin sinir ağları kullanılarak koyun-keçi çiçeği hastalığının tespiti ve sınıflandırılması için hibrit bir yaklaşım
14. Fuzzy restricted Boltzmann machine for the enhancement of deep learning10.1109/TFUZZ.2015.2406889 ↗
15. Airline passenger profiling based on fuzzy deep machine learning10.1109/TNNLS.2016.2609437 ↗
16. Chopade, H.A., and Narvekar, M. (2017, January 23–24). Hybrid auto text summarization using deep neural network and fuzzy logic system. Proceedings of the 2017 İnternational Conference on İnventive Computing and İnformatics (ICICI), Coimbatore, India.10.1109/ICICI.2017.8365192 ↗
17. Yazdanbakhsh, O., and Dick, S. (2019). A deep neuro-fuzzy network for image classification. arXiv.
18. Price, S.R., Price, S.R., and Anderson, D.T. (2019, January 23–26). Introducing fuzzy layers for deep learning. Proceedings of the 2019 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE), New Orleans, LA, USA.10.1109/FUZZ-IEEE.2019.8858790 ↗
19. Application of fuzzy deep neural networks for COVID-19 diagnosis through chest radiographs10.12688/f1000research.126197.1 ↗
20. Atanassov, K., Sotirov, S., and Pencheva, T. (2023). Intuitionistic fuzzy deep neural network. Mathematics, 11.10.3390/math11030716 ↗
21. Mathematical modeling and simulation of traffic flow control in urban environments using fuzzy deep neural network with optimization algorithm10.1109/ACCESS.2024.3483846 ↗
22. Wu, S.Y., Li, R.Z., Song, Y.Q., Qin, S.J., Wen, Q.Y., and Gao, F. (2024). A hierarchical fused quantum fuzzy neural network for image classification. arXiv.
23. Yeganejou, M., Honari, K., Kluzinski, R., Dick, S., Lipsett, M., and Miller, J. (2023). DCNFIS: Deep convolutional neuro-fuzzy inference system. arXiv.
24. Hierarchical fuzzy deep learning for image classification
25. Remote sensing image segmentation based on the fuzzy deep convolutional neural network10.1080/01431161.2021.1938738 ↗
26. Land cover classification of high-resolution remote sensing images based on interval Type-2 fuzzy convolutional neural network
27. Fuzzy deep learning for the diagnosis of Alzheimer’s Disease: Approaches and challenges10.1109/TFUZZ.2024.3409412 ↗
28. Modeling of hyperparameter tuned fuzzy deep neural network-based human activity recognition for disabled people10.1155/2024/5551009 ↗
29. Kaya Karakutuk, A., and Ozdemir, O. (2025). A novel fuzzy kernel extreme learning machine algorithm in classification problems. Appl. Sci., 15.10.3390/app15084506 ↗
30. Lyons, M.J. (2021). “Excavating AI” re-excavated: Debunking a fallacious account of the JAFFE dataset. arXiv.10.31234/osf.io/bvf2s ↗
31. Lyons, M.J., Kamachi, M., and Gyoba, J. (2020). Coding facial expressions with Gabor wavelets (IVC Special Issue). arXiv.
32. Review of Deep Learning Methods for Remote Sensing Satellite Images Classification: Experimental Survey and Comparative Analysis10.1186/s40537-023-00772-x ↗
33. Sumbul, G., Charfuelan, M., Demir, B., and Markl, V. (August, January 28). BigEarthNet: A Large-Scale Benchmark Archive for Remote Sensing Image Understanding. Proceedings of the 2019 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Yokohama, Japan.10.1109/IGARSS.2019.8900532 ↗
34. Chapelle, C. (2019). Formulaic Language and Collocation. The Concise Encyclopaedia of Applied Linguistics, Wiley-Blackwell.
35. Hoeser, T., Bachofer, F., and Kuenzer, C. (2020). Object Detection and Image Segmentation with Deep Learning on Earth Observation Data: A Review—Part II: Applications. Remote Sens., 12.10.3390/rs12183053 ↗
36. Helber, P., Bischke, B., Dengel, A., and Borth, D. (2018, January 22–27). Introducing EuroSAT: A novel dataset and deep learning benchmark for land use and land cover classification. Proceedings of the IGARSS 2018—2018 IEEE International Geoscience and Remote Sensing Symposium, Valencia, Spain.10.1109/IGARSS.2018.8519248 ↗
37. EuroSAT: A novel dataset and deep learning benchmark for land use and land cover classification10.1109/JSTARS.2019.2918242 ↗
38. (2025, March 25). EuroSAT Dataset. Available online: https://zenodo.org/records/7711810.
39. Gonzalez, R.C., and Woods, R.E. (2018). Digital Image Processing, Pearson Education. [4th ed.].
40. Distinctive image features from scale-invariant keypoints10.1023/B:VISI.0000029664.99615.94 ↗
41. ImageNet classification with deep convolutional neural networks
42. O’Shea, K., and Nash, R. (2015). An introduction to convolutional neural networks. arXiv.
43. Zadeh, L.A. (1996). Fuzzy sets. Fuzzy Sets, Fuzzy Logic, and Fuzzy Systems: Selected Papers, World Scientific.10.1142/9789814261302_0001 ↗
44. Intuitionistic fuzzy sets10.1016/S0165-0114(86)80034-3 ↗
45. A novel ranking approach based on incircle of triangular intuitionistic fuzzy numbers
46. Yager, R.R. (2013, January 24–28). Pythagorean fuzzy subsets. Proceedings of the 2013 Joint IFSA World Congress and NAFIPS Annual Meeting (IFSA/NAFIPS), Edmonton, AB, Canada.10.1109/IFSA-NAFIPS.2013.6608375 ↗
47. Parameter reduction method for Pythagorean fuzzy soft sets10.32323/ujma.615166 ↗
48. Ahmadi, M., Soofiabadi, M., Nikpour, M., Naderi, H., Abdullah, L., and Arandian, B. (2022). Developing a deep neural network with fuzzy wavelets and integrating an inline PSO to predict energy consumption patterns in urban buildings. Mathematics, 10.10.3390/math10081270 ↗
49. Prediction of cloud resources demand based on hierarchical Pythagorean fuzzy deep neural network10.1109/TSC.2019.2906901 ↗
50. Random search for hyper-parameter optimization
51. Development of a convolutional neural network to accurately detect land use and land cover10.1016/j.mex.2024.102719 ↗
52. Improving LULC classification from satellite imagery using deep learning—EuroSAT dataset10.5194/isprs-archives-XLIII-B3-2021-369-2021 ↗
53. Östman, J., Corrado, R., Hilton, J., and Theodorou, A. (2023). Decentralised semi-supervised onboard learning for scene classification in low-Earth orbit. arXiv.
54. Cheon, M. (2024). Kolmogorov-Arnold network for satellite image classification in remote sensing. arXiv.
55. Land use classification of satellite images with convolutional neural networks (CNNs)