journal article·2023-07-05Open access

Cross-Domain Transfer Learning for Natural Scene Classification of Remote-Sensing Imagery

Muhammad Akhtar, Iqbal Murtza, Muhammad Adnan, Ayesha Saadia

Applied Sciences· Volume 13· Issue 13

Abstract

Natural scene classification, which has potential applications in precision agriculture, environmental monitoring, and disaster management, poses significant challenges due to variations in the spatial resolution, spectral resolution, texture, and size of remotely sensed images of natural scenes on Earth. For such challenging problems, deep-learning-based algorithms have demonstrated amazing performances in recent years. Among these methodologies, transfer learning is a useful technique which employs the learned features already extracted from the pre-trained models from large-scale datasets for the problem at hand, resulting in quicker and more accurate models. In this study, we deployed cross-domain transfer learning for the land-cover classification of remotely sensed images of natural scenes. We conducted extensive experiments to measure the performance of the proposed method and explored the factors that affect the performance of the models. Our findings suggest that fine-tuning the ResNet-50 model outperforms various other models in terms of the classification accuracy. The experimental results showed that the deployed cross-domain transfer-learning system achieved outstanding (99.5% and 99.1%) accurate performances compared to previous benchmarks on the NaSC-TG2 dataset with the final tuning of the whole structure and only the last three layers, respectively.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Remote-Sensing Image Classification · Remote Sensing and Land Use · Remote Sensing in Agriculture

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Faculty of Computing & AI, Air University, Islamabad 44000, Pakistan

Department of Technology and Safety, UiT The Arctic University of Norway, 9019 Tromsø, Norway

References (30)

Show source-provided references
1. Remote Sensing Image Scene Classification: Advances and Open Challenges10.3390/geomatics3010007 ↗
2. Deep learning for remote sensing image classification: A survey10.1002/widm.1264 ↗
3. Current trends in deep learning for Earth Observation: An open-source benchmark arena for image classification10.1016/j.isprsjprs.2023.01.014 ↗
4. Remote sensing image scene classification meets deep learning: Challenges, methods, benchmarks, and opportunities10.1109/JSTARS.2020.3005403 ↗
5. A literature review on remote sensing scene categorization based on convolutional neural networks10.1080/01431161.2023.2204200 ↗
6. ImageNet classification with deep convolutional neural networks10.1145/3065386 ↗
7. NaSC-TG2: Natural Scene Classification With Tiangong-2 Remotely Sensed Imagery10.1109/JSTARS.2021.3063096 ↗
8. Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv.
9. Comparison of support vector machine and maximum likelihood classification technique using satellite imagery
10. Deep learning10.1038/nature14539 ↗
11. Remote sensing image scene classification: Benchmark and state of the art10.1109/JPROC.2017.2675998 ↗
12. AID: A benchmark data set for performance evaluation of aerial scene classification10.1109/TGRS.2017.2685945 ↗
13. Multi-scale context for scene labeling via flexible segmentation graph10.1016/j.patcog.2016.03.023 ↗
14. Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., and Torralba, A. (2016, January 27–30). Learning deep features for discriminative localization. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.319 ↗
15. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
16. Scene parsing using inference embedded deep networks10.1016/j.patcog.2016.01.027 ↗
17. Pohlen, T., Hermans, A., Mathias, M., and Leibe, B. (2017, January 21–26). Full-resolution residual networks for semantic segmentation in street scenes. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.353 ↗
18. Adaptive deep co-occurrence feature learning based on classifier-fusion for remote sensing scene classification10.1109/JSTARS.2020.3044264 ↗
19. Remote sensing scene classification using convolutional features and deep forest classifier10.1109/LGRS.2019.2911855 ↗
20. Generative adversarial networks for hyperspectral image classification10.1109/TGRS.2018.2805286 ↗
21. Fang, B., Li, Y., Zhang, H., and Chan, J.C.-W. (2018). Semi-supervised deep learning classification for hyperspectral image based on dual-strategy sample selection. Remote Sens., 10.10.3390/rs10040574 ↗
22. Vision transformer: An excellent teacher for guiding small networks in remote sensing image scene classification
23. Zhao, G., Zhang, Y., Tan, J., Li, C., and Ren, Y. (2020). A data fusion modeling framework for retrieval of land surface temperature from Landsat-8 and MODIS Data. Sensors, 20.10.3390/s20154337 ↗
24. Integrating multilayer features of convolutional neural networks for remote sensing scene classification10.1109/TGRS.2017.2711275 ↗
25. Multi-Scale Location Attention Network for Building and Water Segmentation of Remote Sensing Image10.1109/TGRS.2023.3276703 ↗
26. Ghadi, Y.Y., Rafique, A.A., Al Shloul, T., Alsuhibany, S.A., Jalal, A., and Park, J. (2022). Robust object categorization and Scene classification over remote sensing images via features fusion and fully convolutional network. Remote Sens., 14.10.3390/rs14071550 ↗
27. Koonce, B. (2021). Convolutional Neural Networks with Swift for Tensorflow: Image Recognition and Dataset Categorization, Apress.10.1007/978-1-4842-6168-2 ↗
28. Scene classification for remote sensing images with self-attention augmented CNN10.1049/ipr2.12540 ↗
29. Multispectral Scene Classification via Cross-Modal Knowledge Distillation
30. A Generic Cryptographic Deep-Learning Inference Platform for Remote Sensing Scenes10.1109/JSTARS.2023.3260867 ↗