Remote Sensing Image Segmentation for Aircraft Recognition Using U-Net as Deep Learning Architecture
Source abstract
Abstract
Recognizing aircraft automatically by using satellite images has different applications in both the civil and military sectors. However, due to the complexity and variety of the foreground and background of the analyzed images, it remains challenging to obtain a suitable representation of aircraft for identification. Many studies and solutions have been presented in the literature, but only a few studies have suggested handling the issue using semantic image segmentation techniques due to the lack of publicly labeled datasets. With the advancement of CNNs, researchers have presented some CNN architectures, such as U-Net, which has the ability to obtain very good performance using a small training dataset. The U-Net architecture has received much attention for segmenting 2D and 3D biomedical images and has been recognized to be highly successful for pixel-wise satellite image classification. In this paper, we propose a binary image segmentation model to recognize aircraft by exploiting and adopting the U-Net architecture for remote sensing satellite images. The proposed model does not require a significant amount of labeled data and alleviates the need for manual aircraft feature extraction. The public dense labeling remote sensing dataset is used to perform the experiments and measure the robustness and performance of the proposed model. The mean IoU and pixel accuracy are adopted as metrics to assess the obtained results. The results in the testing dataset indicate that the proposed model can achieve a 95.08% mean IoU and a pixel accuracy of 98.24%.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Neural Network Applications · Remote Sensing and LiDAR Applications · Robotics and Sensor-Based Localization
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Computer Engineering Department, Ankara Medipol University, 06050 Ankara, Turkey
Department of Advanced Computing Sciences, Maastricht University, 6211 LK Maastricht, The Netherlands
Department College of Engineering and Technology, American University of the Middle East, Egaila 54200, Kuwait
College of Business Administration, American University of the Middle East, Egaila 54200, Kuwait
References (44)
Show source-provided references
1. POI detection of high-rise buildings using remote sensing images: A semantic segmentation method based on multitask attention Res-U-Net
2. Hao, X., Yin, L., Li, X., Zhang, L., and Yang, R. (2023). A multi-objective semantic segmentation algorithm based on improved U-Net networks. Remote Sens., 15.10.3390/rs15071838 ↗
3. Shao, X., Qiang, Y., Li, J., Li, L., Zhao, X., and Wang, Q. (2023, January 26–28). Semantic segmentation of remote sensing image based on Contextual U-Net. Proceedings of the 2nd International Conference on Applied Statistics, Computational Mathematics, and Software Engineering (ASCMSE 2023), SPIE, Kaifeng, China.10.1117/12.2692004 ↗
4. Shao, Z., Yang, K., and Zhou, W. (2018). Performance evaluation of single-label and multi-label remote sensing image retrieval using a dense labeling dataset. Remote Sens., 10.10.3390/rs10060964 ↗
5. Tummidi, J.R.D., Kamble, R.S., Bakliwal, S., Desai, A., Lad, B.V., and Keskar, A.G. (2023, January 5–6). Salient object detection based aircraft detection for optical remote sensing images. Proceedings of the 2nd International Conference on Paradigm Shifts in Communications Embedded Systems, Machine Learning and Signal Processing (PCEMS), IEEE, Nagpur, India.10.1109/PCEMS58491.2023.10136078 ↗
6. PatternNet: A benchmark dataset for performance evaluation of remote sensing image retrieval10.1016/j.isprsjprs.2018.01.004 ↗
7. Distinctive image features from scale-invariant keypoints10.1023/B:VISI.0000029664.99615.94 ↗
8. Jégou, H., Douze, M., Schmid, C., and Pérez, P. (2010, January 13–18). Aggregating local descriptors into a compact image representation. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, IEEE, San Francisco, CA, USA.10.1109/CVPR.2010.5540039 ↗
9. Daniilidis, K., Maragos, P., and Paragios, N. (2010). Computer Vision—ECCV 2010. ECCV 2010. Lecture Notes in Computer Science, Springer.10.1007/978-3-642-15561-1 ↗
10. Gabor feature based classification using the enhanced fisher linear discriminant model for face recognition10.1109/TIP.2002.999679 ↗
11. Multiresolution gray-scale and rotation invariant texture classification with local binary patterns10.1109/TPAMI.2002.1017623 ↗
12. Sivic, J., and Zisserman, A. (2003, January 13–16). Video Google: A text retrieval approach to object matching in videos. Proceedings of the 9th IEEE International Conference on Computer Vision, IEEE, Nice, France.10.1109/ICCV.2003.1238663 ↗
13. Topcu, A.E., Alzoubi, Y.I., Elbasi, E., and Camalan, E. (2023). Social media zero-day attack detection using TensorFlow. Electronics, 12.10.3390/electronics12173554 ↗
14. Alzoubi, Y.I., Topcu, A.E., and Erkaya, A.E. (2023). Machine learning-based text classification comparison: Turkish language context. Appl. Sci., 13.10.3390/app13169428 ↗
15. Aircraft recognition based on landmark detection in remote sensing images10.1109/LGRS.2017.2715858 ↗
16. Aircraft type recognition based on segmentation with deep convolutional neural networks10.1109/LGRS.2017.2786232 ↗
17. U-net: Convolutional networks for biomedical image segmentation
18. Text analysis of smart cities: A big data-based model
19. Aircraft recognition in infrared image using wavelet moment invariants10.1016/j.imavis.2008.08.007 ↗
20. Research concerning aircraft recognition of remote sensing images based on ICA Zernike invariant moments
21. An aircraft recognition method based on principal component analysis and image model matching
22. Fang, Z., Yao, G., and Zhang, Y. (2012, January 4–28). Target recognition of aircraft based on moment invariants and BP neural network. Proceedings of the World Automation Congress 2012, IEEE, Puerto Vallarta, Mexico.
23. Wang, D., He, X., Zhonghui, W., and Yu, H. (2009, January 16–19). A method of aircraft image target recognition based on modified PCA features and SVM. Proceedings of the 9th International Conference on Electronic Measurement and Instruments, IEEE, Beijing, China.10.1109/ICEMI.2009.5274100 ↗
24. Maggiori, E., Tarabalka, Y., Charpiat, G., and Alliez, P. (2017, January 23–28). Can semantic labeling methods generalize to any city? The inria aerial image labeling benchmark. Proceedings of the International Geoscience and Remote Sensing Symposium (IGARSS), IEEE, Fort Worth, TX, USA.10.1109/IGARSS.2017.8127684 ↗
25. Pan, X., Gao, L., Marinoni, A., Zhang, B., Yang, F., and Gamba, P. (2018). Semantic labeling of high resolution aerial imagery and LiDAR data with fine segmentation network. Remote Sens., 10.10.3390/rs10050743 ↗
26. Learning rich features from RGB-D images for object detection and segmentation
27. Long, J., Shelhamer, E., and Darrell, T. (2015, January 7–12). Fully convolutional networks for semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, IEEE, Boston, MA, USA.10.1109/CVPR.2015.7298965 ↗
28. Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K., and Yuille, A.L. (2014). Semantic image segmentation with deep convolutional nets and fully connected crfs. arXiv.
29. Noh, H., Hong, S., and Han, B. (2015, January 11–18). Learning deconvolution network for semantic segmentation. Proceedings of the International Conference on Computer Vision, IEEE, Santiago, Chile.10.1109/ICCV.2015.178 ↗
30. A deep convolutional encoder-decoder architecture for image segmentation10.1109/TPAMI.2016.2644615 ↗
31. High-resolution aerial image labeling with convolutional neural networks10.1109/TGRS.2017.2740362 ↗
32. Liu, Y., Minh Nguyen, D., Deligiannis, N., Ding, W., and Munteanu, A. (2017). Hourglass-shapenetwork based semantic segmentation for high resolution aerial imagery. Remote Sens., 9.10.3390/rs9060522 ↗
33. 2D-3D fully convolutional neural networks for cardiac MR segmentation
34. Objects segmentation from high-resolution aerial images using U-Net with pyramid pooling layers10.1109/LGRS.2018.2868880 ↗
35. Pyo, J., Han, K.-j., Cho, Y., Kim, D., and Jin, D. (2022). Generalization of U-Net semantic segmentation for forest change detection in South Korea using airborne imagery. Forests, 13.10.3390/f13122170 ↗
36. Using U-Net network for efficient brain tumor segmentation in MRI images10.1016/j.health.2022.100098 ↗
37. Glaucoma detection in retinal fundus images using U-Net and supervised machine learning algorithms
38. Buslaev, A., Seferbekov, S., Iglovikov, V., and Shvets, A. (2018, January 18–22). Fully convolutional network for automatic road extraction from satellite imagery. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, IEEE, Salt Lake City, UT, USA.10.1109/CVPRW.2018.00035 ↗
39. Aircraft segmentation in remote sensing images based on multi-scale residual U-Net with attention10.1007/s11042-023-16210-2 ↗
40. A real-time efficient object segmentation system based on U-Net using aerial drone images10.1007/s11554-021-01166-z ↗
41. Alzoubi, Y.I., Topcu, A.E., and Ozdemir, E. (2024). Enhancing document image retrieval in education: Leveraging ensemble-based document image retrieval systems for improved precision. Appl. Sci., 14.10.3390/app14020751 ↗
42. Chollet, F. (2023, March 15). GitHub Repository. Available online: https://github.com/keras-team/keras.
43. Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G.S., Davis, A., Dean, J., and Devin, M. (2016). Tensorflow: Large-scale machine learning on heterogeneous distributed systems. arXiv.
44. Scikit-learn: Machine learning in Python