ST-YOLOv8: Small-Target Ship Detection in SAR Images Targeting Specific Marine Environments
Source abstract
Abstract
Synthetic Aperture Radar (SAR) image ship detection faces challenges such as distinguishing ships from other terrains and structures, especially in specific marine complex environments. The motivation behind this work is to enhance detection accuracy while minimizing false positives, which is crucial for applications like defense vessel monitoring and civilian search and rescue operations. To achieve this goal, we propose several architectural improvements to You Only Look Once version 8 Nano (YOLOv8n) and present Small Target-YOLOv8(ST-YOLOv8)—a novel lightweight SAR ship detection model based on the enhance YOLOv8n framework. The C2f module in the backbone’s transition sections is replaced by the Conv_Online Reparameterized Convolution (C_OREPA) module, reducing convolutional complexity and improving efficiency. The Atrous Spatial Pyramid Pooling (ASPP) module is added to the end of the backbone to extract finer features from smaller and more complex ship targets. In the neck network, the Shuffle Attention (SA) module is employed before each upsampling step to improve upsampling quality. Additionally, we replace the Complete Intersection over Union (C-IoU) loss function with the Wise Intersection over Union (W-IoU) loss function, which enhances bounding box precision. We conducted ablation experiments on two widely used multimodal SAR datasets. The proposed model significantly outperforms the YOLOv8n baseline, achieving 94.1% accuracy, 82% recall, and 87.6% F1 score on the SAR Ship Detection Dataset (SSDD), and 92.7% accuracy, 84.5% recall, and 88.1% F1 score on the SAR Ship Dataset_v0 dataset (SSDv0). Furthermore, the ST-YOLOv8 model outperforms several state-of-the-art multi-scale ship detection algorithms on both datasets. In summary, the ST-YOLOv8 model, by integrating advanced neural network architectures and optimization techniques, significantly improves detection accuracy and reduces false detection rates. This makes it highly suitable for complex backgrounds and multi-scale ship detection. Future work will focus on lightweight model optimization for deployment on mobile platforms to broaden its applicability across different scenarios.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Synthetic Aperture Radar (SAR) Applications and Techniques · Advanced SAR Imaging Techniques · Advanced Neural Network Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Information Science and Technology, Shijiazhuang Tiedao University, Shijiazhuang 050043, China
Hebei Key Laboratory of Electromagnetic Environmental Effects and Information Processing, Shijiazhuang 050043, China
Shijiazhuang Key Laboratory of Artificial Intelligence, Shijiazhuang 050043, China
Funding
Natural Science Foundation of Hebei Province
References (54)
Show source-provided references
1. Zhang, Y., and Hao, Y. (2022). A Survey of SAR Image Target Detection Based on Convolutional Neural Networks. Remote Sens., 14.10.3390/rs14246240 ↗
2. An automatic ship and ship wake detection system for spaceborne SAR images in coastal regions10.1109/36.508418 ↗
3. Textural Infornation in SAR Images10.1109/TGRS.1986.289643 ↗
4. Tebaldini, S., Manzoni, M., Tagliaferri, D., Rizzi, M., Monti-Guarnieri, A.V., Prati, C.M., Spagnolini, U., Nicoli, M., Russo, I., and Mazzucco, C. (2022). Sensing the Urban Environment by Automotive SAR Imaging Potentials and Challenges. Remote Sens., 14.10.3390/rs14153602 ↗
5. Hovland, H.A., Johannessen, J.A., and Digranes, G. (1994, January 8–12). Slick detection in SAR images. Proceedings of the IGARSS’94—1994 IEEE International Geoscience and Remote Sensing Symposium, Pasadena, CA, USA.
6. Quality Assessment of Despeckled SAR Images10.1109/JSTARS.2013.2279501 ↗
7. Lattari, F., Gonzalez Leon, B., Asaro, F., Rucci, A., Prati, C., and Matteucci, M. (2019). Deep Learning for SAR Image Despeckling. Remote Sens., 11.10.3390/rs11131532 ↗
8. Liu, L., and Lei, B. (2018, January 22–27). Can SAR Images and Optical Images Transfer with Each Other. Proceedings of the IGARSS, Valencia, Spain.10.1109/IGARSS.2018.8518921 ↗
9. SAR Image Despeckling Using a Convolutional Neural Network10.1109/LSP.2017.2758203 ↗
10. Wavelet Fusion on Ratio Images for Change Detection in SAR Images10.1109/LGRS.2012.2191387 ↗
11. Chierchia, G., Cozzolino, D., Poggi, G., and Verdoliva, L. (2017, January 23–28). SAR image despeckling through convolutional neural networks. Proceedings of the IGARSS, Fort Worth, TX, USA.10.1109/IGARSS.2017.8128234 ↗
12. Interference suppression in synthesized SAR images10.1109/LGRS.2004.838419 ↗
13. Target Classification Using the Deep Convolutional Networks for SAR Images10.1109/TGRS.2016.2551720 ↗
14. Tandem-L: A Highly Innovative Bistatic SAR Mission for Global Observation of Dynamic Processes on the Earth’s Surface10.1109/MGRS.2015.2437353 ↗
15. Feng, S., Fan, Y., Tang, Y., Cheng, H., Zhao, C., Zhu, Y., and Cheng, C. (2022). A Change Detection Method Based on Multi-Scale Adaptive Convolution Kernel Network and Multimodal Conditional Random Field for Multi-Temporal Multispectral Images. Remote Sens., 14.10.3390/rs14215368 ↗
16. HRLE-SARDet A Lightweight SAR Target Detection Algorithm Based on Hybrid Representation Learning Enhancement
17. Yoshida, T., and Ouchi, K. (2022). Detection of Ships Cruising in the Azimuth Direction Using Spotlight SAR Images with a Deep Learning Method. Remote Sens., 14.10.3390/rs14194691 ↗
18. Ship Surveillance with TerraSAR-X10.1109/TGRS.2010.2071879 ↗
19. Detection Performance of a Mean-Level Threshold10.1109/TAES.1968.5409020 ↗
20. A statistical and geometrical edge detector for SAR images10.1109/36.7708 ↗
21. Wang, S., Gao, S., Zhou, L., Liu, R., Zhang, H., Liu, J., Jia, Y., and Qian, J. (2022). YOLO-SD Small Ship Detection in SAR Images by Multi-Scale Convolution and Feature Transformer Module. Remote Sens., 14.10.3390/rs14205268 ↗
22. Yu, X., Salimpour, S., Queralta, J.P., and Westerlund, T. (2023). General-Purpose Deep Learning Detection and Segmentation Models for Images from a Lidar-Based Camera Sensor. Sensors, 23.10.3390/s23062936 ↗
23. Wei, D., Du, Y., Du, L., and Li, L. (2021). Target Detection Network for SAR Images Based on Semi-Supervised Learning and Attention Mechanism. Remote Sens., 13.10.3390/rs13142686 ↗
24. Natural language processing (almost) from scratch
25. Kang, M., Ji, K., Leng, X., and Lin, Z. (2017). Contextual Region-Based Convolutional Neural Network with Multilayer Fusion for SAR Ship Detection. Remote Sens., 9.10.3390/rs9080860 ↗
26. Lightweight Deep Neural Networks for Ship Target Detection in SAR Imagery10.1109/TIP.2022.3231126 ↗
27. Jiang, Y., Li, W., and Liu, L. (2021). R-CenterNet+ Anchor-Free Detector for Ship Detection in SAR Images. Sensors, 21.10.3390/s21175693 ↗
28. Faster R-CNN Towards Real-Time Object Detection with Region Proposal Networks10.1109/TPAMI.2016.2577031 ↗
29. Pang, J., Chen, K., Shi, J., Feng, H., Ouyang, W., and Lin, D. (2019, January 15–20). Libra R-CNN Towards Balanced Learning for Object Detection. Proceedings of the CVPR, Long Beach, CA, USA.10.1109/CVPR.2019.00091 ↗
30. Mask R-CNN10.1109/TPAMI.2018.2844175 ↗
31. YOLOv1 to YOLOv10 The Fastest and Most Accurate Real-time Object Detection Systems10.1561/116.20240058 ↗
32. Farhadi, A., and Redmon, J. (2018). Yolov3 An incremental improvement. arXiv.
33. Bochkovskiy, A., Wang, C., and Liao, H. (2020). YOLOv4 Optimal Speed and Accuracy of Object Detection. arXiv.
34. SSD Single Shot MultiBox Detector
35. Fully Convolutional One-Stage 3D Object Detection on LiDAR Range Images
36. Zhang, T., Zhang, X., Ke, X., Zhan, X., Shi, J., Wei, S., Pan, D., Li, J., Su, H., and Zhou, Y. (2020). LS-SSDD-v1.0 A Deep Learning Dataset Dedicated to Small Ship Detection from Large-Scale Sentinel-1 SAR Images. Remote Sens., 12.10.3390/rs12182997 ↗
37. Lin, T.Y., Dollár, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. (2017, January 21–26). Feature Pyramid Networks for Object Detection. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.106 ↗
38. Zeng, L., Zhou, D., Pan, Q., Lu, C., and Zhou, Y. (August, January 28). Sar Target Detection Based on Psift Feature Clustering. Proceedings of the IGARSS 2019, Yokohama, Japan.10.1109/IGARSS.2019.8900284 ↗
39. Remote Sensing Image Automatic Registration on Multi-scale Harris-Laplacian10.1007/s12524-014-0432-2 ↗
40. Zhu, H., Xie, Y., Huang, H., Jing, C., Rong, Y., and Wang, C. (2021). DB-YOLO A Duplicate Bilateral YOLO Network for Multi-Scale Ship Detection in SAR Images. Sensors, 21.10.3390/s21238146 ↗
41. Dense Attention Pyramid Networks for Multi-Scale Ship Detection in SAR Images10.1109/TGRS.2019.2923988 ↗
42. Zhou, K., Zhang, M., Wang, H., and Tan, J. (2022). Ship Detection in SAR Images Based on Multi-Scale Feature Extraction and Adaptive Feature Fusion. Remote Sens., 14.10.3390/rs14030755 ↗
43. Sun, Z., Leng, X., Lei, Y., Xiong, B., Ji, K., and Kuang, G. (2021). BiFA-YOLO A Novel YOLO-Based Method for Arbitrary-Oriented Ship Detection in High-Resolution SAR Images. Remote Sens., 13.10.3390/rs13214209 ↗
44. CTF-Net A Convolutional and Transformer Fusion Network for SAR Ship Detection10.1109/LGRS.2023.3310206 ↗
45. A Comprehensive Review of YOLO Architectures in Computer Vision from YOLOv1 to YOLOv8 and YOLO-NAS10.3390/make5040083 ↗
46. Jain, S., Dash, S., and Deorari, R. (2022, January 6–7). Object detection using coco dataset. Proceedings of the 2022 International Conference on Cyber Resilience (ICCR), Dubai, United Arab Emirates.10.1109/ICCR56254.2022.9995808 ↗
47. Tong, Z., Chen, Y., Xu, Z., and Yu, R. (2023). Wise-IoU bounding box regression loss with dynamic focusing mechanism. arXiv.
48. Hu, M., Feng, J., Hua, J., Lai, B., Huang, J., Gong, X., and Hua, X.S. (2022, January 18–24). Online convolutional re-parameterization. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.00065 ↗
49. A2SPPNet: Attentive atrous spatial pyramid pooling network for salient object detection10.1109/TMM.2022.3141933 ↗
50. Vehicle classification using a real-time convolutional structure based on DWT pooling layer and SE blocks10.1016/j.eswa.2021.115420 ↗
51. Zhang, Q.-L., and Yang, Y.-B. (2021, January 6–11). Sa-net: Shuffle attention for deep convolutional neural networks. Proceedings of the ICASSP, Toronto, ON, Canada.
52. The pascal visual object classes (voc) challenge10.1007/s11263-009-0275-4 ↗
53. Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., and Zitnick, C.L. (2014, January 6–12). Microsoft coco: Common objects in context. Proceedings of the Computer Vision–ECCV, Zurich, Switzerland.10.1007/978-3-319-10602-1_48 ↗
54. van Rijsbergen, C. (1979). Information Retrieval, Buttersworth. [2nd ed.].