Swin-PAFF: A SAR Ship Detection Network with Contextual Cross-Information Fusion
Source abstract
Abstract
Synthetic Aperture Radar (SAR) image target detection has widespread applications in both military and civil domains. However, SAR images pose challenges due to strong scattering, indistinct edge contours, multi-scale representation, sparsity, and severe background interference, which make the existing target detection methods in low accuracy. To address this issue, this paper proposes a multi-scale fusion framework (Swin-PAFF) for SAR target detection that utilizes the global context perception capability of the Transformer and the multi-layer feature fusion learning ability of the feature pyramid structure (FPN). Firstly, to tackle the issue of inadequate perceptual image context information in SAR target detection, we propose an end-to-end SAR target detection network with the Transformer structure as the backbone. Furthermore, we enhance the ability of the Swin Transformer to acquire contextual features and cross-information by incorporating a Swin-CC backbone network model that combines the Spatial Depthwise Pooling (SDP) module and the self-attentive mechanism. Finally, we design a cross-layer fusion neck module (PAFF) that better handles multi-scale variations and complex situations (such as sparsity, background interference, etc.). Our devised approach yields a noteworthy AP@0.5:0.95 performance of 91.3% when assessed on the HRSID dataset. The application of our proposed technique has resulted in a noteworthy advancement of 8% in the AP@0.5:0.95 scores on the HRSID dataset.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Advanced SAR Imaging Techniques · Advanced Neural Network Applications · Geophysical Methods and Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (44)
Show source-provided references
1. CFAR ship detection in polarimetric synthetic aperture radar images based on whitening filter10.1109/TGRS.2019.2931353 ↗
2. A curvature-based saliency method for ship detection in SAR images10.1109/LGRS.2020.3005197 ↗
3. Ship detection with superpixel-level fisher vector in high-resolution SAR images10.1109/LGRS.2019.2920668 ↗
4. Synthetic aperture radar ship detection using haar-like features10.1109/LGRS.2016.2631638 ↗
5. A unified deep learning framework of multi-scale detectors for geo-spatial object detection in high-resolution satellite images10.1007/s13369-021-06288-x ↗
6. Two-stream encoder GAN with progressive training for co-saliency detection10.1109/LSP.2021.3049997 ↗
7. A mask attention interaction and scale enhancement network for SAR ship instance segmentation
8. D-MFPN: A doppler feature matrix fused with a multilayer feature pyramid network for sar ship detection10.3390/rs15030626 ↗
9. PPA-Net: Pyramid pooling attention network for multi-scale ship detection in SAR images10.3390/rs15112855 ↗
10. Semisupervised SAR ship detection network via scene characteristic learning
11. Multi-aspect convolutional-transformer network for SAR automatic target recognition10.3390/rs14163924 ↗
12. Multi-scale ship target detection using SAR images based on improved YOLOv5
13. A super lightweight and efficient sar image ship detector10.1109/LGRS.2023.3330867 ↗
14. Global and local context-aware ship detector for high-resolution SAR images
15. Small ship detection of SAR images based on optimized feature pyramid and sample augmentation10.1109/JSTARS.2023.3302575 ↗
16. Marine ship instance segmentation by deep neural networks using a global and local attention (GALA) mechanism10.1371/journal.pone.0279248 ↗
17. Detection with fast feature pyramids and lightweight convolutional neural network: A practical aircraft detector for optical remote images10.1117/1.JRS.16.024506 ↗
18. Attention is all you need
19. A survey on vision transformer10.1109/TPAMI.2022.3152247 ↗
20. Carion · Computer Vision—ECCV 2020, Lecture Notes in Computer Science · 2020 · 213
21. SAR ship detection based on swin transformer and feature enhancement feature pyramid network
22. Vision Transformers are robust learners10.1609/aaai.v36i2.20103 ↗
23. CCNet: Criss-cross attention for semantic segmentation
24. Z. Ge, S. Liu, F. Wang, Z. Li and J. Sun, “YOLOX: Exceeding YOLO series in 2021,” arXiv:2107.08430, 2021.
25. Feature alignment FPN for oriented object detection in remote sensing images10.1109/LGRS.2023.3330957 ↗
26. SCM: A searched convolutional metaformer for SAR ship classification10.3390/rs15112904 ↗
27. Cattle body detection based on YOLOv5-ASFF for precision livestock farming10.1016/j.compag.2022.107579 ↗
28. Coordinate attention for efficient mobile network design
29. SAR ship detection dataset (SSDD): Official release and comprehensive data analysis10.3390/rs13183690 ↗
30. HRSID: A high-resolution SAR images dataset for ship detection and instance segmentation10.1109/ACCESS.2020.3005861 ↗
31. C. Kai, W. Jia, P. Jiang, C. Yu, X. Yu et al., “MMDetection: Open mmlab detection toolbox and benchmark,” arXiv:1906.07155, 2019.
32. A universal ship detection method with domain-invariant representations
33. You only look one-level feature
34. C. Y. Wang, A. Bochkovskiy and H. Y. Mark, “YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors,” arXiv:2207.02696, 2022.10.1109/CVPR52729.2023.00721 ↗
35. DC-YOLOv8: Small-size object detection algorithm based on camera sensor10.3390/electronics12102323 ↗
36. Road damage detection using RetinaNet
37. Efficient ship detection in synthetic aperture radar images and lateral images using deep learning techniques
38. An improved FCOS method for ship detection in SAR images10.1109/JSTARS.2022.3213583 ↗
39. TOOD: Task-aligned one-stage object detection
40. Fully deformable convolutional network for ship detection in remote sensing imagery10.3390/rs14081850 ↗
41. A local-sparse-information-aggregation Transformer with explicit contour guidance for SAR ship detection10.3390/rs14205247 ↗
42. S-DETR: A Transformer model for real-time detection of marine ships10.3390/jmse11040696 ↗
43. YOLO-Lite: An efficient lightweight network for sar ship detection10.3390/rs15153771 ↗
44. DSF-Net: A dual feature shuffle guided multi-field fusion network for SAR small ship target detection10.3390/rs15184546 ↗