An Intelligent Detection Method for Optical Remote Sensing Images Based on Improved YOLOv7
Source abstract
Abstract
To address the issue of imbalanced detection performance and detection speed in current mainstream object detection algorithms for optical remote sensing images, this paper proposes a multi-scale object detection model for remote sensing images on complex backgrounds, called DI-YOLO, based on You Only Look Once v7-tiny (YOLOv7-tiny). Firstly, to enhance the model’s ability to capture irregular-shaped objects and deformation features, as well as to extract high-level semantic information, deformable convolutions are used to replace standard convolutions in the original model. Secondly, a Content Coordination Attention Feature Pyramid Network (CCA-FPN) structure is designed to replace the Neck part of the original model, which can further perceive relationships between different pixels, reduce feature loss in remote sensing images, and improve the overall model’s ability to detect multi-scale objects. Thirdly, an Implicitly Efficient Decoupled Head (IEDH) is proposed to increase the model's flexibility, making it more adaptable to complex detection tasks in various scenarios. Finally, the Smoothed Intersection over Union (SIoU) loss function replaces the Complete Intersection over Union (CIoU) loss function in the original model, resulting in more accurate prediction of bounding boxes and continuous model optimization. Experimental results on the High-Resolution Remote Sensing Detection (HRRSD) dataset demonstrate that the proposed DI-YOLO model outperforms mainstream target detection algorithms in terms of mean Average Precision (mAP) for optical remote sensing image detection. Furthermore, it achieves Frames Per Second (FPS) of 138.9, meeting fast and accurate detection requirements.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Advanced Neural Network Applications · Remote-Sensing Image Classification · Video Surveillance and Tracking Methods
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (42)
Show source-provided references
1. Deep learning for unmanned aerial vehicle-based object detection and tracking: A survey10.1109/MGRS.2021.3115137 ↗
2. Ship detection and classification from optical remote sensing images: A survey10.1016/j.cja.2020.12.013 ↗
3. Multiscale methods for optical remote-sensing image captioning10.1109/LGRS.2020.3009243 ↗
4. A survey on object detection in optical remote sensing images10.1016/j.isprsjprs.2016.03.014 ↗
5. An extended set of Haar-like features for rapid object detection
6. Histograms of oriented gradients for human detection
7. Object detection with discriminatively trained part-based models10.1109/TPAMI.2009.167 ↗
8. Ship detection in panchromatic images: A new method and its DSP implementation
9. Vehicle detection in remote sensing imagery based on salient information and local shape feature10.1016/j.ijleo.2015.06.024 ↗
10. Unsupervised ship detection based on saliency and S-HOG descriptor from optical satellite images10.1109/LGRS.2015.2408355 ↗
11. Airplane detection in remote sensing images based on object proposal
12. Occluded object detection in high-resolution remote sensing images using partial configuration object model10.1109/JSTARS.2017.2655098 ↗
13. Real-time 3D object detection and classification in autonomous driving environment using 3D LiDAR and camera sensors10.3390/electronics11244203 ↗
14. Rich feature hierarchies for accurate object detection and semantic segmentation
15. Fast R-CNN
16. Faster R-CNN: Towards real-time object detection with region proposal networks10.1109/TPAMI.2016.2577031 ↗
17. You only look once: Unified, real-time object detection
18. YOLO9000: Better, faster, stronger
19. J. Redmon and A. Farhadi, “YOLOv3: An incremental improvement,” 2018. [Online]. Available: http://arxiv.org/abs/1804.02767 (accessed on 06/05/2023)
20. A. Bochkovskiy, C. Y. Wang and H. Y. M. Liao, “YOLOv4: Optimal speed and accuracy of object detection,” 2018. [Online]. Available: http://arxiv.org/abs/2004.10934 (accessed on 06/05/2023)
21. Z. Ge, S. Liu, F. Wang, Z. Li and J. Sun, “YOLOX: Exceeding YOLO series in 2021,” 2021. [Online]. Available: http://arxiv.org/abs/2107.08430 (accessed on 06/05/2023)
22. C. Y. Wang, I. H. Yeh and H. Y. M. Liao, “You only learn one representation: Unified network for multiple tasks,” 2021. [Online]. Available: http://arxiv.org/abs/2105 (accessed on 06/13/2023)
23. C. Li, L. Li, H. Jiang, K. Weng, Y. Geng et al., “YOLOv6: A single-stage object detection framework for industrial applications,” 2023. [Online]. Available: http://arxiv.org/abs/2209.02976 (accessed on 06/06/2023)
24. C. Y. Wang, A. Bochkovskiy and H. Y. M. Liao, “YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors,” 2023. [Online]. Available: http://arxiv.org/abs/2207.02696 (accessed on 06/05/2023)10.1109/CVPR52729.2023.00721 ↗
25. SSD: Single shot multibox detector10.1007/978-3-319-46448-0_2 ↗
26. C. Y. Fu, W. Liu, A. Ranga, A. Tyagi and A. C. Berg, “DSSD: Deconvolutional single shot detector,” 2017. [Online]. Available: http://arxiv.org/abs/1701.06659 (accessed on 06/05/2023)
27. CAD-Net: A context-aware detection network for objects in remote sensing imagery10.1109/TGRS.2019.2930982 ↗
28. Fast seismic landslide detection based on improved mask R-CNN10.3390/rs14163928 ↗
29. R-CNN-Based ship detection from high resolution remote sensing imagery10.3390/rs11060631 ↗
30. An efficient building extraction method from high spatial resolution remote sensing images based on improved Mask R-CNN10.3390/s20051465 ↗
31. Attention and feature fusion SSD for remote sensing object detection10.1109/TIM.2021.3118092 ↗
32. YOLOrs: Object detection in multimodal remote sensing imagery10.1109/JSTARS.2020.3041316 ↗
33. Deep residual learning for image recognition
34. Hierarchical and robust convolutional neural network for very high-resolution remote sensing object detection10.1109/TGRS.2019.2900302 ↗
35. Multi-class geospatial object detection and geographic image classification based on collection of part detectors10.1016/j.isprsjprs.2014.10.002 ↗
36. Deformable convolutional networks
37. CARAFE: Content-Aware ReAssembly of FEatures
38. Coordinate attention for efficient mobile network design
39. Squeeze-and-Excitation networks
40. CFCANet: A complete frequency channel attention network for SAR image scene classification10.1109/JSTARS.2021.3125107 ↗
41. Z. Gevorgyan, “SIoU loss: More powerful learning for bounding box regression,” 2022. [Online]. Available: http://arxiv.org/abs/2205.12740 (accessed on 06/25/2023)
42. Grad-CAM: Visual explanations from deep networks via gradient-based localization