MSC-YOLO: Improved YOLOv7 Based on Multi-Scale Spatial Context for Small Object Detection in UAV-View
Source abstract
Abstract
Accurately identifying small objects in high-resolution aerial images presents a complex and crucial task in the field of small object detection on unmanned aerial vehicles (UAVs). This task is challenging due to variations in UAV flight altitude, differences in object scales, as well as factors like flight speed and motion blur. To enhance the detection efficacy of small targets in drone aerial imagery, we propose an enhanced You Only Look Once version 7 (YOLOv7) algorithm based on multi-scale spatial context. We build the MSC-YOLO model, which incorporates an additional prediction head, denoted as P2, to improve adaptability for small objects. We replace conventional downsampling with a Spatial-to-Depth Convolutional Combination (CSPDC) module to mitigate the loss of intricate feature details related to small objects. Furthermore, we propose a Spatial Context Pyramid with Multi-Scale Attention (SCPMA) module, which captures spatial and channel-dependent features of small targets across multiple scales. This module enhances the perception of spatial contextual features and the utilization of multiscale feature information. On the Visdrone2023 and UAVDT datasets, MSC-YOLO achieves remarkable results, outperforming the baseline method YOLOv7 by 3.0% in terms of mean average precision (mAP). The MSC-YOLO algorithm proposed in this paper has demonstrated satisfactory performance in detecting small targets in UAV aerial photography, providing strong support for practical applications.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Advanced Neural Network Applications · Robotics and Sensor-Based Localization · Advanced Image and Video Retrieval Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (50)
Show source-provided references
1. Multiple moving targets surveillance based on a cooperative network for multi-UAV10.1109/MCOM.2018.1700422 ↗
2. Multi-drone optimal mission assignment and 3D path planning for disaster rescue10.3390/drones7060394 ↗
3. Perspectives for remote sensing with unmanned aerial vehicles in precision agriculture10.1016/j.tplants.2018.11.007 ↗
4. Fast near-duplicate image detection in riemannian space by a novel hashing scheme
5. Traffic analysis through deep-learning-based image segmentation from UAV streaming10.1109/JIOT.2022.3223283 ↗
6. You only look once: Unified, real-time object detection
7. YOLO9000: Better, faster, stronger
8. J. Redmon and A. Farhadi, “YOLOv3: An incremental improvement,” arXiv preprint arXiv:1804.02767, 2018.
9. A. Bochkovskiy, C. Y. Wang, and H. Y. M. Liao, “YOLOv4: Optimal speed and accuracy of object detection,” arXiv preprint arXiv:2004.10934, 2020.
10. C. Li et al., “YOLOv6: A single-stage object detection framework for industrial applications,” arXiv preprint arXiv: 2209. 02976, 2022.
11. YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors
12. Detection and tracking meet drones challenge10.1109/TPAMI.2021.3119563 ↗
13. The unmanned aerial vehicle benchmark: Object detection, tracking and baseline10.1007/s11263-019-01266-1 ↗
14. M. Kisantal, Z. Wojna, J. Murawski, J. Naruniec, and K. Cho, “Augmentation for small object detection,” arXiv preprint arXiv:1902.07296, 2019.10.5121/csit.2019.91713 ↗
15. H. Zhang, M. Cisse, Y. N. Dauphin, and D. Lopez-Paz, “mixup: Beyond empirical risk minimization,” arXiv preprint arXiv:1710.09412, 2017.
16. Simple copy-paste is a strong data augmentation method for instance segmentation
17. CutMix: Regularization strategy to train strong classifiers with localizable features
18. RRNet: A hybrid detector for object detection in drone-captured images
19. Dense and small object detection in UAV vision based on cascade network
20. Towards efficient detection for small objects via attention-guided detection network and data augmentation10.3390/s22197663 ↗
21. A full data augmentation pipeline for small object detection based on generative adversarial networks10.1016/j.patcog.2022.108998 ↗
22. SSD: Single shot multibox detector
23. Z. Ge, S. Liu, F. Wang, Z. Li, and J. Sun, “YOLOX: Exceeding yolo series in 2021,” arXiv preprint arXiv:2107.08430, 2021.
24. Faster R-CNN: Towards real-time object detection with region proposal networks10.1109/TPAMI.2016.2577031 ↗
25. Rich feature hierarchies for accurate object detection and semantic segmentation
26. Cascade R-CNN: Delving into high quality object detection
27. Feature pyramid networks for object detection
28. Clustered object detection in aerial images
29. How to fully exploit the abilities of aerial image detectors
30. A global-local self-adaptive network for drone-view object detection10.1109/TIP.2020.3045636 ↗
31. Density map guided object detection in aerial images
32. Towards resolving the challenge of long-tail distribution in UAV images for object detection
33. Novel up-scale feature aggregation for object detection in aerial images10.1016/j.neucom.2020.06.011 ↗
34. Coarse-grained density map guided object detection in aerial images
35. TPH-YOLOv5: Improved YOLOv5 based on transformer prediction head for object detection on drone-captured scenarios
36. Small object detection method based on adaptive spatial parallel convolution and fast multi-scale fusion10.3390/rs14020420 ↗
37. QueryDet: Cascaded sparse query for accelerating high-resolution small object detection
38. Dilated convolution based RCNN using feature fusion for Low-Altitude aerial objects10.1016/j.eswa.2022.117106 ↗
39. ARSD: An adaptive region selection object detection framework for UAV images10.3390/drones6090228 ↗
40. ShuffleNet V2: Practical guidelines for efficient CNN architecture design
41. No more strided convolutions or pooling: A new CNN building block for low-resolution images and small objects
42. Y. Liu, H. Li, C. Hu, S. Luo, Y. Luo and C. W. Chen, “Learning to aggregate multi-scale context for instance segmentation in remote sensing images,” arXiv preprint arXiv:2111.11057, 2021.
43. Efficient multi-scale attention module with cross-spatial learning
44. Microsoft COCO: Common objects in context
45. K. Chen et al., “MMDetection: Open mmlab detection toolbox and benchmark,” arXiv preprint arXiv:1906.07155, 2019.
46. TPH-YOLOv5++: Boosting object detection on drone-captured scenarios with cross-layer asymmetric transformer10.3390/rs15061687 ↗
47. YOLOv7-UAV: An unmanned aerial vehicle image object detection algorithm based on improved yolov710.3390/electronics12143141 ↗
48. Object detection in UAV images via global density fused convolutional network10.3390/rs12193140 ↗
49. UFPMP-Det: Toward accurate and efficient object detection on drone imagery
50. Grad-CAM: Visual explanations from deep networks via gradient-based localization10.1007/s11263-019-01228-7 ↗