A DCM-DETR object detector for drone images in harsh environments
Source abstract
Abstract
Under adverse weather conditions, especially haze, small target detection in Unmanned Aerial Vehicle (UAV) images faces significant challenges due to low contrast, blurred features, and scale changes. To address these issues, this paper proposes DCM-DETR (Dynamic Contrast Module), an enhanced version of Real-Time Detection Transformer (RT-DETR) tailored for drone-based robust detection in complex environments. The framework integrates three new modules: a dynamic convolution fusion module, which uses adaptive convolution kernel and multi-scale feature mixing to improve angle and scale invariance; contrast wavelet feature aggregation, which is used to decouple high-frequency details from low-frequency structural features to enhance anti-haze capability; and frequency-spatial attention and multi-scale progressive channel attention combined with frequency domain filtering and spatial attention to reduce noise and improve feature resolution. Numerous experiments on the HazyDet and VisDrone-2019 datasets show that DCM-DETR outperforms the most advanced detectors, achieving an AP50 score of 74.3% and 40.8%, respectively, while maintaining a real-time inference speed of 128.8 FPS. The model’s efficiency (53.5 GFLOPs) and balance parameter design (22.1M) further validate its practicality for deployment on resource-constrained UAV platforms. This work advances the application of RT-DETR-based models in UAVs, providing a powerful solution for extreme weather scenarios.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Neural Network Applications · Advanced Image and Video Retrieval Techniques · Archaeological Research and Protection
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Information Engineering, Hebei University of Architecture 1 , Zhangjiakou, Hebei Province 075000,
Hebei Collaborative Innovation Center of Green Buildings 2 , Zhangjiakou, Hebei Province 075000,
References (29)
Show source-provided references
1. Object detection with deep learning: A review IEEE transactions on neural networks and learning systems10.1109/TNNLS.2018.2876865 ↗
2. SA-Net: Shuffle attention for deep convolutional neural networks
3. YOLO-TSL: A lightweight target detection algorithm for UAV infrared images based on Triplet attention and Slim-neck10.1016/j.infrared.2024.105487 ↗
4. Exploring the YOLO-FT deep learning algorithm for UAV-based smart agriculture detection in communication networks10.1109/tnsm.2024.3424232 ↗
5. Object tracking and detection techniques under GANN threats: A systemic review10.1016/j.asoc.2023.110224 ↗
6. SOD-YOLO: Small-object-detection algorithm based on improved YOLOv8 for UAV images10.3390/rs16163057 ↗
7. Detection of pine wilt disease using AAV remote sensing with an improved YOLO model10.1109/jstars.2024.3478333 ↗
8. Maize tassel detection with CA-YOLO for UAV images in complex field environments10.1016/j.compag.2023.108562 ↗
9. ParameterNet: Parameters are all you need for large-scale visual pretraining of mobile networks
10. Omni-kernel network for image restoration
11. A YOLO-NL object detector for real-time detection10.1016/j.eswa.2023.122256 ↗
12. Improved YOLOv8 small target detection algorithm in aerial images
13. YOLO-FA: Type-1 fuzzy attention based YOLO detector for vehicle detection10.1016/j.eswa.2023.121209 ↗
14. KSL-POSE: A real-time 2D human pose estimation method based on modified YOLOv8-pose framework10.3390/s24196249 ↗
15. A comprehensive review of YOLO architectures in computer vision: From YOLOv1 to YOLOv8 and YOLO-NAS10.3390/make5040083 ↗
16. AMFLW-YOLO: A lightweight network for remote sensing image detection based on attention mechanism and multiscale feature fusion10.1109/tgrs.2023.3327285 ↗
17. A. Wang , “YOLOv10: Real-time end-to-end object detection,” arXiv:2405.14458 (2024).
18. VisDrone-DET2021: The vision meets drone object detection challenge results
19. STF-YOLO: A small target detection algorithm for UAV remote sensing images based on improved SwinTransformer and class weighted classification decoupling head10.1016/j.measurement.2023.113936 ↗
20. Computer vision in the sky: Ultralytics YOLOv8 and deep SORT synergy for accurate vehicle speed monitoring in drone video
21. LD-YOLOv10: A lightweight target detection algorithm for drone scenarios based on YOLOv1010.3390/electronics13163269 ↗
22. H. Zhang , C.Xu, and S.Zhang, “Inner-IoU: More effective intersection over union loss with auxiliary bounding box,” arXiv:2311.02877 (2023).
23. YOLO-DroneMS: Multi-scale object detection network for unmanned aerial vehicle (UAV) images10.3390/drones8110609 ↗
24. YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors
25. ASF-YOLO: A novel YOLO model with attentional scale sequence fusion for cell instance segmentation10.1016/j.imavis.2024.105057 ↗
26. UAV-YOLOv8: A small-object-detection model based on improved YOLOv8 for UAV aerial photography scenarios10.3390/s23167190 ↗
27. OD-YOLO: Robust small object detection model in remote sensing image with a novel multi-scale feature fusion10.3390/s24113596 ↗
28. Effective feature fusion network in BIFPN for small object detection
29. Drone-DETR: Efficient small object detection for remote sensing image using enhanced RT-DETR model10.3390/s24175496 ↗