Nighttime Intelligent UAV-Based Vehicle Detection and Classification Using YOLOv10 and Swin Transformer
Source abstract
Abstract
Unmanned Aerial Vehicles (UAVs) have become indispensable for intelligent traffic monitoring, particularly in low-light conditions, where traditional surveillance systems struggle. This study presents a novel deep learning-based framework for nighttime aerial vehicle detection and classification that addresses critical challenges of poor illumination, noise, and occlusions. Our pipeline integrates MSRCR enhancement with OPTICS segmentation to overcome low-light challenges, while YOLOv10 enables accurate vehicle localization. The framework employs GLOH and Dense-SIFT for discriminative feature extraction, optimized using the Whale Optimization Algorithm to enhance classification performance. A Swin Transformer-based classifier provides the final categorization, leveraging hierarchical attention mechanisms for robust performance. Extensive experimentation validates our approach, achieving detection mAP@0.5 scores of 91.5% (UAVDT) and 89.7% (VisDrone), alongside classification accuracies of 95.50% and 92.67%, respectively. These results outperform state-of-the-art methods by up to 5.10% in accuracy and 4.2% in mAP, demonstrating the framework’s effectiveness for real-time aerial surveillance and intelligent traffic management in challenging nighttime environments.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Vehicle License Plate Recognition · Advanced Neural Network Applications · Video Surveillance and Tracking Methods
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (34)
Show source-provided references
1. Aerial vehicle detection at night: a synthesized dataset and performance evaluation of state-of-the-art object detection models
2. Cost-effective drone detection with deep neural networks for day and night surveillance
3. Vehicle detection in UAV images via background suppression pyramid network and multi-scale task adaptive decoupled head10.3390/rs15245698 ↗
4. Autonomous traffic monitoring and management by a simulated swarm of UAVs
5. Vehicle detection in aerial images using a fast oriented region search and the vector of locally aggregated descriptors10.3390/s19153294 ↗
6. Image-based automated framework for detecting and classifying unmanned aerial vehicles
7. Comprehensive review of UAV detection, security, and communication advancements to prevent threats10.3390/drones6100284 ↗
8. Advances and challenges in drone detection and classification techniques: a state-of-the-art review10.3390/s24010125 ↗
9. Sensor-based vehicle detection and classification: a systematic review
10. A survey on applications of unmanned aerial vehicles using machine learning10.1109/ACCESS.2023.3326101 ↗
11. System design for ML-based detection of unauthorized UAVs and integration within the UTM framework
12. Development of vehicle detection and counting systems with UAV cameras: deep learning and Darknet algorithms10.18178/joig.11.3.248-262 ↗
13. Vision-based autonomous vehicle systems based on deep learning: a systematic literature review10.3390/app12146831 ↗
14. Improved deep learning-based vehicle detection for urban applications using remote sensing imagery10.3390/rs15194747 ↗
15. TF-NET: deep learning empowered tiny feature network for nighttime UAV detection
16. End-to-end object detection with transformers
17. Drone-based visible-thermal object detection with transformers and prompt tuning10.3390/drones8090451 ↗
18. A novel framework for vehicle detection and tracking in night ware surveillance systems10.1109/ACCESS.2024.3417267 ↗
19. An image enhancement algorithm based on multi-scale Retinex theory to improve the images quality of sensors
20. A comprehensive survey of optical remote sensing image segmentation methods10.1080/07038992.2020.1805729 ↗
21. Comparative analysis of YOLOv8 and YOLOv10 in vehicle detection: performance metrics and model efficacy10.3390/vehicles6030065 ↗
22. Robust region feature extraction with salient MSER and segment distance-weighted GLOH for remote sensing image registration10.1109/JSTARS.2023.3344474 ↗
23. Evaluation of feature extraction methods for different types of images10.1007/s12596-022-01024-6 ↗
24. A novel effective vehicle detection method based on Swin Transformer in hazy scenes10.3390/math10132199 ↗
25. Robust vehicle detection in high-resolution aerial images with imbalanced data10.1109/TAI.2021.3081057 ↗
26. VisDrone-DET2021: the vision meets drone object detection challenge results
27. Vehicle detection method for intelligent vehicle at nighttime based on video and laser information10.1142/S021800141850009X ↗
28. Vehicle type classification using unsupervised convolutional neural network
29. Robust nighttime vehicle detection by tracking and grouping headlights10.1109/TITS.2015.2425229 ↗
30. A Hough space feature for vehicle detection
31. Feature selection based on tensor decomposition and object proposal for night-time multiclass vehicle detection10.1109/TSMC.2018.2872891 ↗
32. Vision-based on-road nighttime vehicle detection and tracking using improved HOG features10.3390/s24051590 ↗
33. Small target detection in UAV view based on improved YOLOv8 algorithm10.1038/s41598-024-84747-9 ↗
34. An efficient and robust night-time surveillance object detection system using YOLOv8 and high-performance computing