Remote Sensing Imagery for Multi-Stage Vehicle Detection and Classification via YOLOv9 and Deep Learner
Source abstract
Abstract
Unmanned Aerial Vehicles (UAVs) are increasingly employed in traffic surveillance, urban planning, and infrastructure monitoring due to their cost-effectiveness, flexibility, and high-resolution imaging. However, vehicle detection and classification in aerial imagery remain challenging due to scale variations from fluctuating UAV altitudes, frequent occlusions in dense traffic, and environmental noise, such as shadows and lighting inconsistencies. Traditional methods, including sliding-window searches and shallow learning techniques, struggle with computational inefficiency and robustness under dynamic conditions. To address these limitations, this study proposes a six-stage hierarchical framework integrating radiometric calibration, deep learning, and classical feature engineering. The workflow begins with radiometric calibration to normalize pixel intensities and mitigate sensor noise, followed by Conditional Random Field (CRF) segmentation to isolate vehicles. YOLOv9, equipped with a bi-directional feature pyramid network (BiFPN), ensures precise multi-scale object detection. Hybrid feature extraction employs Maximally Stable Extremal Regions (MSER) for stable contour detection, Binary Robust Independent Elementary Features (BRIEF) for texture encoding, and Affine-SIFT (ASIFT) for viewpoint invariance. Quadratic Discriminant Analysis (QDA) enhances feature discrimination, while a Probabilistic Neural Network (PNN) performs Bayesian probability-based classification. Tested on the Roundabout Aerial Imagery (15,474 images, 985K instances) and AU-AIR (32,823 instances, 7 classes) datasets, the model achieves state-of-the-art accuracy of 95.54% and 94.14%, respectively. Its superior performance in detecting small-scale vehicles and resolving occlusions highlights its potential for intelligent traffic systems. Future work will extend testing to nighttime and adverse weather conditions while optimizing real-time UAV inference.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Remote Sensing and LiDAR Applications · Advanced Image Fusion Techniques · Remote Sensing and Land Use
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (37)
Show source-provided references
1. A detailed survey and future directions of unmanned aerial vehicles (UAVs) with potential applications10.3390/aerospace8120363 ↗
2. A critical review of unmanned aerial vehicles (UAVs) use in architecture and urbanism: scientometric and bibliometric analysis10.3390/app11219966 ↗
3. Networked unmanned aerial vehicles for surveillance and monitoring: a survey10.3390/fi13070174 ↗
4. Faster R-CNN and YOLO-based vehicle detection: a survey
5. Autonomous vehicles and intelligent automation: applications, challenges, and opportunities
6. Utilizing YOLOv8 for enhanced traffic monitoring in intelligent transportation systems (ITS) applications10.1016/j.dsp.2024.104594 ↗
7. Real-time vehicle detection using YOLOv8-nano for intelligent transportation systems10.18280/ts.410407 ↗
8. Vehicle detection in aerial images using a fast oriented region search and the vector of locally aggregated descriptors10.3390/s19153294 ↗
9. Image-based automated framework for detecting and classifying unmanned aerial vehicles
10. Detection and classification of vehicles for traffic video analytics10.1016/j.procs.2018.10.527 ↗
11. Deep neural network-based vehicle detection and classification of aerial images10.32604/iasc.2022.024812 ↗
12. Goecks VG, Woods G, Valasek J. Combining visible and infrared spectrum imagery using machine learning for small unmanned aerial system detection. arXiv:2003.12638. 2020. doi:10.1117/12.2557442.10.1117/12.2557442 ↗
13. Lee EJ. Validation of object detection in UAV-based images using synthetic data. arXiv:2201.06629. 2022. doi:10.1117/12.2586860.10.1117/12.2586860 ↗
14. Simultaneously detecting and counting dense vehicles from drone images10.1109/TIE.2019.2899548 ↗
15. Unmanned aerial vehicle visual detection and tracking using deep neural networks: a performance benchmark
16. Toward fast and accurate vehicle detection in aerial images using coupled region-based convolutional neural networks10.1109/JSTARS.2017.2694890 ↗
17. Vehicle detection and classification in aerial imagery
18. Unmanned aerial vehicle hyperspectral remote sensing image classification based on parallel convolutional neural network
19. Based on improved lightweight YOLOv8 for vehicle detection
20. End-to-end object detection with transformers
21. Tan M, Pang R, Le QV. EfficientDet: scalable and efficient object detection. arXiv:1911.09070. 2020. doi:10.48550/arXiv.1911.09070.10.1109/CVPR42600.2020.01079 ↗
22. Identifying the optimal radiometric calibration method for UAV-based multispectral imaging10.3390/rs15112909 ↗
23. An image segmentation algorithm based on a local region conditional random field model
24. Vehicle detection and classification using an ensemble of EfficientDet and YOLOv810.7717/peerj-cs.2233 ↗
25. Object recognition and classification based on improved bag of features using SURF and MSER local feature extraction
26. Robust generalized quadratic discriminant analysis10.1016/j.patcog.2021.107981 ↗
27. Vehicle classification in intelligent transportation systems using deep learning and seismic data
28. SSD: single shot multibox detector
29. Focal loss for dense object detection10.1109/TPAMI.2018.2858826 ↗
30. Faster R-CNN: towards real-time object detection with region proposal networks10.1109/TPAMI.2016.2577031 ↗
31. Performance comparison of small object detection algorithms of UAV-based aerial images
32. Intelligent traffic surveillance through multi-label semantic segmentation and filter-based tracking
33. YOLOv7: trainable bag-of-freebies sets new state-of-the-art for real-time object detectors
34. Remote sensing-based vehicle monitoring system using YOLOv10 and CrossViT
35. AU-AIR: a multi-modal unmanned aerial vehicle dataset for low altitude traffic surveillance
36. Enhancing vehicle detection and tracking in UAV imagery: a pixel labeling and particle filter approach10.1109/ACCESS.2024.3401253 ↗
37. Semantic segmentation based real-time traffic monitoring via Res-UNet classifier and kalman filter10.1007/s42979-024-03586-7 ↗