journal article·2023-02-27Open access

A Fast and Accurate Real-Time Vehicle Detection Method Using Deep Learning for Unconstrained Environments

Annam Farid, Farhan Hussain, Khurram Khan, Mohsin Shahzad, Uzair Khan, Zahid Mahmood

Applied Sciences· Volume 13· Issue 5

Abstract

Deep learning-based classification and detection algorithms have emerged as a powerful tool for vehicle detection in intelligent transportation systems. The limitations of the number of high-quality labeled training samples makes the single vehicle detection methods incapable of accomplishing acceptable accuracy in road vehicle detection. This paper presents detection and classification of vehicles on publicly available datasets by utilizing the YOLO-v5 architecture. This paper’s findings utilize the concept of transfer learning through fine tuning the weights of the pre-trained YOLO-v5 architecture. To employ the concept of transfer learning, extensive data sets of images and videos of the congested traffic patterns were collected by the authors. These datasets were made more comprehensive by pointing various attributes, for instance high- and low-density traffic patterns, occlusions, and different weather circumstances. All of these gathered datasets were manually annotated. Ultimately, the improved YOLO-v5 structure becomes accustomed to any difficult traffic patterns. By fine-tuning the pre-trained network through our datasets, our proposed YOLO-v5 has exceeded several other traditional vehicle detection methods in terms of detection accuracy and execution time. Detailed simulations performed on the PKU, COCO, and DAWN datasets demonstrate the effectiveness of the proposed method in various challenging situations.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Neural Network Applications · Video Surveillance and Tracking Methods · Traffic Prediction and Management Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Computer and Software Engineering, College of Electrical and Mechanical Engineering (CEME), National University of Sciences and Technology (NUST), Islamabad 44000, Pakistan

Faculty of Computer Science and Engineering, GIK Institute of Engineering Sciences and Technology, Topi 23460, Pakistan

Department of Electrical and Computer Engineering, COMSATS University Islamabad, Abbottabad Campus, Abbottabad 22060, Pakistan

References (42)

Show source-provided references
1. Towards a Fully Automated Car Parking System10.1049/iet-its.2018.5021 ↗
2. Real-time object detection based on YOLO-v2 for tiny vehicle object10.1016/j.procs.2021.02.031 ↗
3. LittleYOLO-SPP: A delicate real-time vehicle detection algorithm10.1016/j.ijleo.2020.165818 ↗
4. A lightweight Tiny-YOLOv3 vehicle detection approach10.1007/s11554-021-01131-w ↗
5. Mobile Cloud based Framework for Sports Applications10.1007/s11045-019-00639-6 ↗
6. Hamsa, S., Panthakkan, A., Al Mansoori, S., and Alahamed, H. (2018, January 7–8). Automatic Vehicle Detection from Aerial Images using Cascaded Support Vector Machine and Gaussian Mixture Model. Proceedings of the 2018 International Conference on Signal Processing and Information Security (ICSPIS), Dubai, United Arab Emirates.10.1109/CSPIS.2018.8642716 ↗
7. Detection of Cars in HighResolution Aerial Images of Complex Urban Environments10.1109/TGRS.2017.2716984 ↗
8. Detection of Compound Structures Using a Gaussian Mixture Model With Spectral and Spatial Constraints10.1109/TGRS.2014.2299540 ↗
9. Hbaieb, A., Rezgui, J., and Chaari, L. (2019, January 15–18). Pedestrian Detection for Autonomous Driving within Cooperative Communication System. Proceedings of the 2019 IEEE Wireless Communications and Networking Conference (WCNC), Marrakesh, Morocco.10.1109/WCNC.2019.8886037 ↗
10. Xiong, L., Yue, W., Xu, Q., Zhu, Z., and Chen, Z. (2020, January 17–19). High Speed Front-Vehicle Detection Based on Video Multi-feature Fusion. Proceedings of the 2020 IEEE 10th International Conference on Electronics Information and Emergency Communication (ICEIEC), Beijing, China.10.1109/ICEIEC49280.2020.9152309 ↗
11. Yawen, T., and Jinxu, G. (2018, January 15–17). Research on Vehicle Detection Technology Based on SIFT Feature. Proceedings of the 8th International Conf on Electronics Info. and Emergency Communication (ICEIEC), Beijing, China.10.1109/ICEIEC.2018.8473575 ↗
12. A Deep Learning-Based Hybrid Framework for Object Detection and Recognition in Autonomous Driving10.1109/ACCESS.2020.3033289 ↗
13. YOLO-ACN: Focusing on small target and occluded object detection10.1109/ACCESS.2020.3046515 ↗
14. Cai, Z., and Vasconcelos, N. (2018, January 18–23). Cascade R-CNN: Delving into High Quality Object Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00644 ↗
15. Wang, C., Wang, H., Yu, F., and Xia, W. (2021, January 28–30). A High-Precision Fast Smoky Vehicle Detection Method Based on Improved Yolov5 Network. Proceedings of the 2021 IEEE International Conference on Artificial Intelligence and Industrial Design (AIID), Guangzhou, China.10.1109/AIID51893.2021.9456462 ↗
16. Miao, Y., Liu, F., Hou, T., Liu, L., and Liu, Y. (2020, January 6–8). A Nighttime Vehicle Detection Method Based on YOLO v3. Proceedings of the 2020 Chinese Automation Congress (CAC), Shanghai, China.10.1109/CAC51589.2020.9326819 ↗
17. Sarda, A., Dixit, S., and Bhan, A. (2021, January 4–6). Object Detection for Autonomous Driving using YOLO [You Only Look Once] algorithm. Proceedings of the 2021 Third International Conference on Intelligent Communication Technologies and Virtual Mobile Networks (ICICV), Tirunelveli, India.10.1109/ICICV50876.2021.9388577 ↗
18. Zhao, S., and You, F. (2020, January 11–12). Vehicle Detection Based on Improved Yolov3 Algorithm. Proceedings of the 2020 International Conference on Intelligent Transportation, Big Data & Smart City (ICITBS), Vientiane, Laos.10.1109/ICITBS49701.2020.00024 ↗
19. Ćorović, A., Ilić, V., Ðurić, S., Marijan, M., and Pavković, B. (2018, January 20–21). The Real-Time Detection of Traffic Participants Using YOLO Algorithm. Proceedings of the 2018 26th Telecommunications Forum (TELFOR), Belgrade, Serbia.10.1109/TELFOR.2018.8611986 ↗
20. Lou, L., Zhang, Q., Liu, C., Sheng, M., Zheng, Y., and Liu, X. (2019, January 24–27). Vehicles Detection of Traffic Flow Video Using Deep Learning. Proceedings of the 2019 IEEE 8th Data Driven Control and Learning Systems Conference (DDCLS), Dali, China.10.1109/DDCLS.2019.8908873 ↗
21. Machiraju, G.S.R., Kumari, K.A., and Sharif, S.K. (2021, January 20–22). Object Detection and Tracking for Community Surveillance using Transfer Learning. Proceedings of the 2021 6th International Conference on Inventive Computation Technologies (ICICT), Coimbatore, India.10.1109/ICICT50816.2021.9358698 ↗
22. Snegireva, D., and Kataev, G. (2021, January 5–11). Vehicle Classification Application on Video Using Yolov5 Architecture. Proceedings of the 2021 International Russian Automation Conference (RusAutoCon), Sochi, Russia.10.1109/RusAutoCon52004.2021.9537439 ↗
23. Jana, A.P., Biswas, A. (2018, January 18–19). YOLO based Detection and Classification of Objects in video records. Proceedings of the 2018 3rd IEEE International Conference on Recent Trends in Electronics, Information & Communication Technology (RTEICT), Bangalore, India.10.1109/RTEICT42901.2018.9012375 ↗
24. Hu, X., Wei, Z., and Zhou, W. (2021, January 12–14). A video streaming vehicle detection algorithm based on YOLOv4. Proceedings of the 2021 IEEE 5th Advanced Information Technology, Electronic and Automation Control Conference (IAEAC), Chongqing, China.10.1109/IAEAC50856.2021.9390613 ↗
25. Kasper-Eulaers, M., Hahn, N., Berger, S., Sebulonsen, T., and Kummervold, P.E. (2021). Short Communication: Detecting Heavy Goods Vehicles in Rest Areas in Winter Conditions Using YOLOv5. Algorithms, 14.10.3390/a14040114 ↗
26. Bounding box-free instance segmentation using semi-supervised iterative learning for vehicle detection10.1109/JSTARS.2022.3169128 ↗
27. Vehicle detection and counting in high-resolution aerial images using convolutional regression neural network10.1109/ACCESS.2017.2782260 ↗
28. Improved Vision-Based Vehicle Detection and Classification by Optimized YOLOv410.1109/ACCESS.2022.3143365 ↗
29. Vehicle detection and tracking in adverse weather using a deep learning framework10.1109/TITS.2020.3014013 ↗
30. Mahmood, Z., Khan, K., Khan, U., Adil, S.H., Ali, S.S.A., and Shahzad, M. (2022). Towards Automatic License Plate Detection. Sensors, 22.10.3390/s22031245 ↗
31. Wu, T.H., Wang, W.T., and Liu, Y.Q. (2021, January 18–20). Real-time vehicle and distance detection based on improved yolo v5 network. Proceedings of the 2021 3rd World Symposium on Artificial Intelligence (WSAI), Guangzhou, China.10.1109/WSAI51899.2021.9486316 ↗
32. Lin, T., Maire, M., Belongie, S., Hays, J., Perona, P., Romanan, D., Dollar, P., and Zitnick, C. (2014, January 6–12). Microsoft COCO: Common objects in context. Proceedings of the Computer Vision–ECCV 2014: 13th European Conference, Zurich, Switzerland.10.1007/978-3-319-10602-1_48 ↗
33. He, Y., Zhu, C., Wang, J., Savvides, M., and Zhang, X. Proceedings of the In Proceedings of the Ieee/Cvf Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA, 15–20 June 2019 pp.
34. Dynamic vehicle detection with sparse point clouds based on PE-CPD10.1109/TITS.2018.2857510 ↗
35. Zhao, Q., Sheng, T., Wang, Y., Tang, Z., Chen, Y., Cai, L., and Ling, H. (2019, January 17). M2Det: A single-shot object detector based on multi-level feature pyramid network. Proceedings of the AAAI Conference on Artificial Intelligence, Montréal, QC, Canada.10.1609/aaai.v33i01.33019259 ↗
36. Li, Y., Chen, Y., Wang, N., and Zhang, Z. (2019). Scale-aware trident networks for object detection. arXiv.10.1109/ICCV.2019.00615 ↗
37. Mask SSD: An effective single-stage approach to object instance segmentation10.1109/TIP.2019.2947806 ↗
38. A new approach to track multiple vehicles with the combination of robust detection and two classifiers10.1109/TITS.2017.2756989 ↗
39. Law, H., and Deng, J. (2018, January 17–24). CornerNet: Detecting objects as paired keypoints. Proceedings of the European Conference on Computer Vision (ECCV), Glasgow, UK.10.1007/978-3-030-01264-9_45 ↗
40. He, K., Gkioxari, G., Dollár, P., and Girshick, R. (2017, January 22–29). Mask R-CNN. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.322 ↗
41. Orientation-Aware Vehicle Detection in Aerial Images via an Anchor-Free Object Detection Approach10.1109/TGRS.2020.3011418 ↗
42. SINet: A scale-insensitive convolutional neural network for fast vehicle detection10.1109/TITS.2018.2838132 ↗