journal article·2024-01-08Open access

Enhanced YOLO Network for Improving the Efficiency of Traffic Sign Detection

Yang Cui, Dong Guo, Hao Yuan, Hengzhi Gu, Hongbo Tang

Applied Sciences· Volume 14· Issue 2

Abstract

One important task for autonomous driving is the precise detection and recognition of road traffic signs. This research focuses on a comprehensive set of 72 distinct traffic signs that are prevalent on urban roads in China, with the goal of developing an enhanced You Only Look Once (YOLO) network model tailored for this specific task. The modifications include the omission of the terminal convolution module and Conv3 (C3) module within the backbone network. Additionally, the 32-fold downsampling is replaced with a 16-fold downsampling, and a feature fusion module with dimensions of 152 × 152 is introduced in the feature layer. To capture a more encompassing context, a novel hybrid space pyramid pooling module, referred to as Hybrid Spatial Pyramid Pooling Fast (H-SPPF), is introduced. Furthermore, a channel attention mechanism is integrated into the framework, combined with three other improved methodologies. Upon evaluation, the enhanced algorithm demonstrates impressive results, achieving a precision rate of 91.72%, a recall rate of 91.77%, and a mean average precision (mAP) of 93.88% at an intersection over union (IoU) threshold of 0.5. Additionally, the method also achieves an mAP of 75.81% for a variety of IoU criteria between 0.5 and 0.95. These achievements are validated on an augmented dataset established for this study.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Neural Network Applications · Infrastructure Maintenance and Monitoring · Vehicle License Plate Recognition

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Automobile, Chang’an University, Xi’an 710064, China

Funding

National Key Research and Development Program of China

References (31)

Show source-provided references
1. Cascade saccade machine learning network with hierarchical classes for traffic sign detection10.1016/j.scs.2020.102700 ↗
2. Shallow convolutional neural networks for human activity recognition using wearable sensors10.1109/TIM.2021.3091990 ↗
3. Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23–28). Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.10.1109/CVPR.2014.81 ↗
4. Spatial pyramid pooling in deep convolutional networks for visual recognition10.1109/TPAMI.2015.2389824 ↗
5. Girshick, R. (2015, January 7–13). Fast r-cnn. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.10.1109/ICCV.2015.169 ↗
6. He, K., Gkioxari, G., Dollár, P., and Girshick, R. (2018, January 5). Mask R-CNN. Proceedings of the IEEE International Conference on Computer Vision, Istanbul, Turkey.10.1109/ICCV.2017.322 ↗
7. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks10.1109/TPAMI.2016.2577031 ↗
8. Deep detection network for real-life traffic sign in vehicular networks10.1016/j.comnet.2018.02.026 ↗
9. Lin, T.Y., Dollár, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. (2017, January 21–26). Feature Pyramid Networks for Object Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.106 ↗
10. Traffic signal detection and classification in street views using an attention model10.1007/s41095-018-0116-x ↗
11. A Cascaded R-CNN With Multiscale Attention and Imbalanced Samples for Traffic Sign Detection10.1109/ACCESS.2020.2972338 ↗
12. Wang, F., Li, Y., Wei, Y., and Dong, H. (2020, January 20–23). Improved Faster RCNN for Traffic Sign Detection. Proceedings of the 2020 IEEE 23rd International Conference on Intelligent Transportation Systems (ITSC), Rhodes, Greece.10.1109/ITSC45102.2020.9294270 ↗
13. Res2net: A new multi-scale backbone architecture10.1109/TPAMI.2019.2938758 ↗
14. Leibe, B., Matas, J., Sebe, N., and Welling, M. (2016). Computer Vision—ECCV 2016, Lecture Notes in Computer Science; Springer.10.1007/978-3-319-46478-7 ↗
15. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27–30). You Only Look Once: Unified, Real-Time Object Detection. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.91 ↗
16. Redmon, J., and Farhadi, A. (2017, January 21–26). YOLO9000: Better, Faster, Stronger. Proceedings of the IEEE Conference on Computer Vision & Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.690 ↗
17. Wang, C.-Y., Bochkovskiy, A., and Liao, H.-Y.M. (2023, January 17–24). YOLOv7: Trainable Bag-of-freebies sets new state-of-the-art for real-time object detectors. Proceedings of the 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, BC, Canada.10.1109/CVPR52729.2023.00721 ↗
18. Improved YOLOv5 network for real-time multi-scale traffic sign detection10.1007/s00521-022-08077-5 ↗
19. Garg, P., Chowdhury, D.R., and More, V.N. (2019, January 6–8). Traffic Sign Recognition and Classification Using YOLOv2, Faster RCNN and SSD. Proceedings of the 2019 10th International Conference on Computing, Communication and Networking Technologies (ICCCNT), Kanpur, India.10.1109/ICCCNT45670.2019.8944491 ↗
20. Ahmad, T., Chen, X., Saqlain, A.S., and Ma, Y. (2021, January 24–26). EDF-SSD: An Improved Feature Fused SSD for Object Detection. Proceedings of the 2021 IEEE 6th International Conference on Cloud Computing and Big Data Analytics (ICCCBDA), Chengdu, China.10.1109/ICCCBDA51879.2021.9442501 ↗
21. Real-Time Detection Method for Small Traffic Signs Based on Yolov310.1109/ACCESS.2020.2984554 ↗
22. Redmon, J., and Farhadi, A. (2018). Yolov3: An incremental improvement. arXiv.
23. Context-aware block net for small object detection10.1109/TCYB.2020.3004636 ↗
24. Cui, L., Ma, R., Lv, P., Jiang, X., Gao, Z., Zhou, B., and Xu, M. (2018). MDSSD: Multi-scale deconvolutional single shot detector for small objects. arXiv.
25. An Improved Light-Weight Traffic Sign Recognition Algorithm Based on YOLOv4-Tiny10.1109/ACCESS.2021.3109798 ↗
26. Rezatofighi, H., Tsoi, N., Gwak, J., Sadeghian, A., Reid, I., and Savarese, S. (2019, January 15–20). Generalized intersection over union: A metric and a loss for bounding box regression. Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.10.1109/CVPR.2019.00075 ↗
27. Gan, Z., Wenju, L., Wanghui, C., and Pan, S. (2021, January 25–27). Traffic sign recognition based on improved YOLOv4. Proceedings of the 2021 6th International Conference on Intelligent Informatics and Biomedical Sciences (ICIIBMS), Oita, Japan.10.1109/ICIIBMS52876.2021.9651596 ↗
28. Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., and Zitnick, C.L. (2014). Microsoft coco: Common objects in context. arXiv.10.1007/978-3-319-10602-1_48 ↗
29. Zhu, Z., Liang, D., Zhang, S., Huang, X., Li, B., and Hu, S. (2016, January 27–30). Traffic-sign detection and classification in the wild. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.232 ↗
30. Liu, S., Qi, L., Qin, H., Shi, J., and Jia, J. (2018, January 18–23). Path aggregation network for instance segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00913 ↗
31. Hu, J., Shen, L., and Sun, G. (2018, January 18–23). Squeeze-and-Excitation Networks. Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.10.1109/CVPR.2018.00745 ↗