Deep Learning for Traffic Sign Recognition Based on Spatial Pyramid Pooling with Scale Analysis
Source abstract
Abstract
In the area of traffic sign detection (TSD) methods, deep learning has been implemented and achieves outstanding performance. The detection of a traffic sign, as it has a dual function in monitoring and directing the driver, is a big concern for driver support systems. A core feature of autonomous vehicle systems is the identification of the traffic sign. This article focuses on the prohibitive sign. The objective is to detect in real-time and reduce processing time considerably. In this study, we implement the spatial pyramid pooling (SPP) principle to boost Yolo V3’s backbone network for the extraction of functionality. Our work uses SPP for more comprehensive learning of multiscale object features. Then, perform a comparative investigation of Yolo V3 and Yolo V3 SPP across various scales to recognize the prohibitory sign. Comparisons with Yolo V3 SPP models reveal that their mean average precision (mAP) is higher than Yolo V3. Furthermore, the test accuracy findings indicate that the Yolo V3 SPP model performs better than Yolo V3 for different sizes.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Neural Network Applications · Hand Gesture Recognition Systems · Vehicle License Plate Recognition
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Information Management, Chaoyang University of Technology, Taichung City 41349, Taiwan
Faculty of Information Technology, Satya Wacana Christian University, Salatiga 50711, Indonesia
Department of Mathematics and Computer Science, University of Münster, D-48149 Münster, Germany
School of Creative Technologies, The University of Portsmouth, Portsmouth PO1 2UP, UK
Funding
Ministry of Science and Technology, Taiwan
References (57)
Show source-provided references
1. Evaluation of deep neural networks for traffic sign detection systems10.1016/j.neucom.2018.08.009 ↗
2. Real-time traffic sign recognition using deep network for embedded platforms10.2352/ISSN.2470-1173.2019.15.AVM-033 ↗
3. Users of the world, unite! The challenges and opportunities of Social Media10.1016/j.bushor.2009.09.003 ↗
4. Personalized Recommendation Combining User Interest and Social Circle10.1109/TKDE.2013.168 ↗
5. Girshick, R., Donahue, J., Darrell, T., Malik, J., and Malik, J. (2014, January 23–28). Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.10.1109/CVPR.2014.81 ↗
6. Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R., and LeCun, Y. (2014, January 14–16). Overfeat: Integrated recognition, localization and detection using convolutional networks. Proceedings of the 2nd International Conference on Learning Representations, ICLR 2014, Banff, AB, Canada.
7. Object detection with class aware region proposal network and focused attention objective10.1016/j.patrec.2018.09.025 ↗
8. Multi-scale Orderless Pooling of Deep Convolutional Activation Features10.1007/978-3-319-10584-0_26 ↗
9. Vision-Based Traffic Sign Detection and Analysis for Intelligent Driver Assistance Systems: Perspectives and Survey10.1109/TITS.2012.2209421 ↗
10. Shahud, M., Bajracharya, J., Praneetpolgrang, P., and Petcharee, S. (2018, January 21–24). Thai Traffic Sign Detection and Recognition Using Convolutional Neural Networks. Proceedings of the 2018 22nd International Computer Science and Engineering Conference (ICSEC), Chiang Mai, Thailand.10.1109/ICSEC.2018.8712662 ↗
11. A CPSS Approach for Emergency Evacuation in Building Fires10.1109/MIS.2014.38 ↗
12. Random Forest and Support Vector Machine on Features Selection for Regression Analysis
13. Multi-Feature Fusion and Enhancement Single Shot Detector for Traffic Sign Recognition10.1109/ACCESS.2020.2975828 ↗
14. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., and Berg, A.C. (2016). SSD: Single shot multibox detector. Proceedings of the Lecture Notes in Computer Science Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics, Springer.10.1007/978-3-319-46448-0_2 ↗
15. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks10.1109/TPAMI.2016.2577031 ↗
16. A Cascaded R-CNN With Multiscale Attention and Imbalanced Samples for Traffic Sign Detection10.1109/ACCESS.2020.2972338 ↗
17. Dai, J., Li, Y., He, K., and Sun, J. (2016, January 5–10). R-FCN: Object detection via region-based fully convolutional networks. Proceedings of the Advances in Neural Information Processing Systems, Barcelona, Spain.
18. Redmon, J., and Farhadi, A. (2017, January 21–26). YOLO9000: Better, Faster, Stronger. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.690 ↗
19. Integrating Real-Time Weather Forecasts Data Using OpenWeatherMap and Twitter
20. Te Comparative Analysis of Restricted Boltzmann Machine Models for Image Classification
21. Jensen, M.B., Nasrollahi, K., and Moeslund, T.B. (2017, January 21–26). Evaluating State-of-the-Art Object Detector on Challenging Traffic Light Data. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Honolulu, HI, USA.10.1109/CVPRW.2017.122 ↗
22. Zhang, J., Huang, M., Jin, X., and Li, X. (2017). A Real-Time Chinese Traffic Sign Detection Algorithm Based on Modified YOLOv2. Algorithms, 10.10.3390/a10040127 ↗
23. Redmon, J., and Farhadi, A. (2018). YOLOv3: An Incremental Improvement. arXiv.
24. Bochkovskiy, A., Wang, C.-Y., and Liao, H.-Y.M. (2020). YOLOv4: Optimal Speed and Accuracy of Object Detection. arXiv, 1–17.
25. Grauman, K., and Darrell, T. (2005, January 17–21). The pyramid match kernel: Discriminative classification with sets of image features. Proceedings of the Tenth IEEE International Conference on Computer Vision (ICCV’05) Volume 1, Beijing, China.10.1109/ICCV.2005.239 ↗
26. Lazebnik, S., Schmid, C., and Ponce, J. (2006, January 17–22). Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories. Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Volume 1 (CVPR’06), New York, NY, USA.
27. He, K., Zhang, X., Ren, S., and Sun, J. (2015). Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition. IEEE Trans. Pattern Anal. Mach. Intell., 1–14.10.1109/TPAMI.2015.2389824 ↗
28. Dewi, C., Chen, R.-C., and Tai, S.-K. (2020). Evaluation of Robust Spatial Pyramid Pooling Based on Convolutional Neural Network for Traffic Sign Recognition System. Electronics, 9.10.3390/electronics9060889 ↗
29. Yanliang, C., Yongran, L., Baisen, W., Hanyin, Z., and Zhihong, W. (2019). Applying deep learning technology to image recognition of traffic signs. Proceedings of the 2019 International Conference on Technologies and Applications of Artificial Intelligence, Springer.
30. Yen-Zhang, H. (2018). Building a traffic signs open dataset in Taiwan and verify it by convolutional neural network. [Ph.D. Thesis, National Taichung University of Science and Technology].
31. Dewi, C., Chen, R.-C., Liu, Y.-T., Liu, Y.-S., and Jiang, L.-Q. (2020, January 26–28). Taiwan Stop Sign Recognition with Customize Anchor. Proceedings of the 12th International Conference on Computer Modeling and Simulation; Association for Computing Machinery (ACM), Brisbane, Australia.10.1145/3408066.3408078 ↗
32. Redmon, J., Divvala, S., Girshick, R., and Ali, F. (2016, January 27–30). (YOLO) You Only Look Once. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.
33. Springenberg, J.T., Dosovitskiy, A., Brox, T., and Riedmiller, M. (2014). Striving for simplicity: The all convolutional net. arXiv.
34. Hu, Y., Wu, X., Zheng, G., and Liu, X. (2019, January 27–30). Object Detection of UAV for Anti-UAV Based on Improved YOLO v3. Proceedings of the 2019 Chinese Control Conference (CCC), Guangzhou, China.10.23919/ChiCC.2019.8865525 ↗
35. Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. (2017, January 21–26). Feature Pyramid Networks for Object Detection. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.106 ↗
36. Chen, Q., Liu, L., Han, R., Qian, J., and Qi, D. (2019, January 27–30). Image identification method on high speed railway contact network based on YOLO v3 and SENet. Proceedings of the 2019 Chinese Control Conference (CCC), Guangzhou, China.10.23919/ChiCC.2019.8865153 ↗
37. Automatic Traffic Sign Detection and Recognition Using SegU-Net and a Modified Tversky Loss Function With L1-Constraint10.1109/TITS.2019.2911727 ↗
38. Mini-YOLOv3: Real-Time Object Detector for Embedded Applications10.1109/ACCESS.2019.2941547 ↗
39. Wu, F., Jin, G., Gao, M., He, Z., and Yang, Y. (2019, January 9–11). Helmet Detection Based on Improved YOLO V3 Deep Model. Proceedings of the 2019 IEEE 16th International Conference on Networking, Sensing and Control (ICNSC), Banff, Canada.10.1109/ICNSC.2019.8743246 ↗
40. Research on Small Target Detection in Driving Scenarios Based on Improved Yolo Network10.1109/ACCESS.2020.2966328 ↗
41. Ultrasonic Diagnosis of Breast Nodules Using Modified Faster R-CNN10.1177/0161734619882683 ↗
42. Dewi, C., Chen, R.-C., and Liu, Y.-T. (2019, January 23–25). Similar Music Instrument Detection via Deep Convolution YOLO-Generative Adversarial Network. Proceedings of the 2019 IEEE 10th International Conference on Awareness Science and Technology (iCAST), Morioka, Japan.10.1109/ICAwST.2019.8923404 ↗
43. Sivic, J., and Zisserman, A. (2003, January 13–16). Video Google: A text retrieval approach to object matching in videos. Proceedings of the Proceedings Ninth IEEE International Conference on Computer Vision, Nice, France.10.1109/ICCV.2003.1238663 ↗
44. Yang, J., Yu, K., Gong, Y., and Huang, T. (2009). Linear spatial pyramid matching using sparse coding for image classification. In Proceedings of the 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops. CVPR Workshops, 1794–1801.
45. Wang, J., Yang, J., Yu, K., Lv, F., Huang, T., and Gong, Y. (2010, January 13–18). Locality-constrained Linear Coding for image classification. Proceedings of the 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Francisco, CA, USA.10.1109/CVPR.2010.5540018 ↗
46. Improving the Fisher Kernel for Large-Scale Image Classification10.1007/978-3-642-15561-1_11 ↗
47. Van De Sande, K.E.A., Uijlings, J.R.R., Gevers, T., and Smeulders, A.W.M. (2011, January 6–13). Segmentation as selective search for object recognition. Proceedings of the 2011 International Conference on Computer Vision, Barcelona, Spain.10.1109/ICCV.2011.6126456 ↗
48. Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012, January 3–6). ImageNet classification with deep convolutional neural networks. Proceedings of the Advances in Neural Information Processing Systems (NIPS), Lake Tahoe, NV, USA.
49. (2020, March 13). Bbox label tool. Available online: https://github.com/puzzledqs/BBox-Label-Tool.
50. Zoph, B., Cubuk, E.D., Ghiasi, G., Lin, T.-Y., Shlens, J., and Le, Q.V. (2019). Learning Data Augmentation Strategies for Object Detection. arXiv, 1–13.
51. Murugavel, M. (2020, March 20). YOLO Annotation Tool. Available online: https://github.com/ManivannanMurugavel/YOLO-Annotation-Tool.
52. Dewi, C., Chen, R.-C., and Yu, H. (2020). Weight analysis for various prohibitory sign detection and recognition using deep learning. Multimed. Tools Appl., 1–19.10.1007/s11042-020-09509-x ↗
53. Selecting critical features for data classification based on machine learning methods10.1186/s40537-020-00327-4 ↗
54. Dewi, C., and Chen, R.-C. (2019, January 6–9). Human Activity Recognition Based on Evolution of Features Selection and Random Forest. Proceedings of the 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC), Bari, Italy.10.1109/SMC.2019.8913868 ↗
55. Huang, Y.-Q., Zheng, J.-C., Sun, S.-D., Yang, C.-F., and Liu, J. (2020). Optimized YOLOv3 Algorithm and Its Application in Traffic Flow Detections. Appl. Sci., 10.10.3390/app10093079 ↗
56. Dewi, C., and Chen, R.-C. (2019). Decision Making Based on IoT Data Collection for Precision Agriculture. Intelligent Tools for Building a Scientific Information Platform, Springer Science and Business Media LLC.10.1007/978-3-030-14132-5_3 ↗
57. Dewi, C., and Chen, R. (2019). Intelligent information and database systems: Recent developments. Intelligent Information and Database Systems: Recent Developments, Springer.