journal article·2019-09-08Open access

Performance Evaluation of Region-Based Convolutional Neural Networks Toward Improved Vehicle Taillight Detection

Zhenzhou Wang, Wei Huo, Pingping Yu, Lin Qi, Shanshan Geng, Ning Cao

Applied Sciences· Volume 9· Issue 18

Abstract

Increasingly serious traffic jams and traffic accidents pose threats to the social economy and human life. The lamp semantics of driving is a major way to transmit the driving behavior information between vehicles. The detection and recognition of the vehicle taillights can acquire and understand the taillight semantics, which is of great significance for realizing multi-vehicle behavior interaction and assists driving. It is a challenge to detect taillights and identify the taillight semantics on real traffic road during the day. The main research content of this paper is mainly to establish a neural network to detect vehicles and to complete recognition of the taillights of the preceding vehicle based on image processing. First, the outlines of the preceding vehicles are detected and extracted by using convolutional neural networks. Then, the taillight area in the Hue-Saturation-Value (HSV) color space are extracted and the taillight pairs are detected by correlations of histograms, color and positions. Then the taillight states are identified based on the histogram feature parameters of the taillight image. The detected taillight state of the preceding vehicle is prompted to the driver to reduce traffic accidents caused by the untimely judgement of the driving intention of the preceding vehicle. The experimental results show that this method can accurately identify taillight status during the daytime and can effectively reduce the occurrence of confused judgement caused by light interference.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Autonomous Vehicle Technology and Safety · Video Surveillance and Tracking Methods · Advanced Neural Network Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Information Science and Engineering, Hebei University of Science and Technology, Shijiazhuang 050000, China

School of Information Technology, Hebei University of Economics and Business, Shijiazhuang 050061, China

School of Computer and Information Engineering, Chuzhou University, Chuzhou 239000, China

School of Internet of Things and Software Technology, Wuxi Vocational College of Science and Technology, Wuxi 214028, China

Funding

Science and Technology Support Plan Project of Hebei Province

References (27)

Show source-provided references
1. Vehicle rear-end collision warning algorithm based on DSRC
2. Susel, F., and Takayuki, I. (2016, January 1–4). Driver classification for intelligent transportation systems using fuzzy logic. Proceedings of the 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC), Rio de Janeiro, Brazil.
3. Liu, Y. (2018, January 25–26). Big Data Technology and Its Analysis of Application in Urban Intelligent Transportation System. Proceedings of the 2018 International Conference on Intelligent Transportation, Big Data & Smart City (ICITBS), Xiamen, China.10.1109/ICITBS.2018.00012 ↗
4. Xu, Y., and Yu, F. (2013, January 26–27). Research on the Image Acquisition and Camera Control of Machine Vision Camera Based on LabVIEW. Proceedings of the 2013 5th International Conference on Intelligent Human-Machine Systems and Cybernetics, Hangzhou, China.10.1109/IHMSC.2013.266 ↗
5. Jin, M. (2013, January 16–18). A New Vehicle Safety Space Model Based on Driving Intention. Proceedings of the 2013 Third International Conference on Intelligent System Design and Engineering Applications, Hong Kong, China.
6. Wu, H., Li, Y., Wu, C., Ma, Z., and Zhou, H. (2017, January 8–10). A longitudinal minimum safety distance model based on driving intention and fuzzy reasoning. Proceedings of the 2017 4th International Conference on Transportation Information and Safety (ICTIS), Banff, AB, Canada.10.1109/ICTIS.2017.8047760 ↗
7. Robust Vehicle Detection and Distance Estimation Under Challenging Lighting Conditions10.1109/TITS.2015.2421482 ↗
8. Weis, T., Mundt, M., Harding, P., and Ramesh, V. (2017, January 16–19). Anomaly detection for automotive visual signal transition estimation. Proceedings of the IEEE 20th International Conference on Intelligent Transportation Systems (ITSC), Yokohama, Japan.10.1109/ITSC.2017.8317605 ↗
9. Jen, C., Chen, Y., and Hsiao, H. (2017, January 12–14). Robust detection and tracking of vehicle taillight signals using frequency domain feature based Adaboost learning. Proceedings of the IEEE International Conference on Consumer Electronics—Taiwan (ICCE-TW), Taipei, Taiwan.10.1109/ICCE-China.2017.7991176 ↗
10. Casares, M., Almagambetov, A., and Velipasalar, S. (2012, January 18–21). A Robust Algorithm for the Detection of Vehicle Turn Signals and Brake Lights. Proceedings of the 2012 IEEE Ninth International Conference on Advanced Video and Signal-Based Surveillance, Beijing, China.10.1109/AVSS.2012.2 ↗
11. Almagambetov, A., Casares, M., and Velipasalar, S. (2012, January 11–13). Autonomous tracking of vehicle rear lights and detection of brakes and turn signals. Proceedings of the IEEE Symposium on Computational Intelligence for Security and Defence Applications, Ottawa, ON, Canada.10.1109/CISDA.2012.6291543 ↗
12. Cui, Z., Yang, S., and Tsai, H. (2015, January 15–18). A Vision-Based Hierarchical Framework for Autonomous Front-Vehicle Taillights Detection and Signal Recognition. Proceedings of the IEEE 18th International Conference on Intelligent Transportation Systems, Las Palmas, Spain.10.1109/ITSC.2015.156 ↗
13. Qing, M., and Jo, K. (2011, January 22–24). Vehicle detection using tail light segmentation. Proceedings of the 2011 6th International Forum on Strategic Technology, Harbin, China.
14. Wang, J., Zhou, L., Pan, Y., and Lee, S. (2016, January 19–22). Appearance-based Brake-Lights recognition using deep learning and vehicle detection. Proceedings of the 2016 IEEE Intelligent Vehicles Symposium (IV), Gothenburg, Sweden.10.1109/IVS.2016.7535481 ↗
15. Wang, Y., Liu, Z., and Deng, W. (2019). Anchor Generation Optimization and Region of Interest Assignment for Vehicle Detection. Sensors, 19.10.3390/s19051089 ↗
16. Zhang, F., Li, C., and Yang, F. (2019). Vehicle Detection in Urban Traffic Surveillance Images Based on Convolutional Neural Networks with Feature Concatenation. Sensors, 19.10.3390/s19030594 ↗
17. Vehicle detection based on vision and millimeter wave radar
18. Manuel, I., Tardi, T., Pérez-Oria, J., and Robla, S. (2017). Shadow-Based Vehicle Detection in Urban Traffic. Sensors, 17.10.3390/s17050975 ↗
19. Zhou, Z., Duan, G., Lei, H., Zhou, G., Wan, N., and Yang, W. (2018, January 9–11). Human behavior recognition method based on double-branch deep convolution neural network. Proceedings of the 2018 Chinese Control and Decision Conference (CCDC), Shenyang, China.
20. Yang, Z., Li, J., and Li, H. (2018, January 26–29). Real-time Pedestrian and Vehicle Detection for Autonomous Driving. Proceedings of the 2018 IEEE Intelligent Vehicles Symposium (IV), Changshu, China.10.1109/IVS.2018.8500642 ↗
21. Krizhevsky, A., Sutskever, I., and Hinton, G. (2012, January 2–6). ImageNet Classification with Deep Convolutional Neural Networks. Proceedings of the 26th Annual Conference on Neural Information Processing Systems, Lake Tahoe, NV, USA.
22. Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23–28). Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.10.1109/CVPR.2014.81 ↗
23. Long, J., Shelhamer, E., and Darrell, T. (2015, January 7–12). Fully Convolutional Networks for Semantic Segmentation. Proceedings of the 2015 IEEE Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298965 ↗
24. Szegedy, C., Toshev, A., and Erhan, D. (2013, January 5–10). Deep Neural Networks for Object Detection. Proceedings of the Advances in Neural Information Processing Systems, Nevada, NV, USA.
25. Sande, K., Uijlings, J., Gevers, T., and Smeulders, A. (2011, January 6–13). Segmentation as selective search for object recognition. Proceedings of the IEEE Computer Vision, Barcelona, Spain.
26. Girshick, R. (2015, January 11–18). Fast R-CNN. Proceedings of the IEEE Computer Vision, Santiago, Chile.10.1109/ICCV.2015.169 ↗
27. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks10.1109/TPAMI.2016.2577031 ↗