Seatbelt Detection Algorithm Improved with Lightweight Approach and Attention Mechanism
Source abstract
Abstract
Precise and rapid detection of seatbelts is an essential research field for intelligent traffic management. In order to improve the detection precision of seatbelts and speed up algorithm inference velocity, a lightweight seatbelt detection algorithm is proposed. Firstly, by adding the G-ELAN module designed in this paper to the YOLOv7-tiny network, the optimization of construction and reduction of parameters are accomplished, and the ResNet is compressed with the channel pruning approach to decrease computational overheads. Then, the Mish activation function is utilized to replace the Leaky Relu in the neck to enhance the non-linear competence of the network. Finally, the triplet attention module is integrated into the model after pruning to make up for the underlying performance reduction caused by the previous stage and upgrade overall detection precision. The experimental results based on the self-built seatbelt dataset showed that, compared to the initial network, the Mean Average Precision (mAP) achieved by the proposed GM-YOLOv7 was improved by 3.8%, while the volume and the computation amount were lowered by 20% and 24.6%, respectively. Compared with YOLOv3, YOLOX, and YOLOv5, the mAP of GM-YOLOv7 increased by 22.4%, 4.6%, and 4.2%, respectively, and the number of computational operations decreased by 25%, 63%, and 38%, respectively. In addition, the accuracy of the improved RST-Net increased to 98.25%, while the parameter value was reduced by 48% compared to the basic model, effectively improving the detection performance and realizing a lightweight structure.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Neural Network Applications · Vehicle License Plate Recognition · Infrastructure Maintenance and Monitoring
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Information Engineering, Henan University of Science and Technology, Luoyang 471023, China
Funding
National Natural Science Foundation of China
References (48)
Show source-provided references
1. Detection and Recognition of Stationary Vehicles and Seat Belts in Intelligent Internet of Things Traffic Management System10.1007/s00521-021-05870-6 ↗
2. Intelligent Detection of Vehicle Driving Safety Based on Deep Learning
3. Analysis and Research on the Images of Drivers and Passengers Wearing Seat Belt in Traffic Inspection10.1007/s10586-018-2070-x ↗
4. Accurate Seat Belt Detection in Road Surveillance Images Based on CNN and SVM10.1016/j.neucom.2016.06.098 ↗
5. Deep Learning-Based Car Seatbelt Classifier Resilient to Weather Conditions10.14419/ijet.v9i1.30050 ↗
6. Seatbelt Detection in Road Surveillance Images Based on Improved Dense Residual Network with Two-Level Attention Mechanism10.1117/1.JEI.30.3.033036 ↗
7. Hu, J., Shen, L., Albanie, S., Sun, G., and Wu, E. (2018, January 18–22). Squeeze-and-Excitation Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.10.1109/CVPR.2018.00745 ↗
8. Huang, G., Liu, Z., van der Maaten, L., and Weinberger, K.Q. (2017, January 21–26). Densely Connected Convolutional Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.243 ↗
9. Automatic Detection of Vehicle Occupancy and Driver’s Seat Belt Status Using Deep Learning10.1007/s11760-022-02244-w ↗
10. He, K., Zhang, X., Ren, S., and Sun, J. (July, January 26). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
11. Seat belt detecting of car drivers with deep learning
12. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks10.1109/TPAMI.2016.2577031 ↗
13. Han, K., Wang, Y., Tian, Q., Guo, J., Xu, C., and Xu, C. (2018, January 13–19). GhostNet: More Features from Cheap Operations. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.
14. Wang, C.-Y., Bochkovskiy, A., and Liao, H.-Y.M. (2022). YOLOv7: Trainable Bag-of-Freebies Sets New State-of-the-Art for Real-Time Object Detectors. arXiv.10.1109/CVPR52729.2023.00721 ↗
15. Misra, D. (2020). Mish: A Self Regularized Non-Monotonic Activation Function. arXiv.
16. Misra, D., Nalamada, T., Arasanipalai, A.U., and Hou, Q. (2020). Rotate to Attend: Convolutional Triplet Attention Module. arXiv.10.1109/WACV48630.2021.00318 ↗
17. Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014). Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation. arXiv.10.1109/CVPR.2014.81 ↗
18. Girshick, R. (2015). Fast R-CNN. arXiv.10.1109/ICCV.2015.169 ↗
19. He, K., Gkioxari, G., Dollár, P., and Girshick, R. (2018). Mask R-CNN. arXiv.10.1109/ICCV.2017.322 ↗
20. Lin, T.-Y., Goyal, P., Girshick, R., He, K., and Dollár, P. (2018). Focal Loss for Dense Object Detection. arXiv.10.1109/ICCV.2017.324 ↗
21. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016). You Only Look Once: Unified, Real-Time Object Detection. arXiv.10.1109/CVPR.2016.91 ↗
22. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., and Berg, A.C. (2016, January 11–14). SSD: Single Shot MultiBox Detector. Proceedings of the Computer Vision—ECCV 2016, ECCV 2016, Amsterdam, The Netherlands.10.1007/978-3-319-46448-0_2 ↗
23. He, Y., Zhang, X., and Sun, J. (2017, January 22–29). Channel Pruning for Accelerating Very Deep Neural Networks. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Venice, Italy.10.1109/ICCV.2017.155 ↗
24. Model Compression and Hardware Acceleration for Neural Networks: A Comprehensive Survey10.1109/JPROC.2020.2976475 ↗
25. Jacob, B., Kligys, S., Chen, B., Zhu, M., Tang, M., Howard, A., Adam, H., and Kalenichenko, D. (2018, January 18–22). Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00286 ↗
26. Zhang, P., Zhong, Y., and Li, X. (2019, January 27–28). SlimYOLOv3: Narrower, Faster and Better for Real-Time UAV Applications. Proceedings of the IEEE/CVF International Conference on Computer Vision Workshop (ICCVW), IEEE, Seoul, Republic of Korea.10.1109/ICCVW.2019.00011 ↗
27. Wen, W., Wu, C., Wang, Y., Chen, Y., and Li, H. (2016). Learning Structured Sparsity in Deep Neural Networks. arXiv.
28. LeCun, Y., Denker, J.S., and Solla, S.A. (April, January 28). Optimal Brain Damage. Proceedings of the IEEE International Conference on Neural Networks, San Francisco, CA, USA.
29. Chollet, F. (2017). Xception: Deep Learning with Depthwise Separable Convolutions. arXiv.10.1109/CVPR.2017.195 ↗
30. Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications. arXiv.
31. Zhang, X., Zhou, X., Lin, M., and Sun, J. (2017). ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices. arXiv.10.1109/CVPR.2018.00716 ↗
32. Courbariaux, M., Hubara, I., Soudry, D., El-Yaniv, R., and Bengio, Y. (2016). Binarized Neural Networks: Training Deep Neural Networks with Weights and Activations Constrained to +1 or −1. arXiv.
33. Rastegari, M., Ordonez, V., Redmon, J., and Farhadi, A. (2016). XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks. arXiv.10.1007/978-3-319-46493-0_32 ↗
34. Tensor Decompositions and Applications10.1137/07070111X ↗
35. Hu, J., Shen, L., Albanie, S., Sun, G., and Vedaldi, A. (2019). Gather-Excite: Exploiting Feature Context in Convolutional Neural Networks. arXiv.
36. Woo, S. (2018). CBAM: Convolutional Block Attention Module. arXiv.10.1007/978-3-030-01234-2_1 ↗
37. Yang, L., Zhang, R.-Y., Li, L., and Xie, X. (2021, January 18–24). SimAM: A Simple, Parameter-Free Attention Module for Convolutional Neural Networks. Proceedings of the International Conference on Machine Learning, Online.
38. Hou, Q., Zhou, D., and Feng, J. (2021). Coordinate Attention for Efficient Mobile Network Design. arXiv.10.1109/CVPR46437.2021.01350 ↗
39. Ioffe, S., and Szegedy, C. (2015). Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift. arXiv.
40. Mao, A., Mohri, M., and Zhong, Y. (2023). Cross-Entropy Loss Functions: Theoretical Analysis and Applications. arXiv.
41. Wang, Q., Wu, B., Zhu, P., Li, P., Zuo, W., and Hu, Q. (2020). ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networks. arXiv.10.1109/CVPR42600.2020.01155 ↗
42. Yang, Q.-L.Z.Y.-B. (2021). SA-Net: Shuffle Attention for Deep Convolutional Neural Networks. arXiv.
43. Redmon, J., and Farhadi, A. (2018). YOLOv3: An Incremental Improvement. arXiv.
44. Ge, Z., Liu, S., Wang, F., Li, Z., and Sun, J. (2021). YOLOX: Exceeding YOLO Series in 2021. arXiv.
45. Tan, M., and Le, Q.V. (2020). EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks. arXiv.
46. Xie, S., Girshick, R., Dollár, P., Tu, Z., and He, K. (2017). Aggregated Residual Transformations for Deep Neural Networks. arXiv.10.1109/CVPR.2017.634 ↗
47. Zagoruyko, S., and Komodakis, N. (2017). Wide Residual Networks. arXiv.10.5244/C.30.87 ↗
48. Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization10.1007/s11263-019-01228-7 ↗