Automatic Detection of Construction Workers’ Helmet Wear Based on Lightweight Deep Learning
Source abstract
Abstract
To reduce the risk of head trauma to workers working in high-risk workplaces such as construction sites, we designed a new automated lightweight end-to-end convolutional neural network to identify whether all people on a construction site are wearing helmets. Firstly, we used GhostNet as the backbone feature extraction network to take advantage of its low running cost and make the model lighter overall while ensuring efficient automatic feature extraction. Secondly, we designed a multi-scale segmentation and feature fusion network (MSFFN) in the feature-processing stage to improve the algorithm’s robustness in detecting objects at different scales. In contrast, the design of the feature fusion network can enrich the diversity of helmet features and improve the accuracy of helmet detection when distance changes, viewpoint changes, and occlusion phenomena occur. Thirdly, we proposed an improved version of the attention mechanism, the lightweight residual convolutional attention network version 2 (LRCA-Netv2). The main idea of the improvement is implemented around the spatial dimension by fusing the combined features along with the horizontal and vertical directions and then weighting them separately. Such an operation allows the establishment of dependencies between the more distant features with improved accuracy compared to the original LRCA-Net. Finally, when tested on the dataset, the proposed lightweight helmet-wearing detection network has a mAP and FPS of 93.5% and 42.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Occupational Health and Safety Research · Traffic and Road Safety · Injury Epidemiology and Prevention
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Civil Engineering, Kyungpook National University, Daegu 41566, Korea
Funding
Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education
References (34)
Show source-provided references
1. The effect of hardhats on head and neck response to vertical impacts from large construction objects10.1016/j.aap.2014.08.011 ↗
2. Rubaiyat, A.H., Toma, T.T., Kalantari-Khandani, M., Rahman, S.A., Chen, L., Ye, Y., and Pan, C.S. (2016, January 13–16). Automatic detection of helmet uses for construction safety. Proceedings of the 2016 IEEE/WIC/ACM International Conference on Web Intelligence Workshops (WIW), Omaha, NE, USA.10.1109/WIW.2016.045 ↗
3. Li, J., Liu, H., Wang, T., Jiang, M., Wang, S., Li, K., and Zhao, X. (2017, January 4–6). Safety helmet wearing detection based on image processing and machine learning. Proceedings of the 2017 Ninth International Conference on Advanced Computational Intelligence (ICACI), Doha, Qatar.10.1109/ICACI.2017.7974509 ↗
4. An intelligent vision-based approach for helmet identification for work safety10.1016/j.compind.2018.03.037 ↗
5. Li, K., Zhao, X., Bian, J., and Tan, M. (2018). Automatic safety helmet wearing detection. arXiv.10.1109/CYBER.2017.8446080 ↗
6. Jin, M., Zhang, J., Chen, X., Wang, Q., Lu, B., Zhou, W., Nie, G., and Wang, X. (2020, January 26–28). Safety Helmet Detection Algorithm based on Color and HOG Features. Proceedings of the 2020 IEEE 19th International Conference on Cognitive Informatics and Cognitive Computing (ICCI* CC), Beijing, China.10.1109/ICCICC50026.2020.9450264 ↗
7. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., and Berg, A.C. (2016). SSD: Single shot multibox detector. Lecture Notes in Computer Science: European Conference on Computer Vision, Springer.10.1007/978-3-319-46448-0_2 ↗
8. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27–30). You only look once: Unified, real-time object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.91 ↗
9. Faster R-CNN: Towards real-time object detection with region proposal networks
10. Tan, M., and Le, Q. (2019, January 10-15). Efficientnet: Rethinking model scaling for convolutional neural networks. Proceedings of the 36th International Conference on Machine Learning, Long Beach, CA, USA.
11. Du, S., Shehata, M., and Badawy, W. (2011, January 11–13). Hard hat detection in video sequences based on face features, motion, and color information. Proceedings of the 2011 3rd International Conference on Computer Research and Development, Shanghai, China.
12. Silva, R., Aires, K., Santos, T., Abdala, K., Veras, R., and Soares, A. (2013, January 7–11). Automatic detection of motorcyclists without helmet. Proceedings of the 2013 XXXIX Latin American Computing Conference (CLEI), Caracas, Venezuela.10.1109/CLEI.2013.6670613 ↗
13. Visual tracking of construction job site workforce and equipment with particle filtering10.1061/(ASCE)CP.1943-5487.0000573 ↗
14. Hard-hat detection for construction safety visualization10.1155/2015/721380 ↗
15. Hardhat-wearing detection for enhancing on-site safety of construction workers10.1061/(ASCE)CO.1943-7862.0000974 ↗
16. Automated hardhat detection for construction safety applications10.1016/j.proeng.2017.08.022 ↗
17. A Study of Low-resolution Safety Helmet Image Recognition Combining Statistical Features with Artificial Neural Network
18. Detecting non-hardhat use by a deep learning method from far-field surveillance videos10.1016/j.autcon.2017.09.018 ↗
19. Bo, Y., Huan, Q., Huan, X., Rong, Z., Hongbin, L., Kebin, M., Weizhong, Z., and Lei, Z. (2019, January 19–20). Helmet detection under the power construction scene based on image analysis. Proceedings of the 2019 IEEE 7th International Conference on Computer Science and Network Technology (ICCSNT), Dalian, China.10.1109/ICCSNT47585.2019.8962495 ↗
20. Wu, F., Jin, G., Gao, M., Zhiwei, H.E., and Yang, Y. (2019, January 9–11). Helmet detection based on improved YOLO V3 deep model. Proceedings of the 2019 IEEE 16th International Conference on Networking, Sensing and Control (ICNSC), Banff, AB, Canada.10.1109/ICNSC.2019.8743246 ↗
21. Long, X., Cui, W., and Zheng, Z. (2019, January 15–17). Safety helmet wearing detection based on deep learning. Proceedings of the 2019 IEEE 3rd Information Technology, Networking, Electronic and Automation Control Conference (ITNEC), Chengdu, China.10.1109/ITNEC.2019.8729039 ↗
22. Deep learning for site safety: Real-time detection of personal protective equipment10.1016/j.autcon.2020.103085 ↗
23. Hayat, A., and Morgado-Dias, F. (2022). Deep Learning-Based Automatic Safety Helmet Detection System for Construction Safety. Appl. Sci., 12.10.3390/app12168268 ↗
24. Wang, L., Xie, L., Yang, P., Deng, Q., Du, S., and Xu, L. (2020). Hardhat-wearing detection based on a lightweight convolutional neural network with multi-scale features and a top-down module. Sensors, 20.10.3390/s20071868 ↗
25. Yang, X., Yang, J., Yan, J., Zhang, Y., Zhang, T., Guo, Z., Sun, X., and Fu, K. (November, January 27). SCRDet: Towards more robust detection for small, cluttered and rotated objects. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Korea.
26. Yang, X., Yan, J., Liao, W., Yang, X., Tang, J., and He, T. (IEEE Trans. Pattern Anal. Mach. Intell., 2022). SCRDet++: Detecting small, cluttered and rotated objects via instance-level feature denoising and rotation loss smoothing, IEEE Trans. Pattern Anal. Mach. Intell., Early Access.10.1109/TPAMI.2022.3166956 ↗
27. Han, K., Wang, Y., Tian, Q., Guo, J., Xu, C., and Xu, C. (2020, January 14–19). GhostNet: More features from cheap operations. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.00165 ↗
28. Liang, H., and Seo, S. (2022). Lightweight Deep Learning for Road Environment Recognition. Appl. Sci., 12.10.3390/app12063168 ↗
29. Gochoo, M. (2022). Safety Helmet detection with Extended Labels 5K images (SHEL5K). Mendeley Data.
30. Peng, D., Sun, Z., Chen, Z., Cai, Z., Xie, L., and Jin, L. (2018, January 20–24). Detecting heads using feature refine net and cascaded multi-scale architecture. Proceedings of the 2018 24th International Conference on Pattern Recognition (ICPR), Beijing, China.10.1109/ICPR.2018.8545068 ↗
31. Zheng, Z., Wang, P., Liu, W., Li, J., Ye, R., and Ren, D. (2020, January 3). Distance-IoU loss: Faster and better learning for bounding box regression. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.10.1609/aaai.v34i07.6999 ↗
32. Bochkovskiy, A., Wang, C.Y., and Liao, H.Y.M. (2020). Yolov4: Optimal speed and accuracy of object detection. arXiv.
33. Ge, Z., Liu, S., Wang, F., Li, Z., and Sun, J. (2021). Yolox: Exceeding Yolo series in 2021. arXiv.
34. Tan, M., Pang, R., and Le, Q.V. (2020, January 14–19). EfficientDet: Scalable and efficient object detection. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.01079 ↗