journal article·2023-09-26Open access

Faster R-CNN-LSTM Construction Site Unsafe Behavior Recognition Model

Xu Li, Tianxuan Hao, Fan Li, Lizhen Zhao, Zehua Wang

Applied Sciences· Volume 13· Issue 19

Abstract

Aiming at the problem of insufficient accuracy caused by the insufficient mining of spatiotemporal features in the process of unsafe behavior and danger identification of construction personnel, the traditional two-stream convolution model is improved, and a two-stream convolution dangerous behavior recognition model based on Faster R-CNN-LSTM is proposed. In this model, the Faster R-CNN network is connected in parallel with the LSTM network. The Faster R-CNN network is used as the spatial flow, and the human spatial motion posture is divided into static and dynamic features to extract the anchor point features, respectively. The fusion of the two is used as the output of the spatial flow. An improved sliding long-term and short-term memory network is used in the time flow to increase the extraction ability of the time series features of the construction personnel. Finally, the two branches are fused in time and space to classify and identify whether the construction personnel wear safety helmets. The results show that the MAP of the improved Faster R-CNN-LSTM network framework is increased by 15%. The original CNN-LSTM network framework detected four targets, but there was one misdetection, with an accuracy of 91.48%. The improved frame detection accuracy reaches 99.99%, and there is no error detection. The proposed method is superior to the pre-improvement and other methods that can effectively identify the unsafe behavior of construction workers on construction sites and also has a good distinction effect on fuzzy actions.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Occupational Health and Safety Research · Anomaly Detection Techniques and Applications · Infrastructure Maintenance and Monitoring

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

College of Safety Science and Engineering, Henan Polytechnic University, Jiaozuo 454150, China

China Construction Eighth Engineering Division Corp., Ltd., Zhengzhou 450000, China

References (24)

Show source-provided references
1. Driving Behavior Risk Measurement and Cluster Analysis Driven by Vehicle Trajectory Data10.3390/app13095675 ↗
2. Deep Learning-Based Applications for Safety Management in the AEC Industry: A Review10.3390/app11020821 ↗
3. Improving Machine Learning Identification of Unsafe Driver Behavior by Means of Sensor Fusion10.3390/app10186417 ↗
4. Guo, H., Liu, W., Zhang, W., and Skitmor, M. (2014, January 27–28). A BIM-RFID Unsafe On-Site Behavior Warning System. Proceedings of the 2014 International Conference on Construction and Real Estate Management, Kunming, China.10.1061/9780784413777.040 ↗
5. Unsafe factor recognition and interactive analysis based on deep learning
6. Research on driver behavior recognition method based on convolutional neural network
7. Integration between artificial intelligence technologies for miners’ unsafe behavior identification
8. Construction Workers’ Unsafe Behavior Research Analysis and Evaluation Model
9. Region-based convolutional networks for accurate object detection and segmentation10.1109/TPAMI.2015.2437384 ↗
10. Girshick, R. (2015, January 7–13). Fast r-cnn. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.10.1109/ICCV.2015.169 ↗
11. Faster R-CNN: Towards real-time object detection with region proposal networks10.1109/TPAMI.2016.2577031 ↗
12. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (July, January 26). You only look once: Unified, real-time object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.
13. Analysis and Design of Safety Helmet Identification System Based on Wavelet Transform and Neural Network
14. Detecting non-hardhat-use by a deep learning method from far-field surveillance videos10.1016/j.autcon.2017.09.018 ↗
15. Research on Construction Worker Safety Helmet Wearing Recognition Based on Deep Learning
16. Safety Helmet Detection and Identity Recognition Based on Improved Faster RCNN
17. Improved YOLO v3 Algorithm and Its Application in Safety Helmet Detection
18. MDFNet: An unsupervised lightweight network for ear print recognition10.1007/s12652-022-04028-z ↗
19. Zhang, H., Ma, C., Pazzi, V., Zou, Y., and Casagli, N. (2020). Microseismic Signal Denoising and Separation Based on Fully Convolutional Encoder–Decoder Network. Appl. Sci., 10.10.3390/app10186621 ↗
20. Xiao, S., Nie, A., Zhang, Z., Liu, S., Song, M., and Zhang, H. (2020). Fault Diagnosis of a Reciprocating Compressor Air Valve Based on Deep Learning. Appl. Sci., 10.10.3390/app10186596 ↗
21. Park, J., Kim, J.K., Jung, S., Gil, Y., Choi, J.I., and Son, H.S. (2020). ECG-Signal Multi-Classification Model Based on Squeeze-and-Excitation Residual Neural Networks. Appl. Sci., 10.10.21203/rs.3.rs-34360/v1 ↗
22. Date Fruit Sorting Based on Deep Learning and Discriminant Correlation Analysis10.1109/ACCESS.2022.3194550 ↗
23. Son, N., Yang, S., and Na, J. (2020). Deep Neural Network and Long Short-Term Memory for Electric Power Load Forecasting. Appl. Sci., 10.10.3390/app10186489 ↗
24. Do, N.T., Kim, S.H., Yang, H.J., and Lee, G.S. (2020). Robust Hand Shape Features for Dynamic Hand Gesture Recognition Using Multi-Level Feature LSTM. Appl. Sci., 10.10.3390/app10186293 ↗