journal article·2023-07-18Open access

Real-Time Intelligent Detection System for Illegal Wearing of On-Site Power Construction Worker Based on Edge-YOLO and Low-Cost Edge Devices

Rong Chang, Bangyuan Li, Junpeng Dang, Chuanxu Yang, Anning Pan, Yang Yang

Applied Sciences· Volume 13· Issue 14

Abstract

Ensuring personal safety and preventing accidents are critical aspects of power construction safety supervision. However, current monitoring methods are inefficient and unreliable as most of them rely on manual monitoring and transmission, which results in slow detection and delayed warnings regarding violations. To overcome these challenges, we propose an intelligent detection system that can accurately identify instances of illegal wearing of power construction workers in real-time. Firstly, we integrated the squeeze-and-excitation (SE) module into our convolutional neural network to enhance detection accuracy. This module effectively prioritizes informative features while suppressing less relevant ones, resulting in improved overall performance. Secondly, we present an embedded real-time detection system that utilizes Jetson Xavier NX and Edge-YOLO. This system promptly detects and alerts power construction workers of instances of illegal wearing behavior. To ensure a lightweight implementation, we design appropriate detection heads based on target size and distribution, reducing model parameters while enhancing detection speed and minimizing accuracy loss. Additionally, we employed data augmentation to enhance the system’s robustness. Our experimental results demonstrate that our improved Edge-YOLO model achieves high detection precision and recall rates of 0.964 and 0.966, respectively, with a frame rate of 35.36 frames per second when deployed on Jetson Xavier NX. Therefore, Edge-YOLO proves to be an ideal choice for intelligent real-time detection systems, providing superior accuracy and speed performance compared to the original YOLOv5s model and other models in the YOLO series for safety monitoring at construction sites.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Occupational Health and Safety Research · Fire Detection and Safety Systems · Anomaly Detection Techniques and Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Yuxi Power Supply Bureau, Yunnan Power Grid Corporation, Yuxi 653100, China

School of Big Data, Baoshan University, Baoshan 678000, China

School of Physics and Electronic Information, Yunnan Normal University, Kunming 650500, China

School of Information Science and Technology, Yunnan Normal University, Kunming 650500, China

Funding

The science and technology program · Yunnan Province Ten Thousand Talents Program

References (32)

Show source-provided references
1. Basahel, A.M. (2021). Safety leadership, safety attitudes, safety knowledge and motivation toward safety-related behaviors in electrical substation construction projects. Int. J. Environ. Res. Public Health, 18.10.3390/ijerph18084196 ↗
2. Video stream analysis in clouds: An object detection and classification framework for high performance video analytics10.1109/TCC.2016.2517653 ↗
3. Xu, P., Tang, Z., Huang, J., Li, X., Yan, Y., and Xiao, J. (2021, January 15–17). Review on Functional Architecture and Key Technologies of Intelligent Substation. Proceedings of the 2021 International Conference on Advanced Electrical Equipment and Reliable Operation (AEERO), Beijing, China.10.1109/AEERO52475.2021.9708346 ↗
4. An overview on safe operation of grid-connected converters from resilience perspective: Analysis and design10.1016/j.ijepes.2022.108511 ↗
5. Real time object detection and trackingsystem for video surveillance system10.1007/s11042-020-09749-x ↗
6. Hu, J., Shen, L., and Sun, G. (2018, January 18–22). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00745 ↗
7. Rapid object detection using a boosted cascade of simple features
8. Histograms of oriented gradients for human detection10.1109/CVPR.2005.177 ↗
9. Object detection with discriminatively trained part-based models10.1109/TPAMI.2009.167 ↗
10. Imagenet classification with deep convolutional neural networks10.1145/3065386 ↗
11. Shafiq, M., and Gu, Z. (2022). Deep residual learning for image recognition: A survey. Appl. Sci., 12.10.3390/app12188972 ↗
12. Ren, S., He, K., Girshick, R., and Sun, J. (2016). Faster r-cnn: Towards real-time object detection with region proposal networks. Adv. Neural Inf. Process. Syst., 2577031.
13. Lin, T.Y., Dollár, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. (2017, January 21–26). Feature pyramid networks for object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.106 ↗
14. Duan, K., Bai, S., Xie, L., Qi, H., Huang, Q., and Tian, Q. (2019, January 27–28). Centernet: Keypoint triplets for object detection. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea.10.1109/ICCV.2019.00667 ↗
15. A Review of Yolo algorithm developments10.1016/j.procs.2022.01.135 ↗
16. Lin, T.Y., Goyal, P., Girshick, R., He, K., and Dollár, P. (2017, January 22–29). Focal loss for dense object detection. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.324 ↗
17. Tan, M., and Le, Q. (2019, January 9–15). Efficientnet: Rethinking model scaling for convolutional neural networks. Proceedings of the International Conference on Machine Learning, PMLR, Long Beach, CA, USA.
18. An overview on edge computing research10.1109/ACCESS.2020.2991734 ↗
19. Machine learning at the network edge: A survey10.1145/3469029 ↗
20. Real-time and accurate object detection on edge device with TensorFlow Lite
21. Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L.C. (2018, January 18–22). Mobilenetv2: Inverted residuals and linear bottlenecks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00474 ↗
22. Locally GAN-generated face detection based on an improved Xception10.1016/j.ins.2021.05.006 ↗
23. Huang, R., Pedoeem, J., and Chen, C. (2018, January 10–13). YOLO-LITE: A real-time object detection algorithm optimized for non-GPU computers. Proceedings of the 2018 IEEE International Conference on Big Data (Big Data), Seattle, WA, USA.10.1109/BigData.2018.8621865 ↗
24. Cai, Y., Li, H., Yuan, G., Niu, W., Li, Y., Tang, X., Ren, B., and Wang, Y. (2021, January 2–9). Yolobile: Real-time object detection on mobile devices via compression-compilation co-design. Proceedings of the AAAI Conference on Artificial Intelligence, Virtual.10.1609/aaai.v35i2.16179 ↗
25. Weapons detection for security and video surveillance using cnn and YOLO-v5s
26. Deep learning-based substation remote construction management and AI automatic violation detection system10.1049/gtd2.12387 ↗
27. Liao, F., Sun, Y., Wu, Y., and Wang, J. (2022, January 25–27). Real-time Occupancy Detection Of On-street Parking Spaces Based On An Edge Device. Proceedings of the 2022 Asia Conference on Algorithms, Computing and Machine Learning (CACML), Hangzhou, China.10.1109/CACML55074.2022.00109 ↗
28. SETR-YOLOv5n: A Lightweight Low-Light Lane Curvature Detection Method Based on Fractional-Order Fusion Model10.1109/ACCESS.2022.3203443 ↗
29. Safety helmet wearing detection based on YOLOv5 of attention mechanism
30. Channel pruned YOLO V5s-based deep learning approach for rapid and accurate apple fruitlet detection before fruit thinning10.1016/j.biosystemseng.2021.08.015 ↗
31. CDNet: A real-time and robust crosswalk detection network on Jetson nano based on YOLOv510.1007/s00521-022-07007-9 ↗
32. Wang, C.Y., Bochkovskiy, A., and Liao, H.Y.M. (2022). YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. arXiv.