journal article·2025-10-18Open access

Real-Time Deep-Learning-Based Recognition of Helmet-Wearing Personnel on Construction Sites from a Distance

Fatih Aslan, Yaşar Becerikli

Applied Sciences· Volume 15· Issue 20

Abstract

On construction sites, it is crucial and and in most cases mandatory to wear safety equipment such as helmets, safety shoes, vests, and belts. The most important of these is the helmet, as it protects against head injuries and can also serve as a marker for detecting and tracking workers, since a helmet is typically visible to cameras on construction sites. Checking helmet usage, however, is a labor-intensive and time-consuming process. A lot of work has been conducted on detecting and tracking people. Some studies have involved hardware-based systems that require batteries and are often perceived as intrusive by workers, while others have focused on vision-based methods. The aim of this work is not only to detect workers and helmets, but also to identify workers through labeled helmets using symbol detection methods. Person and helmet detection tasks were handled by training existing datasets and gained accurate results. For symbol detection, 14 different shapes were selected and put on helmets in a triple format side by side. A total of 11,243 images have been annotated. YOLOv5 and YOLOv8 were used to train the dataset and obtain models. The results show that both methods achieved high precision and recall. However, YOLOv5 slightly outperformed YOLOv8 in real-time identification tests, correctly detecting the helmet symbols. A testing dataset containing different distances was generated in order to measure accuracy by distance. According to the results, accurate identification was achieved at distances of up to 10 meters. Also, a location-based symbol-ordering algorithm is proposed. Since symbol detection does not follow any order and works with confidence values in the inference mode, a left to right approach is followed.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Occupational Health and Safety Research · Traffic and Road Safety · Anomaly Detection Techniques and Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Research and Development Department, Sefine Shipyard, 77700 Yalova, Türkiye

Computer Engineering Department, Kocaeli University, 41001 Kocaeli, Türkiye

Digital Forensics Department, The Council of Forensic Medicine (ATK), 34186 Istanbul, Türkiye

Funding

Sefine Shipyard

References (48)

Show source-provided references
1. NIOSH Science Blog (2024, August 13). Traumatic Brain Injuries in Construction, Available online: https://blogs.cdc.gov/niosh-science-blog/2016/03/21/constructiontbi.
2. Occupational Safety and Health Administration (2024, August 13). Top 10 Most Frequently Cited Standards, Available online: https://www.osha.gov/top10citedstandards.
3. Fault Tree Analysis of Unreasonably Wearing Helmets for Builders
4. Rubaiyat, A.H.M., Toma, T.T., Kalantari-Khandani, M., Rahman, S.A., Chen, L., Ye, Y., and Pan, C.S. (2016, January 13–16). Automatic Detection of Helmet Uses for Construction Safety. Proceedings of the 2016 IEEE/WIC/ACM International Conference on Web Intelligence Workshops (WIW), Omaha, NE, USA.10.1109/WIW.2016.045 ↗
5. Real-Time Alarming, Monitoring, and Locating for Non-Hard-Hat Use in Construction10.1061/(ASCE)CO.1943-7862.0001629 ↗
6. Deep Learning for Site Safety: Real-Time Detection of Personal Protective Equipment10.1016/j.autcon.2020.103085 ↗
7. Mobile Passive Radio Frequency Identification (RFID) Portal for Automated and Rapid Control of Personal Protective Equipment (PPE) on Construction Sites10.1016/j.autcon.2013.08.009 ↗
8. Real-Time Personal Protective Equipment Monitoring System10.1016/j.comcom.2012.01.005 ↗
9. Hayat, A., and Morgado-Dias, F. (2022). Deep Learning-Based Automatic Safety Helmet Detection System for Construction Safety. Appl. Sci., 12.10.3390/app12168268 ↗
10. Deep Learning-Based Safety Helmet Detection in Engineering Management Based on Convolutional Neural Networks10.1155/2020/9703560 ↗
11. Wang, Z., Wu, Y., Yang, L., Thirunavukarasu, A., Evison, C., and Zhao, Y. (2021). Fast Personal Protective Equipment Detection for Real Construction Sites Using Deep Learning Approaches. Sensors, 21.10.3390/s21103478 ↗
12. Adjabi, I., Ouahabi, A., Benzaoui, A., and Taleb-Ahmed, A. (2020). Past, Present, and Future of Face Recognition: A Review. Electronics, 9.10.20944/preprints202007.0479.v1 ↗
13. Taigman, Y., Yang, M., Ranzato, M., and Wolf, L. (2014, January 23–28). DeepFace: Closing the Gap to Human-Level Performance in Face Verification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.10.1109/CVPR.2014.220 ↗
14. Schroff, F., Kalenichenko, D., and Philbin, J. (2015, January 7–12). FaceNet: A Unified Embedding for Face Recognition and Clustering. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298682 ↗
15. Wen, Y., Zhang, K., Li, Z., and Qiao, Y. (2016, January 11–14). A Discriminative Feature Learning Approach for Deep Face Recognition. Proceedings of the ECCV 2016: 14th European Conference on Computer Vision, Amsterdam, The Netherlands.10.1007/978-3-319-46478-7_31 ↗
16. Wu, Y., Liu, H., Li, J., and Fu, Y. (2017, January 23–27). Deep Face Recognition with Center Invariant Loss. Proceedings of the Thematic Workshops of ACM Multimedia, Mountain View, CA, USA.10.1145/3126686.3126693 ↗
17. Yin, X., Yu, X., Sohn, K., Liu, X., and Chandraker, M. (2019, January 15–20). Feature Transfer Learning for Face Recognition with Under-Represented Data. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00585 ↗
18. Philippe, V., and Bourlai, T. (2024, January 15–24). Exploring Image Augmentation Methods for Long-Distance Face Recognition Using Deep Learning. Proceedings of the SoutheastCon 2024, Atlanta, GA, USA.10.1109/SoutheastCon52093.2024.10500032 ↗
19. Low-Resolution Face Recognition in the Wild via Selective Knowledge Distillation10.1109/TIP.2018.2883743 ↗
20. Kortli, Y., Jridi, M., Al Falou, A., and Atri, M. (2020). Face Recognition Systems: A Survey. Sensors, 20.10.3390/s20020342 ↗
21. Andreev, P., Aprahamian, B., and Marinov, M. (2019, January 6–8). QR Code’s Maximum Scanning Distance Investigation. Proceedings of the 2019 16th Conference on Electrical Machines, Drives and Power Systems (ELMA), Varna, Bulgaria.10.1109/ELMA.2019.8771488 ↗
22. Jose, A., Thodupunoori, H., and Nair, B.B. (2018, January 3–5). A Novel Traffic Sign Recognition System Combining Viola–Jones Framework and Deep Learning. Proceedings of the Soft Computing and Signal Processing: Proceedings of ICSCSP 2018, Chennai, India.10.1007/978-981-13-3600-3_48 ↗
23. Neural-Network-Based Traffic Sign Detection and Recognition in High-Definition Images Using Region Focusing and Parallelization10.1109/ACCESS.2020.3031191 ↗
24. Dharnesh, K., Prramoth, M.M., Saravanan, A.S., Sivabalan, M.A., and Sivraj, P. (2023, January 8–10). Performance Comparison of Road Traffic Sign Recognition System Based on CNN and YOLO v5. Proceedings of the 2023 Innovations in Power and Advanced Computing Technologies (i-PACT), Kuala Lumpur, Malaysia.
25. Indian Traffic Sign Detection and Recognition Using Deep Learning10.1016/j.ijtst.2022.06.002 ↗
26. Traffic Sign Detection under Challenging Conditions: A Deeper Look into Performance Variations and Spectral Characteristics10.1109/TITS.2019.2931429 ↗
27. Cao, N. (2020, January 25–27). Research and Development of Icon Recognition System Based on Machine Vision. Proceedings of the IOP Conference Series: Materials Science and Engineering, Xi’an, China.10.1088/1757-899X/740/1/012183 ↗
28. Symbol Detection with Deep Learning
29. Dalal, N., and Triggs, B. (2005, January 20–26). Histograms of Oriented Gradients for Human Detection. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05), San Diego, CA, USA.
30. Martinson, E., and Yalla, V. (2016, January 26–31). Real-Time Human Detection for Robots Using CNN with a Feature-Based Layered Pre-Filter. Proceedings of the 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), New York, NY, USA.10.1109/ROMAN.2016.7745248 ↗
31. Improvement of Deep Learning-Based Human Detection Using Dynamic Thresholding for Intelligent Surveillance System
32. Li, F., Chen, Y., Hu, M., Luo, M., and Wang, G. (2023). Helmet-Wearing Tracking Detection Based on StrongSORT. Sensors, 23.10.3390/s23031682 ↗
33. Li, J., Zhao, X., Kong, L., Zhang, L., and Zou, Z. (2024). Construction Activity Recognition Method Based on Object Detection, Attention Orientation Estimation, and Person Re-Identification. Buildings, 14.10.3390/buildings14061644 ↗
34. Titulacin (2023, May 01). Person Detection Computer Vision Project. Available online: https://universe.roboflow.com/titulacin/person-detection-9a6mk/dataset/16.
35. Northeastern University, China (2022, September 01). Hard Hat Workers Dataset. Available online: https://universe.roboflow.com/joseph-nelson/hard-hat-workers/dataset/14.
36. A Survey on Deep Learning and Its Applications10.1016/j.cosrev.2021.100379 ↗
37. Taye, M.M. (2023). Theoretical Understanding of Convolutional Neural Network: Concepts, Architectures, Applications, Future Directions. Computation, 11.10.3390/computation11030052 ↗
38. A Deep Learning Approach for Classification of Cloud Image Patches on Small Datasets
39. Zeiler, M.D., and Fergus, R. (2014, January 6–12). Visualizing and Understanding Convolutional Networks. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland.10.1007/978-3-319-10590-1_53 ↗
40. A Review of Object Detection Based on Deep Learning10.1007/s11042-020-08976-6 ↗
41. Shen, J., and Shafiq, M.O. (2018, January 17–20). Deep Learning Convolutional Neural Networks with Dropout—A Parallel Approach. Proceedings of the 2018 17th IEEE International Conference on Machine Learning and Applications (ICMLA), Orlando, FL, USA.10.1109/ICMLA.2018.00092 ↗
42. SDMSEAF-YOLOv8: A Framework to Significantly Improve the Detection Performance of Unmanned Aerial Vehicle Images10.1080/10106049.2024.2339294 ↗
43. Ali, M.L., and Zhang, Z. (2024). The YOLO Framework: A Comprehensive Review of Evolution, Applications, and Benchmarks in Object Detection. Computers, 13.10.20944/preprints202410.1785.v1 ↗
44. A Comprehensive Review of YOLO Architectures in Computer Vision: From YOLOv1 to YOLOv8 and YOLO-NAS10.3390/make5040083 ↗
45. An Improved Fire Detection Approach Based on YOLO-v8 for Smart Cities10.1007/s00521-023-08809-1 ↗
46. YOLOv8-QSD: An Improved Small Object Detection Algorithm for Autonomous Vehicles Based on YOLOv8
47. Lou, H., Duan, X., Guo, J., Liu, H., Gu, J., Bi, L., and Chen, H. (2023). DC-YOLOv8: Small-Size Object Detection Algorithm Based on Camera Sensor. Electronics, 12.10.20944/preprints202304.0124.v1 ↗
48. Terzi, D.S., and Azginoglu, N. (2023). In-Domain Transfer Learning Strategy for Tumor Detection on Brain MRI. Diagnostics, 13.10.3390/diagnostics13122110 ↗