Effectiveness of Image Augmentation Techniques on Non-Protective Personal Equipment Detection Using YOLOv8
Source abstract
Abstract
Non-Protective Personal Equipment (PPE) detection is crucial on construction sites. Although deep learning models are adept at identifying such information from on-site cameras, their success relies on large, diverse, and high-quality datasets. Image augmentation offers an alternative for artificially broadening dataset diversity. However, its impact on non-PPE detection in construction environments has not been adequately examined. This study introduces a methodology applying eight distinct augmentation techniques—brightness, contrast, perspective, rotation, scale, shearing, translation, and a combined strategy incorporating all methods. Model performance was assessed by comparing accuracy across different classes and architectures, both with and without augmentation. While most of these augmentations improved accuracy, their effectiveness was found to be task-dependent. Moreover, the most beneficial augmentation varied by non-PPE class and architecture, suggesting that augmentation strategies should be tailored to the unique features of each class and model. Although the primary focus here is on non-PPE, the evaluated techniques could also extend to related tasks on construction sites, such as detecting heavy equipment or identifying hazardous worker behavior.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Industrial Vision Systems and Defect Detection
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Architectural Engineering, Hanyang University, Seoul 04763, Republic of Korea
Funding
Korean government (Ministry of Science and ICT)
References (39)
Show source-provided references
1. Towards On-Site Hazards Identification of Improper Use of Personal Protective Equipment Using Deep Learning-Based Geometric Relationships and Hierarchical Scene Graph10.1016/j.autcon.2021.103619 ↗
2. Falls from Heights: A Computer Vision-Based Approach for Safety Harness Detection10.1016/j.autcon.2018.02.018 ↗
3. A Labelled Dataset for Rebar Counting Inspection on Construction Sites Using Unmanned Aerial Vehicles10.1016/j.dib.2024.110720 ↗
4. Autonomous Structural Visual Inspection Using Region-Based Deep Learning for Detecting Multiple Damage Types10.1111/mice.12334 ↗
5. Frid-Adar, M., Klang, E., Amitai, M., Goldberger, J., and Greenspan, H. (2018, January 4–7). Synthetic Data Augmentation Using GAN for Improved Liver Lesion Classification. Proceedings of the International Symposium on Biomedical Imaging, Washington, DC, USA.10.1109/ISBI.2018.8363576 ↗
6. The Development of a Rebar-Counting Model for Reinforced Concrete Columns: Using an Unmanned Aerial Vehicle and Deep-Learning Approach10.1061/JCEMD4.COENG-13686 ↗
7. Detecting Non-Hardhat-Use by a Deep Learning Method from Far-Field Surveillance Videos10.1016/j.autcon.2017.09.018 ↗
8. Gu, Y., Xu, S., Wang, Y., and Shi, L. (2019, January 14–17). An Advanced Deep Learning Approach for Safety Helmet Wearing Detection. Proceedings of the 2019 International Conference on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData), Atlanta, GA, USA.10.1109/iThings/GreenCom/CPSCom/SmartData.2019.00128 ↗
9. Yan, D., and Wang, L. (2021, January 4–6). Improved YOLOv3 Helmet Detection Algorithm. Proceedings of the 2021 4th International Conference on Robotics, Control and Automation Engineering, RCAE 2021, Wuhan, China.10.1109/RCAE53607.2021.9638803 ↗
10. Detecting Safety Helmet Wearing on Construction Sites with Bounding-Box Regression and Deep Transfer Learning10.1111/mice.12579 ↗
11. Deep Learning for Site Safety: Real-Time Detection of Personal Protective Equipment10.1016/j.autcon.2020.103085 ↗
12. Wang, Z., Wu, Y., Yang, L., Thirunavukarasu, A., Evison, C., and Zhao, Y. (2021). Fast Personal Protective Equipment Detection for Real Construction Sites Using Deep Learning Approaches. Sensors, 21.10.3390/s21103478 ↗
13. Deep Learning-Based Framework for Monitoring Wearing Personal Protective Equipment on Construction Sites
14. Automatic Detection of Personal Protective Equipment in Construction Sites Using Metaheuristic Optimized YOLOv510.1007/s13369-023-08700-0 ↗
15. Image Augmentation to Improve Construction Resource Detection Using Generative Adversarial Networks, Cut-and-Paste, and Image Transformation Techniques10.1016/j.autcon.2020.103198 ↗
16. Asif, M., Liu, S., Ali, G.M., Bouferguene, A., and Al-Hussein, M. (2023). The Effectiveness of Data Augmentation in Construction Site-Related Image Classification. Lecture Notes in Civil Engineering, Springer.10.1007/978-3-031-34593-7_16 ↗
17. Evaluation of Impact of Image Augmentation Techniques on Two Tasks: Window Detection and Window States Detection10.1016/j.rineng.2024.103571 ↗
18. Detecting Building Entrances on Street View Images Using Deep Learning for Supporting Indoor-Outdoor Seamless Services10.7848/ksgpc.2023.41.5.351 ↗
19. A Survey on Image Data Augmentation for Deep Learning10.1186/s40537-019-0197-0 ↗
20. O’Gara, S., and McGuinness, K. Comparing Data Augmentation Strategies for Deep Image ClassificationIn Proceedings of the Irish Machine Vision and Image Processing Conference (IMVIP), Dublin, Ireland, 28–30 August 2019.
21. Brightness as an Augmentation Technique for Image Classification10.28991/ESJ-2022-06-04-015 ↗
22. Data Augmentation: A Comprehensive Survey of Modern Approaches10.1016/j.array.2022.100258 ↗
23. Perspective Transformation Data Augmentation for Object Detection10.1109/ACCESS.2019.2962572 ↗
24. Jung, A.B., Wada, K., Crall, J., Tanaka, S., Graving, J., Reinders, C., Yadav, S., Banerjee, J., Vecsei, G., and Kraft, A. (2020). Imgaug, GitHub.
25. Alomar, K., Aysel, H.I., and Cai, X. (2023). Data Augmentation in Classification and Segmentation: A Survey and New Strategies. J. Imaging, 9.10.3390/jimaging9020046 ↗
26. Comparative Effectiveness of Data Augmentation Using Traditional Approaches versus StyleGANs in Automated Sewer Defect Detection10.1061/JWRMD5.WRENG-5831 ↗
27. Tuning of Data Augmentation Hyperparameters in Deep Learning to Building Construction Image Classification with Small Datasets10.1007/s13042-022-01555-1 ↗
28. Ye, Y., Ma, X., Zhou, X., Bao, G., Wan, W., and Cai, S. (2023). Dynamic and Real-Time Object Detection Based on Deep Learning for Home Service Robots. Sensors, 23.10.3390/s23239482 ↗
29. (2024, December 04). SafetyHelmetWearing-Dataset. Available online: https://github.com/njvisionpower/Safety-Helmet-Wearing-Dataset?tab=readme-ov-file.
30. (2024, December 04). Safety Helmet Computer Vision Project. Available online: https://universe.roboflow.com/digitalimage-114q6/safety-helmet-q3b8o.
31. Automated Detection of Exterior Cladding Material in Urban Area from Street View Images Using Deep Learning10.1016/j.jobe.2024.110466 ↗
32. Automatic Damage Detection of Historic Masonry Buildings Based on Mobile Deep Learning10.1016/j.autcon.2019.03.003 ↗
33. Mokayed, H., Alsayed, G., Lodin, F., Hagner, O., and Backe, B. (2024, January 2–5). Enhancing Object Detection in Snowy Conditions: Evaluating YOLO v9 Models with Augmentation Techniques. Proceedings of the 2024 11th International Conference on Internet of Things: Systems, Management and Security (IOTSMS), Malmö, Sweden.10.1109/IOTSMS62296.2024.10710270 ↗
34. Eum, I., Kim, J., Wang, S., and Kim, J. (2025). Heavy Equipment Detection on Construction Sites Using You Only Look Once (YOLO-Version 10) with Transformer Architectures. Appl. Sci., 15.10.3390/app15052320 ↗
35. Hwang, D., Kim, J.-J., Moon, S., and Wang, S. (2025). Image Augmentation Approaches for Building Dimension Estimation in Street View Images Using Object Detection and Instance Segmentation Based on Deep Learning. Appl. Sci., 15.10.3390/app15052525 ↗
36. Wang, S., Hae, H., and Kim, J. (2018). Development of Easily Accessible Electricity Consumption Model Using Open Data and GA-SVR. Energies, 11.10.3390/en11020373 ↗
37. Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012). ImageNet Classification with Deep Convolutional Neural Networks. Advances in Neural Information Processing Systems, Proceedings of the 26th International Conference on Neural Information Processing Systems, Lake Tahoe, NV, USA, 3–6 December 2012, Curran Associates Inc.
38. Han, J., Kim, J., Kim, S., and Wang, S. (2024). Effectiveness of Image Augmentation Techniques on Detection of Building Characteristics from Street View Images Using Deep Learning. J. Constr. Eng. Manag., 150.10.1061/JCEMD4.COENG-15075 ↗
39. Automatic Classification of Rural Building Characteristics Using Deep Learning Methods on Oblique Photography10.1007/s12273-021-0872-x ↗