Heavy Equipment Detection on Construction Sites Using You Only Look Once (YOLO-Version 10) with Transformer Architectures
Source abstract
Abstract
Monitoring heavy equipment in real time is crucial for ensuring safety and operational efficiency at construction sites, yet achieving both high detection accuracy and fast inference remains challenging under diverse environmental conditions. Although previous studies have attempted to improve accuracy and speed, their findings often lack generalizability, partly due to inconsistent datasets and the need for more advanced techniques. In response, this study proposes an enhanced object detection method that integrates transformer-based backbone networks into the You Only Look Once (YOLO-version 10) framework. Evaluations conducted on a large-scale dataset of construction-site images demonstrate notable improvements in detecting the heavy equipment of varying sizes. Comparisons with other detectors confirm that the proposed model not only achieves higher accuracy but also maintains competitive processing speed, making it suitable for real-time deployment. Additionally, the dataset is made available for broader experimentation and development. These findings underscore the method’s potential to strengthen on-site safety by providing more reliable and efficient heavy equipment detection in complex work environments, while also acknowledging areas for further refinement.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Infrastructure Maintenance and Monitoring · Occupational Health and Safety Research · Advanced Neural Network Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Architectural Engineering, Hanyang University, Seoul 133791, Republic of Korea
Funding
National Research Foundation of Korea (NRF)
References (39)
Show source-provided references
1. Shin, Y., Choi, Y., Won, J., Hong, T., and Koo, C. (2024). A New Benchmark Model for the Automated Detection and Classification of a Wide Range of Heavy Construction Equipment. J. Manag. Eng., 40.10.1061/JMENEA.MEENG-5630 ↗
2. Evaluation of Impact of Image Augmentation Techniques on Two Tasks: Window Detection and Window States Detection10.1016/j.rineng.2024.103571 ↗
3. Hu, H., Wang, L., Zhang, M., Ding, Y., and Zhu, Q. (2020). Fast and Regularized Reconstruction of Building Facades from Street-View Images Using Binary Integer Programming. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, IEEE.10.5194/isprs-annals-V-2-2020-365-2020 ↗
4. Deep Learning for Site Safety: Real-Time Detection of Personal Protective Equipment10.1016/j.autcon.2020.103085 ↗
5. Mokayed, H., Alsayed, G., Lodin, F., Hagner, O., and Backe, B. (2024, January 2–5). Enhancing Object Detection in Snowy Conditions: Evaluating YOLO v9 Models with Augmentation Techniques. Proceedings of the 2024 11th International Conference on Internet of Things: Systems, Management and Security (IOTSMS), Malmö, Sweden.10.1109/IOTSMS62296.2024.10710270 ↗
6. The Development of a Rebar-Counting Model for Reinforced Concrete Columns: Using an Unmanned Aerial Vehicle and Deep-Learning Approach10.1061/JCEMD4.COENG-13686 ↗
7. Yolo-Former: Marrying Yolo and Transformer for Foreign Object Detection
8. Rajput, L., Tyagi, N., Tyagi, S., and Tyagi, D.K. (2024, January 3–4). State of the Art Object Detection: A Comparative Study of YOLO and ViT. Proceedings of the 2024 International Conference on Intelligent Systems for Cybersecurity (ISCS), Gurugram, India.10.1109/ISCS61804.2024.10581202 ↗
9. Automated Detection of Workers and Heavy Equipment on Construction Sites: A Convolutional Neural Network Approach10.1016/j.aei.2018.05.003 ↗
10. Wang, M., Wong, P., Luo, H., Kumar, S., Delhi, V., and Cheng, J. (2019, January 21–24). Predicting Safety Hazards among Construction Workers and Equipment Using Computer Vision and Deep Learning Techniques. Proceedings of the 36th International Symposium on Automation and Robotics in Construction, ISARC 2019, Banff, AB, Canada.10.22260/ISARC2019/0054 ↗
11. Interaction Analysis for Vision-Based Activity Identification of Earthmoving Excavators and Dump Trucks10.1016/j.autcon.2017.12.016 ↗
12. Blue, S.T., and Brindha, M. (2019, January 6–8). Edge Detection Based Boundary Box Construction Algorithm for Improving the Precision of Object Detection in YOLOv3. Proceedings of the 2019 10th International Conference on Computing, Communication and Networking Technologies, ICCCNT 2019, Kanpur, India.10.1109/ICCCNT45670.2019.8944852 ↗
13. Nath, N.D., and Behzadan, A.H. (2020). Deep Convolutional Networks for Construction Object Detection Under Different Visual Conditions. Front. Built Environ., 6.10.3389/fbuil.2020.00097 ↗
14. Critical Review and Road Map of Automated Methods for Earthmoving Equipment Productivity Monitoring10.1061/(ASCE)CP.1943-5487.0001017 ↗
15. End-to-End Vision-Based Detection, Tracking and Activity Analysis of Earthmoving Equipment Filmed at Ground Level10.1016/j.autcon.2019.04.006 ↗
16. Automated Detection of Exterior Cladding Material in Urban Area from Street View Images Using Deep Learning10.1016/j.jobe.2024.110466 ↗
17. Imran, A., Hulikal, M.S., and Gardi, H.A.A. (2024). Real Time American Sign Language Detection Using Yolo-V9. arXiv.
18. Chen, W., Huang, Z., Mu, Q., and Sun, Y. (2022). PCB Defect Detection Method Based on Transformer-YOLO. IEEE Access.10.1109/ACCESS.2022.3228206 ↗
19. Wang, C.-Y., Yeh, I.-H., and Mark Liao, H.-Y. (October, January 29). Yolov9: Learning What You Want to Learn Using Programmable Gradient Information. Proceedings of the European Conference on Computer Vision, Milan, Italy.
20. Mei, J., and Zhu, W. (2024). BGF-YOLOv10: Small Object Detection Algorithm from Unmanned Aerial Vehicle Perspective Based on Improved YOLOv10. Sensors, 24.10.3390/s24216911 ↗
21. Comparative Performance of YOLOv8, YOLOv9, YOLOv10, YOLOv11 and Faster R-CNN Models for Detection of Multiple Weed Species10.1016/j.atech.2024.100648 ↗
22. A Survey of the Vision Transformers and Their CNN-Transformer Based Variants10.1007/s10462-023-10595-0 ↗
23. Bazi, Y., Bashmal, L., Rahhal, M.M.A., Dayil, R.A., and Ajlan, N.A. (2021). Vision Transformers for Remote Sensing Image Classification. Remote Sens., 13.10.3390/rs13030516 ↗
24. Ali, A.M., Benjdira, B., Koubaa, A., El-Shafai, W., Khan, Z., and Boulila, W. (2023). Vision Transformers in Image Restoration: A Survey. Sensors, 23.10.3390/s23052385 ↗
25. Baek, J.W., and Chung, K. (2023). Swin Transformer-Based Object Detection Model Using Explainable Meta-Learning Mining. Appl. Sci., 13.10.3390/app13053213 ↗
26. Conv-PVT: A Fusion Architecture of Convolution and Pyramid Vision Transformer10.1007/s13042-022-01750-0 ↗
27. Automatic Classification of Rural Building Characteristics Using Deep Learning Methods on Oblique Photography10.1007/s12273-021-0872-x ↗
28. ImageNet Classification with Deep Convolutional Neural Networks
29. Automatic Damage Detection of Historic Masonry Buildings Based on Mobile Deep Learning10.1016/j.autcon.2019.03.003 ↗
30. Van Rijn, J.N., and Hutter, F. (2017, January 8–10). An Empirical Study of Hyperparameter Importance across Datasets. Proceedings of the CEUR Workshop Proceedings, Bangalore, India.
31. Dropout vs. Batch Normalization: An Empirical Study of Their Impact to Deep Learning10.1007/s11042-019-08453-9 ↗
32. An Empirical Study of the Impact of Hyperparameter Tuning and Model Optimization on the Performance Properties of Deep Neural Networks10.1145/3506695 ↗
33. Effectiveness of Image Augmentation Techniques on Detection of Building Characteristics from Street View Images Using Deep Learning10.1061/JCEMD4.COENG-15075 ↗
34. A Survey on Image Data Augmentation for Deep Learning10.1186/s40537-019-0197-0 ↗
35. Brightness as an Augmentation Technique for Image Classification10.28991/ESJ-2022-06-04-015 ↗
36. Tuning of Data Augmentation Hyperparameters in Deep Learning to Building Construction Image Classification with Small Datasets10.1007/s13042-022-01555-1 ↗
37. A Semi-Labelled Dataset for Fault Detection in Air Handling Units from a Large-Scale Office10.1016/j.dib.2024.110956 ↗
38. Wang, S., Hae, H., and Kim, J. (2018). Development of Easily Accessible Electricity Consumption Model Using Open Data and GA-SVR. Energies, 11.10.3390/en11020373 ↗
39. Chen, K., Wang, J., Pang, J., Cao, Y., Xiong, Y., Li, X., Sun, S., Feng, W., Liu, Z., and Xu, J. (2019). MMDetection: Open MMLab Detection Toolbox and Benchmark. arXiv.