Rotating Target Detection Method of Concrete Bridge Crack Based on YOLO v5
Source abstract
Abstract
Crack detection is a critical and essential aspect of concrete bridge maintenance and management. Manual inspection often falls short in meeting the demands of large-scale crack detection in terms of cost, efficiency, accuracy, and data management. To address the challenges faced by existing generic object detection algorithms in achieving high accuracy or efficiency when detecting cracks with large aspect ratios, overlapping structures, and clear directional characteristics, this paper presents improvements to the YOLO v5 model. These enhancements include the introduction of angle regression variables, the definition of a new loss function, the integration of PSA-Neck and ECA-Layer attention mechanism modules into the network architecture, consideration of the contribution of each node’s features to the network, and the addition of skip connections within the same feature scale. This results in a novel crack image rotation object detection algorithm named “R-YOLO v5”. After training the R-YOLO v5 model for 300 iterations on a dataset comprising 1628 crack images, the model achieved an mAP@0.5 of 94.03% on the test set, which is significantly higher than other rotation object detection algorithms such as SASM, S2A Net, Re Det, as well as the horizontal-box YOLO v5 model. Furthermore, R-YOLO v5 demonstrates clear advantages in terms of model size (4.17 MB) and detection speed (0.01 s per image). These results demonstrate that the designed model effectively detects cracks in concrete bridges and exhibits robustness, minimal memory usage, making it suitable for real-time crack detection on small devices like smartphones or drones. Additionally, the rotation object detection improvement strategy discussed in this study holds potential applicability for enhancing other object detection algorithms.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Infrastructure Maintenance and Monitoring · Concrete Corrosion and Durability · Geophysical Methods and Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Civil Engineering, Southwest Jiaotong University, Chengdu 610031, China
Guangxi Key Laboratory of International Join for China-ASEAN Comprehensive Transportation, Nanning University, Nanning 530000, China
Funding
Cultivation Program for the Guangxi Science and Technology Plan Project of China
References (45)
Show source-provided references
1. Review on the mechanism and mitigation of cracks in concrete
2. Convolutional networks and transformers for intelligent road tunnel investigations10.1016/j.compstruc.2022.106918 ↗
3. Thoughts on the Development of Bridge Technology in China10.1016/j.eng.2019.10.001 ↗
4. Advances in Computer Vision-Based Civil Infrastructure Inspection and Monitoring10.1016/j.eng.2018.11.030 ↗
5. Arc Length method for extracting crack pattern characteristics
6. A self-adaptive exhaustive search optimization-based method for restoration of bridge defects images10.1007/s13042-020-01066-x ↗
7. Multi-View Geometric 3D Reconstruction Method for Identifying Structural Defects and Deformations
8. Robotic System for Inspection by Contact of Bridge Beams Using UAVs10.3390/s19020305 ↗
9. Automated crack evaluation of a high-rise bridge pier using a ring-type climbing robot
10. Deep Learning-Based Crack Damage Detection Using Convolutional Neural Networks10.1111/mice.12263 ↗
11. Crack Detection and Segmentation Using Deep Learning with 3D Reality Mesh Model for Quantitative Assessment and Integrated Visualization10.1061/(ASCE)CP.1943-5487.0000890 ↗
12. Autonomous Structural Visual Inspection Using Region-Based Deep Learning for Detecting Multiple Damage Types10.1111/mice.12334 ↗
13. Automated crack detection and crack depth prediction for reinforced concrete structures using deep learning10.1016/j.conbuildmat.2023.130709 ↗
14. Redmon, J., and Farhadi, A. (2018). YOLOv3: An Incremental Improvement. Computer Vision and Pattern Recognition. arXiv.
15. Ge, Z., Liu, S., Wang, F., Li, Z., and Sun, J. (2021). YOLOx: Exceeding YOLO Series in 2021. Computer Vision and Pattern Recognition. arXiv.
16. Zhou, T., Liu, F., Ye, X., Wang, H., and Lu, H. (2023). CCGL-YOLOV5: A cross-modal cross-scale global-local attention YOLOV5 lung tumor detection model. Comput. Biol. Med., 165.10.1016/j.compbiomed.2023.107387 ↗
17. Klinwichit, P., Yookwan, W., Limchareon, S., Chinnasarn, K., Jang, J., and Onuean, A. (2023). BUU-LSPINE: A Thai Open Lumbar Spine Dataset for Spondylolisthesis Detection. Appl. Sci., 13.10.3390/app13158646 ↗
18. Small-object detection based on YOLOv5 in autonomous driving systems10.1016/j.patrec.2023.03.009 ↗
19. Cho, K., and Cho, D. (2022). Autonomous Driving Assistance with Dynamic Objects Using Traffic Surveillance Cameras. Appl. Sci., 12.10.3390/app12126247 ↗
20. Online visual monitoring method for liquid rocket engine nozzle welding based on a multi-task deep learning model10.1016/j.jmsy.2023.02.016 ↗
21. High Inclusiveness and Accuracy Motion Blur Real-Time Gesture Recognition Based on YOLOv4 Model Combined Attention Mechanism and DeblurGanv210.3390/app11219982 ↗
22. Bridged Crack Detection Method Based on Convolutional Neural Networks
23. Bridge Surface Crack Detection Algorithm Based on YOLOv3 and Attention Mechanism
24. Bridge Crack Intelligent Recognition and Measurement based on YOLOv5 and UNet3+
25. Tan, G., Ou, J., Ai, Y., and Yang, R. (2022). Bridge Crack Image Segmentation Method based on Improved DeepLabv3+ Mode. J. Jilin Univ., 1–7.
26. Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition10.1109/TPAMI.2015.2389824 ↗
27. Trinh, H., Le, D., and Kwon, Y. (2014). PANET: PANET: A GPU-based tool for fast parallel analysis of robustness dynamics and feed-forward/feedback loop structures in large-scale biological networks. PLoS ONE, 9.10.1371/journal.pone.0103010 ↗
28. Neubeck, A., and Gool, L. (2006, January 20–24). Efficient Non-Maximum Suppression. Proceedings of the 18th International Conference on Pattern Recognition (ICPR’06), Hong Kong, China.10.1109/ICPR.2006.479 ↗
29. Misra, D. (2019). Mish. A Self Regularized Non-Monotonic Neural Activation Function. Machine Learning. arXiv.
30. Distance-IoU Loss: Faster and Better Learning for Bounding Box Regression
31. Girshick, R. (2015, January 7–13). Fast R CNN. Proceedings of the 2015 IEEE International Conference on Computer Vision, Santiago, Chile.10.1109/ICCV.2015.169 ↗
32. Yang, X., Yan, J., Ming, Q., Wang, W., Zhang, X., and Tian, Q. (2021, January 18–24). Rethinking Rotated Object Detection with Gaussian Wasserstein Distance Loss. Proceedings of the Proceedings of the 38th International Conference on Machine Learning, Virtual Event.
33. Hu, J., Shen, L., and Sun, G. (2018, January 18–23). Squeeze-and-excitation networks. Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00745 ↗
34. The generative adversarial network improved by channel relationship learning mechanisms10.1016/j.neucom.2021.04.123 ↗
35. Li, X., Wang, C., Ju, H., and Li, Z. (2022). Surface Defect Detection Model for Aero-Engine Components Based on Improved YOLOv5. Appl. Sci., 12.10.3390/app12147235 ↗
36. A sheep dynamic counting scheme based on the fusion between an improved-sparrow-search YOLOv5x-ECA model and few-shot deepsort algorithm10.1016/j.compag.2023.107696 ↗
37. CBAM: Convolutional Block Attention Module
38. Guo, Z., Yang, J., and Liu, S. (2023). Research on Lightweight Model for Rapid Identification of Chunky Food Based on Machine Vision. Appl. Sci., 13.10.3390/app13158781 ↗
39. Dayan Ban, SCA-Net: Spatial and channel attention-based network for 3D point clouds10.1016/j.cviu.2023.103690 ↗
40. Xu, Y., Liu, J., Zhao, X., and Zhu, X. (2023). AMS-PAN: Breast ultrasound image segmentation model combining attention mechanism and multi-scale features. Biomed. Signal Process. Control, 81.10.1016/j.bspc.2022.104425 ↗
41. Tan, M., Pang, R., and Le, Q. (2020, January 13–19). EfficientDet: Scalable and Efficient Object Detection. Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.01079 ↗
42. (2023, September 22). Concrete Road Surface, Bridge Construction, Tunnel Crack and Fracture Detection Dataset. Available online: https://blog.csdn.net/Together_CZ/article/details/128290225?utm_medium=distribute.pc_relevant.none-task-blog-2~default~baidujs_utm_term~default-2-128290225-blog-125138837.235^v38^pc_relevant_sort_base2&spm=1001.2101.3001.4242.2&utm_relevant_index=5.
43. Shape-Adaptive Selection and Measurement for Oriented Object Detection
44. Align Deep Features for Oriented Object Detection
45. Han, J., Ding, J., Xue, N., and Xia, G. (2021, January 20–25). Redet: A Rotation-equivariant Detector for Aerial Object Detection. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.00281 ↗