Coarse–Fine Combined Bridge Crack Detection Based on Deep Learning
Source abstract
Abstract
The crack detection of concrete bridges is an important link in the safety evaluation of bridge structures, and the rapid and accurate identification and detection of bridge cracks is a prerequisite for ensuring the safety and long-term stable use of bridges. To solve the incomplete crack detection and segmentation caused by the complex background and small proportion in the actual bridge crack images, this paper proposes a coarse–fine combined bridge crack detection method of “double detection + single segmentation” based on deep learning. To validate the effect and practicality of fine crack detection, images of old civil bridges and viaduct bridges against a complex background and images of a bridge crack against a simple background are used as datasets. You Only Look Once V5(x) (YOLOV5(x)) was preferred as the object detection network model (ODNM) to perform initial and fine detection of bridge cracks, respectively. Using U-Net as the optimal semantic segmentation network model (SSNM), the crack detection results are accurately segmented for fine crack detection. The test results showed that the initial crack detection using YOLOV5(x) was more comprehensive and preserved the original shape of bridge cracks. Second, based on the initial detection, YOLOV5(x) was adopted for fine crack detection, which can determine the location and shape of cracks more carefully and accurately. Finally, the U-Net model was used to segment the accurately detected cracks and achieved a maximum accuracy (AC) value of 98.37%. The experiment verifies the effectiveness and accuracy of this method, which not only provides a faster and more accurate method for fine detection of bridge cracks but also provides technical support for future automated detection and preventive maintenance of bridge structures and has practical value for bridge crack detection engineering.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Infrastructure Maintenance and Monitoring · Concrete Corrosion and Durability · Asphalt Pavement Performance Evaluation
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
College of Surveying and Geo-Informatics, North China University of Water Resources and Electric Power, Zhengzhou 450046, China
Funding
Henan Provincial Science and Technology Research Project
References (57)
Show source-provided references
1. A concrete crack recognition method based on progressive cascade convolution neural network
2. Ren, J., Zhao, G., Ma, Y., Zhao, D., Liu, T., and Yan, J. (2022). Automatic pavement crack detection fusing attention mechanism. Electronics, 11.10.3390/electronics11213622 ↗
3. Zhou, S., Pan, Y., Huang, X., Yang, D., Ding, Y., and Duan, R. (2022). Crack texture feature identification of fiber reinforced concrete based on deep learning. Materials, 15.10.3390/ma15113940 ↗
4. Fatigue damage prognosis of steel bridges under traffic loading using a time-based crack growth method10.1016/j.engstruct.2021.112162 ↗
5. Bridge crack classification and measurement method based on deep convolution neural network
6. Tunnel crack identification based on deep learning
7. Detection of sealed and unsealed cracks with complex backgrounds using deep convolutional neural network10.1016/j.autcon.2019.102946 ↗
8. Acquirement and analysis of bridge crack images10.1080/10798587.2010.10643111 ↗
9. Automatic damage detection using anchor-free method and unmanned surface vessel10.1016/j.autcon.2021.104017 ↗
10. Concrete structural health monitoring using embedded piezoceramic transducers10.1088/0964-1726/16/4/003 ↗
11. Localization of acoustic emission sources in structural health monitoring of masonry bridge10.1002/stc.1675 ↗
12. Full scale strain monitoring of a suspension bridge using high performance distributed fiber optic sensors10.1088/0957-0233/27/12/124017 ↗
13. Automatic pavement distress detection system10.1016/S0020-0255(97)10062-7 ↗
14. Cai, Y., and Zhang, Y. (2011, January 15–17). Research on pavement crack recognition methods based on image processing. Proceedings of the Third International Conference on Digital Image Processing (ICDIP 2011), Chengdu, China.10.1117/12.896675 ↗
15. Analysis of edge-detection techniques for crack identification in bridges10.1061/(ASCE)0887-3801(2003)17:4(255) ↗
16. Cardellicchio, A., Ruggieri, S., Leggieri, V., and Uva, G. (2022). View VULMA: Data set for training a machine-learning tool for a fast vulnerability analysis of existing buildings. Data, 7.10.3390/data7010004 ↗
17. A deep learning approach for fast detection and classification of concrete damage10.1016/j.autcon.2021.103785 ↗
18. Ochoa-Ruiz, G., Angulo-Murillo, A.A., Ochoa-Zezzatti, A., Aguilar-Lobo, L.M., Vega-Fernández, J.A., and Natraj, S. (2020). An asphalt damage dataset and detection system based on retinanet for road conditions assessment. Appl. Sci., 10.10.3390/app10113974 ↗
19. Automated bridge surface crack detection and segmentation using computer vision-based deep learning model10.1016/j.engappai.2022.105225 ↗
20. Zhang, L., Zhang, Y., Zhang, Z., Shen, J., and Wang, H. (2019). Real-time water surface object detection based on improved Faster R-CNN. Sensors, 19.10.3390/s19163523 ↗
21. Jia, J., Fu, M., Liu, X., and Zheng, B. (2022). Underwater object detection based on improved EfficientNet. Remote Sens., 14.10.3390/rs14184487 ↗
22. YOLOv5-Tassel: Detecting tassels in RGB UAV imagery with improved YOLOv5 based on transfer learning10.1109/JSTARS.2022.3206399 ↗
23. An algorithm for target detection of engineering vehicles based on improved centernet
24. A research on an improved Unet-based concrete crack detection algorithm10.1177/1475921720940068 ↗
25. Fu, H., Meng, D., Li, W., and Wang, Y. (2021). Bridge Crack Semantic Segmentation Based on Improved Deeplabv3+. J. Mar. Sci. Eng., 9.10.3390/jmse9060671 ↗
26. Instance segmentation scheme for roofs in rural areas based on Mask R-CNN
27. Detection of the drivable area on high-speed road via YOLACT10.1007/s11760-021-02117-8 ↗
28. Physical interpretation of machine learning-based recognition of defects for the risk management of existing bridge heritage10.1016/j.engfailanal.2023.107237 ↗
29. Deep learning-based crack damage detection using convolutional neural networks10.1111/mice.12263 ↗
30. Structural damage detection with automatic feature-extraction through deep learning10.1111/mice.12313 ↗
31. Combining Faster R-CNN and Model-Driven Clustering for elongated object detection10.1109/TIP.2019.2947792 ↗
32. Improving Faster R-CNN framework for fast vehicle detection10.1155/2019/3808064 ↗
33. Bridge crack detection method based on convolution neural network
34. Shipwreck target recognition in side-scan sonar images by improved YOLOv3 model based on transfer learning10.1109/ACCESS.2020.3024813 ↗
35. Deep learning for assessing severity of cracks in concrete structures10.15837/ijccc.2023.1.4977 ↗
36. Yadav, D.P., Kishore, K., Gaur, A., Kumar, A., Singh, K.U., Singh, T., and Swarup, C. (2022). A novel multi-scale feature fusion-based 3SCNet for building crack detection. Sustainability, 14.10.3390/su142316179 ↗
37. Crack detection for concrete bridges with imaged based deep learning10.1177/00368504221128487 ↗
38. Convolutional neural networks (CNNs)-based multi-category damage detection and recognition of high-speed rail (HSR) reinforced concrete (RC) bridges using test images10.1016/j.engstruct.2022.115306 ↗
39. A deep learning-based method for pixel-level crack detection on concrete bridges10.1049/ipr2.12512 ↗
40. Faster R-CNN: Towards real-time object detection with region proposal networks10.1109/TPAMI.2016.2577031 ↗
41. Automatic bridge crack detection using unmanned aerial vehicle and Faster R-CNN10.1016/j.conbuildmat.2022.129659 ↗
42. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S.E., Fu, C., and Berg, A.C. (2016, January 11–14). SSD: Single shot multibox detector. Proceedings of the 14th European Conference, Computer Vision—ECCV 2016, Amsterdam, The Netherlands.10.1007/978-3-319-46448-0_2 ↗
43. Automated asphalt highway pavement crack detection based on deformable single shot multi-box detector under a complex environment10.1109/ACCESS.2021.3125703 ↗
44. Bochkovskiy, A., Wang, C., and Liao, H.M. (2020). YOLOv4: Optimal speed and accuracy of object detection. arXiv.
45. YOLO-v4 small object detection algorithm fused whith L-α
46. Jocher, G., Stoken, A., Chaurasia, A., Borovec, J., Xie, T., Kwon, Y., Michael, K., Changyu, L., Fang, J., and Abrahim, V. (2021). Ultralytics/yolov5: v6.0—YOLOv5n “Nano” Models, Roboflow Integration, Tensor, Flow Export, Open, CV DNN Support, Zenodo. Zenodo Technical Report.
47. Yu, G., and Zhou, X. (2023). An improved YOLOv5 crack detection method combined with a bottleneck transformer. Mathematics, 11.10.3390/math11102377 ↗
48. Ronneberger, O., Fischer, P., and Brox, T. U-Net: Convolutional networks for biomedical image segmentation. U-Net: Convolutional Networks for Biomedical Image Segmentation, Proceedings of the Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015, 18th International Conference, Munich, Germany, 5–9 October 2015, Springer.10.1007/978-3-319-24574-4_28 ↗
49. Su, H., Wang, X., Han, T., Wang, Z., Zhao, Z., and Zhang, P. (2022). Research on a U-Net bridge crack identification and feature-calculation methods based on a CBAM attention mechanism. Buildings, 12.10.3390/buildings12101561 ↗
50. Zhao, H., Shi, J., Qi, X., Wang, X., and Jia, J. (2017, January 21–26). Pyramid Scene Parsing Network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.660 ↗
51. Automated bridge crack detection based on improving encoder–decoder network and strip pooling10.1061/JITSE4.ISENG-2218 ↗
52. DeepLab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs10.1109/TPAMI.2017.2699184 ↗
53. Research on crack segmentation and feature quantification of concrete beams based on optimized DeepLabv3+
54. Research on detection algorithm for bridge cracks based on deep learning
55. Ma, K., Meng, X., Hao, M., Huang, G., Hu, Q., and He, P. (2023). Research on the efficiency of bridge crack detection by coupling deep learning frameworks with convolutional neural networks. Sensors, 23.10.3390/s23167272 ↗
56. He, K., Gkioxari, G., Dollár, P., and Girshick, R. (2017, January 22–29). Mask R-CNN. Proceedings of the IEEE International Conference on Computer Vision ICCV 2017, Venice, Italy.10.1109/ICCV.2017.322 ↗
57. Crack intelligent recognition and bridge monitoring methods