journal article·2025-07Open access

Improvement of crack detectivity for concrete surface of subway tunnels with anti-corrosion coatings using deep learning and image processing

Qingyu Du, Qi Jiang

Abstract

The long-term survivability of subway tunnels heavily depends on the durability and stability of concrete structures. Cracks in concrete, caused by factors such as severe loading, environmental influences, and chemical effects etc., lead to a reduction in structural durability and may even result in a loss of stability. In this study, crack detection is achieved through deep learning and image processing . We design a novel crack locally ordered annotation method. Training the object detection model using the proposed annotation method can achieve more accurate crack localization. Subsequently, based on the proposed annotation method, we improve the You Only Look Once version 8 nano (YOLOv8n) model by incorporating Focal Efficient Intersection over Union (FEIoU) and a path aggregation feature pyramid network with dynamic snake convolution (PADFPN), resulting in a YOLOv8n model combined with FEIoU and PADFPN (YOLOv8n-FED). This model effectively integrates multi-scale information of cracks. Finally, we extract the detected crack regions and segment them using a region-growing algorithm. In terms of object detection, based on the proposed annotation method, YOLOv8n-FED, compared with the original model, achieves a detection precision of 95.0 %, an improvement of 3.7 %; and a mean Average Precision (mAP) 50–95 of 80.7 %, a gain of 6.2 %. For semantic segmentation, our method yielded satisfactory results without requiring laborious pixel-level annotations, achieving a precision and F1-score of 75.2 % and 80.9 %, respectively, both outperforming the comparison models. Moreover, it can capture finer crack edge features.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Infrastructure Maintenance and Monitoring · Concrete Corrosion and Durability · Asphalt Pavement Performance Evaluation

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (57)

Show source-provided references
1. High-speed acquisition and intelligent tunnel surface defects recognition10.1016/j.tust.2023.105572 ↗
2. Y. Zhang et al., The design of glass crack detection system based on image preprocessing technology, In: 2014 IEEE 7th Joint International Information Technology and Artificial Intelligence Conference, IEEE, 2014, 39-42.105572.〈https://ieeexplore.ieee.org/abstract/document/7065001〉.10.1109/ITAIC.2014.7065001 ↗
3. Image processing algorithm for realtime crack inspection in hole expansion test10.1007/s12541-019-00101-4 ↗
4. Pixel-level road crack detection in UAV remote sensing images based on ARD-Unet10.1016/j.measurement.2023.113252 ↗
5. Crack detection using image processing: a critical review and analysis10.1016/j.aej.2017.01.020 ↗
6. H. Oliveira, P.L. Correia, Automatic road crack segmentation using entropy and image dynamic thresholding, In: Proc. Eur. Signal Process. Conf., 2009, 622-626.〈https://ieeexplore.ieee.org/abstract/document/7077805〉.
7. Comparative analysis of image binarization methods for crack identification in concrete structures10.1016/j.cemconres.2017.04.018 ↗
8. Comparison analysis on present image based crack detection methods in concrete structures
9. Wavelet-morphology based detection of incipient linear cracks in asphalt pavements from RGB camera imagery and classification using circular Radon transform10.1016/j.aei.2016.06.003 ↗
10. Analysis of edge-detection techniques for crack identification in bridges10.1061/(ASCE)0887-3801(2003)17:4(255) ↗
11. Damage classification for masonry historic structures using convolutional neural networks based on still images10.1111/mice.12411 ↗
12. Road crack detection using deep convolutional neural network
13. Auto inspection system using a mobile robot for detecting concrete cracks in a tunnel10.1016/j.autcon.2006.05.003 ↗
14. Automated visual inspection of pavement crack detection and characterization
15. Sealed-crack detection algorithm using heuristic thresholding approach10.1061/(ASCE)CP.1943-5487.0000447 ↗
16. CrackTree: automatic crack detection from pavement images10.1016/j.patrec.2011.11.004 ↗
17. A novel method for asphalt pavement crack classification based on image processing and machine learning10.1007/s00366-018-0611-9 ↗
18. Analysis of Edge-detection techniques for crack identification in bridges10.1061/(ASCE)0887-3801(2003)17:4(255) ↗
19. Model-based quantitation of 3-D magnetic resonance angiographie images10.1109/42.811279 ↗
20. H.K. Ryu, J.K. Lee, E.T. Hwang, J. Liu, H.H. Lee, W.H. ChoiA new corner detection method of gray-level image using Hessian matrix, (2007)537-540.10.1109/IFOST.2007.4798654.10.1109/IFOST.2007.4798654 ↗
21. Deep learning-based crack damage detection using convolutional neural networks10.1111/mice.12263 ↗
22. Autonomous structural visual inspection using region-based deep learning for detecting multiple damage types10.1111/mice.12334 ↗
23. Real-time detection of cracks in tiled sidewalks using YOLO-based method applied to unmanned aerial vehicle (UAV) images10.1016/j.autcon.2023.104745 ↗
24. An improved YOLOv5 crack detection method combined with a bottleneck transformer10.3390/math11102377 ↗
25. A novel hybrid approach for crack detection10.1016/j.patcog.2020.107474 ↗
26. Fully convolutional networks for semantic segmentation
27. Hybrid pixel-level concrete crack segmentation and quantification across complex backgrounds using deep learning10.1016/j.autcon.2020.103291 ↗
28. A novel approach for industrial concrete defect identification based on image processing and deep convolutional neural networks
29. Deep learning for crack detection on masonry facades using limited data and transfer learning
30. Automated crack detection and crack depth prediction for reinforced concrete structures using deep learning10.1016/j.conbuildmat.2023.130709 ↗
31. Improvement of crack detectivity for noisy concrete surface by machine learning methods and infrared images
32. DMA-Net: DeepLab with multi-scale attention for pavement crack segmentation10.1109/TITS.2022.3158670 ↗
33. SDDNet: real-time crack segmentation10.1109/TIE.2019.2945265 ↗
34. Efficient attention-based deep encoder and decoder for automatic crack segmentation10.1177/14759217211053776 ↗
35. Advanced crack detection and segmentation on bridge decks using deep learning10.1016/j.conbuildmat.2023.132839 ↗
36. Small-sample data-driven lightweight convolutional neural network for asphalt pavement defect identification
37. Automatic pixel-level crack detection with multi-scale feature fusion for slab tracks10.1111/mice.12984 ↗
38. P. Dollár, C.L. Zitnick, Microsoft COCO: Common Objects in Context. BT -Computer Vision - ECCV 2014 - 13th European Conference, Zurich, Switzerland, September 6-12, 2014, Proceedings, Part V, (2014)740-755.10.1007/978-3-319-10602-1_48.10.1007/978-3-319-10602-1_48 ↗
39. Focal and efficient IOU loss for accurate bounding box regression10.1016/j.neucom.2022.07.042 ↗
40. S. Liu, L. Qi, H. Qin, et al., Path aggregation network for instance segmentation, In: Proceedings of the IEEE conference on computer vision and pattern recognition.2018, 8759-8768.10.1109/CVPR.2018.00913.10.1109/CVPR.2018.00913 ↗
41. Dynamic snake convolution based on topological geometric constraints for tubular structure segmentation
42. Patch-based weakly supervised semantic segmentation network for crack detection10.1016/j.conbuildmat.2020.120291 ↗
43. M. Islam, S. Jia, N. Bruce, How much position information do convolutional neural networks encode.arxiv preprint arxiv:2001.08248 (2020).
44. M. Islam, M. Kowal, S. Jia, Global pooling, more than meets the eye: Position information is encoded channel-wise in cnns.In: Proceedings of the IEEE/CVF International conference on computer vision, 2021, 793-801.10.1109/ICCV48922.2021.00083.
45. Z. Zheng, P. Wang, W. Liu, et al., Distance-IoU loss: Faster and better learning for bounding box regression, In: Proceedings of the AAAI conference on artificial intelligence.34 (2020)12993-13000.〈https://ojs.aaai.org/index.php/AAAI/article/view/6999〉.10.1609/aaai.v34i07.6999 ↗
46. Generalized focal loss: Learning qualified and distributed bounding boxes for dense object detection
47. T. Lin, P. Goyal, R. Girshick, K. He, and P. Dollár, Focal loss for dense object detection, In: Proc. IEEE Int. Conf. Comput. Vis. (ICCV), 2017, 2980-2988.10.1109/ICCV.2017.324.10.1109/ICCV.2017.324 ↗
48. Improved YOLOv7 target detection algorithm based on UAV aerial photography10.3390/drones8030104 ↗
49. A method for multi-target segmentation of bud-stage apple trees based on improved YOLOv810.1016/j.compag.2024.108876 ↗
50. Pixel-level detection and measurement of concrete crack using faster region-based convolutional neural network and morphological feature extraction
51. Deep learning-based structural health monitoring10.1016/j.autcon.2024.105328 ↗
52. Feature pyramid networks for object detection
53. Z. Tong, Y. Chen, Z. Xu, et al., Wise-IoU: Bounding Box Regression Loss with Dynamic Focusing Mechanism, 2023, arXiv:2301.10051.〈https://arxiv.org/abs/2301.10051〉.
54. U-net: convolutional networks for biomedical image segmentation
55. Encoder-decoder with atrous separable convolution for semantic image segmentation
56. R. Strudel, R. Garcia, I. Laptev, C. Schmid, Segmenter: Transformer for semantic segmentation, In: Proceedings of the IEEE/CVF international conference on computer vision.2021, 7242-7252.10.1109/ICCV48922.2021.00717.10.1109/ICCV48922.2021.00717 ↗
57. SegFormer:simple and efficient design for semantic segmentation with transformers