journal article·2025-07Open access

A novel MPDENet model and efficient combined loss function for real-time pixel-level segmentation detection of tunnel lining cracks

Ningyu Zhao, Yi Song, Hao Liu, Ailin Yang, Haifei Jiang, Haihong Tan

Abstract

Recent studies have demonstrated the potential of using convolutional neural networks (CNNs) for tunnel lining crack detection, offering a promising alternative to manual inspection methods. However, the performance of CNNs is often hindered by the sample imbalance in crack images, and the existing model architectures are often too computationally expensive, presenting challenges for real-time detection. In this study, an efficient combined loss function was proposed to address the sample imbalance issue, and a novel lightweight model, MPDENet, was introduced for real-time pixel-level segmentation detection of tunnel lining cracks of interference backgrounds. Specifically, the ResNet50 was replaced with improved MobileNetV2 as a backbone for the Pyramid Scene Parsing Network (PSPNet) to strike a desirable balance between detection accuracy and computational efficiency. Subsequently, the receptive field was expanded by including dilation convolution, facilitating the capture of more comprehensive crack contour information. Lastly, the ECA attention mechanism was introduced to enhance the model's capacity to distinguish cracks from interference backgrounds. Experimental results on a homemade dataset show that the combined loss function significantly improves the recall of crack detection and superior detection accuracy than other loss functions. MPDENet achieved an Intersection over Union (IoU) score of 75.26 % on the homemade dataset, which showcases a notable performance improvement of 2.64 % compared to PSPNet while significantly alleviating computational burden. Moreover, the robustness and scalability of the proposed method on two publicly available crack datasets are also verified. MPDENet can process 512 × 512 resolution crack images at a speed of 36 frames per second (FPS), making it well-suited for real-time detection in practical applications.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Infrastructure Maintenance and Monitoring · Non-Destructive Testing Techniques · Concrete Corrosion and Durability

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (76)

Show source-provided references
1. Deep learning-based image recognition for crack and leakage defects of metro shield tunnel10.1016/j.tust.2018.04.002 ↗
2. A fast detection method via region-based fully convolutional neural networks for shield tunnel lining defects10.1111/mice.12367 ↗
3. A review on computer vision based defect detection and condition assessment of concrete and asphalt civil infrastructure10.1016/j.aei.2015.01.008 ↗
4. Road crack detection using deep convolutional neural network10.1109/ICIP.2016.7533052 ↗
5. Image-based concrete crack detection in tunnels using deep fully convolutional networks10.1016/j.conbuildmat.2019.117367 ↗
6. Structural crack detection using deep convolutional neural networks10.1016/j.autcon.2021.103989 ↗
7. Pavement crack detection based on transformer network10.1016/j.autcon.2022.104646 ↗
8. Computer vision-based concrete crack detection using U-net fully convolutional networks10.1016/j.autcon.2019.04.005 ↗
9. Past, present and future of robotic tunnel inspection10.1016/j.autcon.2015.02.003 ↗
10. Automated assessment of cracks on concrete surfaces using adaptive digital image processing10.12989/sss.2014.14.4.719 ↗
11. A systematic review of convolutional neural network-based structural condition assessment techniques10.1016/j.engstruct.2020.111347 ↗
12. A novel technique for wall crack detection using image fusion
13. A threshold selection method from gray-level histograms10.1109/TSMC.1979.4310076 ↗
14. Pavement crack segmentation algorithm based on local optimal threshold of cracks density distribution
15. ImageNet classification with deep convolutional neural networks10.1145/3065386 ↗
16. Object detection with deep learning: a review10.1109/TNNLS.2018.2876865 ↗
17. Automatic crack classification and segmentation on masonry surfaces using convolutional neural networks and transfer learning
18. Going deeper with convolutions
19. Very deep convolutional networks for large-scale image recognition
20. Deep residual learning for image recognition
21. Automatic segmentation and quantification of global cracks in concrete structures based on deep learning10.1016/j.measurement.2022.111550 ↗
22. Fully convolutional networks for semantic segmentation
23. U-net: Convolutional networks for biomedical image segmentation
24. Automatic recognition of highway tunnel defects based on an improved U-Net model10.1109/JSEN.2019.2934897 ↗
25. CrackU-net: a novel deep convolutional neural network for pixelwise pavement crack detection10.1002/stc.2551 ↗
26. Encoder-decoder with atrous separable convolution for semantic image segmentation
27. DeepCrack: a deep hierarchical feature learning architecture for crack segmentation10.1016/j.neucom.2019.01.036 ↗
28. Pixel-level pavement crack segmentation with encoder-decoder network10.1016/j.measurement.2021.109914 ↗
29. Automatic tunnel lining crack detection via deep learning with generative adversarial network-based data augmentation10.1016/j.undsp.2022.07.003 ↗
30. Advanced industrial informatics towards smart, safe and sustainable roads: a state of the art
31. G. Andrew, Z.J.M. Menglong, Efficient convolutional neural networks for mobile vision applications[J]. arXiv preprint arXiv:1704.04861, 2017, 〈https://doi.org/10.48550/arXiv.1704.04861〉.
32. Mobilenetv2: inverted residuals and linear bottlenecks
33. Searching for Mobilenetv3
34. Shufflenet: An extremely efficient convolutional neural network for mobile devices
35. Shufflenet v2: practical guidelines for efficient CNN architecture design
36. Ghostnet: more features from cheap operations
37. An investigation into real-time surface crack classification and measurement for structural health monitoring using transfer learning convolutional neural networks and otsu method10.1016/j.aej.2024.02.052 ↗
38. Lightweight semantic segmentation of complex structural damage recognition for actual bridges10.1177/14759217221147015 ↗
39. Lightweight multi-scale encoder– decoder network with locally enhanced attention mechanism for concrete crack segmentation10.1088/1361-6501/ada786 ↗
40. A method for surveying road pavement distress based on front-view image data using a lightweight segmentation approach10.1061/JCCEE5.CPENG-5868 ↗
41. Enhanced precision in dam crack width measurement: leveraging advanced lightweight network identification for pixel-level accuracy10.1155/2023/9940881 ↗
42. Multimodal fusion network for crack segmentation with modified U-net and transfer learning–based MobileNetV210.1061/JITSE4.ISENG-2499 ↗
43. Fast detection algorithm for cracks on tunnel linings based on deep semantic segmentation10.1007/s11709-023-0965-y ↗
44. Deep convolutional neural networks for semantic segmentation of cracks10.1002/stc.2850 ↗
45. Pyramid scene parsing network
46. Unified perceptual parsing for scene understanding
47. Automatic bridge crack detection using boundary refinement based on real-time segmentation network
48. Encoder–decoder with pyramid region attention for pixel-level pavement crack recognition
49. F. Yu, V. Koltun Multi-scale context aggregation by dilated convolutions[J]. arXiv preprint arXiv:1511.07122, 2015. 〈https://doi.org/10.48550/arXiv.1511.07122〉.
50. CycleADC-Net: a crack segmentation method based on multi-scale feature fusion10.1016/j.measurement.2022.112107 ↗
51. A detection method for pavement cracks combining object detection and attention mechanism10.1109/TITS.2022.3177210 ↗
52. ECA-Net: efficient channel attention for deep convolutional neural networks
53. Squeeze-and-excitation networks
54. Focal loss for dense object detection
55. V-net: fully convolutional neural networks for volumetric medical image segmentation10.1109/3DV.2016.79 ↗
56. Structural crack detection from benchmark data sets using pruned fully convolutional networks10.1061/(ASCE)ST.1943-541X.0003140 ↗
57. CrackGAN: Pavement crack detection using partially accurate ground truths based on generative adversarial learning10.1109/TITS.2020.2990703 ↗
58. D.P. Kingma, J. Ba, Adam: A method for stochastic optimization, arXiv preprint arXiv:1412.6980, 2014, 〈https://doi.org/10.48550/arXiv.1412.6980〉.
59. Delving deep into rectifiers: surpassing human-level performance on imagenet classification
60. Efficientnet: rethinking model scaling for convolutional neural networks
61. K. Sun, Y. Zhao, B. Jiang, et al. High-resolution representations for labeling pixels and regions. arXiv preprint arXiv:1904.04514, 2019. 〈https://doi.org/10.48550/arXiv.1904.04514〉.
62. SegFormer: simple and efficient design for semantic segmentation with transformers
63. DcsNet: a real-time deep network for crack segmentation10.1007/s11760-021-02034-w ↗
64. Espnetv2: a light-weight, power efficient, and general purpose convolutional neural network
65. Cbam: convolutional block attention module
66. Coordinate attention for efficient mobile network design
67. Mixed spatial pyramid pooling for semantic segmentation10.1016/j.asoc.2020.106209 ↗
68. Optimized deep encoder-decoder methods for crack segmentation10.1016/j.dsp.2020.102907 ↗
69. Automatic pixel-level crack segmentation in images using fully convolutional neural network based on residual blocks and pixel local weights10.1016/j.engappai.2021.104391 ↗
70. A pavement crack synthesis method based on conditional generative adversarial networks10.3934/mbe.2024038 ↗
71. Swin transformer: hierarchical vision transformer using shifted windows
72. Bridging the gap between vision transformers and convolutional neural networks on small datasets10.52202/068431-1066 ↗
73. Tunnel structural inspection and assessment using an autonomous robotic system10.1016/j.autcon.2017.12.001 ↗
74. Automatic tunnel crack inspection using an efficient mobile imaging module and a lightweight CNN10.1109/TITS.2021.3138428 ↗
75. Automatic defect detection of metro tunnel surfaces using a vision-based inspection system10.1016/j.aei.2020.101206 ↗
76. Lightweight defect detection equipment for road tunnels