journal article·2024-09-03Open access

Efficient Detection of Apparent Defects in Subway Tunnel Linings Based on Deep Learning Methods

Ao Zheng, Shouming Qi, Yanquan Cheng, Di Wu, Jiasong Zhu

Applied Sciences· Volume 14· Issue 17

Abstract

High-precision and rapid detection of apparent defects in subway tunnel linings is crucial for ensuring the structural integrity of tunnels and the safety of train operations. However, current methods often do not adequately account for the spatial characteristics of these defects and perform poorly in detecting and extracting small-scale defects, which limits the accuracy of detection and geometric parameter extraction. To address these challenges, this paper proposes an efficient algorithm for detecting and extracting apparent defects in subway tunnels. Firstly, YOLOv8 was selected as the foundational architecture due to its comprehensive performance. The coordinate attention module and Bottleneck Transformer 3 were then integrated into the model’s backbone to enhance the focus on defect-prone areas and improve the learning of feature relationships between defects and other infrastructure. Subsequently, a high-resolution detection layer was added to the model’s head to further improve sensitivity to subtle defects. Additionally, a low-quality crack dataset was created using an open access dataset, and transfer learning combined with Real-ESRGAN was employed to enhance the detail and resolution of fine cracks. The results of the field experiments demonstrate that the proposed model significantly improves detection accuracy in high-incidence areas and for small-scale defects, achieving a mean average precision (mAP) of 87% in detecting cracks, leakage, exfoliation, and related infrastructure defects. Furthermore, the crack enhancement techniques substantially improve the representation of fine-crack details, increasing feature extraction accuracy by a factor of four. The findings of this paper could provide crucial technical support for the automated operation and maintenance of metro tunnels.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Infrastructure Maintenance and Monitoring · Advanced Measurement and Detection Methods · Geophysical Methods and Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

National Key Laboratory of Green and Long-Life Road Engineering in Extreme Environment, Shenzhen 518060, China

School of Civil and Transportation Engineering, Shenzhen University, Shenzhen 518060, China

School of Transportation and Civil Engineering, Fujian Agriculture and Forestry University, Fuzhou 350108, China

Shenzhen Technology Institute of Urban Public Safety, Shenzhen 518000, China

Funding

Shenzhen Science and Technology Innovation Commission

References (54)

Show source-provided references
1. Deep learning with visual explanations for leakage defect segmentation of metro shield tunnel10.1016/j.tust.2023.105107 ↗
2. Correction of Mobile TLS Intensity Data for Water Leakage Spots Detection in Metro Tunnels10.1109/LGRS.2016.2605158 ↗
3. Concrete Spalling Detection for Metro Tunnel from Point Cloud Based on Roughness Descriptor
4. Deep learning based method of longitudinal dislocation detection for metro shield tunnel segment10.1016/j.tust.2021.103949 ↗
5. Rapid Surface Damage Detection Equipment for Subway Tunnels Based on Machine Vision System10.1061/(ASCE)IS.1943-555X.0000591 ↗
6. Liu, X.F., Hong, Z.L., Shi, W., and Guo, X.D. (2023). Image-Processing-Based Subway Tunnel Crack Detection System. Sensors, 23.10.3390/s23136070 ↗
7. A crack detection system of subway tunnel based on image processing10.1177/00202940211062015 ↗
8. Wang, A., Togo, R., Ogawa, T., and Haseyama, M. (2022). Defect Detection of Subway Tunnels Using Advanced U-Net Network. Sensors, 22.10.3390/s22062330 ↗
9. Tunnel inspection using photogrammetric techniques and image processing: A review10.1016/j.isprsjprs.2018.07.010 ↗
10. High Spatial Resolution Survey Using Frequency-Shifted Feedback Laser for Transport Infrastructure Maintenance10.20965/jdr.2017.p0546 ↗
11. Ai, Q., and Yuan, Y. (2019). Rapid Acquisition and Identification of Structural Defects of Metro Tunnel. Sensors, 19.10.3390/s19194278 ↗
12. Ba, Y.L., Zuo, J., and Jia, Z.M. (2019, January 20–22). Image Filtering Algorithms for Tunnel Lining Surface Cracks Based on Adaptive Median-Gaussian. Proceedings of the 6th International Conference on Transportation Engineering (ICTE), Chengdu, China.
13. Automatic subway tunnel crack detection system based on line scan camera10.1002/stc.2776 ↗
14. A novel tunnel-lining crack recognition system based on digital image technology10.1016/j.tust.2020.103724 ↗
15. Recent advances in convolutional neural networks10.1016/j.patcog.2017.10.013 ↗
16. Deep Learning for Generic Object Detection: A Survey10.1007/s11263-019-01247-4 ↗
17. A Fast Detection Method via Region-Based Fully Convolutional Neural Networks for Shield Tunnel Lining Defects10.1111/mice.12367 ↗
18. Faster multi-defect detection system in shield tunnel using combination of FCN and faster RCNN10.1177/1369433219849829 ↗
19. Zhou, M., Cheng, W., Huang, H., and Chen, J. (2021). A Novel Approach to Automated 3D Spalling Defects Inspection in Railway Tunnel Linings Using Laser Intensity and Depth Information. Sensors, 21.10.3390/s21175725 ↗
20. Automatic defect detection of metro tunnel surfaces using a vision-based inspection system10.1016/j.aei.2020.101206 ↗
21. Chen, Q., Kang, Z.Z., Cao, Z., Xie, X.W., Guan, B.W., Pan, Y.X., and Chang, J. (2024). Combining Cylindrical Voxel and Mask R-CNN for Automatic Detection of Water Leakages in Shield Tunnel Point Clouds. Remote Sens., 16.10.3390/rs16050896 ↗
22. Man, K., Liu, R.L., Liu, X.L., Song, Z.F., Liu, Z.X., Cao, Z.X., and Wu, L.W. (2022). Water Leakage and Crack Identification in Tunnels Based on Transfer-Learning and Convolutional Neural Networks. Water, 14.10.3390/w14091462 ↗
23. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks10.1109/TPAMI.2016.2577031 ↗
24. Cai, Z., and Vasconcelos, N. (2018, January 17–21). Cascade R-CNN: Delving into High Quality Object Detection. Proceedings of the 31st IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.10.1109/CVPR.2018.00644 ↗
25. Object Detection in 20 Years: A Survey10.1109/JPROC.2023.3238524 ↗
26. A Survey of Deep Learning-Based Object Detection10.1109/ACCESS.2019.2939201 ↗
27. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., and Berg, A.C. (2016, January 11–14). SSD: Single Shot MultiBox Detector. Proceedings of the 14th European Conference on Computer Vision (ECCV), Amsterdam, The Netherlands.10.1007/978-3-319-46448-0_2 ↗
28. Ge, Z., Liu, S.T., Wang, F., Li, Z.M., and Sun, J. (2021). YOLOX: Exceeding YOLO Series in 2021. arXiv.
29. Li, C.Y., Li, L.L., Jiang, H.L., Weng, K.H., Geng, Y.F., Li, L., Ke, Z.D., Li, Q.Y., Cheng, M., and Nie, W.Q. (2022). YOLOv6: A Single-Stage Object Detection Framework for Industrial Applications. arXiv.
30. Wang, C.Y., Bochkovskiy, A., and Liao, H.Y.M. (2022). YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. arXiv.10.1109/CVPR52729.2023.00721 ↗
31. An improved fire detection approach based on YOLO-v8 for smart cities10.1007/s00521-023-08809-1 ↗
32. Li, Y.T., Fan, Q.S., Huang, H.S., Han, Z.G., and Gu, Q. (2023). A Modified YOLOv8 Detection Network for UAV Aerial Image Recognition. Drones, 7.10.3390/drones7050304 ↗
33. Hou, Q.B., Zhou, D.Q., and Feng, J.S. (2021, January 19–25). Coordinate Attention for Efficient Mobile Network Design. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.10.1109/CVPR46437.2021.01350 ↗
34. A Survey of Visual Transformers10.1109/TNNLS.2022.3227717 ↗
35. Srinivas, A., Lin, T.Y., Parmar, N., Shlens, J., Abbeel, P., and Vaswani, A. (2021, January 19–25). Bottleneck Transformers for Visual Recognition. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.10.1109/CVPR46437.2021.01625 ↗
36. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2017, January 4–9). Attention Is All You Need. Proceedings of the 31st Annual Conference on Neural Information Processing Systems (NIPS), Long Beach, CA, USA.
37. Real-world single image super-resolution: A brief review10.1016/j.inffus.2021.09.005 ↗
38. Fluorescent Nanoparticles for Super-Resolution Imaging10.1021/acs.chemrev.2c00050 ↗
39. The design and use of steerable filters10.1109/34.93808 ↗
40. Research on the single image super-resolution method based on sparse Bayesian estimation
41. MFFN: Image super-resolution via multi-level features fusion network10.1007/s00371-023-02795-0 ↗
42. CTCNet: A CNN-Transformer Cooperation Network for Face Image Super-Resolution10.1109/TIP.2023.3261747 ↗
43. A Review of the Deep Learning Methods for Medical Images Super Resolution Problems10.1016/j.irbm.2020.08.004 ↗
44. Wang, X.T., Xie, L.B., Dong, C., Shan, Y., and Soc, I.C. (2021, January 11–17). Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Data. Proceedings of the 18th IEEE/CVF International Conference on Computer Vision (ICCV), Montreal, BC, Canada.10.1109/ICCVW54120.2021.00217 ↗
45. Residual Dense Network for Image Restoration10.1109/TPAMI.2020.2968521 ↗
46. Wang, X.T., Yu, K., Wu, S.X., Gu, J.J., Liu, Y.H., Dong, C., Qiao, Y., and Loy, C.C. (2018, January 8–14). ESRGAN: Enhanced Super-Resolution Generative Adversarial Networks. Proceedings of the 15th European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-11021-5_5 ↗
47. U-Net: Deep learning for cell counting, detection, and morphometry10.1038/s41592-018-0261-2 ↗
48. Simonyan, K., and Zisserman, A. (2015). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv.
49. Timofte, R., Agustsson, E., Van Gool, L., Yang, M.-H., Zhang, L., Lim, B., Son, S., Kim, H., Nah, S., and Lee, K.M. (2017, January 22–25). NTIRE 2017 Challenge on Single Image Super-Resolution: Methods and Results. Proceedings of the 30th IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Honolulu, HI, USA.10.1109/CVPRW.2017.150 ↗
50. The role of public-private partnership in constructing the smart transportation city: A case of the bike sharing platform10.1080/10941665.2018.1544913 ↗
51. Yin, Z.-R., Lei, Z., Zheng, A., Zhu, J., and Liu, X.-Z. (2023). Automatic Detection and Association Analysis of Multiple Surface Defects for Shield Subway Tunnel. Sensors, 23.10.20944/preprints202304.0813.v1 ↗
52. Venkatanath, N., Praneeth, D., Chandrasekhar, B.H.M., Channappayya, S.S., and Medasani, S.S. (March, January 27). Blind image quality evaluation using perception based features. Proceedings of the 2015 Twenty First National Conference on Communications (NCC), Mumbai, India.10.1109/NCC.2015.7084843 ↗
53. No-reference color image quality assessment: From entropy to perceptual quality10.1186/s13640-019-0479-7 ↗
54. (2020, March 19). Crack_Segmentation. Available online: https://github.com/khanhha/crack_segmentation.