A Novel Technique for High-Efficiency Characterization of Complex Cracks with Visual Artifacts
Source abstract
Abstract
In this paper, we introduce SHSnet, an advanced deep learning model designed for the efficient end-to-end segmentation of complex cracks, including thin, tortuous, and densely distributed ones. SHSnet features a non-uniform attention mechanism, a large receptive field, and boundary refinement to enhance segmentation performance while maintaining computational efficiency. To further optimize the model’s learning capability with highly imbalanced datasets, we employ a loss function (LP) based on the focal Tversky function. SHSnet shows very high performance, with values of 0.85, 0.83, 0.81, and 0.84 for precision, recall, intersection over union (IOU), and F-score, respectively. It achieves this with 10× fewer parameters than other models in the literature. Complementing SHSnet, we also present the post-processing unit (PPU), which analyzes crack morphological parameters through fracture mechanics and geometric properties. The PPU generates scanning lines to accurately compute these parameters, ensuring reliable results. The PPU shows a relative error of 0.4%, 1.2%, and 5.6% for crack number, length, and width, respectively. The methodology was benchmarked on complex ECC crack datasets as well as on multiple online datasets. In both of these cases, our results confirm that SHSnet consistently delivers superior performance and efficiency across various scenarios as compared to the methods in the literature.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Infrastructure Maintenance and Monitoring · Non-Destructive Testing Techniques · Concrete Corrosion and Durability
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Institute of Ocean Engineering, SIGS, Tsinghua University, Shenzhen 518055, China
Department of Civil Engineering, The Hong Kong University of Science and Technology, Hong Kong, China
Funding
Scientific Research Startup Funds, Tsinghua University · Guangdong Province · Shenzhen Municipality · Hong Kong RGC
References (62)
Show source-provided references
1. ICD: A methodology for real time onset detection of overlapped acoustic emission waves10.1016/j.autcon.2020.103341 ↗
2. Acoustic emission for characterising the crack propagation in strain-hardening cement-based composites (SHCC)10.1016/j.cemconres.2014.12.003 ↗
3. A strategy for in situ determination of self-healing state for strain hardening cementitious composites10.1016/j.cemconcomp.2020.103641 ↗
4. Influence of micro-cracking on the composite resistivity of Engineered Cementitious Composites10.1016/j.cemconres.2014.01.002 ↗
5. Potential of mechanically induced cascaded long-period grating structure for reflectometric pressure, strain, and temperature sensing10.1109/JSEN.2020.2993011 ↗
6. Review: Optical fiber sensors for civil engineering applications10.1617/s11527-013-0201-7 ↗
7. A fundamental method for prediction of failure of strain hardening cementitious composites without prior information10.1016/j.cemconcomp.2020.103745 ↗
8. Review on computer vision-based crack detection and quantification methodologies for civil structures10.1016/j.conbuildmat.2022.129238 ↗
9. Application of deep convolutional neural networks for automated and rapid identification and computation of crack statistics of thin cracks in strain hardening cementitious composites (SHCCs)10.1016/j.cemconcomp.2021.104159 ↗
10. Autonomous Structural Visual Inspection Using Region-Based Deep Learning for Detecting Multiple Damage Types10.1111/mice.12334 ↗
11. A review on computer vision based defect detection and condition assessment of concrete and asphalt civil infrastructure10.1016/j.aei.2015.01.008 ↗
12. Deep learning-based crack segmentation for civil infrastructure: Data types, architectures, and benchmarked performance10.1016/j.autcon.2022.104678 ↗
13. Weld crack detection and quantification using laser thermography, mask R-CNN, and CycleGAN10.1016/j.autcon.2022.104568 ↗
14. Anomaly detection of defects on concrete structures with the convolutional autoencoder10.1016/j.aei.2020.101105 ↗
15. Autoencoder-based anomaly detection for surface defect inspection10.1016/j.aei.2021.101272 ↗
16. Silva, W.R.L.D., and Lucena, D.S.D. (2018). Concrete Cracks Detection Based on Deep Learning Image Classification. Proceedings, 2.10.3390/ICEM18-05387 ↗
17. A comparison of deep convolutional neural networks for image-based detection of concrete surface cracks
18. Autonomous concrete crack detection using deep fully convolutional neural network10.1016/j.autcon.2018.11.028 ↗
19. Automatic Pixel-Level Crack Detection and Measurement Using Fully Convolutional Network10.1111/mice.12412 ↗
20. Robust pixel-wise concrete crack segmentation and properties retrieval using image patches10.1016/j.autcon.2020.103535 ↗
21. Feature Pyramid and Hierarchical Boosting Network for Pavement Crack Detection10.1109/TITS.2019.2910595 ↗
22. DeepCrack: A deep hierarchical feature learning architecture for crack segmentation10.1016/j.neucom.2019.01.036 ↗
23. Automatic Road Crack Detection Using Random Structured Forests10.1109/TITS.2016.2552248 ↗
24. CrackTree: Automatic crack detection from pavement images10.1016/j.patrec.2011.11.004 ↗
25. SDDNet: Real-Time Crack Segmentation10.1109/TIE.2019.2945265 ↗
26. Chen, L., Papandreou, G., Schroff, F., and Adam, H. (2017). Rethinking Atrous Convolution for Semantic Image Segmentation. arXiv.
27. Sarmiento, J. (2021). Pavement Distress Detection and Segmentation using YOLOv4 and DeepLabv3 on Pavements in the Philippines. arXiv.
28. Underwater crack pixel-wise identification and quantification for dams via lightweight semantic segmentation and transfer learning10.1016/j.autcon.2022.104600 ↗
29. Efficient surface defect detection using self-supervised learning strategy and segmentation network10.1016/j.aei.2022.101566 ↗
30. Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications. arXiv.
31. Real-Time Tunnel Crack Analysis System via Deep Learning10.1109/ACCESS.2019.2916330 ↗
32. Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5–9). U-Net: Convolutional Networks for Biomedical Image Segmentation. Proceedings of the 18th International Conference, Munich, Germany.10.1007/978-3-319-24574-4_28 ↗
33. Oktay, O., Schlemper, J., Folgoc, L., Lee, M., Heinrich, M., Misawa, K., Mori, K., McDonagh, S., Hammerla, N., and Kainz, B. (2018). Attention U-Net: Learning Where to Look for the Pancreas. arXiv.
34. Ran, R., Xu, X., Qiu, S., Cui, X., and Wu, F. (2021, January 15–17). Crack-SegNet: Surface Crack Detection in Complex Background Using Encoder-Decoder Architecture. Proceedings of the 2021 4th International Conference on Sensors, Signal and Image Processing, Nanjing, China.10.1145/3502814.3502817 ↗
35. Yao, Z., Xu, J., Hou, S., and Mooi, C.C. (2024). CrackNex: A Few-shot Low-light Crack Segmentation Model Based on Retinex Theory for UAV Inspections. arXiv.10.1109/ICRA57147.2024.10611660 ↗
36. A research on an improved Unet-based concrete crack detection algorithm10.1177/1475921720940068 ↗
37. Zhou, Z., Siddiquee, M.M.R., Tajbakhsh, N., and Liang, J. (2018). UNet++: A Nested U-Net Architecture for Medical Image Segmentation. Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support, Springer.10.1007/978-3-030-00889-5_1 ↗
38. Attention-based generative adversarial network with internal damage segmentation using thermography10.1016/j.autcon.2022.104412 ↗
39. Network for robust and high-accuracy pavement crack segmentation10.1016/j.autcon.2024.105375 ↗
40. Highly accurate and automatic semantic segmentation of multiple cracks in engineered cementitious composites (ECC) under dual pre-modification deep-learning strategy10.1016/j.cemconres.2022.107066 ↗
41. Automatic identification and quantification of dense microcracks in high-performance fiber-reinforced cementitious composites through deep learning-based computer vision10.1016/j.cemconres.2021.106532 ↗
42. Lepech, M., and Li, V.C. (2005, January 22–24). Design and field demonstration of ECC link slabs for jointless bridge decks. Proceedings of the Third International Conference on Construction Materials: Performance, Innovations and Structural Implications, Vancouver, BC, Canada.
43. Li, V.C., Fischer, G., Kim, Y., Lepech, M.D., Qian, S., Weimann, M., and Wang, S. (2003). Durable Link Slabs for Jointless Bridge Decks Based on Strain-Hardening Cementitious Composites, The National Academies of Sciences, Engineering, and Medicine.
44. Rokugo, K. (2017). Applications of SHCC in Japan—Tools and Tips for Promoting its Use. Strain-Hardening Cement-Based Composites, Springer.10.1007/978-94-024-1194-2_77 ↗
45. Patching repair with ECC on cracked concrete surface
46. Tan, M., and Le, Q.V. (2019, January 9–15). EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks. Proceedings of the 36th International Conference on Machine Learning, Long Beach, CA, USA.
47. Peng, C., Zhang, X., Yu, G., Luo, G., and Sun, J. (2017, January 21–26). Large Kernel Matters—Improve Semantic Segmentation by Global Convolutional Network. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.189 ↗
48. Measures of the Amount of Ecologic Association Between Species10.2307/1932409 ↗
49. Focal Loss for Dense Object Detection
50. Hybrid pixel-level concrete crack segmentation and quantification across complex backgrounds using deep learning10.1016/j.autcon.2020.103291 ↗
51. Shoemake, K. (1994). Graphics Gems IV, Academic Press.
52. Li, V.C. (2019). Engineered Cementitious Composites (ECC): Bendable Concrete for Sustainable and Resilient Infrastructure, Springer. [1st ed.].10.1007/978-3-662-58438-5 ↗
53. Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7–12). Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298594 ↗
54. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep Residual Learning for Image Recognition. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
55. A novel strategy to assess healing induced recovery of mechanical properties of strain hardening cementitious composites through autogenous healing10.1016/j.cemconcomp.2023.105177 ↗
56. Water permeability of engineered cementitious composites10.1016/j.cemconcomp.2009.07.002 ↗
57. Van Zijl, G.P., and Slowik, V. (2017). A Framework for Durability Design with Strain-Hardening Cement-Based Composites (SHCC): State-of-the-Art Report of the RILEM Technical Committee 240-FDS, Springer.10.1007/978-94-024-1013-6 ↗
58. Power spectral entropy of acoustic emission signal as a new damage indicator to identify the operating regime of strain hardening cementitious composites10.1016/j.cemconcomp.2019.103409 ↗
59. Multiaxial Fatigue and Cracking Orientation of Forged AZ80 Magnesium Alloy10.1016/j.prostr.2020.04.055 ↗
60. Macek, W., Branco, R., de Jesus, J., Costa, J.D., Zhu, S.-P., Nejad, R.M., and Gryguć, A. (2024). Strain energy density and entire fracture surface parameters relationship for LCF life prediction of additively manufactured 18Ni300 steel. Int. J. Damage Mech., 10567895241245879.10.1177/10567895241245879 ↗
61. Gryguć, A., Karparvarfard, S.M.H., Roostaei, A., Toscano, D., Shaha, S., Behravesh, B., and Jahed, H. (2020). On the Load Multiaxiality Effect on the Cyclic Behaviour of Magnesium Alloys. Magnesium Technology 2020, Springer International Publishing.10.1007/978-3-030-36647-6_25 ↗
62. Fully Convolutional Networks for Semantic Segmentation10.1109/TPAMI.2016.2572683 ↗