journal article·2021-04-01

Lightweight pixel-wise segmentation for efficient concrete crack detection using hierarchical convolutional neural network

Jin Kim, Seungbo Shim, Yohan Cha, Gye-Chun Cho

Smart Materials and Structures· Volume 30· Issue 4
Publisher page

Abstract

Abstract The aging of concrete structures is a threat to public safety; therefore, maintenance and repair of these structures have been highly emphasized. However, regular inspections to detect concrete cracks that rely on operators lack objectivity and consume a lot of time. To overcome this limitation, high-resolution image processing and deep learning have been adopted. Nevertheless, cracks on structure surfaces are still challenging to detect owing to the variety of shapes of cracks and the dependence of recognition performance on image conditions. Herein, we propose a new concrete crack detection method that applies the semantic segmentation technique using 1196 concrete crack images and labeled images produced in this study. A new segmentation algorithm is developed using a hierarchical convolutional neural network to improve speed, and a multi-loss update method is proposed to improve accuracy. The performance of the proposed network is evaluated in terms of accuracy and speed. The results show that the proposed network produces a 2.165% increase in the intersection over union of crack, 65.90% decrease in the average inference time, and 99.90% decrease in the number of parameters compared with the best accuracy results using existing segmentation networks. It is expected that the application of this improved crack detection method will result in faster and more accurate crack detection and, consequently, improved safety, thereby making it suitable for application in structure safety inspections.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Infrastructure Maintenance and Monitoring · Concrete Corrosion and Durability · Structural Health Monitoring Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (58)

Show source-provided references
1. Past, present and future of robotic tunnel inspection10.1016/j.autcon.2015.02.003 ↗
2. Fast crack detection method for large-size concrete surface images using percolation-based image processing10.1007/s00138-009-0189-8 ↗
3. Image-based concrete crack detection in tunnels using deep fully convolutional networks10.1016/j.conbuildmat.2019.117367 ↗
4. Development of an inspection system for cracks in a concrete tunnel lining10.1139/l07-008 ↗
5. Review of deep convolution neural network in image classification10.1109/ICRAMET.2017.8253139 ↗
6. Deep learning for generic object detection: a survey10.1007/s11263-019-01247-4 ↗
7. A review on deep learning techniques applied to semantic segmentation
8. A survey of semantic segmentation
9. Crack detection using image processing: a critical review and analysis10.1016/j.aej.2017.01.020 ↗
10. Comparison analysis on present image-based crack detection methods in concrete structures10.1109/CISP.2010.5647496 ↗
11. A method for crack detection on a concrete structure10.1109/ICPR.2006.98 ↗
12. A robust approach for automatic detection and segmentation of cracks in underground pipeline images10.1016/j.imavis.2005.05.017 ↗
13. Image‐based crack detection for real concrete surfaces10.1002/tee.20244 ↗
14. An operational application of automatic feature extraction: the measurement of cracks in concrete structures10.1111/0031-868X.00198 ↗
15. Support-vector networks10.1007/BF00994018 ↗
16. Random forests10.1023/A:1010933404324 ↗
17. Nearest neighbor pattern classification10.1109/TIT.1967.1053964 ↗
18. Tunnel crack detection and classification system based on image processing10.1117/12.460191 ↗
19. Automatic crack detection and classification method for subway tunnel safety monitoring10.3390/s141019307 ↗
20. Adaptive road crack detection system by pavement classification10.3390/s111009628 ↗
21. Supervised strategies for cracks detection in images of road pavement flexible surfaces10.5281/ZENODO.41140 ↗
22. Automatic road crack detection using random structured forests10.1109/TITS.2016.2552248 ↗
23. Review of pavement defect detection methods10.1109/ACCESS.2020.2966881 ↗
24. Deep convolutional neural networks for image classification: a comprehensive review10.1162/neco_a_00990 ↗
25. Deep learning-based multimedia analytics: a review10.1145/3321511 ↗
26. Very deep convolutional networks for large-scale image recognition
27. Deep residual learning for image recognition10.1109/CVPR.2016.90 ↗
28. Densely connected convolutional networks10.1109/CVPR.2017.243 ↗
29. Deep learning‐based crack damage detection using convolutional neural networks10.1111/mice.12263 ↗
30. Vision‐based automated crack detection for bridge inspection10.1111/mice.12141 ↗
31. ImageNet classification with deep convolutional neural networks10.1145/3065386 ↗
32. Image-based concrete crack detection using convolutional neural network and exhaustive search technique10.1155/2019/6520620 ↗
33. Faster R-CNN: towards real-time object detection with region proposal networks10.1109/TPAMI.2016.2577031 ↗
34. SSD: single shot multibox detector10.1007/978-3-319-46448-0_2 ↗
35. You only look once: unified, real-time object detection10.1109/CVPR.2016.91 ↗
36. Concrete crack detection with handwriting script interferences using faster region‐based convolutional neural network10.1111/mice.12497 ↗
37. A fast detection method via region‐based fully convolutional neural networks for shield tunnel lining defects10.1111/mice.12367 ↗
38. Pavement crack detection based on yolo v310.1109/IICSPI48186.2019.9095956 ↗
39. Fully convolutional networks for semantic segmentation10.1109/CVPR.2015.7298965 ↗
40. U-Net: convolutional networks for biomedical image segmentation10.1007/978-3-319-24574-4_28 ↗
41. SegNet: a deep convolutional encoder–decoder architecture for image segmentation10.1109/TPAMI.2016.2644615 ↗
42. Encoder–decoder network for pixel‐level road crack detection in black‐box images10.1111/mice.12440 ↗
43. DeepCrack: a deep hierarchical feature learning architecture for crack segmentation10.1016/j.neucom.2019.01.036 ↗
44. Autonomous concrete crack detection using deep fully convolutional neural network10.1016/j.autcon.2018.11.028 ↗
45. Vision-based autonomous crack detection of concrete structures using a fully convolutional encoder–decoder network10.3390/s19194251 ↗
46. CrackU‐net: a novel deep convolutional neural network for pixelwise pavement crack detection10.1002/stc.2551 ↗
47. Automatic tunnel crack detection based on U-Net and a convolutional neural network with alternately updated clique10.3390/s20030717 ↗
48. An overview of multi-task learning in deep neural networks
49. Multi-scale dense networks for resource efficient image classification
50. Multi-scale self-guided attention for medical image segmentation10.1109/JBHI.2020.2986926 ↗
51. Full-resolution residual networks for semantic segmentation in street scenes10.1109/CVPR.2017.353 ↗
52. A Study on Segmentation Model Using Deep Learning for Effective Crack Detection in Tunnel
53. DeepLab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs10.1109/TPAMI.2017.2699184 ↗
54. CGNet: a light-weight context guided network for semantic segmentation10.1109/TIP.2020.3042065 ↗
55. SDNET2018: An annotated image dataset for non-contact concrete crack detection using deep convolutional neural networks10.1016/j.dib.2018.11.015 ↗
56. Concrete crack images for classification, Mendeley data, v110.17632/5y9wdsg2zt.1 ↗
57. Encoder–decoder with atrous separable convolution for semantic image segmentation10.1007/978-3-030-01234-2_49 ↗
58. LedNet: a lightweight encoder–decoder network for real-time semantic segmentation10.1109/ICIP.2019.8803154 ↗