journal article·2021-06-04Open access

Automated Vision-Based Crack Detection on Concrete Surfaces Using Deep Learning

Rajagopalan-Sam Rajadurai, Su-Tae Kang

Applied Sciences· Volume 11· Issue 11

Abstract

Cracking in concrete structures affects performance and is a major durability problem. Cracks must be detected and repaired in time in order to maintain the reliability and performance of the structure. This study focuses on vision-based crack detection algorithms, based on deep convolutional neural networks that detect and classify cracks with higher classification rates by using transfer learning. The image dataset, consisting of two subsequent image classes (no-cracks and cracks), was trained by the AlexNet model. Transfer learning was applied to the AlexNet, including fine-tuning the weights of the architecture, replacing the classification layer for two output classes (no-cracks and cracks), and augmenting image datasets with random rotation angles. The fine-tuned AlexNet model was trained by stochastic gradient descent with momentum optimizer. The precision, recall, accuracy, and F1 metrics were used to evaluate the performance of the trained AlexNet model. The accuracy and loss obtained through the training process were 99.9% and 0.1% at the learning rate of 0.0001 and 6 epochs. The trained AlexNet model accurately predicted 1998/2000 and 3998/4000 validation and test images, which demonstrated the prediction accuracy of 99.9%. The trained model also achieved precision, recall, accuracy, and F1 scores of 0.99, respectively.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Infrastructure Maintenance and Monitoring · Concrete Corrosion and Durability · Geophysical Methods and Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Civil Engineering, Daegu University, Gyeongsan 38453, Korea

Funding

Daegu University

References (46)

Show source-provided references
1. Crack and non-crack classification from concrete surface images using machine learning10.1177/1475921718768747 ↗
2. (2021, March 01). ASCE’s 2017 Infrastructure Report Card|GPA: D+. Available online: https://infrastructurereportcard.org/tag/2020/.
3. Park, C.-H., and Lee, H.-I. (2016). Future Trend of Capital Investment for Korean Transportation Infrastructure, Construction and Economy Research Institute of Korea.
4. Kim, B., and Cho, S. (2020). Automated multiple concrete damage detection using instance segmentation deep learning model. Appl. Sci., 10.10.3390/app10228008 ↗
5. Crack detection study for hydraulic concrete using PPP-BOTDA
6. Comparative analysis of image binarization methods for crack identification in concrete structures10.1016/j.cemconres.2017.04.018 ↗
7. A real time nondestructive crack detection system for the automotive stamping process10.1109/TIM.2016.2583218 ↗
8. Elasticity nonlinear diagnostic method for crack detection and depth estimation10.1121/1.4933844 ↗
9. Elastic moduli of a cracked solid10.1016/0020-7683(76)90044-5 ↗
10. Stiffness reduction of cracked solids10.1016/0013-7944(87)90129-9 ↗
11. A fully non-contact ultrasonic propagation imaging system for closed surface crack evaluation10.1007/s11340-011-9567-z ↗
12. Automatic road crack detection and characterization10.1109/TITS.2012.2208630 ↗
13. Chalioris, C.E., Kytinou, V.K., Voutetaki, M.E., and Karayannis, C.G. (2021). Flexural damage diagnosis in reinforced concrete beams using a wireless admittance monitoring system—Tests and finite element analysis. Sensors, 21.10.3390/s21030679 ↗
14. Structural health monitoring of seismically vulnerable RC frames under lateral cyclic loading
15. Unsupervised approach for autonomous pavement-defect detection and quantification using an inexpensive depth sensor10.1061/(ASCE)CP.1943-5487.0000245 ↗
16. A robust automatic crack detection method from noisy concrete surfaces10.1007/s00138-009-0244-5 ↗
17. Yiyang, Z. (2014, January 20–21). The design of glass crack detection system based on image preprocessing technology. Proceedings of the IEEE 7th Joint International Information Technology and Artificial Intelligence Conference, Chongqing, China.10.1109/ITAIC.2014.7065001 ↗
18. Surface crack detection in welds using thermography10.1016/j.ndteint.2013.03.008 ↗
19. Wang, P., and Huang, H. (2010, January 16–18). Comparison analysis on present image-based crack detection methods in concrete structures. Proceedings of the 3rd International Congress on Image and Signal Processing, Yantai, China.10.1109/CISP.2010.5647496 ↗
20. Real-time image thresholding based on sample space reduction and interpolation approach10.1061/(ASCE)0887-3801(2003)17:4(264) ↗
21. Image-based crack detection for real concrete surfaces10.1002/tee.20244 ↗
22. Vision-based automated crack detection for bridge inspection10.1111/mice.12141 ↗
23. Automatic crack detection and classification method for subway tunnel safety monitoring10.3390/s141019307 ↗
24. Moussa, G., and Hussain, K. (2011, January 19–22). A new technique for automatic detection and parameters estimation of pavement crack. Proceedings of the 4th International Multi-Conference on Engineering Technology Innovation, Orlando, FL, USA.
25. Adaptive road crack detection system by pavement classification10.3390/s111009628 ↗
26. Position-invariant neural network for digital pavement crack analysis10.1111/j.1467-8667.2004.00341.x ↗
27. Saar, T., and Talvik, O. (2010, January 4–6). Automatic asphalt pavement crack detection and classification using neural networks. Proceedings of the 12th Biennial Baltic Electronics Conference, Tallinn, Estonia.10.1109/BEC.2010.5630750 ↗
28. Rapid entropy-based detection and properties measurement of concrete spalling with machine vision for post-earthquake safety assessments10.1016/j.aei.2012.06.005 ↗
29. A noise robust method based on completed local binary patterns for hot-rolled steel strip surface defects10.1016/j.apsusc.2013.09.002 ↗
30. Automated crack detection on concrete bridges10.1109/TASE.2014.2354314 ↗
31. Nb-cnn: Deep learning-based crack detection using convolutional neural network and naive bayes data fusion10.1109/TIE.2017.2764844 ↗
32. Zhang, L., Yang, F., Zhang, Y.D., and Zhu, Y.J. (2016, January 25–28). Road crack detection using deep convolutional neural network. Proceedings of the 2016 IEEE International Conference on Image Processing, Phoenix, AZ, USA.10.1109/ICIP.2016.7533052 ↗
33. Makantasis, K., Protopapadakis, E., Doulamis, A., Doulamis, N., and Loupos, C. (2015, January 3–5). Deep convolutional neural networks for efficient vision based tunnel inspection. Proceedings of the 2015 IEEE International Conference on Intelligent Computer Communication and Processing, Cluj-Napoca, Romania.10.1109/ICCP.2015.7312681 ↗
34. Deep learning-based crack damage detection using convolutional neural networks10.1111/mice.12263 ↗
35. Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv.
36. Badrinarayanan, V., Handa, A., and Cipolla, R. (2015). Segnet: A deep convolutional encoder decoder architecture for robust semantic pixel-wise labelling. arXiv.
37. Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5–9). U-Net: Convolutional Networks for Biomedical Image Segmentation. Proceedings of the International Conference on Medical Image Computing and Computer Assisted Intervention, Munich, Germany.10.1007/978-3-319-24574-4_28 ↗
38. Encoder-decoder network for pixel-level road crack detection in black-box images10.1111/mice.12440 ↗
39. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the 30th IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2016.90 ↗
40. Automatic pixel-level multiple damage detection of concrete structure using fully convolutional network10.1111/mice.12433 ↗
41. Autonomous concrete crack detection using deep fully convolutional neural network10.1016/j.autcon.2018.11.028 ↗
42. Imagenet classification with deep convolutional neural networks
43. Monitoring sugar crystallization with deep neural networks10.1016/j.jfoodeng.2020.109965 ↗
44. Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., and Fei-Fei, L. (2009, January 20–25). Imagenet: A large-scale hierarchical image database. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.10.1109/CVPR.2009.5206848 ↗
45. and Fırat, C. (2019). Concrete Crack Images for Classification. Mendeley Data, V2.
46. Maguire, M., Dorafshan, S., and Thomas, R.J. (2018). SDNET2018: A concrete crack image dataset for machine learning applications. Utah State Univ.