Concrete Crack Detection Based on Well-Known Feature Extractor Model and the YOLO_v2 Network
Source abstract
Abstract
This paper compares the crack detection performance (in terms of precision and computational cost) of the YOLO_v2 using 11 feature extractors, which provides a base for realizing fast and accurate crack detection on concrete structures. Cracks on concrete structures are an important indicator for assessing their durability and safety, and real-time crack detection is an essential task in structural maintenance. The object detection algorithm, especially the YOLO series network, has significant potential in crack detection, while the feature extractor is the most important component of the YOLO_v2. Hence, this paper employs 11 well-known CNN models as the feature extractor of the YOLO_v2 for crack detection. The results confirm that a different feature extractor model of the YOLO_v2 network leads to a different detection result, among which the AP value is 0.89, 0, and 0 for ‘resnet18’, ‘alexnet’, and ‘vgg16’, respectively meanwhile, the ‘googlenet’ (AP = 0.84) and ‘mobilenetv2’ (AP = 0.87) also demonstrate comparable AP values. In terms of computing speed, the ‘alexnet’ takes the least computational time, the ‘squeezenet’ and ‘resnet18’ are ranked second and third respectively; therefore, the ‘resnet18’ is the best feature extractor model in terms of precision and computational cost. Additionally, through the parametric study (influence on detection results of the training epoch, feature extraction layer, and testing image size), the associated parameters indeed have an impact on the detection results. It is demonstrated that: excellent crack detection results can be achieved by the YOLO_v2 detector, in which an appropriate feature extractor model, training epoch, feature extraction layer, and testing image size play an important role.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Infrastructure Maintenance and Monitoring · Concrete Corrosion and Durability · Occupational Health and Safety Research
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Civil and Transportation Engineering, Guangdong University of Technology, Guangzhou 510006, China
Department of Mechanical Engineering, Hong Kong Polytechnic University, Hung Hom, Kowloon 999077 China
References (40)
Show source-provided references
1. A review on computer vision based defect detection and condition assessment of concrete and asphalt civil infrastructure10.1016/j.aei.2015.01.008 ↗
2. A two-phase model to predict the remaining useful life of corroded reinforced concrete beams10.1007/s13349-019-00327-w ↗
3. Recognition of rust grade and rust ratio of steel structures based on ensembled convolutional neural network10.1111/mice.12563 ↗
4. Autonomous Structural Visual Inspection Using Region-Based Deep Learning for Detecting Multiple Damage Types10.1111/mice.12334 ↗
5. Automatic bridge crack identification from concrete surface using ResNeXt with postprocessing10.1002/stc.2620 ↗
6. Concrete bridge surface damage detection using a single-stage detector10.1111/mice.12500 ↗
7. Automatic Road Crack Detection Using Random Structured Forests10.1109/TITS.2016.2552248 ↗
8. Artificial Neural Networks: A Tutorial10.1109/2.485891 ↗
9. Automatic Detection of Rail Surface Cracks with a Superpixel-Based Data-Driven Framework10.1061/(ASCE)CP.1943-5487.0000799 ↗
10. An Artificial Intelligence Method for Asphalt Pavement Pothole Detection Using Least Squares Support Vector Machine and Neural Network with Steerable Filter-Based Feature Extraction
11. Evolutionary Artificial Neural Networks10.1142/S0129065793000171 ↗
12. Structural Damage Detection with Automatic Feature extraction through Deep Learning10.1111/mice.12313 ↗
13. Zhong, K., Teng, S., Liu, G., Chen, G., and Cui, F. (2020). Structural Damage Features Extracted by Convolutional Neural Networks from Mode Shapes. Appl. Sci., 10.10.3390/app10124247 ↗
14. Deep learning10.1038/nature14539 ↗
15. Convolutional neural network-based data anomaly detection method using multiple information for structural health monitoring10.1002/stc.2296 ↗
16. Deep Learning-Based Crack Damage Detection Using Convolutional Neural Networks10.1111/mice.12263 ↗
17. A novel machine learning-based algorithm to detect damage in high-rise building structures10.1002/tal.1400 ↗
18. Structural damage detection using convolutional neural networks combining strain energy and dynamic response10.1007/s11012-019-01052-w ↗
19. Teng, S., Chen, G., Liu, G., Lv, J., and Cui, F. (2019). Modal Strain Energy-Based Structural Damage Detection Using Convolutional Neural Networks. Appl. Sci., 9.10.3390/app9163376 ↗
20. Deep Transfer Learning for Image-Based Structural Damage Recognition10.1111/mice.12363 ↗
21. Automated defect classification in sewer closed circuit television inspections using deep convolutional neural networks10.1016/j.autcon.2018.03.028 ↗
22. Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012, January 3–6). ImageNet Classification with Deep Convolutional Neural Networks. Proceedings of the International Conference on Neural Information Processing Systems, Lake Tahoe, NV, USA.
23. Automated Pixel-Level Pavement Crack Detection on 3D Asphalt Surfaces Using a Deep-Learning Network10.1111/mice.12297 ↗
24. Automatic classification of pavement crack using deep convolutional neural network10.1080/10298436.2018.1485917 ↗
25. Road Damage Detection and Classification Using Deep Neural Networks with Smartphone Images10.1111/mice.12387 ↗
26. Kaur, T., and Gandhi, T.K. (2019, January 19–21). Automated Brain Image Classification Based on VGG-16 and Transfer Learning. Proceedings of the 2019 International Conference on Information Technology (ICIT), Bhubaneswar, India.10.1109/ICIT48102.2019.00023 ↗
27. Liang, Y., Bing, L., Wei, L., Liu, Z., and Xiao, J. (2017, January 24–28). Deep Concrete Inspection Using Unmanned Aerial Vehicle Towards CSSC Database. Proceedings of the 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems, Vancouver, BC, Canada.
28. Visual data classification in post-event building reconnaissance10.1016/j.engstruct.2017.10.057 ↗
29. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks10.1109/TPAMI.2016.2577031 ↗
30. Automatic seismic damage identification of reinforced concrete columns from images by a region-based deep convolutional neural network10.1002/stc.2313 ↗
31. Image-based post-disaster inspection of reinforced concrete bridge systems using deep learning with Bayesian optimization
32. Tran, V.P., Tran, T.S., Lee, H.J., Kim, K.D., Baek, J., and Nguyen, T.T. (2020). One stage detector (RetinaNet)-based crack detection for asphalt pavements considering pavement distresses and surface objects. J. Civil Struct. Health Monit.10.1007/s13349-020-00447-8 ↗
33. Review of Robotic Infrastructure Inspection Systems10.1061/(ASCE)IS.1943-555X.0000353 ↗
34. A deep learning-based framework for an automated defect detection system for sewer pipes10.1016/j.autcon.2019.102967 ↗
35. Automated pavement crack detection and segmentation based on two-step convolutional neural network10.1111/mice.12622 ↗
36. Unified Vision-Based Methodology for Simultaneous Concrete Defect Detection and Geolocalization10.1111/mice.12351 ↗
37. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27–30). You Only Look Once: Unified, Real-Time Object Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.91 ↗
38. ImageNet Large Scale Visual Recognition Challenge10.1007/s11263-015-0816-y ↗
39. (2020, December 14). Available online: http://www.mathworks.com/.
40. Stochastic Gradient Descent as Approximate Bayesian Inference