journal article·2019-07-01Open access

Concrete Cracks Detection Based on FCN with Dilated Convolution

Jianming Zhang, Chaoquan Lu, Jin Wang, Lei Wang, Xiao-Guang Yue

Applied Sciences· Volume 9· Issue 13

Abstract

In civil engineering, the stability of concrete is of great significance to safety of people’s life and property, so it is necessary to detect concrete damage effectively. In this paper, we treat crack detection on concrete surface as a semantic segmentation task that distinguishes background from crack at the pixel level. Inspired by Fully Convolutional Networks (FCN), we propose a full convolution network based on dilated convolution for concrete crack detection, which consists of an encoder and a decoder. Specifically, we first used the residual network to extract the feature maps of the input image, designed the dilated convolutions with different dilation rates to extract the feature maps of different receptive fields, and fused the extracted features from multiple branches. Then, we exploited the stacked deconvolution to do up-sampling operator in the fused feature maps. Finally, we used the SoftMax function to classify the feature maps at the pixel level. In order to verify the validity of the model, we introduced the commonly used evaluation indicators of semantic segmentation: Pixel Accuracy (PA), Mean Pixel Accuracy (MPA), Mean Intersection over Union (MIoU), and Frequency Weighted Intersection over Union (FWIoU). The experimental results show that the proposed model converges faster and has better generalization performance on the test set by introducing dilated convolutions with different dilation rates and a multi-branch fusion strategy. Our model has a PA of 96.84%, MPA of 92.55%, MIoU of 86.05% and FWIoU of 94.22% on the test set, which is superior to other models.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Infrastructure Maintenance and Monitoring · Concrete Corrosion and Durability · Asphalt Pavement Performance Evaluation

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Hunan Provincial Key Laboratory of Intelligent Processing of Big Data on Transportation, School of Computer and Communication Engineering, Changsha University of Science and Technology, Changsha 410114, China

School of Information Science and Engineering, Fujian University of Technology, Fuzhou 350118, China

School of Civil Engineering, Changsha University of Science and Technology, Changsha 410114, China

Rattanakosin International College of Creative Entrepreneurship, Rajamangala University of Technology Rattanakosin, Nakhon Pathom 73170, Thailand

Funding

National Natural Science Foundation of China · Scientific Research Fund of Hunan Provincial Education Department · Postgraduate Scientific Research Innovation Fund of Hunan Province · Undergraduate Inquiry Learning and Innovative Experimental Fund of CSUST · Postgraduate Training Innovation Base Construction Project of Hunan Province

References (49)

Show source-provided references
1. Nhat-Duc, H. (2018). Detection of Surface Crack in Building Structures Using Image Processing Technique with an Improved Otsu Method for Image Thresholding. Adv. Civ. Eng.10.1155/2018/3924120 ↗
2. Liu, X., Ai, Y., and Scherer, S. (2017, January 17–20). Robust Image-Based Crack Detection in Concrete Structure Using Multi-Scale Enhancement and Visual Features. Proceedings of the IEEE International Conference on Image Processing, Beijing, China.10.1109/ICIP.2017.8296693 ↗
3. Dorafshan, S., Thomas, R.J., and Maguire, M. (2019). Benchmarking Image Processing Algorithms for Unmanned Aerial System-Assisted Crack Detection in Concrete Structures. Infrastructures, 4.10.3390/infrastructures4020019 ↗
4. Deep Learning-Based Crack Damage Detection Using Convolutional Neural Networks10.1111/mice.12263 ↗
5. Dorafshan, S., Thomas, R., Coopmans, C., and Maguire, M. (2018, January 2–15). Deep Learning Neural Networks for sUAS-Assisted Structural Inspections: Feasibility and Application. Proceedings of the International Conference on Unmanned Aircraft Systems, 650 N. Pearl Str., Dallas, TX, USA.10.1109/ICUAS.2018.8453409 ↗
6. Autonomous Structural Visual Inspection Using Region-Based Deep Learning for Detecting Multiple Damage Types10.1111/mice.12334 ↗
7. Long, J., Shelhamer, E., and Darrell, T. (2015, January 7–12). Fully Convolutional Networks for Semantic Segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298965 ↗
8. Teichmann, M., Weber, M., Zöllner, M., Cipolla, R., and Urtasun, R. (2018, January 26–30). MultiNet: Real-time Joint Semantic Reasoning for Autonomous Driving. Proceedings of the IEEE Intelligent Vehicles Symposium, Changshu, Suzhou, China.10.1109/IVS.2018.8500504 ↗
9. Kampffmeyer, M., Salberg, A., and Jenssen, R. (2016, January 26–30). Semantic Segmentation of Small Objects and Modeling of Uncertainty in Urban Remote Sensing Images Using Deep Convolutional Neural Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Las Vegas, NV, USA.10.1109/CVPRW.2016.90 ↗
10. He, K., Zhang, X., Ren, S., and Ren, S. (2016, January 26–30). Deep Residual Learning for Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
11. Chen, L., Papandreou, G., Schroff, F., and Adam, H. (2017). Rethinking Atrous Convolution for Semantic Image Segmentation. arXiv.
12. (2019, June 01). Concrete Crack Images for Classification. Available online: https://data.mendeley.com/datasets/5y9wdsg2zt/1.
13. Alberto, G., Sergio, O., Sergiu, O., Victor, V., and Jose, G. (2017). A Review on Deep Learning Techniques Applied to Semantic Segmentation. arXiv.
14. Ng, H., Hashim, M., and Jaw, S. (2014, January 27–31). Building Concrete Cracks Detection Using Image-Based Nondestructive Geotechnical Technique. Proceedings of the Asian Conference on Remote Sensing 2014: Sensing for Reintegration of Societies, Nay Pyi Taw, Myanmar.
15. Taghavipour, S., Kharkovsky, S., Kang, W., Samali, B., and Mirza, O. (2017). Detection and Monitoring of Flexural Cracks in Reinforced Concrete Beams Using Mounted Smart Aggregate Transducers. Smart Mater. Struct., 26.10.1088/1361-665X/aa849a ↗
16. Voigt, B., Bordin, F., Gorkos, P., and Veronez, M. (2016, January 26–30). Detection of Cracks and Loss of Mass in Concrete Through 3D Point Clouds Generated by Terrestrial Laser Scanner. Proceedings of the International Conference on Bridge Maintenance, Safety and Management, Foz do Iguaçu, Brazil.10.1201/9781315207681-282 ↗
17. Chen, Y., Wang, J., Xia, R., Zhang, Q., Cao, Z., and Yang, K. (2019). The Visual Object Tracking Algorithm Research Based on Adaptive Combination Kernel. J. Ambient Intell. Humaniz. Comput., (in press).10.1007/s12652-018-01171-4 ↗
18. Zhang, J., Jin, X., Sun, J., Wang, J., and Sangaiah, A. (2018). Spatial and Semantic Convolutional Features for Robust Visual Object Tracking. Multimed. Tools Appl., in press.10.1007/s11042-018-6562-8 ↗
19. A Fast Object Tracker Based on Integrated Multiple Features and Dynamic Learning Rate
20. Dual Model Learning Combined with Multiple Feature Selection for Accurate Visual Tracking10.1109/ACCESS.2019.2908668 ↗
21. A Full Convolutional Network Based on DenseNet for Remote Sensing Scene Classification10.3934/mbe.2019167 ↗
22. Gatys, L., Ecker, A., and Bethge, M. (2016, January 26–30). Image Style Transfer Using Convolutional Neural Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.265 ↗
23. Calderón, L., and Bairan, J. (2017, January 7–8). Crack Detection in Concrete Elements from RGB Pictures Using Modified Line Detection Kernels. Proceedings of the Intelligent Systems Conference, London, UK.10.1109/IntelliSys.2017.8324222 ↗
24. Dinh, T., Ha, Q., and La, H. (2016, January 13–15). Computer Vision-Based Method for Concrete Crack Detection. Proceedings of the International Conference on Control, Automation, Robotics and Vision, Phuket, Thailand.10.1109/ICARCV.2016.7838682 ↗
25. The Algorithm of Accelerated Cracks Detection and Extracting Skeleton by Direction Chain Code in Concrete Surface Image10.1080/13682199.2016.1146816 ↗
26. Karen, S., and Andrew, Z. (2015). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv.
27. Improved VGG Model for Road Traffic Sign Recognition
28. ImageNet Large Scale Visual Recognition Challenge10.1007/s11263-015-0816-y ↗
29. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks10.1109/TPAMI.2016.2577031 ↗
30. Multi-Camera Transfer GAN for Person Re-Identification10.1016/j.jvcir.2019.01.029 ↗
31. Semi-Supervised Learning with Generative Adversarial Networks on Digital Signal Modulation Classification
32. Adversarial Learning for Distant Supervised Relation Extraction
33. Detecting Iris Liveness with Batch Normalized Convolutional Neural Network
34. Deep Learning in Data-Driven Pavement Image Analysis and Automated Distress Detection: A Review10.3390/data3030028 ↗
35. Wang, X., and Hu, Z. (2017, January 8–10). Grid-Based Pavement Crack Analysis Using Deep Learning. Proceedings of the International Conference on Transportation Information and Safety, Banff, AB, Canada.10.1109/ICTIS.2017.8047878 ↗
36. NB-CNN: Deep Learning-Based Crack Detection Using Convolutional Neural Network and Naïve Bayes Data Fusion10.1109/TIE.2017.2764844 ↗
37. Cha, Y., and Choi, W. (2016, January 1–2). Vision-Based Concrete Crack Detection Using a Convolutional Neural Network. Proceedings of the IMAC Conference and Exposition on Structural Dynamics, Garden Grove, CA, USA.
38. Automated Vision-Based Detection of Cracks on Concrete Surfaces Using a Deep Learning Technique
39. A Two-Stage Crack Detection Method for Concrete Bridges Using Convolutional Neural Networks10.1587/transinf.2018EDL8150 ↗
40. Automated Detection of Sewer Pipe Defects in Closed-Circuit Television Images Using Deep Learning Techniques10.1016/j.autcon.2018.08.006 ↗
41. A Fast Detection Method via Region-Based Fully Convolutional Neural Networks for Shield Tunnel Lining Defects10.1111/mice.12367 ↗
42. Computer Vision-Based Concrete Crack Detection Using U-net Fully Convolutional Networks10.1016/j.autcon.2019.04.005 ↗
43. Automated Pixel-Level Pavement Crack Detection on 3D Asphalt Surfaces Using a Deep-Learning Network10.1111/mice.12297 ↗
44. Autonomous Concrete Crack Detection Using Deep Fully Convolutional Neural Network10.1016/j.autcon.2018.11.028 ↗
45. Automatic Pixel-Level Crack Detection and Measurement Using Fully Convolutional Network10.1111/mice.12412 ↗
46. In-Process Virtual Verification of Weld Seam Removal in Robotic Abrasive Belt Grinding Process Using Deep Learning10.1016/j.rcim.2019.01.006 ↗
47. Nair, V., and Hinton, G. (2010, January 21–25). Rectified Linear Units Improve Restricted Boltzmann Machines. Proceedings of the International Conference on Machine Learning, Haifa, Israel.
48. Ioffe, S., and Szegedy, C. (2015, January 6–11). Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift. Proceedings of the International Conference on Machine Learning, Lile, France.
49. (2019, June 16). SDNET2018: A Concrete Crack Image Dataset for Machine Learning Applications. Available online: https://digitalcommons.usu.edu/all_datasets/48/.