A Multi-Scale Contextual Information Enhancement Network for Crack Segmentation
Source abstract
Abstract
In recent years, convolutional neural-network-based crack segmentation methods have performed excellently. However, existing crack segmentation methods still suffer from background noise interference, such as dirt patches and pitting, as well as the imprecise segmentation of fine-grained spatial structures. This is mainly due to the fact that convolutional neural networks dilute low-level spatial information in the process of extracting deep semantic features, and the network cannot obtain accurate context awareness because of the limitation of the actual receptive field size. To address these problems, an encoder–decoder crack segmentation network based on multi-scale contextual information enhancement is proposed. First, a new architecture of skip connection is proposed, enabling the network to obtain refined crack segmentation results; then, a contextual feature enhancement module is designed to make the network more effective at distinguishing between cracks and background noise; finally, the deformable convolution is introduced into the encoder network to further enhance its ability to extract the diverse morphological features of cracks by adaptively adjusting the sampling area and the receptive field size. Experiments show that the proposed method is effective in crack segmentation and outperforms mainstream segmentation networks such as DeepLab V3+ and UNet++.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Infrastructure Maintenance and Monitoring · Non-Destructive Testing Techniques · Concrete Corrosion and Durability
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
College of Computer and Information Engineering, Hohai University, Nanjing 211100, China
State Key Laboratory of Hydrology–Water Resources and Hydraulic Engineering, Nanjing Hydraulic Research Institute, Nanjing 210029, China
College of Harbour, Coastal and Offshore Engineering, Hohai University, Nanjing 211100, China
Funding
Nation Nature Science Foundation of China
References (55)
Show source-provided references
1. Salam, M., Mathavan, S., Kamal, K., and Rahman, M. (2013, January 6–9). Pavement crack detection using the Gabor filter. Proceedings of the 16th international IEEE conference on intelligent transportation systems, The Hague, Netherlands.
2. Eisenbach, M., Stricker, R., Seichter, D., Amende, K., Debes, K., Sesselmann, M., Ebersbach, D., Stoeckert, U., and Gross, H.M. (2017, January 14–19). How to get pavement distress detection ready for deep learning? A systematic approach. Proceedings of the 2017 International Joint Conference on Neural Networks, Anchorage, Alaska.10.1109/IJCNN.2017.7966101 ↗
3. Deepcrack: Learning hierarchical convolutional features for crack detection10.1109/TIP.2018.2878966 ↗
4. Improved pavement distress detection based on contourlet transform and multi-direction morphological structuring elements
5. Su, Z., and Guo, Y. (2010, January 10–12). Algorithm on Contourlet Domain in Detection of Road Cracks for Pavement Images. Proceedings of the 2010 Ninth International Symposium on Distributed Computing and Applications to Business, Engineering and Science, Hong Kong, China.
6. Detection of the Crack in Cantilever Structures Using Fuzzy Gaussian Inference Technique10.2514/1.35927 ↗
7. Automatic ridgelet image enhancement algorithm for road crack image based on fuzzy entropy and fuzzy divergence10.1016/j.optlaseng.2009.05.014 ↗
8. Zuo, Y., Wang, G., and Zuo, C. (2008, January 13–17). Wavelet Packet Denoising for Pavement Surface Cracks Detection. Proceedings of the 2008 International Conference on Computational Intelligence and Security, Suzhou, China.10.1109/CIS.2008.208 ↗
9. Wavelet-Based Pavement Distress Classification10.1177/0361198105194000111 ↗
10. Histogram-Based Approach for Automated Pavement-Crack Sensing10.1061/(ASCE)0733-947X(1992)118:5(700) ↗
11. Real-Time Image Thresholding Based on Sample Space Reduction and Interpolation Approach10.1061/(ASCE)0887-3801(2003)17:4(264) ↗
12. Zhao, H., Qin, G., and Wang, X. (2010, January 16–18). Improvement of canny algorithm based on pavement edge detection. Proceedings of the 2010 3rd International Congress on Image and Signal Processing, Yantai, China.10.1109/CISP.2010.5646923 ↗
13. Analysis of Edge-Detection Techniques for Crack Identification in Bridges10.1061/(ASCE)0887-3801(2003)17:4(255) ↗
14. Jmour, N., Zayen, S., and Abdelkrim, A. (2018, January 25). Convolutional neural networks for image classification. Proceedings of the 2018 International Conference on Advanced Systems and Electric Technologies, Hammamet, Tunisia.10.1109/ASET.2018.8379889 ↗
15. He, K., Zhang, X., Ren, S., and Sun, J. (2015, January 7–13). Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification. Proceedings of the 2015 IEEE International Conference on Computer Vision, Santiago, Chile.10.1109/ICCV.2015.123 ↗
16. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks10.1109/TPAMI.2016.2577031 ↗
17. Redmon, J., and Farhadi, A. (2018). Yolov3: An incremental improvement. arXiv.
18. Long, J., Shelhamer, E., and Darrell, T. (2015, January 8–10). Fully convolutional networks for semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298965 ↗
19. Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5–9). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Munich, Germany.10.1007/978-3-319-24574-4_28 ↗
20. Deep learning-based crack damage detection using convolutional neural networks10.1111/mice.12263 ↗
21. Pauly, L., Hogg, D., Fuentes, R., and Peel, H. (2017, January 28). Deeper networks for pavement crack detection. Proceedings of the 34th The International Association for Automation and Robotics in Construction, Taipei, Taiwan.10.22260/ISARC2017/0066 ↗
22. Tang, J., Mao, Y., Wang, J., and Wang, L. (2019, January 5–7). Multi-task Enhanced Dam Crack Image Detection Based on Faster R-CNN. Proceedings of the 2019 IEEE 4th International Conference on Image, Vision and Computing, Xiamen, China.10.1109/ICIVC47709.2019.8981093 ↗
23. Suh, G., and Cha, Y.J. (2018, January 5–8). Deep faster R-CNN-based automated detection and localization of multiple types of damage. Proceedings of the Sensors and Smart Structures Technologies for Civil, Mechanical, and Aerospace Systems 2018, Denver, CO, USA.10.1117/12.2295954 ↗
24. Optimized deep encoder-decoder methods for crack segmentation10.1016/j.dsp.2020.102907 ↗
25. DeepCrack: A deep hierarchical feature learning architecture for crack segmentation10.1016/j.neucom.2019.01.036 ↗
26. SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation10.1109/TPAMI.2016.2644615 ↗
27. Automated Pavement Crack Segmentation Using U-Net-Based Convolutional Neural Network10.1109/ACCESS.2020.3003638 ↗
28. Han, C., Ma, T., Huyan, J., Huang, X., and Zhang, Y. (2021). CrackW-Net: A novel pavement crack image segmentation convolutional neural network. IEEE Trans. Intell. Transp. Syst.10.1109/TITS.2021.3095507 ↗
29. Huang, H., Lin, L., Tong, R., Hu, H., Zhang, Q., Iwamoto, Y., Han, X., Chen, Y.W., and Wu, J. (2020, January 4–8). Unet 3+: A full-scale connected unet for medical image segmentation. Proceedings of the 2020 IEEE International Conference on Acoustics, Speech and Signal Processing, Barcelona, Spain.10.1109/ICASSP40776.2020.9053405 ↗
30. Zhao, H., Shi, J., Qi, X., Wang, X., and Jia, J. (2017, January 22–25). Pyramid scene parsing network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.660 ↗
31. Automatic Road Pavement Assessment with Image Processing: Review and Comparison10.1155/2011/989354 ↗
32. Katakam, N. (2009). Pavement Crack Detection System Through Localized Thresholding. [Doctoral Dissertation, University of Toledo].
33. Oliveira, H., and Correia, P.L. (2009, January 25). Automatic road crack segmentation using entropy and image dynamic thresholding. Proceedings of the 2009 17th European Signal Processing Conference, Glasgow, Scotland.
34. An efficient and reliable coarse-to-fine approach for asphalt pavement crack detection10.1016/j.imavis.2016.11.018 ↗
35. Wavelet-Based Pavement Distress Image Edge Detection with À Trous Algorithm10.3141/2024-09 ↗
36. Fernandes, K., and Ciobanu, L. (2014, January 27–30). Pavement pathologies classification using graph-based features. Proceedings of the 2014 IEEE International Conference on Image Processing, Paris, France.10.1109/ICIP.2014.7025159 ↗
37. Automatic Road Crack Detection Using Random Structured Forests10.1109/TITS.2016.2552248 ↗
38. Image-based concrete crack detection in tunnels using deep fully convolutional networks10.1016/j.conbuildmat.2019.117367 ↗
39. UNet++: Redesigning Skip Connections to Exploit Multiscale Features in Image Segmentation10.1109/TMI.2019.2959609 ↗
40. Ran, R., Xu, X., Qiu, S., Cui, X., and Wu, F. (2021, January 15–17). Crack-SegNet: Surface Crack Detection in Complex Background Using Encoder-Decoder Architecture. Proceedings of the 2021 4th International Conference on Sensors, Signal and Image Processing, Nanjing, China.10.1145/3502814.3502817 ↗
41. Chen, L.C., Papandreou, G., Schroff, F., and Adam, H. (2017). Rethinking atrous convolution for semantic image segmentation. arXiv.
42. DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs10.1109/TPAMI.2017.2699184 ↗
43. Chen, L.C., Zhu, Y., Papandreou, G., Schroff, F., and Adam, H. (2018). Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation. Lect. Notes Comput. Sci., 833–851.10.1007/978-3-030-01234-2_49 ↗
44. DMA-Net: DeepLab with Multi-Scale Attention for Pavement Crack Segmentation10.1109/TITS.2022.3158670 ↗
45. Yuan, Y., Chen, X., and Wang, J. (2020, January 23–28). Object-contextual representations for semantic segmentation. Proceedings of the 16th European Conference on Computer Vision, Glasgow, UK.10.1007/978-3-030-58539-6_11 ↗
46. Zhou, T., Wang, W., Konukoglu, E., and Goo, L.V. (2022, January 19–24). Rethinking Semantic Segmentation: A Prototype View. Proceedings of the 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA.10.1109/CVPR52688.2022.00261 ↗
47. Group-Wise Learning for Weakly Supervised Semantic Segmentation10.1109/TIP.2021.3132834 ↗
48. König, J., Jenkins, M.D., Mannion, M., Barrie, P., and Morison, G. (2022). Weakly-Supervised Surface Crack Segmentation by Generating Pseudo-Labels Using Localization with a Classifier and Thresholding. IEEE Trans. Intell. Transp. Syst., 1–12.10.1109/TITS.2022.3204853 ↗
49. Dai, J., Qi, H., Xiong, Y., Li, Y., Zhang, G., Hu, H., and Wei, Y. (2017, January 22–29). Deformable convolutional networks. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.89 ↗
50. Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7–13). Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Santiago, Chile.10.1109/CVPR.2015.7298594 ↗
51. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 26–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
52. Hu, J., Shen, L., and Sun, G. (2018, January 18–22). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00745 ↗
53. Özgenel, Ç.F. Concrete Crack Segmentation Dataset, Version 1; Mendeley Data.
54. Fan, Z., Li, C., Chen, Y., Di Mascio, P., Chen, X., Zhu, G., and Loprencipe, G. (2020). Ensemble of deep convolutional neural networks for automatic pavement crack detection and measurement. Coatings, 10.10.3390/coatings10020152 ↗
55. Chen, L.C., Papandreou, G., Kokkinos, I., Murphy, K., and Yuille, A.L. (2014). Semantic image segmentation with deep convolutional nets and fully connected crfs. arXiv.