PSNet: Parallel-Convolution-Based U-Net for Crack Detection with Self-Gated Attention Block
Source abstract
Abstract
Crack detection is an important task for road maintenance. Currently, convolutional neural-network-based segmentation models with attention blocks have achieved promising results, for the reason that these models can avoid the interference of lights and shadows. However, by carefully examining the structure of these models, we found that these segmentation models usually use down-sampling operations to extract high-level features. This operation reduces the resolution of features and causes feature information loss. Thus, in our proposed method, a Parallel Convolution Module (PCM) was designed to avoid feature information loss caused by down-sampling. In addition, the attention blocks in these models only focused on selecting channel features or spatial features, without controlling feature information flow. To solve the problem, a Self-Gated Attention Block (SGAB) was used to control the feature information flow in the attention block. Therefore, based on the ideas above, a PSNet with a PCM and SGAB was proposed by us. Additionally, as there were few public datasets for detailed evaluation of our method, we collected a large dataset by ourselves, which we named the OAD_CRACK dataset. Compared with the state-of-the-art crack detection method, our proposed PSNet demonstrated competitive segmentation performance. The experimental results showed that our PSNet could achieve accuracies of 92.6%, 81.2%, 98.5%, and 76.2% against the Cracktree200, CRACK500, CFD, and OAD_CRACK datasets, respectively, which were 2.6%, 4.2%, 1.2%, and 3.3% higher than those of the traditional attention models.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Infrastructure Maintenance and Monitoring · Asphalt Pavement Performance Evaluation · Concrete Corrosion and Durability
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Electronics and Communication Engineering, Sun Yat-sen University, Guangzhou 510275, China
References (33)
Show source-provided references
1. Detection crack in image using Otsu method and multiple filtering in image processing techniques10.1016/j.ijleo.2015.09.147 ↗
2. Detection of cracks in simply-supported beams by continuous wavelet transform of reconstructed modal data10.1016/j.compstruc.2010.08.008 ↗
3. Marques, A., and Correia, P.L. (2012). Automatic Road Pavement Crack Detection Using SVM. [Master’s Thesis, Instituto Superior Técnico].
4. Attard, L., Debono, C.J., Valentino, G., Di Castro, M., Masi, A., and Scibile, L. (2019, January 23–25). Automatic crack detection using mask R-CNN. Proceedings of the 2019 11th International Symposium on Image and Signal Processing and Analysis (ISPA), Dubrovnik, Croatia.10.1109/ISPA.2019.8868619 ↗
5. A crack identification method for concrete structures using improved U-net convolutional neural networks10.1155/2021/6654996 ↗
6. Nie, M., and Wang, C. (2019, January 28–30). Pavement Crack Detection based on yolo v3. Proceedings of the 2019 2nd International Conference on Safety Produce Informatization (IICSPI), Chongqing, China.10.1109/IICSPI48186.2019.9095956 ↗
7. Improved online sequential extreme learning machine for identifying crack behavior in concrete dam10.1177/1369433218788635 ↗
8. Method of feature pyramid and attention enhancement network for pavement crack detection10.1117/1.JEI.31.3.033019 ↗
9. Li, R., Xu, K., Wu, D., and Zhu, Z. (2021, January 9–11). Pixel-level crack detection using an attention mechanism. Proceedings of the 2021 6th International Conference on Intelligent Computing and Signal Processing (ICSP), Xi’an, China.10.1109/ICSP51882.2021.9408784 ↗
10. Pavement crack detection network based on pyramid structure and attention mechanism10.1049/iet-ipr.2019.0973 ↗
11. Crack detection of concrete pavement with cross-entropy loss function and improved VGG16 network model10.1109/ACCESS.2020.2981561 ↗
12. Yu, J., Kim, D.Y., Lee, Y., and Jeon, M. (November, January 19). Unsupervised pixel-level road defect detection via adversarial image-to-frequency transform. Proceedings of the 2020 IEEE Intelligent Vehicles Symposium (IV), Las Vegas, NV, USA.10.1109/IV47402.2020.9304843 ↗
13. Deep learning-based real-time crack segmentation for pavement images10.1007/s12205-021-0474-2 ↗
14. Ramachandran, P., Zoph, B., and Le, Q.V. (2017). Swish: A self-gated activation function. arXiv.
15. Automatic road crack detection using random structured forests10.1109/TITS.2016.2552248 ↗
16. LIBSVM: A library for support vector machines10.1145/1961189.1961199 ↗
17. Long, J., Shelhamer, E., and Darrell, T. (2015, January 7–12). Fully convolutional networks for semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298965 ↗
18. Zhang, L., Yang, F., Zhang, Y.D., and Zhu, Y.J. (2016, January 25–28). Road crack detection using deep convolutional neural network. Proceedings of the 2016 IEEE International Conference on Image Processing (ICIP), Phoenix, AZ, USA.10.1109/ICIP.2016.7533052 ↗
19. Jenkins, M.D., Carr, T.A., Iglesias, M.I., Buggy, T., and Morison, G. (2018, January 3–7). A deep convolutional neural network for semantic pixel-wise segmentation of road and pavement surface cracks. Proceedings of the 2018 26th European Signal Processing Conference (EUSIPCO), Rome, Italy.
20. Nguyen NT, H., Le, T.H., Perry, S., and Nguyen, T.T. (2018, January 6–7). Pavement crack detection using convolutional neural network. Proceedings of the 9th International Symposium on Information and Communication Technology, Da Nang City, Vietnam.10.1145/3287921.3287949 ↗
21. Zhang, H., Wu, C., Zhang, Z., Zhu, Y., Lin, H., Zhang, Z., Sun, Y., He, T., Mueller, J., and Manmatha, R. (2022, January 18–24). Resnest: Split-attention networks. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPRW56347.2022.00309 ↗
22. Li, J., Liu, Y., Zhang, Y., and Zhang, Y. (2021). Cascaded attention DenseUNet (CADUNet) for road extraction from very-high-resolution images. ISPRS Int. J. Geo-Inf., 10.10.3390/ijgi10050329 ↗
23. Wang, Q., Wu, B., Zhu, P., Li, P., Zuo, W., and Hu, Q. (2020, January 13–19). ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networks. Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR42600.2020.01155 ↗
24. Self-channel-and-spatial-attention neural network for automated multi-organ segmentation on head and neck CT images10.1088/1361-6560/ab79c3 ↗
25. Yang, G., Geng, P., Ma, H., Liu, J., and Luo, J. (2021, January 16–17). DWTA-Unet: Concrete Crack Segmentation Based on Discrete Wavelet Transform and Unet. Proceedings of the 2021 Chinese Intelligent Automation Conference, Fuzhou, China.10.1007/978-981-16-6372-7_75 ↗
26. Temurtas, F., Gulbag, A., and Yumusak, N. (2004, January 14–17). A study on neural networks using taylor series expansion of sigmoid activation function. Proceedings of the Computational Science and Its Applications–ICCSA 2004: International Conference, Assisi, Italy.10.1007/978-3-540-24768-5_41 ↗
27. Lau, M.M., and Lim, K.H. (2018, January 3–6). Review of adaptive activation function in deep neural network. Proceedings of the 2018 IEEE-EMBS Conference on Biomedical Engineering and Sciences (IECBES), Sarawak, Malaysia.10.1109/IECBES.2018.8626714 ↗
28. Convergence analysis of two-layer neural networks with relu activation
29. Adaptive sigmoid-like and PReLU activation functions for all-optical perceptron10.1364/OL.422930 ↗
30. Kato, S., and Hotta, K. (2021). Mse loss with outlying label for imbalanced classification. arXiv.
31. Mannor, S., Peleg, D., and Rubinstein, R. (2005, January 7–11). The cross entropy method for classification. Proceedings of the 22nd International Conference on Machine Learning, Bonn, Germany.10.1145/1102351.1102422 ↗
32. Phan, T.H., and Yamamoto, K. (2020). Resolving class imbalance in object detection with weighted cross entropy losses. arXiv.
33. Lin, T.Y., Goyal, P., Girshick, R., He, K., and Dollár, P. (2017, January 22–29). Focal loss for dense object detection. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.324 ↗