Road Crack Detection by Combining Dynamic Snake Convolution and Attention Mechanism
Source abstract
Abstract
As one of the early manifestations of road pavement structure degradation, road cracks will accelerate the deterioration of the road if not detected and repaired in time. Aiming at the problems of low recall and incomplete crack detection in current road detection, based on the U-Net network, this paper proposed an Attention-Dynamic Snake Convolution U-Net (ADSC-U-Net) network. Firstly, the dynamic snake-shaped convolution was added to the normal downsampling process to make the network adaptively focus on the slender and curved local features, which can solve the problem of low accuracy of small crack detection. Secondly, the attention mechanism was used to pay better attention to the significant features of positive samples under the condition of a large proportion gap between positive and negative samples, which solved the problem of the poor crack integrity detection effect. Finally, the dataset was expanded by random vertical and horizontal flip operations, which solved the problem of network training overfitting caused by the small-scale datasets. The experimental results showed that, when the input image had a resolution of 480 × 320, evaluation indices P, R, and F1 of ADSC-U-Net on the self-built dataset were 74.44%, 68.77%, and 69.42%, respectively. Compared to SegNet, DeepLab, and DeepCrack, the P was improved by 1.90%, 2.49%, and 11.64%, respectively; the R was improved by 8.01%, 4.70%, and 59.58%, respectively; and the comprehensive evaluation index F1 was improved by 5.73%, 4.02%, and 55.87%, respectively, which proves the effectiveness of the proposed method.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Infrastructure Maintenance and Monitoring · Asphalt Pavement Performance Evaluation · Non-Destructive Testing Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Information Engineering, Chang’an University, Xi’an 710018, China
Shandong Key Laboratory of Smart Transportation (Preparation), Jinan 250014, China
School of Electronics and Control Engineering, Chang’an University, Xi’an 710018, China
Funding
Open Project of Shandong Key Laboratory of Smart Transportation · China Postdoctoral Science Foundation · Shaanxi Transportation Scientific Research and Development Project · Key Science and Technology Project of Ministry of Transport · Key Research and Development Program of Shaanxi
References (33)
Show source-provided references
1. Joint optimization of budget allocation and maintenance planning of multi-facility transportation infrastructure systems10.1016/j.ejor.2020.05.050 ↗
2. Deep learning-based crack detection: A survey10.1007/s42947-022-00172-z ↗
3. Oliveira, H., and Correia, P.L. (2009, January 24–28). Automatic road crack segmentation using entropy and image dynamic thresholding. Proceedings of the 2009 17th European Signal Processing Conference (EUSIPCO), Glasgow, UK.
4. Sealed-crack detection algorithm using heuristic thresholding approach10.1061/(ASCE)CP.1943-5487.0000447 ↗
5. Multi-scale wavelet transform filtering of non-uniform pavement surface image background for automated pavement distress identification10.1016/j.measurement.2016.02.044 ↗
6. An Artificial Intelligence Method for Asphalt Pavement Pothole Detection Using Least Squares Support Vector Machine and Neural Network with Steerable Filter-Based Feature Extraction10.1155/2018/7419058 ↗
7. Smartphone-based pothole detection utilizing artificial neural networks10.1061/(ASCE)IS.1943-555X.0000489 ↗
8. CrackU-net: A novel deep convolutional neural network for pixelwise pavement crack detection10.1002/stc.2551 ↗
9. Research progress of surface defect detection methods based on machine vision
10. Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5–9). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the Medical image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany.10.1007/978-3-319-24574-4_28 ↗
11. Qi, Y., He, Y., Qi, X., Zhang, Y., and Yang, G. (2023, January 2–6). Dynamic snake convolution based on topological geometric constraints for tubular structure segmentation. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Paris, France.10.1109/ICCV51070.2023.00558 ↗
12. Woo, S., Park, J., Lee, J.Y., and Kweon, I.S. (2018, January 8–14). Cbam: Convolutional block attention module. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Gemany.10.1007/978-3-030-01234-2_1 ↗
13. Deep learning-based crack damage detection using convolutional neural networks10.1111/mice.12263 ↗
14. Computer vision framework for crack detection of civil infrastructure—A review10.1016/j.engappai.2022.105478 ↗
15. Review of pavement defect detection methods10.1109/ACCESS.2020.2966881 ↗
16. Deep learning-based roadway crack classification using laser-scanned range images: A comparative study on hyperparameter selection10.1016/j.autcon.2020.103171 ↗
17. Fan, R., Bocus, M.J., Zhu, Y., Jiao, J., Wang, L., Ma, F., Cheng, S., and Liu, M. (2019, January 9–12). Road crack detection using deep convolutional neural network and adaptive thresholding. Proceedings of the 2019 IEEE Intelligent Vehicles Symposium (IV), Paris, France.10.1109/IVS.2019.8814000 ↗
18. Xu, H., Su, X., Wang, Y., Cai, H., Cui, K., and Chen, X. (2019). Automatic bridge crack detection using a convolutional neural network. Appl. Sci., 9.10.3390/app9142867 ↗
19. Deep machine learning approach to develop a new asphalt pavement condition index10.1016/j.conbuildmat.2020.118513 ↗
20. Pavement distress detection using convolutional neural networks with images captured via UAV10.1016/j.autcon.2021.103991 ↗
21. Du, F.J., and Jiao, S.J. (2022). Improvement of lightweight convolutional neural network model based on YOLO algorithm and its research in pavement defect detection. Sensors, 22.10.3390/s22093537 ↗
22. Pavement crack detection and segmentation method based on improved deep learning fusion model10.1155/2020/8515213 ↗
23. Automated pavement crack detection and segmentation based on two-step convolutional neural network10.1111/mice.12622 ↗
24. Pixelwise asphalt concrete pavement crack detection via deep learning-based semantic segmentation method10.1002/stc.2974 ↗
25. CurSeg: A pavement crack detector based on a deep hierarchical feature learning segmentation framework10.1049/itr2.12173 ↗
26. CrackCLF: Automatic pavement crack detection based on closed-loop feedback10.1109/TITS.2023.3332995 ↗
27. Dai, J., Qi, H., Xiong, Y., Li, Y., Zhang, G., Hu, H., and Wei, Y. (2017, January 22–29). Deformable convolutional networks. Proceedings of the IEEE international conference on computer vision (ICCV), Venice, Italy.10.1109/ICCV.2017.89 ↗
28. Chen, Y., Dai, X., Liu, M., Chen, D., Yuan, L., and Liu, Z. (2020, January 13–16). Dynamic convolution: Attention over convolution kernels. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR42600.2020.01104 ↗
29. Zhang, L., Yang, F., Zhang, Y.D., and Zhu, Y.J. (2016, January 25–28). Road crack detection using deep convolutional neural network. Proceedings of the 2016 IEEE International Conference on Image Processing (ICIP), Phoenix, AZ, USA.10.1109/ICIP.2016.7533052 ↗
30. Automatic road crack detection using random structured forests10.1109/TITS.2016.2552248 ↗
31. Segnet: A deep convolutional encoder-decoder architecture for image segmentation10.1109/TPAMI.2016.2644615 ↗
32. Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs10.1109/TPAMI.2017.2699184 ↗
33. DeepCrack: A deep hierarchical feature learning architecture for crack segmentation10.1016/j.neucom.2019.01.036 ↗