journal article·2023-06-16Open access

A Highway Pavement Crack Identification Method Based on an Improved U-Net Model

Qinge Wu, Zhichao Song, Hu Chen, Yingbo Lu, Lintao Zhou

Applied Sciences· Volume 13· Issue 12

Abstract

Crack identification plays a vital role in preventive maintenance strategies during highway pavement maintenance. Therefore, accurate identification of cracks in highway pavement images is the key to highway maintenance work. In this paper, an improved U-Net network adopting multi-scale feature prediction fusion and the improved parallel attention module was put forward to better identify concrete cracks. Multiscale feature prediction fusion combines multiple U-Net features generated by intermediate layers for aggregated prediction, thus using global information from different scales. The improved parallel attention module is used to process the U-Net decoded output of multi-scale feature prediction fusion, which can give more weight to the target region in the image and further capture the global contextual information of the image to improve the recognition accuracy. Improving the bottleneck layer is used to improve the robustness of the model and prevent overfitting. Experiments show that the improved U-Net network in this paper has a significant improvement over the original U-Net network. The performance of the proposed method in this paper was investigated on two publicly available datasets (Crack500 and CFD) and compared with competing methods proposed in the literature. Using the Crack500 dataset, the method in this paper achieved the highest score in precision (89.60%), recall (95.83%), mIOU (83.80%), and F1-score (92.61%). Similarly, for the CFD dataset, the method in this paper achieved high values for precision (93.29%), mIOU (82.07%), recall (86.26%), and F1-score (89.64%). Thus, the method has several advantages for identifying cracks in highway pavements and is an ideal tool for practical work. In future work, identifying more crack types and model light-weighting are the key objectives. Meanwhile, this paper provides a new idea for road crack identification.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Infrastructure Maintenance and Monitoring · Asphalt Pavement Performance Evaluation · Concrete Corrosion and Durability

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Electrical and Information Engineering, Zhengzhou University of Light Industry, Zhengzhou 450002, China

Funding

Key Science and Technology Program of Henan Province · Key Science and Technology Project of Henan Province University

References (45)

Show source-provided references
1. A Deep Learning Method for Pavement Crack Identification Based on Limited Field Images10.1109/TITS.2022.3160524 ↗
2. A new image processing strategy for surface crack identification in building structures under non-uniform illumination10.1049/ipr2.12357 ↗
3. Wang, D., Liu, Z., Gu, X., Wu, W., Chen, Y., and Wang, L. (2022). Automatic detection of pothole distress in asphalt pavement using improved convolutional neural networks. Remote Sens., 14.10.3390/rs14163892 ↗
4. Xiao, Y., and Li, J. (2018, January 25–27). Crack detection algorithm based on the fusion of percolation theory and adaptive canny operator. Proceedings of the 2018 37th Chinese Control Conference (CCC), Wuhan, China.10.23919/ChiCC.2018.8482676 ↗
5. Image Based Techniques for Crack Detection, Classification and Quantification in Asphalt Pavement: A Review10.1007/s11831-016-9194-z ↗
6. Arya, D., Ghosh, S.K., and Toshniwal, D. (2021, January 14–17). Automatic Recognition of Road Cracks Using Sobel Components in Digital Images. Proceedings of the Sixth International Conference of Transportation Research Group of India: CTRG 2021, Singapore.10.1007/978-981-19-3505-3_11 ↗
7. A triple-thresholds pavement crack detection method leveraging random structured forest10.1016/j.conbuildmat.2020.120080 ↗
8. A critical review and comparative study on image segmentation-based techniques for pavement crack detection10.1016/j.conbuildmat.2021.126162 ↗
9. Automated crack segmentation via saturation channel thresholding, area classification and fusion of modified level set segmentation with Canny edge detection10.1016/j.heliyon.2020.e05748 ↗
10. Crack detection near the ends of a beam using wavelet transform and high resolution beam deflection measurement10.1016/j.euromechsol.2021.104259 ↗
11. Detection and quantification of damage in bridges using a hybrid algorithm with spatial filters under environmental and operational variability10.1016/j.istruc.2021.03.031 ↗
12. Multiple Crack Detection using Wavelet Transforms and Energy Signal Techniques10.3221/IGF-ESIS.52.21 ↗
13. Concrete Cracks Detection Using Convolutional NeuralNetwork Based on Transfer Learning
14. Automatic Pixel-Level Crack Detection for Civil Infrastructure Using Unet++ and Deep Transfer Learning10.1109/JSEN.2021.3089718 ↗
15. Nie, M., and Wang, K. (2018, January 10–12). Pavement distress detection based on transfer learning. Proceedings of the 2018 5th International conference on systems and informatics (ICSAI), Nanjing, China.10.1109/ICSAI.2018.8599473 ↗
16. Novel Machine Learning Model with Wrapper-Based Dimensionality Reduction for Pre-dicting Chronic Kidney Disease Risk
17. A novel machine learning model to predict the staying time of international migrants10.1142/S0218213021500020 ↗
18. Machine Learning Techniques for Human Age and Gender Identification Based on Teeth X-Ray Images10.1155/2022/8302674 ↗
19. A New GAN-Based Approach to Data Augmentation and Image Segmentation for Crack Detection in Thermal Imaging Tests10.1007/s12559-021-09922-w ↗
20. CrackGAN: Pavement crack detection using partially accurate ground truths based on gen-erative adversarial learning10.1109/TITS.2020.2990703 ↗
21. Ahmed, T.U., Hossain, M.S., Alam, M.J., and Andersson, K. (2019, January 18–20). An integrated CNN-RNN framework to assess road crack. Proceedings of the 2019 22nd International Conference on Computer and Information Technology (ICCIT), Dhaka, Bangladesh.10.1109/ICCIT48885.2019.9038607 ↗
22. Convolution neural network model with improved pooling strategy and feature selection for weld defect recognition10.1007/s40194-020-01027-6 ↗
23. Automatic pixel-level detection of vertical cracks in asphalt pavement based on GPR investigation and improved mask R-CNN10.1016/j.autcon.2022.104689 ↗
24. Unified Approach to Pavement Crack and Sealed Crack Detection Using Preclassification Based on Transfer Learning10.1061/(ASCE)CP.1943-5487.0000736 ↗
25. A novel U-shaped encoder–decoder network with attention mechanism for detection and evaluation of road cracks at pixel level10.1111/mice.12826 ↗
26. RAO-UNet: A residual attention and octave UNet for road crack detection via balance loss10.1049/itr2.12146 ↗
27. DMA-Net: DeepLab with Multi-Scale Attention for Pavement Crack Segmentation10.1109/TITS.2022.3158670 ↗
28. Fan, Z., Lin, H., Li, C., Su, J., Bruno, S., and Loprencipe, G. (2022). Use of Parallel ResNet for High-Performance Pavement Crack Detection and Measurement. Sustainability, 14.10.3390/su14031825 ↗
29. Feature Pyramid and Hierarchical Boosting Network for Pavement Crack Detection10.1109/TITS.2019.2910595 ↗
30. CrackU-net: A novel deep convolutional neural network for pixelwise pavement crack detection10.1002/stc.2551 ↗
31. Image-based concrete crack detection in tunnels using deep fully convolutional networks10.1016/j.conbuildmat.2019.117367 ↗
32. A real-time crack detection algorithm for pavement based on CNN with multiple feature layers10.1080/14680629.2021.1925578 ↗
33. Computer vision-based concrete crack detection using U-net fully convolutional networks10.1016/j.autcon.2019.04.005 ↗
34. Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5–9). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the Medical Image Computing and Computer-Assisted Intervention—MICCAI 2015: 18th International Conference, Munich, Germany. Proceedings, Part III 18.
35. AGCNN: Adaptive Gabor Convolutional Neural Networks with Receptive Fields for Vein Biometric Recognition10.1002/cpe.5697 ↗
36. MUFFIN: Multi-scale feature fusion for drug–drug interaction prediction10.1093/bioinformatics/btab169 ↗
37. FU-Net: Fast biomedical image segmentation model based on bottleneck convolution layers10.1007/s00530-020-00726-w ↗
38. Benz, P., Zhang, C., Karjauv, A., and Kweon, I.S. (2021, January 3–8). Revisiting batch normalization for improving corruption robustness. Proceedings of the IEEE/CVF winter conference on applications of computer vision, Waikoloa, HI, USA.10.1109/WACV48630.2021.00054 ↗
39. Fan, X., Zhang, S., Tanwisuth, K., Qian, X., and Zhou, M. (2021). Contextual dropout: An efficient sample-dependent dropout module. arXiv.
40. Fu, J., Liu, J., Tian, H., Li, Y., Bao, Y., Fang, Z., and Lu, H. (2019, January 15-20). Dual attention network for scene segmentation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00326 ↗
41. Chao, X., Hu, X., Feng, J., Zhang, Z., Wang, M., and He, D. (2021). Construction of Apple Leaf Diseases Identification Networks Based on Xception Fused by SE Module. Appl. Sci., 11.10.3390/app11104614 ↗
42. Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv.
43. Pavement crack detection and recognition using the architecture of segNet
44. Pixel-Level Recognition of Pavement Distresses Based on U-Net10.1155/2021/5460844 ↗
45. Wen, Z., Wang, H., Yuan, H., Liu, M., and Guo, X. (2019, January 16–18). A method of pulmonary embolism segmentation from CTPA images based on U-net. Proceedings of the 2019 IEEE 2nd International Conference on Computer and Communication Engineering Technology (CCET), Beijing, China.10.1109/CCET48361.2019.8989357 ↗