journal article·2024-12-31

Enhanced pavement crack segmentation with minimal labeled data: a triplet attention teacher-student framework

Mohammed Ameen Mohammed, Zheng Han, Yange Li, Zaid Al-Huda, Weidong Wang

Publisher page

Abstract

Effective crack detection is critical for pavement maintenance, yet existing methods face significant challenges. Deep learning has become a popular solution due to its superior accuracy and automation capabilities, but supervised methods require extensive labelled data, making it costly and time-intensive. Unsupervised methods, while less data-reliant, struggle with feature extraction, especially for indistinct crack edges. Semi-supervised methods attempt to bridge this gap by using minimal labelled data, enhancing accuracy while reducing manual labelling efforts. However, accurate segmentation remains difficult, particularly with sparse labelled data or complex crack patterns. These limitations highlight the need for a more effective approach. To address these challenges, we propose a novel framework based on a teacher-student model enhanced with triplet attention. Leveraging the Unet architecture, this approach enables efficient feature extraction with minimal labelled data. The teacher model refines predictions using an exponential moving average of the student model’s weights, while the student model is trained with supervised and uncertainty losses. Evaluations on three benchmark datasets demonstrate our framework outperforms fully supervised models, achieving higher intersection-over-union and dice scores with just 2% labelled data. This approach overcomes the limitations of existing methods, enabling accurate crack segmentation with minimal labelled data.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Infrastructure Maintenance and Monitoring · Asphalt Pavement Performance Evaluation · Concrete Corrosion and Durability

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Civil Engineering, Central South University, Changsha, People’s Republic of China

Hunan Provincial Key Laboratory for Disaster Prevention and Mitigation of Rail Transit Engineering Structures, Changsha, People’s Republic of China

Ministry of Education, The Key Laboratory of Engineering Structures of Heavy Haul Railway, Changsha, People’s Republic of China

Stirling College, Chengdu University, Chengdu, People’s Republic of China

Funding

National Key Research and Development Program of Chiname of China · Natural Science Foundation of Hunan Province · National Natural Science Foundation of China · Science and Technology Plan Project of Changsha · Innovation Provincial Program of Hunan Provinceme of Hunan Province · Natural Science Foundation for Excellent Young Scholars of Hunan

References (47)

Show source-provided references
1. 10.1016/j.autcon.2023.10513810.1016/j.autcon.2023.105138 ↗
2. 10.1016/j.engappai.2023.10614210.1016/j.engappai.2023.106142 ↗
3. Ali, R., and Cha, Y.J, 2022. Attention-based generative adversarial network with internal damage segmentation using thermography. Automation in Construction, 141, 104412.
4. 10.1061/(ASCE)CP.1943-5487.000085410.1061/(ASCE)CP.1943-5487.0000854 ↗
5. 10.1016/j.autcon.2023.10518110.1016/j.autcon.2023.105181 ↗
6. 10.1109/ICASSP49357.2023.1009472510.1109/ICASSP49357.2023.10094725 ↗
7. 10.1016/j.conbuildmat.2024.13515110.1016/j.conbuildmat.2024.135151 ↗
8. 10.1007/s11760-021-02123-w10.1007/s11760-021-02123-w ↗
9. Chow, J.K., et al., 2020. Anomaly detection of defects on concrete structures with the convolutional autoencoder. Advanced Engineering Informatics, 45, 101105.
10. 10.1609/aaai.v37i6.2589010.1609/aaai.v37i6.25890 ↗
11. 10.1016/j.autcon.2021.10360610.1016/j.autcon.2021.103606 ↗
12. 10.1016/j.asoc.2018.05.01810.1016/j.asoc.2018.05.018 ↗
13. Guo, F., et al., 2023a. A novel transformer-based network with attention mechanism for automatic pavement crack detection. Construction and Building Materials, 391, 131852.
14. 10.1111/mice.1299810.1111/mice.12998 ↗
15. 10.1111/mice.1259310.1111/mice.12593 ↗
16. 10.1007/s40996-021-00668-x10.1007/s40996-021-00668-x ↗
17. 10.1061/(ASCE)CP.1943-5487.000091810.1061/(ASCE)CP.1943-5487.0000918 ↗
18. Ji, A., et al., 2020. An integrated approach to automatic pixel-level crack detection and quantification of asphalt pavement. Automation in Construction, 114, 103176.
19. Jiang, Y., et al., 2022. Two-step deep learning approach for pavement crack damage detection and segmentation. International Journal of Pavement Engineering, 24, 2.
20. 10.1016/j.jag.2022.10268510.1016/j.jag.2022.102685 ↗
21. 10.1007/978-3-030-76004-5_1410.1007/978-3-030-76004-5_14 ↗
22. 10.1177/1475921721105377610.1177/14759217211053776 ↗
23. Kendall A. and Gal Y. 2017. What uncertainties do we need in Bayesian deep learning for computer vision? In: Advances in neural information processing systems.
24. Li, G., et al., 2020. Semi-supervised semantic segmentation using adversarial learning for pavement crack detection. IEEE Access, 8, 51446–51459.
25. Liu, Y., et al., 2019a. Deepcrack: A deep hierarchical feature learning architecture for crack segmentation. Neurocomputing, 338, 139–153.
26. Liu, Z., et al., 2019b. Computer vision-based concrete crack detection using U-net fully convolutional networks. Automation in Construction, 104, 129–139.
27. 10.1080/14680629.2023.226685310.1080/14680629.2023.2266853 ↗
28. Liu, F., and Wang, L, 2022. UNet-based model for crack detection integrating visual explanations. Construction and Building Materials, 322, 126265.
29. Mohammed, M.A., et al., 2022. End-to-end semi-supervised deep learning model for surface crack detection of infrastructures. Frontiers in Materials, 9, 1058407.10.3389/fmats.2022.1058407 ↗
30. 10.1155/2021/992370410.1155/2021/9923704 ↗
31. 10.1007/s10462-023-10395-610.1007/s10462-023-10395-6 ↗
32. Pan, Y., Zhang, G., and Zhang, L, 2020. A spatial-channel hierarchical deep learning network for pixel-level automated crack detection. Automation in Construction, 119, 103357.
33. 10.1016/j.conbuildmat.2020.12008010.1016/j.conbuildmat.2020.120080 ↗
34. 10.1007/978-3-319-24574-4_2810.1007/978-3-319-24574-4_28 ↗
35. 10.1109/TITS.2016.255224810.1109/TITS.2016.2552248 ↗
36. Shim, S., et al., 2020. Multiscale and adversarial learning-based semi-supervised semantic segmentation approach for crack detection in concrete structures. IEEE Access, 8, 170939–170950.10.1109/ACCESS.2020.3022786 ↗
37. 10.1186/s12859-018-2195-110.1186/s12859-018-2195-1 ↗
38. Tran, T.S., et al., 2023. Advanced crack detection and segmentation on bridge decks using deep learning. Construction and Building Materials, 400, 132839.
39. 10.1016/j.compind.2021.10354510.1016/j.compind.2021.103545 ↗
40. Wang, W., and Su, C, 2021. Semi-supervised semantic segmentation network for surface crack detection. Automation in Construction, 128, 103786.10.1016/j.autcon.2021.103786 ↗
41. 10.1016/j.autcon.2023.10493910.1016/j.autcon.2023.104939 ↗
42. 10.1080/10298436.2021.198549110.1080/10298436.2021.1985491 ↗
43. 10.1111/mice.1241210.1111/mice.12412 ↗
44. 10.1109/TITS.2019.291059510.1109/TITS.2019.2910595 ↗
45. Yang, X., et al., 2021. Pixel-level automatic annotation for forest fire image. Engineering Applications of Artificial Intelligence, 104, 104353.10.1016/j.engappai.2021.104353 ↗
46. 10.1080/10298436.2022.208669210.1080/10298436.2022.2086692 ↗
47. 10.1016/j.autcon.2021.10376410.1016/j.autcon.2021.103764 ↗