ETAFHrNet: A Transformer-Based Multi-Scale Network for Asymmetric Pavement Crack Segmentation
Source abstract
Abstract
Accurate segmentation of pavement cracks from high-resolution remote sensing imagery plays a crucial role in automated road condition assessment and infrastructure maintenance. However, crack structures often exhibit asymmetry, irregular morphology, and multi-scale variations, posing significant challenges to conventional CNN-based methods in real-world environments. Specifically, the proposed ETAFHrNet focuses on two predominant pavement-distress morphologies—linear cracks (transverse and longitudinal) and alligator cracks—and has been empirically validated on their intersections and branching patterns over both asphalt and concrete road surfaces. In this work, we present ETAFHrNet, a novel attention-guided segmentation network designed to address the limitations of traditional architectures in detecting fine-grained and asymmetric patterns. ETAFHrNet integrates Transformer-based global attention and multi-scale hybrid feature fusion, enhancing both contextual perception and detail sensitivity. The network introduces two key modules: the Efficient Hybrid Attention Transformer (EHAT), which captures long-range dependencies, and the Cross-Scale Hybrid Attention Module (CSHAM), which adaptively fuses features across spatial resolutions. To support model training and benchmarking, we also propose QD-Crack, a high-resolution, pixel-level annotated dataset collected from real-world road inspection scenarios. Experimental results show that ETAFHrNet significantly outperforms existing methods—including U-Net, DeepLabv3+, and HRNet—in both segmentation accuracy and generalization ability. These findings demonstrate the effectiveness of interpretable, multi-scale attention architectures in complex object detection and image classification tasks, making our approach relevant for broader applications, such as autonomous driving, remote sensing, and smart infrastructure systems.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Infrastructure Maintenance and Monitoring · Asphalt Pavement Performance Evaluation · Non-Destructive Testing Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
College of Geodesy and Geomatics, Shandong University of Science and Technology, Qingdao 266590, China
Funding
National Natural Science Foundation of China · “Elite Program” Research Support Foundation
References (60)
Show source-provided references
1. CrackU-net: A Novel Deep Convolutional Neural Network for Pixelwise Pavement Crack Detection10.1002/stc.2551 ↗
2. Ragnoli, A., De Blasiis, M.R., and Di Benedetto, A. (2018). Pavement Distress Detection Methods: A Review. Infrastructures, 3.10.20944/preprints201809.0567.v1 ↗
3. Automatic Road Crack Detection and Characterization10.1109/TITS.2012.2208630 ↗
4. Nafaa, S., Essam, H., Ashour, K., Emad, D., Mohamed, R., Elhenawy, M., Ashqar, H.I., Hassan, A.A., and Alhadidi, T.I. (2024). Automated Pavement Cracks Detection and Classification Using Deep Learning. arXiv.10.1109/ICMI60790.2024.10586098 ↗
5. Mukherjee, R., Iqbal, H., Marzban, S., Badar, A., Brouns, T., Gowda, S., Arani, E., and Zonooz, B. (2021). AI Driven Road Maintenance Inspection. arXiv.
6. Real-Time High-Resolution Neural Network with Semantic Guidance for Crack Segmentation10.1016/j.autcon.2023.105112 ↗
7. DeepCrack: A Deep Hierarchical Feature Learning Architecture for Crack Segmentation10.1016/j.neucom.2019.01.036 ↗
8. Sun, K., Xiao, B., Liu, D., and Wang, J. (2019, January 15–20). Deep High-Resolution Representation Learning for Human Pose Estimation. Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.10.1109/CVPR.2019.00584 ↗
9. Yang, F., Zhang, L., Yu, S., Prokhorov, D., Mei, X., and Ling, H. (2019). Feature Pyramid and Hierarchical Boosting Network for Pavement Crack Detection. arXiv.10.1109/TITS.2019.2910595 ↗
10. Fan, R., Bocus, M.J., Zhu, Y., Jiao, J., Wang, L., Ma, F., Cheng, S., and Liu, M. (2019). Road Crack Detection Using Deep Convolutional Neural Network and Adaptive Thresholding. arXiv.10.1109/IVS.2019.8814000 ↗
11. Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation10.1007/978-3-030-01234-2_49 ↗
12. Wang, X., Girshick, R., Gupta, A., and He, K. (2018, January 18–23). Non-Local Neural Networks. Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00813 ↗
13. Hu, J., Shen, L., and Sun, G. (2018, January 18–23). Squeeze-and-Excitation Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.10.1109/CVPR.2018.00745 ↗
14. Woo, S., Park, J., Lee, J.Y., and Kweon, I.S. (2018). CBAM: Convolutional Block Attention Module. arXiv.10.1007/978-3-030-01234-2_1 ↗
15. Li, H., Xiong, P., An, J., and Wang, L. (2018). Pyramid Attention Network for Semantic Segmentation. arXiv.
16. Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2021). An Image Is Worth 16x16 Words: Transformers for Image Recognition at Scale. arXiv.
17. Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021, January 10–17). Swin Transformer: Hierarchical Vision Transformer Using Shifted Windows. Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada.10.1109/ICCV48922.2021.00986 ↗
18. Xie, E., Wang, W., Yu, Z., Anandkumar, A., Alvarez, J.M., and Luo, P. (2021). SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers. arXiv.
19. Liu, H., Miao, X., Mertz, C., Xu, C., and Kong, H. (2021, January 10–17). CrackFormer: Transformer Network for Fine-Grained Crack Detection. Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada.10.1109/ICCV48922.2021.00376 ↗
20. Fu, J., Liu, J., Tian, H., Li, Y., Bao, Y., Fang, Z., and Lu, H. (2019, January 15–20). Dual Attention Network for Scene Segmentation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.10.1109/CVPR.2019.00326 ↗
21. Zheng, S., Lu, J., Zhao, H., Zhu, X., Luo, Z., Wang, Y., Fu, Y., Feng, J., Xiang, T., and Torr, P.H. (2021, January 20–25). Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformers. Proceedings of the 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.10.1109/CVPR46437.2021.00681 ↗
22. Ding, F. (2024). Crack Detection in Infrastructure Using Transfer Learning, Spatial Attention, and Genetic Algorithm Optimization. arXiv.
23. Improved U-Net Based on Mixed Loss Function for Liver Medical Image Segmentation10.3788/LOP57.221003 ↗
24. Zhang, L., Yang, F., Daniel Zhang, Y., and Zhu, Y.J. (2016, January 25–28). Road Crack Detection Using Deep Convolutional Neural Network. Proceedings of the 2016 IEEE International Conference on Image Processing (ICIP), Phoenix, AZ, USA.10.1109/ICIP.2016.7533052 ↗
25. Zamir, S.W., Arora, A., Khan, S., Hayat, M., Khan, F.S., and Yang, M.H. (2022, January 18–24). Restormer: Efficient Transformer for High-Resolution Image Restoration. Proceedings of the 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA.10.1109/CVPR52688.2022.00564 ↗
26. Chen, C.F.R., Fan, Q., and Panda, R. (2021, January 10–17). CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classification. Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada.10.1109/ICCV48922.2021.00041 ↗
27. Tian, D., Han, Y., Liu, Y., Li, J., Zhang, P., and Liu, M. (2023). Hybrid Cross-Feature Interaction Attention Module for Object Detection in Intelligent Mobile Scenes. Remote Sens., 15.10.3390/rs15204991 ↗
28. Axial-DeepLab: Stand-Alone Axial-Attention for Panoptic Segmentation10.1007/978-3-030-58548-8_7 ↗
29. Long, J., Shelhamer, E., and Darrell, T. (2015, January 7–12). Fully Convolutional Networks for Semantic Segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.10.1109/CVPR.2015.7298965 ↗
30. Ronneberger, O., Fischer, P., and Brox, T. (2015). U-Net: Convolutional Networks for Biomedical Image Segmentation. arXiv.10.1007/978-3-319-24574-4_28 ↗
31. Zhao, H., Shi, J., Qi, X., Wang, X., and Jia, J. (2017, January 21–26). Pyramid Scene Parsing Network. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.660 ↗
32. Sun, K., Zhao, Y., Jiang, B., Cheng, T., Xiao, B., Liu, D., Mu, Y., Wang, X., Liu, W., and Wang, J. (2019). High-Resolution Representations for Labeling Pixels and Regions. arXiv.
33. Yin, Z., Liang, K., Ma, Z., and Guo, J. (2022, January 28–31). Duplex Contextual Relation Network For Polyp Segmentation. Proceedings of the 2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI), Kolkata, India.10.1109/ISBI52829.2022.9761402 ↗
34. Xu, C., Zhang, Q., Mei, L., Chang, X., Ye, Z., Wang, J., Ye, L., and Yang, W. (2023). Cross-Attention-Guided Feature Alignment Network for Road Crack Detection. ISPRS Int. J. Geo-Inf., 12.10.3390/ijgi12090382 ↗
35. Lin, H., Cheng, X., Wu, X., Yang, F., Shen, D., Wang, Z., Song, Q., and Yuan, W. (2021). CAT: Cross Attention in Vision Transformer. arXiv.10.1109/ICME52920.2022.9859720 ↗
36. A Novel Transformer-Based Network with Attention Mechanism for Automatic Pavement Crack Detection10.1016/j.conbuildmat.2023.131852 ↗
37. CrackCLF: Automatic Pavement Crack Detection Based on Closed-Loop Feedback10.1109/TITS.2023.3332995 ↗
38. Chen, L.C., Yang, Y., Wang, J., Xu, W., and Yuille, A.L. (2016, January 27–30). Attention to Scale: Scale-Aware Semantic Image Segmentation. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.396 ↗
39. Ho, J., Kalchbrenner, N., Weissenborn, D., and Salimans, T. (2019). Axial Attention in Multidimensional Transformers. arXiv.
40. EAN: Edge-Aware Network for Image Manipulation Localization10.1109/TCSVT.2024.3473933 ↗
41. Chen, J., Lu, Y., Yu, Q., Luo, X., Adeli, E., Wang, Y., Lu, L., Yuille, A.L., and Zhou, Y. (2021). TransUNet: Transformers Make Strong Encoders for Medical Image Segmentation. arXiv.
42. Guo, J., Han, K., Wu, H., Tang, Y., Chen, X., Wang, Y., and Xu, C. (2022, January 18–24). CMT: Convolutional Neural Networks Meet Vision Transformers. Proceedings of the 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA.10.1109/CVPR52688.2022.01186 ↗
43. Chen, Y., Dai, X., Chen, D., Liu, M., Dong, X., Yuan, L., and Liu, Z. (2021). Mobile-Former: Bridging MobileNet and Transformer. arXiv.10.1109/CVPR52688.2022.00520 ↗
44. Chen, Y., Dai, X., Chen, D., Liu, M., Dong, X., Yuan, L., and Liu, Z. (2022, January 18–24). Mobile-Former: Bridging MobileNet and Transformer. Proceedings of the 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA.10.1109/CVPR52688.2022.00520 ↗
45. Wu, Z., Liu, Z., Lin, J., Lin, Y., and Han, S. (2020). Lite Transformer with Long-Short Range Attention. arXiv.
46. Wang, Q., Wu, B., Zhu, P., Li, P., Zuo, W., and Hu, Q. (2020, January 13–19). ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networks. Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR42600.2020.01155 ↗
47. Zou, R., Song, C., and Zhang, Z. (2022, January 18–24). The Devil Is in the Details: Window-Based Attention for Image Compression. Proceedings of the 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA.10.1109/CVPR52688.2022.01697 ↗
48. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2017). Attention Is All You Need. arXiv.
49. Tolstikhin, I., Houlsby, N., Kolesnikov, A., Beyer, L., Zhai, X., Unterthiner, T., Yung, J., Steiner, A., Keysers, D., and Uszkoreit, J. (2021). MLP-Mixer: An All-MLP Architecture for Vision. arXiv.
50. Shao, D., Ren, L., and Ma, L. (2023). MSF-Net: A Lightweight Multi-Scale Feature Fusion Network for Skin Lesion Segmentation. Biomedicines, 11.10.3390/biomedicines11061733 ↗
51. Sample Generation of Semi-automatic Pavement Crack Labelling and Robustness in Detection of Pavement Diseases10.1049/el.2019.2692 ↗
52. Maguire, M., Dorafshan, S., and Thomas, R.J. (2018). SDNET2018: A Concrete Crack Image Dataset for Machine Learning Applications, Utah State University.
53. Zhuang, F., Qi, Z., Duan, K., Xi, D., Zhu, Y., Zhu, H., Xiong, H., and He, Q. (2019). A Comprehensive Survey on Transfer Learning. arXiv.
54. Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., Huang, Z., Karpathy, A., Khosla, A., and Bernstein, M. (2014). ImageNet Large Scale Visual Recognition Challenge. arXiv.10.1007/s11263-015-0816-y ↗
55. Loshchilov, I., and Hutter, F. (2016). SGDR: Stochastic Gradient Descent with Warm Restarts. arXiv.
56. Kingma, D.P., and Ba, J. (2017). Adam: A Method for Stochastic Optimization. arXiv.
57. Jamal, M.A., Brown, M., Yang, M.H., Wang, L., and Gong, B. (2020, January 13–19). Rethinking Class-Balanced Methods for Long-Tailed Visual Recognition From a Domain Adaptation Perspective. Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR42600.2020.00763 ↗
58. Cui, Y., Jia, M., Lin, T.Y., Song, Y., and Belongie, S. (2019, January 15–20). Class-Balanced Loss Based on Effective Number of Samples. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.10.1109/CVPR.2019.00949 ↗
59. Wu, B., Xu, C., Dai, X., Wan, A., Zhang, P., Yan, Z., Tomizuka, M., Gonzalez, J., Keutzer, K., and Vajda, P. (2020). Visual Transformers: Token-Based Image Representation and Processing for Computer Vision. arXiv.
60. Wang, Y., Liu, C., Fan, Y., Niu, C., Huang, W., Pan, Y., Li, J., Wang, Y., and Li, J. (2025). A Multi-Modal Deep Learning Solution for Precise Pneumonia Diagnosis: The PneumoFusion-Net Model. Front. Physiol., 16.10.3389/fphys.2025.1512835 ↗