Bridging Data Distribution Gaps: Test-Time Adaptation for Enhancing Cross-Scenario Pavement Distress Detection
Source abstract
Abstract
Automatic pavement distress detection using deep learning has revolutionized maintenance efficiency, but deploying models in new, unseen scenarios presents significant challenges due to shifts in data distribution. Traditional transfer learning requires extensive labeled data from the new domain, which is both time-consuming and costly. This paper proposes a test-time adaptation (TTA) framework that addresses feature distribution biases across different scenes, including differences in background, perspective, and environmental conditions. It adapts models at inference time without requiring additional labeled data, making it a promising solution for cross-scenario applications. The framework dynamically adapts the model to these biases by generating domain-specific prior knowledge, applying perspective correction, and generating global attention maps to reduce focus on irrelevant elements. We evaluate the framework on a cross-scene dataset that includes pavement images from three countries and four perspectives. In unsupervised settings, the TTA framework improves detection accuracy by 20.6%, achieving 93.09% of the accuracy obtained through transfer learning with 10,000 labeled images. Compared to traditional transfer learning, our framework reduces the reliance on high-quality labeled data while achieving similar performance gains. Experimental results also demonstrate the framework’s adaptability across various deep learning detection models, offering a scalable solution for rapid deployment and cross-scenario application of pavement distress detection systems.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Infrastructure Maintenance and Monitoring · Geophysical Methods and Applications · Asphalt Pavement Performance Evaluation
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Logistics Engineering College, Shanghai Maritime University, Shanghai 201306, China
Transportation Infrastructure Digital Research Center, Tongji University, Shanghai 201804, China
The Key Laboratory of Road and Traffic Engineering, Ministry of Education, Tongji University, Shanghai 201804, China
Chongqing Traffic Engineering Quality Inspection Co., Ltd., Chongqing 400000, China
Funding
Young Scientists Fund of the National Natural Science Foundation of China · China Postdoctoral Science Foundation
References (34)
Show source-provided references
1. RoadID: A Dedicated Deep Convolutional Neural Network for Multipavement Distress Detection10.1061/JPEODX.0000317 ↗
2. Road Damage Detection and Classification Using Deep Neural Networks with Smartphone Images: Road Damage Detection and Classification10.1111/mice.12387 ↗
3. A Review on Automated Pavement Distress Detection Methods10.1080/23311916.2017.1374822 ↗
4. Deep Learning-Based Crack Damage Detection Using Convolutional Neural Networks: Deep Learning-Based Crack Damage Detection Using CNNs10.1111/mice.12263 ↗
5. Image Based Techniques for Crack Detection, Classification and Quantification in Asphalt Pavement: A Review10.1007/s11831-016-9194-z ↗
6. Bai, J., Li, S., Zhang, H., Huang, L., and Wang, P. (2021). Robust Target Detection and Tracking Algorithm Based on Roadside Radar and Camera. Sensors, 21.10.3390/s21041116 ↗
7. Pavement Distress Detection Using Convolutional Neural Networks with Images Captured via UAV10.1016/j.autcon.2021.103991 ↗
8. Deep Neural Networks for Asphalt Pavement Distress Detection and Condition Assessment
9. Cross-Scene Pavement Distress Detection by a Novel Transfer Learning Framework10.1111/mice.12674 ↗
10. DA-RDD: Toward Domain Adaptive Road Damage Detection Across Different Countries10.1109/TITS.2022.3221067 ↗
11. An Image-Based System for Pavement Crack Evaluation Using Transfer Learning and Wavelet Transform10.1007/s42947-020-0098-9 ↗
12. Automated Pavement Distress Detection and Deterioration Analysis Using Street View Map10.1109/ACCESS.2020.2989028 ↗
13. Pavement Distress Detection Using Street View Images Captured via Action Camera10.1109/TITS.2023.3306578 ↗
14. Arya, D., Maeda, H., Ghosh, S.K., Toshniwal, D., Mraz, A., Kashiyama, T., and Sekimoto, Y. (2020). Transfer Learning-Based Road Damage Detection for Multiple Countries. arXiv.10.1016/j.autcon.2021.103935 ↗
15. Development of a Multi-Distress Detection System for Asphalt Pavements: Transfer Learning-Based Approach10.1177/03611981211012001 ↗
16. Chen, Y., Li, W., Sakaridis, C., Dai, D., and Van Gool, L. (2018, January 18–22). Domain Adaptive Faster R-Cnn for Object Detection in the Wild. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00352 ↗
17. A Generative Adversarial Network Approach for Removing Motion Blur in the Automatic Detection of Pavement Cracks10.1111/mice.13231 ↗
18. Integrating GAN and Texture Synthesis for Enhanced Road Damage Detection10.1109/TITS.2024.3373394 ↗
19. A Semi-Supervised Learning Approach for Pixel-Level Pavement Anomaly Detection10.1109/TITS.2023.3267433 ↗
20. Generative Adversarial Network for Road Damage Detection10.1111/mice.12561 ↗
21. Salaudeen, H., and Çelebi, E. (2022). Pothole Detection Using Image Enhancement GAN and Object Detection Network. Electronics, 11.10.3390/electronics11121882 ↗
22. We Learn Better Road Pothole Detection: From Attention Aggregation to Adversarial Domain Adaptation
23. Automatic Intelligent Recognition of Pavement Distresses with Limited Dataset Using Generative Adversarial Networks10.1016/j.autcon.2022.104674 ↗
24. Li, Z., Shi, S., Schiele, B., and Dai, D. (June, January 29). Test-Time Domain Adaptation for Monocular Depth Estimation. Proceedings of the 2023 IEEE International Conference on Robotics and Automation (ICRA), London, UK.10.1109/ICRA48891.2023.10161304 ↗
25. Segu, M., Schiele, B., and Yu, F. (2023, January 1–6). Darth: Holistic Test-Time Adaptation for Multiple Object Tracking. Proceedings of the IEEE/CVF International Conference on Computer Vision, Paris, France.10.1109/ICCV51070.2023.00891 ↗
26. Ahmed, S.M., Niloy, F.F., Raychaudhuri, D.S., Oymak, S., and Roy-Chowdhury, A.K. (2024). MeTA: Multi-Source Test Time Adaptation. arXiv.
27. Jaiswal, A., Babu, A.R., Zadeh, M.Z., Banerjee, D., and Makedon, F. (2021). A Survey on Contrastive Self-Supervised Learning. Technologies, 9.10.3390/technologies9010002 ↗
28. Wang, X., Girshick, R., Gupta, A., and He, K. (2018, January 18–22). Non-Local Neural Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00813 ↗
29. Dosovitskiy, A. (2020). An Image Is Worth 16x16 Words: Transformers for Image Recognition at Scale. arXiv.
30. RDD2022-The Multi-National Road Damage Dataset Released through CRDDC’2022
31. Zhu, J.-Y., Park, T., Isola, P., and Efros, A.A. (2017, January 22–29). Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.244 ↗
32. Wang, J., Chen, Y., Yu, H., Huang, M., and Yang, Q. (2019, January 8–12). Easy Transfer Learning by Exploiting Intra-Domain Structures. Proceedings of the 2019 IEEE International Conference on Multimedia and Expo (ICME), Shanghai, China.10.1109/ICME.2019.00211 ↗
33. Li, P., and Tuzhilin, A. (2020, January 3–7). DDTCDR: Deep Dual Transfer Cross Domain Recommendation. Proceedings of the 13th International Conference on Web Search and Data Mining, Houston, TX, USA.10.1145/3336191.3371793 ↗
34. Liu, B., Yu, H., and Qi, G. (2022, January 18–24). Graftnet: Towards Domain Generalized Stereo Matching with a Broad-Spectrum and Task-Oriented Feature. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.01267 ↗