journal article·2025-05-29Open access

A Review on Automated Detection and Identification Algorithms for Highway Pavement Distress

Zhenglong Lv, Zhexin Hao, Yuhan Zhu, Cong Lu

Applied Sciences· Volume 15· Issue 11

Abstract

The global expansion of road networks and the aging of infrastructure have intensified the need for efficient pavement distress detection technologies to ensure road safety and sustainability. While traditional manual inspections are time consuming and labor-intensive, recent advances in automated systems have improved detection precision. However, challenges persist, including limited accuracy, poor generalization across datasets, and high computational demands for pixel-level segmentation. This review systematically examines the evolution of pavement distress detection, covering three key phases: manual inspection, semi-automated systems, and non-destructive automated methods. We analyze advancements in image acquisition (e.g., 2D to 3D, ground to aerial platforms) and processing techniques (e.g., threshold-based segmentation to deep learning), highlighting critical trade-offs between speed, accuracy, and scalability. Our findings reveal that, while modern systems excel in controlled environments, their real-world performance remains inconsistent due to varying imaging conditions and underrepresented distress types. To address these gaps, we propose four future directions: (1) enhancing environmental adaptability through multi-sensor datasets, (2) optimizing datasets via self-supervised learning, (3) deploying lightweight models on edge devices for real-time analysis, and (4) integrating predictive maintenance frameworks. These strategies aim to shift pavement management from reactive repairs to proactive, data-driven decision making, ultimately supporting smarter infrastructure systems.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Infrastructure Maintenance and Monitoring · Asphalt Pavement Performance Evaluation · Water Systems and Optimization

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

JSTI Group, Nanjing 211100, China

School of Civil Engineering, Southeast University, Nanjing 211100, China

Funding

Jiangsu Science and Technology Department Projects · ongoing research projects of JSTI Group

References (88)

Show source-provided references
1. Review of pavement detection technology
2. Lu, J. (2007). Application of Image Systemforroad Pavement Distress Test. [Master’s Thesis, Southeast University]. (In Chinese).
3. Development summary of international pavement surface distress automatic survey system
4. Technical exploration of automatic acquisition and processing equipment for road damage images
5. Xu, Z.G. (2018). Automatic Recognition Technology for Road Surface Damage Images, Xidian University Press. (In Chinese).
6. Laurent, J., Talbot, M., and Doucet, M. (1997, January 12–15). Road Surface Inspection Using Laser Scanners Adapted for the High Precision 3D Measurements of Large Flat Surfaces. Proceedings of the International Conference on Recent Advances in 3-D Digital Imaging and Modeling, Ottawa, ON, Canada.
7. Themistocleous, K., Neocleous, K., Pilakoutas, K., and Hadjimitsis, D.G. (2014, January 7–10). Damage Assessment using Advanced Non-Intrusive Inspection Methods: Integration of Space, UAV, GPR, and field spectroscopy. Proceedings of the Second International Conference On Remote Sensing And Geoinformation of the Environment (RSCy2014), Paphos, Cyprus.10.1117/12.2069507 ↗
8. Object-based and supervised detection of potholes and cracks from the pavement images acquired by UAV10.5194/isprs-archives-XLII-4-W4-209-2017 ↗
9. Detection of asphalt pavement potholes and cracks based on the unmanned aerial vehicle multispectral imagery10.1109/JSTARS.2018.2865528 ↗
10. Monitoring asphalt pavement aging and damage conditions from low-altitude UAV imagery based on a CNN approach10.1080/07038992.2020.1870217 ↗
11. Highway Crack Segmentation from Unmanned Aerial Vehicle Images Using Deep Learning10.1109/LGRS.2022.3214929 ↗
12. Pavement distress detection using convolutional neural networks with images captured via UAV10.1016/j.autcon.2021.103991 ↗
13. Road damage detection using UAV images based on multi-level attention mechanism10.1016/j.autcon.2022.104613 ↗
14. Automated road damage detection using UAV images and deep learning techniques10.1109/ACCESS.2023.3287770 ↗
15. Pixel-level road crack detection in UAV remote sensing images based on ARD-Unet10.1016/j.measurement.2023.113252 ↗
16. An automated road roughness detection from mobile laser scanning data10.5194/isprs-archives-XLII-1-W1-91-2017 ↗
17. MTD measurement of asphalt pavement based on high precision laser section elevation
18. Tan, M. (2012). Research on Detection and Reconstruction of Road Surface Based-on Lynx Vehicle-Borne Laser Point Cloud. [Master’s Thesis, Central South University]. (In Chinese).
19. A Low-Cost Multi-sensor Deep Learning System for Pavement Distress Detection and Severity Classification10.1007/978-3-031-03918-8_3 ↗
20. Pavement surface distress detection in complex scenarios driven by multi-dimensional image fusion
21. Development of a car-free street mapping model using an integrated system with unmanned aerial vehicles, aerial mapping cameras, and a deep learning algorithm10.1061/(ASCE)CP.1943-5487.0001013 ↗
22. HighRPD: A high-altitude drone dataset of road pavement distress10.1016/j.dib.2025.111377 ↗
23. Chu, Y.L. (2008). Automatic Pavement Crack Identification Systemresearch Based on Digital Image Processing. [Master’s Thesis, Chang’an University]. (In Chinese).
24. A threshold selection method from gray-level histograms10.1109/TSMC.1979.4310076 ↗
25. Li, P., Wang, C., Li, S.M., and Feng, B.C. (2015, January 18–20). Research on Crack Detection Method of Airport Runway Based on Twice-Threshold Segmentation. Proceedings of the 2015 Fifth International Conference on Instrumentation and Measurement, Computer, Communication and Control (IMCCC), Qinhuangdao, China.
26. Tang, J.S., and Gu, Y.L. (2013, January 13–16). Automatic Crack Detection and Segmentation Using a Hybrid Algorithm for Road Distress Analysis. Proceedings of the 2013 IEEE International Conference on Systems, Man, and Cybernetics, Manchester, UK.10.1109/SMC.2013.516 ↗
27. Liu, F.F., Xu, G.A., Yang, Y.X., Niu, X.X., and Pan, Y.L. (2008, January 21–22). Novel Approach to Pavement Cracking Automatic Detection Based on Segment Extending. Proceedings of the 2008 International Symposium on Knowledge Acquisition and Modeling, Wuhan, China.10.1109/KAM.2008.29 ↗
28. Song, M.P., Cui, D.Q., Yu, C.Y., An, J.B., Chang, C.I., and Song, M.P. (2018, January 27–29). Crack Detection Algorithm for Photovoltaic Image Based on Multi-Scale Pyramid and Improved Region Growing. Proceedings of the 2018 IEEE 3rd International Conference on Image, Vision and Computing (ICIVC), Chongqing, China.10.1109/ICIVC.2018.8492810 ↗
29. Hu, F. (2013). The Digital Image Identification System of Highway Pavement Disease Application Research. [Master’s Thesis, Chongqing Jiaotong University]. (In Chinese).
30. Cracktree: Automatic crack detection from pavement images10.1016/j.patrec.2011.11.004 ↗
31. Automatic road defect detection by textural pattern recognition based on Adaboost10.1111/j.1467-8667.2011.00736.x ↗
32. Automatic road crack detection using random structured forests10.1109/TITS.2016.2552248 ↗
33. Automated crack detection on concrete bridges10.1109/TASE.2014.2354314 ↗
34. Image processing-based classification of asphalt pavement cracks using support vector machine optimized by artificial bee colony10.1061/(ASCE)CP.1943-5487.0000781 ↗
35. A novel method for asphalt pavement crack classification based on image processing and machine learning10.1007/s00366-018-0611-9 ↗
36. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Łukasz, and Polosukhin, I. (2017, January 4–9). Attention is All You Need. Proceedings of the Advances in Neural Information Processing Systems, Long Beach, CA, USA.
37. Wang, W.H., Xie, E.Z., Li, X., Fan, D.P., Song, K.T., Liang, D., Lu, T., Luo, P., and Shao, L. (2021, January 11–17). Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutions. Proceedings of the IEEE International Conference on Computer Vision, Montreal, QC, Canada.10.1109/ICCV48922.2021.00061 ↗
38. Wang, N.N., Shang, L.H., and Song, X.T. (2023). A Transformer-Optimized Deep Learning Network for Road Damage Detection and Tracking. Sensors, 23.10.3390/s23177395 ↗
39. Zhang, L., Yang, F., Daniel Zhang, Y., and Zhu, Y.J. (2016, January 25–28). Road Crack Detection Using Deep Convolutional Neural Network. Proceedings of the 23rd IEEE International Conference on Image Processing (ICIP), Phoenix, AZ, USA.10.1109/ICIP.2016.7533052 ↗
40. Automatic classification of pavement crack using deep convolutional neural network10.1080/10298436.2018.1485917 ↗
41. Convolutional neural network for pothole detection in asphalt pavement10.1080/14680629.2019.1615533 ↗
42. Satheesan, D., Talib, M., Li, S.N., and Yuan, A. (2024, January 10–13). An Automated Method for Pavement Surface Distress Evaluation. Proceedings of the International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences—ISPRS Archives, Halifax, NS, Canada.
43. LiDAR-based automatic pavement distress detection and management using deep learning and BIM10.1061/JCEMD4.COENG-14358 ↗
44. Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23–28). Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.10.1109/CVPR.2014.81 ↗
45. Girshick, R. (2015, January 17). Fast R-CNN. Proceedings of the IEEE International Conference on Computer Vision, Volume 2015 International Conference on Computer Vision (ICCV 2015), Santiago, Chile.10.1109/ICCV.2015.169 ↗
46. Faster R-CNN: Towards real-time object detection with region proposal networks10.1109/TPAMI.2016.2577031 ↗
48. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., and Berg, A.C. (2016, January 8–16). SSD: Single Shot Multibox Detector. Proceedings of the 14th European Conference on Computer Vision (ECCV), Amsterdam, The Netherlands.10.1007/978-3-319-46448-0_2 ↗
49. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (July, January 26). You Only Look Once: Unified, Real-Time Object Detection. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.91 ↗
50. Pradhan, S., Kulkarni, S., Ponnalagu, R.N., and Ranjan Gupta, R. (2023, January 14–17). Performance Evaluation of Yolov5s and Faster RCNN Models in Detection of Potholes from Road Surface Images. Proceedings of the 2023 IEEE 20th India Council International Conference (INDICON), Hyderabad, India.10.1109/INDICON59947.2023.10440881 ↗
51. Li, J.Q., Zhang, X.F., and Li, H.W. (2019, January 4–7). Method for Detecting Road Pavement Damage Based on Deep Learning. Proceedings of the International Society for Optical Engineering (SPIE), Denver, CO, USA.10.1117/12.2514437 ↗
52. Li, H.D. (2019). Research on Pavement Distresses Location and Measurement Under the Heavy Traffic Using Deep Learning & UAV. [Master’s Thesis, Chang’an University]. (In Chinese).
53. Automatic road crack detection and classification using multi-tasking Faster RCNN
54. Gou, C., Peng, B., Li, T.R., and Gao, Z.P. (2019, January 14–16). Pavement Crack Detection Based on the Improved Faster-RCNN. Proceedings of the 2019 IEEE 14th International Conference on Intelligent Systems and Knowledge Engineering (ISKE), Dalian, China.10.1109/ISKE47853.2019.9170456 ↗
55. Hassan, S.A., Han, S.H., and Shin, S.Y. (September, January 30). Real-Time Road Cracks Detection Based on Improved Deep Convolutional Neural Network. Proceedings of the 2020 IEEE Canadian Conference on Electrical and Computer Engineering (CCECE), London, ON, Canada.10.1109/CCECE47787.2020.9255771 ↗
56. Chen, Z.H., Wang, D.H., Wang, Y.Z., Lin, S.Y., Jia, H.R., Lin, P.X., Liu, Y.X., and Chen, L. (2023, January 16–18). Research and Implementation of Road Damage Detection Algorithm Based on Object Detection Network. Proceedings of the 2023 4th International Seminar on Artificial Intelligence, Networking and Information Technology (AINIT), Nanjing, China.10.1109/AINIT59027.2023.10212930 ↗
57. Wu, C.G., Ye, M., Zhang, J.L., and Ma, Y.C. (2023). YOLO-LWnet: A lightweight road damage object detection network for mobile terminal devices. Sensors, 23.10.3390/s23063268 ↗
58. Sami, A.A., Sakib, S., Deb, K., and Sarker, I.H. (2023). Improved YOLOv5-based real-time road pavement damage detection in road infrastructure management. Algorithms, 16.10.3390/a16090452 ↗
59. Mothilall, D., and Zyl, T.V. (2024, January 1–2). Improving Road Damage Maintenance in South Africa Using Deep Learning. Proceedings of the 2024 International Conference on Artificial Intelligence, Computer, Data Sciences and Applications (ACDSA), Victoria, Seychelles.10.1109/ACDSA59508.2024.10467363 ↗
60. OBC-YOLOv8: An improved road damage detection model based on YOLOv810.7717/peerj-cs.2593 ↗
61. Road damage detection and classification using deep neural networks with smartphone images10.1111/mice.12387 ↗
62. Andika, F., and Bandung, Y. (2023, January 16). Road Damage Classification Using SSD Mobilenet with Image Enhancement. Proceedings of the 2023 International Conference on Computer Science, Information Technology and Engineering (ICCoSITE), Jakarta, Indonesia.10.1109/ICCoSITE57641.2023.10127763 ↗
63. Li, S., and Huang, Y. (2023, January 18–20). Damage Detection Algorithm Based on Faster-RCNN. Proceedings of the 2023 5th International Conference on Electronics and Communication, Network and Computer Technology (ECNCT), Guangzhou, China.10.1109/ECNCT59757.2023.10280967 ↗
64. A hybrid approach for pavement crack detection using mask R-CNN and vision transformer model
65. Deepcrack: Learning hierarchical convolutional features for crack detection10.1109/TIP.2018.2878966 ↗
66. Cheng, J.R., Xiong, W., Chen, W.Y., Gu, Y., and Li, Y.S. (2018, January 28–31). Pixel-Level Crack Detection using U-Net. Proceedings of the IEEE Region 10 Annual International Conference, Jeju, Republic of Korea.10.1109/TENCON.2018.8650059 ↗
67. Pavement crack detection and segmentation method based on improved deep learning fusion model10.1155/2020/8515213 ↗
68. Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5–9). U-net: Convolutional Networks for Biomedical Image Segmentation. Proceedings of the Lecture Notes in Computer Science, Munich, Germany.10.1007/978-3-319-24574-4_28 ↗
69. SegNet: A deep convolutional encoder-decoder architecture for image segmentation10.1109/TPAMI.2016.2644615 ↗
70. Automated pixel-level pavement distress detection based on stereo vision and deep learning10.1016/j.autcon.2021.103788 ↗
71. Intelligent segmentation and measurement model for asphalt road cracks based on modified mask R-CNN algorithm
72. Pixel-level intelligent segmentation and measurement method for pavement multiple damages based on mobile deep learning10.1109/ACCESS.2021.3121413 ↗
73. Weakly supervised pavement crack semantic segmentation based on multi-scale object localization and incremental annotation refinement10.1007/s10489-022-04212-w ↗
74. Pavement crack measurement based on aerial 3d reconstruction and learning-based segmentation method10.1088/1361-6501/ac8e22 ↗
75. Yu, G., Dong, J.M., Wang, Y.H., and Zhou, X.L. (2023). RUC-Net: A residual-Unet-based convolutional neural network for pixel-level pavement crack segmentation. Sensors, 23.10.3390/s23010053 ↗
76. Automatic Pixel-level pavement sealed crack detection using Multi-fusion U-Net network10.1016/j.measurement.2023.112475 ↗
77. A novel real-time pixel-level road crack segmentation network10.1007/s11554-024-01458-0 ↗
78. Road surface damage detection based on hierarchical architecture using lightweight auto-encoder network10.1016/j.autcon.2021.103833 ↗
79. CrackHAM: A novel automatic crack detection network based on U-Net for asphalt pavement10.1109/ACCESS.2024.3353729 ↗
80. Zim, A.H., Iqbal, A., Al-Huda, Z., Malik, A., and Kuribayashi, M. (March, January 28). EfficientCrackNet: A Lightweight Model for Crack Segmentation. Proceedings of the 2025 IEEE Winter Conference on Applications of Computer Vision(WACV), Tucson, AZ, USA.10.1109/WACV61041.2025.00612 ↗
81. Deepcrack: A deep hierarchical feature learning architecture for crack segmentation10.1016/j.neucom.2019.01.036 ↗
82. CrackGAN: Pavement crack detection using partially accurate ground truths based on generative adversarial learning10.1109/TITS.2020.2990703 ↗
83. Highly accurate and automatic semantic segmentation of multiple cracks in engineered cementitious composites (ECC) under dual pre-modification deep-learning strategy10.1016/j.cemconres.2022.107066 ↗
84. 3D crack recognition in Engineered Cementitious Composites (ECC) based on super-resolution reconstruction and semantic segmentation of X-ray Computed Microtomography10.1016/j.compositesb.2024.111730 ↗
85. (2018). Highway Performance Assessment Standard (Standard No. JTG 5210-2018). (In Chinese).
86. Road dynamic target recognition using a low-cost millimeter wave radar10.1088/1361-6501/adb63f ↗
87. Context Autoencoder for Self-supervised Representation Learning10.1007/s11263-023-01852-4 ↗
88. Application of pavement disease detection based on Jetson TX2