journal article·2022-12-18Open access

Road Pavement Damage Detection Based on Local Minimum of Grayscale and Feature Fusion

Wei-Wei Jin, Guo-Hong Chen, Zhuo Chen, Yun-Lei Sun, Jie Ni, Hao Huang, Wai-Hung Ip, Kai-Leung Yung

Applied Sciences· Volume 12· Issue 24

Abstract

In this work, we propose a road pavement damage detection deep learning model based on feature points from a local minimum of grayscale. First, image blocks, consisting of the neighborhood of feature points, are cut from the image window to form an image block dataset. The image blocks are then input into a convolutional neural network (CNN) to train the model, extracting the image block features. In the testing process, the feature points as well as the image blocks are selected from a test image, and the trained CNN model can output the feature vectors for these feature image blocks. All the feature vectors will be combined to a composite feature vector as the feature descriptor of the test image. At last, the classifier of the model, constructed by a support vector machine (SVM), gives the classification as to whether the image window contains damaged areas or not. The experimental results suggest that the proposed pavement damage detection method based on feature-point image blocks and feature fusion is of high accuracy and efficiency. We believe that it has application potential in general road damage detection, and further investigation is desired in the future.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Infrastructure Maintenance and Monitoring · Asphalt Pavement Performance Evaluation · Concrete Corrosion and Durability

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Information and Electrical Engineering, Zhejiang University City College, 51 Huzhou Street, Hangzhou 310015, China

Hubei Key Lab of Ferro- & Piezoelectric Materials and Devices, Faculty of Physics and Electronic Science, Hubei University, 368 Youyi Street, Wuhan 430062, China

Key Laboratory of Wireless Sensor Network and Communication, Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, 865 Changning Road, Shanghai 200050, China

Department of Industrial and Systems Engineering, The Hong Kong Polytechnic University, Hong Kong, China

Funding

Zhejiang Provincial Natural Science Foundation

References (31)

Show source-provided references
1. Towards Energy-Efficient and Secure Data Transmission in AI-Enabled Software Defined Industrial Networks10.1109/TII.2021.3122370 ↗
2. A Trust-based Security System for Data Collection in Smart City10.1109/TII.2020.3006137 ↗
3. Trust management-based and energy efficient hierarchical routing protocol in wireless sensor networks10.1016/j.dcan.2021.03.005 ↗
4. Research progress on automatic processing technology for pavement distress
5. A framework for pavement crack detection and classification10.1088/1757-899X/800/1/012020 ↗
6. Chen, H. (2020). Deep Learning for Pavement Distress Detection. [Ph.D. Thesis, Zhejiang University of Technology].
7. A critical review and comparative study on image segmentation-based techniques for pavement crack detection10.1016/j.conbuildmat.2021.126162 ↗
8. Pavement Distress Detection Based on Artificial Population
9. Foreground-background separation technique for crack detection10.1111/mice.12428 ↗
10. Visual analysis of asphalt pavement for detection and localization of potholes10.1016/j.aei.2018.09.002 ↗
11. Pavement crack detection fused HOG and watershed algorithm of range image
12. Surface roughness prediction of machined components using gray level co-occurrence matrix and Bagging Tree10.5937/fme2002468P ↗
13. Lu, K. (2020). Advances in deep learning methods for pavement surface crack detection and identification with visible light visual images. arXiv.
14. Eisenbach, M., Stricker, R., Seichter, D., Amende, K., Debes, K., Sesselmann, M., Ebersbach, D., Stöckert, U., and Gross, H.-M. (2017, January 3). How to Get Pavement Distress Detection Ready for Deep Learning? A Systematic Approach. Proceedings of the 2017 International Joint Conference on Neural Networks, Anchorage, AK, USA.10.1109/IJCNN.2017.7966101 ↗
15. Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv.
16. Hou, Y., Dong, Y., Zhang, Y., Zhou, Z., Tong, X., Wu, Q., Qian, Z., and Li, R. (2022). The Application of a Pavement Distress Detection Method Based on FS-Net. Sustainability, 14.10.3390/su14052715 ↗
17. Ukhwah, E.N., Yuniarno, E.M., and Suprapto, Y.K. (2020, January 6). Asphalt pavement pothole detection using deep learning method based on YOLO neural network. Proceedings of the 2019 International Seminar on Intelligent Technology and Its Applications, Surabaya, Indonesia.10.1109/ISITIA.2019.8937176 ↗
18. Pavement Crack Detection Network Based on Pyramid Structure and Attention Mechanism10.1049/iet-ipr.2019.0973 ↗
19. Chen, G.-H., Ni, J., Chen, Z., Huang, H., Sun, Y.-L., Ip, W.H., and Yung, K.L. (2022). Detection of Highway Pavement Damage Based on a CNN Using Grayscale and HOG Features. Sensors, 22.10.3390/s22072455 ↗
20. An analytic framework for enhancing the performance of big heterogeneous data analysis10.1177/1847979021990523 ↗
21. Automated pavement distress detection using region based convolutional neural networks10.1080/10298436.2020.1833204 ↗
22. Pavement Crack Detection Using Progressive Curvilinear Structure Anisotropy Filtering and Adaptive Graph-Cuts10.1109/ACCESS.2020.2985216 ↗
23. Laganiére, R. (2014). OpenCV2 Computer Vision Application Programming Cookbook, Packt Publishing Ltd.. [2nd ed.].
24. Image Enhancement of Empirical Mode Decomposition Based on Local Gradient Extreme Point
25. Vincent, L. (2002, January 6). Morphological Grayscale Reconstruction: Definition, Efficient Algorithm and Applications in Image Analysis. Proceedings of the 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Champaign, IL, USA.
26. Automatic Pixel-Level crack detection and measurement using fully convolutional network10.1111/mice.12412 ↗
27. Feature pyramid and hierarchical boosting network for pavement crack detection10.1109/TITS.2019.2910595 ↗
28. CNN and HOG Dual-Path Feature Fusion for Face Expression Recognition
29. A Deeply Supervised Convolutional Neural Network for Pavement Crack Detection With Multiscale Feature Fusion10.1109/TNNLS.2021.3062070 ↗
30. Stricker, R., Eisenbach, M., Sesselmann, M., Debes, K., and Gross, H.-M. (2019, January 30). Improving Visual Road Condition Assessment by Extensive Experiments on the Extended GAPs Dataset. Proceedings of the 2019 International Joint Conference on Neural Networks, Budapest, Hungary.10.1109/IJCNN.2019.8852257 ↗
31. Real-Time Detection for Eye Closure Feature of Fatigue Driving Based on CNN and SVM