journal article·2024-07Open access

Research on lightweight GPR road surface disease image recognition and data expansion algorithm based on YOLO and GAN

Chen Liu, Yongsheng Yao, Jue Li, Junfeng Qian, Lihao Liu

Abstract

The aim of this paper is to improve the accuracy and efficiency of ground penetrating Radar (GPR) detection of internal road surface disease images. Based on the YOLOv4 target detection algorithm, this study introduces MobilenetV2 and CBAM attention mechanism, and combines the Focal loss confidence loss function to iterate the model, so as to design an efficient and lightweight GPR pavement disease image recognition algorithm, MC-YOLOv4. At the same time, in order to alleviate the problem of data scarcity in GPR, we redesign an unsupervised generative adversarial neural network based on self-attention mechanism, namely SGAN-W. Experiments show that MC-YOLOv4 not only has faster reasoning ability, but also occupies only 23% of the memory of YOLOv5-S. After using the SGAN data augmentation, the [email protected] evaluation index is further improved by 2.63%, and the collapse and mode collapse that may occur in the training process of the traditional Convolutional Generative Adversarial Neural Network (DCGAN) are avoided. After introducing the Focal loss confidence loss function to participate in the training, It significantly improves the imbalance between the precision and recall of the detection model, and this scheme is verified and supported by real scenes. The experimental results show that the proposed method has significant advantages in automatic detection and data expansion of lightweight GPR pavement invisible diseases, which has a wide range of application value and research significance.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Geophysical Methods and Applications · Infrastructure Maintenance and Monitoring · Ultrasonics and Acoustic Wave Propagation

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (62)

Show source-provided references
1. GPR laboratory tests and numerical models to characterize cracks in cement concrete specimens, exemplifying damage in rigid pavement10.1016/j.measurement.2020.107662 ↗
2. Characterizing fatigue damage evolution in asphalt mixtures using acoustic emission and Gaussian mixture model analysis
3. An innovative method for measuring pavement dielectric constant using the extended CMP method with two air-coupled GPR systems10.1016/j.ndteint.2014.05.002 ↗
4. Deep learning-based underground object detection for urban road pavement10.1080/10298436.2018.1559317 ↗
5. Laboratory assessment of nine methods for nondestructive evaluation of concrete bridge decks with overlays10.1016/j.conbuildmat.2018.08.127 ↗
6. Study on significance enhancement algorithm of abnormal features of urban road ground penetrating radar images10.3390/rs14071546 ↗
7. A novel, compact, low-cost, impulse ground-penetrating radar for nondestructive evaluation of pavements10.1109/TIM.2004.827308 ↗
8. GPR-based detection of internal cracks in asphalt pavement: a combination method of DeepAugment data and object detection10.1016/j.measurement.2022.111281 ↗
9. GPR target detection using a neural network classifier designed by a multi-objective genetic algorithm10.1016/j.asoc.2019.03.030 ↗
10. GPR identification of voids inside concrete based on the support vector machine algorithm10.1088/1742-2132/10/3/034002 ↗
11. F. Picetti, G. Testa, F. Lombardi, P. Bestagini, M. Lualdi, S. Tubaro, Convolutional autoencoder for landmine detection on GPR scans, 2018 41st international conference on telecommunications and signal processing (TSP), IEEE, 2018, pp. 1–4.10.1109/TSP.2018.8441206 ↗
12. Real-time hyperbola recognition and fitting in GPR data10.1109/TGRS.2016.2592679 ↗
13. N.R. Syambas, A system for identification of a buried object on GPR using a decision tree method, 2011 6th International Conference on Telecommunication Systems, Services, and Applications (TSSA), IEEE, 2011, pp. 169–175.10.1109/TSSA.2011.6095428 ↗
14. S.S. Bishop, J.C. Isaacs, L.E. Besaw, P.J. Stimac, Deep convolutional neural networks for classifying GPR B-scans, Detection and Sensing of Mines, Explosive Objects, and Obscured Targets XX, 2015.
15. Automatic classification of pavement distress using 3d ground-penetrating radar and deep convolutional neural network10.1109/TITS.2022.3197712 ↗
16. Hybrid pixel-level concrete crack segmentation and quantification across complex backgrounds using deep learning10.1016/j.autcon.2020.103291 ↗
17. Innovative method for recognizing subgrade defects based on a convolutional neural network10.1016/j.conbuildmat.2018.02.081 ↗
18. Railway subgrade defect automatic recognition method based on improved faster R-CNN
19. Performance analysis of detecting buried pipelines in GPR images using Faster R-CNN
20. V. Kafedziski, S. Pecov, D. Tanevski, 2018.Detection and classification of land mines from ground penetrating radar data using faster R-CNN, 2018 26th telecommunications forum (TELFOR), IEEE, 2018, pp. 1–4.10.1109/TELFOR.2018.8612117 ↗
21. Automatic hyperbola detection and fitting in GPR B-scan image10.1016/j.autcon.2019.102839 ↗
22. A review of research on object detection based on deep learning
23. F. Sultana, A. Sufian, P. Dutta, 2020. A review of object detection models based on convolutional neural network, Intelligent computing: image processing based applications (2020) 1–16.10.1007/978-981-15-4288-6_1 ↗
24. A.K. Shetty, I. Saha, R.M. Sanghvi, S.A. Save, Y.J. Patel, 2021. A review: Object detection models, 2021 6th International Conference for Convergence in Technology (I2CT), IEEE, 2021, pp. 1–8.10.1109/I2CT51068.2021.9417895 ↗
25. A comprehensive and systematic look up into deep learning based object detection techniques: a review10.1016/j.cosrev.2020.100301 ↗
26. W. Liu, D. Anguelov, D. Erhan, C. Szegedy, S. Reed, C.-Y. Fu, A.C. Berg, 2016. Ssd: Single shot multibox detector, Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11–14, 2016, Proceedings, Part I 14, Springer, 2016, pp. 21–37.10.1007/978-3-319-46448-0_2 ↗
27. You only look once: Unified, real-time object detection
28. Centernet: Keypoint triplets for object detection
29. A YOLO detector providing fast and accurate pupil center estimation using regions surrounding a pupil10.28991/ESJ-2022-06-05-05 ↗
30. A framework to create a deep learning detector from a small dataset: a case of parawood pith estimation10.28991/ESJ-2023-07-01-017 ↗
31. A framework to estimate the key point within an object based on a deep learning object detection10.28991/HIJ-2023-04-01-08 ↗
32. Object detection using YOLO: challenges, architectural successors, datasets and applications10.1007/s11042-022-13644-y ↗
33. A. Bochkovskiy, C.-Y. Wang, H.-Y.M. Liao, 2020. Yolov4: Optimal speed and accuracy of object detection, arXiv preprint arXiv:2004.10934 (2020).
34. Detection of concealed cracks from ground penetrating radar images based on deep learning algorithm10.1016/j.conbuildmat.2020.121949 ↗
35. The application of improved YOLO V3 in multi-scale target detection10.3390/app9183775 ↗
36. Small target deep convolution recognition algorithm based on improved YOLOv410.1007/s13042-021-01496-1 ↗
37. Evaluating the optimised YOLO-based defect detection method for subsurface diagnosis with ground penetrating radar
38. A GANs-based deep learning framework for automatic subsurface object recognition from ground penetrating radar data10.1109/ACCESS.2021.3064205 ↗
39. Detection of Camellia oleifera fruit in complex scenes by using YOLOv7 and data augmentation10.3390/app122211318 ↗
40. Segmentation of masses on mammograms using data augmentation and deep learning10.1007/s10278-020-00330-4 ↗
41. Application of combining YOLO models and 3D GPR images in road detection and maintenance10.3390/rs13061081 ↗
42. Enhanced automatic root recognition and localization in GPR images through a YOLOv4-based deep learning approach
43. Deep learning-based pavement subsurface distress detection via ground penetrating radar data10.1016/j.autcon.2022.104516 ↗
44. Numerical solution of initial boundary value problems involving Maxwell's equations in isotropic media10.1109/TAP.1966.1138693 ↗
45. Specific evaluation of tunnel lining multi-defects by all-refined GPR simulation method using hybrid algorithm of FETD and FDTD10.1016/j.conbuildmat.2018.07.039 ↗
46. A. Radford, L. Metz, S. Chintala, 2015. Unsupervised representation learning with deep convolutional generative adversarial networks, arXiv preprint arXiv:1511.06434 (2015).
47. Automatic recognition of tunnel lining elements from GPR images using deep convolutional networks with data augmentation10.1016/j.autcon.2021.103830 ↗
48. Automatic classification of asphalt pavement cracks using a novel integrated generative adversarial networks and improved VGG model10.1016/j.engstruct.2022.115406 ↗
49. Self-attention generative adversarial networks, International conference on machine learning
50. Mobilenetv2: inverted residuals and linear bottlenecks
51. Xception: deep learning with depthwise separable convolutions
52. Cbam: convolutional block attention module
53. Focal loss for dense object detection
54. Y. Chen, Y. Wang, Y. Zhang, Y. Guo, 2019. Panet: A context based predicate association network for scene graph generation, 2019 IEEE International Conference on Multimedia and Expo (ICME), IEEE, 2019, pp. 508–513.10.1109/ICME.2019.00094 ↗
55. T. Miyato, T. Kataoka, M. Koyama, Y. Yoshida, 2018. Spectral normalization for generative adversarial networks, arXiv preprint arXiv:1802.05957 (2018).
56. Gans trained by a two time-scale update rule converge to a local nash equilibrium
57. Signal processing of GPR data for road surveys10.3390/geosciences9020096 ↗
58. An overview of ground-penetrating radar signal processing techniques for road inspections10.1016/j.sigpro.2016.05.016 ↗
59. One-class SVM based outlier detection strategy to detect thin interlayer debondings within pavement structures using Ground Penetrating Radar data10.1016/j.jappgeo.2021.104392 ↗
60. Calibration of FDTD simulation of GPR signal for asphalt pavement compaction monitoring10.1109/TGRS.2014.2344858 ↗
61. Numerical properties of staggered finite-difference solutions of Maxwell's equations for ground-penetrating radar modeling10.1029/95GL03515 ↗
62. Finite-difference time-domain simulation of GPR data10.1016/S0926-9851(98)00019-6 ↗