journal article·2022-10-27Open access

GPR Data Augmentation Methods by Incorporating Domain Knowledge

Guanghua Yue, Chenglong Liu, Yishun Li, Yuchuan Du, Shili Guo

Applied Sciences· Volume 12· Issue 21

Abstract

Deep learning has significantly improved the recognition efficiency and accuracy of ground-penetrating radar (GPR) images. A significant number of weight parameters need to be specified, which requires lots of labeled GPR images. However, obtaining the ground-truth subsurface distress labels is challenging as they are invisible. Data augmentation is a predominant method to expand the dataset. The traditional data augmentation methods, such as rotating, scaling, cropping, and flipping, would change the GPR signals’ real features and cause the model’s poor generalization ability. We proposed three GPR data augmentation methods (gain compensation, station spacing, and radar signal mapping) to overcome these challenges by incorporating domain knowledge. Then, the most state-of-the-art model YOLOv7 was applied to verify the effectiveness of these data augmentation methods. The results showed that the proposed data augmentation methods decrease loss function values when the training epochs grow. The performance of the deep learning model gradually became stable when the original datasets were augmented two times, four times, and eight times, proving that the augmented datasets can increase the robustness of the training model. The proposed data augmentation methods can be used to expand the datasets when the labeled training GPR images are insufficient.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Geophysical Methods and Applications · Seismic Imaging and Inversion Techniques · Microwave Imaging and Scattering Analysis

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Key Laboratory of Road and Traffic Engineering of the Ministry of Education, Tongji University, Shanghai 201804, China

Henan Wanli Transportation Technology Group Co., Ltd., Xuchang 461000, China

College of Resource and Environment, Henan Institute of Engineering, Zhengzhou 451191, China

Funding

National key research and development program of China · Scientific Research Project of the Shanghai Science and Technology Commission

References (40)

Show source-provided references
1. Large-scale pavement roughness measurements with vehicle crowdsourced data using semi-supervised learning10.1016/j.trc.2021.103048 ↗
2. A novel approach for pavement texture characterisation using 2D-wavelet decomposition10.1080/10298436.2020.1825712 ↗
3. Liu, C., Nie, T., Du, Y., Cao, J., Wu, D., and Li, F. (2022). A Response-Type Road Anomaly Detection and Evaluation Method for Steady Driving of Automated Vehicles. IEEE T. Intell. Transp., 1–12.10.1109/TITS.2022.3182428 ↗
4. Yue, G., Du, Y., Liu, C., Guo, S., Li, Y., and Gao, Q. (2022). Road subsurface distress recognition method using multiattribute feature fusion with ground penetratin gradar. Int. J. Pavement Eng., 1–13.10.1080/10298436.2022.2037591 ↗
5. Peng, M., Wang, D., Liu, L., Shi, Z., Shen, J., and Ma, F. (2021). Recent Advances in the GPR Detection of Grouting Defects behind Shield Tunnel Segments. Remote Sens., 13.10.3390/rs13224596 ↗
6. Guo, S., Xu, Z., Li, X., and Zhu, P. (2022). Detection and Characterization of Cracks in Highway Pavement with the Amplitude Variation of GPR Diffracted Waves: Insights from Forward Modeling and Field Data. Remote Sens., 14.10.3390/rs14040976 ↗
7. An overview of ground-penetrating radar signal processing techniques for road inspections10.1016/j.sigpro.2016.05.016 ↗
8. Automatic hyperbola detection and fitting in GPR B-scan image10.1016/j.autcon.2019.102839 ↗
9. Polarity Change Extraction of GPR Data for Under-road Cavity Detection: Application on Sudeoksa Testbed Data10.2113/JEEG24.3.419 ↗
10. Detection and Discrimination of Land Mines in Ground-Penetrating Radar Based on Edge Histogram Descriptors and a Possibilistic K-Nearest Neighbor Classifier10.1109/TFUZZ.2008.2005249 ↗
11. Performance assessment of SVM-based classification techniques for the detection of artificial debondings within pavement structures from stepped-frequency A-scan radar data10.1016/j.ndteint.2019.102128 ↗
12. Xu, J., Zhang, J., and Sun, W. (2021). Recognition of the Typical Distress in Concrete Pavement Based on GPR and 1D-CNN. Remote Sens., 13.10.3390/rs13122375 ↗
13. ImageNet Classification with Deep Convolutional Neural Networks10.1145/3065386 ↗
14. Autonomous pavement distress detection using ground penetrating radar and region-based deep learning10.1016/j.measurement.2020.108077 ↗
15. Improved Mask R-CNN with distance guided intersection over union for GPR signature detection and segmentation10.1016/j.autcon.2020.103414 ↗
16. Chen, S., Wang, L., Fang, Z., Shi, Z., and Zhang, A. (2021, January 18–20). A Ground-penetrating Radar Object Detection Method Based on Deep Learning. Proceedings of the 2021 IEEE 4th International Conference on Electronic Information and Communication Technology (ICEICT), Xi’an, China.10.1109/ICEICT53123.2021.9531310 ↗
17. Li, X., Liu, H., Zhou, F., Chen, Z., Giannakis, I., and Slob, E. (2021). Deep learning-based nondestructive evaluation of reinforcement bars using ground penetrating radar and electromagnetic induction data. Comput. Aided Civ. Inf.10.1111/mice.12798 ↗
18. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., and Berg, A.C. (2016). SSD: Single Shot Multi Box Detector. Proceedings of European Conference on Computer Vision, Amsterdam, The Netherlands, 8–16 October 2016, Springer.10.1007/978-3-319-46448-0_2 ↗
19. Redmon, J., and Farhadi, A. (2018). YOLOv3: An Incremental Improvement. arXiv.
20. Duan, K., Bai, S., Xie, L., Qi, H., Huang, Q., and Tian, Q. (November, January 27). CenterNet: Keypoint Triplets for Object Detection. Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Korea.10.1109/ICCV.2019.00667 ↗
21. Focal Loss for Dense Object Detection10.1109/TPAMI.2018.2858826 ↗
22. Wang, C., Bochkovskiy, A., and Liao, H.M. (2022). YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. arXiv.10.1109/CVPR52729.2023.00721 ↗
23. Cross-scene pavement distress detection by a novel transfer learning framework10.1111/mice.12674 ↗
24. Bralich, J., Reichman, D., Collins, L., and Malof, J. (2017). Improving convolutional neural networks for buried target detection in ground penetrating radar using transfer learning via pretraining. Detection and Sensing of Mines, Explosive Objects, and Obscured Targets XXII, International Society for Optics and Photonics.10.1117/12.2263112 ↗
25. Residual CNN plus Bi-LSTM model to analyze GPR B scan images10.1016/j.autcon.2020.103525 ↗
26. Automatic recognition of tunnel lining elements from GPR images using deep convolutional networks with data augmentation10.1016/j.autcon.2021.103830 ↗
27. Perez, L., and Wang, J. (2017). The Effectiveness of Data Augmentation in Image Classification using Deep Learning. arXiv.
28. Detection and localization of rebar in concrete by deep learning using ground penetrating radar10.1016/j.autcon.2020.103279 ↗
29. Buslaev, A., Iglovikov, V.I., Khvedchenya, E., Parinov, A., Druzhinin, M., and Kalinin, A.A. (2020). Albumentations: Fast and Flexible Image Augmentations. Information, 11.10.3390/info11020125 ↗
30. Zong, Z., Chen, C., Mi, X., Sun, W., Song, Y., Li, J., Dong, Z., Huang, R., and Yang, B. (2019, January 18–20). A Deep Learning Approach for Urban Underground Objects Detection from Vehicle-Borne Ground Penetrating Radar Data in Real-Time. Proceedings of the International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Munich, Germany.10.5194/isprs-archives-XLII-2-W16-293-2019 ↗
31. Sonoda, J., and Kimoto, T. (2018, January 6–9). Object Identification form GPR Images by Deep Learning. Proceedings of the 2018 Asia-Pacific Microwave Conference (APMC), Kyoto, Japan.10.23919/APMC.2018.8617556 ↗
32. Veal, C., Dowdy, J., Brockner, B., Anderson, D.T., Ball, J.E., and Scott, G. (2018). Generative adversarial networks for ground penetrating radar in hand held explosive hazard detection. Detection and Sensing of Mines, Explosive Objects, and Obscured Targets XXIII, SPIE.
33. Li, J., Madry, A., Peebles, J., and Schmidt, L. (2018, January 10–15). On the Limitations of First-Order Approximation in GAN Dynamics. Proceedings of the 35th International Conference on Machine Learning, Stockholm, Sweden.
34. Chen, G., Bai, X., Wang, G., Wang, L., Luo, X., Ji, M., Feng, P., and Zhang, Y. (2021, January 12). Subsurface Voids Detection from Limited Ground Penetrating Radar Data Using Generative Adversarial Network and YOLOV5. Proceedings of the 2021 IEEE International Geoscience and Remote Sensing Symposium IGARSS, Brussels, Belgium.10.1109/IGARSS47720.2021.9554954 ↗
35. Bianchini Ciampoli, L., Tosti, F., Economou, N., and Benedetto, F. (2019). Signal Processing of GPR Data for Road Surveys. Geosciences, 9.10.3390/geosciences9020096 ↗
36. Deep learning-based pavement subsurface distress detection via ground penetrating radar data10.1016/j.autcon.2022.104516 ↗
37. The Impact of Spatial Sampling and Migration on the Interpretation of Complex Archaeological Ground-penetrating Radar Data10.1002/arp.1501 ↗
38. Zhang, X., Zeng, H., Guo, S., and Zhang, L. (2022). Efficient Long Range Attention Network for Image Super resolution. arXiv.10.1007/978-3-031-19790-1_39 ↗
39. Kasper-Eulaers, M., Hahn, N., Berger, S., Sebulonsen, T., Myrland, Ø., and Kummervold, P.E. (2021). Short Communication: Detecting Heavy Goods Vehicles in Rest Areas in Winter Conditions Using YOLOv5. Algorithms, 14.10.3390/a14040114 ↗
40. Reichman, D., Collins, L.M., and Malof, J.M. (2017, January 28–30). Some good practices for applying convolutional neural networks to buried threat detection in Ground Penetrating Radar. Proceedings of the 2017 9th International Workshop on Advanced Ground Penetrating Radar (IWAGPR), Edinburgh, UK.10.1109/IWAGPR.2017.7996100 ↗