journal article·2022-07-08Open access

Simulation Dataset Preparation and Hybrid Training for Deep Learning in Defect Detection Using Digital Shearography

Weixian Li, Dandan Wang, Sijin Wu

Applied Sciences· Volume 12· Issue 14

Abstract

Since real experimental shearography images are usually few, the application of deep learning for defect detection in digital shearography is limited. A simulation dataset preparation method of shearography images is proposed in this paper. Firstly, deformation distributions are estimated by finite element analysis (FEA); secondly, phase maps are calculated according to the optical shearography system; finally, simulated shearography images are obtained after 2π modulus and gray transform. Various settings in the parameters of object, defect, load and shearing in those three steps could prepare a diverse simulation dataset for deep learning. Together with the real experimental images taken from a shearography setup, hybrid trainings of deep learning for defect detection are performed and discussed. The results show that a simulation dataset, generated without any real defective specimen, shearography system or manual experiment, can greatly improve the generalization of a deep learning network when the number of experimental training images is small.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Optical measurement and interference techniques · Image Processing Techniques and Applications · Image and Object Detection Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Instrumentation Science and Opto-Electronics Engineering, Beijing Information Science and Technology University, Beijing 100101, China

Funding

National Natural Science Foundation of China · Key Cultivation Projects of Beijing Information Science and Technology University

References (32)

Show source-provided references
1. Review of Electronic Speckle Pattern Interferometry (ESPI) for Three Dimensional Displacement Measurement10.3901/CJME.2014.01.001 ↗
2. Zhao, Q., Dan, X., Sun, F., Wang, Y., Wu, S., and Yang, L. (2018). Digital Shearography for NDT: Phase Measurement Technique and Recent Developments. Appl. Sci., 8.10.3390/app8122662 ↗
3. A Compact Laser Shearography System for On-Site Robotic Inspection of Wind Turbine Blades
4. Defect detection in unpolished Si wafers by digital shearography10.1088/0957-0233/15/1/005 ↗
5. A new technique to detect defect size and depth in composite structures using digital shearography and unconstrained optimization
6. On-line monitoring of the quality of elements of aircraft structures by the method of electron shearography10.1007/s11003-009-9186-3 ↗
7. Assessment of defect detection in wood–plastic composites via shearography method10.1177/0892705713518810 ↗
8. Quality evaluation of rubber-to-metal bonded structures based on shearography10.1007/s11433-015-5658-7 ↗
9. Research on Inner Defect Detection of Pressure Vessels with Digital Shearography10.1117/12.2083822 ↗
10. Acoustic shearography for crack detection in metallic plates10.1088/1361-665X/aacfe9 ↗
11. Defect detection for tire laser shearography image using curvelet transform based edge detector10.1016/j.optlastec.2012.08.023 ↗
12. Comparison between segmentation performances of a tool based on wavelet decomposition and multithreshold and of a U-net convolutional neural network applied to shearography images of carbon fiber reinforced plastic plates with low-velocity impact damages
13. Measurement of the defect size by shearography or other interferometric techniques10.1117/1.OE.51.3.033602 ↗
14. Fast automatic multi-defects recognition based on the spatial characteristics of Freeman chain code10.1117/1.OE.59.12.124103 ↗
15. Improvement of defect detection in shearography by using Principal Component Analysis10.1117/12.2062831 ↗
16. Identification of flaws using digital shearography
17. Improved impact damage characterisation in CFRP samples using the fusion of optical lock-in thermography and optical square-pulse shearography images10.1016/j.ndteint.2020.102215 ↗
18. Neural fuzzy analysis of delaminated composites fromshearography imaging10.1016/S0263-8223(01)00103-9 ↗
19. Impact induced damage characterization of composite platesusing neural networks10.1088/0964-1726/16/2/033 ↗
20. Defect identification in GRID-LOCK joints10.1016/j.ndteint.2006.12.006 ↗
21. Fröhlich, H.B., Fantin, A.V., de Oliveira, B.C.F., Willemann, D.P., Iervolino, L.A., Benedet, M.E., and Gonçalves Junior, A.A. (2018, January 8–13). Defect classification in shearography images using convolutional neural networks. Proceedings of the 2018 International Joint Conference on Neural Networks (IJCNN), Rio de Janeiro, Brazil.10.1109/IJCNN.2018.8489133 ↗
22. An automated shearography system for cylindrical surface inspection10.1016/j.measurement.2018.11.085 ↗
23. Chang, C., Srinivasan, K., Wang, W., Ganapathy, G.P., Vincent, D.R., and Deepa, N. (2020). Quality Assessment of Tire Shearography Images via Ensemble Hybrid Faster Region-Based ConvNets. Electronics, 9.10.3390/electronics9010045 ↗
24. Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23–28). Rich feature hierarchies for accurate object detection and semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.10.1109/CVPR.2014.81 ↗
25. Girshick, R. (2015, January 7–13). Fast R-CNN. Proceedings of the2015 IEEE Conference on Computer Vision (ICCV), Santiago, Chile.10.1109/ICCV.2015.169 ↗
26. Faster R-CNN: Towards real-time object detection with region proposal networks10.1109/TPAMI.2016.2577031 ↗
28. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27–30). You only look once: Unified, real-time object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.91 ↗
29. Bochkovskiy, A., Wang, C., and Liao, H.M. (2020). Yolov4: Optimal speed and accuracy of object detection. arXiv.
30. Wang, C., Liao, H.M., Yeh, I., Wu, Y., Chen, P., and Hsieh, J. (2020, January 14–19). CSPNet: A new backbone that can enhance learning capability of CNN. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Seattle, WA, USA.10.1109/CVPRW50498.2020.00203 ↗
31. Spatial pyramid pooling in deep convolutional networks for visual recognition10.1109/TPAMI.2015.2389824 ↗
32. Liu, S., Qi, L., Qin, H., Shi, J., and Jia, J. (2018, January 18–23). Path aggregation network for instance segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00913 ↗