Reduced Training Data for Laser Ultrasound Signal Interpretation by Neural Networks
Source abstract
Abstract
Abstract The performance of machine learning algorithms is conditioned by the availability of training datasets, which is especially true for the field of nondestructive evaluation. Here we propose one reconfigurable specimen instead of numerous reference specimens with known, unchangeable defect properties, which are usually complicated to fabricate. It consist of a shape memory polymer foil with temperature-dependent Young’s modulus and ultrasound attenuation. This open a possibility to generate a reconfigurable defect by projecting a heating laser in the form of a short line on the specimen surface. Ultrasound is generated by a laser pulse at one fixed position and detected by a laser vibrometer at another fixed position for 64 different defect positions and 3 different configurations of the specimen. The obtained diversified datasets are used to optimize the neural network architecture for the interpretation of ultrasound signals. We study the performance of the model in cases of reduced and dissimilar training datasets. In our first study, we classify the specimen configurations with the defect position being the disturbing parameter. The model shows high performance on a dataset of signals obtained at all the defect positions, even if trained on a completely different dataset containing signals obtained at only few defect positions. In our second study, we perform precise defect localization. The model becomes robust to the changes in the specimen configuration when a reduced dataset, containing signals obtained at two different specimen configurations, is used for the training process. This work highlights the potential of the demonstrated machine learning algorithm for industrial quality control. High-volume products (simulated by a reconfigurable specimen in our work) can be rapidly tested on the production line using this single-point and contact-free laser ultrasonic method.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Industrial Vision Systems and Defect Detection · Thermography and Photoacoustic Techniques · Photoacoustic and Ultrasonic Imaging
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (61)
Show source-provided references
1. Chen, X.W., Lin, X.: Big data deep learning: challenges and perspectives. IEEE Access 2, 514–525 (2014). https://doi.org/10.1109/ACCESS.2014.232502910.1109/ACCESS.2014.2325029 ↗
2. LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 521(7553), 436–444 (2015). https://doi.org/10.1038/nature1453910.1038/nature14539 ↗
3. Uijlings, J.R.R., van de Sande, K.E.A., Gevers, T., Smeulders, A.W.M.: Selective search for object recognition. Int. J. Comput. Vis. 104(2), 154–171 (2013). https://doi.org/10.1007/s11263-013-0620-510.1007/s11263-013-0620-5 ↗
4. Guodong, G., Li, S.Z.: Content-based audio classification and retrieval by support vector machines. IEEE Trans. Neural Netw. 14(1), 209–215 (2003). https://doi.org/10.1109/TNN.2002.80662610.1109/TNN.2002.806626 ↗
5. McLoughlin, I., Zhang, H., Xie, Z., Song, Y., Xiao, W.: Robust sound event classification using deep neural networks. IEEE/ACM Trans. Audio Speech Lang. Process. 23(3), 540–552 (2015). https://doi.org/10.1109/TASLP.2015.238961810.1109/TASLP.2015.2389618 ↗
6. Noda, K., Yamaguchi, Y., Nakadai, K., Okuno, H.G., Ogata, T.: Audio-visual speech recognition using deep learning. Appl. Intell. 42(4), 722–737 (2015). https://doi.org/10.1007/s10489-014-0629-710.1007/s10489-014-0629-7 ↗
7. Caggiano, A., Zhang, J., Alfieri, V., Caiazzo, F., Gao, R., Teti, R.: Machine learning-based image processing for on-line defect recognition in additive manufacturing. CIRP Ann. 68(1), 451–454 (2019). https://doi.org/10.1016/j.cirp.2019.03.02110.1016/j.cirp.2019.03.021 ↗
8. Ngan, H.Y.T., Pang, G.K.H., Yung, N.H.C.: Automated fabric defect detection—a review. Image Vis. Comput. 29(7), 442–458 (2011). https://doi.org/10.1016/j.imavis.2011.02.00210.1016/j.imavis.2011.02.002 ↗
9. Tao, X., Zhang, D., Ma, W., Liu, X., Xu, D.: Automatic metallic surface defect detection and recognition with convolutional neural networks. Appl. Sci. (2018). https://doi.org/10.3390/app809157510.3390/app8091575 ↗
10. Fuchs, P., Kröger, T., Garbe, C.S.: Defect detection in CT scans of cast aluminum parts: a machine vision perspective. Neurocomputing 453, 85–96 (2021). https://doi.org/10.1016/j.neucom.2021.04.09410.1016/j.neucom.2021.04.094 ↗
11. Schlotterbeck, M., Schulte, L., Alkhaldi, W., Krenkel, M., Toeppe, E., Tschechne, S., Wojek, C.: Automated defect detection for fast evaluation of real inline CT scans. Nondestruct. Test. Eval. 35(3), 266–275 (2020). https://doi.org/10.1080/10589759.2020.178544610.1080/10589759.2020.1785446 ↗
12. Rus, J., Gustschin, A., Mooshofer, H., Grager, J.-C., Bente, K., Gaal, M., Pfeiffer, F., Grosse, C.U.: Qualitative comparison of non-destructive methods for inspection of carbon fiber-reinforced polymer laminates. J. Compos. Mater. 57(27), 4325–4337 (2020). https://doi.org/10.1177/002199832093116210.1177/0021998320931162 ↗
13. Rus, J., Kulla, D., Grager, J.C., Grosse, C.U.: Air-coupled ultrasonic inspection of fiber-reinforced plates using an optical microphone. In: Proceedings of German Acoustical Society, DAGA Rostock, pp. 763–766 (2019)
14. Blomme, E., Bulcaen, D., Declercq, F.: Air-coupled ultrasonic NDE: experiments in the frequency range 750 kHz–2 MHz. NDT E Int. 35, 417–426 (2002). https://doi.org/10.1016/S0963-8695(02)00012-910.1016/S0963-8695(02)00012-9 ↗
15. Rus, J., Grosse, C.U.: Thickness measurement via local ultrasonic resonance spectroscopy. Ultrasonics 109, 106261 (2021). https://doi.org/10.1016/j.ultras.2020.10626110.1016/j.ultras.2020.106261 ↗
16. Rus, J., Grosse, C.U.: Local ultrasonic resonance spectroscopy: a demonstration on plate inspection. J. Nondestruct. Eval. (2020). https://doi.org/10.1007/s10921-020-00674-510.1007/s10921-020-00674-5 ↗
17. Migliori, A., Sarrao, J.L.: Resonant Ultrasound Spectroscopy: Applications to Physics, Materials Measurements, and Nondestructive Evaluation. A Wiley-Interscience publication, New York (1997)
18. Jüngert, A., Grosse, C., Krüger, M.: Local acoustic resonance spectroscopy (LARS) for glass fiber-reinforced polymer applications. J. Nondestr. Eval. 33(1), 23–33 (2014). https://doi.org/10.1007/s10921-013-0199-310.1007/s10921-013-0199-3 ↗
19. Solodov, I., Bai, J., Busse, G.: Resonant ultrasound spectroscopy of defects: case study of flat-bottomed holes. J. Appl. Phys. 113(22), 223512 (2013). https://doi.org/10.1063/1.481092610.1063/1.4810926 ↗
20. Blouin, A., Lévesque, D., Néron, C., Drolet, D., Monchalin, J.P.: Improved resolution and signal-to-noise ratio in laser-ultrasonics by SAFT processing. Opt. Express 2(13), 531–539 (1998). https://doi.org/10.1364/OE.2.00053110.1364/OE.2.000531 ↗
21. Fendt, K.T., Mooshofer, H., Rupitsch, S.J., Ermert, H.: Ultrasonic defect characterization in heavy rotor forgings by means of the synthetic aperture focusing technique and optimization methods. IEEE Trans. Ultrason. Ferroelectr. Freq. Control 63(6), 874–885 (2016). https://doi.org/10.1109/TUFFC.2016.255728110.1109/TUFFC.2016.2557281 ↗
22. Fendt, K.T., Mooshofer, H., Rupitsch, S.J., Lerch, R., Ermert, H.: Investigation of the synthetic aperture focusing technique resolution for heavy rotor forging ultrasonic inspection. IEEE Int. Ultrason. Symp. (IUS) (2013). https://doi.org/10.1109/ULTSYM.2013.047610.1109/ULTSYM.2013.0476 ↗
23. Ni, C.-Y., Chen, C., Ying, K.-N., Dai, L.-N., Yuan, L., Kan, W.-W., Shen, Z.-H.: Non-destructive laser-ultrasonic synthetic aperture focusing technique (SAFT) for 3D visualization of defects. Photoacoustics 22, 100248 (2021). https://doi.org/10.1016/j.pacs.2021.10024810.1016/j.pacs.2021.100248 ↗
24. Camacho, J., Atehortua, D., Cruza, J.F., Brizuela, J., Ealo, J.: Ultrasonic crack evaluation by phase coherence processing and TFM and its application to online monitoring in fatigue tests. NDT E Int. 93, 164–174 (2018). https://doi.org/10.1016/j.ndteint.2017.10.00710.1016/j.ndteint.2017.10.007 ↗
25. Piedade, L.P., Painchaud-April, G., Duff, A.L., Bélanger, P.: Compressive sensing strategy on sparse array to accelerate ultrasonic TFM imaging. IEEE Trans. Ultrason. Ferroelectr. Freq. Control 70(6), 538–550 (2023). https://doi.org/10.1109/TUFFC.2023.326671910.1109/TUFFC.2023.3266719 ↗
26. Schmid, S., Wei, H., Grosse, C.U.: On the uncertainty in the segmentation of ultrasound images reconstructed with the total focusing method. SN Appl. Sci. 5(4), 108 (2023). https://doi.org/10.1007/s42452-023-05342-710.1007/s42452-023-05342-7 ↗
27. Tsai, C.D., Wu, T.T., Liu, Y.H.: Application of neural networks to laser ultrasonic NDE of bonded structures. NDT E Int. 34(8), 537–546 (2001). https://doi.org/10.1016/S0963-8695(01)00015-910.1016/S0963-8695(01)00015-9 ↗
28. Yang, J., Cheng, J., Berthelot, Y.H.: Determination of the elastic constants of a composite plate using wavelet transforms and neural networks. J. Acoust. Soc. Am. 111(3), 1245–1250 (2002). https://doi.org/10.1121/1.145107110.1121/1.1451071 ↗
29. Lefevre, F., Jenot, F., Ouaftouh, M., Duquennoy, M., Poussot, P., Ourak, M.: Laser ultrasonics and neural networks for the characterization of thin isotropic plates. Rev. Sci. Instrum. 80(1), 014901 (2009). https://doi.org/10.1063/1.307051810.1063/1.3070518 ↗
30. Oishi, A., Yamada, K., Yoshimura, S., Yagawa, G., Nagai, S., Matsuda, Y.: Neural network-based inverse analysis for defect identification with laser ultrasonics. Res. Nondestr. Eval. 13(2), 79–95 (2001). https://doi.org/10.1080/0934984010940968810.1080/09349840109409688 ↗
31. Zhang, K., Lv, G., Guo, S., Chen, D., Liu, Y., Feng, W.: Evaluation of subsurface defects in metallic structures using laser ultrasonic technique and genetic algorithm-back propagation neural network. NDT E Int. 116, 102339 (2020). https://doi.org/10.1016/j.ndteint.2020.10233910.1016/j.ndteint.2020.102339 ↗
32. Guo, S., Feng, H., Feng, W., Lv, G., Chen, D., Liu, Y., Wu, X.: Automatic quantification of subsurface defects by analyzing laser ultrasonic signals using convolutional neural networks and wavelet transform. IEEE Trans. Ultrason. Ferroelectr. Freq. Control 68(10), 3216–3225 (2021). https://doi.org/10.1109/TUFFC.2021.308794910.1109/TUFFC.2021.3087949 ↗
33. Virkkunen, I., Koskinen, T., Jessen-Juhler, O., Rinta-aho, J.: Augmented ultrasonic data for machine learning. J. Nondestr. Eval. 40(1), 4 (2021). https://doi.org/10.1007/s10921-020-00739-510.1007/s10921-020-00739-5 ↗
34. Koskinen, T., Virkkunen, I., Siljama, O., Jessen-Juhler, O.: The effect of different flaw data to machine learning powered ultrasonic inspection. J. Nondestr. Eval. 40(1), 24 (2021). https://doi.org/10.1007/s10921-021-00757-x10.1007/s10921-021-00757-x ↗
35. Sambath, S., Nagaraj, P., Selvakumar, N.: Automatic defect classification in ultrasonic NDT using artificial intelligence. J. Nondestr. Eval. 30(1), 20–28 (2011). https://doi.org/10.1007/s10921-010-0086-010.1007/s10921-010-0086-0 ↗
36. Rai, A., Mitra, M.: Lamb wave based damage detection in metallic plates using multi-headed 1-dimensional convolutional neural network. Smart Mater. Struct. 30(3), 035010 (2021). https://doi.org/10.1088/1361-665x/abdd0010.1088/1361-665x/abdd00 ↗
37. Yang, X., Chen, S., Jin, S., Chang, W.: Crack orientation and depth estimation in a low-pressure turbine disc using a phased array ultrasonic transducer and an artificial neural network. Sensors (2013). https://doi.org/10.3390/s13091237510.3390/s130912375 ↗
38. Medak, D., Posilović, L., Subašić, M., Budimir, M., Lončarić, S.: Automated defect detection from ultrasonic images using deep learning. IEEE Trans. Ultrason. Ferroelectr. Freq. Control 68(10), 3126–3134 (2021). https://doi.org/10.1109/TUFFC.2021.308175010.1109/TUFFC.2021.3081750 ↗
39. Latête, T., Gauthier, B., Belanger, P.: Towards using convolutional neural network to locate, identify and size defects in phased array ultrasonic testing. Ultrasonics 115, 106436 (2021). https://doi.org/10.1016/j.ultras.2021.10643610.1016/j.ultras.2021.106436 ↗
40. Pyle, R.J., Bevan, R.L.T., Hughes, R.R., Rachev, R.K., Ali, A.A.S., Wilcox, P.D.: Deep learning for ultrasonic crack characterization in NDE. IEEE Trans. Ultrason. Ferroelectr. Freq. Control 68(5), 1854–1865 (2021). https://doi.org/10.1109/TUFFC.2020.304584710.1109/TUFFC.2020.3045847 ↗
41. Martín, Ó., López, M., Martín, F.: Artificial neural networks for quality control by ultrasonic testing in resistance spot welding. J. Mater. Process. Technol. 183(2), 226–233 (2007). https://doi.org/10.1016/j.jmatprotec.2006.10.01110.1016/j.jmatprotec.2006.10.011 ↗
42. Amiri, N., Farrahi, G.H., Kashyzadeh, K.R., Chizari, M.: Applications of ultrasonic testing and machine learning methods to predict the static & fatigue behavior of spot-welded joints. J. Manuf. Process. 52, 26–34 (2020). https://doi.org/10.1016/j.jmapro.2020.01.04710.1016/j.jmapro.2020.01.047 ↗
43. Chen, D., Zhou, Y., Wang, W., Zhang, Y., Deng, Y.: Ultrasonic signal classification and porosity testing for CFRP materials via artificial neural network. Mater. Today Commun. 30, 103021 (2022). https://doi.org/10.1016/j.mtcomm.2021.10302110.1016/j.mtcomm.2021.103021 ↗
44. Xue, R., Wang, X., Yang, Q., Xu, D., Sun, Y., Zhang, J., Krishnaswamy, S.: Grain size distribution characterization of aluminum with a particle swarm optimization neural network using laser ultrasonics. Appl. Acoust. 180, 108125 (2021). https://doi.org/10.1016/j.apacoust.2021.10812510.1016/j.apacoust.2021.108125 ↗
45. Melville, J., Alguri, K.S., Deemer, C., Harley, J.B.: Structural damage detection using deep learning of ultrasonic guided waves. AIP Conf. Proc. 1949(1), 230004 (2018). https://doi.org/10.1063/1.503165110.1063/1.5031651 ↗
46. Shukla, K., Di Leoni, P.C., Blackshire, J., Sparkman, D., Karniadakis, G.E.: Physics-informed neural network for ultrasound nondestructive quantification of surface breaking cracks. J. Nondestr. Eval. 39(3), 61 (2020). https://doi.org/10.1007/s10921-020-00705-110.1007/s10921-020-00705-1 ↗
47. Song, H., Yang, Y.: Super-resolution visualization of subwavelength defects via deep learning-enhanced ultrasonic beamforming: a proof-of-principle study. NDT E Int. 116, 102344 (2020). https://doi.org/10.1016/j.ndteint.2020.10234410.1016/j.ndteint.2020.102344 ↗
48. Lerosey, G., de Rosny, J., Tourin, A., Fink, M.: Focusing beyond the diffraction limit with far-field time reversal. Science 315(5815), 1120–1122 (2007). https://doi.org/10.1126/science.113482410.1126/science.1134824 ↗
49. Orazbayev, B., Fleury, R.: Far-field subwavelength acoustic imaging by deep learning. Phys. Rev. X 10(3), 031029 (2020). https://doi.org/10.1103/PhysRevX.10.03102910.1103/PhysRevX.10.031029 ↗
50. del Hougne, M., Gigan, S., del Hougne, P.: Deeply subwavelength localization with reverberation-coded aperture. Phys. Rev. Lett. 127(4), 043903 (2021). https://doi.org/10.1103/PhysRevLett.127.04390310.1103/PhysRevLett.127.043903 ↗
51. Chang, C.-S., Lee, Y.-C.: Ultrasonic touch sensing system based on lamb waves and convolutional neural network. Sensors (2020). https://doi.org/10.3390/s2009261910.3390/s20092619 ↗
52. Sikdar, S., Liu, D., Kundu, A.: Acoustic emission data based deep learning approach for classification and detection of damage-sources in a composite panel. Compos. B Eng. 228, 109450 (2022). https://doi.org/10.1016/j.compositesb.2021.10945010.1016/j.compositesb.2021.109450 ↗
53. Firouzeh, A., Salerno, M., Paik, J.: Stiffness control with shape memory polymer in underactuated robotic origamis. IEEE Trans. Rob. 33(4), 765–777 (2017). https://doi.org/10.1109/TRO.2017.269226610.1109/TRO.2017.2692266 ↗
54. Meyendorf, N., Ida, N., Singh, R., Vrana, J.: NDE 4.0: progress, promise, and its role to industry 4.0. NDT E Int. 140, 102957 (2023). https://doi.org/10.1016/j.ndteint.2023.10295710.1016/j.ndteint.2023.102957 ↗
55. Singh, R., Fernandez, R.S., Vrana, J.: Principles for successful deployment of NDE 4.0. J. Non Destruct. 19(4), 28–34 (2022)
56. Valeske, B., Osman, A., Römer, F., Tschuncky, R.: Next generation NDE sensor systems as IIoT elements of Industry 4.0. Res. Nondestr. Eval. 31(5–6), 340–369 (2020). https://doi.org/10.1080/09349847.2020.184186210.1080/09349847.2020.1841862 ↗
57. Vrana, J.: The core of the fourth revolutions: industrial internet of things, digital twin, and cyber-physical loops. J. Nondestr. Eval. 40(2), 46 (2021). https://doi.org/10.1007/s10921-021-00777-710.1007/s10921-021-00777-7 ↗
58. Vrana, J., Meyendorf, N., Ida, N., Singh, R.: Introduction to NDE 4.0. Handbook of Nondestructive Evaluation 4.0, pp. 3–30 (2022). https://doi.org/10.1007/978-3-030-73206-6_4310.1007/978-3-030-73206-6_43 ↗
59. Vrana, J., Singh, R.: NDE 4.0—a design thinking perspective. J. Nondestr. Eval. 40(1), 8 (2021). https://doi.org/10.1007/s10921-020-00735-910.1007/s10921-020-00735-9 ↗
60. Vrana, J., Singh, R.: Value Creation in NDE 4.0: What and How. Handbook of Nondestructive Evaluation 4.0, pp. 1–27 (2021). https://doi.org/10.1007/978-3-030-48200-8_41-110.1007/978-3-030-48200-8_41-1 ↗
61. Vrana, J., Singh, R.: Cyber-physical loops as drivers of value creation in NDE 4.0. J. Nondestr. Eval. 40(3), 61 (2021). https://doi.org/10.1007/s10921-021-00793-710.1007/s10921-021-00793-7 ↗