Automated crack detection on metallic materials with flying-spot thermography using deep learning and progressive training
Source abstract
Abstract
In non-destructive testing for metallic materials, ‘Flying-spot’ thermography allows the detection of cracks thanks to the scanning of samples by a local laser heat source observed in the infrared spectrum. However, distinguishing a crack from other surface structures such as air ducts or non-planar shapes on the material surface can be challenging in an automation perspective. To address this, we propose to use deep learning techniques, which can exploit contextual information but require a significant amount of labelled data. This study presents a training method based on curriculum learning and recent denoising diffusion models to generate synthetic images. The protocol progressively increases the complexity of training images, using successively simulated data from a multi-physics finite-element software, synthetically generated data with diffusion process, and finally real data. Several detection scores are measured for various machine learning and deep learning architectures, demonstrating the benefits of the proposed approach for regular application cases and degraded experimental conditions, consisting of limited thermal enlightenment recordings.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Thermography and Photoacoustic Techniques · Additive Manufacturing Materials and Processes · Machine Learning in Materials Science
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
DTIS, ONERA, Université Paris-Saclay, Palaiseau, France
DMAS, ONERA, Université Paris-Saclay, Châtillon, France
Funding
Agence de l’innovation de Défense
References (43)
Show source-provided references
1. 10.1364/AO.7.00174310.1364/AO.7.001743 ↗
2. 10.1080/17686733.2019.170573210.1080/17686733.2019.1705732 ↗
3. 10.1016/S1290-0729(99)80033-710.1016/S1290-0729(99)80033-7 ↗
4. 10.21611/qirt.2018.08010.21611/qirt.2018.080 ↗
5. 10.1088/1742-6596/214/1/01207210.1088/1742-6596/214/1/012072 ↗
6. 10.1088/0957-0233/22/3/03570110.1088/0957-0233/22/3/035701 ↗
7. 10.1063/1.514497210.1063/1.5144972 ↗
8. 10.1007/s10973-021-11181-810.1007/s10973-021-11181-8 ↗
9. Pech-May NW, Ziegler M. Detection of surface breaking cracks using flying line laser thermography: a Canny-based algorithm. Eng Proc. 2021 Nov;8(1):22.
10. 10.1016/j.optlaseng.2020.10643110.1016/j.optlaseng.2020.106431 ↗
11. Schmidt RM. Recurrent neural networks (RNNs): a gentle Introduction and overview. arXiv: 1912.05911 [Cs Stat]. 2019 Nov.
12. Helvig K, Gaverina L, Trouvé-Peloux P, et al. Toward deep learning fusion of flying spot thermography and visible inspection for surface cracks detection on metallic materials. Proceedings of the 2022 International Conference on Quantitative InfraRed Thermography; July 2022; Paris (France): QIRT Council; 2022.
13. Liang KJ Jain A Abbeel P. Generative adversarial network training is a continual learning Problem. arXiv: 1811.11083 [Cs Stat]. 2018 Nov.
14. Ho J Jain A Abbeel P. Denoising diffusion probabilistic models. Number: arXiv: 2006.11239 arXiv: 2006.11239 [Cs Stat]. 2020 Dec.
15. Dhariwal P Nichol A. Diffusion models beat GANs on image synthesis. arXiv: 2105.05233 [Cs Stat]. 2021 Jun.
16. Xie Y Li Q. Measurement-conditioned denoising diffusion probabilistic model for Under-sampled Medical image Reconstruction. Number: arXiv: 2203.03623 arXiv: 2203.03623 [Cs Eess]. 2022 Mar.
17. 10.5214/ans.0972-7531.101730910.5214/ans.0972-7531.1017309 ↗
18. 10.1016/j.cognition.2008.11.01410.1016/j.cognition.2008.11.014 ↗
19. 10.1145/1553374.155338010.1145/1553374.1553380 ↗
20. Hacohen G Weinshall D. On the power of curriculum learning in training deep networks. Number: arXiv: 1904.03626 arXiv: 1904.03626 [Cs Stat]. 2019 May.
21. Kilinc O Montana G. Follow the object: curriculum learning for manipulation tasks with imagined goals. arXiv: 2008.02066 arXiv: 2008.02066 [Cs Stat]. 2020 Aug.
22. Chevalier-Boisvert M Bahdanau D Lahlou S et al. BabyAI: a platform to study the sample efficiency of grounded language learning. arXiv: 1810.08272 [Cs]. 2019 Dec.
23. COMSOL Multiphysics. Introduction To Comsol multiphysics®. Burlington, MA: COMSOL Multiphysics; 1998 [cited 2018 Feb 9].
24. 10.1016/j.ndteint.2017.03.01010.1016/j.ndteint.2017.03.010 ↗
25. 10.1016/j.ijthermalsci.2019.10600010.1016/j.ijthermalsci.2019.106000 ↗
26. 10.1007/978-3-319-24574-4_2810.1007/978-3-319-24574-4_28 ↗
27. Wang P. lucidrains/denoising-diffusion-pytorch 2022 Oct. original-date: 2020-08-26T02:22:10Z.
28. Gulrajani I Kumar K Ahmed F et al. PixelVAE: a latent variable model for natural images. arXiv: 1611.05013 [Cs]. 2016 Nov.
29. Chadebec C Vincent LJ Allassonniere S. Pythae: unifying generative autoencoders in python - a benchmarking use case. 2022 Oct.
30. Kingma DP Jimmy B. Adam: a method for stochastic optimization. arXiv. 2014 Dec.
31. Ruder S. An overview of gradient descent optimization algorithms. arXiv. 2016 Sept.
32. Simonyan K Zisserman A. Very deep convolutional networks for large-scale image recognition. arXiv: 1409.1556 [Cs]. 2015 Apr.
33. Dosovitskiy A Beyer L Kolesnikov A et al. An image is worth 16x16 words: transformers for image recognition at scale. arXiv: 2010.11929 [Cs]. 2021 Jun.
34. Vaswani A Shazeer N Parmar N et al. Attention is all you need. Number: arXiv: 1706.03762 arXiv: 1706.03762 [Cs]. 2017 Dec.
35. Raghu M Unterthiner T Kornblith S et al. Do Vision transformers see like convolutional neural networks? 2021; 13.
36. 10.1109/ICCV48922.2021.0098610.1109/ICCV48922.2021.00986 ↗
37. Touvron H Cord M Sablayrolles A et al. Going deeper with image transformers. Number: arXiv: 2103.17239 arXiv: 2103.17239 [Cs]. 2021 Apr.10.1109/ICCV48922.2021.00010 ↗
38. 10.1109/CVPR.2005.17710.1109/CVPR.2005.177 ↗
39. Wightman R. Pytorch image models. 2019. Available from: https://github.com/rwightman/pytorch-image-models
40. David MWP. Evaluation: from precision recall and F-measure to ROC informedness markedness and correlation. arXiv. 2020 Oct.
41. Paul S Chen PY Vision transformers are robust learners. arXiv: 2105.07581 [Cs]. 2021 Dec.
42. Ruiz N Yuanzhen L Jampani V et al. DreamBooth: fine tuning text-to-image diffusion models for subject-driven generation. arXiv: 2208.12242 [Cs]. 2023 Mar.10.1109/CVPR52729.2023.02155 ↗
43. Ho J Saharia C Chan W et al. Cascaded diffusion models for high fidelity image generation. arXiv: 2106.15282 [Cs]. 2021 Dec.