Pulsed Thermography Dataset for Training Deep Learning Models
Source abstract
Abstract
Pulsed thermography is an indispensable tool in the field of non-destructive evaluation. However, the data generated by this technique can be challenging to analyze and require expertise to interpret. With the rapid progress in deep learning, image segmentation has become a well-established area of research. This has motivated efforts to apply deep learning methods to non-destructive evaluation data processing, including pulsed thermography. Despite this trend, there has been a lack of public pulsed thermography datasets available for the evaluation of various spatial-temporal deep learning models for segmentation tasks. This paper aims to address this gap by presenting the PVC-Infrared dataset for deep learning. In addition, we evaluated the performance of popular deep-learning-based instance segmentation models on this dataset. Furthermore, we examined the effect of the number of frames and data transformations on the performance of these models. The results of this study suggest that appropriate preprocessing techniques can significantly reduce the size of the data while maintaining the performance of deep learning models, thereby speeding up the data processing process. This highlights the potential for using deep learning methods to make non-destructive evaluation data analysis more efficient and accessible to a wider range of practitioners.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Thermography and Photoacoustic Techniques · Infrared Thermography in Medicine · Photoacoustic and Ultrasonic Imaging
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Engineering, University of Applied Sciences in Saarbrücken, 66117 Saarbrücken, Germany
Faculty of Science and Engineering, Department of Electrical and Computer Engineering, University Laval, Quebec City, QC G1V 0A6, Canada
Fraunhofer Institute for Nondestructive Testing IZFP, 66123 Saarbrücken, Germany
Chair of Cognitive Sensor Systems, Saarland University, 66123 Saarbrücken, Germany
Funding
European Regional Development Fund (ERDF)
References (42)
Show source-provided references
1. Imagenet classification with deep convolutional neural networks10.1145/3065386 ↗
2. Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv.
3. He, K., Zhang, X., Ren, S., and Sun, J. (July, January 26). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.
4. Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23–28). Rich feature hierarchies for accurate object detection and semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.10.1109/CVPR.2014.81 ↗
5. Girshick, R. (2015, January 7–13). Fast r-cnn. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.10.1109/ICCV.2015.169 ↗
6. Bochkovskiy, A., Wang, C.Y., and Liao, H.Y.M. (2020). Yolov4: Optimal speed and accuracy of object detection. arXiv.
7. Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5–9). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Munich, Germany.10.1007/978-3-319-24574-4_28 ↗
8. Zhao, H., Shi, J., Qi, X., Wang, X., and Jia, J. (2017, January 21–26). Pyramid scene parsing network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.660 ↗
9. Segnet: A deep convolutional encoder-decoder architecture for image segmentation10.1109/TPAMI.2016.2644615 ↗
10. Karpathy, A., Toderici, G., Shetty, S., Leung, T., Sukthankar, R., and Fei-Fei, L. (2014, January 23–28). Large-scale video classification with convolutional neural networks. Proceedings of the IEEE conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.10.1109/CVPR.2014.223 ↗
11. Wang, X., Girshick, R., Gupta, A., and He, K. (2018, January 18–23). Non-local neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00813 ↗
12. Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Fei-Fei, L. (2009, January 20–25). Imagenet: A large-scale hierarchical image database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.10.1109/CVPR.2009.5206848 ↗
13. The pascal visual object classes (voc) challenge10.1007/s11263-009-0275-4 ↗
14. Lin, T.Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., and Zitnick, C.L. (2014, January 6–12). Microsoft coco: Common objects in context. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland.10.1007/978-3-319-10602-1_48 ↗
15. Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., and Schiele, B. (2016, January 27–30). The cityscapes dataset for semantic urban scene understanding. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.350 ↗
16. Zhou, B., Zhao, H., Puig, X., Fidler, S., Barriuso, A., and Torralba, A. (2017, January 21–26). Scene parsing through ade20k dataset. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.544 ↗
17. Chakravarthy, A.D., Bonthu, S., Chen, Z., and Zhu, Q. (2019, January 16–19). Predictive models with resampling: A comparative study of machine learning algorithms and their performances on handling imbalanced datasets. Proceedings of the 2019 18th IEEE International Conference On Machine Learning Furthermore, Applications (ICMLA), Boca Raton, FL, USA.10.1109/ICMLA.2019.00245 ↗
18. Artificial intelligence for defect detection in infrared images of solid oxide fuel cells10.1016/j.infrared.2021.103815 ↗
19. Wei, Z., Fernandes, H., Herrmann, H.G., Tarpani, J.R., and Osman, A. (2021). A deep learning method for the impact damage segmentation of curve-shaped cfrp specimens inspected by infrared thermography. Sensors, 21.10.3390/s21020395 ↗
20. Fang, Q., Ibarra-Castanedo, C., and Maldague, X. (2021). Automatic defects segmentation and identification by deep learning algorithm with pulsed thermography: Synthetic and experimental data. Big Data Cogn. Comput., 5.10.3390/bdcc5010009 ↗
21. Chung, Y., Lee, S., and Kim, W. (2021). Latest advances in common signal processing of pulsed thermography for enhanced detectability: A review. Appl. Sci., 11.10.3390/app112412168 ↗
22. Fleuret, J.R., Ebrahimi, S., Ibarra-Castanedo, C., and Maldague, X.P. (2021). Independent component analysis applied on pulsed thermographic data for carbon fiber reinforced plastic inspection: A comparative study. Appl. Sci., 11.10.3390/app11104377 ↗
23. Qualitative and quantitative assessment of aerospace structures by pulsed thermography10.1080/10589750701448548 ↗
24. Jensen, F., Terlau, M., Sorg, M., and Fischer, A. (2021). Active Thermography for the Detection of Sub-Surface Defects on a Curved and Coated GFRP-Structure. Appl. Sci., 11.10.3390/app11209545 ↗
25. Verspeek, S., Ribbens, B., Maldague, X., and Steenackers, G. (2022). Spot Weld Inspections Using Active Thermography. Appl. Sci., 12.10.3390/app12115668 ↗
26. Active thermography testing and data analysis for the state of conservation of panel paintings10.1016/j.ijthermalsci.2017.12.036 ↗
27. Defect identification in composite materials via thermography and deep learning techniques10.1016/j.compstruct.2020.112405 ↗
28. Temporal and spatial deep learning network for infrared thermal defect detection10.1016/j.ndteint.2019.102164 ↗
29. Alhammad, M., Avdelidis, N., Ibarra-Castanedo, C., Torbali, M., Genest, M., Zhang, H., Zolotas, A., and Maldgue, X. (2022). Automated Impact Damage Detection Technique for Composites Based on Thermographic Image Processing and Machine Learning Classification. Sensors, 22.10.3390/s22239031 ↗
30. Automated Defect Detection in Non-planar Objects Using Deep Learning Algorithms10.1007/s10921-022-00845-6 ↗
31. Automated defect classification in infrared thermography based on a neural network10.1016/j.ndteint.2019.102147 ↗
32. Generative principal component thermography for enhanced defect detection and analysis
33. IRT-GAN: A generative adversarial network with a multi-headed fusion strategy for automated defect detection in composites using infrared thermography10.1016/j.compstruct.2022.115543 ↗
34. PTB-TIR: A thermal infrared pedestrian tracking benchmark10.1109/TMM.2019.2932615 ↗
35. Jia, X., Zhu, C., Li, M., Tang, W., and Zhou, W. (2021, January 11–17). LLVIP: A visible-infrared paired dataset for low-light vision. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada.10.1109/ICCVW54120.2021.00389 ↗
36. Thermal imaging dataset from composite material academic samples inspected by pulsed thermography10.1016/j.dib.2020.106313 ↗
37. University Laval Infrared Thermography Databases for Deep Learning Multiple Types of Defect Detections Training
38. Pulse phase infrared thermography10.1063/1.362662 ↗
39. A study of defect depth using neural networks in pulsed phase thermography: Modelling, noise, experiments10.1016/S0035-3159(98)80048-2 ↗
40. Principal component thermography for flaw contrast enhancement and flaw depth characterisation in composite structures10.1016/S0263-8223(02)00161-7 ↗
41. Iglovikov, V., and Shvets, A. (2018). Ternausnet: U-net with vgg11 encoder pre-trained on imagenet for image segmentation. arXiv.
42. Kingma, D.P., and Ba, J. (2015, January 7–9). Adam: A Method for Stochastic Optimization. Proceedings of the ICLR (Poster), San Diego, CA, USA.