journal article·2023-06

Using the Unsupervised Mixture of Gaussian Models for Multispectral Non-destructive Evaluation of the Replica of Botticelli’s “The Birth of Venus”

Qi Li, Hai Zhang, Jue Hu, Stefano Sfarra, Miranda Mostacci, Dazhi Yang, Marc Georges, Vladimir P. Vavilov, Xavier P. V. Maldague

Publisher page

Abstract

With increasing attention paid to the protection of cultural relics, non-destructive testing (NDT) technologies are thought to be profoundly rewarding, resulting in a widespread uptake of feature-extraction algorithms and defect-detection techniques. Among various alternatives, infrared thermography (IRT) and Terahertz time-domain spectroscopy (THz-TDS) are non-invasive in nature and thus are appropriate for applications involving ancient buildings and artworks. The present study is motivated by the fact that online/offline background segmentation algorithms based on the Gaussian mixture model and widely used in video processing to distinguish between foreground and background, can be successfully integrated as a feature extraction tool with NDT. Since IRT and THz-TDS image sequences resemble a video, the image length and width can be taken as the first two dimensions, and time can serve as the third one. Such sequences can be processed effectively by the background segmentation algorithms, thus can help detect defects of different types at varying depths. The experimental section of the paper considers a tempera painting (a replica of Botticelli’s “The Birth of Venus”) with artificiallyintroduced defects. For benchmarking purposes, the background segmentation algorithms (based on a mixture of Gaussian models) are compared with the fast Fourier transform and principal component analysis to demonstrate the superior performance of the proposed novel algorithms.
Source: openaire · Quality: candidate unverified · Source record ↗

Research context

OpenAlex topics: Thermography and Photoacoustic Techniques · Advanced Chemical Sensor Technologies · Essential Oils and Antimicrobial Activity

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (47)

Show source-provided references
1. Schumann, W., Zürcher, J.P., Cuche, D.: Holography and Deformation Analysis. Springer, Berlin, Heidelberg (1985). https://doi.org/10.1007/978-3-540-38981-1_110.1007/978-3-540-38981-1_1 ↗
2. Vest, C.M.: Holographic Interferometry. China Machine Press, Beijing (1984). (in Chinese)
3. Sfarra, S., Ibarra-Castanedo, C., Ambrosini, D., Paoletti, D., Bendada, A., Maldague, X.: Discovering the defects in paintings using non-destructive testing (NDT) techniques and passing through measurements of deformation. J. Nondestr. Eval. 33, 358–383 (2014). https://doi.org/10.1007/s10921-013-0223-710.1007/s10921-013-0223-7 ↗
4. Vincitorio, F., Ramil, A., López, A. J., Saavedra, E., Yáñez, A.: NDT testing by holographic interferometry applied to the structural diagnostic of artwork conservations by means of sound wave excitation. In: Eighth International Conference on Vibration Measurements by Laser Techniques: Advances and Applications, pp. 184–191 (2008). https://doi.org/10.1117/12.80299110.1117/12.802991 ↗
5. Li, X.: Wavelet transform for detection of partial fringe patterns induced by defects in nondestructive testing of holographic interferometry and electronic speckle pattern interferometry. Opt. Eng. 39, 2821–2827 (2000). https://doi.org/10.1117/1.130848510.1117/1.1308485 ↗
6. Markov, V.B., Boone, P.M., Burykin, N.M., Ovsyannikov, V.V.: Defect localization in museum items with traditional and electronic holographic nondestructive testing. In: International Conference on Optical Diagnostics of Materials and Devices for Opto-, Micro-, and Quantum Electronics, pp. 548–556 (1995). https://doi.org/10.1117/12.22622410.1117/12.226224 ↗
7. Alvarez-Arenas, T.G.: Acoustic impedance matching of piezoelectric transducers to the air. IEEE Trans. Ultrason. Ferroelectr. Freq. Control 51, 624–633 (2004). https://doi.org/10.1109/TUFFC.2004.132083410.1109/TUFFC.2004.1320834 ↗
8. Shanmugam, P., Iglesias, L., Michaud, J.F., Alquier, D., Colin, L., Dufour, I., Certon, D.: Broad bandwidth air-coupled micromachined ultrasonic transducers for gas sensing. Ultrasonics 114, 106410 (2021). https://doi.org/10.1016/j.ultras.2021.10641010.1016/j.ultras.2021.106410 ↗
9. Chang, J.J., Chen, Z.H.: Development and application of high signal-to-noise ratio air-coupled ultrasonic sensorin. 2019 Far East NDT New Technology & Application Forum (FENDT), pp. 173–177 (2019). https://doi.org/10.1109/FENDT47723.2019.896277710.1109/FENDT47723.2019.8962777 ↗
10. Minkina, W.: Theoretical basics of radiant heat transfer–practical examples of calculation for the infrared (IR) used in infrared thermography measurements. Quant. InfraRed Thermogr. J. 18, 269–282 (2021). https://doi.org/10.1080/17686733.2020.173816410.1080/17686733.2020.1738164 ↗
11. Vavilov, V.P., Karabutov, A.A., Chulkov, A.O., Derusova, D.A., Moskovchenko, A.I., Cherepetskaya, E.B., Mironova, E.A.: Comparative study of active infrared thermography, ultrasonic laser vibrometry and laser ultrasonics in application to the inspection of graphite/epoxy composite parts. Quant. InfraRed Thermogr. J. 17, 235–248 (2020). https://doi.org/10.1080/17686733.2019.164697110.1080/17686733.2019.1646971 ↗
12. Zhang, H., Sfarra, S., Saluja, K., Peeters, J., Fleuret, J., Duan, Y., Fernandes, H., Avdelidis, N., Ibarra-Castanedo, C., Maldague, X.: Non-destructive investigation of paintings on canvas by continuous wave terahertz imaging and flash thermography. J. Nondestr. Eval. 36, 1–12 (2017). https://doi.org/10.1007/s10921-017-0414-810.1007/s10921-017-0414-8 ↗
13. Hu, J., Zhang, H., Sfarra, S., Gargiulo, G., Avdelidis, N.P., Zhang, M., Yang, D., Maldague, X.: Non-destructive imaging of marqueteries based on a new infrared-terahertz fusion technique. Infrared Phys. Technol. (2022). https://doi.org/10.1016/j.infrared.2022.10427710.1016/j.infrared.2022.104277 ↗
14. Hu, J., Zhang, H., Sfarra, S., Pivarčiová, E., Yao, Y., Duan, Y., Ibarra-Castanedo, C., Tian, G., Maldague, X.: Autonomous dynamic line-scan continuous-wave terahertz non-destructive inspection system combined with unsupervised exposure fusion. NDT E Int. 132, 102705 (2022). https://doi.org/10.1016/j.ndteint.2022.10270510.1016/j.ndteint.2022.102705 ↗
15. Cooley, J.W., Lewis, P.A.W., Welch, P.D.: The fast Fourier transform and its applications. IEEE Trans. Educ. 12, 27–34 (1969). https://doi.org/10.1109/TE.1969.432043610.1109/TE.1969.4320436 ↗
16. Rajic, N.: Principal component thermography for flaw contrast enhancement and flaw depth characterisation in composite structures. Compos. Struct. 58, 521–528 (2002). https://doi.org/10.1016/S0263-8223(02)00161-710.1016/S0263-8223(02)00161-7 ↗
17. Marinetti, S., Finesso, L., Marsilio, E.: Matrix factorization methods: application to thermal NDT/E. NDT E Int. 39, 611–616 (2006). https://doi.org/10.1016/j.ndteint.2006.04.00810.1016/j.ndteint.2006.04.008 ↗
18. Ghaderi, H., Kabiri, P.: Automobile independent fault detection based on acoustic emission using FFT. In: Singapore International NDT Conference & Exhibition (SINCE 2011) (2011). https://www.ndt.net/article/SINCE2011/papers/11_Kabiri_Rev2.pdf
19. Hanbay, K., Talu, M.F., Özgüven, Ö.F.: Fabric defect detection systems and methods—a systematic literature review. Optik 127, 11960–11973 (2016). https://doi.org/10.1016/j.ijleo.2016.09.11010.1016/j.ijleo.2016.09.110 ↗
20. Marcomini, L.A., Cunha, A.L.: A comparison between background modelling methods for vehicle segmentation in highway traffic videos. arXiv Preprint. (2018). https://doi.org/10.48550/arXiv.1810.0283510.48550/arXiv.1810.02835 ↗
21. Stauffer, C., Grimson, W.E.L.: Adaptive background mixture models for real-time tracking. In: Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149), pp. 246–252 (1999). https://doi.org/10.1109/CVPR.1999.78463710.1109/CVPR.1999.784637 ↗
22. Allili, M.S., Bouguila, N., Ziou, D.: A robust video foreground segmentation by using generalized Gaussian mixture modeling. In: Fourth Canadian Conference on Computer and Robot Vision (CRV’07), pp. 503–509 (2007). https://doi.org/10.1109/CRV.2007.710.1109/CRV.2007.7 ↗
23. Dwork, C., Roth, A.: The algorithmic foundations of differential privacy. Found. Trends® Theor. Comput. Sci. 9, 211–407 (2014). https://doi.org/10.1561/040000004210.1561/0400000042 ↗
24. Meng, D., De La Torre, F.: Robust matrix factorization with unknown noise. In: 2013 IEEE International Conference on Computer Vision, pp. 1337–1344 (2013). https://doi.org/10.1109/ICCV.2013.16910.1109/ICCV.2013.169 ↗
25. Yong, H., Meng, D., Zuo, W., Zhang, L.: Robust online matrix factorization for dynamic background subtraction. IEEE Trans. Pattern Anal. Mach. Intell. 40, 1726–1740 (2017). https://doi.org/10.1109/TPAMI.2017.273235010.1109/TPAMI.2017.2732350 ↗
26. Botticelli, S.: The Birth of Venus. https://www.uffizi.it/en/artworks/birth-of-venus. Accessed 9 Sept 2022
27. Laureti, S., Malekmohammadi, H., Rizwan, M.K., Burrascano, P., Sfarra, S., Mostacci, M., Ricci, M.: Looking through paintings by combining hyper-spectral imaging and pulse-compression thermography. Sensors 19, 4335 (2019). https://doi.org/10.3390/s1919433510.3390/s19194335 ↗
28. Cielo, P.: Pulsed photothermal evaluation of layered materials. J. Appl. Phys. 56, 230–234 (1984). https://doi.org/10.1063/1.33375810.1063/1.333758 ↗
29. Bozzoli, F., Cattani, L., Mocerino, A., Rainieri, S., Tougri, I., Colaço, M.J.: Characterisation of the heat transfer in displaced enhancement devices by means of inverse problem approach applied to IR images. Quant. InfraRed Thermogr. J. 18, 108–126 (2021). https://doi.org/10.1080/17686733.2019.170069610.1080/17686733.2019.1700696 ↗
30. Sakagami, T., Kubo, S.: Applications of pulse heating thermography and lock-in thermography to quantitative nondestructive evaluations. Infrared Phys. Technol. 43, 211–218 (2002). https://doi.org/10.1016/S1350-4495(02)00141-X10.1016/S1350-4495(02)00141-X ↗
31. Maldague, X., Galmiche, F., Ziadi, A.: Advances in pulsed phase thermography. Infrared Phys. Technol. 43, 175–181 (2002). https://doi.org/10.1016/S1350-4495(02)00138-X10.1016/S1350-4495(02)00138-X ↗
32. Maldague, X., Krapez, J.C., Cielo, P.: Subsurface flaw detection in reflective materials by thermal-transfer imaging. In: Thermosense XI: International Conference on Thermal Infrared Sensing for Diagnostics and Control, vol. 1094, pp. 163–174 (1989). https://doi.org/10.1117/12.95339910.1117/12.953399 ↗
33. Larbi Youcef, M., Feuillet, V., Ibos, L., Candau, Y.: In situ quantitative diagnosis of insulated building walls using passive infrared thermography. Quant. InfraRed Thermogr. J. 19, 41–69 (2022). https://doi.org/10.1080/17686733.2020.180593910.1080/17686733.2020.1805939 ↗
34. Tao, N., Wang, C., Zhang, C., Sun, J.: Quantitative measurement of cast metal relics by pulsed thermal imaging. Quant. InfraRed Thermogr. J. 19, 27–40 (2022). https://doi.org/10.1080/17686733.2020.179930410.1080/17686733.2020.1799304 ↗
35. Liu, K., Huang, K.L., Sfarra, S., Yang, J., Liu, Y., Yao, Y.: Factor analysis thermography for defect detection of panel paintings. Quant. InfraRed Thermogr. J. (2022). https://doi.org/10.1080/17686733.2021.201965810.1080/17686733.2021.2019658 ↗
36. Serantoni, V., Jourdan, F., Louche, H., Sultan, A.: Proposal for a protocol using an infrared microbolometer camera and wavelet analysis to study foot thermoregulation. Quant. InfraRed Thermogr. J. 18, 73–91 (2021). https://doi.org/10.1080/17686733.2019.169784710.1080/17686733.2019.1697847 ↗
37. Shoa, P., Hemmat, A., Gheysari, M., Amirfattahi, R.: Effect of micro climatic indices on the accuracy of thermographic plant water status monitoring, case study of a semi-arid area. Quant. InfraRed Thermogr. J. 18, 283–299 (2021). https://doi.org/10.1080/17686733.2020.176849610.1080/17686733.2020.1768496 ↗
38. Hebling, J., Yeh, K.L., Hoffmann, M.C., Nelson, K.A.: High-power THz generation, THz nonlinear optics, and THz nonlinear spectroscopy. IEEE J. Sel. Top. Quantum Electron. 14, 345–353 (2008). https://doi.org/10.1109/JSTQE.2007.91460210.1109/JSTQE.2007.914602 ↗
39. Zhong, S.: Progress in terahertz nondestructive testing: a review. Front. Mech. Eng. 14, 273–281 (2019). https://doi.org/10.1007/s11465-018-0495-910.1007/s11465-018-0495-9 ↗
40. Redo-Sanchez, A., Laman, N., Schulkin, B., Tongue, T.: Review of terahertz technology readiness assessment and applications. J. Infrared Millim. Terahertz Waves 34, 500–518 (2013). https://doi.org/10.1007/s10762-013-9998-y10.1007/s10762-013-9998-y ↗
41. Guo, J.: Study on terahertz time-domain spectral imaging. Dissertation, Changchun University of Science and Technology (2019)
42. Moon, T.K.: The expectation-maximization algorithm. IEEE Signal Process. Mag. 13, 47–60 (1996). https://doi.org/10.1109/79.54397510.1109/79.543975 ↗
43. Cao, X., Zhao, Q., Meng, D., Chen, Y., Xu, Z.: Robust low-rank matrix factorization under general mixture noise distributions. IEEE Trans. Image Process. 25, 4677–4690 (2016). https://doi.org/10.1109/TIP.2016.259334310.1109/TIP.2016.2593343 ↗
44. Wang, X., Gou, S., Wang, X., Zhao, Y., Zhang, L.: Patch-based gaussian mixture model for concealed object detection in millimeter-wave images. In: TENCON 2018-2018 IEEE Region 10 Conference, pp. 2522–2527 (2018). https://doi.org/10.1109/TENCON.2018.865014810.1109/TENCON.2018.8650148 ↗
45. Kroonenberg, P.M., De Leeuw, J.: Principal component analysis of three-mode data by means of alternating least squares algorithms. Psychometrika 45, 69–97 (1980). https://doi.org/10.1007/BF0229359910.1007/BF02293599 ↗
46. Gauvain, J.L., Lee, C.H.: Maximum a posteriori estimation for multivariate Gaussian mixture observations of Markov chains. IEEE Trans. Speech Audio Process. 2, 291–298 (1994). https://doi.org/10.1109/89.27927810.1109/89.279278 ↗
47. Ibarra-Castanedo, C., Maldague, X.P.: Handbook of Technical Diagnostics, pp. 175–220. Springer, Berlin, Heidelberg (2013). https://doi.org/10.1007/978-3-642-25850-3_1010.1007/978-3-642-25850-3_10 ↗