A novel application of deep learning approach over IRT images for the automated detection of rising damp on historical masonries
Source abstract
Abstract
Nowadays, the fusion of Artificial Intelligence (AI) comprises a widespread approach for resolving various types of problems in many scientific domains including Protection of Monuments. Non-Destructive Testing (NDT) approaches and Infra-Red Thermography (IRT) specifically, plays a key role for the diagnosis and the assessment of the monuments’ preservation state. Additionally, IRT comprises a powerful tool for continuous monitoring especially when it concerns the physical and/or chemical processes that take place within or on the material and affect the irradiation of the historical surfaces. This study explores the application of Deep Learning (DL) to IRT images of passive approach, focusing on the automated detection of rising damp in historical masonries. The IRT data were acquired from two monuments, the Holy Aedicule of the Holy Sepulchre and the Historical Building "Msma’a". Exploiting the capabilities of AI for enhancing the non-intrusive nature of passive IRT, this research seeks to provide a cost-effective and non-destructive approach for the early identification of rising damp, contributing significantly to the long-term preservation, conservation, and protection of the cultural heritage. To achieve this, the study takes advantage of a combination of the PSPNet image segmentation model with the ResNet-50 backbone, the PSP_R50 model. The mmsegment framework, renowned for its versatility and effectiveness, serves as the ideal platform for training, evaluating, and fine-tuning the proposed segmentation model. Despite having a relatively small dataset, a highly effective segmentation model (0.93 accuracy, 0.89 IoU), has been successfully developed.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: 3D Surveying and Cultural Heritage · Thermography and Photoacoustic Techniques · Conservation Techniques and Studies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (36)
Show source-provided references
1. Cartz · 1995
2. Use of sonic and GPR tests to control the effectiveness of grout injections of stone masonry
3. Advances on the use of non-destructive techniques for mechanical characterization of stone masonry: GPR and sonic tests10.1016/j.prostr.2017.07.096 ↗
4. Multispectral applications of infrared thermography in the diagnosis and protection of built cultural heritage10.3390/app8020284 ↗
5. NDT as a monitoring tool of the works progress and the assessment of materials and rehabilitation interventions at the Holy Aedicule of the Holy Sepulchre10.1016/j.conbuildmat.2018.09.007 ↗
6. Machine learning and thermography applied to the detection and classification of cracks in building,"
7. Automatic detection and identification of defects by deep learning algorithms from pulsed thermography data10.3390/s23094444 ↗
8. Automatic detection of moistures in different construction materials from thermographic images10.1007/s10973-019-08264-y ↗
9. Defect identification in composite materials via thermography and deep learning techniques
10. Deep learning approach for the identification of structural layers in historic monuments from ground penetrating radar images
11. Application of infrared thermography to historic building investigation
12. Infrared thermographic inspection of murals and characterization of degradation in historic monuments10.1016/j.conbuildmat.2012.06.062 ↗
13. Thermal imaging for the archaeological investigation of historic buildings10.3390/rs10091401 ↗
14. Quantitative measurement of cast metal relics by pulsed thermal imaging10.1080/17686733.2020.1799304 ↗
15. Study of the historical mortars of the Holy Aedicule as a basis for the design, application and assessment of repair mortars: a multispectral approach applied on the Holy Aedicule10.1016/j.conbuildmat.2018.06.016 ↗
16. Metagenomics of the built cultural heritage: microbiota characterization of the building materials of the holy aedicule of the holy sepulchre in Jerusalem
17. IRT and GPR techniques for moisture detection and characterisation in buildings
18. In situ assessment of superficial moisture condition in façades of historic building using non-destructive techniques
19. Introduction of the combination of thermal fundamentals and Deep Learning for the automatic thermographic inspection of thermal bridges and water-related problems in infrastructures10.1080/17686733.2022.2060545 ↗
20. Quasi-quantitative infrared thermographic detection of moisture variation in facades with adhered ceramic cladding using principal component analysis10.1016/j.buildenv.2015.07.027 ↗
21. Introduction of deep learning in thermographic monitoring of cultural heritage and improvement by automatic thermogram pre-processing algorithms
22. Yi Liu, Fumin Wang, Kaixin Liu, Miranda Mostacci, Yuan Yao & Stefano Sfarra, " Deep convolutional autoencoder thermography for artwork defect detection," Quantitative InfraRed Thermography Journal, 2023.10.1080/17686733.2023.2225246 ↗
23. Automated classification of thermal defects in the building envelope using thermal and visible images10.1080/17686733.2022.2033531 ↗
24. Mitropoulos, The Church of Holy Sepulchre – The Work of Kalfas Komnenos (in Greek), European Centre of for Byzantine and Post-Byzantine Monuments, 2009.
25. A. Moropoulou, E. Korres, A. Georgopoulos, C. Spyrakos, Ch. Mouzakis, K.C. Lampropoulos, M. Apostolopoulou, E.T. Delegou, Emm. Alexakis, "The rehabilitation of the Holy Aedicule," in XXXIII International Conference on Science and Cultural Heritage: "THE NEW FRONTIERS OF RESTORATION. Transfers, Contaminations, Hybridizations , 2017.
26. Ground penetrating radar prospection of the construction phases of the Holy Aedicula of the Holy Sepulchre in correlation with architectural analysis10.1016/j.conbuildmat.2017.08.044 ↗
27. Lavas · 2009
28. Merging geometric documentation with materials characterization and analysis of the history of the holy aedicule in the Church of the Holy Sepulchre10.5194/isprs-archives-XLII-5-W1-487-2017 ↗
29. Hengshuang Zhao, Jianping Shi, Xiaojuan Qi, Xiaogang Wang, Jiaya Jia, Pyramid scene parsing network," in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017.
30. Kaiming He et al., Deep residual learning for image recognition, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition., 2016.
31. Chen, K., Wang, J., Pang, J., Cao, Y., Xiong, Y., Li, X.,. & Lin, D., MMDetection: Open mmlab detection toolbox and benchmark., Computer Vision and Pattern Recognition, 17 6 2019.
32. Xiang, Kaite, Kaiwei Wang, and Kailun Yang., Importance-aware semantic segmenta-tion with efficient pyramidal context network for navigational assistant systems., in: IEEE Intelligent Transportation Systems Conference (ITSC), 2019.10.1109/ITSC.2019.8917096 ↗
33. Coronary angiography image segmentation based on PSPNet
34. Wada Kentaro, Labelme: Image Polygonal Annotation with Python.
35. Data augmentation can improve robustness
36. M. Cordts, M. Omran, S. Ramos, T. Rehfeld, M. Enzweiler, R. Benenson, U. Franke, S. Roth, and B. Schiele, The Cityscapes Dataset for Semantic Urban Scene Understanding, in: Conference on Computer Vision and Pattern Recognition (CVPR), 2016.10.1109/CVPR.2016.350 ↗