journal article·2025-09-28Open access

High-Resolution 3D Thermal Mapping: From Dual-Sensor Calibration to Thermally Enriched Point Clouds

Neri Edgardo Güidi, Andrea di Filippo, Salvatore Barba

Applied Sciences· Volume 15· Issue 19

Abstract

Thermal imaging is increasingly applied in remote sensing to identify material degradation, monitor structural integrity, and support energy diagnostics. However, its adoption is limited by the low spatial resolution of thermal sensors compared to RGB cameras. This study proposes a modular pipeline to generate thermally enriched 3D point clouds by fusing RGB and thermal imagery acquired simultaneously with a dual-sensor unmanned aerial vehicle system. The methodology includes geometric calibration of both cameras, image undistortion, cross-spectral feature matching, and projection of radiometric data onto the photogrammetric model through a computed homography. Thermal values are extracted using a custom parser and assigned to 3D points based on visibility masks and interpolation strategies. Calibration achieved 81.8% chessboard detection, yielding subpixel reprojection errors. Among twelve evaluated algorithms, LightGlue retained 99% of its matches and delivered a reprojection accuracy of 18.2% at 1 px, 65.1% at 3 px and 79% at 5 px. A case study on photovoltaic panels demonstrates the method’s capability to map thermal patterns with low temperature deviation from ground-truth data. Developed entirely in Python, the workflow integrates into Agisoft Metashape or other software. The proposed approach enables cost-effective, high-resolution thermal mapping with applications in civil engineering, cultural heritage conservation, and environmental monitoring applications.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Thermography and Photoacoustic Techniques · Calibration and Measurement Techniques · Infrared Target Detection Methodologies

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Civil Engineering, University of Salerno, 84084 Fisciano, SA, Italy

References (40)

Show source-provided references
1. Patrucco, G., Gómez, A., Adineh, A., Rahrig, M., and Lerma, J.L. (2022). 3D Data Fusion for Historical Analyses of Heritage Buildings Using Thermal Images: The Palacio de Colomina as a Case Study. Remote Sens., 14.10.3390/rs14225699 ↗
2. Sutherland, N., Marsh, S., Priestnall, G., Bryan, P., and Mills, J. (2023). InfraRed Thermography and 3D-Data Fusion for Architectural Heritage: A Scoping Review. Remote Sens., 15.10.3390/rs15092422 ↗
3. Kantaros, A., Ganetsos, T., and Petrescu, F.I. (2023). Three-Dimensional Printing and 3D Scanning: Emerging Technologies Exhibiting High Potential in the Field of Cultural Heritage. Appl. Sci., 13.10.3390/app13084777 ↗
4. Ramm, R., de Dios Cruz, P., Heist, S., Kühmstedt, P., and Notni, G. (2024). Fusion of Multimodal Imaging and 3D Digitization Using Photogrammetry. Sensors, 24.10.3390/s24072290 ↗
5. Paziewska, J., and Rzonca, A. (2022). Integration of Thermal and RGB Data Obtained by Means of a Drone for Interdisciplinary Inventory. Energies, 15.10.3390/en15144971 ↗
6. Adamopoulos, E., Volinia, M., Girotto, M., and Rinaudo, F. (2020). Three-Dimensional Thermal Mapping from IRT Images for Rapid Architectural Heritage NDT. Buildings, 10.10.3390/buildings10100187 ↗
7. Investigation on Performance of RGB Point Cloud and Thermal Information Data Fusion for 3D Building Thermal Map Modeling Using Aerial Images under Different Experimental Conditions10.1016/j.jobe.2021.103380 ↗
8. ElSheikh, A., Abu-Nabah, B.A., Hamdan, M.O., and Tian, G.-Y. (2023). Infrared Camera Geometric Calibration: A Review and a Precise Thermal Radiation Checkerboard Target. Sensors, 23.10.3390/s23073479 ↗
9. Thermal Point Clouds of Buildings: A Review10.1016/j.enbuild.2022.112425 ↗
10. Ioannides, M., Fink, E., Cantoni, L., and Champion, E. (2020, January 2–5). 3D Thermal Mapping of Architectural Heritage. Proceedings of the Digital Heritage. Progress in Cultural Heritage: Documentation, Preservation, and Protection, Virtual Event.10.1007/978-3-030-73043-7 ↗
11. Sarlin, P.-E., DeTone, D., Malisiewicz, T., and Rabinovich, A. (2020, January 13–19). SuperGlue: Learning Feature Matching with Graph Neural Networks. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.00499 ↗
12. Lindenberger, P., Sarlin, P.-E., and Pollefeys, M. (2023, January 11–17). LightGlue: Local Feature Matching at Light Speed. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada.10.1109/ICCV51070.2023.01616 ↗
13. Wang, Y., He, X., Peng, S., Tan, D., and Zhou, X. (2024, January 16–22). Efficient LoFTR: Semi-Dense Local Feature Matching with Sparse-Like Speed. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR52733.2024.02047 ↗
14. A Novel Application of Deep Learning Approach over IRT Images for the Automated Detection of Rising Damp on Historical Masonries
15. A Passive Stereo Calibration Technique for Visible-Thermal, Low-Resolution Imaging in Remote Sensing Applications10.1016/j.measurement.2024.114647 ↗
16. Dlesk, A., Vach, K., and Pavelka, K. (2021). Transformations in the Photogrammetric Co-Processing of Thermal Infrared Images and RGB Images. Sensors, 21.10.3390/s21155061 ↗
17. Wang, S., Leroy, V., Cabon, Y., Chidlovskii, B., and Revaud, J. (2024, January 16–22). DUSt3R: Geometric 3D Vision Made Easy. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR52733.2024.01956 ↗
18. Leonardis, A., Ricci, E., Roth, S., Russakovsky, O., Sattler, T., and Varol, G. (October, January 29). Grounding Image Matching in 3D with MASt3R. Proceedings of the Computer Vision—ECCV 2024, Milan, Italy.10.1007/978-3-031-72980-5 ↗
19. Tuzcuoğlu, Ö., Köksal, A., Sofu, B., Kalkan, S., and Alatan, A.A. (2024, January 16–22). XoFTR: Cross-Modal Feature Matching Transformer. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPRW63382.2024.00431 ↗
20. Liu, Y., Lai, W., Zhao, Z., Xiong, Y., Zhu, J., Cheng, J., and Xu, Y. (2025). LiftFeat: 3D Geometry-Aware Local Feature Matching. arXiv.10.1109/ICRA55743.2025.11127853 ↗
21. Chen, G., Fu, T., Chen, H., Teng, W., Xiao, H., and Zhao, Y. (2025, January 11–15). RDD: Robust Feature Detector and Descriptor Using Deformable Transformer. Proceedings of the Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR52734.2025.00599 ↗
22. Edstedt, J., Bökman, G., Wadenbäck, M., and Felsberg, M. (2024, January 18–21). DeDoDe: Detect, Don’t Describe—Describe, Don’t Detect for Local Feature Matching. Proceedings of the 2024 International Conference on 3D Vision (3DV), Davos, Switzerland.10.1109/3DV62453.2024.00035 ↗
23. Edstedt, J., Bökman, G., and Zhao, Z. (2024, January 16–22). DeDoDe v2: Analyzing and Improving the DeDoDe Keypoint Detector. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPRW63382.2024.00428 ↗
24. Shen, X., Cai, Z., Yin, W., Müller, M., Li, Z., Wang, K., Chen, X., and Wang, C. (2024). GIM: Learning Generalizable Image Matcher from Internet Videos. arXiv.
25. Edstedt, J., Sun, Q., Bökman, G., Wadenbäck, M., and Felsberg, M. (2023, January 17–24). RoMa: Robust Dense Feature Matching. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.10.1109/CVPR52733.2024.01871 ↗
26. Jiang, H., Karpur, A., Cao, B., Huang, Q., and Araujo, A. (2024, January 16–22). OmniGlue: Generalizable Feature Matching with Foundation Model Guidance. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR52733.2024.01878 ↗
27. Thermal Reality Capturing with the Microsoft HoloLens 2 for Energy System Analysis10.1016/j.enbuild.2023.113020 ↗
28. A Geometric Calibration Method for Thermal Cameras Using a ChArUco Board10.1016/j.infrared.2024.105219 ↗
29. Sher, B.A., Xu, X., Chen, G., and Feng, C. (2023, January 5–7). Marker-Based Extrinsic Calibration for Thermal-RGB Camera Pair with Different Calibration Board Materials. Proceedings of the 40th ISARC, Chennai, India.10.22260/ISARC2023/0066 ↗
30. Automatic calibration and co-registration for a stereo camera system and a thermal imaging sensor using a chessboard10.5194/isprs-archives-XLII-2-W13-1631-2019 ↗
31. Rzeszotarski, D., and Wiecek, B. (2008, January 2–5). Calibration for 3D Reconstruction of Thermal Images. Proceedings of the 2008 International Conference on Quantitative InfraRed Thermography, QIRT Council, Krakow, Poland.10.21611/qirt.2008.14_03_04 ↗
32. Saponaro, P., Sorensen, S., Rhein, S., and Kambhamettu, C. (2015, January 27–30). Improving Calibration of Thermal Stereo Cameras Using Heated Calibration Board. Proceedings of the 2015 IEEE International Conference on Image Processing (ICIP), Quebec City, QC, Canada.10.1109/ICIP.2015.7351702 ↗
33. Plane Chessboard-Based Calibration Method for a LWIR Ultra-Wide-Angle Camera10.1364/AO.58.000744 ↗
34. Hong, M., Lu, Y., Ye, N., Lin, C., Zhao, Q., and Liu, S. (2022, January 18–24). Unsupervised Homography Estimation with Coplanarity-Aware GAN. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.01714 ↗
35. Zhang, J., Wang, C., Liu, S., Jia, L., Ye, N., Wang, J., Zhou, J., and Sun, J. (2020, January 23–28). Content-Aware Unsupervised Deep Homography Estimation. Proceedings of the European Conference on Computer Vision, Glasgow, UK.10.1007/978-3-030-58452-8_38 ↗
36. Sarlin, P.-E., Cadena, C., Siegwart, R., and Dymczyk, M. (2019, January 15–20). From Coarse to Fine: Robust Hierarchical Localization at Large Scale. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.01300 ↗
37. Zhang, Z. (2021). Camera Calibration. Computer Vision, Springer.10.1007/978-3-030-63416-2_164 ↗
38. Kuenzer, C., and Dech, S. (2013). Geometric Calibration of Thermographic Cameras. Thermal Infrared Remote Sensing: Sensors, Methods, Applications, Springer.10.1007/978-94-007-6639-6 ↗
39. A Mask-Based Approach for the Geometric Calibration of Thermal-Infrared Cameras10.1109/TIM.2012.2182851 ↗
40. Parrinello, S., and De Marco, R. (2023). Digital Strategies for Endangered Cultural Heritage: Forthcoming Interspecies. Handbook of Research on Strategies and Creative Interdisciplinarity for the Digitization and Safeguard of Endangered Heritage, Pavia University Press.