Digital restoration of mural paintings from late Tang tomb M1373 in Xi’an based on hyperspectral analysis and image interaction processing
Source abstract
Abstract
In this study, we take the mural of the Late Tang M1373 tomb unearthed in the eastern suburbs of Xi’an, Shaanxi Province in November 2022 as the object, focus on the insufficient consideration of color authenticity in the current use of image processing for mural visual restoration, as well as the lack of systematic mural color and visual restoration method based on hyperspectral images. A improved spectral recognition method of mural pigment based on fusion spectral analysis and mixed spectral modeling was used in real scene; a virtual restoration method for mural pigment colors based on bandpass energy integration, pseudocolor display and color space correction was proposed; in addition, a integrity restoration of painting patterns including draft line enhancement and human-computer interaction image processing was used in the real mural color restoration. The experimental results show that the mural uses traditional mineral pigments such as ochre, earth yellow, mineral green and carbon black for its red, yellow, green and black pigments, and the accuracy rate of this method is higher than 97% in simulation experiments with noise of %4 spectral amplitude. Meanwhile, the richness of painting color of the restoration results is significantly improved compared to the original color photos, especially, the new method with color space correction is significantly better than the method without color space correction in texture.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Cultural Heritage Materials Analysis · Conservation Techniques and Studies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (33)
Show source-provided references
1. Chen, A. D. et al. Excavation report on M1373 of the late Tang dynasty mural tomb in Baiyangzhai, Xiaan, Shaanxi (in Chinese). Archaeol. Cultural. Relics 1, 50–61 (2024).
2. Shi, Y. Z. & Wang, X. Y. A spatial study of the relics of Chinese tomb murals. Religions 14, 166–166 (2023).10.3390/rel14020166 ↗
3. Gao, Y. et al. Multidimensional knowledge discovery of cultural relics resources in the Tang tomb mural category. Electron. Libr. 42, 1–22 (2024).10.1108/EL-04-2023-0091 ↗
4. Yang, J. L., Cao, J., Yang, H. M., Li, Y. H. & Wang, J. L. Digitally assisted preservation and restoration of a fragmented mural in a Tang tomb. Sens. Imaging 22, 32–32 (2021).10.1007/s11220-021-00354-2 ↗
5. Fu, X. Y. et al. Digital color restoration of soot covered murals in the Mogao Grottoes at Dunhuang (in Chinese). Dunhuang. Res 1, 137–147 (2021).
6. Singh, U., Maiti, S., Saini, A. & Dhiraj. Ancient Indian murals digital restoration through image inpainting. In: Proceedings of the 10th International Conference on Signal Processing and Integrated Networks, SPIN 2023:635-640.10.1109/SPIN57001.2023.10116111 ↗
7. Yong, M. D., Jia, Q. L. & Ping, X. Costume digital restoration of the tomb mural of YanFei. J. Fiber Bioeng. Inform. 16, 351–366 (2023).10.3993/jfbim03046 ↗
8. Zheng, S. Intangible heritage restoration of damaged tomb murals through augmented reality technology: A case study of Zhao Yigong tomb murals in Tang dynasty of China. J. Cultural Herit. 69, 135–147 (2024).10.1016/j.culher.2024.08.005 ↗
9. Liu, K. X., Wu, H. H., Ji, Y. B. & Zhu, C. Archaeology and restoration of costumes in Tang tomb murals based on reverse engineering and human-computer interaction technology. Sustainability 14, 6232–6232 (2022).10.3390/su14106232 ↗
10. Xu, Z. S. et al. Mural rescue: Advancing blind mural restoration via SAM-adapter enhanced damage segmentation and integrated restoration techniques. In: Proceedings of the 20th International Conference on Intelligent Computing (ICIC).2024:456-463.10.1007/978-981-97-5600-1_40 ↗
11. Liu, Z. J., Xu, W. Z., Zhang, Y. J., Wang, Y. Y. & Li, J. W. Identification of the pigments on the mural paintings from an ancient Chinese tomb of Tang dynasty using micro-raman and scanning electron microscopy/energy dispersive X-ray spectroscopy analysis. Minerals 13, 1–11 (2023).10.3390/min13091224 ↗
12. Guo, R. et al. Analysis and research on yellow pigment of Tang tomb murals unearthed in Xi’an (in Chinese). Sci. Cultural Relics Prot. Archaeol. 31, 62–71 (2019).
13. Ma, Z. Z., Yan, J., Zhao, X. C., Václav, P. & Huang, X. J. Discussion and analysis on cementation materials of tomb murals (in Chinese). Archaeology. Cultural. Relics 5, 123–128 (2021).
14. Lv, C. H., Li, Z. L., Shen, Y. H., Li, J. H. & Zheng, J. SeparaFill: Two generators connected mural image restoration based on generative adversarial network with skip connect. Herit. Sci. 10, 1–13 (2022).10.1186/s40494-022-00771-w ↗
15. Wu, M., Chang, X. & Wang, J. Fragments inpainting for tomb murals using a dual-attention mechanism GAN with improved generators. Appl. Sci.-Basel 13, 3972–3972 (2023).10.3390/app13063972 ↗
16. Yan, Y. et al. Image restoration technology of Tang dynasty tomb murals using adversarial edge learning. ACM J. Comput. Cultural Herit. 17, 1–11 (2024).10.1145/3674984 ↗
17. Zhou, S. T. & Xie, Y. H. Intelligent restoration technology of mural digital image based on machine learning algorithm. Wirel. Commun. Mob. Comput. 2022, 1–12 (2022).10.1155/2022/9092062 ↗
18. Shi, W. & Meng, X. P. Mural restoration research based on samples and deep learning. In: Proceedings of the 2024 IEEE International Conference on Information Technology, Electronics and Intelligent Communication Systems, ICITEICS 2024, 1–4 (2024).10.1109/ICITEICS61368.2024.10625359 ↗
19. Cheng, Y. M. & Xu, Z. G. Restoration of damaged mural images based on recurrent feature inference and global-local attention. In: Proceedings of the 2023 IEEE International Conference on Image Processing and Computer Applications, ICIPCA 2023,115–120 (2023).10.1109/ICIPCA59209.2023.10257777 ↗
20. Ren, Y. K. & Liu, F. The spectral inversion model for electrical conductivity in mural plaster following phosphate erosion based on fractional order differentiation and novel spectral indices. Herit. Sci. 12, 1–27 (2024).10.1186/s40494-024-01385-0 ↗
21. Yu, K. et al. Automatic labeling framework for paint loss disease of ancient murals based on hyperspectral image classification and segmentation. Herit. Sci. 12, 1–12 (2024).10.1186/s40494-024-01316-z ↗
22. Li, J. F. & Wan, X. X. Study on non-destructive identification of mineral pigments of mural cultural relics by visible spectroscopy (in Chinese). Spectrosc. Spectr. Anal. 38, 200–204 (2018).
23. Li, G. H. et al. Study on the application of an automatic hyperspectral scanning system to investigate Chinese paintings (in Chinese). Chinese Museum, 180–185 (2021).
24. Ramani, K., Yukitha, P., Karthik, S.,Chowdary, K. A. & Akash, M. Advancements in hyperspectral image processing using machine learning. In: Proceedings of 2024 IEEE international conference on information technology, electronics and intelligent communication systems, ICITEICS 2024.2024.10.1109/ICITEICS61368.2024.10625396 ↗
25. Li, X. Y., Li, Z. M., Qiu, H. M., Hou, G. L. & Fan, P. P. An overview of hyperspectral image feature extraction, classification methods and the methods based on small samples. Appl. Spectrosc. Rev. 58, 367–400 (2023).10.1080/05704928.2021.1999252 ↗
26. Galli, A. et al. An innovative protocol for the study of painting materials involving the combined use of MA-XRF maps and hyperspectral images. Eur. Phys. J. 137, 1–16 (2021).
27. Zeng, Z. M. et al. Virtual restoration of ancient tomb murals based on hyperspectral imaging. Herit. Sci. 12, 410 (2024).10.1186/s40494-024-01501-0 ↗
28. Wang, K., Wang, H. Q., Yin, Y., Mao, L. & Zhang, Y. Color restoration and evaluation of murals based on spectral reconstruction technology (in Chinese). Laser Technol. 43, 280–285 (2019).
29. Zhao, J. Tomb mural image enhancement based on improved CycleGAN. In: Proceedings of International Conference on Virtual Reality, Human-Computer Interaction and Artificial Intelligence (VRHCIAI). 242–247 (2022).10.1109/VRHCIAI57205.2022.00049 ↗
30. Qiao, K. Z., Hou, M. L., Lyu, S. Q. & Li, L. H. Extraction and restoration of scratched murals based on hyperspectral imaging-a case study of murals in the east wall of the sixth grotto of Yungang Grottoes, Datong, China. Herit. Sci. 12, 1–20 (2024).10.1186/s40494-024-01215-3 ↗
31. Sun, P. Y. et al. Virtual cleaning of sooty mural hyperspectral images using the LIME model and improved dark channel prior. Sci. Rep. 14, 1–20 (2024).10.1038/s41598-023-50600-8 ↗
32. Ren, H., Sun, K., Zhao, F. H. & Zhu, X. Dunhuang murals image restoration method based on generative adversarial network. Herit. Sci. 12, 1–20 (2024).10.1186/s40494-024-01159-8 ↗
33. Yang, W. Z., Tang, X. J., Zhang, P. C., Hu, B. L. & Jin, Z. L. Research on a method for virtual restoration of the colors of tomb mural pigments based on spectral fusion analysis (in Chinese). Sci. Conserv. Archaeol. 35, 11–23 (2023).