journal article·2026-02-19Open access

Individual-Aware Gradient Boosting Regression for Visual Saliency Prediction of Damaged Regions in Ancient Murals

Naiyu Xie, Yingchun Cao, Bowen Zhang

Applied Sciences· Volume 16· Issue 4

Abstract

Murals are vital cultural heritage assets, yet many are increasingly threatened by long-term natural weathering, environmental erosion, and human-induced damage. Given limited conservation resources, an objective method for prioritizing restoration is urgently needed. This study proposes an Individual-Aware Gradient Boosting Regression (IA-GBR) approach to predict the visual saliency of damaged mural regions by integrating physical damage characteristics, spatial location, and observer identity. We construct an eye-tracking dataset containing complete fixation records from multiple participants viewing diverse mural damage types. IA-GBR employs a two-level feature fusion strategy that combines damage, spatial, and individual features within a gradient boosting residual learning framework. The experimental results demonstrate that IA-GBR consistently outperforms baseline methods, including linear and ridge regression, SVR, decision trees, random forests, AdaBoost, and multilayer perceptrons. Feature importance analysis further reveals the relative contributions of individual differences, damage size, spatial position, and semantic factors to saliency formation. The proposed framework provides data-driven support for restoration prioritization and advances perception-aware saliency modeling in cultural heritage conservation.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Visual Attention and Saliency Detection · Aesthetic Perception and Analysis · Urban Green Space and Health

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Civil Engineering and Architecture, Jiangsu University of Science and Technology, Zhenjiang 212003, China

Funding

Jiangsu University of Science and Technology Research Initiation Fund

References (45)

Show source-provided references
1. Mora, P. (1974). Causes of Deterioration of Mural Paintings, International Centre for the Study of the Preservation and the Restoration of Cultural Property (ICCROM).
2. Pedersoli, J.L., Antomarchi, C., and Michalski, S. (2016). A Guide to Risk Management of Cultural Heritage, ICCROM-ATHAR.
3. Wang, Y., and Wu, X. (2023). Current progress on murals: Distribution, conservation and utilization. Herit. Sci., 11.10.1186/s40494-023-00904-9 ↗
4. Yang, J., Cao, J., Yang, H., Li, Y., and Wang, J. (2021). Digitally assisted preservation and restoration of a fragmented mural in a Tang Tomb. Sens. Imaging, 22.10.1007/s11220-021-00354-2 ↗
5. Kanlı, B.K. (2019). Assessment of Changes in Values of Cultural Heritage Buildings due to Adaptive Reuse Works in Walled City of Nicosia. [Master’s Thesis, Eastern Mediterranean University (EMU)-Doğu Akdeniz Üniversitesi (DAÜ)].
6. A study on the diagnosis technology for conservation status of painting cultural heritage using digital image analysis program10.3390/heritage6020098 ↗
7. Performance-based assessment of cultural heritage assets: Outcomes of the European FP7 PERPETUATE project10.1007/s10518-014-9674-1 ↗
8. Wu, X., Yu, Y., and Li, Y. (2025). A damage detection network for ancient murals via multi-scale boundary and region feature fusion. npj Herit. Sci., 13.10.1038/s40494-025-01546-9 ↗
9. MOSAIC-Tracker: Mutual-enhanced Occlusion-aware Spatiotemporal Adaptive Identity Consistency network for aerial multi-object tracking10.1016/j.isprsjprs.2025.08.013 ↗
10. Liu, K., Zou, J., Zhang, W., Li, Q., and Wang, Q. (2025). MSDP-Net: Multi-scale Distribution Perception Network for Rotating Object Detection in Remote Sensing. Pattern Recogn., 172.10.1016/j.patcog.2025.112740 ↗
11. Zhang, W., Li, Q., and Wang, Q. (2025). Refined Cascade Cost Volume for Multiview Remote Sensing Image Reconstruction. IEEE Trans. Geosci. Remote Sens., 63.10.1109/TGRS.2025.3595544 ↗
12. Zhang, W., Yang, Z., Li, Q., and Wang, Q. (2025). Semantic-Guided Multiview Stereo Reconstruction for Aerial Image. IEEE Trans. Geosci. Remote Sens., 63.10.1109/TGRS.2025.3585623 ↗
13. Zhang, W., Li, Q., Yuan, Y., and Wang, Q. (2024). Visual Consistency Enhancement for Multiview Stereo Reconstruction in Remote Sensing. IEEE Trans. Geosci. Remote Sens., 62.10.1109/TGRS.2024.3482697 ↗
14. Chen, L., Wu, L., and Wan, J. (2025). Damage detection and digital reconstruction method for grotto murals based on YOLOv10. npj Herit. Sci., 13.10.1038/s40494-025-01607-z ↗
15. Van Vijle, A., Hacıgüzeller, P., and Van der Snickt, G. (2025). Machine learning for painting conservation: A state-of-the-art review. npj Herit. Sci., 13.10.1038/s40494-025-01924-3 ↗
16. Sumathi, G., and Uma Devi, M. (2024). Inpainting of damaged temple murals using edge-and line-guided diffusion patch GAN. Front. Artif. Intell., 7.10.3389/frai.2024.1453847 ↗
17. Saleem, M.R., Mayne, R., and Napolitano, R. (2024). Evaluating human expert knowledge in damage assessment using eye tracking: A disaster case study. Buildings, 14.10.3390/buildings14072114 ↗
18. Pierdicca, R., Paolanti, M., Quattrini, R., Mameli, M., and Frontoni, E. (2020). A visual attentive model for discovering patterns in eye-tracking data—A proposal in cultural heritage. Sensors, 20.10.3390/s20072101 ↗
19. Mandolesi, S., Gambelli, D., Naspetti, S., and Zanoli, R. (2022). Exploring visitors’ visual behavior using eye-tracking: The case of the “Studiolo Del Duca”. J. Imaging, 8.10.3390/jimaging8010008 ↗
20. A model of saliency-based visual attention for rapid scene analysis10.1109/34.730558 ↗
21. Graph-based visual saliency
22. Hou, X., and Zhang, L. (2007). Saliency detection: A spectral residual approach. Proceedings of the 2007 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE.10.1109/CVPR.2007.383267 ↗
23. Bruce, N.D.B., and Tsotsos, J.K. (2009). Saliency, attention, and visual search: An information theoretic approach. J. Vis., 9.10.1167/9.3.5 ↗
24. Kümmerer, M., Theis, L., and Bethge, M. (2014). Deep gaze i: Boosting saliency prediction with feature maps trained on imagenet. arXiv.
25. Pan, J., Sayrol, E., Giro-i-Nieto, X., McGuinness, K., and O’Connor, N.E. (2016). Shallow and deep convolutional networks for saliency prediction. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE.10.1109/CVPR.2016.71 ↗
26. Cornia, M., Baraldi, L., Serra, G., and Cucchiara, R. (2016). A deep multi-level network for saliency prediction. Proceedings of the 23rd International Conference on Pattern Recognition (ICPR), IEEE.10.1109/ICPR.2016.7900174 ↗
27. What is a salient object? A dataset and a baseline model for salient object detection10.1109/TIP.2014.2383320 ↗
28. Koide, N., Kubo, T., Nishida, S., Shibata, T., and Ikeda, K. (2015). Art expertise reduces influence of visual salience on fixation in viewing abstract-paintings. PLoS ONE, 10.10.1371/journal.pone.0117696 ↗
29. Arnold, L., Aryal, S., Hong, B., Nitharsan, M., Shah, A., Ahmed, W., Lilani, Z., Su, W., and Piaggio, D. (2025). A systematic literature review of eye-tracking and machine learning methods for improving productivity and reading abilities. Appl. Sci., 15.10.20944/preprints202502.0816.v2 ↗
30. Sáiz-Manzanares, M.C., Pérez, I.R., Rodríguez, A.A., Arribas, S.R., Almeida, L., and Martin, C.F. (2021). Analysis of the learning process through eye tracking technology and feature selection techniques. Appl. Sci., 11.10.3390/app11136157 ↗
31. Bai, K., Wang, J., Wang, H., and Chen, X. (2022). A study of eye-tracking gaze point classification and application based on conditional random field. Appl. Sci., 12.10.3390/app12136462 ↗
32. Melnyk, K., Friedman, L., Katrychuk, D., and Komogortsev, O. (2025). Gaze prediction as a function of eye movement type and individual differences. Proceedings of the 2025 Symposium on Eye Tracking Research and Applications, Association for Computing Machinery.10.1145/3715669.3723116 ↗
33. Landwehr, N., Arzt, S., Scheffer, T., and Kliegl, R. (2014). A model of individual differences in gaze control during reading. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), Association for Computational Linguistics.10.3115/v1/D14-1192 ↗
34. Peterson, M.F., Lin, J., Zaun, I., and Kanwisher, N. (2016). Individual differences in face-looking behavior generalize from the lab to the world. J. Vis., 16.10.1167/16.7.12 ↗
35. Individual differences in visual salience vary along semantic dimensions10.1073/pnas.1820553116 ↗
36. 3D multispectral imaging for cultural heritage preservation: The case study of a wooden sculpture of the Museo Egizio di Torino10.3390/heritage6030148 ↗
37. Targa, L., Cano, C., Solbes-García, Á., Casas, S., Alba, E., and Portalés, C. (2025). Automated edge detection for cultural heritage conservation: Comparative evaluation of classical and deep learning methods on artworks affected by natural disaster damage. Appl. Sci., 15.10.3390/app15158260 ↗
38. Yu, Z., Lyu, S., Hou, M., Sun, Y., and Li, L. (2024). A new method for extracting refined sketches of ancient murals. Sensors, 24.10.3390/s24072213 ↗
39. Luo, C., Shang, Z., Zhang, Y., Pan, H., Nuermaimaiti, A., Wang, C., Li, N., and Zhang, B. (2025). SmaAt-UNet optimized by particle swarm optimization (PSO): A study on the identification of detachment diseases in Ming Dynasty temple mural paintings in North China. Appl. Sci., 15.10.3390/app152212295 ↗
40. The display makes a difference: A mobile eye tracking study on the perception of art before and after a museum’s rearrangement
41. Deng, J., Chen, J., and Lei, Y. (2024). A study on the visual perception of cultural value characteristics of traditional southern Fujian architecture based on eye tracking. Buildings, 14.10.3390/buildings14113529 ↗
42. Implementation of eye tracking technology on cultural heritage research and practice10.15292/IU-CG.2019.07.016-021 ↗
43. Fixation duration and the learning process: An eye tracking study with subtitled videos10.16910/jemr.13.6.1 ↗
44. Hayes, T.R., and Henderson, J.M. (2017). Scan patterns during real-world scene viewing predict individual differences in cognitive capacity. J. Vis., 17.10.1167/17.5.23 ↗
45. Djilali, Y.A.D., McGuinness, K., and O’Connor, N. (2024, January 4–8). Learning saliency from fixations. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), Waikoloa, HI, USA.