ViT-HVE: a vision transformer-based framework for recognition and weighted evaluation of cultural heritage values
Source abstract
Abstract
Cultural heritage value is essential for heritage protection and utilization. However, existing evaluation methods remain subjective and labor-intensive. To address these challenges, we propose the Vision Transformer-based Heritage Value Evaluation (ViT-HVE) model, the first deep learning-based model for heritage value evaluation. Taking heritage sites along the Yellow River in Shaanxi as a case study, we construct a ten-dimensional value system using Latent Dirichlet Allocation (LDA) and establish the first Cultural Heritage Value Recognition (CHVR) dataset. To enable quantitative evaluation, we introduce the Top-k Heritage Value Weighting (TK-HVW) method, which derives value weights by extracting and normalizing probability distributions across value categories. Extensive experiments demonstrate that ViT-HVE outperforms existing state-of-the-art methods, achieving 0.890 Precision, 0.887 F1-Score, and 0.889 Accuracy. Furthermore, the predicted value distributions show strong alignment with expert evaluations, substantiating the reliability of our method and highlighting its potential for cultural heritage value evaluation and decision-making.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Cultural Heritage Management and Preservation · 3D Surveying and Cultural Heritage · Infrastructure Maintenance and Monitoring
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (65)
Show source-provided references
1. Zhang, J., Jiang, L., Wang, X., Chen, Z. & Xu, S. A study on the spatiotemporal aggregation and corridor distribution characteristics of cultural heritage: the case of fuzhou, china. Buildings 14, 121 (2024).10.3390/buildings14010121 ↗
2. Logan, W. Cultural diversity, cultural heritage and human rights: towards heritage management as human rights-based cultural practice. In World heritage management and human rights, 19–32 (Routledge, 2016).10.4324/9781315613031-25 ↗
3. Lähdesmäki, T. & Čeginskas, V. L. Conceptualisation of heritage diplomacy in scholarship. Int. J. Herit. Stud. 28, 635–650 (2022).10.1080/13527258.2022.2054846 ↗
4. Galluccio, C. & Giambona, F. Cultural heritage and economic development: Measuring sustainability over time. Socio-Economic Plan. Sci. 95, 101998 (2024).10.1016/j.seps.2024.101998 ↗
5. Jixiang, S. Step in the world of cultural landscape heritage (2010).
6. Yang, Y., Wang, Z., Shen, H. & Jiang, N. The impact of emotional experience on tourists’ cultural identity and behavior in the cultural heritage tourism context: An empirical study on dunhuang mogao grottoes. Sustainability 15, 8823 (2023).10.3390/su15118823 ↗
7. Cao, K., Liu, Y., Cao, Y., Wang, J. & Tian, Y. Construction and characteristic analysis of landscape gene maps of traditional villages along ancient qin-shu roads, western china. Herit. Sci. 12, 37 (2024).10.1186/s40494-024-01155-y ↗
8. Buragohain, D., Meng, Y., Deng, C., Li, Q. & Chaudhary, S. Digitalizing cultural heritage through metaverse applications: challenges, opportunities, and strategies. Herit. Sci. 12, 295 (2024).10.1186/s40494-024-01403-1 ↗
9. Díaz-Andreu, M. Heritage values and the public (2017).10.1080/20518196.2016.1228213 ↗
10. Fan, X., Wang, Z. & Li, S. Value evaluation model (vem) of ancient chinese military settlement heritage: a case study of liaoxi corridor in the ming dynasty. Herit. Sci. 12, 97 (2024).10.1186/s40494-024-01210-8 ↗
11. Fredheim, L. H. & Khalaf, M. The significance of values: Heritage value typologies re-examined. Int. J. Herit. Stud. 22, 466–481 (2016).10.1080/13527258.2016.1171247 ↗
12. Mydland, L. & Grahn, W. Identifying heritage values in local communities. Int. J. Herit. Stud. 18, 564–587 (2012).10.1080/13527258.2011.619554 ↗
13. Apaydin, V. The entanglement of the heritage paradigm: values, meanings and uses. Int. J. Herit. Stud. 24, 491–507 (2018).10.1080/13527258.2017.1390488 ↗
14. Bertacchini, E. & Frontuto, V. Economic valuation of industrial heritage: A choice experiment on shanghai baosteel industrial site. J. Cultural Herit. 66, 215–228 (2024).10.1016/j.culher.2023.11.016 ↗
15. Bedate, A., Herrero, L. C. & Sanz, J. Á. Economic valuation of the cultural heritage: application to four case studies in spain. J. cultural Herit. 5, 101–111 (2004).10.1016/j.culher.2003.04.002 ↗
16. Provins, A., Pearce, D., Ozdemiroglu, E., Mourato, S. & Morse-Jones, S. Valuation of the historic environment: The scope for using economic valuation evidence in the appraisal of heritage-related projects. Prog. Plan. 69, 131–175 (2008).10.1016/j.progress.2008.01.001 ↗
17. Ma, H., Li, S. & Chan, C. Analytic hierarchy process (ahp)-based assessment of the value of non-world heritage tulou: A case study of pinghe county, fujian province. Tour. Manag. Perspect. 26, 67–77 (2018).
18. Liu, F., Zhao, Q. & Yang, Y. An approach to assess the value of industrial heritage based on dempster–shafer theory. J. Cultural Herit. 32, 210–220 (2018).10.1016/j.culher.2018.01.011 ↗
19. Chen, X. et al. Evaluating urban industrial heritage value using industrial heritage matrix analytic hierarchy process models a case study of mawei shipbuilding in fuzhou city. Int. Rev. Spat. Plan. Sustain. Dev. 12, 99–118 (2024).
20. Shao, D., Zoh, K. & Xie, Y. The spatial differentiation mechanism of intangible cultural heritage and its integration with tourism development based on explainable machine learning and coupled coordination models: a case study of the jiang-zhe-hu in china. Herit. Sci. 12, 1–22 (2024).10.1186/s40494-024-01528-3 ↗
21. Fan, X., Mao, L., Zou, C., Wang, C. & Mo, D. Settlement strategies and their driving mechanisms of neolithic settlements using machine learning approaches: a case study in zhejiang province. npj Herit. Sci. 13, 186 (2025).10.1038/s40494-025-01753-4 ↗
22. Rodriguez, J. M. P., Guida, A. G. & Fattore, C. Integrated analysis of urban heat islands in historical heritage contexts: The case of matera (2024).
23. Chen, Z., Gao, Q., Li, X., Yang, X. & Wang, Z. Beyond inundation: a comprehensive assessment of sea level rise impact on coastal cultural heritage in china. Herit. Sci. 12, 121 (2024).10.1186/s40494-024-01233-1 ↗
24. Wang, J., Fan, W. & You, J. Evaluation of tourism elements in historical and cultural blocks using machine learning: a case study of taiping street in hunan province. npj Herit. Sci. 13, 30 (2025).10.1038/s40494-025-01641-x ↗
25. Zheng, X., Huang, Y., Xie, Z. & Zheng, A. Quantifying tourist perception of cultural landscapes in traditional towns in china using multimodal machine learning. npj Herit. Sci. 13, 320 (2025).10.1038/s40494-025-01907-4 ↗
26. Boesgaard, C. et al. Prediction of the indoor climate in cultural heritage buildings through machine learning: first results from two field tests. Heritage Science10 (2022).10.1186/s40494-022-00805-3 ↗
27. Wang, T., Zhang, M. & Li, Z. Explainable machine learning links erosion damage to environmental factors on gansu rammed earth great wall. npj Herit. Sci. 13, 366 (2025).10.1038/s40494-025-01930-5 ↗
28. Kumar, P., Ofli, F., Imran, M. & Castillo, C. Detection of disaster-affected cultural heritage sites from social media images using deep learning techniques. J. Comput. Cultural Herit. (JOCCH) 13, 1–31 (2020).10.1145/3383314 ↗
29. Hou, M., Huo, D., Yang, Y., Yang, S. & Chen, H. Using mask r-cnn to rapidly detect the gold foil shedding of stone cultural heritage in images. Herit. Sci. 12, 46 (2024).10.1186/s40494-024-01158-9 ↗
30. Qiu, H. et al. Research on intelligent monitoring technology for roof damage of traditional chinese residential buildings based on improved yolov8: taking ancient villages in southern fujian as an example. Herit. Sci. 12, 231 (2024).10.1186/s40494-024-01345-8 ↗
31. Yang, S., Zheng, L., Chen, Y., Huang, Y. & Huang, Y. Artificial intelligence assists the identification and application of rural heritage wall surface damage in zhejiang. npj Herit. Sci. 13, 143 (2025).10.1038/s40494-025-01725-8 ↗
32. Chen, X., He, J. & Wang, S. Deep learning-driven pathology detection and analysis in historic masonry buildings of suzhou. npj Herit. Sci. 13, 197 (2025).10.1038/s40494-025-01783-y ↗
33. Sasithradevi, A., Chanthini, B., Subbulakshmi, T. & Prakash, P. et al. Monunet: a high performance deep learning network for kolkata heritage image classification. Herit. Sci. 12, 1–14 (2024).10.1186/s40494-024-01340-z ↗
34. Han, Q., Yin, C., Deng, Y. & Liu, P. Towards classification of architectural styles of chinese traditional settlements using deep learning: A dataset, a new framework, and its interpretability. Remote Sens. 14, 5250 (2022).10.3390/rs14205250 ↗
35. Tao, J. et al. Classification and distribution of traditional grass-roofed dwellings in china based on deep learning. Land 13, 1595 (2024).10.3390/land13101595 ↗
36. Gao, C. et al. Cross-cultural insights into traditional jiangnan gardens of china and japanese gardens through algorithm-enhanced comparative analysis. npj Herit. Sci. 13, 315 (2025).10.1038/s40494-025-01880-y ↗
37. Zhang, S. et al. A coordinate-to-semantic attention network for multi-label ancient chinese architecture image classification. npj Herit. Sci. 13, 14 (2025).10.1038/s40494-025-01547-8 ↗
38. Sasithradevi, A., Sabarinathan Shoba, S., Roomi, S. M. M. & Prakash, P. Kolamnetv2: efficient attention-based deep learning network for tamil heritage art-kolam classification. Herit. Sci. 12, 60 (2024).10.1186/s40494-024-01167-8 ↗
39. Dorozynski, M. & Rottensteiner, F. Deep descriptor learning with auxiliary classification loss for retrieving images of silk fabrics in the context of preserving european silk heritage. ISPRS Int. J. Geo-Inf. 11, 82 (2022).10.3390/ijgi11020082 ↗
40. Varshney, S., Lakshmi, C. V. & Patvardhan, C. Madhubani art classification using transfer learning with deep feature fusion and decision fusion based techniques. Eng. Appl. Artif. Intell. 119, 105734 (2023).10.1016/j.engappai.2022.105734 ↗
41. Sandoval, C., Pirogova, E. & Lech, M. Two-stage deep learning approach to the classification of fine-art paintings. IEEE access 7, 41770–41781 (2019).10.1109/ACCESS.2019.2907986 ↗
42. Hu, Y., Wu, S., Ma, Z. & Cheng, S. Integrating deep learning and machine learning for ceramic artifact classification and market value prediction. npj Herit. Sci. 13, 1–17 (2025).10.1038/s40494-025-01886-6 ↗
43. Tan, G., Zhu, J. & Chen, Z. Deep learning based identification and interpretability research of traditional village heritage value elements: a case study in hubei province. Herit. Sci. 12, 200 (2024).10.1186/s40494-024-01322-1 ↗
44. Xiao, X., Fang, C., Lin, H. & Chen, J. A framework for quantitative analysis and differentiated marketing of tourism destination image based on visual content of photos. Tour. Manag. 93, 104585 (2022).10.1016/j.tourman.2022.104585 ↗
45. Zhang, K., Chen, Y. & Li, C. Discovering the tourists’ behaviors and perceptions in a tourism destination by analyzing photos’ visual content with a computer deep learning model: The case of beijing. Tour. Manag. 75, 595–608 (2019).10.1016/j.tourman.2019.07.002 ↗
46. Xiao, X., Fang, C. & Lin, H. Characterizing tourism destination image using photos’ visual content. ISPRS Int. J. Geo-Inf. 9, 730 (2020).10.3390/ijgi9120730 ↗
47. Zhang, H., Jiang, J. & Guo, X. Hsvi-net: a deep learning network for scene understanding based on panoramic street-view images within historical districts. npj Herit. Sci. 13, 383 (2025).10.1038/s40494-025-01950-1 ↗
48. Ogawa, Y., Oki, T., Zhao, C., Sekimoto, Y. & Shimizu, C. Evaluating the subjective perceptions of streetscapes using street-view images. Landsc. Urban Plan. 247, 105073 (2024).10.1016/j.landurbplan.2024.105073 ↗
49. An, Z. & Wang, K. Yellow river culture and chinese civilization. Journal of Literature, History & Philosophy 3–13 (1992).
50. Zhang, S. Exploring thematic evolution in interdisciplinary forest fire prediction research: A latent dirichlet allocation–bidirectional encoder representations from transformers model analysis. Forests 16, 346 (2025).10.3390/f16020346 ↗
51. Büschken, J. & Allenby, G. M. Sentence-based text analysis for customer reviews. Mark. Sci. 35, 953–975 (2016).10.1287/mksc.2016.0993 ↗
52. Dosovitskiy, A. et al. An image is worth 16 x 16 words: Transformers for image recognition at scale. In International Conference on Learning Representations (2021).
53. Weiss, K., Khoshgoftaar, T. M. & Wang, D. A survey of transfer learning. J. Big data 3, 1–40 (2016).10.1186/s40537-016-0043-6 ↗
54. Ridnik, T., Ben-Baruch, E., Noy, A. & Zelnik-Manor, L. Imagenet-21k pretraining for the masses. In Thirty-fifth Conference on Neural Information Processing Systems Datasets and Benchmarks Track (2021).
55. Hu, E. J. et al. Lora: Low-rank adaptation of large language models. In International Conference on Learning Representations (2021).
56. Selvaraju, R. R. et al. Grad-cam: Visual explanations from deep networks via gradient-based localization. In Proceedings of the IEEE international conference on computer vision, 618–626 (2017).10.1109/ICCV.2017.74 ↗
57. Paszke, A. et al. Pytorch: An imperative style, high-performance deep learning library. Advances in neural information processing systems 32 (2019).
58. Robbins, H. & Monro, S. A stochastic approximation method. The annals of mathematical statistics 400–407 (1951).10.1214/aoms/1177729586 ↗
59. Zhu, Y. et al. Melo: Low-rank adaptation is better than fine-tuning for medical image diagnosis. In 2024 IEEE International Symposium on Biomedical Imaging (ISBI), 1–5 (IEEE, 2024).10.1109/ISBI56570.2024.10635615 ↗
60. Tan, M. & Le, Q. Efficientnet: Rethinking model scaling for convolutional neural networks. In International conference on machine learning, 6105–6114 (PMLR, 2019).
61. He, K., Zhang, X., Ren, S. & Sun, J. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition, 770–778 (2016).10.1109/CVPR.2016.90 ↗
62. Huang, G., Liu, Z., Van Der Maaten, L. & Weinberger, K. Q. Densely connected convolutional networks. In Proceedings of the IEEE conference on computer vision and pattern recognition, 4700–4708 (2017).10.1109/CVPR.2017.243 ↗
63. Howard, A. G. et al. Mobilenets: Efficient convolutional neural networks for mobile vision applications. doi: 10.48550. arXiv preprint arXiv.1704.048611704 (2017).
64. Szegedy, C. et al. Going deeper with convolutions. In Proceedings of the IEEE conference on computer vision and pattern recognition, 1–9 (2015).10.1109/CVPR.2015.7298594 ↗
65. Liu, Z. et al. Swin transformer: Hierarchical vision transformer using shifted windows. In Proceedings of the IEEE/CVF international conference on computer vision, 10012–10022 (2021).10.1109/ICCV48922.2021.00986 ↗