Affective-Computing-Driven Personalized Display of Cultural Information for Commercial Heritage Architecture
Source abstract
Abstract
The display methods for traditional cultural heritage lack personalization and emotional interaction, making it difficult to stimulate the public’s deep cultural awareness. This is especially true in commercialized historical districts, where cultural value is easily overlooked. Balancing cultural value and commercial value in information display has become one of the challenges that needs to be addressed. To solve the above problems, this article focuses on the identification of deep cultural values and the optimization of the information display in Beijing’s Qianmen Street, proposing a framework for cultural information mining and display based on affective computing and large language models. The pre-trained models QwenLM and RoBERTa were employed to analyze text and image data from user-generated content on social media, identifying users’ emotional tendencies toward various cultural value dimensions and quantifying their multilayered understanding of architectural heritage. This study further constructed a multimodal information presentation model driven by emotional feedback, mapping it into virtual reality environments to enable personalized, multilayered cultural information visualization. The framework’s effectiveness was validated through an eye-tracking experiment that assessed how different presentation styles impacted users’ emotional engagement and cognitive outcomes. The results show that the affective computing and multimodal data fusion approach to cultural heritage presentation accurately captures users’ emotions, enhancing their interest and emotional involvement. Personalized presentations of information significantly improve users’ engagement, historical understanding, and cultural experience, thereby fostering a deeper comprehension of historical contexts and architectural details.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: 3D Surveying and Cultural Heritage
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Mechanical Engineering, University of Science and Technology Beijing, Beijing 100083, China
Department of Physics, Tsinghua University, Beijing 100084, China
Creative Lab, Esri, 380 New York Street, Redlands, CA 92373, USA
Funding
Humanities and Social Science Fund of Ministry of Education · Beijing High-Level Talent Training of Propaganda and Culture Project · National Cultural and Tourism Science and Technology Innovation Research and Development Project
References (30)
Show source-provided references
1. A comprehensive survey on affective computing; challenges, trends, applications, and future directions10.1109/ACCESS.2024.3422480 ↗
2. Zhang, Y., Wang, M., Wu, Y., Tiwari, P., Li, Q., Wang, B., and Qin, J. (2023). Dialoguellm: Context and emotion knowledge-tuned large language models for emotion recognition in conversations. arXiv.
3. Ferracani, A., Bertini, M., Pala, P., Nannotti, G., Principi, F., and Becchi, G. (November, January 28). Personalized Generative Storytelling with AI-Visual Illustrations for the Promotion of Knowledge in Cultural Heritage Tourism. Proceedings of the 6th Workshop on the Analysis, Understanding, and Promotion of Heritage Contents, Melbourne, Australia.10.1145/3689094.3689465 ↗
4. Wang, Y., Liu, J., Wang, W., Chen, J., Yang, X., Sang, L., Wen, Z., and Peng, Q. (2024). Construction of Cultural Heritage Knowledge Graph Based on Graph Attention Neural Network. Appl. Sci., 14.10.3390/app14188231 ↗
5. Construction of interpretation and presentation system of cultural heritage site: An analysis of the old city, Zuoying10.3390/heritage4010020 ↗
6. Influence of User-Generated Content (UGC) in Social Media on the Intangible Cultural Heritage Preservation of Gen Z Tourists in the Digital Economy Era10.1002/jtr.2743 ↗
7. A model approach for post evaluation of adaptive reuse of architectural heritage: A case study of Beijing central axis historical buildings10.1186/s40494-023-00902-x ↗
8. Tao, S., and Duan, W. (2024). A Post-Evaluation Study on the Renewal of Public Space in Qianmen Street of Beijing’s Central Axis Based on Grounded Theory. Buildings, 14.10.3390/buildings14123969 ↗
9. Yang, Y., Wang, Z., Shen, H., and Jiang, N. (2023). The Impact of Emotional Experience on Tourists’ Cultural Identity and Behavior in the Cultural Heritage Tourism Context: An Empirical Study on Dunhuang Mogao Grottoes. Sustainability, 15.10.3390/su15118823 ↗
10. Gîrbacia, F. (2024). An Analysis of Research Trends for Using Artificial Intelligence in Cultural Heritage. Electronics, 13.10.3390/electronics13183738 ↗
11. Orea-Giner, A., Muñoz-Mazón, A., Villacé-Molinero, T., and Fuentes-Moraleda, L. (2022). Cultural tourist and user experience with artificial intelligence: A holistic perspective from the Industry 5.0 approach. J. Tour. Future, 1–18.10.1108/JTF-04-2022-0115 ↗
12. Named entity recognition and classification in historical documents: A survey10.1145/3604931 ↗
13. Trichopoulos, G. (2023, January 27–28). Large language models for cultural heritage. Proceedings of the 2nd International Conference of the ACM Greek SIGCHI Chapter, Athens, Greece.10.1145/3609987.3610018 ↗
14. Local experiences on Instagram: Social media data as source of evidence for experience design
15. A survey of sentiment analysis in social media10.1007/s10115-018-1236-4 ↗
16. Understanding the influence of user-generated content on tourist loyalty behavior in a cultural World Heritage Site
17. BERT for Arabic topic modeling: An experimental study on BERTopic technique10.1016/j.procs.2021.05.096 ↗
18. Deep feature-based text clustering and its explanation10.1109/TKDE.2020.3028943 ↗
19. A new Italian Cultural Heritage dataset: Detecting fake reviews with BERT and ELECTRA leveraging sentiment
20. Leveraging Large Language Model ChatGPT for enhanced understanding of end-user emotions in social media feedbacks10.1016/j.eswa.2024.125524 ↗
21. Interpretable clusters for representing citizens’ sense of belonging through interaction with cultural heritage
22. Ding, J., Tao, Z., Hou, M., Chen, D., and Wang, L. (2023). A Comparative Study of Perceptions of Destination Image Based on Content Mining: Fengjing Ancient Town and Zhaojialou Ancient Town as Examples. Land, 12.10.3390/land12101954 ↗
23. User-generated content may increase urban park use: Evidence from multisource social media data10.1177/23998083231210412 ↗
24. Okanovic, V., Ivkovic-Kihic, I., Boskovic, D., Mijatovic, B., Prazina, I., Skaljo, E., and Rizvic, S. (2022). Interaction in extended reality applications for cultural heritage. Appl. Sci., 12.10.3390/app12031241 ↗
25. The cognitive affective model of immersive learning (CAMIL): A theoretical research-based model of learning in immersive virtual reality10.1007/s10648-020-09586-2 ↗
26. Multisensory augmented reality in cultural heritage: Impact of different stimuli on presence, enjoyment, knowledge and value of the experience10.1109/ACCESS.2020.3032379 ↗
27. Integrating eye-movement analysis and the semantic differential method to analyze the visual effect of a traditional commercial block in Hefei, China10.1016/j.foar.2021.01.002 ↗
28. Integrating Physical and Virtual Experiences in Cultural Tourism: An Adaptive Multimodal Recommender System10.1109/ACCESS.2025.3539205 ↗
29. The role of artistic quality in a heritage architectural style in modulating tourist interest and aesthetic pleasure: A case study of Hui-style architecture in the Hongcun Scenic Area, China10.1080/1743873X.2024.2378805 ↗
30. Your Eyes on Speed: Using Pupil Dilation to Adaptively Select Speed-Reading Parameters in Virtual Reality10.1145/3676531 ↗