Interaction in eXtended Reality Applications for Cultural Heritage
Source abstract
Abstract
Digital technologies in the modern era are almost mandatory for the presentation of all types of cultural heritage. Virtual depictions of crafts and traditions offer the users the possibility of time travel, taking them to the past through the use of 3D reconstructions of cultural monuments and sites. However, digital resources alone are not enough to adequately present cultural heritage. Additional information on the historical context in the form of stories, virtual reconstructions, and digitized objects is needed. All of this can be implemented using a digital multimedia presentation technique called digital storytelling. Nowadays, an integral part of many museum exhibitions is interactive digital storytelling. This paper gives an overview of the techniques and discusses different means of facilitating interaction on digital storytelling applications for virtual cultural heritage presentations. We describe the ways in which natural interaction and interaction via eXtended Reality (Virtual and Augmented Reality) applications for cultural heritage are made possible. Users will find the stories told through these applications educational and entertaining at the same time. Through user-experience studies, we measure the user edutainment level and present how users react to implemented interactions.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Augmented Reality Applications · Virtual Reality Applications and Impacts · 3D Surveying and Cultural Heritage
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Faculty of Electrical Engineering, University of Sarajevo, 71000 Sarajevo, Bosnia and Herzegovina
Sarajevo Film Academy, Sarajevo School of Science and Technology, Hrasnička cesta 3a, 71000 Sarajevo, Bosnia and Herzegovina
References (53)
Show source-provided references
1. Bruno, F., Ricca, M., Lagudi, A., Kalamara, P., Manglis, A., Fourkiotou, A., Papadopoulou, D., and Veneti, A. (2020). Digital Technologies for the Sustainable Development of the Accessible Underwater Cultural Heritage Sites. J. Mar. Sci. Eng., 8.10.3390/jmse8110955 ↗
2. The Contribution of Earth Sciences to the Preservation of Underwater Archaeological Stone Materials: An Analytical Approach
3. Wiberg, C., and Jegers, K. (2003, January 22–27). Satisfaction and learnability in edutainment: A usability study of the knowledge game ‘Laser Challenge’ at the Nobel e-museum. Proceedings of the HCI International 2003, Crete, Greece.
4. Fundamentals Of Interactive Storytelling10.5824/1309-1581.2012.3.002.x ↗
5. Miller, C.H. (2019). Digital Storytelling: A Creator’s Guide to Interactive Entertainment, CRC Press.10.1201/9780429440045 ↗
6. How to Breathe Life into Cultural Heritage 3D Reconstructions10.1017/S106279871600034X ↗
7. Liarokapis, F., Voulodimos, A., Doulamis, N., and Doulamis, A. (2020). Visual Computing for Cultural Heritage, Springer International Publishing.10.1007/978-3-030-37191-3 ↗
8. Rizvic, S., Djapo, N., Alispahic, F., Hadzihalilovic, B., Cengic, F.F., Imamovic, A., Okanovic, V., and Boskovic, D. (2017, January 6–8). Guidelines for interactive digital storytelling presentations of cultural heritage. Proceedings of the 2017 9th International Conference on Virtual Worlds and Games for Serious Applications (VS-Games), Athens, Greece.10.1109/VS-GAMES.2017.8056610 ↗
9. Aylett, R. Emergent Narrative, Social Immersion and “Storification”. Proceedings of the 1st International Workshop on Narrative and Interactive Learning Environments, Available online: https://www.academia.edu/544496/Emergent_narrative_social_immersion_and_storification_.
10. Augmented reality technologies, systems and applications10.1007/s11042-010-0660-6 ↗
11. Ivkovic, I., Klisura, N., and Sljivo, S. (2018, January 25–27). Bridges of Sarajevo. Proceedings of the CESCG 2018: The 22nd Central European Seminar on Computer Graphics (Non-per-Reviewed), Smolenice, Slovakia.
12. Argyriou, L., Economou, D., and Bouki, V. (2017, January 26–29). 360-degree interactive video application for cultural heritage education. Proceedings of the 3rd Annual International Conference of the Immersive Learning Research Network, Coimbra, Portugal.
13. Design methodology for 360 immersive video applications: The case study of a cultural heritage virtual tour10.1007/s00779-020-01373-8 ↗
14. Škola, F., Rizvić, S., Cozza, M., Barbieri, L., Bruno, F., Skarlatos, D., and Liarokapis, F. (2020). Virtual Reality with 360-Video Storytelling in Cultural Heritage: Study of Presence, Engagement, and Immersion. Sensors, 20.10.3390/s20205851 ↗
15. From 3D reconstruction to virtual reality: A complete methodology for digital archaeological exhibition10.1016/j.culher.2009.02.006 ↗
16. Katifori, A., Karvounis, M., Kourtis, V., Perry, S., Ioanidis, Y., and Roussou, M. (2019). Applying Interactive Storytelling in Cultural Heritage: Opportunities, Challenges and Lessons Learned, Springer.10.1007/978-3-030-04028-4_70 ↗
17. Crawford, C. (2013). Chris Crawford on Interactive Storytelling, New Riders.
18. Roussou, M., Pujol, L., Katifori, A., Chrysanthi, A., Perry, S., and Vayanou, M. (2015, January 8–11). The Museum as Digital Storyteller: Collaborative participatory creation of interactive digital experiences. Proceedings of the MW2015: Museums and the Web 2015, Chicago, IL, USA.
19. Liguori, A., and Rappoport, P. (2018, January 21–23). Digital storytelling in cultural and heritage education: Reflecting on storytelling practices applied with the Smithsonian Learning Lab to enhance 21st-century learning. Proceedings of the International Digital Storytelling Conference 2018: Current Trends in Digital Storytelling: Research & Practices, Zakynthos, Greece.
20. Sierra, A., de Prado, G., Ruiz Soler, I., and Codina, F. (2017, January 19–22). Virtual reality and archaeological reconstruction: Be there, back then. Proceedings of the Museums and the Web 2017, Cleveland, OH, USA.
21. Realistic Virtual Humans for Cultural Heritage Applications10.3390/heritage4040228 ↗
22. Rizvic, S., Boskovic, D., Bruno, F., Petriaggi, B., Sljivo, S., and Cozza, M. (2019, January 4–6). Actors in VR storytelling. Proceedings of the 2019 11th International Conference on Virtual Worlds and Games for Serious Applications (VS-Games), Vienna, Austria.10.1109/VS-Games.2019.8864520 ↗
23. Immersive VR Experience of Redeveloped Post-industrial Sites: The Example of “Zeche Holland” in Bochum-Wattenscheid10.1007/s42489-019-00030-2 ↗
24. Walmsley, A.P., and Kersten, T.P. (2020). The Imperial Cathedral in Königslutter (Germany) as an Immersive Experience in Virtual Reality with Integrated 360° Panoramic Photography. Appl. Sci., 10.10.3390/app10041517 ↗
25. Virtual Reality Application of the Fortress Al Zubarah in Qatar Including Performance Analysis of Real-Time Visualisation10.1007/s42489-021-00092-1 ↗
26. From photo to 3D to mixed reality: A complete workflow for cultural heritage visualisation and experience
27. A survey of augmented, virtual, and mixed reality for cultural heritage10.1145/3145534 ↗
28. Map Symbols in Video Games: The Example of “Valheim”10.1007/s42489-021-00085-0 ↗
29. Hulusic, V., and Chalmers, A. (2021). Tangible Interfaces for VR Cultural Heritage Application—School House Virtual Museum. Eurographics Workshop on Graphics and Cultural Heritage, The Eurographics Association.
30. Haugstvedt, A.C., and Krogstie, J. (2012, January 5–8). Mobile augmented reality for cultural heritage: A technology acceptance study. Proceedings of the 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Atlanta, GA, USA.10.1109/ISMAR.2012.6402563 ↗
31. A theoretical model of mobile augmented reality acceptance in urban heritage tourism10.1080/13683500.2015.1070801 ↗
32. Augmented reality, virtual reality and 3D printing for the co-creation of value for the visitor experience at cultural heritage places10.1108/JPMD-07-2016-0045 ↗
33. Enhancing the tourism experience through mobile augmented reality: Challenges and prospects10.5772/51644 ↗
34. Han, D.I., Jung, T., and Gibson, A. (2013). Dublin AR: Implementing augmented reality in tourism. Information and Communication Technologies in Tourism 2014, Springer.10.1007/978-3-319-03973-2_37 ↗
35. Systematic review and meta-analysis of augmented reality in educational settings10.1007/s10055-019-00379-9 ↗
36. Augmented reality in medicine: Systematic and bibliographic review10.2196/10967 ↗
37. Research trends and opportunities of augmented reality applications in architecture, engineering, and construction10.1016/j.autcon.2012.12.017 ↗
38. Augmented Reality Experience for Inaccessible Areas in Museums
39. Narralive—Creating and experiencing mobile digital storytelling in cultural heritage
40. Roussou, M., and Katifori, A. (2018). Flow, Staging, Wayfinding, Personalization: Evaluating User Experience with Mobile Museum Narratives. Multimodal Technol. Interact., 2.10.3390/mti2020032 ↗
41. Chávez, G., Avila, F., and Rockwood, A. (2013, January 20–22). Lightweight visualization for high-quality materials on WebGL. Proceedings of the 18th International Conference on 3D Web Technology, San Sebastian, Spain.10.1145/2466533.2466542 ↗
42. Rizvic, S., Okanovic, V., Prazina, I., Sadzak, A., Catalano, C., and Luca, L. (2016, January 5–7). 4D Virtual Reconstruction of White Bastion Fortress. Proceedings of the Eurographics Workshop on Graphics and Cultural Heritage 2016, Genova, Italy.
43. Fleck, P., Schmalstieg, D., and Arth, C. (2020, January 9–13). Creating IoT-ready XR-WebApps with Unity3D. Proceedings of the 25th International Conference on 3D Web Technology, Seoul, Korea.10.1145/3424616.3424691 ↗
44. VR Interactive Feature of HTML5-based WebVR Control Laboratory by Using Head-mounted Display10.3991/ijoe.v14i03.8112 ↗
45. Transforming clinical imaging and 3D data for virtual reality learning objects: HTML5 and mobile devices implementation10.1002/ase.1330 ↗
46. Rizvić, S. (2018). Digitalna Prezentacija Kulturnog Naslijeda Bosne i Hercegovine, TDP Sarajevo.
47. Rizvic, S., Boskovic, D., Okanovic, V., and Sljivo, S. (2019, January 6–9). Virtual Reality Experience of Sarajevo War Heritage. Proceedings of the GCH’19: Proceedings of the Eurographics Workshop on Graphics and Cultural Heritage, Sarajevo, Bosnia and Herzegovina.
48. Selmanovic, E., Rizvic, S., Harvey, C., Boskovic, D., Hulusic, V., Chahin, M., and Sljivo, S. (2018, January 12–15). VR Video Storytelling for Intangible Cultural Heritage Preservation. Proceedings of the GCH’18: Proceedings of the Eurographics Workshop on Graphics and Cultural Heritage, Vienna, Austria.
49. Improving accessibility to intangible cultural heritage preservation using virtual reality
50. Rizvić, S., Bošković, D., Okanović, V., Kihić, I.I., Prazina, I., and Mijatović, B. (2021). Time Travel to the Past of Bosnia and Herzegovina through Virtual and Augmented Reality. Appl. Sci., 11.10.3390/app11083711 ↗
51. Rizvic, S., Boskovic, D., Okanovic, V., and Sljivo, S. (2017, January 27–29). Kyrenia: Hyper storytelling pilot application. Proceedings of the GCH’17: Proceedings of the Eurographics Workshop on Graphics and Cultural Heritage, Graz, Austria.
52. Boskovic, D., Rizvic, S., Okanovic, V., Sljivo, S., and Sinanovic, N. (2017, January 26–28). Measuring immersion and edutainment in multimedia cultural heritage applications. Proceedings of the 2017 XXVI International Conference on Information, Communication and Automation Technologies (ICAT), Sarajevo, Bosnia and Herzegovina.10.1109/ICAT.2017.8171604 ↗
53. User acceptance of information technology: Toward a unified view10.2307/30036540 ↗