journal article·2024-04-28Open access

Enriching User-Visitor Experiences in Digital Museology: Combining Social and Virtual Interaction within a Metaverse Environment

Alba Alabau, Lidia Fabra, Ana Martí-Testón, Adolfo Muñoz, J. Ernesto Solanes, Luis Gracia

Applied Sciences· Volume 14· Issue 9

Abstract

This study investigates the potential of integrating multilayer animations and sophisticated shader technologies to enhance visitor social interactions within metaverse exhibition spaces. It is part of a broader initiative aimed at developing innovative digital museology strategies that foster social engagement through virtual reality (VR) experiences. The methodology adopted seeks to provide a more immersive and human-centric exploration of 3D digital environments by blending elements of physical spaces with the interactive dynamics common in video games. A virtual exhibition space themed around Mars was created as a testbed to facilitate social interactions among users, who navigate the environment via avatars. This digital space was developed using a specialized Unity template designed by the metaverse platform Spatial.io. Overcoming the programming constraints imposed by Spatial.io, which limits the use of external scripts for security and stability, posed a significant challenge. Nonetheless, by leveraging the ability to modify shader codes used for material creation and employing advanced animation techniques with layered effects, the authors of this work achieved dynamic material responses to lighting changes and initiated complex asset interactions beyond simple linear animations.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Virtual Reality Applications and Impacts · Museums and Cultural Heritage · Augmented Reality Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Instituto de Diseño y Fabricación, Universitat Politècnica de València, 46022 València, Spain

Funding

Spanish Government · MCIN/AEI/10.13039/501100011033 · Generalitat Valenciana

References (59)

Show source-provided references
1. Spadoni, E., Carulli, M., Ferrise, F., and Bordegoni, M. (2023, January 23–28). Impact of Multisensory XR Technologies on Museum Exhibition Visits. Proceedings of the International Conference on Human-Computer Interaction, Copenhagen, Denmark.10.1007/978-3-031-35897-5_9 ↗
2. Silva, M., and Teixeira, L. (2021, January 3–4). eXtended Reality (XR) experiences in museums for cultural heritage: A systematic review. Proceedings of the International Conference on Intelligent Technologies for Interactive Entertainment, Virtual Event.10.1007/978-3-030-99188-3_5 ↗
3. Beyond virtual museums: Experiencing immersive virtual reality in real museums10.1016/j.culher.2010.04.001 ↗
4. Experiencing immersive virtual reality in museums10.1016/j.im.2019.103229 ↗
5. Cultural Heritage in Fully Immersive Virtual Reality10.3390/virtualworlds1010006 ↗
6. Extended reality and informative models for the architectural heritage: From scan-to-BIM process to virtual and augmented reality10.4995/var.2019.11923 ↗
7. Margetis, G., Apostolakis, K.C., Ntoa, S., Papagiannakis, G., and Stephanidis, C. (2021). X-Reality Museums: Unifying the Virtual and Real World towards Realistic Virtual Museums. Appl. Sci., 11.10.3390/app11010338 ↗
8. A proposal of virtual museum metaverse content for the MZ generation10.1080/14626268.2022.2063903 ↗
9. Designing virtual reality based 3D modeling and interaction technologies for museums10.1016/j.heliyon.2023.e16486 ↗
10. How Post 90’s Gesture Interact with Automobile Skylight10.1080/10447318.2021.1948687 ↗
11. Zidianakis, E., Partarakis, N., Ntoa, S., Dimopoulos, A., Kopidaki, S., Ntagianta, A., Ntafotis, E., Xhako, A., Pervolarakis, Z., and Kontaki, E. (2021). The Invisible Museum: A User-Centric Platform for Creating Virtual 3D Exhibitions with VR Support. Electronics, 10.10.3390/electronics10030363 ↗
12. Advanced interactive digital storytelling in digital heritage applications
13. User experience model and design strategies for virtual reality-based cultural heritage exhibition10.1007/s10055-024-00942-z ↗
14. Museum beyond physical walls: An exploration of virtual reality-enhanced experience in an exhibition-like space10.1007/s10055-022-00643-5 ↗
15. Immersive Museums in the Digital Age: Exploring the Impact of Virtual Reality on Visitor Satisfaction and Loyalty
16. The Mediterranean forest in a science museum: Engaging children through drawings that come to life in a virtual world10.1007/s11042-024-18606-0 ↗
17. Meileni, H., Hapsari, Y., Devani, F.T., Nugraha, A.C., Jannah, M., and Firdaus, R. (2023, January 30–31). Exploration of Virtual Reality Technology Implementation in the Mobile Application of Balaputra Dewa Museum. Proceedings of the 7th FIRST 2023 International Conference on Global Innovations (FIRST-ESCSI 2023), Palembang, Indonesia.10.2991/978-94-6463-386-3_38 ↗
18. Schlachhoff, E., Dengler, N., Holland, L.V., Stotko, P., de Heuvel, J., Klein, R., and Bennewitz, M. (2024). RHINO-VR Experience: Teaching Mobile Robotics Concepts in an Interactive Museum Exhibit. arXiv.10.1109/RO-MAN60168.2024.10731357 ↗
19. Shehade, M., and Stylianou-Lambert, T. (2020). Virtual Reality in Museums: Exploring the Experiences of Museum Professionals. Appl. Sci., 10.10.3390/app10114031 ↗
20. STEM Education in Metaverse Environment: Challenges and Opportunities10.55290/steam.1139543 ↗
21. The use of virtual reality and augmented reality in education
22. AIDM: Artificial intelligent for digital museum autonomous system with mixed reality and software-driven data collection and analysis10.1007/s10515-021-00315-9 ↗
23. Virtual STEM Class for Nuclear Safety Education in Metaverse10.1016/j.procs.2014.08.224 ↗
24. Solanes, J.E., Montava-Jordà, S., Golf-Laville, E., Colomer-Romero, V., Gracia, L., and Muñoz, A. (2023). Enhancing STEM Education through Interactive Metaverses: A Case Study and Methodological Framework. Appl. Sci., 13.10.3390/app131910785 ↗
25. Mittal, S. (2023). Metaverse Business and Economic Models: Opportunities and Challenges for Virtual Economies, Digital Asset Markets, and Advertising Strategies. [BSc Thesis, Delhi Technological University]. Available online: http://14.139.251.106:8080/jspui/bitstream/repository/20292/1/Shivangi%20Mittal%20DMBA.pdf.
26. Mixed reality experiences in museums: Exploring the impact of functional elements of the devices on visitors’ immersive experiences and post-experience behaviours10.1016/j.im.2022.103698 ↗
27. Pagano, A., Palombini, A., Bozzelli, G., De Nino, M., Cerato, I., and Ricciardi, S. (2020). ArkaeVision VR Game: User Experience Research between Real and Virtual Paestum. Appl. Sci., 10.10.3390/app10093182 ↗
28. Social interactions in the metaverse: Framework, initial evidence, and research roadmap10.1007/s11747-022-00908-0 ↗
29. Bailenson, J. (2018). Experience on Demand: What Virtual Reality Is, How It Works, and What It Can Do, WW Norton & Company.
30. Empathy and embodied experience in virtual environment: To what extent can virtual reality stimulate empathy and embodied experience?10.1016/j.chb.2017.09.012 ↗
31. A framework for fidelity evaluation of immersive virtual reality systems10.1007/s10055-021-00618-y ↗
32. Next-Generation Museum: A Metaverse Journey into the Culture10.7433/s120.2023.08 ↗
33. Hutson, J., and Hutson, P. (2023). Application of Modern Trends in Museum, IntechOpen.
34. Hawkey, R. (2004). Learning with Digital Technologies in Museums, Science Centres and Galleries, Futurelab.
35. The significant loss of museum educators in 2020: A data story10.1080/10598650.2021.1977906 ↗
36. The Chicago sound show at the smart museum of art, the University of Chicago10.1080/20551940.2020.1719467 ↗
37. 3D reproductions of cultural heritage artifacts: Evaluation of significance and experience10.14434/sdh.v5i1.32323 ↗
38. Transformation of the museum experience through virtual reality (METAVERSE)
39. Unity (2024, March 11). Shaders. Unity Documentation. Available online: https://docs.unity3d.com/Manual/Shaders.html.
40. (2024, March 11). Hub de Museología Experimental. Available online: https://hume.institutoidf.com/.
41. NASA (2023, April 28). NASA IMAGES, Available online: https://www.nasa.gov/images/.
42. (2024, March 11). Spatial.io. Available online: https://www.spatial.io/.
43. AI and 6G Into the Metaverse: Fundamentals, Challenges and Future Research Trends10.1109/OJCOMS.2024.3349465 ↗
44. Martí-Testón, A., Muñoz, A., Gracia, L., and Solanes, J.E. (2023). Using WebXR Metaverse Platforms to Create Touristic Services and Cultural Promotion. Appl. Sci., 13.10.3390/app13148544 ↗
45. (2024, March 11). Spatial Creator Toolkit. Available online: https://docs.spatial.io/.
46. Unity (2024, March 11). Game Development Platform. Available online: https://unity.com/.
47. Unity (2024, March 11). Animation System Overview. Available online: https://docs.unity3d.com/Manual/AnimationOverview.html.
48. Blattgerste, J., Strenge, B., Renner, P., Pfeiffer, T., and Essig, K. (2017, January 21–23). Comparing Conventional and Augmented Reality Instructions for Manual Assembly Tasks. Proceedings of the 10th International Conference on PErvasive Technologies Related to Assistive Environments, ACM, Island of Rhodes, Greece.10.1145/3056540.3056547 ↗
49. Stephanidis, C. (2017). HCI International 2017—Posters’ Extended Abstracts, Springer.10.1007/978-3-319-58753-0 ↗
50. A Personal Resource for Technology Interaction: Development and Validation of the Affinity for Technology Interaction (ATI) Scale10.1080/10447318.2018.1456150 ↗
51. Camera 3D positioning mixed reality-based interface to improve worker safety, ergonomics and productivity10.1016/j.cirpj.2020.01.004 ↗
52. Solanes, J.E., Muñoz, A., Gracia, L., and Tornero, J. (2022). Virtual Reality-Based Interface for Advanced Assisted Mobile Robot Teleoperation. Appl. Sci., 12.10.3390/app12126071 ↗
53. The Experience of Presence: Factor Analytic Insights10.1162/105474601300343603 ↗
54. Real and Illusory Interactions Enhance Presence in Virtual Environments10.1162/105474602760204318 ↗
55. The sense of presence in virtual environments: A three-component scale measuring spatial presence, involvement, and realness
56. Brooke, J. (1996). “SUS-A Quick and Dirty Usability Scale.” Usability Evaluation in Industry, CRC Press.
57. Educación virtual: Consideraciones éticas y semánticas desde la infoesfera
58. EVE Museos Innovación (2024, April 14). Museos y su Futuro Tecnológico. Available online: https://evemuseografia.com/2023/02/07/museos-y-su-futuro-tecnologico/.
59. Pando, F. (2024, April 14). La Realidad Virtual como Herramienta para el Aprendizaje, la Salud y el Trabajo del Futuro. Available online: https://www.itmastersmag.com/noticias-analisis/que-es-y-hacia-donde-avanza-la-realidad-virtual/.