ATON: An Open-Source Framework for Creating Immersive, Collaborative and Liquid Web-Apps for Cultural Heritage
Source abstract
Abstract
The web and its recent advancements represent a great opportunity to build universal, rich, multi-user and immersive Web3D/WebXR applications targeting Cultural Heritage field—including 3D presenters, inspection tools, applied VR games, collaborative teaching tools and much more. Such opportunity although, introduces additional challenges besides common issues and limitations typically encountered in this context. The “ideal” Web3D application should be able to reach every device, automatically adapting its interface, rendering and interaction models—resulting in a single, liquid product that can be consumed on mobile devices, PCs, Museum kiosks and immersive AR/VR devices, without any installation required for final users. The open-source ATON framework is the result of research and development activities carried out during the last 5 years through national and international projects: it is designed around modern and robust web standards, open specifications and large open-source ecosystems. This paper describes the framework architecture and its components, assessed and validated through different case studies. ATON offers institutions, researchers, professionals a scalable, flexible and modular solution to craft and deploy liquid web-applications, providing novel and advanced features targeting Cultural Heritage field in terms of 3D presentation, annotation, immersive interaction and real-time collaboration.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: 3D Surveying and Cultural Heritage · Augmented Reality Applications · Virtual Reality Applications and Impacts
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
National Research Council—Institute of Heritage Science (CNR-ISPC), Area della Ricerca di Roma 1, 00015 Monterotondo, Italy
Department of Cultural Heritage, University of Padua, 35139 Padua, Italy
References (92)
Show source-provided references
1. Kharoub, H., Lataifeh, M., and Ahmed, N. (2019). 3d user interface design and usability for immersive vr. Appl. Sci., 9.10.3390/app9224861 ↗
2. 3D graphics on the web: A survey10.1016/j.cag.2014.02.002 ↗
3. Gasston, P. (2013). The Modern Web: Multi-Device Web Development with HTML5, CSS3, and JavaScript, No Starch Press.
4. Nurminen, J.K., Meyn, A.J., Jalonen, E., Raivio, Y., and Marrero, R.G. (2013, January 14–19). P2P media streaming with HTML5 and WebRTC. Proceedings of the 2013 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS), Turin, Italy.10.1109/INFCOMW.2013.6970739 ↗
5. The seven deadly sins of the HTML5 WebAPI: A large-scale study on the risks of mobile sensor-based attacks10.1145/3403947 ↗
6. Neelakantam, S., and Pant, T. (2017). Bringing VR to the Web and WebVR Frameworks. Learning Web-Based Virtual Reality, Springer.10.1007/978-1-4842-2710-7 ↗
7. Jones, B., and Waliczek, N. (2019). WebXR device API. W3C Work. Draft, 10.
8. González-Zúñiga, L.D., and O’Shaughnessy, P. (2019). Virtual Reality… in the Browser. VR Developer Gems, CRC Press.
9. Maclntyre, B., and Smith, T.F. (2018, January 16–20). Thoughts on the Future of WebXR and the Immersive Web. Proceedings of the 2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), Munich, Germany.10.1109/ISMAR-Adjunct.2018.00099 ↗
10. Biggio, F. (2020, January 28–30). Protocols of immersive web: WebXR APIs and the AR Cloud. Proceedings of the 3rd International Conference on Web Studies, Madrid, Spain.10.1145/3423958.3423965 ↗
11. Echavarria, K.R., Dibble, L., Bracco, A., Silverton, E., and Dixon, S. (2019, January 6–9). Augmented Reality (AR) Maps for Experiencing Creative Narratives of Cultural Heritage. Proceedings of the EUROGRAPHICS Workshop on Graphics and Cultural Heritage (2019), Sarajevo, Bosnia and Herzegovina.
12. Jung, K., Nguyen, V.T., and Lee, J. (2021). BlocklyXR: An Interactive Extended Reality Toolkit for Digital Storytelling. Appl. Sci., 11.10.3390/app11031073 ↗
13. gltf: Designing an open-standard runtime asset format10.1201/b16721-28 ↗
14. Happa, J., and Artusi, A. (2020). Studying Illumination and Cultural Heritage. Visual Computing for Cultural Heritage, Springer.10.1007/978-3-030-37191-3_2 ↗
15. Vanweddingen, V., Vastenhoud, C., Proesmans, M., Hameeuw, H., Vandermeulen, B., Van der Perre, A., Lemmers, F., Watteeuw, L., and Van Gool, L. (2018). A status quaestionis and future solutions for using multi-light reflectance imaging approaches for preserving cultural heritage artifacts. Euro-Mediterranean Conference, Springer.10.1007/978-3-030-01765-1_23 ↗
16. Schilling, A., Bolling, J., and Nagel, C. (2016, January 22–24). Using glTF for streaming CityGML 3D city models. Proceedings of the 21st International Conference on Web3D Technology, Anaheim, CA, USA.10.1145/2945292.2945312 ↗
17. Combining IFC and 3D tiles to create 3D visualization for building information modeling10.1016/j.autcon.2019.102995 ↗
18. Mao, B., Ban, Y., and Laumert, B. (2020). Dynamic Online 3D Visualization Framework for Real-Time Energy Simulation Based on 3D Tiles. ISPRS Int. J. Geo-Inf., 9.10.3390/ijgi9030166 ↗
19. Danchilla, B. (2012). Three. js framework. Beginning WebGL for HTML5, Springer.10.1007/978-1-4302-3997-0 ↗
20. Münster, S., Maiwald, F., Lehmann, C., Lazariv, T., Hofmann, M., and Niebling, F. (2020, January 12). An Automated Pipeline for a Browser-based, City-scale Mobile 4D VR Application based on Historical Images. Proceedings of the 2nd Workshop on Structuring and Understanding of Multimedia heritAge Contents, Seattle, WA, USA.10.1145/3423323.3425748 ↗
21. Gill, A. (2017, January 4). AFrame: A domain specific language for virtual reality. Proceedings of the 2nd International Workshop on Real World Domain Specific Languages, Austin, TX, USA.10.1145/3039895.3039899 ↗
22. 3DHOP: 3D heritage online presenter10.1016/j.cag.2015.07.001 ↗
23. Lloyd, J. (2016). Contextualizing 3D cultural heritage. Euro-Mediterranean Conference, Springer.10.1007/978-3-319-48496-9_69 ↗
24. Romphf, J., Neuman-Donihue, E., Heyworth, G., and Zhu, Y. (2021). Resurrect3D: An Open and Customizable Platform for Visualizing and Analyzing Cultural Heritage Artifacts. arXiv.10.31224/osf.io/g3y6n ↗
25. Progressive web apps: The possible web-native unifier for mobile development
26. Dawning of Progressive Web Applications (PWA): Edging Out the Pitfalls of Traditional Mobile Development
27. Shah, H. (2017). Node. js challenges in implementation. Glob. J. Comput. Sci. Technol., 17.
28. CulturalERICA: A conversational agent improving the exploration of European cultural heritage10.1016/j.culher.2019.07.010 ↗
29. Huang, C.M., and Guo, Y.A. (2018, January 16–18). A Touring and Navigation Service Platform for Mobile Digital Culture Heritage (M-DCH). Proceedings of the 2018 15th International Symposium on Pervasive Systems, Algorithms and Networks (I-SPAN), Yichang, China.10.1109/I-SPAN.2018.00038 ↗
30. Bran, E., Bautu, E., Popovici, D.M., Braga, V., and Cojuhari, I. (2019). Cultural Heritage Interactive Dissemination through Natural Interaction, RoCHI.
31. Doglio, F., Doglio, and Corrigan (2018). REST API Development with Node.js, Springer.10.1007/978-1-4842-3715-1 ↗
32. Aderaldo, C.M., Mendonça, N.C., Pahl, C., and Jamshidi, P. (2017, January 22). Benchmark requirements for microservices architecture research. Proceedings of the 2017 IEEE/ACM 1st International Workshop on Establishing the Community-Wide Infrastructure for Architecture-Based Software Engineering (ECASE), Buenos Aires, Argentina.10.1109/ECASE.2017.4 ↗
33. Collaborating and Learning in Shared Virtual Environments
34. Vincenti, G., and Braman, J. (2010). Teaching through Multi-User Virtual Environments: Applying Dynamic Elements to the Modern Classroom: Applying Dynamic Elements to the Modern Classroom, IGI Global.10.4018/978-1-61692-822-3 ↗
35. Barchetti, U., Bucciero, A., Santo Sabato, S., and Mainetti, L. (2010). A Framework to Generate 3D Learning Experience. New Achievements in Technology, Education and Development, IntechOpen.10.5772/9214 ↗
36. Mariani, R. (2021, November 22). A New Virtual. A New Reality. How Pedagogical Approaches Are Changing. Available online: https://purdueglobal.dspacedirect.org/handle/20.500.12264/323.
37. Li, J., Vinayagamoorthy, V., Williamson, J., Shamma, D.A., and Cesar, P. (2021, January 8–13). Social VR: A New medium for remote communication and collaboration. Proceedings of the Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems, Yokohama, Japan.10.1145/3411763.3441346 ↗
38. Jonas, M., Said, S., Yu, D., Aiello, C., Furlo, N., and Zytko, D. (2019, January 22–25). Towards a taxonomy of social vr application design. Proceedings of the Extended Abstracts of the Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts, Barcelona, Spain.10.1145/3341215.3356271 ↗
39. Kong, Y. (2018). User Experience in Social Virtual Reality: Exploring Methodologies for Evaluating User Experience in Social Virtual Reality. [Master Thesis, Delft University of Technology].
40. Reinhardt, J., and Wolf, I.K. (2018, January 7–9). Opportunities of Social VR in Digital Museum Twins. Proceedings of the Berlin Conference on Electronic Media & Visual Arts EVA BERLIN 2018, Berlin, Germany.
41. Latoschik, M.E., Roth, D., Gall, D., Achenbach, J., Waltemate, T., and Botsch, M. (2017, January 8–10). The effect of avatar realism in immersive social virtual realities. Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology, Gothenburg, Sweden.10.1145/3139131.3139156 ↗
42. Bönsch, A., Radke, S., Overath, H., Asché, L.M., Wendt, J., Vierjahn, T., Habel, U., and Kuhlen, T.W. (2018, January 18–22). Social VR: How personal space is affected by virtual agents’ emotions. Proceedings of the 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), Tuebingen/Reutlingen, Germany.10.1109/VR.2018.8446480 ↗
43. Hudák, M., Korečko, Š., and Sobota, B. (2020, January 23–25). Advanced user interaction for web-based collaborative virtual reality. Proceedings of the 2020 11th IEEE International Conference on Cognitive Infocommunications (CogInfoCom), Mariehamn, Finland.10.1109/CogInfoCom50765.2020.9237899 ↗
44. Bredikhina, L., Sakaguchi, T., and Shirai, A. (2020, January 9–13). Web3D Distance live workshop for children in Mozilla Hubs. Proceedings of the 25th International Conference on 3D Web Technology, Seoul, Korea.10.1145/3424616.3424724 ↗
45. Suslov, N. (2019, January 16–18). LiveCoding. space: Towards P2P Collaborative Live Programming Environment for WebXR. Proceedings of the Fourth International Conference on Live Coding (ICLC 2019), Madrid, Spain. Available online: http://iclc.livecodenetwork.org/2019/papers/paper133.pdf.
46. Fette, I., and Melnikov, A. (2021, November 22). TheWebsocket Protocol. RFC Editor. Available online: https://www.hjp.at/doc/rfc/rfc6455.html.
47. Chen, B., and Xu, Z. (2011, January 26–28). A framework for browser-based Multiplayer Online Games using WebGL and WebSocket. Proceedings of the 2011 IEEE International Conference on Multimedia Technology, Hangzhou, China.
48. Gunkel, S., Prins, M., Stokking, H., and Niamut, O. (2017). WebVR Meets WebRTC: Towards 360-Degree Social VR Experiences, IEEE.10.1109/VR.2017.7892377 ↗
49. ARIADNE: A research infrastructure for archaeology10.1145/3064527 ↗
50. A cloud-based architecture for processing and dissemination of 3D landscapes online
51. Gonzalez, D. (2016). Developing Microservices with node.js, Packt Publishing.
52. Bryan, P., and Nottingham, M. (2013). Javascript object notation (json) patch. RFC 6902 (Propos. Stand.), Internet Engineering Task Force (IETF).10.17487/rfc6902 ↗
53. Frain, B. (2020). Responsive Web Design with HTML5 and CSS: Develop Future-Proof Responsive Websites Using the Latest HTML5 and CSS Techniques, Packt Publishing Ltd.
54. 3D reconstruction and validation of historical background for immersive VR applications and games: The case study of the Forum of Augustus in Rome10.1016/j.culher.2019.12.004 ↗
55. Optimising Environmental Educational Narrative Videogames: The Case of ‘A Night in the Forum’10.1145/3424952 ↗
56. Russell, J. (2015). HDR Image-Based Lighting on the Web. WebGL Insights, A K Peters/CRC Press.
57. Towards foveated rendering for gaze-tracked virtual reality10.1145/2980179.2980246 ↗
58. Dangkham, P. (2018, January 10–12). Mobile augmented reality on web-based for the tourism using HTML5. Proceedings of the 2018 IEEE International Conference on Information Networking (ICOIN), Chiang Mai, Thailand.10.1109/ICOIN.2018.8343165 ↗
59. The WINCKELMANN300 PROJECT: Dissemination of Culture with Virtual Reality at the Capitoline Museum in Rome10.5194/isprs-archives-XLII-2-371-2018 ↗
60. Designing interaction metaphors for Web3D cultural dissemination10.1016/j.culher.2012.01.009 ↗
61. Bozgeyikli, E., Raij, A., Katkoori, S., and Dubey, R. (2016, January 16–19). Point & teleport locomotion technique for virtual reality. Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play, Austin, TX, USA.10.1145/2967934.2968105 ↗
62. Boletsis, C. (2017). The new era of virtual reality locomotion: A systematic literature review of techniques and a proposed typology. Multimodal Technol. Interact., 1.10.3390/mti1040024 ↗
63. Habgood, M.J., Moore, D., Wilson, D., and Alapont, S. (2018, January 18–22). Rapid, continuous movement between nodes as an accessible virtual reality locomotion technique. Proceedings of the 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), Tuebingen/Reutlingen, Germany.
64. Cournia, N., Smith, J.D., and Duchowski, A.T. (2003, January 5–10). Gaze-vs. hand-based pointing in virtual environments. Proceedings of the CHI’03 Extended Abstracts on Human Factors in Computing Systems, Ft. Lauderdale, FL, USA.10.1145/765891.765982 ↗
65. Minakata, K., Hansen, J.P., MacKenzie, I.S., Bækgaard, P., and Rajanna, V. (2019, January 25–28). Pointing by gaze, head, and foot in a head-mounted display. Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications, Denver, CO, USA.10.1145/3317956.3318150 ↗
66. Spatial indexing of complex virtual reality scenes in the web10.1142/S0219467817500097 ↗
67. Temporal Lensing: An Interactive and Scalable Technique for Web3D/WebXR Applications in Cultural Heritage10.3390/heritage4020040 ↗
68. Flotyński, J., Malamos, A.G., Brutzman, D., Hamza-Lup, F.G., Polys, N.F., Sikos, L.F., and Walczak, K. (2020). Recent advances in Web3D semantic modeling. Recent Adv. Imaging Model. Reconstr., 23–49.10.4018/978-1-5225-5294-9.ch002 ↗
69. Effective annotations over 3D models10.1111/cgf.13664 ↗
70. Separating semantics from rendering: A scene graph based architecture for graphics applications10.1007/s00371-011-0572-0 ↗
71. Serna, S.P., Schmedt, H., Ritz, M., and Stork, A. (2012, January 19–21). Interactive Semantic Enrichment of 3D Cultural Heritage Collections. Proceedings of the VAST: International Symposium on Virtual Reality, Archaeology and Intelligent Cultural Heritage, Brighton, UK.
72. A white-box framework to oversee archaeological virtual reconstructions in space and time: Methods and tools
73. Alger, M. (2021, November 22). Visual Design Methods for Virtual Reality. Ravensbourne, Available online: http://aperturesciencellc. com/vr/VisualDesignMethodsforVR_MikeAlger. pdf.
74. Immersive VR and education: Embodied design principles that include gesture and hand controls10.3389/frobt.2018.00081 ↗
75. Hammady, R., and Ma, M. (2019). Designing spatial ui as a solution of the narrow fov of microsoft hololens: Prototype of virtual museum guide. Augmented Reality and Virtual Reality, Springer.10.1007/978-3-030-06246-0_16 ↗
76. Rai, R. (2013). Socket. IO Real-Time Web Application Development, Packt Publishing Ltd.
77. Palombini, A., Fanini, B., and Pagano, A. (2018). The Virtual Museum of the Upper Calore Valley. International and Interdisciplinary Conference on Digital Environments for Education, Arts and Heritage, Springer.
78. Interactive Digital Environments for Cultural Heritage and Museums. Building a digital ecosystem to display hidden collections
79. Heritage education through serious games. A web-based proposal for primary schools to cope with distance learning
80. Encoding immersive sessions for online, interactive VR analytics10.1007/s10055-019-00405-w ↗
81. Fanini, B., and Cinque, L. (2020). Encoding, Exchange and Manipulation of Captured Immersive VR Sessions for Learning Environments: The PRISMIN Framework. Appl. Sci., 10.10.3390/app10062026 ↗
82. Cavalieri, M. (2008). La villa romana di Aiano-Torraccia di Chiusi, III campagna di scavi 2007. Il progetto internazionale “VII Regio. Il caso della Val d’Elsa in età romana e tardoantica”. FOLD&R Fastionline Doc. Res., 1–23. Available online: http://www.fastionline.org/docs/FOLDER-it-2008-110.pdf.
83. Ferdani, D., Demetrescu, E., Cavalieri, M., Pace, G., and Lenzi, S. (2020). 3D Modelling and Visualization in Field Archaeology. From Survey To Interpretation Of The Past Using Digital Technologies. Groma. Doc. Archaeol.
84. Demetrescu, E. (2017). Virtual reconstruction as a scientific tool. Digital Research and Education in Architectural Heritage, Springer.10.1007/978-3-319-76992-9_7 ↗
85. Italgraf (2009). Nora. Il Foro Romano. Storia di un’area Urbana Dall’età Fenicia alla Tarda Antichità (1997–2006), I–IV, Edizioni Quasar.
86. Pai, H.Y. (2019, January 3–6). Texture designs and workflows for physically based rendering using procedural texture generation. Proceedings of the 2019 IEEE Eurasia Conference on IOT, Communication and Engineering (ECICE), Yunlin, Taiwan.10.1109/ECICE47484.2019.8942651 ↗
87. Baruah, R. (2021). Creating an Augmented Reality Website with Three. js and the WebXR API. AR and VR Using the WebXR API, Springer.10.1007/978-1-4842-6318-1 ↗
88. Inverse lighting and photorealistic rendering for augmented reality10.1007/s00371-010-0501-7 ↗
89. Waldner, F. (2021, November 22). Real-Time Ray Traced Ambient Occlusion and Animation: Image Quality and Performance of Hardware-Accelerated Ray Traced Ambient Occlusion. Available online: https://www.diva-portal.org/smash/record.jsf?pid=diva2%3A1574351&dswid=3216.
90. The European Research Infrastructure for Heritage Science (ERIHS)10.5194/isprs-archives-XLII-2-W5-661-2017 ↗
91. Sparkes, M. (2021, November 22). What Is a Metaverse. Available online: https://www.sciencedirect.com/science/article/abs/pii/S0262407921014500.
92. Potenziani, M., Callieri, M., and Scopigno, R. (2018, January 12–15). Developing and Maintaining a Web 3D Viewer for the CH Community: An Evaluation of the 3DHOP Framework. Proceedings of the Eurographics GCH, Vienna, Austria.