SARA: A Microservice-Based Architecture for Cross-Platform Collaborative Augmented Reality
Source abstract
Abstract
Augmented Reality (AR) functionalities may be effectively leveraged in collaborative service scenarios (e.g., remote maintenance, on-site building, street gaming, etc.). Standard development cycles for collaborative AR require to code for each specific visualization platform and implement the necessary control mechanisms over the shared assets. in order to face this challenge, this paper describes SARA, an architecture to support cross-platform collaborative Augmented Reality applications based on microservices. The architecture is designed to work over the concept of collaboration models which regulate the interaction and permissions of each user over the AR assets. Five of these collaboration models were initially integrated in SARA (turn, layer, ownership, hierarchy-based and unconstrained examples) and the platform enables the definition of new ones. Thanks to the reusability of its components, during the development of an application, SARA enables focusing on the application logic while avoiding the implementation of the communication protocol, data model handling and orchestration between the different, possibly heterogeneous, devices involved in the collaboration (i.e., mobile or wearable AR devices using different operating systems). to describe how to build an application based on SARA, a prototype for HoloLens and iOS devices has been implemented. the prototype is a collaborative voxel-based game in which several players work real time together on a piece of land, adding or eliminating cubes in a collaborative manner to create buildings and landscapes. Turn-based and unconstrained collaboration models are applied to regulate the interaction. the development workflow for this case study shows how the architecture serves as a framework to support the deployment of collaborative AR services, enabling the reuse of collaboration model components, agnostically handling client technologies.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Augmented Reality Applications · Interactive and Immersive Displays · IoT and Edge/Fog Computing
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Information Processing and Telecommunications Center, Universidad Politécnica de Madrid, 28040 Madrid, Spain
ETSI Telecomunicación, Av. Complutense 30, 28040 Madrid, Spain
Funding
Universidad Politécnica de Madrid
References (37)
Show source-provided references
1. (2020, March 17). Gartner 100 Million Consumers Will Shop in AR by 2020. Available online: https://www.gartner.com/en/newsroom/press-releases/2019-04-01-gartner-says-100-million-consumers-will-shop-in-augme.
2. A survey of augmented reality10.1162/pres.1997.6.4.355 ↗
3. A taxonomy of mixed reality visual displays
4. Caudell, T.P., and Mizell, D.W. (1992, January 7–10). Augmented reality: An application of heads-up display technology to manual manufacturing processes. Proceedings of the IEEE 25th Hawaii International Conference on System Sciences, Kauai, HI, USA.10.1109/HICSS.1992.183317 ↗
5. Rekimoto, J. (1996, January 18–20). Transvision: A hand-held augmented reality system for collaborative design. Proceedings of the Virtual Systems and Multimedia, Gifu, Japan.
6. Schmalstieg, D., Fuhrmann, A., Szalavari, Z., and Gervautz, M. (1996, January 26–28). Studierstube-an environment for collaboration in augmented reality. Proceedings of the CVE’96 Workshop Proceedings, Nottingham, UK.
7. “Studierstube”: An environment for collaboration in augmented reality10.1007/BF01409796 ↗
8. The studierstube augmented reality project10.1162/105474602317343640 ↗
9. Kaufmann, H. (2003). Collaborative Augmented Reality in Education, Institute of Software Technology and Interactive Systems, Vienna University of Technology.
10. Studierstube: An Application Environment for Multi-User Games in Virtual Reality
11. Exploring MARS: Developing indoor and outdoor user interfaces to a mobile augmented reality system10.1016/S0097-8493(99)00103-X ↗
12. Benko, H., Ishak, E.W., and Feiner, S. (2004, January 2–5). Collaborative mixed reality visualization of an archaeological excavation. Proceedings of the Third IEEE and ACM International Symposium on Mixed and Augmented Reality, Arlington, VA, USA.
13. Nilsson, S., Johansson, B., and Jonsson, A. (2009, January 19–22). Using AR to support cross-organisational collaboration in dynamic tasks. Proceedings of the 8th IEEE International Symposium on Mixed and Augmented Reality, Orlando, FL, USA.10.1109/ISMAR.2009.5336522 ↗
14. Distributed augmented reality for visualizing collaborative construction tasks10.1061/(ASCE)0887-3801(2009)23:6(418) ↗
15. Datcu, D., Cidota, M., Lukosch, S., Oliveira, D.M., and Wolff, M. (2014, January 19–20). Virtual co-location to support remote assistance for inflight maintenance in ground training for space missions. Proceedings of the 15th International Conference on Computer Systems and Technologies, Ruse, Bulgaria.10.1145/2659532.2659647 ↗
16. Aschenbrenner, D., Li, M., Dukalski, R., Verlinden, J., and Lukosch, S. (2018, January 18–22). Collaborative production line planning with augmented fabrication. Proceedings of the IEEE Conference on Virtual Reality and 3D User Interfaces (VR), Reutlingen, Germany.10.1109/VR.2018.8446533 ↗
17. Coppens, A., and Mens, T. (2018, January 21–24). Towards Collaborative Immersive Environments for Parametric Modelling. Proceedings of the International Conference on Cooperative Design, Visualization and Engineering, Hangzhou, China.10.1007/978-3-030-00560-3_44 ↗
18. REENACT: A step forward in immersive learning about Human History by augmented reality, role playing and social networking10.1016/j.eswa.2014.02.018 ↗
19. Enhancing 21st century skills with AR: Using the gradual immersion method to develop collaborative creativity10.12973/eurasia.2017.00627a ↗
20. Datcu, D., Lukosch, S.G., and Lukosch, H.K. (2014, January 15). A collaborative game to study the perception of presence during virtual co-location. Proceedings of the Companion Publication of the 17th ACM Conference on Computer Supported Cooperative Work & Social Computing, Baltimore, MD, USA.10.1145/2556420.2556792 ↗
21. Huo, K., Wang, T., Paredes, L., Villanueva, A.M., Cao, Y., and Ramani, K. (2018, January 14–17). SynchronizAR: Instant Synchronization for Spontaneous and Spatial Collaborations in Augmented Reality. Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology, Berlin, Germany.10.1145/3242587.3242595 ↗
22. De Belen, R.A.J., Nguyen, H., Filonik, D., Del Favero, D., and Bednarz, T. (2019). A systematic review of the current state of collaborative mixed reality technologies: 2013–2018. AIMS Electron. Electr. Eng.
23. Chi, P.Y.P., and Li, Y. (2015). Weave: Scripting cross-device wearable interaction. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, ACM.10.1145/2702123.2702451 ↗
24. Houben, S., and Marquardt, N. (2015). Watchconnect: A toolkit for prototyping smartwatch-centric cross-device applications. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, ACM.10.1145/2702123.2702215 ↗
25. Nebeling, M., Teunissen, E., Husmann, M., and Norrie, M.C. (2014, January 17–20). XDKinect: Development framework for cross-device interaction using kinect. Proceedings of the 2014 ACM SIGCHI Symposium on Engineering Interactive Computing Systems, Rome, Italy.10.1145/2607023.2607024 ↗
26. Yang, J., and Wigdor, D. (2014, January 17–20). Panelrama: enabling easy specification of cross-device web applications. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Rome, Italy.10.1145/2556288.2557199 ↗
27. Nebeling, M., Mintsi, T., Husmann, M., and Norrie, M. (2014, January 17–20). Interactive development of cross-device user interfaces. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Rome, Italy.10.1145/2556288.2556980 ↗
28. Speicher, M., Hall, B.D., Yu, A., Zhang, B., Zhang, H., Nebeling, J., and Nebeling, M. (2018, January 21–26). XD-AR: Challenges and opportunities in cross-device augmented reality application development. Proceedings of the ACM on Human-Computer Interaction, Montreal, QB, Canada.10.1145/3229089 ↗
29. (2020, March 17). Azure Spatial Anchors. Microsoft. Available online: https://azure.microsoft.com/id-id/services/spatial-anchors/.
30. (2020, March 17). Spectator View. Microsoft. Available online: https://docs.microsoft.com/en-us/windows/mixed-reality/spectator-view/.
31. (2020, March 17). Merriam-Webster’s Definition of Collaboration. Available online: https://www.merriam-webster.com/dictionary/collaboration.
32. A Solution to the Simultaneous Localization and Map Building (SLAM) problem10.1109/70.938381 ↗
33. The pains and gains of microservices: A systematic grey literature review10.1016/j.jss.2018.09.082 ↗
34. (2020, March 17). Minecraft. Available online: https://www.minecraft.net/en-us/.
35. (2020, March 17). Minecraft Earth. Available online: https://www.minecraft.net/es-es/about-earth.
36. (2020, March 17). League Of Legends Game. Available online: https://www.leagueoflegends.com.
37. (2020, March 17). SARA in Action, Video on YouTube. Available online: https://youtu.be/EBMPeK7gJ0Q.