A Multi-Robot Spatial Augmented Reality Sandbox with Virtual Sensors for Computational Thinking Education
Source abstract
Abstract
In this paper, we introduce an immersive Spatial Augmented Reality (SAR) arena where multiple mobile robots interact with virtual sensors and actuators, enabling novice students to explore distributed and parallel algorithms. The arena uses overhead projection to display virtual objects (e.g., walls, targets, and sensor fields) onto a physical workspace, while robots (Smart Cutebot controlled by Micro:bit) operate under both physical and projected inputs. This framework is implemented via specialized software extensions for Microsoft MakeCode, offering varying levels of abstraction suitable for both novice learners and advanced researchers. The system’s effectiveness is validated through technical characterization of its positioning sensors (achieving an accuracy of over 99% and a precision margin of ±0.1 cm) and qualitative user studies with primary and university-level students. The findings suggest that the virtualization of robotic components through SAR significantly lowers the entry barrier for understanding distributed programming and collective robotics while fostering the development of computational thinking through immersive, collaborative interaction.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Augmented Reality Applications · Virtual Reality Applications and Impacts · Robotics and Automated Systems
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Computer Engineering, Universidad Católica Andrés Bello (UCAB), Av. Teherán, Urb. Montalbán, Parroquia La Vega, Ap. 20332, Caracas 1020, Venezuela
Faculty of Engineering, University of Deusto, Av. Universidades, 24, 48007 Bilbao, Spain
Funding
Basque Government
References (33)
Show source-provided references
1. Bonabeau, E., Dorigo, M., and Theraulaz, G. (1999). Swarm Intelligence—From Natural to Artificial Systems, Oxford University Press.10.1093/oso/9780195131581.001.0001 ↗
2. Liu, J., and Wu, J. (2001). Multiagent Robotic Systems, CRC Press.10.1201/9781420038835 ↗
3. Van Steen, M., and Tanenbaum, A.S. (2017). Distributed Systems, Maarten van Steen.
4. Computation and Computational Thinking10.1093/comjnl/bxs074 ↗
5. Broll, B., Ledeczi, A., Volgyesi, P., Sallai, J., Maroti, M., and Vanags, C. (2017). Introducing parallel and distributed computing to K12. Proceedings of the 2017 IEEE International Parallel and Distributed Processing Symposium Workshops, IEEE.10.1109/IPDPSW.2017.81 ↗
6. Papert, S. (1980). Mindstorms: Children, Computers, and Powerful Ideas, Basic Books, Inc.
7. Scratch: Programming for all10.1145/1592761.1592779 ↗
8. Applicability of augmented and virtual reality for education in robotics
9. Effect of augmented reality-based virtual educational robotics on programming students’ enjoyment of learning, computational thinking skills, and academic achievement10.1016/j.compedu.2022.104721 ↗
10. Bimber, O., and Raskar, R. (2005). Spatial Augmented Reality Merging Real and Virtual Worlds, A K Peters.10.1201/b10624 ↗
11. Ghiringhelli, F., Guzzi, J., Caro, G., Caglioti, V., Gambardella, L., and Giusti, A. (2014). Interactive Augmented Reality for understanding and analyzing multi-robot systems. Proceedings of the 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems, IEEE.10.1109/IROS.2014.6942709 ↗
12. Hönig, W., Milanes, C., Scaria, L., Phan, T., Bolas, M., and Ayanian, N. (2015). Mixed reality for robotics. Proceedings of the 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE.10.1109/IROS.2015.7354138 ↗
13. A multichannel human-swarm robot interaction system in augmented reality10.1016/j.vrih.2020.05.006 ↗
14. Towards Augmented Reality Support for Swarm Monitoring: Evaluating Visual Cues to Prevent Fragmentation10.1109/TVCG.2025.3616840 ↗
15. Suzuki, R., Karim, A., Xia, T., Hedayati, H., and Marquardt, N. (2022). Augmented Reality and Robotics: A Survey and Taxonomy for AR-enhanced Human-Robot Interaction and Robotic Interfaces. Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, ACM.10.1145/3491102.3517719 ↗
16. Exploring the educational potential of robotics in schools: A systematic review10.1016/j.compedu.2011.10.006 ↗
17. A systematic review of teaching and learning machine learning in K-12 education10.1007/s10639-022-11416-7 ↗
18. A Review on the Use of Robots in Education and Young Children
19. Coding and Computational Thinking in Early Childhood: The Impact of ScratchJr in Europe10.20897/ejsteme/3868 ↗
20. Kegeleirs, M., and Birattari, M. (2025). Towards applied swarm robotics: Current limitations and enablers. Front. Robot. AI, 12.10.3389/frobt.2025.1607978 ↗
21. Arai, K. (2022). Past, Present, and Future of Swarm Robotics. Intelligent Systems and Applications. IntelliSys 2021, Springer. Lecture Notes in Networks and Systems.10.1007/978-3-030-82199-9 ↗
22. A programming environment having three levels of complexity for mobile robotics10.15446/ing.investig.v32n3.35947 ↗
23. Immersive Interfaces for Engagement and Learning10.1126/science.1167311 ↗
24. A systematic review of immersive virtual reality applications for higher education: Design elements, lessons learned, and research agenda10.1016/j.compedu.2019.103778 ↗
25. Augmented reality spatial programming paradigm applied to end-user robot programming10.1016/j.rcim.2024.102770 ↗
26. Virtual, Augmented, and Mixed Reality for Human-robot Interaction: A Survey and Virtual Design Element Taxonomy10.1145/3597623 ↗
27. Makhataeva, Z., and Varol, H.A. (2020). Augmented reality for robotics: A review. Robotics, 9.10.3390/robotics9020021 ↗
28. Augmented reality and robotics in education: A systematic literature review10.1016/j.chbah.2025.100157 ↗
29. Jang, S., Yum, H., and Lee, A. (2025). Data-Driven Forward Kinematics for Robotic Spatial Augmented Reality: A Deep Learning Framework Using LSTM and Attention. Actuators, 14.10.3390/act14120569 ↗
30. Lárez, J. (2020). Ambiente de Robótica Multi-Agente Basado en Sensores y Actuadores Virtuales para Micro-Robots Minimalistas, Universidad Católica Andrés Bello.
31. Espejo, P. (2022). Entorno de Robótica Educativa Multiagente Orientado a Favorecer el Desarrollo del Pensamiento Computacional en Jóvenes Cursantes de Educación Media. [Bachelor’s Thesis, UCAB, Escuela Ingeniería Informática].
32. Augmented Reality Robot Manipulation with Physical Mock-up and Improved Spatial Cognition10.1016/j.ijhcs.2025.103658 ↗
33. Educational robotics as a pedagogical resource for K-12 students with learning difficulties10.1038/s41598-025-19821-x ↗