Examining and Comparing the Effectiveness of Virtual Reality Serious Games and LEGO Serious Play for Learning Scrum
Source abstract
Abstract
Significant research work has been undertaken related to the game-based learning approach over the last years. However, a closer look at this work reveals that further research is needed to examine some types of game-based learning approaches such as virtual reality serious games and LEGO Serious Play. This article examines and compares the effectiveness for learning Scrum and related agile practices of a serious game based on virtual reality and a learning activity based on the LEGO Serious Play methodology. The presented study used a quasi-experimental design with two groups, pre- and post-tests, and a perceptions questionnaire. The sample was composed of 59 software engineering students, 22 of which belonged to group A, while the other 37 were part of group B. The students in group A played the virtual reality serious game, whereas the students in group B conducted the LEGO Serious Play activity. The results show that both game-based learning approaches were effective for learning Scrum and related agile practices in terms of learning performance and motivation, but they also show that the students who played the virtual reality serious game outperformed their peers from the other group in terms of learning performance.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Educational Games and Gamification · Virtual Reality Applications and Impacts · Teaching and Learning Programming
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Computer Science Department, Universidad Politécnica de Madrid, 28040 Madrid, Spain
Funding
Universidad Politécnica de Madrid (UPM)
References (61)
Show source-provided references
1. Digital games in engineering education: Systematic review and future trends10.1080/03043797.2022.2093168 ↗
2. The effect of game-based learning on student achievement: A meta-analysis study
3. Effects of game-based learning on students’ mathematics achievement: A meta-analysis10.1111/jcal.12347 ↗
4. Effects of digital game-based learning on elementary science learning: A systematic review10.1109/ACCESS.2019.2916324 ↗
5. An update to the systematic literature review of empirical evidence of the impacts and outcomes of computer games and serious games10.1016/j.compedu.2015.11.003 ↗
6. A systematic literature review of games-based learning empirical evidence in primary education10.1016/j.compedu.2016.09.001 ↗
7. Engineers at play: Games as teaching tools for undergraduate engineering students10.1002/jee.20106 ↗
8. Digital.ai (2021). 15th State of Agile Report, Digital.ai. Available online: https://info.digital.ai/rs/981-LQX-968/images/SOA15.pdf.
9. Verma, P., Kumar, R., Tuteja, J., and Gupta, N. (2021, January 4–6). Systematic review of virtual reality & its challenges. Proceedings of the 3rd International Conference on Intelligent Communication Technologies and Virtual Mobile Networks (ICICV 2021), Tirunelveli, India.10.1109/ICICV50876.2021.9388631 ↗
10. A systematic review of immersive virtual reality for industrial skills training10.1080/0144929X.2021.1954693 ↗
11. Kurniawan, C., Rosmansyah, Y., and Dabarsyah, B. (2019, January 25–26). A Systematic Literature Review on Virtual Reality for Learning. Proceedings of the 2019 5th International Conference on Wireless and Telematics, ICWT 2019, Yogyakarta, Indonesia.10.1109/ICWT47785.2019.8978263 ↗
12. Virtual reality surgery simulation: A survey on patient specific solution
13. Hernandez, Y., and Ramirez, M.P. (2016, January 25–28). Virtual reality systems for training improvement in electrical distribution substations. Proceedings of the IEEE 16th International Conference on Advanced Learning Technologies, ICALT 2016, Austin, TX, USA.10.1109/ICALT.2016.141 ↗
14. Stănică, I.-C., Dascalu, M.-I., Moldoveanu, A., Bodea, C.-N., and Hostiuc, S. (2016, January 21–22). A survey of virtual reality applications as psychotherapeutic tools to treat phobias. Proceedings of the 12th International Scientific Conference eLearning and Software for Education, Bucharest, Romania.10.12753/2066-026X-16-056 ↗
15. Cheng, A., Yang, L., and Andersen, E. (2017, January 6–11). Teaching language and culture with a virtual reality game. Proceedings of the Conference on Human Factors in Computing Systems, Denver, CO, USA.10.1145/3025453.3025857 ↗
16. Rivas, D., Alvarez, M.V., Guerrero, F., Grijalva, D., Loor, S., Espinoza, J., Vayas, G., and Huerta, M. (2017, January 20–22). Virtual reality applied to physics teaching. Proceedings of the 2017 9th International Conference on Education Technology and Computers, Barcelona, Spain.10.1145/3175536.3175575 ↗
17. Kamińska, D., Sapiński, T., Wiak, S., Tikk, T., Haamer, R.E., Avots, E., Helmi, A., Ozcinar, C., and Anbarjafari, G. (2019). Virtual reality and its applications in education: Survey. Information, 10.10.3390/info10100318 ↗
18. Pirker, J., Dengel, A., Holly, M., and Safikhani, S. (2020, January 1–4). Virtual Reality in Computer Science Education: A Systematic Review. Proceedings of the 26th ACM Symposium on Virtual Reality Software and Technology, Virtual Event, Canada.10.1145/3385956.3418947 ↗
19. Mayor, J., and López-Fernández, D. (2021). Scrum VR: Virtual reality serious video game to learn Scrum. Appl. Sci., 11.10.3390/app11199015 ↗
20. Learning and Motivational Impact of Using a Virtual Reality Serious Video Game to Learn Scrum10.1109/TG.2022.3213127 ↗
21. Are virtual reality serious video games more effective than web video games?10.1109/MCG.2023.3244036 ↗
22. Ma, M., Fletcher, B., Göbel, S., Hauge, J.B., and Marsh, T. (2020). Serious Games, Springer.10.1007/978-3-030-61814-8 ↗
23. Radhakrishnan, U., and Koumaditis, K. (2020, January 1–4). Teaching Scrum with a Virtual Sprint Simulation: Initial design and considerations. Proceedings of the 26th ACM Symposium on Virtual Reality Software and Technology, Virtual Event, Canada.10.1145/3385956.3422107 ↗
24. Visescu, I., Blindu, A., Radhakrishnan, U., Kadenic, M., Chinello, F., and Koumaditis, K. (2022, January 8–12). Teaching project management in a virtual environment: The Virtual Scrum Simulator (ScrumSim). Proceedings of the 2022 Nordic Human-Computer Interaction Conference, Aarhus, Denmark.10.1145/3547522.3547717 ↗
25. (2023, November 17). LEGO Serious Play. Available online: https://www.lego.com/themes/serious-play/background.
26. How It All Began: The Origins Of LEGO® Serious Play®10.18646/2056.54.18-025 ↗
27. Facilitating co-creation experience in the classroom with Lego Serious Play10.1016/j.ausmj.2018.05.013 ↗
28. James, A.R. (2013). Lego Serious Play: A three-dimensional approach to learning development. J. Learn. Dev. High. Educ., 6.10.47408/jldhe.v0i6.208 ↗
29. Hansen, P.K., and O’Connor, R. (2012). Encyclopedia of the Sciences of Learning, Springer.
30. Nielsen, C.B., and Adams, P. (2015, January 28–30). Active learning via LEGO MINDSTORMS in Systems Engineering education. Proceedings of the 2015 IEEE International Symposium on Systems Engineering (ISSE), Rome, Italy.10.1109/SysEng.2015.7302802 ↗
31. Kurkovsky, S. (2015, January 4–8). Teaching software engineering with LEGO serious play. Proceedings of the 2015 ACM Conference on Innovation and Technology in Computer Science Education, Vilnius, Lithuania.10.1145/2729094.2742604 ↗
32. Kurkovsky, S., Ludi, S., and Clark, L. (2019, January 27). Active learning with LEGO for software requirements. Proceedings of the 50th ACM Technical Symposium on Computer Science Education (SIGCSE 2019), Minneapolis, MN, USA.10.1145/3287324.3287444 ↗
33. Kurkovsky, S. (2018, January 2–4). Using LEGO to teach software interfaces and integration. Proceedings of the 23rd Annual ACM Conference on Innovation and Technology in Computer Science Education, Larnaca, Cyprus.10.1145/3197091.3205831 ↗
34. Kurkovsky, S. (2016, January 9–13). A LEGO-based approach to introducing test-driven development. Proceedings of the 2016 ACM Conference on Innovation and Technology in Computer Science Education, Arequipa, Peru.10.1145/2899415.2925500 ↗
35. Kurkovsky, S. (2020, January 11–14). A simple game to introduce Scrum concepts. Proceedings of the 51st ACM Technical Symposium on Computer Science Education (SIGCSE 2020), Portland, OR, USA.10.1145/3328778.3372593 ↗
36. LEGO® Serious Play in Software Engineering Education10.1109/ACCESS.2021.3095552 ↗
37. Krivitsky, A. (2017). lego4scrum: A Complete Guide. A Great Way to Teach the Scrum Framework and Agile Thinking, Self-published by Alexey Krivitsky.
38. Velić, M., Padavić, I., and Dobrović, Ž. (2012, January 19–21). Metamodel of Agile Project Management and the Process of Building with LEGO® Bricks. Proceedings of the 23rd Central European Conference on Information and Intelligent Systems (CECIIS 2012), Varazdin, Croatia.
39. Gama, K. (2019, January 23–27). An experience report on using LEGO-based activities in a software engineering course. Proceedings of the XXXIII Brazilian Symposium on Software Engineering, Salvador, Brazil.10.1145/3350768.3353817 ↗
40. Paasivaara, M., Heikkilä, V., Lassenius, C., and Toivola, T. (June, January 31). Teaching students Scrum using LEGO blocks. Proceedings of the 36th International Conference on Software Engineering, Hyderabad, India.
41. Gama, K., and Oliveira, H. (2022, January 5–7). An experience report on teaching Scrum principles in a playful way through distant collaboration with online whiteboards. Proceedings of the XXXVI Brazilian Symposium on Software Engineering (SBES ’22), Virtual.10.1145/3555228.3555256 ↗
42. Steghofer, J.-P., and Burden, H. (2022, January 25–27). One block on top of the other: Using Minetest to teach Scrum. Proceedings of the 2022 IEEE/ACM 44th International Conference on Software Engineering: Software Engineering Education and Training, Pittsburgh, PA, USA.10.1109/ICSE-SEET55299.2022.9794186 ↗
43. Lee, W.L. (2016, January 8–11). SCRUM-X: An interactive and experiential learning platform for teaching Scrum. Proceedings of the 7th International Conference on Education, Training and Informatics (ICETI 2016), Orlando, FL, USA.
44. Christensen, E.L., and Paasivaara, M. (2022, January 25–27). Respond to change or die: An educational Scrum simulation for distributed teams. Proceedings of the ACM/IEEE 44th International Conference on Software Engineering: Software Engineering Education and Training, Pittsburgh, PA, USA.10.1145/3510456.3514145 ↗
45. Virtual Scrum: A teaching aid to introduce undergraduate software engineering students to Scrum10.1002/cae.21588 ↗
46. Fernandes, J.M., and Sousa, S.M. (2010, January 25–26). PlayScrum—A card game to learn the Scrum agile method. Proceedings of the 2010 Second International Conference on Games and Virtual Worlds for Serious Applications, Braga, Portugal.10.1109/VS-GAMES.2010.24 ↗
47. Marshburn, D.G., and Sieck, J.P. (2019, January 8–11). Don’t break the build: Developing a Scrum retrospective game. Proceedings of the 52nd Hawaii International Conference on System Sciences, Maui, HI, USA.10.24251/HICSS.2019.838 ↗
48. SCRUMIA—An educational game for teaching Scrum in computing courses10.1016/j.jss.2013.05.030 ↗
49. Villavicencio, M., Narvaez, E., Izquierdo, E., and Pincay, J. (2017, January 25–28). Learning Scrum by doing real-life projects. Proceedings of the 2017 IEEE Global Engineering Education Conference (EDUCON 2017), Athens, Greece.10.1109/EDUCON.2017.7943039 ↗
50. Play Ball: Bringing Scrum into the classroom
51. Schwaber, K., and Sutherland, J. (2023, November 17). Scrum Guide 2020. Available online: https://scrumguides.org/docs/scrumguide/v2020/2020-Scrum-Guide-US.pdf.
52. (2023, November 17). Agile Alliance Agile Alliance Web Portal. Available online: https://www.agilealliance.org.
53. Bishop, I., and Rizwan Abid, M. (2018, January 9–11). Survey of locomotion systems in virtual reality. Proceedings of the 2nd International Conference on Information System and Data Mining, Lakeland, FL, USA.10.1145/3206098.3206108 ↗
54. Marcus, A., and Rosenzweig, E. (2020). Design, User Experience, and Usability. Design for Contemporary Interactive Environments, Proceedings of the 22nd HCI International Conference, HCII 2020, Copenhagen, Denmark, 19–24 July 2020, Springer. Lecture Notes in Computer Science.10.1007/978-3-030-49760-6 ↗
55. Rangaswamy, S. (2000, January 8–12). Visual storytelling through lighting. Proceedings of the Game Developers Conference, San Jose, CA, USA.
56. Cohen, J. (1988). Statistical Power Analysis for the Behavioral Sciences, Routledge. [2nd ed.].
57. Quality criteria for serious games: Serious part, game part, and balance10.2196/19037 ↗
58. Gameful experience in gamification: Construction and validation of a gameful experience scale [GAMEX]10.1016/j.intmar.2018.03.002 ↗
59. The development of the Game Engagement Questionnaire: A measure of engagement in video game-playing10.1016/j.jesp.2009.02.016 ↗
60. IJsselsteijn, W.A., de Kort, Y.A.W., and Poels, K. (2013). The Game Experience Questionnaire, Technische Universiteit Eindhoven.
61. (2023, November 17). igroup.org—Project Consortium Igroup Presence Questionnaire (IPQ) Overview. Available online: https://www.igroup.org/pq/ipq.