Integrating Game-Based Learning and Generative AI in Programming Education: A Study on Automated Question Generation and Learning Outcomes Enhancement
Source abstract
Abstract
This study examined the instructional effects of integrating a game-based learning system into a programming course, focusing on how tool-supported practice influences students’ learning outcomes and learning experiences. A quasi-experimental design was employed, involving an experimental group that used a game-based learning system for programming practice and a control group that completed traditional programming assignments. Both groups were taught by the same instructor using identical instructional content over an eight-week period. Pre-tests and post-tests were administered to assess learning performance. Baseline-adjusted and conditional effect analyses were conducted to examine whether the instructional effect varied according to students’ prior programming knowledge. The results showed that students in the experimental group achieved higher post-test performance than those in the control group, and the Group × Pre-test interaction indicated that the learning effect was conditional on learners’ baseline programming competence. In addition, students in the experimental group completed questionnaires on system use perceptions and flow experience. The findings indicated generally positive perceptions of the game-based learning system and a significantly positive level of flow during programming practice. The findings suggest that the GBPLS can support programming practice when it is embedded within a coherent instructional design. However, the observed benefits should be interpreted as conditional rather than universal. The educational value of the system appears to depend on the alignment among programming tasks, feedback, game-based engagement, generative AI-supported question generation, and teacher guidance.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Educational Games and Gamification · Teaching and Learning Programming · Visual and Cognitive Learning Processes
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Information and Computer Engineering, Chung Yuan Christian University, Taoyuan 320314, Taiwan
Undergraduate Program in College of Electrical Engineering and Computer Science, Chung Yuan Christian University, Taoyuan 320314, Taiwan
References (64)
Show source-provided references
1. Exploring children’s perceptions of developing twenty-first century skills through computational thinking and programming10.1080/10494820.2018.1534245 ↗
2. Farrugia-Roberts, M., Jeffries, B., and Søndergaard, H. (2022). Programming to Learn: Logic and Computation from a Programming Perspective. Proceedings of the 27th ACM Conference on on Innovation and Technology in Computer Science Education, Vol. 1, Association for Computing Machinery.10.1145/3502718.3524814 ↗
3. Effectiveness of feedback based on log file analysis in introductory programming courses10.1177/07356331221132651 ↗
4. Inventado, P.S. (2019). Promoting Mastery Learning in an Introductory Programming Course. Proceedings of the 50th ACM Technical Symposium on Computer Science Education, Association for Computing Machinery.10.1145/3287324.3293780 ↗
5. An online integrated programming platform to acquire students’ behavior data for immediate feedback teaching10.1002/cae.22596 ↗
6. IMPACT OF Workload on Teachers’efficiency and Their Students’academic Achievement at the University Level10.51380/gujr-39-02-02 ↗
7. Figueiredo, J., and García-Peñalvo, F.J. (2019). Teaching and learning strategies of programming for university courses. Proceedings of the Seventh International Conference on Technological Ecosystems for Enhancing Multiculturality, Association for Computing Machinery.10.1145/3362789.3362926 ↗
8. Tsai, D.C., Huang, A.Y., Lu, O.H., and Yang, S.J. (2021). Automatic question generation for repeated testing to improve student learning outcome. Proceedings of the 2021 International Conference on Advanced Learning Technologies (ICALT), IEEE.10.1109/ICALT52272.2021.00108 ↗
9. Integrating automatic question generation with computerised adaptive test10.1186/s41039-020-00132-w ↗
10. Towards understanding the effective design of automated formative feedback for programming assignments10.1080/08993408.2020.1860408 ↗
11. Thomas, S. (2019, January 15–19). Using paper-based, near-immediate feedback to support active learning in an introductory programming course. Proceedings of the 2019 ASEE Annual Conference & Exposition, Tampa, FL, USA.
12. Phung, T., Pădurean, V.-A., Singh, A., Brooks, C., Cambronero, J., Gulwani, S., Singla, A., and Soares, G. (2024). Automating human tutor-style programming feedback: Leveraging gpt-4 tutor model for hint generation and gpt-3.5 student model for hint validation. Proceedings of the 14th Learning Analytics and Knowledge Conference, Association for Computing Machinery.10.1145/3636555.3636846 ↗
13. Kulshreshtha, D., Shayan, M., Belfer, R., Reddy, S., Serban, I.V., and Kochmar, E. (2022). Few-shot question generation for personalized feedback in intelligent tutoring systems. PAIS 2022, IOS Press.10.3233/FAIA220062 ↗
14. Lehtinen, T., Haaranen, L., and Leinonen, J. (2023). Automated questionnaires about students’ JavaScript programs: Towards gauging novice programming processes. Proceedings of the 25th Australasian Computing Education Conference, Association for Computing Machinery.10.1145/3576123.3576129 ↗
15. Kuo, J.-Y., Lin, H.-C., Wang, P.-F., and Nie, Z.-G. (2022). A feedback system supporting students approaching a high-level programming course. Appl. Sci., 12.10.3390/app12147064 ↗
16. Does burnout affect academic achievement? A meta-analysis of over 100,000 students10.1007/s10648-020-09533-1 ↗
17. Influence of problem-based learning games on effective computer programming learning in higher education10.1007/s11423-020-09784-3 ↗
18. Game-based learning: Enhancing student experience, knowledge gain, and usability in higher education programming courses10.1109/TE.2021.3136914 ↗
19. Edwards, S.H., Murali, K.P., and Kazerouni, A.M. (2019). The relationship between voluntary practice of short programming exercises and exam performance. Proceedings of the ACM Conference on Global Computing Education, Association for Computing Machinery.10.1145/3300115.3309525 ↗
20. Learning analytics: Game-based learning for programming course in higher education10.1016/j.procs.2020.05.143 ↗
21. Game-based learning for students’ computational thinking: A meta-analysis10.1177/07356331231178948 ↗
22. Xu, X., Liu, R., Chen, Q., and Yang, H. (2023). A Digital Game-based Learning Approach to Improve Students’ Learning Performance of Senior High School Programming Courses. Proceedings of the 2023 4th International Conference on Education Development and Studies, Association for Computing Machinery.10.1145/3591139.3591155 ↗
23. Khan, I.A., Iftikhar, M., Hussain, S.S., Rehman, A., Gul, N., Jadoon, W., and Nazir, B. (2020). Redesign and validation of a computer programming course using Inductive Teaching Method. PLoS ONE, 15.10.1371/journal.pone.0233716 ↗
24. Sacco, O. (2020, January 23–25). Analysing the Effectiveness of Online Gamified Learning Methods as Opposed to Traditional Learning Methods for Teaching Computer Programming. Proceedings of the 14th International Conference on Interfaces and Human Computer Interaction (IHCI 2020) and 13th International Conference on Game and Entertainment Technologies (GET 2020), Virtual.
25. Alammary, A. (2019). Blended learning models for introductory programming courses: A systematic review. PLoS ONE, 14.10.1371/journal.pone.0221765 ↗
26. Leinonen, A., Nygren, H., Pirttinen, N., Hellas, A., and Leinonen, J. (2019). Exploring the applicability of simple syntax writing practice for learning programming. Proceedings of the 50th ACM Technical Symposium on Computer Science Education, Association for Computing Machinery.10.1145/3287324.3287378 ↗
27. The effects of self-regulated learning support on learners’ task performance and cognitive load in computer programing10.1177/07356331211052632 ↗
28. Digital game-based learning in K-12 mathematics education: A systematic literature review10.1007/s10639-021-10721-x ↗
29. Association questions on knowledge retention10.1007/s11092-020-09337-5 ↗
30. Yassine, A., Berrada, M., Tahiri, A., and Chenouni, D. (2020). A Serious Game for Teaching Python Programming Language. Embedded Systems and Artificial Intelligence: Proceedings of ESAI 2019, Fez, Morocco, Springer.10.1007/978-981-15-0947-6_37 ↗
31. Learning programming by creating games through the use of structured activities in secondary education in Greece10.1007/s10639-020-10255-8 ↗
32. Vicente, A., and Cunha, J. (2022). Applying the DevOps methodology for a more efficient process of teaching-learning computer programming. Proceedings of the 2022 31st Annual Conference of the European Association for Education in Electrical and Information Engineering (EAEEIE), IEEE.10.1109/EAEEIE54893.2022.9820399 ↗
33. Research on construction and practice of precision teaching classroom for university programming courses10.1109/ACCESS.2023.3240105 ↗
34. An efficient approach to measure the difficulty degree of practical programming exercises based on student performances
35. Understanding searchers’ perception of task difficulty: Relationships with task type
36. A genetic fuzzy expert system for automatic question classification in a competitive learning environment10.1016/j.eswa.2012.01.115 ↗
37. Adaptive item-based learning environments based on the item response theory: Possibilities and challenges10.1111/j.1365-2729.2010.00368.x ↗
38. How problem difficulty and order influence programming education outcomes in online judge systems10.1016/j.heliyon.2023.e20947 ↗
39. An analysis of children’interaction with an AI chatbot and its impact on their interest in reading10.1016/j.compedu.2022.104576 ↗
40. Pesovski, I., Santos, R., Henriques, R., and Trajkovik, V. (2024). Generative AI for Customizable Learning Experiences. Sustainability, 16.10.3390/su16073034 ↗
41. When Generative AI Meets Socratic Method: Investigating Programming Learning Dynamics Through Behaviours, Interaction Qualities and Perceptions10.1002/jcal.70210 ↗
42. Empirical validation of a generative AI framework for personalized education assessment10.1038/s41598-026-42169-9 ↗
43. Pedagogical applications of generative AI in higher education: A systematic review of the field10.1007/s11528-025-01100-1 ↗
44. Bahroun, Z., Anane, C., Ahmed, V., and Zacca, A. (2023). Transforming Education: A Comprehensive Review of Generative Artificial Intelligence in Educational Settings through Bibliometric and Content Analysis. Sustainability, 15.10.3390/su151712983 ↗
45. Few-shot is enough: Exploring ChatGPT prompt engineering method for automatic question generation in english education10.1007/s10639-023-12249-8 ↗
46. Generative AI Prompt Engineering for Educators: Practical Strategies10.1177/01626434241298954 ↗
47. The promise and challenges of generative AI in education10.1080/0144929X.2024.2394886 ↗
48. Practical and ethical challenges of large language models in education: A systematic scoping review10.1111/bjet.13370 ↗
49. ChatGPT for good? On opportunities and challenges of large language models for education10.1016/j.lindif.2023.102274 ↗
50. Zhu, X., Yue, Y., and Chen, S. (2023). Impact of Major Backgrounds on Student Learning Achievement: A Case Study for Java Programming Course. Educ. Sci., 13.10.3390/educsci13020127 ↗
51. Development and Validation of a Scale to Measure Optimal Experience: The Flow State Scale10.1123/jsep.18.1.17 ↗
52. Silva, P., Costa, E., and de Araújo, J.R. (2019). An adaptive approach to provide feedback for students in programming problem solving. Intelligent Tutoring Systems: 15th International Conference, ITS 2019, Kingston, Jamaica, June 3–7, 2019, Proceedings, Springer.
53. Lai, C.-H., Chen, Y.-J., and Chen, Z.-P. (2025). Fine-Tuning Generative AI with Domain Question Banks: Evaluating Multi-Type Question Generation and Grading. Appl. Sci., 15.10.3390/app152413050 ↗
54. Neisser, U. (2014). Cognitive Psychology: Classic Edition, Psychology Press.10.4324/9781315736174 ↗
55. Analysing controlled trials with baseline and follow up measurements10.1136/bmj.323.7321.1123 ↗
56. ANCOVA versus change from baseline had more power in randomized studies and more bias in nonrandomized studies10.1016/j.jclinepi.2006.02.007 ↗
57. Probing Interactions in Fixed and Multilevel Regression: Inferential and Graphical Techniques10.1207/s15327906mbr4003_5 ↗
58. A self-determination theory approach to predicting school achievement over time: The unique role of intrinsic motivation10.1016/j.cedpsych.2014.08.002 ↗
59. Intrinsic and extrinsic motivation from a self-determination theory perspective: Definitions, theory, practices, and future directions10.1016/j.cedpsych.2020.101860 ↗
60. Learner-controlled practice difficulty in the training of a complex task: Cognitive and motivational mechanisms10.1037/a0029821 ↗
61. Zhang, W., Qu, K., Kang, Z., and Hu, S. (2023). A Multi-Task Knowledge-Tracking Model with a Novel Representative Approach to Problem Difficulty and Student Ability. Appl. Sci., 13.10.3390/app13074226 ↗
62. Teacher competencies in game-based pedagogy10.1016/j.tate.2018.04.012 ↗
63. Teaching and Learning Computational Thinking Through Game-Based Learning: A Systematic Review10.1177/07356331231180951 ↗
64. Comparing traditional teaching and game-based learning using teacher-authored games on computer science education10.1109/TE.2021.3057849 ↗