An Adaptive Multi-Agent Architecture with Reinforcement Learning and Generative AI for Intelligent Tutoring Systems: A Moodle-Based Case Study
Source abstract
Abstract
Intelligent Tutoring Systems are increasingly used in higher education to support personalized learning and academic monitoring in large-scale digital environments. However, existing systems are predominantly based on static architecture and rigid rule-based mechanisms, which limit scalability and hinder effective adaptation to heterogeneous learners, evolving learning behaviors, and real-world educational contexts. This paper presents a self-adaptive multi-agent architecture based on Reinforcement Learning for autonomous decision-making in intelligent systems deployed in real environments. The proposal integrates an RL Meta-Agent that dynamically optimizes the selection of specialized agents through an intelligent switching mechanism, considering the user’s state, behavior, and interaction patterns. The architecture was implemented in Moodle using flows orchestrated in n8n, LLMs, databases, APIs developed in Django, and real academic data. For the empirical evaluation, a real and a simulated case study were designed. A questionnaire was administered to university students, considering dimensions of usability, satisfaction and usefulness, and accessibility and interaction, to understand the perception of the system and improvements. The quantitative data were analyzed using descriptive statistics and nonparametric tests (Mann–Whitney U and Kruskal–Wallis), while the qualitative data were examined using thematic categorization. A simulated case study was conducted to analyze the behavior of the system. The results show that the RL Meta-Agent significantly improves system efficiency, response relevance, and adaptive agent selection, demonstrating that self-adaptive RL-based MAS architectures are a viable solution for intelligent systems applied in real-world contexts, providing empirical evidence of their performance and adaptability in complex scenarios such as higher education.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Intelligent Tutoring Systems and Adaptive Learning · Online Learning and Analytics · E-Learning and Knowledge Management
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
BISITE Research Group, Edificio I+D+i, University of Salamanca, Calle Espejo 2, 37007 Salamanca, Castile and León, Spain
Faculty of Agricultural Industries and Environmental Sciences, Universidad Politécnica Estatal del Carchi, Calle Antisana, Tulcán 040101, Ecuador
Centre National de le Recherche Scientifique—Laboratoire d’Informatique de Grenoble (CNRS-LIG), University of Grenoble-Alps, 38000 Grenoble, France
References (31)
Show source-provided references
1. Cibu, B.-R., Crăciun, L., Molănescu, A.G., and Cotfas, L.-A. (2025). Exploring the Educational Applications of Large Language Models: A Systematic Review and Topic Analysis. Electronics, 14.10.3390/electronics14234683 ↗
2. Riedmann, A., D’Eramo, C., and Lugrin, B. (2025, January 19–23). Real-world testing for reinforcement learning in education. Proceedings of the International Conference on Autonomous Agents and Multiagent Systems (AAMAS), Detroit, MI, USA. Available online: https://www.ifaamas.org/Proceedings/aamas2025/pdfs/p1764.pdf.10.65109/ONWY1735 ↗
3. Zou, Y., Wang, H., and Li, J. (2025). Digital learning in the 21st century: Trends, challenges, and innovations. Front. Educ., 10.10.3389/feduc.2025.1562391 ↗
4. A multi-agent system model to integrate virtual learning environments and intelligent tutoring systems
5. LLM-Agent-UMF: LLM-based Agent Unified Modeling Framework for Seamless Design of Multi Active/Passive Core-Agent Architectures10.1016/j.inffus.2025.103865 ↗
6. A systematic review of AI-driven intelligent tutoring systems in K-12 education
7. Brohi, S., Mastoi, Q., Jhanjhi, N.Z., and Pillai, T.R. (2025). A Research Landscape of Agentic AI and Large Language Models: Applications, Challenges and Future Directions. Algorithms, 18.10.3390/a18080499 ↗
8. Reinforcement Learning in Education: A Systematic Literature Review10.1007/s40593-025-00494-6 ↗
9. Zha, S., Liu, Y., Zheng, C., Xu, J., Yu, F., Gong, J., and Xu, Y. (2024). Mentigo: An Intelligent Agent for Mentoring Students in the Creative Problem Solving Process. arXiv.10.1145/3706598.3713952 ↗
10. Zerkouk, M., Mihoubi, M., and Chikhaoui, B. (2024). A Comprehensive Review of AI-based Intelligent Tutoring Systems: Applications and Challenges. arXiv.
11. Developing an Intelligent Tutoring System Using Reinforcement Learning for Personalized Feedback10.71086/IAJSE/V12I3/IAJSE1221 ↗
12. Enhancement of online education system by using a multi-agent intelligent tutoring system10.1016/j.caeai.2022.100057 ↗
13. LLM-based chatbots in language learning: A systematic literature review
14. Silva, A.P., Fernandes, J., and Rocha, A. (2022, January 9–11). A Recommendation Module based on Reinforcement Learning to an Intelligent Tutoring System. Proceedings of the ICISSp 2022—8th International Conference on Information Systems Security and Privacy, Virtual Event.
15. Schulman, J., Wolski, F., Dhariwal, P., Radford, A., and Klimov, O. (2025, January 24–26). Adaptive Learning Control via Proximal Policy Optimization. Proceedings of the CEUR Workshop Proceedings, Odesa, Ukraine. Available online: https://ceur-ws.org/Vol-4048/paper37.pdf.
16. Piech, C., Huang, J., Phulsaria, A., Sivan, S., Joshi, M., Portela, A., and Tracing, D.K. (2015, January 7–12). Deep Knowledge Tracing. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), Montréal, QC, Canada. Available online: https://stanford.edu/~cpiech/bio/papers/deepKnowledgeTracing.pdf.
17. Application of reinforcement learning in personalized learning path recommendation in secondary education
18. Moncada-Ramirez, J., Matez-Bandera, J.-L., Gonzalez-Jimenez, J., and Ruiz-Sarmiento, J.-R. (2025). Agentic Workflows for Improving Large Language Model Reasoning in Robotic Object-Centered Planning. Robotics, 14.10.20944/preprints202501.0131.v1 ↗
19. Towards multi-agent system for learning object recommendation in e-learning platforms
20. A multi-agent architecture for learning paths-based personalized e-learning systems
21. AgentAI: A comprehensive survey on autonomous agents in distributed AI for industry 4.010.1016/j.eswa.2025.128404 ↗
22. Beale, R. (2025). Aligning conversational AI with proven theories of learning. arXiv.
23. Bandi, A., Kongari, B., Naguru, R., Pasnoor, S., and Vilipala, S.V. (2025). The Rise of Agentic AI: A Review of Definitions, Frameworks, Architectures, Applications, Evaluation Metrics, and Challenges. Future Internet, 17.10.3390/fi17090404 ↗
24. Córdova-Esparza, D.-M. (2025). AI-Powered Educational Agents: Opportunities, Innovations, and Ethical Challenges. Information, 16.10.3390/info16060469 ↗
25. Jiang, Y.-H., Lu, Y., Dai, L., Wang, J., Li, R., and Jiang, B. (2025, December 01). Agentic Workflow for Education: Concepts and Applications. Available online: https://arxiv.org/abs/2509.01517.
26. AI Agents vs. Agentic AI: A Conceptual taxonomy, applications and challenges10.1016/j.inffus.2025.103599 ↗
27. Personalized Adaptive Learning Technologies Based on Machine Learning Techniques to Identify Learning Styles: A Systematic Literature Review10.1109/ACCESS.2023.3276439 ↗
28. (2025, November 21). Moodle Learning Management System. Available online: https://moodle.org.
29. The Wisdom of Practice: Lessons Learned from the Study of Highly Effective Tutors
30. Shahriari, K., and Shahriari, M. (2017, January 21–22). IEEE standard review—Ethically aligned design: A vision for prioritizing human wellbeing with artificial intelligence and autonomous systems. Proceedings of the 2017 IEEE Canada International Humanitarian Technology Conference (IHTC), Toronto, ON, Canada.10.1109/IHTC.2017.8058187 ↗
31. IEEE (2017). Ethically Aligned Design: A Vision for Prioritizing Human Well-Being with Autonomous and Intelligent Systems, IEEE. [2nd ed.]. Available online: https://standards.ieee.org/industry-connections/ec/autonomous-systems.html.