journal article·2026-02-19Open access

Mapping Moodle Resources to Course Topics Using Text Similarity Methods and Expert Evaluation

Beata Gancevska, Simona Ramanauskaitė

Applied Sciences· Volume 16· Issue 4

Abstract

In this research, the alignment and mapping between Modular Object-Oriented Dynamic Learning Environment (Moodle) learning resources and course topics are described using text similarity methods. The goal of this work is to improve the accuracy of automated alignment between Moodle course learning resources and course topics by analyzing text similarity method performance and examining factors that affect how closely they match expert evaluation. During this research, an expert first mapped the e-course learning resources to course topics, after which multiple text similarity techniques were applied to match resource titles and descriptions to those topics. The findings show that the Large Language Model (LLM)-based solution achieves the lowest mean absolute error (MAE), the lowest mean squared error (MSE), and the strongest agreement with expert evaluation. Traditional keyword-based methods, such as Jaccard similarity and Term Frequency–Inverse Document Frequency (TF-IDF), demonstrate moderate performance, while the Sentence Bidirectional Encoder Representations from Transformers (SBERT)-based model shows the weakest alignment with expert evaluation.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Intelligent Tutoring Systems and Adaptive Learning · Innovative Teaching and Learning Methods · Educational Assessment and Pedagogy

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Information Technologies, Faculty of Fundamental Sciences, Vilnius Gediminas Technical University, 10223 Vilnius, Lithuania

References (29)

Show source-provided references
1. Moodle innovation learning technology for medical education: From theory to practice10.9734/jpri/2021/v33i59A34269 ↗
2. Analysis of development trends and experience of using LMS in modern education: An overview10.57125/ELIJ.2023.09.25.05 ↗
3. A systematic review on trends in using Moodle for teaching and learning10.1186/s40594-021-00323-x ↗
4. Quality criteria for online courses development
5. Trends in the design of e-learning and online learning
6. Wongvorachan, T., and Bulut, O. (2025). The use of natural language processing in learning analytics. Advanced Learning Analytics Methods, Springer.10.1007/978-3-031-95365-1_9 ↗
7. Lan, Y., Li, X., Du, H., Lu, X., Gao, M., Qian, W., and Zhou, A. (2025). Survey of natural language processing for education: Taxonomy, systematic review, and future trends. IEEE Trans. Knowl. Data Eng., in press.10.1109/TKDE.2025.3621181 ↗
8. Allam, H., Makubvure, L., Gyamfi, B., Kwadwo, G., and Akinwolere, K. (2024). Text classification: How machine learning is revolutionizing text categorization. Preprints.10.20944/preprints202412.1304.v1 ↗
9. Madatov, K., Sattarova, S., and Vičič, J. (2025). TF-IDF based classification of Uzbek educational texts. Preprints.10.20944/preprints202508.1137.v1 ↗
10. Impact of word embedding models on text analytics in deep learning environment: A review10.1007/s10462-023-10419-1 ↗
11. Curriculum mapping in higher education: A case study and proposed content scope and sequence mapping tool10.1080/0309877X.2014.1000278 ↗
12. Margienė, A., Ramanauskaitė, S., Nugaras, J., Stefanovič, P., and Čenys, A. (2022). Competency-Based E-Learning Systems: Automated Integration of User Competency Portfolio. Sustainability, 14.10.3390/su142416544 ↗
13. Ako-Nai, F., de la Cal Marin, E., and Tan, Q. (2023, January 27). A machine-learning based approach to validating learning materials. Proceedings of the Computational Intelligence in Security for Information Systems Conference, Cham, Switzerland.10.1007/978-3-031-42519-6_29 ↗
14. Ghosh, S., and Desarkar, M.S. (2018, January 23–27). Class specific TF-IDF boosting for short-text classification. Proceedings of the Web Conference 2018, Lyon, France.10.1145/3184558.3191621 ↗
15. Shyrokykh, K., Girnyk, M., and Dellmuth, L. (2023). Short text classification with machine learning in the social sciences. PLoS ONE, 18.10.1371/journal.pone.0290762 ↗
16. Chain-of-thought prompting elicits reasoning in large language models
17. Bubeck, S., Chandrasekaran, V., Eldan, R., Gehrke, J., Horvitz, E., Kamar, E., and Zhang, Y. (2023). Sparks of artificial general intelligence: Early experiments with GPT-4. arXiv.
18. Jurafsky, D., and Martin, J.H. (2025). Speech and Language Processing, Stanford University. [3rd ed.].
19. From frequency to meaning: Vector space models of semantics10.1613/jair.2934 ↗
20. A survey of text similarity approaches
21. Mu, W., and Lim, K.H. (2023, January 6–9). Modelling text similarity: A survey. Proceedings of the ASONAM, Istanbul, Türkiye.10.1145/3625007.3627305 ↗
22. Document similarity using TF-IDF representation and cosine similarity
23. Document plagiarism detection application using TF-IDF and cosine similarity10.32877/bt.v7i2.1697 ↗
24. Kowsari, K., Jafari Meimandi, K., Heidarysafa, M., Mendu, S., Barnes, L., and Brown, D. (2019). Text classification algorithms: A survey. Information, 10.10.3390/info10040150 ↗
25. A novel hybrid methodology for computing semantic similarity
26. Amur, Z.H., Kwang Hooi, Y., Bhanbhro, H., Dahri, K., and Soomro, G.M. (2023). Short-text semantic similarity: Techniques, challenges and future perspectives. Appl. Sci., 13.10.3390/app13063911 ↗
27. Reimers, N., and Gurevych, I. (2019, January 27). Sentence-BERT: Sentence embeddings using Siamese BERT-networks. Proceedings of the EMNLP-IJCNLP, Hong Kong, China.10.18653/v1/D19-1410 ↗
28. Language models are few-shot learners
29. Large language models are zero-shot reasoners