Question–Answer Models for Teaching Programming in Kazakh: A Morphology-Aware Controlled Study
Source abstract
Abstract
This study investigates whether morphology-aware input processing can improve question-answering performance for teaching programming in Kazakh, a low-resource language with rich morphological variation. Rather than proposing a new neural architecture, the study presents a controlled empirical evaluation of an adapted pipeline that combines FEMSeg_kaz preprocessing with morphology-aware post-processing (MAPP) normalization and domain-specific fine-tuning. A dataset of 50,386 Kazakh-language Python programming question–answer pairs was constructed with GPT-4o assistance and expert validation. Each pair consists of a student-style programming question in Kazakh and a corresponding instructional answer, usually including a short explanation and, when appropriate, a Python code example. Experiments with multilingual encoders and a controlled MiniLM setup show that morphology-aware normalization produces measurable improvements under fixed evaluation conditions, while its combination with domain-specific fine-tuning improves several answer selection and contextual-overlap indicators. The findings suggest that carefully controlled adaptation of established NLP techniques can support the development of Kazakh educational QA systems in morphologically rich, low-resource settings. Because no separate validation split or early stopping was used, these findings should be interpreted as controlled fixed-epoch comparison results rather than as fully optimized model selection results.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Topic Modeling · Natural Language Processing Techniques · Intelligent Tutoring Systems and Adaptive Learning
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Faculty of Information Technology and Artificial Intelligence, Al-Farabi Kazakh National University, Almaty 050040, Kazakhstan
Faculty of Computer Science and Management, Wroclaw University of Science and Technology, 50-370 Wrocław, Poland
Funding
Ministry of Science and Higher Education of the Republic of Kazakhstan
References (27)
Show source-provided references
1. A literature review on question answering techniques, paradigms and systems10.1016/j.jksuci.2018.08.005 ↗
2. Joshi, P., Santy, S., Budhiraja, A., Bali, K., and Choudhury, M. (2020). The State and Fate of Linguistic Diversity and Inclusion in the NLP World. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Online, 5–10 July 2020, Association for Computational Linguistics.10.18653/v1/2020.acl-main.560 ↗
3. Tukeyev, U., and Rysbek, B. (2026). Morphology-Aware Segmentation and Tokenization for Turkic Languages: A CSE-Guided Framework (The Kazakh Case). Information, 17.10.3390/info17020128 ↗
4. Devlin, J., Chang, M.-W., Lee, K., and Toutanova, K. (2019). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Minneapolis, MN, USA, 2–7 June 2019, Association for Computational Linguistics.
5. Reimers, N., and Gurevych, I. (2019). Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, Hong Kong, China, 3–7 November 2019, Association for Computational Linguistics.10.18653/v1/D19-1410 ↗
6. TyDi QA: A Benchmark for Information-Seeking Question Answering in Typologically Diverse Languages10.1162/tacl_a_00317 ↗
7. Lewis, P., Oguz, B., Rinott, R., Riedel, S., and Schwenk, H. (2020). MLQA: Evaluating Cross-lingual Extractive Question Answering. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Online, 5–10 July 2020, Association for Computational Linguistics.10.18653/v1/2020.acl-main.653 ↗
8. MKQA: A Linguistically Diverse Benchmark for Multilingual Open Domain Question Answering10.1162/tacl_a_00433 ↗
9. Gururangan, S., Marasović, A., Swayamdipta, S., Lo, K., Beltagy, I., Downey, D., and Smith, N.A. (2020). Don’t Stop Pretraining: Adapt Language Models to Domains and Tasks. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Online, 5–10 July 2020, Association for Computational Linguistics.10.18653/v1/2020.acl-main.740 ↗
10. Karpukhin, V., Oguz, B., Min, S., Lewis, P., Wu, L., Edunov, S., Chen, D., and Yih, W.-t. (2020). Dense Passage Retrieval for Open-Domain Question Answering. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, Online, 16–20 November 2020, Association for Computational Linguistics.10.18653/v1/2020.emnlp-main.550 ↗
11. MIRACL: A Multilingual Retrieval Dataset Covering 18 Diverse Languages10.1162/tacl_a_00595 ↗
12. Zhang, X., Ma, X., Shi, P., and Lin, J. (2021). Mr. TyDi: A Multi-lingual Benchmark for Dense Retrieval. Proceedings of the 1st Workshop on Multilingual Representation Learning, Punta Cana, Dominican Republic, 11 November 2021, Association for Computational Linguistics.10.18653/v1/2021.mrl-1.12 ↗
13. Zhang, T., Kishore, V., Wu, F., Weinberger, K.Q., and Artzi, Y. (2020, January 26–30). BERTScore: Evaluating Text Generation with BERT. Proceedings of the International Conference on Learning Representations, Addis Ababa, Ethiopia.
14. Evaluation of Question Answering Systems: Complexity of Judging a Natural Language10.1145/3744663 ↗
15. Human evaluation of automatically generated text: Current trends and best practice guidelines10.1016/j.csl.2020.101151 ↗
16. Qiu, W., Su, C.L., Jamil, N.B., Thway, M., Ng, S.S.H., Zhang, L., Lim, F.S., and Lai, J.W. (2025). A Systematic Approach to Evaluate the Use of Chatbots in Educational Contexts: Learning Gains, Engagements and Perceptions. Computers, 14.10.35542/osf.io/7yga3_v3 ↗
17. Nainia, A., Vignes-Lebbe, R., Mousannif, H., and Zahir, J. (2025). Beyond BLEU: Ethical Risks of Misleading Evaluation in Domain-Specific QA with LLMs. Proceedings of the First Workshop on Comparative Performance Evaluation: From Rules to Language Models, Varna, Bulgaria, 11 September 2025, INCOMA Ltd.
18. Yeshpanov, R., Efimov, P., Boytsov, L., Shalkarbayuli, A., and Braslavski, P. (2024). KazQAD: Kazakh Open-Domain Question Answering Dataset. Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation, Torino, Italy, 20–25 May 2024, ELRA and ICCL.10.63317/3j6y9kcsnpp9 ↗
19. Togmanov, M., Mukhituly, N., Turmakhan, D., Mansurov, J., Goloburda, M., Sakip, A., Xie, Z., Wang, Y., Syzdykov, B., and Laiyk, N. (2025). KazMMLU: Evaluating Language Models on Kazakh, Russian, and Regional Knowledge of Kazakhstan. Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics, Vienna, Austria, 27 July–1 August 2025, Association for Computational Linguistics.10.18653/v1/2025.acl-long.701 ↗
20. Mansurova, A., Tleubayeva, A., Nugumanova, A., Shomanov, A., and Seker, S.E. (2025). A Systematic Evaluation of Large Language Models and Retrieval-Augmented Generation for the Task of Kazakh Question Answering. Information, 16.10.3390/info16110943 ↗
21. Wiemerslage, A., Silfverberg, M., Yang, C., McCarthy, A.D., Nicolai, G., Colunga, E., and Kann, K. (2022). Morphological Processing of Low-Resource Languages: Where We Are and What’s Next. Proceedings of the Findings of the Association for Computational Linguistics: ACL 2022, Dublin, Ireland, 22–27 May 2022, Association for Computational Linguistics.10.18653/v1/2022.findings-acl.80 ↗
22. Mager, M., Oncevay, A., Mager, E., Kann, K., and Vu, N.T. (2022). BPE vs. Morphological Segmentation: A Case Study on Machine Translation of Four Polysynthetic Languages. Proceedings of the Findings of the Association for Computational Linguistics: ACL 2022, Dublin, Ireland, 22–27 May 2022, Association for Computational Linguistics.10.18653/v1/2022.findings-acl.78 ↗
23. Blevins, T., and Zettlemoyer, L. (2019). Better Character Language Modeling through Morphology. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Florence, Italy, 28 July–2 August 2019, Association for Computational Linguistics.10.18653/v1/P19-1156 ↗
24. Bostrom, K., and Durrett, G. (2020). Byte Pair Encoding is Suboptimal for Language Model Pretraining. Findings of the Association for Computational Linguistics: EMNLP 2020, Online, 16–20 November 2020, Association for Computational Linguistics.10.18653/v1/2020.findings-emnlp.414 ↗
25. Abudouwaili, G., Ruzmamat, S., Abiderexiti, K., Wu, B., and Wumaier, A. (2024). A Benchmark for Morphological Segmentation in Uyghur and Kazakh. Appl. Sci., 14.10.3390/app14135369 ↗
26. Dror, R., Baumer, G., Shlomov, S., and Reichart, R. (2018). The Hitchhiker’s Guide to Testing Statistical Significance in Natural Language Processing. Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, Melbourne, Australia, 15–20 July 2018, Association for Computational Linguistics.10.18653/v1/P18-1128 ↗
27. Card, D., Henderson, P., Khandelwal, U., Jia, R., Mahowald, K., and Jurafsky, D. (2020). With Little Power Comes Great Responsibility. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, Online, 16–20 November 2020, Association for Computational Linguistics.10.18653/v1/2020.emnlp-main.745 ↗