journal article·2025-10-08Open access

TF-IDF-Based Classification of Uzbek Educational Texts

Khabibulla Madatov, Sapura Sattarova, Jernej Vičič

Applied Sciences· Volume 15· Issue 19

Abstract

This paper presents a baseline study on automatic Uzbek text classification. Uzbek is a morphologically rich and low-resource language, which makes reliable preprocessing and evaluation challenging. The approach integrates Term Frequency–Inverse Document Frequency (TF–IDF) representation with three conventional methods: linear regression (LR), k-Nearest Neighbors (k-NN), and cosine similarity (CS, implemented as a 1-NN retrieval model). The objective is to categorize school learning materials by grade level (grades 5–11) to support improved alignment between curricular texts and students’ intellectual development. A balanced dataset of Uzbek school textbooks across different subjects was constructed, preprocessed with standard NLP tools, and converted into TF–IDF vectors. Experimental results on the internal test set of 70 files show that LR achieved 92.9% accuracy (precision = 0.94, recall = 0.93, F1 = 0.93), while CS performed comparably with 91.4% accuracy (precision = 0.92, recall = 0.91, F1 = 0.92). In contrast, k-NN obtained only 28.6% accuracy, confirming its weakness in high-dimensional sparse feature spaces. External evaluation on seven Uzbek literary works further demonstrated that LR and CS yielded consistent and interpretable grade-level mappings, whereas k-NN results were unstable. Overall, the findings establish reliable baselines for Uzbek educational text classification and highlight the potential of extending beyond lexical overlap toward semantically richer models in future work.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Text and Document Classification Technologies · Educational Technology and Assessment · Advanced Text Analysis Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

The Department of Computer Science, Urgench State University Named after Abu Rayhan Biruni, 14 Kh. Alimdjan Str., Urgench City 220100, Uzbekistan

Faculty of Mathematics, Natural Science and Information Technologies, University of Primorska, 6000 Koper, Slovenia

References (21)

Show source-provided references
1. Devlin, J., Chang, M.-W., Lee, K., and Toutanova, K. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers).
2. McCallum, A., and Nigam, K. (1998, January 26–27). A Comparison of Event Models for Naive Bayes Text Classification. Proceedings of the AAAI-98 Workshop on Learning for Text Categorization, Madison, WI, USA. No. 1.
3. Joachims, T. (1998, January 21–23). Text Categorization with Support Vector Machines: Learning with Many Relevant Features. Proceedings of the European Conference on Machine Learning, Chemnitz, Germany.10.1007/BFb0026683 ↗
4. Kim, Y. (2014). Convolutional Neural Networks for Sentence Classification. arXiv.10.3115/v1/D14-1181 ↗
5. BERT (Bidirectional Encoder Representations from Transformers) for Missing Data Imputation in Solar Irradiance Time Series
6. Pires, T., Schlinger, E., and Garrette, D. (2019). How Multilingual Is Multilingual BERT?. arXiv.10.18653/v1/P19-1493 ↗
7. Conneau, A., Khandelwal, K., Goyal, N., Chaudhary, V., Wenzek, G., Guzmán, F., Grave, E., Ott, M., Zettlemoyer, L., and Stoyanov, V. (2019). Unsupervised Cross-Lingual Representation Learning at Scale. arXiv.10.18653/v1/2020.acl-main.747 ↗
8. Oralbekova, D., Mamyrbayev, O., Zhumagulova, S., and Zhumazhan, N. (2024). A Comparative Analysis of LSTM and BERT Models for Named Entity Recognition in Kazakh Language: A Multi-Classification Approach. Modelling and Simulation of Social-Behavioural Phenomena in Creative Societies, Springer.10.1007/978-3-031-72260-8_10 ↗
9. Yeshpanov, R., and Varol, H. (2024). KazSAnDRA: Kazakh Sentiment Analysis Dataset of Reviews and Attitudes. arXiv.
10. Tleubayeva, A., Aubakirov, S., Tabuldin, A., and Shomanov, A. (2025, January 14–16). Development and Evaluation of a Small Kazakh Language Corpus to Improve the Efficiency of Multilingual NLP Systems in Low-Resource Environments. Proceedings of the 2025 IEEE 5th International Conference on Smart Information Systems and Technologies (SIST), Astana, Kazakhstan.10.1109/SIST61657.2025.11139363 ↗
11. Jiang, Z., Yang, M., Tsirlin, M., Tang, R., Dai, Y., and Lin, J. (2023). “Low-Resource” Text Classification: A Parameter-Free Classification Method with Compressors. Findings of the Association for Computational Linguistics: ACL 2023, Association for Computational Linguistics.10.18653/v1/2023.findings-acl.426 ↗
12. Improving Turkish Text Sentiment Classification through Task-Specific and Universal Transformations: An Ensemble Data Augmentation Approach10.1109/ACCESS.2024.3349971 ↗
13. Madatov, K.A., and Bekchanov, S.K. (July, January 28). The Algorithm of Uzbek Text Summarizer. Proceedings of the 2024 IEEE 25th International Conference of Young Professionals in Electron Devices and Materials (EDM), Altai, Russia.10.1109/EDM61683.2024.10615191 ↗
14. Dataset of Vocabulary in Uzbek Primary Education: Extraction and Analysis in Case of the School Corpus10.1016/j.dib.2025.111349 ↗
15. Madatov, K.A., and Sattarova, S. (July, January 28). Creation of a Corpus for Determining the Intellectual Potential of Primary School Students. Proceedings of the International Conference of Young Specialists on Micro/Nanotechnologies and Electron Devices (EDM), Altai, Russia.
16. Multi-Class Text Classification of Uzbek News Articles Using Machine Learning10.1088/1742-6596/1546/1/012097 ↗
17. Kuriyozov, E., Matlatipov, S., Alonso, M.A., and Gómez-Rodríguez, C. (2019). Construction and Evaluation of Sentiment Datasets for Low-Resource Languages: The Case of Uzbek. Language and Technology Conference, Springer.
18. Tan, P.-N., Steinbach, M., and Kumar, V. (2016). Introduction to Data Mining, Pearson Education.
19. James, G., Witten, D., Hastie, T., and Tibshirani, R. (2013). An Introduction to Statistical Learning: With Applications in R, Springer.10.1007/978-1-4614-7138-7 ↗
20. (2025, September 15). ZiyoUz Library—Digital Collection of Literary Works. Available online: https://n.ziyouz.com/kutubxona/category/1-ziyouz.
21. Sattarova, S. (2025). TF–IDF Matrix for Grades 5–11 Uzbek Textbooks [Data Set], Zenodo.