journal article·2026-06-04Open access

From Ancient Manuscripts to Modern Social Media: Evolution of Tonality Analysis Methods for Low-Resource Languages

Zharasbek Baishemirov, Azim Kassymbayev, Didar Yedilkhan, Beibut Amirgaliyev, Beibit Abdikenov

Applied Sciences· Volume 16· Issue 11

Abstract

Recently, computational sentiment analysis has become an essential tool for detecting evaluative language in large text collections. However, its application to many low-resource language families and historical corpora remains largely unexplored. This paper reviews the evolution of sentiment analysis methods in the Turkic language family, with a particular focus on Chagatai, the classical predecessor of several modern Turkic languages. We outline the methods that have evolved since the advent of lexicon-based and rule-based approaches up to the present day with large language models, addressing longstanding problems in agglutinative morphology, data scarcity, orthographic instability, and multilingual lexical mixing. To examine the available options, we conducted a pilot experiment using multilingual models in a zero-shot setting on a curated Chagatai corpus. In the absence of ground-truth annotations, prediction stability was validated with ensemble consistency and inter-model agreement. The results show real promise but also distinct limitations when adapting traditional NLP technologies for historically remote, low-resource languages. Progress in the field will require cross-disciplinary work, systematic diachronic dataset deployment, and a nuanced adaptation of multilingual representation learning to handle linguistically rich, low-resource settings.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Language and cultural evolution · Sentiment Analysis and Opinion Mining · Authorship Attribution and Profiling

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Smart City Research Center, Astana IT University, Mangilik El Avenue 55/11, EXPO Block C1, Astana 010000, Kazakhstan

School of Applied Mathematics, Kazakh-British Technical University, Tole Bi Street 59, Almaty 050000, Kazakhstan

School of Digital Technologies, Narxoz University, Zhandosov Street 55, Almaty 050035, Kazakhstan

School of Artificial Intelligence and Data Science, Astana IT University, Mangilik El Avenue 55/11, EXPO Block C1, Astana 010000, Kazakhstan

Science and Innovation Center “Artificial Intelligence”, Astana IT University, Mangilik El Avenue 55/11, EXPO Block C1, Astana 010000, Kazakhstan

Funding

Ministry of Science and Higher Education of the Republic of Kazakhstan

References (56)

Show source-provided references
1. A survey on sentiment analysis methods, applications, and challenges10.1007/s10462-022-10144-1 ↗
2. Social media sentiment analysis as a tool for predicting market trends
3. Social media sentiment and stock market trends
4. Sentiment analysis: An overview10.1146/annurev-linguistics-011415-040518 ↗
5. Devlin, J., Chang, M.-W., Lee, K., and Toutanova, K. (2018). Bert: Pre-training of deep bidirectional transformers. arXiv.
6. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., and Polosukhin, I. (2017). Attention Is All You Need. Advances in Neural Information Processing Systems, Curran Associates, Inc.
7. Mirzakhalov, J., Babu, A., Ataman, D., Kariev, S., Tyers, F., Abduraufov, O., Hajili, M., Ivanova, S., Khaytbaev, A., and Laverghetta, A. (2021). A large-scale study of machine translation in Turkic languages. Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics.10.18653/v1/2021.emnlp-main.475 ↗
8. Veitsman, Y. (2024). Recent advancements of Turkic Central Asian language processing. arXiv.
9. A comprehensive survey on sentiment analysis10.1016/j.knosys.2021.107134 ↗
10. A review of AI for sentiment analysis in social media
11. Review of sentiment analysis in social media using big data10.14419/mhv83077 ↗
12. A comprehensive review of sentiment analysis techniques
13. Ehrmann, M., Romanello, M., Clematide, S., Ströbel, P.B., and Barman, R. (2020). Language Resources for Historical Newspapers: The Impresso Collection. Proceedings of the 12th Language Resources and Evaluation Conference (LREC 2020), European Language Resources Association.
14. Dewangan, L., Sayeed, Z.A., and Maurya, C. (2025). Benchmark creation for aspect-based sentiment analysis in low-resource Odia language and evaluation through fine-tuning of multilingual models. Proceedings of the 31st International Conference on Computational Linguistics, Association for Computational Linguistics.
15. Wang, M., Adel, H., Lange, L., Strötgen, J., and Schütze, H. (2023). NLNDE at SemEval-2023 Task 12: Adaptive pretraining and source language selection for low-resource multilingual sentiment analysis. Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023), Association for Computational Linguistics.10.18653/v1/2023.semeval-1.68 ↗
16. Building lexicon-based sentiment analysis model for low-resource languages10.1016/j.mex.2023.102460 ↗
17. Natural Language Processing Relies on Linguistics10.1162/coli_a_00560 ↗
18. Towards Comparable Historical NER: Building a Shared Evaluation Corpus for 18th-Century Historical Texts
19. Improving Sentiment Analysis Performance on Morphologically Rich Languages: Language and Domain Independent Approach10.1016/j.csl.2019.01.001 ↗
20. Moeljadi, D. (2016). A Grammar of Chaghatay, Brill.
21. Koto, F., Beck, T., Talat, Z., Gurevych, I., and Baldwin, T. (2024). Zero-shot sentiment analysis in low-resource languages using a multilingual sentiment lexicon. Proceedings of the International Conference on Computational Linguistics (COLING), Association for Computational Linguistics.10.18653/v1/2024.eacl-long.18 ↗
22. Sabharwal, N., and Agrawal, A. (2021). Introduction to NLP. Hands-on Question Answering Systems with BERT, Springer.10.1007/978-1-4842-6664-9 ↗
23. Quantitative approaches to diachronic corpus linguistics
24. OpenITI (2026, April 22). OpenITI: A Machine-Readable Corpus of Islamicate Texts. Available online: https://github.com/OpenITI.
25. Bibliothèque Universitaire des Langues et Civilisations (2026, April 22). BULAC Catalogues and Digital Collections. Available online: https://www.bulac.fr.
26. Schreibman, S., Siemens, R., and Unsworth, J. (2016). A New Companion to Digital Humanities, Wiley-Blackwell.10.1002/9781118680605 ↗
27. Sentiment analysis of Kazakh text and polarity10.3233/WEB-190396 ↗
28. Yeshpanov, R., and Varol, H.A. (2024). KazSAnDRA dataset. Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), ELRA and ICCL.
29. Du, H., Shi, J., Myerston, J., Lu, S., Zhou, G., and Gao, Y. (2025). Role-Guided Annotation and Prototype-Aligned Representation Learning for Historical Literature Sentiment Classification. Findings of the Association for Computational Linguistics: EMNLP 2025, Association for Computational Linguistics.10.18653/v1/2025.findings-emnlp.201 ↗
30. Gimadim, D. (2021). Web-sentiment analysis of public comments for Kazakh-language reviews. Proceedings of the Student Research Workshop Associated with RANLP 2021, INCOMA Ltd.10.26615/issn.2603-2821.2021_010 ↗
31. Zümberoğlu, K.B., Dik, S.Z., Karadeniz, B.S., and Sahmoud, S. (2025). Towards better sentiment analysis in Turkish. Appl. Sci., 15.10.3390/app15042062 ↗
32. Demirci, G.M., Keskin, Ş.R., and Doğan, G. (2019). Sentiment analysis in Turkish with deep learning. 2019 IEEE International Conference on Big Data (Big Data), IEEE.10.1109/BigData47090.2019.9006066 ↗
33. Allanazarova, S. (2024). Sentiment analysis of social network comments in Uzbek language. 2024 9th International Conference on Computer Science and Engineering (UBMK), IEEE.10.1109/UBMK63289.2024.10773536 ↗
34. Sentiment analysis of comments in Uzbek language
35. Using machine learning algorithms for Kyrgyz sentiment analysis10.30574/wjarr.2024.23.3.2681 ↗
36. Keremu, F., and Li, L. (2024). Sentiment classification model for Uyghur language texts. 2024 9th International Symposium on Computer and Information Processing Technology (ISCIPT), IEEE.10.1109/ISCIPT61983.2024.10672845 ↗
37. Pei, Y., Chen, S., Ke, Z., Silamu, W., and Guo, Q. (2022). AB-LaBSE: Uyghur sentiment analysis. Appl. Sci., 12.10.3390/app12031182 ↗
38. Choudhary, N., Singh, R., Bindlish, I., and Shrivastava, M. (2018). Emotions are universal: Learning sentiment-based representations of resource-poor languages using Siamese networks. Computational Linguistics and Intelligent Text Processing. CICLing 2018, Springer.
39. Implementation of naïve Bayes classifier-based machine learning10.1088/1742-6596/1842/1/012008 ↗
40. Akhmedov, S., and Nugumanova, A. (2024). Development of a sentiment analysis model in the Kazakh language to analyze reviews. Preprints, 2024051300.10.20944/preprints202405.1300.v1 ↗
41. Detection of offensive content in the Kazakh language10.7717/peerj-cs.3027 ↗
42. Multilingual thematic modeling: A comparative study of classical and transformational approaches
43. Sentiment analysis through recurrent variants lately on a convolutional neural network of Twitter10.1016/j.future.2018.12.018 ↗
44. Deep learning for sentiment analysis10.1002/widm.1253 ↗
45. Analysis Methods in Neural Language Processing: A Survey10.1162/tacl_a_00254 ↗
46. Das, S., Tariq, A., Santos, T., Kantareddy, S.S., and Banerjee, I. (2023). Recurrent Neural Networks (RNNs): Architectures, Training Tricks, and Introduction to Influential Research. Machine Learning for Brain Disorders, Human.10.1007/978-1-0716-3195-9_4 ↗
47. Leveraging multilingual transformers for sentiment analysis in low-resource languages
48. Ghatora, P.S., Hosseini, S.E., Pervez, S., Iqbal, M.J., and Shaukat, N. (2024). Sentiment analysis of product reviews using machine learning and pre-trained LLM. Big Data Cogn. Comput., 8.10.3390/bdcc8120199 ↗
49. Multi-Class Sentiment Analysis of Social Media Data with Machine Learning Algorithms
50. Wadawadagi, R., and Pagi, V. (2022). Sentiment analysis on social media. Research Anthology on Implementing Sentiment Analysis Across Multiple Disciplines, IGI Global Scientific Publishing.10.4018/978-1-6684-6303-1.ch041 ↗
51. Karim, S.M., Rasul, R.A., and Sultana, T. (2025). Sentiment analysis of social media data. arXiv.
52. Ruder, S., Peters, M.E., Swayamdipta, S., and Wolf, T. (2019). Transfer Learning in Natural Language Processing. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Tutorials, Association for Computational Linguistics.10.18653/v1/N19-5004 ↗
53. Advances in sentiment analysis
54. Qahtani, N.A., and Vedantham, A.K. (2026, April 22). Sentiment Analysis of Financial News and Social Media for Enhanced Stock Price Prediction Using AI. ResearchGate. Available online: https://www.researchgate.net/publication/396011190_Sentiment_Analysis_of_Financial_News_and_Social_Media_for_Enhanced_Stock_Price_Prediction_Using_AI.
55. Sentiment Analysis of Facebook Users Reacting to Political Campaign Posts
56. Toleu, A., Tolegen, G., and Ualiyeva, I. (2025). Fine-tuning large language models for Kazakh text simplification. Appl. Sci., 15.10.20944/preprints202506.1947.v1 ↗