journal article·2025-02-16Open access

Towards Better Sentiment Analysis in the Turkish Language: Dataset Improvements and Model Innovations

Kevser Büşra Zümberoğlu, Sümeyye Zülal Dik, Büşra Sinem Karadeniz, Shaaban Sahmoud

Applied Sciences· Volume 15· Issue 4

Abstract

Sentiment analysis in the Turkish language has gained increasing attention due to the growing availability of Turkish textual data across various domains. However, existing datasets often suffer from limitations such as insufficient size, lack of diversity, and annotation inconsistencies, which hinder the development of robust and accurate sentiment analysis models. In this study, we present a novel enhanced dataset specifically designed to address these challenges, providing a comprehensive and high-quality resource for Turkish sentiment analysis. We perform a comparative evaluation of previously proposed models using our dataset to assess their performance and limitations. Experimental findings demonstrate the effectiveness of the presented dataset and trained models, offering valuable insights for advancing sentiment analysis research in the Turkish language. These results underscore the critical role of the enhanced dataset in bridging the gap between existing datasets and the importance of training the modern sentiment analysis models on scalable, balanced, and curated datasets. This can offer valuable insights for advancing sentiment analysis research in the Turkish language. Furthermore, the experimental results represent an important step in overcoming the challenges associated with Turkish sentiment analysis and improving the performance of existing models.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Sentiment Analysis and Opinion Mining · Topic Modeling · Natural Language Processing Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Computer Engineering Department, Fatih Sultan Mehmet Vakif University, Istanbul 34015, Turkey

Data Science Application and Research Center (VEBIM), Fatih Sultan Mehmet Vakif University, Istanbul 34015, Turkey

References (64)

Show source-provided references
1. Sentiment analysis using common-sense and context information10.1155/2015/715730 ↗
2. Çevrimiçi kullanıcı yorumlarının duygu analizi ile sınıflandırılması
3. Agarwal, B., and Namita, M. (2013, January 24–30). Optimal feature selection for sentiment analysis. Proceedings of the Computational Linguistics and Intelligent Text Processing: 14th International Conference, CICLing 2013, Samos, Greece. Proceedings, Part II 14.
4. Oflazer, K., and Kuruöz, Ì. (1994, January 13–15). Tagging and morphological disambiguation of Turkish text. Proceedings of the Fourth Conference, Stuttgart, Germany.10.3115/974358.974391 ↗
5. Torunoğlu-Selamet, D., and Gülşen, E. (2014, January 26–30). A cascaded approach for social media text normalization of Turkish. Proceedings of the 5th Workshop on Language Analysis for Social Media (LASM), Gothenburg, Sweden.10.3115/v1/W14-1308 ↗
6. Göksel, A., and Celia, K. (2004). Turkish: A Comprehensive Grammar, Routledge.10.4324/9780203340769 ↗
7. Dbmdz (2025, January 13). *Electra-Base-Turkish-Cased-Discriminator* [Model]. Hugging Face. Available online: https://huggingface.co/dbmdz/electra-base-turkish-cased-discriminator.
8. BERTurk-BERT models for Turkish
9. TurkishBERTweet: Fast and reliable large language model for social media analysis10.1016/j.eswa.2024.124737 ↗
10. Devlin, J. (2018). Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv.
11. Tas, N. (2024). RoBERTurk: Adjusting RoBERTa for Turkish. arXiv.
12. Conneau, A., Khandelwal, K., Goyal, N., Chaudhary, V., Wenzek, G., Guzmán, F., and Stoyanov, V. (2020, January 5–10). Unsupervised Cross-lingual Representation Learning at Scale. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Online.10.18653/v1/2020.acl-main.747 ↗
13. Hsu, C.-W. (2003). A Practical Guide to Support Vector Classification, Department of Computer Science, National Taiwan University.
14. Kleinbaum, D.G., and Mitchel, K. (2002). Logistic Regression, Springer.
15. Rish, I. (2001, January 4–6). An empirical study of the naive Bayes classifier. Proceedings of the IJCAI 2001 Workshop on Empirical Methods in Artificial Intelligence, Seattle, DC, USA.
16. Nearest neighbor pattern classification10.1109/TIT.1967.1053964 ↗
17. Induction of decision trees10.1007/BF00116251 ↗
18. Support-Vector Networks10.1007/BF00994018 ↗
19. Hochreiter, S. (1997). Long Short-Term Memory, Neural Computation MIT-Press.10.1162/neco.1997.9.8.1735 ↗
20. Gradient-based learning applied to document recognition10.1109/5.726791 ↗
21. Lexicon-based methods for sentiment analysis10.1162/COLI_a_00049 ↗
22. Opinion mining and sentiment analysis
23. Sentiment analysis in Spanish for improvement of products and services: A deep learning approach
24. Sentiment analysis of financial Twitter posts on Twitter with the machine learning classifiers10.1016/j.heliyon.2023.e23784 ↗
25. Chen, T. (2015). Xgboost: Extreme Gradient Boosting, R Package Version 0.4–2 1.4, The R Foundation for Statistical Computing.
26. A decision-theoretic generalization of on-line learning and an application to boosting10.1006/jcss.1997.1504 ↗
27. Random forests10.1023/A:1010933404324 ↗
28. Learning representations by back-propagating errors10.1038/323533a0 ↗
29. Finding structure in time10.1207/s15516709cog1402_1 ↗
30. Framewise phoneme classification with bidirectional LSTM and other neural network architectures10.1016/j.neunet.2005.06.042 ↗
31. GPT-3: Its nature, scope, limits, and consequences10.1007/s11023-020-09548-1 ↗
32. Touvron, H., Lavril, T., Izacard, G., Martinet, X., Lachaux, M., Lacroix, T., Rozière, B., Goyal, N., Hambro, E., and Azhar, F. (2023). Llama: Open and efficient foundation language models. arXiv.
33. Beleveslis, D., Tjortjis, C., Psaradelis, D., and Nikoglou, D. (2019, January 20–22). A hybrid method for sentiment analysis of election related tweets. Proceedings of the 2019 4th South-East Europe Design Automation, Computer Engineering, Computer Networks and Social Media Conference (SEEDA-CECNSM), Piraeus, Greece.10.1109/SEEDA-CECNSM.2019.8908289 ↗
34. Tweetlerin Duygu Analizi İçin Hibrit Bir Yaklaşım10.57244/dfbd.1314901 ↗
35. Duygu Analizi Tabanli Yeni Bir Hibrit Tavsiyeci Sistem
36. Sebastiani, F., and Andrea, E. (2006, January 20–25). Sentiwordnet: A publicly available lexical resource for opinion mining. Proceedings of the 5th International Conference on Language Resources and Evaluation, European Language Resources Association (ELRA), Genoa, Italy.
37. Sentiment classification for insider threat identification using metaheuristic optimized machine learning classifiers10.1038/s41598-024-77240-w ↗
38. Sentiment analysis of movie reviews based on NB approaches using TF–IDF and count vectorizer10.1007/s13278-024-01250-9 ↗
39. Alizadeh, M., and Seilsepour, A. (2024). A novel self-supervised sentiment classification approach using semantic labeling based on contextual embeddings. Multimed. Tools Appl., 1–26.10.1007/s11042-024-19086-y ↗
40. Sentiment analysis of Canadian maritime case law: A sentiment case law and deep learning approach
41. A hybrid machine learning model for sentiment analysis and satisfaction assessment with Turkish universities using Twitter data10.1016/j.dajour.2024.100473 ↗
42. Jahin, M.A., Shovon, M.S.H., Mridha, M.F., Islam, M.R., and Watanobe, Y. (2024). A hybrid transformer and attention based recurrent neural network for robust and interpretable sentiment analysis of tweets. Sci. Rep., 14.10.1038/s41598-024-76079-5 ↗
43. Vijayaragavan, P., Suresh, C., Maheshwari, A., Vijayalakshmi, K., Narayanamoorthi, R., Gono, M., and Novak, T. (2024). Sustainable sentiment analysis on E-commerce platforms using a weighted parallel hybrid deep learning approach for smart cities applications. Sci. Rep., 14.10.1038/s41598-024-78318-1 ↗
44. Miah, S.U., Kabir, M., Bin Sarwar, T., Safran, M., Alfarhood, S., and Mridha, M.F. (2024). A multimodal approach to cross-lingual sentiment analysis with ensemble of transformer and LLM. Sci. Rep., 14.10.1038/s41598-024-60210-7 ↗
45. Aliyeva, Ç.O., and Yağanoğlu, M. (2024). Deep learning approach to detect cyberbullying on twitter. Multimed. Tools Appl., 1–24.10.1007/s11042-024-19869-3 ↗
46. Optimizing aspect-based sentiment analysis using sentence embedding transformer, bayesian search clustering, and sparse attention mechanism10.1016/j.joitmc.2024.100211 ↗
47. Exploring large language models for the generation of synthetic training samples for aspect-based sentiment analysis in low resource settings10.1016/j.eswa.2024.125514 ↗
48. Aziz, K., Ji, D., Chakrabarti, P., Chakrabarti, T., Iqbal, M.S., and Abbasi, R. (2024). Unifying aspect-based sentiment analysis BERT and multi-layered graph convolutional networks for comprehensive sentiment dissection. Sci. Rep., 14.10.1038/s41598-024-61886-7 ↗
49. DCASAM: Advancing aspect-based sentiment analysis through a deep context-aware sentiment analysis model10.1007/s40747-024-01570-5 ↗
50. Aspect-level sentiment classification with fused local and global context10.1186/s40537-023-00856-8 ↗
51. Game theory and MCDM-based unsupervised sentiment analysis of restaurant reviews10.1007/s10489-023-04471-1 ↗
52. Sentiment analysis based multi-person multi-criteria decision making methodology using natural language processing and deep. learning for smarter decision aid. Case study of restaurant choice using TripAdvisor reviews10.1016/j.inffus.2020.10.019 ↗
53. Punetha, N., and Jain, G. (2024). Advancing sentiment classification through a population game model approach. Sci. Rep., 14.10.1038/s41598-024-70766-z ↗
54. Sentiment-semantic word vectors: A new method to estimate management sentiment10.1186/s41937-024-00126-1 ↗
55. Ontology-based sentiment analysis process for social media content10.1016/j.procs.2015.07.295 ↗
56. Zhang, W., Deng, Y., Liu, B., Pan, S., and Bing, L. (2024). Sentiment Analysis in the Era of Large Language Models: A Reality Check. Findings of the Association for Computational Linguistics: NAACL 2024, Association for Computational Linguistics.10.18653/v1/2024.findings-naacl.246 ↗
57. Yapay Zekâ Çağında Duygu Analizi: Büyük Dil Modellerinin Yükselişi ve Klasik Yaklaşımlarla Karşılaştırılması
58. Bhattarai, P., Sharma, S., and Acharya, B. (2023). A Comprehensive Study of Sentiment Analysis Using Deep Learning Approaches. arXiv.
59. Language models are few-shot learners
60. Language models are unsupervised multitask learners
61. A survey on aspect-based sentiment analysis: Tasks, methods, and challenges10.1109/TKDE.2022.3230975 ↗
62. Köksal, A., and Özgür, A. (2021, January 9–11). Twitter dataset and evaluation of transformers for Turkish sentiment analysis. Proceedings of the 2021 29th Signal Processing and Communications Applications Conference (SIU), Istanbul, Turkey.10.1109/SIU53274.2021.9477814 ↗
63. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A., Kaiser, L., and Polosukhin, I. (2017). Attention Is All You Need. arXiv.
64. Lundberg, S.M., and Lee, S.-I. (2017). A Unified Approach to Interpreting Model Predictions. arXiv.