journal article·2024Open access

Sentiment Analysis of Low-Resource Language Literature Using Data Processing and Deep Learning

Aizaz Ali, Maqbool Khan, Khalil Khan, Rehan Ullah Khan, Abdulrahman Aloraini

Computers, Materials & Continua· Volume 79· Issue 1

Abstract

Sentiment analysis, a crucial task in discerning emotional tones within the text, plays a pivotal role in understanding public opinion and user sentiment across diverse languages. While numerous scholars conduct sentiment analysis in widely spoken languages such as English, Chinese, Arabic, Roman Arabic, and more, we come to grappling with resource-poor languages like Urdu literature which becomes a challenge. Urdu is a uniquely crafted language, characterized by a script that amalgamates elements from diverse languages, including Arabic, Parsi, Pashtu, Turkish, Punjabi, Saraiki, and more. As Urdu literature, characterized by distinct character sets and linguistic features, presents an additional hurdle due to the lack of accessible datasets, rendering sentiment analysis a formidable undertaking. The limited availability of resources has fueled increased interest among researchers, prompting a deeper exploration into Urdu sentiment analysis. This research is dedicated to Urdu language sentiment analysis, employing sophisticated deep learning models on an extensive dataset categorized into five labels: Positive, Negative, Neutral, Mixed, and Ambiguous. The primary objective is to discern sentiments and emotions within the Urdu language, despite the absence of well-curated datasets. To tackle this challenge, the initial step involves the creation of a comprehensive Urdu dataset by aggregating data from various sources such as newspapers, articles, and social media comments. Subsequent to this data collection, a thorough process of cleaning and preprocessing is implemented to ensure the quality of the data. The study leverages two well-known deep learning models, namely Convolutional Neural Networks (CNN) and Recurrent Neural Networks (RNN), for both training and evaluating sentiment analysis performance. Additionally, the study explores hyperparameter tuning to optimize the models’ efficacy. Evaluation metrics such as precision, recall, and the F1-score are employed to assess the effectiveness of the models. The research findings reveal that RNN surpasses CNN in Urdu sentiment analysis, gaining a significantly higher accuracy rate of 91%. This result accentuates the exceptional performance of RNN, solidifying its status as a compelling option for conducting sentiment analysis tasks in the Urdu language.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Sentiment Analysis and Opinion Mining · Topic Modeling · Stock Market Forecasting Methods

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (51)

Show source-provided references
1. A deep learning approach for sentiment analysis of COVID-19 reviews10.3390/app12083709 ↗
2. Deep learning approach for sentiment analysis of short texts
3. Urdu sentiment analysis with deep learning methods10.1109/ACCESS.2021.3093078 ↗
4. Examining attention mechanisms in deep learning models for sentiment analysis10.3390/app11093883 ↗
5. Sentiment analysis and its applications in fighting COVID-19 and infectious diseases: A systematic review10.1016/j.eswa.2020.114155 ↗
6. Sentiment analysis of COVID-19 vaccine on Twitter social media: Systematic literature review
7. T. A. Javed, W. Shahzad, and U. Arshad, “Hierarchical text classification of Urdu news using deep neural network,” arXiv preprint arXiv:2107.03141, 2021.
8. Document-level text classification using single-layer multisize filters convolutional neural network10.1109/ACCESS.2020.2976744 ↗
9. UTSA: Urdu text sentiment analysis using deep learning methods10.1109/ACCESS.2021.3104308 ↗
10. Urdu text classification using majority voting
11. Sentiment analysis of social media content in pashto language using deep learning algorithms
12. A survey on sentiment analysis in Urdu: A resource-poor language10.1016/j.eij.2020.04.003 ↗
13. Sentiment analysis in e-commerce using SVM on Roman Urdu text
14. Pashto language stemming algorithm
15. PHND: Pashtu handwritten numerals database and deep learning benchmark10.1371/journal.pone.0238423 ↗
16. Pashtu numerals recognition through convolutional neural networks
17. Identification of HATE speech tweets in Pashto language using Machine Learning techniques
18. Morphological evaluation and sentiment analysis of Punjabi text using deep learning classification
19. Urdu sentiment analysis using supervised machine learning approach10.1142/S0218001418510011 ↗
20. Identification and handling of intensifiers for enhancing accuracy of Urdu sentiment analysis10.1111/exsy.12317 ↗
21. Deep sentiment analysis using CNN-LSTM architecture of English and Roman Urdu text shared in social media10.3390/app12052694 ↗
22. Sentiment analysis of reviews in natural language: Roman Urdu as a case study10.1109/ACCESS.2022.3150172 ↗
23. BERT based sentiment analysis for low-resourced languages: A case study of Urdu language10.1109/ACCESS.2023.3322101 ↗
24. Bag-of-words, bag-of-topics and word-to-vec based subject classification of text documents in polish–a comparative study
25. Refining word embeddings for sentiment analysis
26. Review on word2vec word embedding neural net
27. U. Khalid, A. Hussain, M. U. Arshad, W. Shahzad, and M. O. Beg, “Co-occurrences using Fasttext embeddings for word similarity tasks in Urdu,” arXiv preprint arXiv:2102.10957, 2021.
28. M. Cliche, “BB_twtr at SemEval-2017 task 4: Twitter sentiment analysis with CNNs and LSTMs,” arXiv preprint arXiv:1704.06125, 2017.10.18653/v1/S17-2094 ↗
29. A. Abdulsalam, A. Alhothali, and S. Al-Ghamdi, “Detecting suicidality in Arabic Tweets using machine learning and deep learning techniques,” arXiv preprint arXiv:2309.00246, 2023.10.1007/s13369-024-08767-3 ↗
30. Deep learning-based sentiment analysis using convolution neural network10.1007/s13369-018-3500-z ↗
31. S. Minaee, E. Azimi, and A. Abdolrashidi, “Deep-sentiment: Sentiment analysis using ensemble of CNN and bi-LSTM models,” arXiv preprint arXiv:1904.04206, 2019.
32. Sentiment analysis using recurrent neural network10.1088/1742-6596/1471/1/012018 ↗
33. Sentiment analysis by using recurrent neural network
34. Arabic sentiment analysis based on word embeddings and deep learning10.3390/computers12060126 ↗
35. Urdu word segmentation
36. Deep learning-based sentiment analysis for Roman Urdu text10.1016/j.procs.2019.01.202 ↗
37. Sentence level sentiment analysis using Urdu nouns
38. Deep sentiment representation based on CNN and LSTM
39. Resources for Urdu Language Processing
40. Urdu spell checking: Reverse edit distance approach
41. Javed · Natural Language Processing and Information Systems. NLDB 2014 · 2014 · 19 · 23210.1007/978-3-319-07983-7_32 ↗
42. Transliterating Urdu for a broad-coverage Urdu/Hindi LFG grammar
43. A rule-based sentiment classification framework for health reviews on mobile social media
44. Named entity dataset for Urdu named entity recognition task
45. Urdu part of speech tagging using conditional random fields
46. Semi-automatic bilingual corpus creation with zero entropy alignments
47. A word segmentation system for handling space omission problem in Urdu script
48. Bilingual lexicography and corpus methods. The example of German-basque as language pair10.1016/j.sbspro.2013.10.645 ↗
49. Multilingual sentiment analysis: From formal to informal and scarce resource languages10.1007/s10462-016-9508-4 ↗
50. Sentiment classification of Roman-Urdu opinions using naïve Bayesian, decision tree and KNN classification techniques
51. Urdu named entity recognition and classification system using artificial neural network