journal article·2023-11-21Open access

Sentiment Analysis of Arabic Course Reviews of a Saudi University Using Support Vector Machine

Ali Louati, Hassen Louati, Elham Kariri, Fahd Alaskar, Abdulaziz Alotaibi

Applied Sciences· Volume 13· Issue 23

Abstract

This study presents the development of a sentimental analysis system for high education students using Arabic text. There is a gap in the literature concerning understanding the perceptions and opinions of students in Saudi Arabia Universities regarding their education beyond COVID-19. The proposed SVM Sentimental Analysis for Arabic Students’ Course Reviews (SVM-SAA-SCR) algorithm is a general framework that involves collecting student reviews, preprocessing them, and using a machine learning model to classify them as positive, negative, or neutral. The suggested technique for preprocessing and classifying reviews includes steps such as collecting data, removing irrelevant information, tokenizing, removing stop words, stemming or lemmatization, and using pre-trained sentiment analysis models. The classifier is trained using the SVM algorithm and performance is evaluated using metrics such as accuracy, precision, and recall. Fine-tuning is done by adjusting parameters such as kernel type and regularization strength to optimize performance. A real dataset provided by the deanship of quality at Prince Sattam bin Abdulaziz University (PSAU) is used and contains students’ opinions on various aspects of their education. We also compared our algorithm with CAMeLBERT, a state-of-the-art Dialectal Arabic model. Our findings show that while the CAMeLBERT model classified 70.48% of the reviews as positive, our algorithm classified 69.62% as positive which proves the efficiency of the suggested SVM-SAA-SCR. The results of the proposed model provide valuable insights into the challenges and obstacles faced by Arab Universities post-COVID-19 and can help to improve their educational experience.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Sentiment Analysis and Opinion Mining · Advanced Text Analysis Techniques · Stock Market Forecasting Methods

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Information Systems, College of Computer Engineering and Sciences, Prince Sattam bin Abdulaziz University, Al-Kharj 11942, Saudi Arabia

SMART Lab, ISG Tunis, University of Tunis, Le Bardo, Tunis 2000, Tunisia

College of Information Technology, Kingdom University, Riffa 40434, Bahrain

Funding

Prince Sattam bin Abdulaziz University

References (38)

Show source-provided references
1. Smith, A., McCarthey, S., and Magnifico, A. (2017). E-Learning Ecologies, Routledge.
2. Jones, B.D. (2020). Handbook of Research in Educational Communications and Technology, Contemporary Educational Technology. Learning Design.
3. Galante, J., Friedrich, C., Dawson, A.F., Modrego-Alarcón, M., Gebbing, P., Delgado-Suárez, I., and Jones, P.B. (2021). Mindfulness-based programmes for mental health promotion in adults in nonclinical settings: A systematic review and meta-analysis of randomised controlled trials. PLoS Med., 18.10.1371/journal.pmed.1003481 ↗
4. Beneath the tip of the iceberg: Current challenges and new directions in sentiment analysis research10.1109/TAFFC.2020.3038167 ↗
5. AI-based conversational agents: A scoping review from technologies to future directions10.1109/ACCESS.2022.3201144 ↗
6. A recent overview of the state-of-the-art elements of text classification10.1016/j.eswa.2018.03.058 ↗
7. Sentimental analysis of indian regional languages on social media10.1016/j.gltp.2021.08.039 ↗
8. Impact of COVID-19 pandemic on ride-hailing services based on large-scale twitter data analysis10.1016/j.jum.2021.03.002 ↗
9. An efficient way of text-based emotion analysis from social media using lra-dnn10.1016/j.neuri.2022.100048 ↗
10. Bonifazi, G., Cauteruccio, F., Corradini, E., Marchetti, M., Sciarretta, L., Ursino, D., and Virgili, L. (2022). A Space-Time Framework for Sentiment Scope Analysis in Social Media. Big Data Cogn. Comput., 6.10.3390/bdcc6040130 ↗
11. A framework for investigating the dynamics of user and community sentiments in a social platform10.1016/j.datak.2023.102183 ↗
12. Opinion mining and sentiment analysis for arabic on-line texts: Application on the political domain10.1007/s10772-017-9422-4 ↗
13. Sghaier, M.A., and Zrigui, M. (2016, January 22–24). Sentiment analysis for arabic e-commerce websites. Proceedings of the 2016 International Conference on Engineering & MIS (ICEMIS), Agadir, Morocco.10.1109/ICEMIS.2016.7745323 ↗
14. Mourad, A., and Darwish, K. (2013, January 14). Subjectivity and sentiment analysis of modern standard arabic and arabic microblogs. Proceedings of the 4th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis, Atlanta, Georgia.
15. Alwakid, G., Osman, T., Haj, M.E., Alanazi, S., Humayun, M., and Sama, N.U. (2022). Muldasa: Multifactor lexical sentiment analysis of social-media content in nonstandard arabic social media. Appl. Sci., 12.10.3390/app12083806 ↗
16. Semantic sentiment analysis in arabic social media
17. Tracking public opinion about online education over COVID-19 in China10.1007/s11423-022-10080-5 ↗
18. Toçoğlu, M.A., and Onan, A. (2020). International Conference on Intelligent and Fuzzy Systems, Springer.
19. Aspect-based sentiment analysis of reviews in the domain of higher education10.1108/EL-06-2019-0140 ↗
20. Skill-centered assessment in an academic course: A formative approach to evaluate student performance and make continuous quality improvements in pedagogy10.3991/ijet.v14i11.10275 ↗
21. Sentimental analysis of student feedback using machine learning techniques
22. Cloud-assisted collaborative estimation for next-generation automobile sensing10.1016/j.engappai.2023.106883 ↗
23. A hybridization of deep learning techniques to predict and control traffic disturbances10.1007/s10462-020-09831-8 ↗
24. Machine learning for human learners: Opportunities, issues, tensions and threats10.1007/s11423-020-09858-2 ↗
25. Sentiment analysis: A review and comparative analysis over social media10.1007/s12652-018-0862-8 ↗
26. Alrehili, A., and Albalawi, K. (2019, January 3–4). Sentiment analysis of customer reviews using ensemble method. Proceedings of the 2019 International Conference on Computer and Information Sciences (ICCIS), Sakaka, Saudi Arabia.10.1109/ICCISci.2019.8716454 ↗
27. Deep recurrent neural network vs. support vector machine for aspect-based sentiment analysis of arabic hotels’ reviews10.1016/j.jocs.2017.11.006 ↗
28. Sentiment analysis of arabic tweets using text mining techniques
29. A comprehensive study for arabic sentiment analysis (challenges and applications)10.1016/j.eij.2019.06.001 ↗
30. Inoue, G., Alhafni, B., Baimukan, N., Bouamor, H., and Habash, N. (2021). The interplay of variant, size, and task type in arabic pre-trained language models. arXiv.
31. Price forecasting for real estate using machine learning: A case study on Riyadh city10.1002/cpe.6748 ↗
32. Modelling personal thermal sensations using C-Support Vector Classification (C-SVC) algorithm10.1016/j.buildenv.2016.01.022 ↗
33. Arsas: An arabic speech-act and sentiment corpus of tweets
34. Nabil, M., Aly, M., and Atiya, A. (2015, January 17–21). Astd: Arabic sentiment tweets dataset. Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, Lisbon, Portugal.10.18653/v1/D15-1299 ↗
35. Rosenthal, S., Farra, N., and Nakov, P. (2019). Semeval-2017 task 4: Sentiment analysis in twitter. arXiv.10.18653/v1/S17-2088 ↗
36. Baly, R., Khaddaj, A., Hajj, H., El-Hajj, W., and Shaban, K.B. (2019). Arsentd-lev: A multi-topic corpus for target-based sentiment analysis in arabic levantine tweets. arXiv.
37. Farha, I.A., and Magdy, W. (2019, January 1). Mazajak: An online arabic sentiment analyser. Proceedings of the Fourth Arabic Natural Language Processing Workshop, Florence, Italy.
38. Obeid, O., Zalmout, N., Khalifa, S., Taji, D., Oudah, M., Alhafni, B., Inoue, G., Eryani, F., Erdmann, A., and Habash, N. (2020, January 11–16). Camel tools: An open source python toolkit for arabic natural language processing. Proceedings of the 12th Language Resources and Evaluation Conference, Marseille, France.