journal article·2021-09-12Open access

Sentiment Analysis and Topic Modeling on Tweets about Online Education during COVID-19

Muhammad Mujahid, Ernesto Lee, Furqan Rustam, Patrick Bernard Washington, Saleem Ullah, Aijaz Ahmad Reshi, Imran Ashraf

Applied Sciences· Volume 11· Issue 18

Abstract

Amid the worldwide COVID-19 pandemic lockdowns, the closure of educational institutes leads to an unprecedented rise in online learning. For limiting the impact of COVID-19 and obstructing its widespread, educational institutions closed their campuses immediately and academic activities are moved to e-learning platforms. The effectiveness of e-learning is a critical concern for both students and parents, specifically in terms of its suitability to students and teachers and its technical feasibility with respect to different social scenarios. Such concerns must be reviewed from several aspects before e-learning can be adopted at such a larger scale. This study endeavors to investigate the effectiveness of e-learning by analyzing the sentiments of people about e-learning. Due to the rise of social media as an important mode of communication recently, people’s views can be found on platforms such as Twitter, Instagram, Facebook, etc. This study uses a Twitter dataset containing 17,155 tweets about e-learning. Machine learning and deep learning approaches have shown their suitability, capability, and potential for image processing, object detection, and natural language processing tasks and text analysis is no exception. Machine learning approaches have been largely used both for annotation and text and sentiment analysis. Keeping in view the adequacy and efficacy of machine learning models, this study adopts TextBlob, VADER (Valence Aware Dictionary for Sentiment Reasoning), and SentiWordNet to analyze the polarity and subjectivity score of tweets’ text. Furthermore, bearing in mind the fact that machine learning models display high classification accuracy, various machine learning models have been used for sentiment classification. Two feature extraction techniques, TF-IDF (Term Frequency-Inverse Document Frequency) and BoW (Bag of Words) have been used to effectively build and evaluate the models. All the models have been evaluated in terms of various important performance metrics such as accuracy, precision, recall, and F1 score. The results reveal that the random forest and support vector machine classifier achieve the highest accuracy of 0.95 when used with Bow features. Performance comparison is carried out for results of TextBlob, VADER, and SentiWordNet, as well as classification results of machine learning models and deep learning models such as CNN (Convolutional Neural Network), LSTM (Long Short Term Memory), CNN-LSTM, and Bi-LSTM (Bidirectional-LSTM). Additionally, topic modeling is performed to find the problems associated with e-learning which indicates that uncertainty of campus opening date, children’s disabilities to grasp online education, and lagging efficient networks for online education are the top three problems.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Sentiment Analysis and Opinion Mining · Misinformation and Its Impacts · Spam and Phishing Detection

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Computer Science, Khwaja Fareed University of Engineering and Information Technology, Rahim Yar Khan 64200, Pakistan

Department of Computer Science, Broward College, Broward County, FL 33332, USA

Division of Business Administration and Economics, Morehouse College, Atlanta, GA 30314, USA

Department of Computer Science, College of Computer Science and Engineering, Taibah University, Medina 42353, Saudi Arabia

Department of Information and Communication Engineering, Yeungnam University, Gyeongsan 38541, Korea

Funding

Florida Center for Advanced Analytics and Data Science funded by Ernesto.Net (under the Algorithms for Good Grant)

References (53)

Show source-provided references
1. Education in and after COVID-19: Immediate responses and long-term visions10.1007/s42438-020-00126-3 ↗
2. Liu, C., and Long, F. (2014, January 16–17). The discussion of traditional teaching and multimedia teaching approach in college English teaching. Proceedings of the International Conference on Management, Education and Social Science, Beijing, China.10.2991/icmess-14.2014.9 ↗
3. The comparison of the effectiveness of computer-based education and traditional education on the numerical memory in students with mathematics disorder
4. Emergent transition from face-to-face to online learning in a South African University in the context of the Coronavirus pandemic10.1057/s41599-020-00603-x ↗
5. Kanani, B. (2021, August 22). Stop Words—Machine Learning. Available online: https://cft.vanderbilt.edu/guides-sub-pages/blooms-taxonomy/.
6. MINLOC: Magnetic field patterns-based indoor localization using convolutional neural networks10.1109/ACCESS.2020.2985384 ↗
7. Umer, M., Ashraf, I., Ullah, S., Mehmood, A., and Choi, G.S. (2021). COVINet: A convolutional neural network approach for predicting COVID-19 from chest X-ray images. J. Ambient. Intell. Humaniz. Comput., 1–13.10.1007/s12652-021-02917-3 ↗
8. Ashraf, I., Hur, S., and Park, Y. (2019). Application of deep convolutional neural networks and smartphone sensors for indoor localization. Appl. Sci., 9.10.3390/app9112337 ↗
9. Spam comments prediction using stacking with ensemble learning10.1088/1742-6596/933/1/012012 ↗
10. Eroğul, U. (2009). Sentiment Analysis in Turkish. [Master’s Thesis, Middle East Technical University].
11. Štrimaitis, R., Stefanovič, P., Ramanauskaitė, S., and Slotkienė, A. (2021). Financial Context News Sentiment Analysis for the Lithuanian Language. Appl. Sci., 11.10.3390/app11104443 ↗
12. Sentiment Analysis of French Tweets based on Subjective Lexicon Approach: Evaluation of the use of OpenNLP and CoreNLP Tools10.3844/jcssp.2018.829.836 ↗
13. Twitter based Sentiment Analysis of Impact of COVID-19 on Education Globaly
14. Relucio, F.S., and Palaoag, T.D. (2018, January 11–13). Sentiment analysis on educational posts from social media. Proceedings of the 9th International Conference on E-Education, E-Business, E-Management and E-Learning, San Diego, CA, USA.10.1145/3183586.3183604 ↗
15. Bhagat, K.K., Mishra, S., Dixit, A., and Chang, C.Y. (2021). Public Opinions about Online Learning during COVID-19: A Sentiment Analysis Approach. Sustainability, 13.10.3390/su13063346 ↗
16. To Impact of COVID-19 in Education System
17. Online learning amid the COVID-19 pandemic: Students perspectives
18. Arabic Tweets Sentiment Analysis about Online Learning during COVID-19 in Saudi Arabia
19. Multi-lingual support for lexicon-based sentiment analysis guided by semantics10.1016/j.dss.2014.03.004 ↗
20. Sentiment Analysis of Movie Reviews using Machine Learning Classifiers
21. Samuel, J., Ali, G., Rahman, M., Esawi, E., and Samuel, Y. (2020). COVID-19 public sentiment insights and machine learning for tweets classification. Information, 11.10.31234/osf.io/sw2dn ↗
22. Jagdale, R.S., Shirsat, V.S., and Deshmukh, S.N. (2019). Sentiment analysis on product reviews using machine learning techniques. Cognitive Informatics and Soft Computing, Springer.10.1007/978-981-13-0617-4_61 ↗
23. Sentiment analysis: A comparative study on different approaches10.1016/j.procs.2016.05.124 ↗
24. Sentiment analysis and opinion mining
25. Rustam, F., Khalid, M., Aslam, W., Rupapara, V., Mehmood, A., and Choi, G.S. (2021). A performance comparison of supervised machine learning models for COVID-19 tweets sentiment analysis. PLoS ONE, 16.10.1371/journal.pone.0245909 ↗
26. Artificial intelligence–enabled analysis of public attitudes on facebook and Twitter toward COVID-19 vaccines in the united kingdom and the united states: Observational study10.2196/26627 ↗
27. Sentiment analysis and its applications in fighting COVID-19 and infectious diseases: A systematic review10.1016/j.eswa.2020.114155 ↗
28. Cross-Cultural Polarity and Emotion Detection Using Sentiment Analysis and Deep Learning on COVID-19 Related Tweets10.1109/ACCESS.2020.3027350 ↗
29. Sentimental Analysis of COVID-19 Tweets Using Deep Learning Models10.3390/idr13020032 ↗
30. Best practices in middle level quaranteaching: Strategies, tips and resources amidst COVID-19
31. From Offline to Online: Challenges and Opportunities for Entrepreneurship Education Following the COVID-19 Pandemic
32. Sentiment Research on Twitter Data
33. A Comparative Study of Stemming Algorithms
34. Armstrong, P. (2021, August 23). Bloom’s Taxonomy. Vanderbilt University Center for Teaching. Available online: https://studymachinelearning.com/nlp-stop-words/.
35. textblob Documentation
36. Sohangir, S., Petty, N., and Wang, D. (February, January 31). Financial sentiment lexicon analysis. Proceedings of the 2018 IEEE 12th International Conference on Semantic Computing (ICSC), Laguna Hills, CA, USA.10.1109/ICSC.2018.00052 ↗
37. Rupapara, V., Rustam, F., Shahzad, H.F., Mehmood, A., Ashraf, I., and Choi, G.S. (2021). Impact of SMOTE on Imbalanced Text Features for Toxic Comments Classification using RVVC Model. IEEE Access, 78621–78634.10.1109/ACCESS.2021.3083638 ↗
38. Eshan, S.C., and Hasan, M.S. (2017, January 22–24). An application of machine learning to detect abusive bengali text. Proceedings of the 2017 20th International Conference of Computer and Information Technology (ICCIT), Dhaka, Bangladesh.10.1109/ICCITECHN.2017.8281787 ↗
39. A comparative study of TF* IDF, LSI and multi-words for text classification10.1016/j.eswa.2010.08.066 ↗
40. Robertson, S. (2004). Understanding inverse document frequency: On theoretical arguments for IDF. J. Doc.10.1108/00220410410560582 ↗
41. Impact Of Topic Modelling Methods In addition, Text Classification Techniques In Text Mining: A Survey
43. Zainuddin, N., and Selamat, A. (2014, January 2–4). Sentiment analysis using support vector machine. Proceedings of the 2014 International Conference on Computer, Communications, and Control Technology (I4CT), Langkawi, Malaysia.10.1109/I4CT.2014.6914200 ↗
44. A comparative study on logistic regression and svm based machine learning approach for analyzing user reviews
45. A survey of decision tree classifier methodology10.1109/21.97458 ↗
46. Donges, N. (2020, August 22). He Random Forest Algorithm. Available online: https://builtin.com/data-science/random-forest-algorithm.
47. Rustam, F., Ashraf, I., Mehmood, A., Ullah, S., and Choi, G.S. (2019). Tweets classification on the base of sentiments for US airline companies. Entropy, 21.10.3390/e21111078 ↗
48. Soucy, P., and Mineau, G.W. (December, January 29). A simple KNN algorithm for text categorization. Proceedings of the 2001 IEEE International Conference on Data Mining, San Jose, CA, USA.
49. Brownlee, J. (2020, August 20). Machine Learning Naive Baiyes. Available online: https://machinelearningmastery.com/better-naive-bayes/.
50. Research of the Improved Adaboost Algorithm Based on Unbalanced Data
51. Ohana, B., and Tierney, B. (2009, January 22–23). Sentiment classification of reviews using SentiWordNet. Proceedings of the 9th IT&T Conference, Dublin, Ireland.
52. Detecting sarcasm in multi-domain datasets using convolutional neural networks and long short term memory network model10.7717/peerj-cs.645 ↗
53. Lsa & lda topic modeling classification: Comparison study on e-books