Optimizing Aspect-Based Sentiment Analysis Using BERT for Comprehensive Analysis of Indonesian Student Feedback
Source abstract
Abstract
Evaluating the learning process requires a platform for students to express feedback and suggestions openly through online reviews. Sentiment analysis is often used to analyze review texts but typically captures only overall sentiment without identifying specific aspects. This study develops an aspect-based sentiment analysis (ABSA) model using IndoBERT, a pre-trained model tailored for the Indonesian language. The research uses 10,000 student reviews from Indonesian universities, processed through data labeling, text preprocessing, and splitting, followed by model training and performance evaluation. The model demonstrated superior performance with an aspect extraction accuracy of 0.973, an F1-score of 0.952, a sentiment classification accuracy of 0.979, and an F1-score of 0.974. Experimental results indicate that the proposed ABSA model surpasses previous state-of-the-art models in analyzing sentiment related to specific aspects of educational evaluation. By leveraging IndoBERT, the model effectively handles linguistic complexities and provides detailed insights into student experiences. These findings highlight the potential of the ABSA model in enhancing learning evaluations by offering precise, aspect-focused feedback, contributing to strategies for improving the quality of higher education.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Sentiment Analysis and Opinion Mining · Advanced Text Analysis Techniques · Text and Document Classification Technologies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Doctoral Program of Information Systems, School of Postgraduate Studies, Diponegoro University, Semarang 50275, Indonesia
Informatics Engineering, Faculty of Engineering, Universitas Muria Kudus, Kudus 59327, Indonesia
Department of Mathematics, Faculty of Science and Mathematics, Diponegoro University, Semarang 50275, Indonesia
Department of Informatics, Faculty of Science and Mathematics, Diponegoro University, Semarang 50275, Indonesia
References (36)
Show source-provided references
1. Evaluation of E-learning Activity Effectiveness in Higher Education Through Sentiment Analysis by Using Naïve Bayes Classifier10.24167/sisforma.v5i1.1450 ↗
2. Learning Analytics Intervention Improves Students’ Engagement in Online Learning10.1007/s10758-021-09547-w ↗
3. Kastrati, Z., Dalipi, F., Imran, A.S., Nuci, K.P., and Wani, M.A. (2021). Sentiment analysis of students’ feedback with nlp and deep learning: A systematic mapping study. Appl. Sci., 11.10.3390/app11093986 ↗
4. LSOIT: Lexicon and Syntax Enhanced Opinion Induction Tree for Aspect-based Sentiment Analysis10.1016/j.eswa.2023.121137 ↗
5. POS-ATAEPE-BiLSTM: An aspect-based sentiment analysis algorithm considering part-of-speech embedding10.1007/s10489-023-04952-3 ↗
6. Aspect-based sentiment analysis on student reviews using the Indo-Bert base model10.1051/e3sconf/202344802004 ↗
7. Flexibly utilizing syntactic knowledge in aspect-based sentiment analysis10.1016/j.ipm.2023.103630 ↗
8. Aspect based sentiment analysis using deep learning approaches: A survey10.1016/j.cosrev.2023.100576 ↗
9. Optimizing aspect-based sentiment analysis using sentence embedding transformer, bayesian search clustering, and sparse attention mechanism10.1016/j.joitmc.2024.100211 ↗
10. Chamid, A.A., and Kusumaningrum, R. (2022). Graph-Based Semi-Supervised Deep Learning for Indonesian Aspect-Based Sentiment Analysis. Big Data Cogn. Comput., 7.10.3390/bdcc7010005 ↗
11. Auto Labeling to Increase Aspect-Based Sentiment Analysis Using K-Nearest Neighbors Method10.1051/e3sconf/202235905001 ↗
12. Sentiment analysis of student evaluation feedback using transformer-based language models
13. Penggunaan Algoritma Klasifikasi Terhadap Analisa Sentimen Pemindahan Ibukota Dengan Pelabelan Otomatis
14. Hybrid Models for Emotion Classification and Sentiment Analysis in Indonesian Language
15. Transformer based contextual text representation framework for intelligent information retrieval10.1016/j.eswa.2023.121629 ↗
16. Breaking down linguistic complexities: A structured approach to aspect-based sentiment analysis
17. Optimized neural attention mechanism for aspect-based sentiment analysis framework with optimal polarity-based weighted features10.1007/s10115-023-01998-0 ↗
18. Desaire, H., Isom, M., and Hua, D. (2024). Almost Nobody Is Using ChatGPT to Write Academic Science Papers (Yet). Big Data Cogn. Comput., 8.10.3390/bdcc8100133 ↗
19. Tsoulos, I.G., Charilogis, V., and Tsalikakis, D. (2024). Local Crossover: A New Genetic Operator for Grammatical Evolution. Algorithms, 17.10.3390/a17100461 ↗
20. Enhancing aspect-based sentiment analysis with BERT-driven context generation and quality filtering10.1016/j.nlp.2024.100077 ↗
21. Williams, L., Anthi, E., and Burnap, P. (2024). Comparing Hierarchical Approaches to Enhance Supervised Emotive Text Classification. Big Data Cogn. Comput., 8.10.3390/bdcc8040038 ↗
22. Perbandingan Kinerja Word Embedding Word2Vec, Glove, Dan Fasttext Pada Klasifikasi Teks10.33365/jtk.v14i2.732 ↗
23. SA-ASBA: A hybrid model for aspect-based sentiment analysis using synthetic attention in pre-trained language BERT model with extreme gradient boosting10.1007/s11227-022-04881-x ↗
24. Predictive intelligence in harmful news identification by BERT-based ensemble learning model with text sentiment analysis10.1016/j.ipm.2022.102872 ↗
25. Mitrov, G., Stanoev, B., Gievska, S., Mirceva, G., and Zdravevski, E. (2024). Combining Semantic Matching, Word Embeddings, Transformers, and LLMs for Enhanced Document Ranking: Application in Systematic Reviews. Big Data Cogn. Comput., 8.10.3390/bdcc8090110 ↗
26. Automatic Text Summarization Method Based on Improved TextRank Algorithm and K-Means Clustering10.1016/j.knosys.2024.111447 ↗
27. Li, C., Gao, F., Bu, J., Xu, L., Chen, X., Gu, Y., Shao, Z., Zheng, Q., Zhang, N., and Wang, Y. (2021). SentiPrompt: Sentiment Knowledge Enhanced Prompt-Tuning for Aspect-Based Sentiment Analysis. arXiv.
28. CoBERT: A Contextual BERT model for recommending employability profiles of information technology students in unstable developing countries10.1016/j.engappai.2023.106728 ↗
29. Solving combinatorial optimization problems over graphs with BERT-Based Deep Reinforcement Learning10.1016/j.ins.2022.11.073 ↗
30. BERT-PG: A two-branch associative feature gated filtering network for aspect sentiment classification10.1007/s10844-023-00785-1 ↗
31. BERT models for Brazilian Portuguese: Pretraining, evaluation and tokenization analysis10.1016/j.asoc.2023.110901 ↗
32. Sentiment analysis on labeled and unlabeled datasets using BERT architecture10.1007/s00500-023-08876-5 ↗
33. Muñoz, S., and Iglesias, C.Á. (2024). Exploiting Content Characteristics for Explainable Detection of Fake News. Big Data Cogn. Comput., 8.10.3390/bdcc8100129 ↗
34. MAbdelgwad, M., ASoliman, T.H., ITaloba, A., and Farghaly, M.F. (J. King Saud Univ. Comput. Inf. Sci., 2021). Arabic aspect based sentiment analysis using bidirectional GRU based models, J. King Saud Univ. Comput. Inf. Sci., in press.10.1016/j.jksuci.2021.08.030 ↗
35. Sentiment Analysis on a Large Indonesian Product Review Dataset10.20473/jisebi.10.1.167-178 ↗
36. Integrating graph embedding and neural models for improving transition-based dependency parsing