Weibo Text Sentiment Analysis Based on BERT and Deep Learning
Source abstract
Abstract
With the rapid increase of public opinion data, the technology of Weibo text sentiment analysis plays a more and more significant role in monitoring network public opinion. Due to the sparseness and high-dimensionality of text data and the complex semantics of natural language, sentiment analysis tasks face tremendous challenges. To solve the above problems, this paper proposes a new model based on BERT and deep learning for Weibo text sentiment analysis. Specifically, first using BERT to represent the text with dynamic word vectors and using the processed sentiment dictionary to enhance the sentiment features of the vectors; then adopting the BiLSTM to extract the contextual features of the text, the processed vector representation is weighted by the attention mechanism. After weighting, using the CNN to extract the important local sentiment features in the text, finally the processed sentiment feature representation is classified. A comparative experiment was conducted on the Weibo text dataset collected during the COVID-19 epidemic; the results showed that the performance of the proposed model was significantly improved compared with other similar models.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Sentiment Analysis and Opinion Mining · Advanced Text Analysis Techniques · Text and Document Classification Technologies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Computer and Communication Engineering, Zhengzhou University of Light Industry, Zhengzhou 450002, China
References (34)
Show source-provided references
1. COVID-19 sensing: Negative sentiment analysis on social media in China via BERT model10.1109/ACCESS.2020.3012595 ↗
2. Semi-supervised learning for big social data analysis10.1016/j.neucom.2017.10.010 ↗
3. Asghar, M.Z., Khan, A., Ahmad, S., Qasim, M., and Khan, I.A. (2017). Lexicon-enhanced sentiment analysis framework using rule-based classification scheme. PLoS ONE, 12.10.1371/journal.pone.0171649 ↗
4. A comprehensive survey on sentiment analysis: Approaches, challenges and trends10.1016/j.knosys.2021.107134 ↗
5. From pixels to sentiment: Fine-tuning CNNs for visual sentiment prediction10.1016/j.imavis.2017.01.011 ↗
6. A survey of multilingual neural machine translation10.1145/3406095 ↗
7. Tai, K.S., Socher, R., and Manning, C.D. (2015). Improved semantic representations from tree-structured long short-term memory networks. arXiv.10.3115/v1/P15-1150 ↗
8. Sentiment classification using a single-layered BiLSTM model10.1109/ACCESS.2020.2988550 ↗
9. Constructing domain-dependent sentiment dictionary for sentiment analysis10.1007/s00521-020-04824-8 ↗
10. Sentiment analysis of Chinese micro-blog text based on extended sentiment dictionary10.1016/j.future.2017.09.048 ↗
11. Senti-N-Gram: An n-gram lexicon for sentiment analysis10.1016/j.eswa.2018.03.004 ↗
12. Generate domain-specific sentiment lexicon for review sentiment analysis10.1007/s11042-017-5529-5 ↗
13. Automatic construction of target-specific sentiment lexicon10.1016/j.eswa.2018.09.024 ↗
14. BiLSTM with multi-polarity orthogonal attention for implicit sentiment analysis10.1016/j.neucom.2019.11.054 ↗
15. A sentiment information collector–extractor architecture based neural network for sentiment analysis10.1016/j.ins.2018.08.026 ↗
16. Two-Level LSTM for Sentiment Analysis With Lexicon Embedding and Polar Flipping
17. Liang, D., and Zhang, Y. (2016). AC-BLSTM: Asymmetric convolutional bidirectional LSTM networks for text classification. arXiv.
18. ABCDM: An attention-based bidirectional CNN-RNN deep model for sentiment analysis10.1016/j.future.2020.08.005 ↗
19. González, J.A., Pla, F., and Hurtado, L.F. (2017, January 3–4). ELiRF-UPV at SemEval-2017 task 4: Sentiment analysis using deep learning. Proceedings of the 11th International Workshop on Semantic Evaluation (SEMEVAL-2017), Vancouver, BC, Canada.10.18653/v1/S17-2121 ↗
20. A Knowledge-Based Deep Learning Architecture for Aspect-Based Sentiment Analysis10.1142/S0129065721500465 ↗
21. Alexandridis, G., Varlamis, I., Korovesis, K., Caridakis, G., and Tsantilas, P. (2021). A Survey on Sentiment Analysis and Opinion Mining in Greek Social Media. Information, 12.10.3390/info12080331 ↗
22. TWilBert: Pre-trained deep bidirectional transformers for Spanish Twitter10.1016/j.neucom.2020.09.078 ↗
23. Knowledge-enabled BERT for aspect-based sentiment analysis10.1016/j.knosys.2021.107220 ↗
24. BERT: A sentiment analysis odyssey10.1057/s41270-021-00109-8 ↗
25. Heuristic-Assisted BERT for Twitter Sentiment Analysis10.1142/S1469026821500152 ↗
26. Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2018). Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv.
27. Sentiment analysis about investors and consumers in energy market based on BERT-BiLSTM10.1109/ACCESS.2020.3024750 ↗
28. Combining attention-based bidirectional gated recurrent neural network and two-dimensional convolutional neural network for document-level sentiment classification10.1016/j.neucom.2019.09.012 ↗
29. Bidirectional LSTM with attention mechanism and convolutional layer for text classification10.1016/j.neucom.2019.01.078 ↗
30. Mao, X., Chang, S., Shi, J., Li, F., and Shi, R. (2019). Sentiment-Aware Word Embedding for Emotion Classification. Appl. Sci., 9.10.3390/app9071334 ↗
31. Batch normalization: Accelerating deep network training by reducing internal covariate shift
32. Kim, Y. (2014). Convolutional neural networks for sentence classification. arXiv.10.3115/v1/D14-1181 ↗
33. Shin, B., Lee, T., and Choi, J.D. (2016). Lexicon integrated cnn models with attention for sentiment analysis. arXiv.10.18653/v1/W17-5220 ↗
34. Self-attention-based BiLSTM model for short text fine-grained sentiment classification10.1109/ACCESS.2019.2957510 ↗