Aspect-Level Sentiment Analysis Based on Syntax-Aware and Graph Convolutional Networks
Source abstract
Abstract
Aspect-level sentiment analysis is a task of identifying and understanding the sentiment polarity of specific aspects of a sentence. In recent years, significant progress has been made in aspect-level sentiment analysis models based on graph convolutional neural networks. However, existing models still have some shortcomings, such as aspect-level sentiment analysis models based on graph convolutional networks not making full use of the information of specific aspects in a sentence and ignoring the enhancement of the model by external general knowledge of sentiment. In order to solve these problems, this paper proposes a sentiment analysis model based on the Syntax-Aware and Graph Convolutional Network (SAGCN). The model first integrates aspect-specific features into contextual information, and second incorporates external sentiment knowledge to enhance the model’s ability to perceive sentiment information. Finally, a multi-head self-attention mechanism and Point-wise Convolutional Transformer (PCT) are applied to capture the semantic information of the sentence. The semantic and syntactic information of the sentences are considered together. Experimental results on three benchmark datasets show that the SAGCN model is able to achieve superior performance compared to the benchmark methods.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Sentiment Analysis and Opinion Mining · Topic Modeling · Text and Document Classification Technologies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Computer and Communication, Lanzhou University of Technology, Lanzhou 730050, China
College of Information Technology, Shanghai Jianqiao University, Shanghai 201306, China
References (32)
Show source-provided references
1. Survey on aspect detection for aspect-based sentiment analysis10.1007/s10462-022-10252-y ↗
2. Aspect-level sentiment analysis based on position features using multilevel interactive bidirectional GRU and attention mechanism10.1155/2020/6689089 ↗
3. Sentiment Orientation of Text:bfsmPMI-SVM
4. Dubey, T., and Jain, A. (2019, January 6–8). Sentiment Analysis of Keenly Intellective Smart Phone Product Review Utilizing SVM Classification Technique. Proceedings of the 2019 10th International Conference on Computing, Communication and Networking Technologies (ICCCNT), Kanpur, India.10.1109/ICCCNT45670.2019.8944795 ↗
5. Liu, B., and Lane, I. (2016, January 8–12). Attention-Based Recurrent Neural Network Models for Joint Intent Detection and Slot Filling. Proceedings of the 17th Annual Conference of the International-Speech-Communication-Association (INTERSPEECH 2016), San Francisco, CA, USA.10.21437/Interspeech.2016-1352 ↗
6. Liang, B., Du, J., Xu, R., Li, B., and Huang, H. (2019). Context-aware embedding for targeted aspect-based sentiment analysis. arXiv.10.18653/v1/P19-1462 ↗
7. Sentence constituent-aware attention mechanism for end-to-end aspect-based sentiment analysis10.1007/s11042-022-12487-x ↗
8. Pennington, J., Socher, R., and Manning, C.D. (2014, January 25–29). Glove: Global Vectors for Word Representation. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), Doha, Qatar.10.3115/v1/D14-1162 ↗
9. Mikolov, T., Sutskever, I., Chen, K., Corrado, G., and Dean, J. (2013, January 5–10). Distributed Representations of Words and Phrases and Their Compositionality. Proceedings of the 27th Annual Conference on Neural Information Processing Systems, NIPS 2013, Lake Tahoe, NV, USA.
10. Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., and Stoyanov, V. (2019). Roberta: A robustly optimized bert pretraining approach. arXiv.
11. Zhang, C., Li, Q., and Song, D. (2019). Aspect-based sentiment classification with aspect-specific graph convolutional networks. arXiv.10.18653/v1/D19-1464 ↗
12. Huang, B., and Carley, K.M. (2019). Syntax-aware aspect level sentiment classification with graph attention networks. arXiv.10.18653/v1/D19-1549 ↗
13. GL-GCN: Global and Local Dependency Guided Graph Convolutional Networks for aspect-based sentiment classification10.1016/j.eswa.2021.115712 ↗
14. Sun, K., Zhang, R., Mensah, S., Mao, Y., and Liu, X. (2019, January 3–7). Aspect-Level Sentiment Analysis via Convolution over Dependency Tree. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), Hong Kong, China.10.18653/v1/D19-1569 ↗
15. Aspect-based sentiment analysis via affective knowledge enhanced graph convolutional networks10.1016/j.knosys.2021.107643 ↗
16. Enhancing aspect-based sentiment analysis using a dual-gated graph convolutional network via contextual affective knowledge10.1016/j.neucom.2023.126526 ↗
17. Tang, D., Qin, B., Feng, X., and Liu, T. (2015). Effective LSTMs for target-dependent sentiment classification. arXiv.
18. Wang, Y., Huang, M., Zhu, X., and Zhao, L. (2016, January 1–5). Attention-Based LSTM for Aspect-Level Sentiment Classification. Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, Austin, TX, USA.10.18653/v1/D16-1058 ↗
19. Tang, D., Qin, B., and Liu, T. (2016). Aspect level sentiment classification with deep memory network. arXiv.10.18653/v1/D16-1021 ↗
20. Ma, D., Li, S., Zhang, X., and Wang, H. (2017). Interactive attention networks for aspect-level sentiment classification. arXiv.10.24963/ijcai.2017/568 ↗
21. DNet: A lightweight and efficient model for aspect based sentiment analysis10.1016/j.eswa.2020.113393 ↗
22. Co-attention networks based on aspect and context for aspect-level sentiment analysis10.1016/j.knosys.2021.106810 ↗
23. Zhang, M., and Qian, T. (2020, January 16–20). Convolution over Hierarchical Syntactic and Lexical Graphs for Aspect Level Sentiment Analysis. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), Online.10.18653/v1/2020.emnlp-main.286 ↗
24. Tian, Y., Chen, G., and Song, Y. (2021, January 6–11). Aspect-Based Sentiment Analysis with Type-Aware Graph Convolutional Networks and Layer Ensemble. Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Online.10.18653/v1/2021.naacl-main.231 ↗
25. Zhang, Z., Ma, Z., Cai, S., Chen, J., and Xue, Y. (2022). Knowledge-Enhanced Dual-Channel GCN for Aspect-Based Sentiment Analysis. Mathematics, 10.10.3390/math10224273 ↗
26. Li, R., Chen, H., Feng, F., Ma, Z., Wang, X., and Hovy, E. (2021, January 1–6). Dual Graph Convolutional Networks for Aspect-Based Sentiment Analysis. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), Online.10.18653/v1/2021.acl-long.494 ↗
27. Song, Y., Wang, J., Jiang, T., Liu, Z., and Rao, Y. (2019). Attentional encoder network for targeted sentiment classification. arXiv.10.1007/978-3-030-30490-4_9 ↗
28. Kipf, T.N., and Welling, M. (2016). Semi-supervised classification with graph convolutional networks. arXiv.
29. Semantics perception and refinement network for aspect-based sentiment analysis10.1016/j.knosys.2021.106755 ↗
30. Pontiki, M., Papageorgiou, H., Galanis, D., Androutsopoulos, I., Pavlopoulos, J., and Manandhar, S. (2014, January 23–24). SemEval-2014 Task 4: Aspect Based Sentiment Analysis. Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014), Dublin, Ireland.10.3115/v1/S14-2004 ↗
31. Dong, L., Wei, F., Tan, C., Tang, D., Zhou, M., and Xu, K. (2014, January 23–24). Adaptive Recursive Neural Network for Target-Dependent Twitter Sentiment Classification. Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), Baltimore, MD, USA.10.3115/v1/P14-2009 ↗
32. Wang, K., Shen, W., Yang, Y., Quan, X., and Wang, R. (2020). Relational graph attention network for aspect-based sentiment analysis. arXiv.10.18653/v1/2020.acl-main.295 ↗