Multiple Interactive Attention Networks for Aspect-Based Sentiment Classification
Source abstract
Abstract
Aspect-Based (also known as aspect-level) Sentiment Classification (ABSC) aims at determining the sentimental tendency of a particular target in a sentence. With the successful application of the attention network in multiple fields, attention-based ABSC has aroused great interest. However, most of the previous methods are difficult to parallelize, insufficiently obtain, and fuse the interactive information. In this paper, we proposed a Multiple Interactive Attention Network (MIN). First, we used the Bidirectional Encoder Representations from Transformers (BERT) model to pre-process the data. Then, we used the partial transformer to obtain a hidden state in parallel. Finally, we took the target word and the context word as the core to obtain and fuse the interactive information. Experimental results on the different datasets showed that our model was much more effective.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Sentiment Analysis and Opinion Mining · Advanced Text Analysis Techniques · Text and Document Classification Technologies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Information Science and Electrical Engineering, Shandong Jiao Tong University, Jinan 250357, China
Funding
National Social Science Foundation · Science Foundation of Ministry of Education of China · Shandong Provincial Social Science Planning Project
References (34)
Show source-provided references
1. Maria Pontiki, D.G., John Pavlopoulos, H.P., and Ion Androutsopoulos, S.M. (2014, January 23–24). Semeval-2014 task 4: SemEval-2014 Task 4: Aspect Based Sentiment Analysis. Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014), Dublin, Ireland.10.3115/v1/S14-2004 ↗
2. Pontiki, M., Galanis, D., Papageorgiou, H., Androutsopoulos, I., Manandhar, S., Mohammad, A.S., Al-Ayyoub, M., Zhao, Y., Qin, B., and De Clercq, O. (2016, January 16–17). Semeval-2016 task 5: Aspect based sentiment analysis. Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval-2016), San Diego, CA, USA.10.18653/v1/S16-1002 ↗
3. Sentiment analysis and opinion mining: A survey
4. Liu, P., Qiu, X., and Huang, X. (2016, January 9–15). Recurrent neural network for text classification with multi-task learning. Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, New York, NY, USA.
5. Mikolov, T., Karafiát, M., Burget, L.Š., Černocký, J., and Khudanpur, S. (2010, January 26–30). Recurrent neural network based language model. Proceedings of the Eleventh Annual Conference of the International Speech Communication Association, Makuhari, Chiba, Japan.10.21437/Interspeech.2010-343 ↗
6. Bahdanau, D., Cho, K., and Bengio, Y. (2014). Neural Machine Translation by Jointly Learning to Align and Translate. arXiv.
7. Firat, O., Cho, K., and Bengio, Y. (2016, January 12–17). Multi-way, multilingual neural machine translation with a shared attention mechanism. Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, San Diego, CA, USA.10.18653/v1/N16-1101 ↗
8. Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (, January 2–7). Bert: Pretraining of deep bidirectional transformers for language understanding. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Minneapolis, Minnesota.
9. Read, J. (2005, January 27). Using emoticons to reduce dependency in machine learning techniques for sentiment classification. Proceedings of the ACL Student Research Workshop, Ann Arbor, MI, USA.10.3115/1628960.1628969 ↗
10. Duwairi, R.M., and Qarqaz, I. (2014, January 27–29). Arabic sentiment analysis using supervised classification. Proceedings of the 2014 International Conference on Future Internet of Things and Cloud, Barcelona, Spain.10.1109/FiCloud.2014.100 ↗
11. Narayanan, V., Arora, I., and Bhatia, A. (2013, January 20–23). Fast and accurate sentiment classification using an enhanced Naive Bayes model. Proceedings of the Intelligent Data Engineering and Automated Learning—IDEAL 2013, Hefei, China.10.1007/978-3-642-41278-3_24 ↗
12. Semi-supervised learning based distributed attack detection framework for IoT10.1016/j.asoc.2018.05.049 ↗
13. Social network security: Issues, challenges, threats, and solutions10.1016/j.ins.2017.08.063 ↗
14. Tang, D., Qin, B., Feng, X., and Liu, T. (2016, January 11–17). Effective LSTMs for Target-Dependent Sentiment Classification. Proceedings of the COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, Osaka, Japan.
15. Zheng, J., Cai, F., Shao, T., and Chen, H. (2018). Self-interaction attention mechanism-based text representation for document classification. Appl. Sci., 8.10.3390/app8040613 ↗
16. Wang, Y., Huang, M., and Zhao, L. (2016, January 1–5). Attention-based LSTM for aspect-level sentiment classification. Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, Austin, TX, USA.10.18653/v1/D16-1058 ↗
17. Tang, D., Qin, B., and Liu, T. (2016, January 1–5). Aspect Level Sentiment Classification with Deep Memory Network. Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, Austin, TX, USA.10.18653/v1/D16-1021 ↗
18. Ma, D., Li, S., Zhang, X., and Wang, H. (2017, January 19–25). Interactive attention networks for aspect-level sentiment classification. Proceedings of the 26th International Joint Conference on Artificial Intelligence, Melbourne, Australia.10.24963/ijcai.2017/568 ↗
19. Gu, S., Zhang, L., Hou, Y., and Song, Y. (2018, January 20–26). A position-aware bidirectional attention network for aspect-level sentiment analysis. Proceedings of the 27th International Conference on Computational Linguistics, Santa Fe, NM, USA.
20. Tang, J., Lu, Z., Su, J., Ge, Y., Song, L., Sun, L., and Luo, J. (August, January 28). Progressive Self-Supervised Attention Learning for Aspect-Level Sentiment Analysis. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics(ACL 2019), Florence, Italy.10.18653/v1/P19-1053 ↗
21. Chung, J., Gulcehre, C., Cho, K.H., and Bengio, Y. (2014). Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling. arXiv.
22. Kim, H., and Jeong, Y.S. (2019). Sentiment Classification Using Convolutional Neural Networks. Appl. Sci., 9.10.3390/app9112347 ↗
23. Lee, J., Park, J., Kim, K., and Nam, J. (2018). Samplecnn: End-to-end deep convolutional neural networks using very small filters for music classification. Appl. Sci., 8.10.3390/app8010150 ↗
24. Zhang, S., Zhang, X., Wang, H., Cheng, J., Li, P., and Ding, Z. (2017). Chinese medical question answer matching using end-to-end character-level multi-scale CNNs. Appl. Sci., 7.10.3390/app7080767 ↗
25. Parikh, A.P., Täckström, O., and Das, D. (2016, January 1–4). Uszkoreit. A decomposable attention model for natural language inference. Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing (EMNLP 2016), Austin, TX, USA.10.18653/v1/D16-1244 ↗
26. Wagner, J., Arora, P., Cortes, S., Barman, U., Bogdanova, D., Foster, J., and Tounsi, L. (2014, January 23–24). Dcu: Aspect-based polarity classification for semeval task 4. Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014), Dublin, Ireland.10.3115/v1/S14-2036 ↗
27. Developing a successful SemEval task in sentiment analysis of Twitter and other social media texts10.1007/s10579-015-9328-1 ↗
28. Pontiki, M., Galanis, D., Papageorgiou, H., Manandhar, S., and Androutsopoulos, I. (2015, January 4–5). 2015.Semeval-2015 task 12: Aspect based sentiment analysis. Proceedings of the 9th International Workshop on Semantic Evaluation (SemEval 2015), Denver, CO, USA.10.18653/v1/S15-2082 ↗
29. Wang, Q., Liu, P., Zhu, Z., Yin, H., Zhang, Q., and Zhang, L. (2019). A Text Abstraction Summary Model Based on BERT Word Embedding and Reinforcement Learning. Appl. Sci., 9.10.3390/app9214701 ↗
30. Lipton, Z.C., Elkan, C., and Naryanaswamy, B. (2014, January 15–19). Optimal thresholding of classifiers to maximize F1 measure. Proceedings of the Joint European Conference on Machine Learning and Knowledge Discovery in Databases(ECML PKDD 2014), Nancy, France.10.1007/978-3-662-44851-9_15 ↗
31. Li, X., Bing, L., Lam, W., and Shi, B. (2018, January 15–20). Transformation Networks for Target-Oriented Sentiment Classification. Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, Melbourne, Australia.10.18653/v1/P18-1087 ↗
32. Xu, H., Liu, B., Shu, L., and Philip, S.Y. (2019, January 2–7). BERT Post-Training for Review Reading Comprehension and Aspect-based Sentiment Analysis. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Minneapolis, MN, USA.
33. Sun, K., Zhang, R., Mensah, S., Mao, Y., and Liu, X. (2019, January 3–7). Aspect-Level Sentiment Analysis via Convolution over Dependency Tree. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, Hong Kong, China.10.18653/v1/D19-1569 ↗
34. Zhang, C., Li, Q., and Song, D. (2019, January 3–7). Aspect-based Sentiment Classification with Aspect-specific Graph Convolutional Networks. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, Hong Kong, China.10.18653/v1/D19-1464 ↗