journal article·2023-09-03Open access

A Novel Bi-Dual Inference Approach for Detecting Six-Element Emotions

Xiaoping Huang, Yujian Zhou, Yajun Du

Applied Sciences· Volume 13· Issue 17

Abstract

In recent years, there has been rapid development in machine learning for solving artificial intelligence tasks in various fields, including translation, speech, and image processing. These AI tasks are often interconnected rather than independent. One specific type of relationship is known as structural duality, which exists between multiple pairs of artificial intelligence tasks. The concept of dual learning has gained significant attention in the fields of machine learning, computer vision, and natural language processing. Dual learning involves using primitive tasks (mapping from domains X to Y) and dual tasks (mapping from domains Y to X) to enhance the performance of both tasks. In this study, we propose a general framework called Bi-Dual Inference by combining the principles of dual inference and dual learning. Our framework generates multiple dual models and a primal model by utilizing two dual tasks: sentiment analysis of input text and sentence generation of sentiment labels. We create these model pairs (primal model f, dual model g) by employing different initialization seeds and data access sequences. Each primal and dual model is considered as a distinct LSTM model. By reasoning about a single task with multiple similar models in the same direction, our framework achieves improved classification results. To validate the effectiveness of our proposed model, we conduct experiments on two datasets, namely NLPCC2013 and NLPCC2014. The results demonstrate that our model outperforms the optimal baseline model in terms of the F1 score, achieving an improvement of approximately 5%. Additionally, we provide parameter values for our proposed model, including model iteration analysis, α parameter analysis, λ parameter analysis, batch size analysis, training sentence length analysis, and hidden layer size setting. These experimental results further confirm the effectiveness of our proposed model.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Sentiment Analysis and Opinion Mining · Text and Document Classification Technologies · Topic Modeling

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Computer and Software Engineering, Xihua University, Chengdu 610039, China

Funding

Science and Technology Department of Sichuan Province · National Natural Science Foundation of China

References (45)

Show source-provided references
1. Baccianella, S., Esuli, A., and Sebastiani, F. (2010, January 17–23). SENTIWORDNET 3.0: An enhanced lexical resource for sentiment analysis and opinion mining. Proceedings of the 7th International Conference on Language Resources and Evaluation (LREC’10), Valletta, Malta.
2. Emotion detection in suicide notes10.1016/j.eswa.2013.05.050 ↗
3. A hybrid model for opinion mining based on domain sentiment dictionary10.1007/s13042-017-0757-6 ↗
4. Lexicon based feature extraction for emotion text classification10.1016/j.patrec.2016.12.009 ↗
5. Lexicon-Based Methods for Sentiment Analysis10.1162/COLI_a_00049 ↗
6. Wu, Y., Kang, X., Matsumoto, K., Yoshida, M., Xielifuguli, K., and Kita, K. (2018, January 24–27). Sentence Emotion Classification for Intelligent Robotics Based on Word Lexicon and Emoticon Emotions. Proceedings of the IEEE International Conference of Intelligent Robotic and Control Engineering (IRCE), Lanzhou, China.10.1109/IRCE.2018.8492969 ↗
7. A method for multi-class sentiment classification based on an improved one-vs-one (OVO) strategy and the support vector machine (SVM) algorithm10.1016/j.ins.2017.02.016 ↗
8. A sentiment classification model based on multiple classifiers10.1016/j.asoc.2016.11.022 ↗
9. Eko Soelistio, Y., and Martinus, R.S.S. (2015). Simple Text Mining for Sentiment Analysis of Political Figure Using Naive Bayes Classifier Method. arXiv.
10. Ouyang, X., Zhou, P., Li, C.H., and Liu, L. (2015, January 21–23). Sentiment Analysis Using Convolutional Neural Network. Proceedings of the IEEE International Conference on Computer and Information Technology, Dhaka, Bangladesh.10.1109/CIT/IUCC/DASC/PICOM.2015.349 ↗
11. Santos, C.N.D., and Gattit, M. (2014, January 23–29). Deep Convolutional Neural Networks for Sentiment Analysis of Short Texts. Proceedings of the International Conference on Computational Linguistics, Dublin, Ireland.
12. Sentiment Classification using Machine Learning Techniques
13. Sentiment Analysis Approach based N-gram and KNN Classifier
14. Pang, B. (2002, January 6–7). Thumbs up? Sentiment Classification Using Machine Learning Techniques. Proceedings of the EMNLP, Philadelphia, PA, USA.10.3115/1118693.1118704 ↗
15. Sentiment Analysis on Twitter Data using KNN and SVM
16. Twitter discussions and concerns about COVID-19 pandemic: Twitter data analysis using a machine learning approach10.2196/20550 ↗
17. Liu, L., Feng, S., Wang, D., and Zhang, Y. (2016, January 2–6). An Empirical Study on Chinese Microblog Stance Detection Using Supervised and Semi-supervised Machine Learning Methods. Proceedings of the International Conference on Computer Processing of Oriental Languages; CCF Conference on Natural Language Processing and Chinese Computing, Kunming, China.10.1007/978-3-319-50496-4_68 ↗
18. Microblog Sentiment Analysis with Emoticon Space Model10.1007/s11390-015-1587-1 ↗
19. Gopalakrishnan, K., and Salem, F.M. (2020). Sentiment Analysis Using Simplified Long Short-term Memory Recurrent Neural Networks. arXiv.
20. Constructing domain-dependent sentiment dictionary for sentiment analysis10.1007/s00521-020-04824-8 ↗
21. A new hybrid-parameter recurrent neural network for online handwritten chinese character recognition10.1016/j.patrec.2019.10.001 ↗
22. Himeno, S., and Aono, M. (2018, January 5–6). KDE-AFFECT at SemEval-2018 Task 1: Estimation of Affects in Tweet by Using Convolutional Neural Network for n-gram. Proceedings of the 12th International Workshop on Semantic Evaluation 2018, New Orleans, LA, USA.
23. Can, E.F., Ezen-Can, A., and Can, F. (2018). Multilingual Sentiment Analysis: An RNN-Based Framework for Limited Data. arXiv.
24. A Convolutional Neural Network for Aspect-Level Sentiment Classification10.1142/S0218001419590468 ↗
25. BiLSTM with Multi-Polarity Orthogonal Attention for Implicit Sentiment Analysis10.1016/j.neucom.2019.11.054 ↗
26. Mikolov, T., Chen, K., Corrado, G., and Dean, J. (2013). Efficient estimation of word representations in vector space. arXiv.
27. Context-aware emotion cause analysis with multi-attention-based neural network10.1016/j.knosys.2019.03.008 ↗
28. de Bruyne, L., de Clercq, O., and Hoste, V. (2018, January 5–6). LT3 at SemEval-2018 Task 1: A classifier chain to detect emotions in tweets. Proceedings of the 12th International Workshop on Semantic Evaluation, New Orleans, LA, USA.10.18653/v1/S18-1016 ↗
29. Turcu, R.A., Amarandei, S.M., Flescan-Lovin-Arseni, I.A., Gifu, D., and Trandabat, D. (2018, January 5–6). EmoIntens Tracker at SemEval-2018 Task 1: Emotional Intensity Levels in Tweets. Proceedings of the 12th International Workshop on Semantic Evaluation 2018, New Orleans, LA, USA.10.18653/v1/S18-1026 ↗
30. Rajabi, Z., Shehu, A., and Uzuner, O. (2020, January 3–5). A Multi-channel BiLSTM-CNN Model for Multilabel Emotion Classification of Informal Text. Proceedings of the 14th IEEE International conference semantic computing, San Diego, CA, USA.10.1109/ICSC.2020.00060 ↗
31. Lu, K., and Wu, J. (2019, January 15–18). Sentiment analysis of film review texts based on sentiment dictionary and SVM. Proceedings of the 3rd International Conference on Innovation in Artificial Intelligence, Suzhou, China.10.1145/3319921.3319966 ↗
32. Exploration of social media for sentiment analysis using deep learning10.1007/s00500-019-04402-8 ↗
33. A hierarchical approach to mood classification in blogs10.1017/S1351324911000118 ↗
34. Mukwazvure, A., and Supreethi, K. (2015, January 2–4). A hybrid approach to sentiment analysis of news comments. Proceedings of the 4th International Conference on Reliability, Infocom Technologies and Optimization (ICRITO) (Trends and Future Directions), Noida, India.10.1109/ICRITO.2015.7359282 ↗
35. Esmin, A.A., De Oliveira, R.L., and Matwin, S. (2012, January 12–15). Hierarchical classification approach to emotion recognition in twitter. Proceedings of the 11th International Conference on Machine Learning and Applications 2012, Boca Raton, FL, USA.10.1109/ICMLA.2012.195 ↗
36. Xia, Y., Qin, T., Chen, W., Bian, J., Yu, N., and Liu, T.Y. (2017, January 6–11). Dual Supervised Learning. Proceedings of the International Conference on Machine Learning 2017, Sydney, Australia.10.24963/ijcai.2017/434 ↗
37. Xia, Y., Bian, J., Qin, T., Yu, N., and Liu, T.Y. (2017, January 19–25). Dual Inference for Machine Learning. Proceedings of the 26th International Joint Conference on Artificial Intelligence, Melbourne, Australia.10.24963/ijcai.2017/434 ↗
38. Xia, Y., Tan, X., Tian, F., Qin, T., Yu, N., and Liu, T.Y. (2018, January 10–15). Model-Level Dual Learning. Proceedings of the International Conference on Machine Learning, Stockholm, Sweden.10.24963/ijcai.2017/434 ↗
39. Dai, A.M., and Le, Q.V. (2015). Semi-Supervised Learning with Heterophily. arXiv.
40. Wang, T., and Cho, K. (2016, January 7–12). Larger-context language modelling with recurrent neural network. Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, Berlin, Germany.10.18653/v1/P16-1125 ↗
41. He, D., Xia, Y., Qin, T., Wang, L., Yu, N., Liu, T.Y., and Ma, W.Y. (2016, January 5–10). Dual learning for machine translation. Proceedings of the Advances in Neural Information Processing Systems 2016, Barcelona, Spain.
42. Long short-term memory10.1162/neco.1997.9.8.1735 ↗
43. Hybrid Neural Network for Sina Weibo Sentiment Analysis10.1109/TCSS.2020.2998092 ↗
44. A Context-Aware Gated Recurrent Units with Self-Attention for Emotion Recognition10.1088/1742-6596/1880/1/012026 ↗
45. Multilingual Text Emotional Analysis Model MF-CSEL