journal article·2024Open access

Improve Chinese Aspect Sentiment Quadruplet Prediction via Instruction Learning Based on Large Generate Models

Zhaoliang Wu, Yuewei Wu, Xiaoli Feng, Jiajun Zou, Fulian Yin

Computers, Materials & Continua· Volume 78· Issue 3

Abstract

Aspect-Based Sentiment Analysis (ABSA) is a fundamental area of research in Natural Language Processing (NLP). Within ABSA, Aspect Sentiment Quad Prediction (ASQP) aims to accurately identify sentiment quadruplets in target sentences, including aspect terms, aspect categories, corresponding opinion terms, and sentiment polarity. However, most existing research has focused on English datasets. Consequently, while ASQP has seen significant progress in English, the Chinese ASQP task has remained relatively stagnant. Drawing inspiration from methods applied to English ASQP, we propose Chinese generation templates and employ prompt-based instruction learning to enhance the model’s understanding of the task, ultimately improving ASQP performance in the Chinese context. Ultimately, under the same pre-training model configuration, our approach achieved a 5.79% improvement in the F1 score compared to the previously leading method. Furthermore, when utilizing a larger model with reduced training parameters, the F1 score demonstrated an 8.14% enhancement. Additionally, we suggest a novel evaluation metric based on the characteristics of generative models, better-reflecting model generalization. Experimental results validate the effectiveness of our approach.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Sentiment Analysis and Opinion Mining · Text and Document Classification Technologies · Computational and Text Analysis Methods

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (54)

Show source-provided references
1. A survey on aspect-based sentiment analysis: Tasks, methods, and challenges10.1109/TKDE.2022.3230975 ↗
2. Unsupervised word and dependency path embeddings for aspect term extraction
3. Deep multi-task learning for aspect term extraction with memory interaction
4. Aspect term extraction with history attention and selective transformation
5. An unsupervised neural attention model for aspect extraction
6. Unsupervised neural aspect extraction with sememes
7. LICD: A language-independent approach for aspect category detection
8. Attention based LSTM for aspect-level sentiment classification
9. Aspect based sentiment analysis with gated convolutional networks
10. Learning to attend via word-aspect associative fusion for aspect-based sentiment analysis
11. Global inference for aspect and opinion terms co-extraction based on multi-task neural networks10.1109/TASLP.2018.2875170 ↗
12. Deep weighted maxsat for aspect-based opinion extraction
13. Introducing syntactic structures into target opinion word extraction with deep learning
14. Target oriented opinion words extraction with target-fused neural sequence labeling
15. Synchronous double-channel recurrent network for aspect-opinion pair extraction
16. SpanMlt: A span-based multi-task learning framework for pair-wise aspect and opinion terms extraction
17. Relation-aware collaborative learning for unified aspect-based sentiment analysis
18. A multi-task incremental learning framework with category name embedding for aspect-category sentiment analysis
19. Grid tagging scheme for aspect-oriented fine-grained opinion extraction
20. Position-aware tagging for aspect sentiment triplet extraction
21. Towards generative aspect-based sentiment analysis
22. Multiple-element joint detection for aspect based sentiment analysis10.1016/j.knosys.2021.107073 ↗
23. Aspect-category-opinion sentiment quadruple extraction with implicit aspects and opinions
24. Aspect sentiment quad prediction as paraphrase generation
25. E. J. Hu et al., “LoRA: Low-rank adaptation of large language models,” arXiv:2106.09685, 2021.
26. Prefix-tuning: Optimizing continuous prompts for generation
27. Q. Zhang et al., “AdaLoRA: Adaptive budget allocation for parameter-efficient fine-tuning,” arXiv:2303.10512, 2023.
28. W. Zhen, R. Panda, L. Karlinsky, R. Feris, H. Sun and Y. Kim, “Multitask prompt tuning enables parameter-efficient transfer learning,” arXiv:2303.02861, 2023.
29. Towards unified INT8 training for convolutional neural network
30. Improving aspect sentiment quad prediction via template-order data augmentation
31. MVP: Multi-view prompting improves aspect sentiment tuple prediction
32. Representing text chunks
33. Conditional random fields: Probabilistic models for segmenting and labeling sequence data
34. Long short-term memory10.1007/978-3-642-24797-2_4 ↗
35. Fine-grained opinion mining with recurrent neural networks and word embeddings
36. Double embeddings and cnn-based sequence labeling for aspect extraction
37. Knowing what, how and why: A near complete solution for aspect-based sentiment analysis
38. Learn from syntax: Improving pair-wise aspect and opinion terms extraction with rich syntactic knowledge
39. Learning multi-grained aspect target sequence for Chinese sentiment analysis10.1016/j.knosys.2018.02.034 ↗
40. A multi-task learning model for chinese-oriented aspect polarity classification and aspect term extraction10.1016/j.neucom.2020.08.001 ↗
41. A local and global context focus multilingual learning model for aspect-based sentiment analysis10.1109/ACCESS.2022.3197218 ↗
42. POS-ATAEPE-BiLSTM: An aspect-based sentiment analysis algorithm considering part-of-speech embedding10.1007/s10489-023-04952-3 ↗
43. Attention is all you need
44. J. Devlin, M. W. Chang, L. Lee, and K. Toutanova, “BERT: Pre-training of deep bidirectional transformers for language understanding,” arXiv:1810.04805, 2018.
45. Utilizing BERT for aspect-based sentiment analysis via constructing auxiliary sentence
46. Question-driven span labeling model for aspect-opinion pair extraction
47. Bidirectional machine reading comprehension for aspect sentiment triplet extraction
48. A joint training dual-MRC framework for aspect based sentiment analysis
49. Exploring the limits of transfer learning with a unified text-totext transformer
50. H. Touvron, T. Lavril, G. Izacard, X. Martinet, and M. Lachaux, “LLaMA: Open and efficient foundation language model,” arXiv:2302.13971, 2023.
51. H. Touvron, L. Martin, K. Stone, P. Albert, and A. Almahairi, “Llama 2: Open foundation and fine-tuned chat models,” arXiv:2307.09288, 2023.
52. Language models are unsupervised multitask learners
53. Language models are few-shot learners
54. Crosslingual generalization through multitask finetuning