journal article·2023Open access

A Semi-Supervised Approach for Aspect Category Detection and Aspect Term Extraction from Opinionated Text

Bishrul Haq, Sher Muhammad Daudpota, Ali Shariq Imran, Zenun Kastrati, Waheed Noor

Computers, Materials & Continua· Volume 77· Issue 1

Abstract

The Internet has become one of the significant sources for sharing information and expressing users’ opinions about products and their interests with the associated aspects. It is essential to learn about product reviews; however, to react to such reviews, extracting aspects of the entity to which these reviews belong is equally important. Aspect-based Sentiment Analysis (ABSA) refers to aspects extracted from an opinionated text. The literature proposes different approaches for ABSA; however, most research is focused on supervised approaches, which require labeled datasets with manual sentiment polarity labeling and aspect tagging. This study proposes a semi-supervised approach with minimal human supervision to extract aspect terms by detecting the aspect categories. Hence, the study deals with two main sub-tasks in ABSA, named Aspect Category Detection (ACD) and Aspect Term Extraction (ATE). In the first sub-task, aspects categories are extracted using topic modeling and filtered by an oracle further, and it is fed to zero-shot learning as the prompts and the augmented text. The predicted categories are the input to find similar phrases curated with extracting meaningful phrases (e.g., Nouns, Proper Nouns, NER (Named Entity Recognition) entities) to detect the aspect terms. The study sets a baseline accuracy for two main sub-tasks in ABSA on the Multi-Aspect Multi-Sentiment (MAMS) dataset along with SemEval-2014 Task 4 sub-task 1 to show that the proposed approach helps detect aspect terms via aspect categories.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Sentiment Analysis and Opinion Mining · Advanced Text Analysis Techniques · Web Data Mining and Analysis

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (73)

Show source-provided references
1. W. Zhang, X. Li, Y. Deng, L. Bing and W. Lam, “A survey on aspect-based sentiment analysis: Tasks, methods, and challenges,” arXiv Prepr. arXiv2203.01054, 2022.
2. Optimal machine learning driven sentiment analysis on COVID-19 twitter data10.32604/cmc.2023.033406 ↗
3. Australian Computer Society, ACS code of ethics, 2018. [Online]. Available: https://www.acs.org.au/content/dam/acs/acs-documents/Code-of-Ethics.pdf
4. Deep learning for aspect-based sentiment analysis: A comparative review10.1016/j.eswa.2018.10.003 ↗
5. D. Gu, J. Wang, S. Cai, C. Yang, Z. Song et al., “Targeted aspect based multimodal sentiment analysis: An attention capsule extraction and multi-head fusion network,” arXiv Prepr. arXiv2103.07659, 2021.10.1109/ACCESS.2021.3126782 ↗
6. A survey of sentiment analysis in social media10.1007/s10115-018-1236-4 ↗
7. Sentiment analysis: A combined approach10.1016/j.joi.2009.01.003 ↗
8. Sentiment analysis of students’ feedback with NLP and deep learning: A systematic mapping study10.3390/app11093986 ↗
9. Text data augmentation for deep learning10.1186/s40537-021-00492-0 ↗
10. The impact of synthetic text generation for sentiment analysis using GAN based models10.1016/j.eij.2022.05.006 ↗
11. Combining resources to improve unsupervised sentiment analysis at aspect-level10.1177/0165551515593686 ↗
12. Deep learning for aspect-based sentiment analysis: A review10.7717/peerj-cs.1044 ↗
13. A survey on opinion mining and sentiment analysis: Tasks, approaches and applications10.1016/j.knosys.2015.06.015 ↗
14. Generate domain-specific sentiment lexicon for review sentiment analysis10.1007/s11042-017-5529-5 ↗
15. Feature selection and ensemble construction: A two-step method for aspect based sentiment analysis10.1016/j.knosys.2017.03.020 ↗
16. Aspect extraction performance with POS tag pattern of dependency relation in aspect-based sentiment analysis
17. Aspect based sentiment analysis using POS tagging and TFIDF10.35940/ijeat.F7935.088619 ↗
18. Part-of-speech tagging10.1002/wics.195 ↗
19. Part-of-speech tagging in context
20. Development of Marathi part of speech tagger using statistical approach
21. Ascertaining polarity of public opinions on Bangladesh cricket using machine learning techniques10.1007/s41324-021-00403-8 ↗
22. Aspect based sentiment analysis in Bangla dataset based on aspect term extraction
23. An enhanced framework for aspect-based sentiment analysis of hotels’ reviews: Arabic reviews case study
24. Deep hotel recommender system using aspect-based sentiment analysis of users’ reviews
25. Al-Smadi · Journal of Computational Science · 2018 · 27 · 38610.1016/j.jocs.2017.11.006 ↗
26. A unified position-aware convolutional neural network for aspect based sentiment analysis10.1016/j.neucom.2021.03.092 ↗
27. Positionless aspect based sentiment analysis using attention mechanism10.1016/j.knosys.2021.107136 ↗
28. Deep learning10.1038/nature14539 ↗
29. A hybrid approach of lexicon-based and corpus-based techniques for arabic book aspect and review polarity detection10.30534/ijatcse/2020/24942020 ↗
30. Aspect-based sentiment analysis: A survey of deep learning methods10.1109/TCSS.2020.3033302 ↗
31. Aspect-based sentiment analysis for sentence types with implicit aspect and explicit opinion in restaurant review using grammatical rules, hybrid approach, and SentiCircle10.22266/ijies2021.1031.27 ↗
32. Sentiment analysis using XLM-R transformer and zero-shot transfer learning on resource-poor Indian language
33. Exploring zero-shot cross-lingual aspect-based sentiment analysis using pre-trained multilingual language models
34. On Vietnamese sentiment analysis: A transfer learning method
35. P. A. Utama, N. S. Moosavi, V. Sanh and I. Gurevych, “Avoiding inference heuristics in few-shot prompt-based finetuning,” arXiv Prepr. arXiv2109.04144, 2021.10.18653/v1/2021.emnlp-main.713 ↗
36. B. Wang, L. Ding, Q. Zhong, X. Li and D. Tao, “A contrastive cross-channel data augmentation framework for aspect-based sentiment analysis,” arXiv Prepr. arXiv2204.07832, 2022.
37. Natural language processing (NLP): An introduction: Making sense of textual data10.1007/978-3-030-88389-8_15 ↗
38. The potential of machine learning algorithms for sentiment classification of students’ feedback on MOOC
39. Sentiment analysis and subjectivity
40. Weakly supervised framework for aspect-based sentiment analysis on students’ reviews of MOOCs10.1109/ACCESS.2020.3000739 ↗
41. SemEval-2014 task 4: Aspect based sentiment analysis
42. D. Tang, B. Qin and T. Liu, “Aspect level sentiment classification with deep memory network,” arXiv Prepr. arXiv1605.08900, 2016.10.18653/v1/D16-1021 ↗
43. C. Zhang, Q. Li and D. Song, “Aspect-based sentiment classification with aspect-specific graph convolutional networks,” arXiv Prepr. arXiv1909.03477, 2019.10.18653/v1/D19-1464 ↗
44. Sentiment analysis using lexicon and machine learning-based approaches: A survey
45. W2VLDA: Almost unsupervised system for aspect based sentiment analysis10.1016/j.eswa.2017.08.049 ↗
46. An enhanced guided LDA model augmented with BERT based semantic strength for aspect term extraction in sentiment analysis10.1016/j.knosys.2022.108668 ↗
47. WS4ABSA: An NMF-based weakly-supervised approach for aspect-based sentiment analysis with application to online reviews
48. A survey of zero-shot learning: Settings, methods, and applications10.1145/3324926 ↗
49. L. Shu, J. Chen, B. Liu and H. Xu, “Zero-shot aspect-based sentiment analysis,” arXiv Prepr. arXiv2202.01924, 2022.
50. R. Seoh, I. Birle, M. Tak, H. S. Chang, B. Pinette et al., “Open aspect target sentiment classification with natural language prompts,” arXiv Prepr. arXiv2109.03685, 2021.10.18653/v1/2021.emnlp-main.509 ↗
51. S. Kobayashi, “Contextual augmentation: Data augmentation by words with paradigmatic relations,” arXiv Prepr. arXiv1805.06201, 2018.10.18653/v1/N18-2072 ↗
52. Data augmentation in a hybrid approach for aspect-based sentiment analysis
53. A challenge dataset and effective models for aspect-based sentiment analysis
54. UWB at semeval-2016 task 5: Aspect based sentiment analysis
55. A review of topic modeling methods10.1016/j.is.2020.101582 ↗
56. Topic modeling: A comprehensive review
57. Latent dirichlet allocation
58. Latent dirichlet allocation (LDA) and topic modeling: Models, applications, a survey10.1007/s11042-018-6894-4 ↗
59. M. Grootendorst, “BERTopic: Neural topic modeling with a class-based TF-IDF procedure,” arXiv preprint arXiv:2203.05794, 2022.
60. A survey on image data augmentation for deep learning10.1186/s40537-019-0197-0 ↗
61. S. Y. Feng, V. Gangal, J. Wei, S. Chandar, S. Vosoughi et al., “A survey of data augmentation approaches for NLP,” arXiv Prepr. arXiv2105.03075, 2021.10.18653/v1/2021.findings-acl.84 ↗
62. Y. Liu, M. Ott, N. Goyal, J. Du, M. Joshi et al., “RoBERTa: A robustly optimized bert pretraining approach,” arXiv Prepr. arXiv1907.11692, 2019.
63. J. Devlin, M. W. Chang, K. Lee and K. Toutanova, “BERT: Pre-training of deep bidirectional transformers for language understanding,” arXiv Prepr. arXiv1810.04805, 2018.
64. V. Sanh, L. Debut, J. Chaumond and T. Wolf, “DistilBERT, a distilled version of BERT: Smaller, faster, cheaper and lighter,” arXiv Prepr. arXiv1910.01108, 2019.
65. N. Reimers and I. Gurevych, “Sentence-bert: Sentence embeddings using siamese bert-networks,” arXiv Prepr. arXiv1908.10084, 2019.10.18653/v1/D19-1410 ↗
66. MTNA: A neural multi-task model for aspect category classification and aspect term extraction on restaurant reviews
67. Improving aspect term extraction with bidirectional dependency tree representation10.1109/TASLP.2019.2913094 ↗
68. Language independent sequence labelling for opinion target extraction10.1016/j.artint.2018.12.002 ↗
69. Multi-task learning for aspect term extraction and aspect sentiment classification10.1016/j.neucom.2020.02.093 ↗
70. A hybrid unsupervised method for aspect term and opinion target extraction10.1016/j.knosys.2018.01.019 ↗
71. Urdu sentiment analysis with deep learning methods10.1109/ACCESS.2021.3093078 ↗
72. The impact of translating resource-rich datasets to low-resource languages through multi-lingual text processing10.1109/ACCESS.2021.3110285 ↗
73. A text generation and prediction system: Pre-training on new corpora using BERT and GPT-2