Feature-Based Augmentation in Sarcasm Detection Using Reverse Generative Adversarial Network
Source abstract
Abstract
Sarcasm detection in text data is an increasingly vital area of research due to the prevalence of sarcastic content in online communication. This study addresses challenges associated with small datasets and class imbalances in sarcasm detection by employing comprehensive data pre-processing and Generative Adversial Network (GAN) based augmentation on diverse datasets, including iSarcasm, SemEval-18, and Ghosh. This research offers a novel pipeline for augmenting sarcasm data with Reverse Generative Adversarial Network (RGAN). The proposed RGAN method works by inverting labels between original and synthetic data during the training process. This inversion of labels provides feedback to the generator for generating high-quality data closely resembling the original distribution. Notably, the proposed RGAN model exhibits performance on par with standard GAN, showcasing its robust efficacy in augmenting text data. The exploration of various datasets highlights the nuanced impact of augmentation on model performance, with cautionary insights into maintaining a delicate balance between synthetic and original data. The methodological framework encompasses comprehensive data pre-processing and GAN-based augmentation, with a meticulous comparison against Natural Language Processing Augmentation (NLPAug) as an alternative augmentation technique. Overall, the F1-score of our proposed technique outperforms that of the synonym replacement augmentation technique using NLPAug. The increase in F1-score in experiments using RGAN ranged from 0.066% to 1.054%, and the use of standard GAN resulted in a 2.88% increase in F1-score. The proposed RGAN model outperformed the NLPAug method and demonstrated comparable performance to standard GAN, emphasizing its efficacy in text data augmentation.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Sentiment Analysis and Opinion Mining · Advanced Text Analysis Techniques · Text and Document Classification Technologies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (36)
Show source-provided references
1. Sarcasm identification in textual data: Systematic review, research challenges and open directions10.1007/s10462-019-09791-8 ↗
2. The unbearable hurtfulness of sarcasm10.1016/j.eswa.2021.116398 ↗
3. Sarcasm detection using machine learning algorithms in Twitter: A systematic review10.1177/1470785320921779 ↗
4. Sarcastic sentiment detection in tweets streamed in real time: A big data approach10.1016/j.dcan.2016.06.002 ↗
5. Automatic sarcasm detection: Systematic literature review10.3390/info13080399 ↗
6. Are word embedding-based features useful for sarcasm detection?
7. Lexical influences on the perception of sarcasm
8. Ensemble classification approach for sarcasm detection10.1155/2021/9731519 ↗
9. Sarcasm detection using an ensemble approach
10. R. Misra and P. Arora, “Sarcasm detection using hybrid neural network,” arXiv:1908.07414, 2019.
11. Medical image generation using generative adversarial networks: A review
12. Face generation for low-shot learning using generative adversarial networks
13. Generative Adversarial Networks (GANs) for image augmentation in agriculture: A systematic review10.1016/j.compag.2022.107208 ↗
14. Sarcasm detection in tweets: A feature-based approach using supervised machine learning models10.14569/IJACSA.2021.0120651 ↗
15. Detection on sarcasm using machine learning classifiers and rule based approach
16. C-Net: Contextual network for sarcasm detection
17. Sarcasm detection using multi-head attention based bidirectional LSTM10.1109/ACCESS.2019.2963630 ↗
18. Plumeria at SemEval-2022 Task 6: Sarcasm detection for English and Arabic using transformers and data augmentation
19. Sarcasm detection in twitter—Performance impact while using data augmentation: Word embeddings10.5391/IJFIS.2022.22.4.401 ↗
20. GAN-BERT: Generative adversarial learning for robust text classification with a bunch of labeled examples
21. Attention is all you need
22. BERT: Pre-training of deep bidirectional transformers for language understanding
23. Augmenting data for sarcasm detection with unlabeled conversation context
24. Deep learning for visual understanding: Part 2 generative adversarial networks10.1109/MSP.2017.2765202 ↗
25. R. M. Weber, “Exploiting the hidden tasks of GANs: Making implicit subproblems explicit,” arXiv:2101.11863, 2021.
26. Generative adversarial networks10.1145/3422622 ↗
27. Y. Liu, M. Ott, N. Goyal, J. Du, M. Joshi et al., “RoBERTa: A robustly optimized BERT pretraining approach,” arXiv:1907.11692, 2019.
28. V. Sanh, L. Debut, J. Chaumond and T. Wolf, “DistilBERT, a distilled version of BERT: Smaller, faster, cheaper and lighter,” arXiv:1910.01108, 2019.
29. iSarcasm: A dataset of intended sarcasm
30. Fracking sarcasm using neural network
31. SemEval-2018 Task 3: Irony detection in English tweets
32. Guidelines for annotating irony in social media text, version 2.0
33. Multiobjective evolutionary algorithms to identify highly autocorrelated areas: The case of spatial distribution in financially compromised farms10.1007/s10479-011-0841-3 ↗
34. Data augmentation approaches in natural language processing: A survey10.1016/j.aiopen.2022.03.001 ↗
35. Points of significance: Model selection and overfitting10.1038/nmeth.3968 ↗
36. Adam: A method for stochastic optimization