Text-Image Feature Fine-Grained Learning for Joint Multimodal Aspect-Based Sentiment Analysis
Source abstract
Abstract
Joint Multimodal Aspect-based Sentiment Analysis (JMASA) is a significant task in the research of multimodal fine-grained sentiment analysis, which combines two subtasks: Multimodal Aspect Term Extraction (MATE) and Multimoda... | Find, read and cite all the research you need on Tech Science Press
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Sentiment Analysis and Opinion Mining
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (58)
Show source-provided references
1. Cross-modal consistency with aesthetic similarity for multimodal false information detection
2. Multimodal consistency-specificity fusion based on information bottleneck for sentiment analysis
3. Multimodal sentiment analysis based on a cross-modal multihead attention mechanism
4. Joint multi-modal aspect-sentiment analysis with auxiliary cross-modal relation detection
5. Vision language pre-training for multimodal aspect-based sentiment analysis
6. Cross-modal multitask transformer for end-to-end multimodal aspect-based sentiment analysis10.1016/j.ipm.2022.103038 ↗
7. Self-adaptive attention fusion for multimodal aspect-based sentiment analysis10.3934/mbe.2024056 ↗
8. T. N. Kipf and M. Welling, “Semi-supervised classification with graph convolutional networks,” 2016, arXiv:1609.02907.
9. Large-scale visual sentiment ontology and detectors using adjective noun pairs
10. Y. Chen, “Convolutional neural network for sentence classification,” M.S. thesis, Univ. of Waterloo, Waterloo, ON, Canada, 2015.
11. B. Shin, T. Lee, and J. D. Choi, “Lexicon integrated CNN models with attention for sentiment analysis,” 2016, arXiv:1610.06272.10.18653/v1/W17-5220 ↗
12. Visual sentiment analysis by attending on local image regions
13. Aspect-based sentiment classification with aspect-specific graph convolutional networks
14. Syntax-aware aspect level sentiment classification with graph attention networks
15. Aspect-level sentiment analysis via convolution over dependency tree
16. Long short-term memory10.1162/neco.1997.9.8.1735 ↗
17. Dependency graph enhanced dual-transformer structure for aspect-based sentiment classification
18. Relational graph attention network for aspect-based sentiment analysis
19. A. Zadeh, M. Chen, S. Poria, E. Cambria, and L. P. Morency, “Tensor fusion network for multimodal sentiment analysis,” 2017, arXiv:1707.07250.10.18653/v1/D17-1115 ↗
20. Beneath the tip of the iceberg: Current challenges and new directions in sentiment analysis research10.1109/TAFFC.2020.3038167 ↗
21. J. Chung, C. Gulcehre, K. Cho, and Y. Bengio, “Empirical evaluation of gated recurrent neural networks on sequence modeling,” 2014, arXiv:1412.3555.
22. Real-time speech emotion and sentiment recognition for interactive dialogue systems
23. Attention is all you need
24. Deep convolutional neural network textual features and multiple kernel learning for utterance-level multimodal sentiment analysis
25. Context-dependent sentiment analysis in user-generated videos
26. P. P. Liang, Z. Liu, A. Zadeh, and L. P. Morency, “Multimodal language analysis with recurrent multistage fusion,” 2018, arXiv:1808.03920.10.18653/v1/D18-1014 ↗
27. Analysis of emotion recognition using facial expressions, speech and multimodal information
28. Emotion recognition using a hierarchical binary decision tree approach10.1016/j.specom.2011.06.004 ↗
29. S. Castro, D. Hazarika, V. Pérez-Rosas, R. Zimmermann, R. Mihalcea and S. Poria, “Towards multimodal sarcasm detection (an _obviously_perfect paper),” 2019, arXiv:1906.01815.10.18653/v1/P19-1455 ↗
30. Multi-modal sarcasm detection in twitter with hierarchical fusion model
31. Object-based visual sentiment concept analysis and application
32. Visual sentiment prediction based on automatic discovery of affective regions10.1109/TMM.2018.2803520 ↗
33. Robust visual-textual sentiment analysis: When attention meets tree-structured recursive neural networks
34. A co-memory network for multimodal sentiment analysis
35. Sentiment analysis of multimodal twitter data10.1007/s11042-019-7390-1 ↗
36. Multi-interactive memory network for aspect based multimodal sentiment analysis
37. Entity-sensitive attention and fusion network for entity-level multimodal sentiment classification10.1109/TASLP.2019.2957872 ↗
38. Adapting BERT for target-oriented multimodal sentiment classification
39. J. Devlin, M. W. Chang, K. Lee, and K. Toutanova, “BERT: Pre-training of deep bidirectional transformers for language understanding,” 2018, arXiv:1810.04805.
40. Exploiting BERT for multimodal target sentiment classification through input space translation
41. Learning from adjective-noun pairs: A knowledge-enhanced framework for target-oriented multimodal sentiment classification
42. Multimodal aspect extraction with region-aware alignment network
43. Improving multimodal named entity recognition via entity span detection with unified multimodal transformer
44. Multimodal representation with embedded visual guiding objects for named entity recognition in social media posts
45. MNER-QG: An end-to-end MRC framework for multimodal named entity recognition with query grounding
46. Neural networks for open domain targeted sentiment
47. A unified model for opinion target extraction and target sentiment prediction
48. Relation-aware collaborative learning for unified aspect-based sentiment analysis
49. E. F. Sang and J. Veenstra, “Representing text chunks,” 1999, arXiv:cs/9907006.10.3115/977035.977059 ↗
50. Y. Liu et al., “Roberta: A robustly optimized BERT pretraining approach,” 2019, arXiv:1907.11692.
51. Deep residual learning for image recognition
52. K. Simonyan and A. Zisserman, “Very deep convolutional networks for large-scale image recognition,” 2014, arXiv:1409.1556.
53. Multimodal transformer for unaligned multimodal language sequences
54. J. L. Ba, J. R. Kiros, and G. E. Hinton, “Layer normalization,” 2016, arXiv:1607.06450.
55. T. Chen, D. Borth, T. Darrell, and S. F. Chang, “DeepSentiBank: Visual sentiment concept classification with deep convolutional neural networks,” 2014, arXiv:1410.8586.
56. Conditional random fields: Probabilistic models for segmenting and labeling sequence data
57. M. Hu, Y. Peng, Z. Huang, D. Li, and Y. Lv, “Open-domain targeted sentiment analysis via span-based extraction and classification,” 2019, arXiv:1906.03820.10.18653/v1/P19-1051 ↗
58. Joint aspect extraction and sentiment analysis with directional graph convolutional networks