journal article·2022-05-28Open access

Self-Supervised Sentiment Analysis in Spanish to Understand the University Narrative of the Colombian Conflict

Paula Rendón-Cardona, Julian Gil-Gonzalez, Julián Páez-Valdez, Mauricio Rivera-Henao

Applied Sciences· Volume 12· Issue 11

Abstract

Sentiment analysis is a relevant area in the natural language processing context–(NLP) that allows extracting opinions about different topics such as customer service and political elections. Sentiment analysis is usually carried out through supervised learning approaches and using labeled data. However, obtaining such labels is generally expensive or even infeasible. The above problems can be faced by using models based on self-supervised learning, which aims to deal with various machine learning paradigms in the absence of labels. Accordingly, we propose a self-supervised approach for sentiment analysis in Spanish that comprises a lexicon-based method and a supervised classifier. We test our proposal over three corpora; the first two are labeled datasets, namely, CorpusCine and PaperReviews. Further, we use an unlabeled corpus conformed by news related to the Colombian conflict to understand the university journalistic narrative of the war in Colombia. Obtained results demonstrate that our proposal can deal with sentiment analysis settings in scenarios with unlabeled corpus; in fact, it acquires competitive performance compared with state-of-the-art techniques in partially-labeled datasets.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Sentiment Analysis and Opinion Mining · Misinformation and Its Impacts · Hate Speech and Cyberbullying Detection

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Faculty of Humanities, Social Sciences, and Education, Universidad Católica de Pereira, Pereira 660005, Colombia

Engineering Faculty, Universidad Tecnológica de Pereira, Pereira 660003, Colombia

School of Management, Universidad del Rosario, Bogotá 110141, Colombia

Funding

Fondo nacional de financiamiento para la ciencia, la tecnología y la innovación Francisco José de Caldas · “Ministerio de ciencia, tecnología e innovación”—(MinCiencias) · Centro nacional de memoria histórica · Universidad Católica de Pereira · Universidad del Quindío · Analytical Center of University Cultural Productions in the Context of the Conflict (caPAZ)

References (62)

Show source-provided references
1. !Basta ya! Colombia: Memorias de guerra y dignidad10.15446/achsc.v41n2.48792 ↗
2. Martínez, A.F.Á., and Agudelo, L.V. (2016). Los Retos del Posconflicto: Justicia, Seguridad y Mercados Ilegales, Ediciones B Colombia.
3. Cárdenas, H.M. (2018). Cómo pueden los nuevos comunicadores hacer periodismo de investigación en la era digital?. Compiladora, 65–84.10.35985/9789585522060.4 ↗
4. Etapas del conflicto armado en Colombia: Hacia el posconflicto
5. Inquest of Current Situation in Afghanistan Under Taliban Rule Using Sentiment Analysis and Volume Analysis10.1109/ACCESS.2022.3144659 ↗
6. Fusion of EEG response and sentiment analysis of products review to predict customer satisfaction10.1016/j.inffus.2018.11.001 ↗
7. Sandoval-Almazan, R., and Valle-Cruz, D. (June, January 30). Facebook impact and sentiment analysis on political campaigns. Proceedings of the 19th Annual International Conference on Digital Government Research: Governance in the Data Age, Delft, The Netherlands.
8. Sentiment analysis for movies reviews dataset using deep learning models10.5121/ijdkp.2019.9302 ↗
9. Sentiment analysis on Twitter: A text mining approach to the Syrian refugee crisis10.1016/j.tele.2017.10.006 ↗
10. A survey of sentiment analysis based on transfer learning10.1109/ACCESS.2019.2925059 ↗
11. Sazzed, S. (2021, January 23–25). Improving Sentiment Classification in Low-Resource Bengali Language Utilizing Cross-Lingual Self-supervised Learning. Proceedings of the International Conference on Applications of Natural Language to Information Systems, Saarbrucken, Germany.10.1007/978-3-030-80599-9_20 ↗
12. Sentiment analysis in Spanish for improvement of products and services: A deep learning approach
13. Severyn, A., and Moschitti, A. (2015, January 4–5). Unitn: Training deep convolutional neural network for twitter sentiment classification. Proceedings of the 9th International Workshop on Semantic Evaluation (SemEval 2015), Denver, CO, USA.10.18653/v1/S15-2079 ↗
14. Ssentia: A self-supervised sentiment analyzer for classification from unlabeled data
15. Sentiment analysis using deep learning architectures: A review10.1007/s10462-019-09794-5 ↗
16. Gong, Y., Liu, L., Yang, M., and Bourdev, L. (2014). Compressing deep convolutional networks using vector quantization. arXiv.
17. Day, M.Y., and Lin, Y.D. (2017, January 4–6). Deep learning for sentiment analysis on google play consumer review. Proceedings of the 2017 IEEE International Conference on Information Reuse and Integration (IRI), San Diego, CA, USA.10.1109/IRI.2017.79 ↗
18. Domain attention model for multi-domain sentiment classification10.1016/j.knosys.2018.05.004 ↗
19. Howard, J., and Ruder, S. (2018). Universal language model fine-tuning for text classification. arXiv.10.18653/v1/P18-1031 ↗
20. Toward multi-label sentiment analysis: A transfer learning based approach10.1186/s40537-019-0278-0 ↗
21. Sun, Q., Liu, Y., Chua, T.S., and Schiele, B. (2019, January 15–20). Meta-transfer learning for few-shot learning. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00049 ↗
22. Learning from multiple inconsistent and dependent annotators to support classification tasks10.1016/j.neucom.2020.10.045 ↗
23. Rodrigues, F., and Pereira, F. (2018, January 2–7). Deep learning from crowds. Proceedings of the AAAI Conference on Artificial Intelligence, New Orleans, LA, USA.10.1609/aaai.v32i1.11506 ↗
24. Twitter sentiment analysis using hybrid cuckoo search method10.1016/j.ipm.2017.02.004 ↗
25. Kwon, H.J., Ban, H.J., Jun, J.K., and Kim, H.S. (2021). Topic modeling and sentiment analysis of online review for airlines. Information, 12.10.3390/info12020078 ↗
26. Kauffmann, E., Peral, J., Gil, D., Ferrández, A., Sellers, R., and Mora, H. (2019). Managing marketing decision-making with sentiment analysis: An evaluation of the main product features using text data mining. Sustainability, 11.10.3390/su11154235 ↗
27. Abdullah, M., and Hadzikadic, M. (2017, January 6–8). Sentiment analysis of twitter data: Emotions revealed regarding donald trump during the 2015–2016 primary debates. Proceedings of the 2017 IEEE 29th International Conference on Tools with Artificial Intelligence (ICTAI), Boston, MA, USA.10.1109/ICTAI.2017.00120 ↗
28. Al-Sarraj, W.F., and Lubbad, H.M. (2018, January 3–4). Bias Detection of Palestinian/Israeli Conflict in Western Media: A Sentiment Analysis Experimental Study. Proceedings of the 2018 International Conference on Promising Electronic Technologies (ICPET), Deir El-Balah, Palestine.10.1109/ICPET.2018.00024 ↗
29. Abedin, E., Jafarzadeh, H., and Akhlaghpour, S. (2018, January 26–30). Opinion mining on Twitter: A sentiment analysis of the Iran deal. Proceedings of the PACIS 2018, Yokohama, Japan.
30. A sentiment reporting framework for major city events: Case study on the China-United States trade war10.1016/j.jclepro.2020.121426 ↗
31. Khun, N.H., and Thant, H.A. (2019, January 24–27). Visualization of Twitter Sentiment during the Period of US Banned Huawei. Proceedings of the 2019 International Conference on Advanced Information Technologies (ICAIT), Chikmagalur, India.10.1109/AITC.2019.8921014 ↗
32. Sentiment analysis on post conflict in Colombia: A text mining approach
33. Big data in evaluation: Experiences from using Twitter analysis to evaluate Norway’s contribution to the peace process in Colombia10.1177/1356389018804259 ↗
34. The validity of sentiment analysis: Comparing manual annotation, crowd-coding, dictionary approaches, and machine learning algorithms10.1080/19312458.2020.1869198 ↗
35. Sentiment Analysis of Political Tweets from the 2019 Spanish Elections10.1109/ACCESS.2021.3097492 ↗
36. Rosenthal, S., Farra, N., and Nakov, P. (2017, January 3–4). SemEval-2017 task 4: Sentiment analysis in Twitter. Proceedings of the 11th International Workshop on Semantic Evaluation (SemEval-2017), Vancouver, BC, Canada.10.18653/v1/S17-2088 ↗
37. Deep learning in computer vision: A critical review of emerging techniques and application scenarios
38. Deep learning for sentiment analysis: A survey10.1002/widm.1253 ↗
39. Learning from crowds
40. A weakly supervised approach to Chinese sentiment classification using partitioned self-training10.1177/0165551513480330 ↗
41. Self-training from labeled features for sentiment analysis10.1016/j.ipm.2010.11.003 ↗
42. de Arriba Serra, A., Oriol Hilari, M., and Franch Gutiérrez, J. (2021, January 22–24). Applying sentiment analysis on Spanish tweets using BETO. Proceedings of the Iberian Languages Evaluation Forum (IberLEF 2021): Co-Located with the Conference of the Spanish Society for Natural Language Processing (SEPLN 2021), XXXVII International Conference of the Spanish Society for Natural Language Processing, Málaga, Spain.
43. Rosá, A., and Chiruzzo, L. (2021). Emotion Classification in Spanish: Exploring the Hard Classes. Information, 12.10.3390/info12110438 ↗
44. Weakly supervised framework for aspect-based sentiment analysis on students’ reviews of MOOCs10.1109/ACCESS.2020.3000739 ↗
45. A syntactic approach for opinion mining on Spanish reviews10.1017/S1351324913000181 ↗
46. Feature-based opinion extraction: A practical, domain-adaptable approach10.3233/AIC-2012-0519 ↗
47. Classification descendante hierarchique et analvse lexicale par contexte-application au corpus des poesies D’A. Rihbaud10.1177/075910638701300107 ↗
48. Postures énonciatives et mondes lexicaux stabilisés en analyse statistique de discours10.3917/ls.121.0189 ↗
49. Hu, M., and Liu, B. (2004, January 22–25). Mining and summarizing customer reviews. Proceedings of the 10th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Seattle, WA, USA.10.1145/1014052.1014073 ↗
50. Hutto, C., and Gilbert, E. (2014, January 1–4). Vader: A parsimonious rule-based model for sentiment analysis of social media text. Proceedings of the International AAAI Conference on Web and Social Media, Ann Arbor, MI, USA.10.1609/icwsm.v8i1.14550 ↗
51. A comparative study of machine translation for multilingual sentence-level sentiment analysis10.1016/j.ins.2019.10.031 ↗
52. The Impact of Translating Resource-Rich Datasets to Low-Resource Languages Through Multi-Lingual Text Processing10.1109/ACCESS.2021.3110285 ↗
53. del Hoyo, R., Hupont, I., Lacueva, F.J., and Abadía, D. (2009, January 6). Hybrid text affect sensing system for emotional language analysis. Proceedings of the International Workshop on Affective-Aware Virtual Agents and Social Robots, Boston, MA, USA.10.1145/1655260.1655263 ↗
54. Sentiment polarity detection in Spanish reviews combining supervised and unsupervised approaches10.1016/j.eswa.2012.12.084 ↗
55. Semantic orientation for polarity classification in Spanish reviews10.1016/j.eswa.2013.06.076 ↗
56. Martínez-Cámara, E., Martín-Valdivia, M.T., and Urena-López, L.A. (2011, January 28–30). Opinion classification techniques applied to a spanish corpus. Proceedings of the International Conference on Application of Natural Language to Information Systems, Alicante, Spain.10.1007/978-3-642-22327-3_17 ↗
57. NgramSPD: Exploring optimal n-gram model for sentiment polarity detection in different languages10.3233/IDA-183879 ↗
58. Zhao, J., Huang, F., Lv, J., Duan, Y., Qin, Z., Li, G., and Tian, G. (2020, January 13–18). Do rnn and lstm have long memory?. Proceedings of the International Conference on Machine Learning, PMLR, Virtual Event, Online.
59. Heurísticas para Data Augmentation en NLP: Aplicación a Revisiones de Artículos Científicos
60. Keith, B., Fuentes, E., and Meneses, C. (2017, January 13–17). A hybrid approach for sentiment analysis applied to paper reviews. Proceedings of the ACM SIGKDD Conference, Halifax, NS, Canada.
61. Hu, Z., Tan, B., Salakhutdinov, R.R., Mitchell, T.M., and Xing, E.P. (2019, January 8–14). Learning data manipulation for augmentation and weighting. Proceedings of the 33rd Conference on Neural Information Processing Systems, Vancouver, BC, Canada. Advances in Neural Information Processing Systems.
62. Gil-González, J., Valencia-Duque, A., Álvarez-Meza, A., Orozco-Gutiérrez, Á., and García-Moreno, A. (2021). Regularized Chained Deep Neural Network Classifier for Multiple Annotators. Appl. Sci., 11.10.3390/app11125409 ↗