journal article·2021-11-12Open access

Detecting Aggressiveness in Tweets: A Hybrid Model for Detecting Cyberbullying in the Spanish Language

Manuel Lepe-Faúndez, Alejandra Segura-Navarrete, Christian Vidal-Castro, Claudia Martínez-Araneda, Clemente Rubio-Manzano

Applied Sciences· Volume 11· Issue 22

Abstract

In recent years, the use of social networks has increased exponentially, which has led to a significant increase in cyberbullying. Currently, in the field of Computer Science, research has been made on how to detect aggressiveness in texts, which is a prelude to detecting cyberbullying. In this field, the main work has been done for English language texts, mainly using Machine Learning (ML) approaches, Lexicon approaches to a lesser extent, and very few works using hybrid approaches. In these, Lexicons and Machine Learning algorithms are used, such as counting the number of bad words in a sentence using a Lexicon of bad words, which serves as an input feature for classification algorithms. This research aims at contributing towards detecting aggressiveness in Spanish language texts by creating different models that combine the Lexicons and ML approach. Twenty-two models that combine techniques and algorithms from both approaches are proposed, and for their application, certain hyperparameters are adjusted in the training datasets of the corpora, to obtain the best results in the test datasets. Three Spanish language corpora are used in the evaluation: Chilean, Mexican, and Chilean-Mexican corpora. The results indicate that hybrid models obtain the best results in the 3 corpora, over implemented models that do not use Lexicons. This shows that by mixing approaches, aggressiveness detection improves. Finally, a web application is developed that gives applicability to each model by classifying tweets, allowing evaluating the performance of models with external corpus and receiving feedback on the prediction of each one for future research. In addition, an API is available that can be integrated into technological tools for parental control, online plugins for writing analysis in social networks, and educational tools, among others.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Hate Speech and Cyberbullying Detection · Bullying, Victimization, and Aggression

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Information Systems, University of the Bío-Bío, Avda. Collao 1202, Casilla 5-C, Concepción 4051381, Chile

Computer Science Department, Universidad Católica de la Santísima Concepción, Concepción 4090541, Chile

Department of Mathematics, University of Cádiz, 11003 Cádiz, Spain

References (38)

Show source-provided references
1. Cyberbullying: Labels, Behaviours and Definition in Three European Countries10.1375/ajgc.20.2.129 ↗
2. Prevalencia de Bullying y Cyberbullying En Latinoamérica: Una Revisión10.33881/2027-1786.rip.11301 ↗
3. Cádiz, P.C., Claro, M., Peña, D.L., Antezana, L., and Maldonado, L. (2017). Implementación de Estudio de Usos, Oportunidades y Riesgos en el uso de TIC por Parte de Niños, Niñas y Adolescentes en Chile, Mineduc y OREALC/UNESCO.
4. Middle School Bullying: Student Reported Perceptions and Prevalence10.1080/23727810.2017.1422645 ↗
5. Slee, P.T., Skrzypiec, G., and Cefai, C. (2017). Adults Perceptions of Bullying in Early Childhood. Child and Adolescent Wellbeing and Violence Prevention in Schools, Routledge.10.4324/9781315102047 ↗
6. Willard, N.E. (2007). Cyberbullying and Cyberthreats: Responding to the Challenge of Online Social Aggression, Threats, and Distress, Research Press.
7. Emotion as a Multicomponent Process: A Model and Some Cross-Cultural Data
8. Serhrouchni, A. (2019, January 20–22). Multilingual Cyberbullying Detection System. Proceedings of the 2019 IEEE International Conference on Electro Information Technology (EIT), Brookings, SD, USA.
9. Chatzakou, D., Kourtellis, N., Blackburn, J., De Cristofaro, E., Stringhini, G., and Vakali, A. (2017, January 25–28). Mean Birds: Detecting Aggression and Bullying on Twitter. Proceedings of the 2017 ACM on Web Science Conference, Troy, NY, USA.10.1145/3091478.3091487 ↗
10. Automatic Detection of Verbal Aggression for Russian and American Imageboards10.1016/j.sbspro.2016.12.022 ↗
11. Sharma, H.K., and Kshitiz, K. (2018, January 22–23). NLP and Machine Learning Techniques for Detecting Insulting Comments on Social Networking Platforms. Proceedings of the 2018 International Conference on Advances in Computing and Communication Engineering, ICACCE 2018, Paris, France.
12. Pawar, R., Agrawal, Y., Joshi, A., Gorrepati, R., and Raje, R.R. (2018, January 3–5). Cyberbullying Detection System with Multiple Server Configurations. Proceedings of the 2018 IEEE International Conference on Electro/Information Technology (EIT), Rochester, MI, USA.10.1109/EIT.2018.8500110 ↗
13. Cyberbullying Detection on Twitter Using Big Five and Dark Triad Features10.1016/j.paid.2019.01.024 ↗
14. Cybercrime Detection in Online Communications: The Experimental Case of Cyberbullying Detection in the Twitter Network10.1016/j.chb.2016.05.051 ↗
15. Del Bosque, L.P., and Garza, S.E. (2014, January 16–22). Aggressive Text Detection for Cyberbullying. Proceedings of the Mexican International Conference on Artificial Intelligence, Tuxtla Gutierrez, Mexico.10.1007/978-3-319-13647-9_21 ↗
16. Machine Learning and Semantic Analysis of In-Game Chat for Cyberbullying10.1016/j.cose.2018.02.016 ↗
17. Sustainable Cyberbullying Detection with Category-Maximized Relevance of Harmful Phrases and Double-Filtered Automatic Optimization10.1016/j.ijcci.2016.07.002 ↗
18. Leon-Paredes, G.A., Palomeque-Leon, W.F., Gallegos-Segovia, P.L., Vintimilla-Tapia, P.E., Bravo-Torres, J.F., Barbosa-Santillan, L.I., and Paredes-Pinos, M.M. (2019, January 13–27). Presumptive Detection of Cyberbullying on Twitter through Natural Language Processing and Machine Learning in the Spanish Language. Proceedings of the 2019 IEEE CHILEAN Conference on Electrical, Electronics Engineering, Information and Communication Technologies (CHILECON), Valparaiso, Chile.10.1109/CHILECON47746.2019.8987684 ↗
19. Celdrán, P. (2009). El Gran Libro de Los Insultos: Tesoro Crítico, Etimológico e Histórico de Los Insultos Españoles, La Esfera de los Libros.
20. Tapia, F., Aguinaga, C., and Luje, R. (2018, January 17–19). Detection of Behavior Patterns through Social Networks like Twitter, Using Data Mining Techniques as a Method to Detect Cyberbullying. Proceedings of the 7th International Conference on Software Process Improvement (CIMPS), Guadalajara, Mexico.10.1109/CIMPS.2018.8625625 ↗
21. Montufar Mercado, R., Chacca Chuctaya, H., and Castro Gutierrez, E. (2018). Automatic Cyberbullying Detection in Spanish-language Social Networks using Sentiment Analysis Techniques. Int. J. Adv. Comput. Sci. Appl. (IJACSA), 9.10.14569/IJACSA.2018.090733 ↗
22. Loper, E., and Bird, S. (2006). NLTK: The Natural Language Toolkit. Proceedings of the COLING/ACL 2006 Interactive Presentation Sessions, Association for Computational Linguistics.
23. Ríos, M., and Gravano, A. (2013, January 14). Spanish DAL: A Spanish Dictionary of Affect in Language. Proceedings of the 4th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis, Atlanta, GA, USA.
24. Overview of MEX-A3T at IberEval 2018: Authorship and Aggressiveness Analysis in Mexican Spanish Tweets
25. INGEOTEC at MEX-A3T: Author Profiling and Aggressiveness Analysis in Twitter Using ΜTC and EvoMSA
26. Casavantes, M., López, R., and González, L.C. (2019, January 24). UACH at MEX-A3T 2019: Preliminary Results on Detecting Aggressive Tweets by Adding Author Information via an Unsupervised Strategy. Proceedings of the IberLEF@ SEPLN, Bilbao, Spain.
27. Cañete, J., Chaperon, G., Fuentes, R., Ho, J.-H., Kang, H., and Perez, J. (2021, October 28). Spanish Pre-Trained BERT Model. Available online: https://users.dcc.uchile.cl/~jperez/papers/pml4dc2020.pdf.
28. Attention Mechanism for Aggressive Detection
29. Transformers and Data Augmentation for Aggressiveness Detection in Mexican Spanish
30. Detecting Aggressiveness in Mexican Spanish Social Media Content by Fine-Tuning Transformer-Based Models
31. Riquelme, R. (2021, October 28). Detección de Violencia Verbal Hacia Las Mujeres En Redes Sociales Mediante Técnicas de Aprendizaje Automático. Available online: http://repobib.ubiobio.cl/jspui/bitstream/123456789/2692/1/Riquelme_Silva_Ricardo.pdf.
32. Lepe, M. (2021, October 28). Modelos Híbridos Basados En Lexicones y Machine Learning Para La Detección de Agresividad Sobre Textos En Idioma Español. Available online: http://www.mcc.ubiobio.cl/docs/tesis/manuel_lepe-tesis(manuellepe).pdf.
33. Segura Navarrete, A., Martínez-Araneda, C., Vidal-Castro, C., and Rubio-Manzano, C. (2021, October 28). A Novel Approach to the Creation of a Labelling Lexicon for Improving Emotion Analysis in Text. Electronic Library. Available online: https://www.researchgate.net/publication/349119080_A_novel_approach_to_the_creation_of_a_labelling_lexicon_for_improving_emotion_analysis_in_text.10.1108/EL-04-2020-0110 ↗
34. Plutchik, R., and Kellerman, H. (1980). A General Psychoevolutionary Theory of Emotion. Emotion: Theory, Research, and Experience: Vol. 1. Theories of Emotion, Academic Press.10.1016/B978-0-12-558701-3.50007-7 ↗
35. Collobert, R., and Weston, J. (2008, January 5–9). A Unified Architecture for Natural Language Processing: Deep Neural Networks with Multitask Learning. Proceedings of the 25th International Conference on Machine Learning, New York, NY, USA.10.1145/1390156.1390177 ↗
36. Enriching Word Vectors with Subword Information10.1162/tacl_a_00051 ↗
37. Cardellino, C. (2021, October 28). Spanish Billion Words Corpus and Embeddings. Available online: https://crscardellino.github.io/SBWCE/.
38. Kotu, V., and Deshpande, B. (2015). Data Mining Process. Predictive Analytics and Data Mining, Elsevier.10.1016/B978-0-12-801460-8.00002-1 ↗