journal article·2025-02-08Open access

Detection of Expressions of Violence Targeting Health Workers with Natural Language Processing Techniques

Merve Varol Arısoy, Mehmet Ali Yalçınkaya, Remzi Gürfidan, Ayhan Arısoy

Applied Sciences· Volume 15· Issue 4

Abstract

The aim of this study is to detect expressions of violence against healthcare workers using natural language processing techniques. Experiments on various NLP models have shown that violent expressions can be successfully classified using textual data. The RAG-ECE model performed the best in this study with a 97.97% accuracy rate and a 97.67% F1 score. The model provided a strong balancing performance in the “no violence” class with 97.71% precision and 97.67% recall rates. In the “violence present” class, it reached 97.67% accuracy and was evaluated as a reliable classifier with both low false positive (3.92%) and low false negative (2.78%) rates. In addition to RAG-ECE, the GPT model provided a milder alternative with 96.19% accuracy and a 96.26% F1 score. The study also compared the performances of other models, such as GPT, BERT, SVM, and NB, and stated that they are considered suitable alternatives due to their low computational costs, especially in small- and medium-sized datasets. The findings of the study show that NLP-based systems offer an effective solution for the early detection and prevention of expressions of violence against healthcare workers.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Artificial Intelligence in Law · Cybercrime and Law Enforcement Studies · Imbalanced Data Classification Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Information Systems Engineering Department, Bucak Faculty of Computer and Information, Burdur Mehmet Akif Ersoy University, 15300 Burdur, Türkiye

Computer Engineering Department, Faculty of Engineering and Architecture, Kırşehir Ahi Evran University, 40100 Kırşehir, Türkiye

Department of Computer Technologies, Yalvaç Technical Sciences Vocational School, Isparta University of Applied Science, 32200 Isparta, Türkiye

References (40)

Show source-provided references
1. Sharing Cases: The Observationes in Early Modern Medicine10.1163/157338210X493932 ↗
2. Comparing Medical Training Costs Internationally: A Systematic Review
3. A primer on medical education in the United States through the lens of a current resident physician
4. Ramzi, Z.S., Fatah, P.W., and Dalvandi, A. (2022). Prevalence of Workplace Violence Against Healthcare Workers During the COVID-19 Pandemic: A Systematic Review and Meta-Analysis. Front. Psychol., 13.10.3389/fpsyg.2022.896156 ↗
5. Violence against physicians and nurses: A systematic literature review10.1007/s10389-021-01689-6 ↗
6. Cyberbullying Detection using Natural Language Processing10.22214/ijraset.2022.43683 ↗
7. A novel ensemble model for identification and classification of cyber harassment on social media platform10.3233/JIFS-230346 ↗
8. Kumari, V., Memon, K., Aslam, B., and Chowdhry, B.S. (2023, January 10–12). An Effective Approach for Violence Detection using Deep Learning and Natural Language Processing. Proceedings of the IMTIC 2023-7th International Multi-Topic ICT Conference 2023: AI Convergence Towards Sustainable Communications, Jamshoro, Pakistan.10.1109/IMTIC58887.2023.10178618 ↗
9. Akti, S., Tataroglu, G.A., and Ekenel, H.K. (2019, January 6–9). Vision-based Fight Detection from Surveillance Cameras. Proceedings of the 2019 9th International Conference on Image Processing Theory, Tools and Applications, IPTA 2019, Istanbul, Turkey.10.1109/IPTA.2019.8936070 ↗
10. The BEHAVE Video Dataset: Ground Truthed Video for Multi-Person Behavior Classification
11. Soliman, M.M., Kamal, M.H., Nashed, M.A.E.-M., Mostafa, Y.M., Chawky, B.S., and Khattab, D. (2019, January 8–10). Violence Recognition from Videos using Deep Learning Techniques. Proceedings of the 2019 IEEE 9th International Conference on Intelligent Computing and Information Systems, ICICIS 2019, Cairo, Egypt.10.1109/ICICIS46948.2019.9014714 ↗
12. Hassner, T., Itcher, Y., and Kliper-Gross, O. (2012, January 16–21). Violent flows: Real-time detection of violent crowd behavior. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshop, Providence, RI, USA.10.1109/CVPRW.2012.6239348 ↗
13. A Systematic Review of Computer Science Solutions for Addressing Violence against Women and Children10.1109/ACCESS.2021.3103459 ↗
14. Roy, R., Dixit, A.K., Saxena, S., and Memoria, M. (2023, January 23–24). Meta-Analysis of Artificial Intelligence Solution for Prevention of Violence Against Women and Girls. Proceedings of the 2023 International Conference on IoT, Communication and Automation Technology, ICICAT 2023, Gorakhpur, India.10.1109/ICICAT57735.2023.10263765 ↗
15. Fathima, K.S., Haroon, R.P., Fathima, F., Thajudeen, T., and Fudin, M. (2023, January 13–14). Domestic Violence Detection System Using Natural Language Processing. Proceedings of the 2023 International Conference on Innovations in Engineering and Technology, ICIET 2023, Muvattupuzha, India.
16. Can natural language processing models extract and classify instances of interpersonal violence in mental healthcare electronic records: An applied evaluative study10.1136/bmjopen-2021-052911 ↗
17. Aggressive and Offensive Language Identification in Hindi, Bangla, and English: A Comparative Study10.1007/s42979-020-00414-6 ↗
18. A Novel Technique to Identify Intimate Partner Violence in a Hospital Setting10.5811/westjem.2022.7.56726 ↗
19. Dobbins, N.J., Chipkin, J., Byrne, T., Ghabra, O., Siar, J., Sauder, M., Huijon, R.M., and Black, T.M. (2024). Deep Learning Models Can Predict Violence and Threats Against Healthcare Providers Using Clinical Notes. medRxiv.10.1101/2024.05.27.24308001 ↗
20. Surveillance of Health Care-Associated Violence Using Natural Language Processing10.1542/peds.2023-063059 ↗
21. Gao, Y., Xiong, Y., Gao, X., Jia, K., Pan, J., Bi, Y., Dai, Y., Sun, J., Wang, M., and Wang, H. (2024, December 31). Retrieval-Augmented Generation for Large Language Models: A Survey. December 2023. [Online]. Available online: https://arxiv.org/abs/2312.10997v5.
22. Jin, C., Zhang, Z., Jiang, X., Liu, F., Liu, X., Liu, X., and Jin, X. (2024, December 31). RAGCache: Efficient Knowledge Caching for Retrieval-Augmented Generation. April 2024. [Online]. Available online: https://arxiv.org/abs/2404.12457v2.
23. Rau, D., Wang, S., Déjean, H., and Clinchant, S. (2024). Context Embeddings for Efficient Answer Generation in RAG. arXiv.
24. Ribeiro, M.T., Singh, S., and Guestrin, C. (2016, January 13–17). ‘Why Should I Trust You?’ Explaining the Predictions of Any Classifier. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.10.1145/2939672.2939778 ↗
25. Mensa, E., Colla, D., Dalmasso, M., Giustini, M., Mamo, C., Pitidis, A., and Radicioni, D.P. (2020). Violence detection explanation via semantic roles embeddings. BMC Med. Inform. Decis. Mak., 20.10.1186/s12911-020-01237-4 ↗
26. Natural language model for automatic identification of Intimate Partner Violence reports from Twitter10.1016/j.array.2022.100217 ↗
27. Monitoring human behaviour during pandemic—Attacks on healthcare personnel scenario10.1016/j.teler.2024.100149 ↗
28. Alam, M.M., and Shome, A. (2020, January 22–24). Attacks on Health Workers during COVID-19 Pandemic-Data Exploration and News Article Detection using NLP and GRU model. Proceedings of the 7th International Conference on Networking, Systems and Security, Dhaka, Bangladesh.10.1145/3428363.3428366 ↗
29. Karystianis, G., Cabral, R.C., Han, S.C., Poon, J., and Butler, T. (2021). Utilizing Text Mining, Data Linkage and Deep Learning in Police and Health Records to Predict Future Offenses in Family and Domestic Violence. Front. Digit. Health, 3.10.3389/fdgth.2021.602683 ↗
30. Raj, C., Agarwal, A., Bharathy, G., Narayan, B., and Prasad, M. (2021). Cyberbullying Detection: Hybrid Models Based on Machine Learning and Natural Language Processing Techniques. Electronics, 10.10.3390/electronics10222810 ↗
31. Aldjanabi, W., Dahou, A., Al-Qaness, M.A.A., Elaziz, M.A., Helmi, A.M., and Damaševičius, R. (2021). Arabic Offensive and Hate Speech Detection Using a Cross-Corpora Multi-Task Learning Model. Informatics, 8.10.3390/informatics8040069 ↗
32. Arcila-Calderón, C., Amores, J.J., Sánchez-Holgado, P., and Blanco-Herrero, D. (2021). Using Shallow and Deep Learning to Automatically Detect Hate Motivated by Gender and Sexual Orientation on Twitter in Spanish. Multimodal Technol. Interact., 5.10.3390/mti5100063 ↗
33. Combining supervised and unsupervised named entity recognition to detect psychosocial risk factors in occupational health checks10.1016/j.ijmedinf.2022.104695 ↗
34. A multi-task learning framework for politeness and emotion detection in dialogues for mental health counselling and legal aid10.1016/j.eswa.2023.120025 ↗
35. Hu, Y.H., Hung, J.H., Hu, L.Y., Huang, S.Y., and Shen, C.C. (2023). An analysis of Chinese nursing electronic medical records to predict violence in psychiatric inpatients using text mining and machine learning techniques. PLoS ONE, 18.10.1371/journal.pone.0286347 ↗
36. ML-NLPEmot: Machine Learning-Natural Language Processing Event-Based Emotion Detection Proactive Framework Addressing Mental Health10.1109/ACCESS.2023.3343121 ↗
37. Orrù, G., Galli, A., Gattulli, V., Gravina, M., Micheletto, M., Marrone, S., Nocerino, W., Procaccino, A., Terrone, G., and Curtotti, D. (2023). Development of Technologies for the Detection of (Cyber)Bullying Actions: The BullyBuster Project. Information, 14.10.3390/info14080430 ↗
38. Mehta, H., and Passi, K. (2022). Social Media Hate Speech Detection Using Explainable Artificial Intelligence (XAI). Algorithms, 15.10.3390/a15080291 ↗
39. Pérez-Landa, G.I., Loyola-González, O., and Medina-Pérez, M.A. (2021). An Explainable Artificial Intelligence Model for Detecting Xenophobic Tweets. Appl. Sci., 11.10.3390/app112210801 ↗
40. Mohammadi, H., Giachanou, A., and Bagheri, A. (2024). A Transparent Pipeline for Identifying Sexism in Social Media: Combining Explainability with Model Prediction. Appl. Sci., 14.10.3390/app14198620 ↗