journal article·2023Open access

Tackling Faceless Killers: Toxic Comment Detection to Maintain a Healthy Internet Environment

Semi Park, Kyungho Lee

Computers, Materials & Continua· Volume 76· Issue 1

Abstract

According to BBC News, online hate speech increased by 20% during the COVID-19 pandemic. Hate speech from anonymous users can result in psychological harm, including depression and trauma, and can even lead to suicide. Malicious online comments are increasingly becoming a social and cultural problem. It is therefore critical to detect such comments at the national level and detect malicious users at the corporate level. To achieve a healthy and safe Internet environment, studies should focus on institutional and technical topics. The detection of toxic comments can create a safe online environment. In this study, to detect malicious comments, we used approximately 9,400 examples of hate speech from a Korean corpus of entertainment news comments. We developed toxic comment classification models using supervised learning algorithms, including decision trees, random forest, a support vector machine, and K-nearest neighbors. The proposed model uses random forests to classify toxic words, achieving an F1-score of 0.94. We analyzed the trained model using the permutation feature importance, which is an explanatory machine learning method. Our experimental results confirmed that the toxic comment classifier properly classified hate words used in Korea. Using this research methodology, the proposed method can create a healthy Internet environment by detecting malicious comments written in Korean.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Hate Speech and Cyberbullying Detection

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (34)

Show source-provided references
1. Shiftee, “Shiftee reveals WFH big data analysis of 2020 and 2021,” 2022. [Online]. Available: https://shiftee.io/en/blog/article/shifteeWorkFromHomeBigDataNews
2. Korea Research, “[Plan] malicious comments, whether regulation and blocking are the best–A study on the perception of comments,” 2021. [Online]. Available: https://hrcopinion.co.kr/archives/17398
3. Bullying, cyberbullying, and suicide
4. From clicks to behaviors: The mediating effect of intentions to like, share, and comment on the relationship between message evaluations and offline behavioral intentions10.1080/15252019.2015.1071677 ↗
5. Leave your comment below: Can biased online comments influence our own prejudicial attitudes and behaviors?10.1111/hcre.12059 ↗
6. Adolescents’ comments in social media: Why do adolescents receive negative feedback and who is most at risk?10.1016/j.chb.2015.07.016 ↗
7. Reading others’ comments and public opinion poll results on social media: Social judgment and spiral of empowerment10.1016/j.chb.2016.09.007 ↗
8. How negative becomes less negative: Understanding the effects of comment valence and response sidedness in social media10.1111/jcom.12205 ↗
9. Dangerous minds? Effects of uncivil online comments on aggressive cognitions, emotions, and behavior10.1016/j.chb.2016.01.022 ↗
10. Waldron · The Harm in Hate Speech · 2012 · 1
11. The Financial News, “K-content exports exceed 14 trillion won in the ‘Korean Wave’,” 2022. [Online]. Available: https://www.fnnews.com/news/202201240917248024
12. Toxic comment tools: A case study
13. J. A. Leite, D. F. Silva, K. Bontcheva and C. Scarton, “Toxic language detection in social media for Brazilian Portuguese: New dataset and multilingual analysis,” arXiv preprint arXiv:2010.04543, 2020.10.18653/v1/2020.aacl-main.91 ↗
14. Detection of harassment on web 2.0
15. Automatic detection of cyberbullying in social media text
16. Abusive language detection in online user content
17. Detecting offensive language in social media to protect adolescent online safety
18. Toxic comment classification
19. Classification of online toxic comments using the logistic regression and neural networks models10.1063/1.5082126 ↗
20. Convolutional neural networks for toxic comment classification
21. H. Hosseini, S. Kannan, B. Zhang and R. Poovendran, “Deceiving google’s perspective API built for detecting toxic comments,” arXiv preprint arXiv:1702.08138, 2017.
22. J. Moon, W. I. Cho and J. Lee, “BEEP! Korean corpus of online news comments for toxic speech detection,” arXiv preprint arXiv:2005.12503, 2020.10.18653/v1/2020.socialnlp-1.4 ↗
23. A new dataset for Korean toxic comment detection
24. KOAS: Korean text offensiveness analysis system
25. International Telecommunication Union, “ITU releases 2021 global and regional ICT estimates,” 2021. [Online]. Available: https://www.itu.int/en/ITU-D/Statistics/Pages/stat/default.aspx
26. KoNLPy: Korean natural language processing in Python
27. A statistical interpretation of term specificity and its application in retrieval10.1108/eb026526 ↗
28. Interpreting TF-IDF term weights as making relevance decisions10.1145/1361684.1361686 ↗
29. Estimating the selectivity of TF-IDF based cosine similarity predicates10.1145/1328854.1328855 ↗
30. Text representation
31. Supervised machine learning: A review of classification techniques
32. Supervised machine learning approaches: A survey10.21917/ijsc.2015.0133 ↗
33. Permutation importance: A corrected feature importance measure
34. Scikit-learn, “4.2. Permutation feature importance,” 2022. [Online]. Available: https://scikit-learn.org/stable/modules/permutation_importance.html#permutation-feature-importance