journal article·2024-10-29Open access

Detecting Suicidal Ideations in Online Forums with Textual and Psycholinguistic Features

Eldar Yeskuatov, Sook-Ling Chua, Lee Kien Foo

Applied Sciences· Volume 14· Issue 21

Abstract

Suicide is a global public health problem that takes hundreds of thousands of lives each year. The key to effective suicide prevention is early detection of suicidal ideations and timely intervention. However, several factors hinder traditional suicide risk screening methods. Primarily, the social stigma associated with suicide presents a challenge to suicidal ideation detection, as existing methods require patients to explicitly communicate their suicidal propensities. In contrast, progressively more at-risk people choose online platforms—such as Reddit—as their preferred avenues for sharing their suicidal experiences and seeking emotional support. As a result, these online platforms have become an unobtrusive source of user-generated textual data that can be used to detect suicidality with supervised machine learning and natural language processing techniques. In this paper, we proposed a suicidal ideation detection approach that combines textual and psycholinguistic features extracted from the Reddit forum. Subsequently, we selected the most informative features using the Boruta algorithm and employed four classifiers: logistic regression, naïve Bayes, support vector machines, and random forest. The naïve Bayes models trained with the combination of term frequency-inverse document frequency (TF-IDF) and National Research Council (NRC) features demonstrated the highest performance, obtaining a F1 score of 70.99%. Our experimental results illustrate that a combination of textual and psycholinguistic features yields better classification performance compared to using those features separately.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Mental Health via Writing · Suicide and Self-Harm Studies · Sentiment Analysis and Opinion Mining

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Faculty of Computing and Informatics, Multimedia University, Persiaran Multimedia, Cyberjaya 63100, Malaysia

Funding

Telekom Malaysia

References (42)

Show source-provided references
1. World Health Organization (2021). Suicide Worldwide in 2019: Global Health Estimates, World Health Organization.
2. World Health Organization (2014). Preventing Suicide: A Global Imperative, World Health Organization.
3. The Psychology of Suicidal Behaviour10.1016/S2215-0366(14)70222-6 ↗
4. American Foundation for Suicide Prevention (2024). Risk Factors, Protective Factors, and Warning Signs, American Foundation for Suicide Prevention. Available online: https://afsp.org/risk-factors-protective-factors-and-warning-signs/.
5. Suicide Risk Assessment Using Machine Learning and Social Networks: A Scoping Review10.1007/s10916-020-01669-5 ↗
6. Harmer, B., Lee, S., Duong, T.v.H., and Saadabadi, A. (2022). Suicidal Ideation. StatPearls, StatPearls Publishing.
7. Passive Suicidal Ideation: Still a High-Risk Clinical Scenario
8. World Health Organization (2021). LIVE LIFE: An Implementation Guide for Suicide Prevention in Countries, World Health Organization.
9. Suicidal Ideation Detection: A Review of Machine Learning Methods and Applications10.1109/TCSS.2020.3021467 ↗
10. Gaur, M., Aribandi, V., Alambo, A., Kursuncu, U., Thirunarayan, K., Beich, J., Pathak, J., and Sheth, A. (2021). Characterization of Time-Variant and Time-Invariant Assessment of Suicidality on Reddit Using C-SSRS. PLoS ONE, 16.10.1371/journal.pone.0250448 ↗
11. Alambo, A., Gaur, M., Lokala, U., Kursuncu, U., Thirunarayan, K., Gyrard, A., Sheth, A., Welton, R.S., and Pathak, J. (February, January 30). Question Answering for Suicide Risk Assessment Using Reddit. Proceedings of the 2019 IEEE 13th International Conference on Semantic Computing (ICSC), Newport Beach, CA, USA.10.1109/ICOSC.2019.8665525 ↗
12. Supervised Learning for Suicidal Ideation Detection in Online User Content10.1155/2018/6157249 ↗
13. Gaur, M., Alambo, A., Sain, J.P., Kursuncu, U., Thirunarayan, K., Kavuluru, R., Sheth, A., Welton, R., and Pathak, J. (2019, January 13–17). Knowledge-Aware Assessment of Severity of Suicide Risk for Early Intervention. Proceedings of the World Wide Web Conference—WWW ′19, San Francisco, CA, USA.10.1145/3308558.3313698 ↗
14. An Ensemble Deep Learning Technique for Detecting Suicidal Ideation from Posts in Social Media Platforms
15. Tadesse, M.M., Lin, H., Xu, B., and Yang, L. (2019). Detection of Suicide Ideation in Social Media Forums Using Deep Learning. Algorithms, 13.10.3390/a13010007 ↗
16. Nikhileswar, K., Vishal, D., Sphoorthi, L., and Fathimabi, S. (2021, January 7–9). Suicide Ideation Detection in Social Media Forums. Proceedings of the 2021 2nd International Conference on Smart Electronics and Communication (ICOSEC), Trichy, India.10.1109/ICOSEC51865.2021.9591887 ↗
17. Gender-Specific Factors of Suicidal Ideation among High School Students in Yunnan Province, China: A Machine Learning Approach10.1016/j.jad.2024.08.072 ↗
18. Predictive Modelling of Deliberate Self-Harm and Suicide Attempts in Young People Accessing Primary Care: A Machine Learning Analysis of a Longitudinal Study10.1007/s00127-022-02415-7 ↗
19. Detecting Suicidal Ideation on Forums: Proof-of-Concept Study10.2196/jmir.9840 ↗
20. Bitew, S.K., Bekoulis, G., Deleu, J., Sterckx, L., Zaporojets, K., Demeester, T., and Develder, C. (2019, January 6). Predicting Suicide Risk from Online Postings in Reddit The UGent-IDLab Submission to the CLPysch 2019 Shared Task, A. Proceedings of the Sixth Workshop on Computational Linguistics and Clinical Psychology, Minneapolis, MN, USA.10.18653/v1/W19-3019 ↗
21. Shing, H.-C., Nair, S., Zirikly, A., Friedenberg, M., Daumé, H., and Resnik, P. (2018, January 5). Expert, Crowdsourced, and Machine Assessment of Suicide Risk via Online Postings. Proceedings of the Fifth Workshop on Computational Linguistics and Clinical Psychology: From Keyboard to Clinic, New Orleans, LA, USA.10.18653/v1/W18-0603 ↗
22. Ríssola, E., Ramírez-Cifuentes, D., Freire, A., and Crestani, F. (2019, January 6). Suicide Risk Assessment on Social Media: USI-UPF at the CLPsych 2019 Shared Task. Proceedings of the Sixth Workshop on Computational Linguistics and Clinical Psychology, Minneapolis, MN, USA.10.18653/v1/W19-3021 ↗
23. Shah, F.M., Haque, F., Un Nur, R., Al Jahan, S., and Mamud, Z. (2020, January 5–7). A Hybridized Feature Extraction Approach to Suicidal Ideation Detection from Social Media Post. Proceedings of the 2020 IEEE Region 10 Symposium (TENSYMP), Dhaka, Bangladesh.10.1109/TENSYMP50017.2020.9230733 ↗
24. Detection of Suicidality Among Opioid Users on Reddit: Machine Learning-Based Approach10.2196/15293 ↗
25. Aldhyani, T.H.H., Alsubari, S.N., Alshebami, A.S., Alkahtani, H., and Ahmed, Z.A.T. (2022). Detecting and Analyzing Suicidal Ideation on Social Media Using Deep Learning and Machine Learning Models. Int. J. Environ. Res. Public Health, 19.10.3390/ijerph191912635 ↗
26. Ambalavanan, A.K., Jagtap, P.D., Adhya, S., and Devarakonda, M. (2019, January 6). Using Contextual Representations for Suicide Risk Assessment from Internet Forums. Proceedings of the Sixth Workshop on Computational Linguistics and Clinical Psychology, Minneapolis, MN, USA.10.18653/v1/W19-3022 ↗
27. Matero, M., Idnani, A., Son, Y., Giorgi, S., Vu, H., Zamani, M., Limbachiya, P., Guntuku, S.C., and Schwartz, H.A. (2019, January 6). Suicide Risk Assessment with Multi-Level Dual-Context Language and BERT. Proceedings of the Sixth Workshop on Computational Linguistics and Clinical Psychology, Minneapolis, MN, USA.10.18653/v1/W19-3005 ↗
28. Haque, F., Nur, R.U., Jahan, S.A., Mahmud, Z., and Shah, F.M. (2020, January 19–21). A Transformer Based Approach to Detect Suicidal Ideation Using Pre-Trained Language Models. Proceedings of the 2020 23rd International Conference on Computer and Information Technology (ICCIT), Dhaka, Bangladesh.10.1109/ICCIT51783.2020.9392692 ↗
29. van Kooten, P. (2023, March 15). Contractions. Available online: https://github.com/kootenpv/contractions.
30. Liu, M. (2023). Are You Really Smiling? Display Rules for Emojis and the Relationship between Emotion Management and Psychological Well-Being. Front. Psychol., 14.10.3389/fpsyg.2023.1035742 ↗
31. Montani, I., Honnibal, M., Honnibal, M., Boyd, A., Van Landeghem, S., and Peters, H. (2023, March 15). spaCy: Industrial-Strength Natural Language Processing in Python. Available online: https://github.com/explosion/spaCy.
32. Scikit-Learn: Machine Learning in Python
33. The Psychological Meaning of Words: LIWC and Computerized Text Analysis Methods10.1177/0261927X09351676 ↗
34. Boyd, R.L., Ashokkumar, A., Seraj, S., and Pennebaker, J.W. (2022). The Development and Psychometric Properties of LIWC-22, University of Texas at Austin.
35. Mohammad, S.M. (2018, January 7–12). Word Affect Intensities. Proceedings of the 11th Edition of the Language Resources and Evaluation Conference (LREC-2018), Miyazaki, Japan.
36. Mohammad, S.M. (2018, January 15–20). Obtaining Reliable Human Ratings of Valence, Arousal, and Dominance for 20,000 English Words. Proceedings of the Annual Conference of the Association for Computational Linguistics (ACL), Melbourne, Australia.10.18653/v1/P18-1017 ↗
37. The Nature of Emotions: Human Emotions Have Deep Evolutionary Roots, a Fact That May Explain Their Complexity and Provide Tools for Clinical Practice10.1511/2001.28.344 ↗
38. Vishnubhotla, K., and Mohammad, S.M. (2022, January 20–25). Tweet Emotion Dynamics: Emotion Word Usage in Tweets from US and Canada. Proceedings of the Thirteenth International Conference on Language Resources and Evaluation (LREC 2022), Marseille, France.
39. Boruta—A System for Feature Selection10.3233/FI-2010-288 ↗
40. Homola, D. (2023, April 06). BorutaPy. Available online: https://github.com/scikit-learn-contrib/boruta_py.
41. In an Absolute State: Elevated Use of Absolutist Words Is a Marker Specific to Anxiety, Depression, and Suicidal Ideation10.1177/2167702617747074 ↗
42. Cognitive Distortions, Humor Styles, and Depression10.5964/ejop.v12i3.1118 ↗