Attention-Based Bi-LSTM Model for Arabic Depression Classification
Source abstract
Abstract
Depression is a common mental health issue that affects a large percentage of people all around the world. Usually, people who suffer from this mood disorder have issues such as low concentration, dementia, mood swings, and even suicide. A social media platform like Twitter allows people to communicate as well as share photos and videos that reflect their moods. Therefore, the analysis of social media content provides insight into individual moods, including depression. Several studies have been conducted on depression detection in English and less in Arabic. The detection of depression from Arabic social media lags behind due the complexity of Arabic language and the lack of resources and techniques available. In this study, we performed a depression analysis on Arabic social media content to understand the feelings of the users. A bidirectional long short-term memory (Bi-LSTM) with an attention mechanism is presented to learn important hidden features for depression detection successfully. The proposed deep learning model combines an attention mechanism with a Bi-LSTM to simultaneously focus on discriminative features and learn significant word weights that contribute highly to depression detection. In order to evaluate our model, we collected a Twitter dataset of approximately 6000 tweets. The data labelling was done by manually classifying tweets as depressed or not depressed. Experimental results showed that the proposed model outperformed state-of-the-art machine learning models in detecting depression. The attention-based Bi-LSTM model achieved 0.83% accuracy on the depression detection task.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Mental Health via Writing · Digital Mental Health Interventions · Sentiment Analysis and Opinion Mining
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (49)
Show source-provided references
1. Healthy People 2010: Understanding and Improving Health · 2000
2. Suicide and primary affective disorders10.1192/bjp.117.539.437 ↗
3. The global burden of disease: A comprehensive assessment of mortality and disability from diseases, injuries, and risk factors in 1990 and projected to 2020: Summary
4. Use of multiple social media platforms and symptoms of depression and anxiety: A nationally-representative study among us young adults10.1016/j.chb.2016.11.013 ↗
5. Association between social media use and depression among us young adults10.1002/da.22466 ↗
6. Cyberbullying, depression, and problem alcohol use in female college students: A multisite study10.1089/cyber.2014.0371 ↗
7. Measuring post-traumatic stress disorder in twitter
8. Aslam, S. Twitter by the Numbers: Stats, Demographics & Fun Facts. 2021. Available online: https://www.omnicoreagency.com/twitterstatistics/#:~{}:text=Twitter%20Demographics&text=There%20ar%20262%20million%20International,users%20have%20higher%20college%20degrees (accessed on 11 February 2021).
9. Depression detection by analyzing social media posts of user
10. Depression detection using emotion artificial intelligence
11. Eye movement analysis for depression detection
12. Attention-based lstm for aspect-level sentiment classification
13. Dynamic multimodal measurement of depression severity using deep auto encoding10.1109/JBHI.2017.2676878 ↗
14. Automated depression detection using deep representation and sequence learning with eeg signals10.1007/s10916-019-1345-y ↗
15. Modelling user attitudes using hierarchical sentiment-topic model10.1016/j.datak.2019.01.005 ↗
16. Structured sentiment analysis
17. Diagnostic and statistical manual of mental disorders (dsm)10.1002/9781118410868.wbehibs011 ↗
18. Depressive moods of users portrayed in twitter
19. Depression detection via harvesting social media: A multimodal dictionary learning solution
20. A deep learning model for detecting mental illness from user content on social media
21. A multiclass depression detection in social media based on sentiment analysis
22. Analysis of public reactions to the novel coronavirus (COVID-19) outbreak on twitter10.1108/K-05-2020-0258 ↗
23. Early depression detection from social network using deep learning techniques
24. Deep learning for depression detection of twitter users
25. Erisk 2017: Clef lab on early risk prediction on the internet: Experimental foundations
26. Measuring the latency of depression detection in social media
27. Data61-csiro systems at the clpsych 2016 shared task
28. Distributed representations of sentences and documents
29. Predicting post severity in mental health forums
30. Detecting Arabic depressed users from twitter data10.1016/j.procs.2019.12.107 ↗
31. Monitoring people's emotions and symptoms from Arabic tweets during the covid-19 pandemic10.3390/info12020086 ↗
32. Neural machine translation by jointly learning to align and translate
33. Grammar as a foreign language
34. Hierarchical attention networks for document classification
35. Bidirectional lstm with attention mechanism and convolutional layer for text classification10.1016/j.neucom.2019.01.078 ↗
36. An lstm-based method with attention mechanism for travel time prediction10.3390/s19040861 ↗
37. Action recognition using visual attention
38. Automatic depression recognition using CNN with attention mechanism from videos10.1016/j.neucom.2020.10.015 ↗
39. Attention-based lstm for psychological stress detection from spoken language using distant supervision
40. Hierarchical attention transfer networks for depression assessment from speech
41. Light stemming for Arabic information retrieval10.1007/978-1-4020-6046-5_12 ↗
42. Glove: Global vectors forward representation
43. Word2vec explained: Deriving mikolov et al.'s negative-sampling word-embedding method
44. Aravec: A set of Arabic word embedding models for use in Arabic nlp10.1016/j.procs.2017.10.117 ↗
45. Long short-term memory10.1162/neco.1997.9.8.1735 ↗
46. Bidirectional recurrent neural networks10.1109/78.650093 ↗
47. Early detection of depression: Social network analysis and random forest techniques10.2196/12554 ↗
48. A boosted machine learning approach for detection of depression
49. Detection of suicide ideation in social media forums using deep learning10.3390/a13010007 ↗