journal article·2020-12-04Open access

Towards Automatic Depression Detection: A BiLSTM/1D CNN-Based Model

Lin Lin, Xuri Chen, Ying Shen, Lin Zhang

Applied Sciences· Volume 10· Issue 23

Abstract

Depression is a global mental health problem, the worst cases of which can lead to self-injury or suicide. An automatic depression detection system is of great help in facilitating clinical diagnosis and early intervention of depression. In this work, we propose a new automatic depression detection method utilizing speech signals and linguistic content from patient interviews. Specifically, the proposed method consists of three components, which include a Bidirectional Long Short-Term Memory (BiLSTM) network with an attention layer to deal with linguistic content, a One-Dimensional Convolutional Neural Network (1D CNN) to deal with speech signals, and a fully connected network integrating the outputs of the previous two models to assess the depressive state. Evaluated on two publicly available datasets, our method achieves state-of-the-art performance compared with the existing methods. In addition, our method utilizes audio and text features simultaneously. Therefore, it can get rid of the misleading information provided by the patients. As a conclusion, our method can automatically evaluate the depression state and does not require an expert to conduct the psychological evaluation on site. Our method greatly improves the detection accuracy, as well as the efficiency.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Mental Health via Writing · Digital Mental Health Interventions · Emotion and Mood Recognition

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Software Engineering, Tongji University, Shanghai 201804, China

Funding

the National Natural Science Foundation of China · the Natural Science Foundation of Shanghai

References (50)

Show source-provided references
1. Detecting Depression Severity from Vocal Prosody10.1109/T-AFFC.2012.38 ↗
2. (2020, June 30). Depression Overview. Available online: https://www.who.int/news-room/fact-sheets/detail/depression.
3. Early intervention for depressive disorders in young people: The opportunity and the (lack of) evidence10.5694/j.1326-5377.2007.tb01329.x ↗
4. The Effect of Exercise on Clinical Depression and Depression Resulting from Mental Illness: A Meta-Analysis10.1123/jsep.20.4.339 ↗
5. Physicians’ attitudes, diagnostic process and barriers regarding depression diagnosis in primary care: A systematic review of qualitative studies10.1093/fampra/cmr092 ↗
6. Stigma of depression: A biologist’s view10.1016/S0140-6736(98)07609-0 ↗
7. A Brief Survey of Public Knowledge and Stigma Towards Depression10.14740/jocmr3282w ↗
8. How Stigma Interferes With Mental Health Care10.1037/0003-066X.59.7.614 ↗
9. Perceived Stigma as a Predictor of Treatment Discontinuation in Young and Older Outpatients with Depression10.1176/appi.ajp.158.3.479 ↗
10. Prevention of major depression: Early detection and early intervention in the general population
11. A review of depression and suicide risk assessment using speech analysis10.1016/j.specom.2015.03.004 ↗
12. Hönig, F., Batliner, A., Nöth, E., Schnieder, S., and Krajewski, J. (2014, January 14–18). Automatic modelling of depressed speech: Relevant features and relevance of gender. Proceedings of the INTERSPEECH 2014, Singapore.10.21437/Interspeech.2014-313 ↗
13. Vocal Acoustic Biomarkers of Depression Severity and Treatment Response10.1016/j.biopsych.2012.03.015 ↗
14. Phonologically-based biomarkers for major depressive disorder10.1186/1687-6180-2011-42 ↗
15. Analysis of syntax and word use to predict successful participation in guided self-help for anxiety and depression10.1016/j.psychres.2010.04.011 ↗
16. Diagnostic classification through content analysis of patients’ speech10.1176/ajp.145.4.464 ↗
17. R, W.J., Godoy, E., Cha, M., Schwarzentruber, A., Khorrami, P., Gwon, Y., Kung, H.T., Dagli, C., and Quatieri, T.F. (2016, January 16). Detecting Depression Using Vocal, Facial and Semantic Communication Cues. Proceedings of the 6th International Workshop on Audio/Visual Emotion Challenge, Amsterdam, The Netherlands.
18. Yang, L., Jiang, D., Xia, X., Pei, X., Oveneke, M.C., and Sahli, H. (2017, January 23–27). Multimodal Measurement of Depression Using Deep Learning Models. Proceedings of the 7th Annual Workshop on Audio/Visual Emotion Challenge, Mountain View, CA, USA.10.1145/3133944.3133948 ↗
19. Al hanai, T., Ghassemi, M.M., and Glass, J.R. (2018, January 2–6). Detecting Depression with Audio/Text Sequence Modeling of Interviews. Proceedings of the INTERSPEECH 2018, Hyderabad, Indian.10.21437/Interspeech.2018-2522 ↗
20. Haque, A., Guo, M., Miner, A.S., and Li, F.F. (2018). Measuring Depression Symptom Severity from Spoken Language and 3D Facial Expressions. arXiv.
21. Cohn, J.F., Kruez, T.S., Matthews, I., Yang, Y., Nguyen, M.H., Padilla, M.T., Zhou, F., and De La Torre, F. (2009, January 10–12). Detecting depression from facial actions and vocal prosody. Proceedings of the 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops, Amsterdam, The Netherlands.10.1109/ACII.2009.5349358 ↗
22. Multimodal Assistive Technologies for Depression Diagnosis and Monitoring10.1007/s12193-013-0123-2 ↗
23. Automatic audiovisual behavior descriptors for psychological disorder analysis10.1016/j.imavis.2014.06.001 ↗
24. Morales, M.R., Scherer, S., and Levitan, R. (2017, January 20–24). OpenMM: An Open-Source Multimodal Feature Extraction Tool. Proceedings of the INTERSPEECH 2017, Stockholm, Sweden.10.21437/Interspeech.2017-1382 ↗
25. Analysis of Acoustic Space Variability in Speech Affected by Depression10.1016/j.specom.2015.09.003 ↗
26. Meng, H., Huang, D., Wang, H., Yang, H., AI-Shuraifi, M., and Wang, Y. (2013, January 21–25). Depression Recognition Based on Dynamic Facial and Vocal Expression Features Using Partial Least Square Regression. Proceedings of the 3rd ACM international workshop on Audio/visual emotion challenge, Barcelona, Spain.10.1145/2512530.2512532 ↗
27. Effect of the addition of a “help” question to two screening questions on specificity for diagnosis of depression in general practice: Diagnostic validity study10.1136/bmj.38607.464537.7C ↗
28. Yang, L., Jiang, D., He, L., Pei, E., Oveneke, M.C., and Sahli, H. (2016, January 16). Decision Tree Based Depression Classification from Audio Video and Language Information. Proceedings of the 6th International Workshop on Audio/Visual Emotion Challenge, Amsterdam, The Netherlands.10.1145/2988257.2988269 ↗
29. Sun, B., Zhang, Y., He, J., Yu, L., Xu, Q., Li, D., and Wang, Z. (2017, January 23–27). A Random Forest Regression Method With Selected-Text Feature For Depression Assessment. Proceedings of the 7th Annual Workshop on Audio/Visual Emotion Challenge, Mountain View, CA, USA.10.1145/3133944.3133951 ↗
30. Gong, Y., and Poellabauer, C. (2017, January 23–27). Topic Modeling Based Multi-Modal Depression Detection. Proceedings of the 7th Annual Workshop on Audio/Visual Emotion Challenge, Mountain View, CA, USA.10.1145/3133944.3133945 ↗
31. Mendels, G., Levitan, S.I., Lee, K.Z., and Hirschberg, J. (2017, January 20–24). Hybrid Acoustic-Lexical Deep Learning Approach for Deception Detection. Proceedings of the INTERSPEECH 2017, Stockholm, Sweden.10.21437/Interspeech.2017-1723 ↗
32. Lam, G., Huang, D.Y., and Lin, W.S. (2019, January 12–17). Context-aware Deep Learning for Multi-modal Depression Detection. Proceedings of the Icassp IEEE International Conference on Acoustics, Brighton, UK.10.1109/ICASSP.2019.8683027 ↗
33. Ma, X., Yang, H., Chen, Q., Huang, D., and Wang, Y. (2016, January 16). DepAudioNet: An Efficient Deep Model for Audio Based Depression Classification. Proceedings of the 6th International Workshop on Audio/Visual Emotion Challenge, Amsterdam, The Netherlands.10.1145/2988257.2988267 ↗
34. Dinkel, H., Wu, M., and Yu, K. (2019). Text-based Depression Detection: What Triggers An Alert. arXiv.
35. Automated screening for distress: A perspective for the future10.1111/ecc.13033 ↗
36. Valstar, M., Gratch, J., Schuller, B., Ringeval, F., Lalanne, D., Torres, M., Scherer, S., Stratou, G., Cowie, R., and Pantic, M. (2016, January 16). AVEC 2016: Depression, Mood, and Emotion Recognition Workshop and Challenge. Proceedings of the 6th International Workshop on Audio/Visual Emotion Challenge, Amsterdam, The Netherlands.10.1145/2964284.2980532 ↗
37. Peters, M.E., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., and Zettlemoyer, L. (2018). Deep Contextualized Word Representations. arXiv.10.18653/v1/N18-1202 ↗
38. Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2019). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. arXiv.
39. Gratch, J., Arstein, R., Lucas, G.M., Stratou, G., Scherer, S., Nazarian, A., Wood, R., Boberg, J., DeVault, D., and Marsella, S. (2014, January 26–31). The Distress Analysis Interview Corpus of human and computer interviews. Proceedings of the LREC, Reykjavik, Iceland.
40. Valstar, M., Schuller, B., Smith, K., Eyben, F., Jiang, B., Bilakhia, S., Schnieder, S., Cowie, R., and Pantic, M. (2013, January 21–25). AVEC 2013: The Continuous Audio/Visual Emotion and Depression Recognition Challenge. Proceedings of the 3rd ACM International Workshop on Audio/Visual Emotion Challenge, Barcelona, Spain.10.1145/2512530.2512533 ↗
41. Cognitive Therapy and Pharmacotherapy for Depression: Singly and in Combination10.1001/archpsyc.1992.01820100018004 ↗
42. Alghowinem, S., Goecke, R., Wagner, M., Epps, J., Gedeon, T., Breakspear, M., and Parker, G. (2013, January 26–31). A Comparative Study of Different Classifiers for Detecting Depression from Spontaneous Speech. Proceedings of the 2013 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Vancouver, BC, Canada.10.1109/ICASSP.2013.6639227 ↗
43. Aman, F., Vacher, M., Rossato, S., and Portet, F. (2013, January 16–19). Speech Recognition of Aged Voices in the AAL Context: Detection of Distress Sentences. Proceedings of the 2013 7th Conference on Speech Technology and Human—Computer Dialogue (SpeD), Cluj-Napoca, Romania.10.1109/SpeD.2013.6682669 ↗
44. Scherer, S., Stratou, G., Gratch, J., and Morency, L.P. (2013, January 25–29). Investigating voice quality as a speaker-independent indicator of depression and PTSD. Proceedings of the INTERSPEECH 2013, Lyon, France.10.21437/Interspeech.2013-240 ↗
45. Screening for Depression in Medical Settings with the Patient Health Questionnaire (PHQ): A Diagnostic Meta-Analysis10.1007/s11606-007-0333-y ↗
46. DeVault, D., Artstein, R., Benn, G., Dey, T., Fast, E., and Gainer, A. (2014, January 5–9). SimSensei Kiosk: A Virtual Human Interviewer for Healthcare Decision Support. Proceedings of the 2014 International Conference on Autonomous Agents and Multi-Agent Systems, Paris, France.
47. Valstar, M., Schuller, B., Smith, K., Almaev, T., Eyben, F., Krajewski, J., Cowie, R., and Pantic, M. (2014, January 7). AVEC 2014: 3D Dimensional Affect and Depression Recognition Challenge. Proceedings of the 4th International Workshop on Audio/Visual Emotion Challenge, Orlando, FL, USA.
48. Comparison of Self-Report and Clinician Ratings on Two Inventories of Depressive Symptomatology10.1176/ps.2006.57.6.829 ↗
49. (2020, April 17). Depression Detect. Available online: https://github.com/kykiefer/depression-detect.
50. Feature Augmenting Networks for Improving Depression Severity Estimation from Speech Signals10.1109/ACCESS.2020.2970496 ↗