Smartphone-Based Digital Phenotyping for Identifying Elevated Depressive Symptom Levels Using Machine Learning
Source abstract
Abstract
Depressive symptoms among university students are a growing public health concern, motivating unobtrusive monitoring with smartphone-based digital phenotyping. This study examined whether passively collected behavioral features can identify elevated depressive symptom risk. We collected smartphone sensing data from 36 university students over two weeks, yielding 551 participant-days. We extracted 21 digital phenotyping features, including 14 additional behavioral features and 7 baseline features. Multiple machine learning models were evaluated using repeated bootstrap validation, and participant-independent generalization was further assessed with Leave-One-Subject-Out (LOSO) validation. We also examined PHQ-9 thresholds, class-imbalance mitigation, and feature importance using SHAP. Tree-based ensemble models achieved the best performance under bootstrap validation, and the proposed feature set consistently outperformed the baseline set. However, performance dropped substantially under LOSO validation, indicating that participant-independent generalization remains challenging. Class weighting and SMOTE did not meaningfully improve performance. SHAP analysis identified home-stay behavior and time-of-day smartphone use as the most influential predictors. These findings highlight that participant-independent prediction remains challenging and underscore the importance of rigorous participant-level validation when developing smartphone-based digital phenotyping models.
Source: crossref · Quality: baseline
Affiliations
Division of Computer Science and Engineering, Sun Moon University, Asan 31460, Republic of Korea
Department of Psychiatry, Korea University Anam Hospital, Korea University College of Medicine, Seoul 02841, Republic of Korea
Funding
MSIT (Ministry of Science, ICT), Republic of Korea
References (28)
Show source-provided references
1. World Health Organization (WHO) (2026, June 06). Depressive Disorder (Depression). WHO Fact Sheet, 2025. Available online: https://www.who.int/news-room/fact-sheets/detail/depression.
2. World Health Organization (WHO) (2022). Mental Health Fact Sheet, WHO.
3. World Health Organization (2026, June 06). Mental Health of Adolescents. Available online: https://www.who.int/news-room/fact-sheets/detail/adolescent-mental-health.
4. Global prevalence and burden of depressive and anxiety disorders in 204 countries and territories in 2020 due to the COVID-19 pandemic10.1016/S0140-6736(21)02143-7 ↗
5. New Dimensions and New Tools to Realize the Potential of RDoC: Digital Phenotyping via Smartphones and Connected Devices10.1038/tp.2017.25 ↗
6. Harnessing Smartphone-Based Digital Phenotyping to Enhance Behavioral and Mental Health10.1038/npp.2016.7 ↗
7. From smartphone data to clinically relevant predictions: A systematic review of digital phenotyping methods in depression10.1016/j.neubiorev.2024.105541 ↗
8. Digital Phenotyping for Stress, Anxiety, and Mild Depression: Systematic Literature Review10.2196/40689 ↗
9. Digital biomarkers of mood disorders and symptom change10.1038/s41746-019-0078-0 ↗
10. Correlations Between Objective Behavioral Features Collected from Mobile and Wearable Devices and Depressive Mood Symptoms in Patients with Affective Disorders: Systematic Review10.2196/mhealth.9691 ↗
11. Smartphone digital phenotyping in mental health disorders: A review of raw sensors utilized, machine learning processing pipelines, and derived behavioral features10.1016/j.psychres.2025.116483 ↗
12. Smartphone-Based Digital Phenotyping Across Health Conditions: Scoping Review10.2196/84146 ↗
13. Canzian, S., and Musolesi, M. (2015). Trajectories of Depression: Unobtrusive Monitoring of Depressive States by Means of Smartphone Mobility Traces. Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp ’15), ACM.10.1145/2750858.2805845 ↗
14. Wang, R., Chen, F., Chen, Z., Li, T., Harari, G., Tignor, S., Zhou, X., Ben-Zeev, K., and Campbell, A.T. (2014). StudentLife: Assessing Mental Health, Academic Performance and Behavioral Trends of College Students Using Smartphones. Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp ’14), ACM.10.1145/2632048.2632054 ↗
15. A Fast and Minimal System to Identify Depression Using Smartphones: Explainable Machine Learning-Based Approach10.2196/28848 ↗
16. Lundberg, S.M., and Lee, S.-I. (2017). A Unified Approach to Interpreting Model Predictions. Proceedings of the 31st International Conference on Neural Information Processing Systems (NeurIPS 2017), Curran Associates, Inc.
17. Stop Explaining Black Box Machine Learning Models for High Stakes Decisions and Use Interpretable Models Instead10.1038/s42256-019-0048-x ↗
18. Mobile Phone Sensor Correlates of Depressive Symptom Severity in Daily-Life Behavior: An Exploratory Study10.2196/jmir.4273 ↗
19. Smartphone Sensor Data for Identifying and Monitoring Symptoms of Mood Disorders: A Longitudinal Observational Study10.2196/35549 ↗
20. RADAR-CNS consortium, Longitudinal Assessment of Seasonal Impacts and Depression Associations on Circadian Rhythm Using Multimodal Wearable Sensing: Retrospective Analysis10.2196/55302 ↗
21. Large-scale digital phenotyping: Identifying depression and anxiety indicators in a general UK population with over 10,000 participants10.1016/j.jad.2025.01.124 ↗
22. Interpersonal and social rhythm therapy: Managing the chaos of bipolar disorder10.1016/S0006-3223(00)00969-0 ↗
23. The origins and current status of behavioral activation treatments for depression10.1146/annurev-clinpsy-032210-104535 ↗
24. Why psychologists should by default use Welch’s t-test instead of Student’s t-test10.5334/irsp.82 ↗
25. The unequal variance t-test is an underused alternative to Student’s t-test and the Mann–Whitney U test10.1093/beheco/ark016 ↗
26. Distinguishing Common Digital Phenotyping and Self-Report Parameters for Monitoring and Predicting Depression: Scoping Review10.2196/70840 ↗
27. The Behavioral Intervention Technology Model: An Integrated Conceptual and Technological Framework for eHealth and mHealth Interventions10.2196/jmir.3077 ↗
28. Mental Health Mobile Phone App Usage, Concerns, and Benefits Among Psychiatric Outpatients: Comparative Survey Study10.2196/11715 ↗