journal article·2024-12-16Open access

Machine Learning Methods in Student Mental Health Research: An Ethics-Centered Systematic Literature Review

Mohamed Drira, Sana Ben Hassine, Michael Zhang, Steven Smith

Applied Sciences· Volume 14· Issue 24

Abstract

This study conducts an ethics-centered analysis of the AI/ML models used in Student Mental Health (SMH) research, considering the ethical principles of fairness, privacy, transparency, and interpretability. First, this paper surveys the AI/ML methods used in the extant SMH literature published between 2015 and 2024, as well as the main health outcomes, to inform future work in the SMH field. Then, it leverages advanced topic modeling techniques to depict the prevailing themes in the corpus. Finally, this study proposes novel measurable privacy, transparency (reporting and replicability), interpretability, and fairness metrics scores as a multi-dimensional integrative framework to evaluate the extent of ethics awareness and consideration in AI/ML-enabled SMH research. Findings show that (i) 65% of the surveyed papers disregard the privacy principle; (ii) 59% of the studies use black-box models resulting in low interpretability scores; and (iii) barely 18% of the papers provide demographic information about participants, indicating a limited consideration of the fairness principle. Nonetheless, the transparency principle is implemented at a satisfactory level with mean reporting and replicability scores of 80%. Overall, our results suggest a significant lack of awareness and consideration for the ethical principles of privacy, fairness, and interpretability in AI/ML-enabled SMH research. As AI/ML continues to expand in SMH, incorporating ethical considerations at every stage—from design to dissemination—is essential for producing ethically responsible and reliable research.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Artificial Intelligence in Healthcare and Education · Ethics in Clinical Research · Mental Health via Writing

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Sobey School of Business, Saint Mary’s University, Halifax, NS B3H 3C3, Canada

School of Management, University of Quebec at Montreal, Montreal, QC H2L 2C4, Canada

Faculty of Science, Saint Mary’s University, Halifax, NS B3H 3C3, Canada

Funding

Social Sciences and Humanities Research Council of Canada · University of Quebec at Montreal (Fund C)

References (100+)

Show source-provided references
1. Machine learning for sociology10.1146/annurev-soc-073117-041106 ↗
2. With an eye to AI and autonomous diagnosis10.1038/s41746-018-0048-y ↗
3. Knight, W. (2024, November 14). The Apple Card Didn’t ‘See’ Gender—And That’s the Problem. Wired. Available online: https://www.wired.com/story/the-apple-card-didnt-see-genderand-thats-the-problem/.
4. Engel, C., Linhardt, L., and Schubert, M. (2024). Code is law: How COMPAS affects the way the judiciary handles the risk of recidivism. Artif. Intell. Law.10.1007/s10506-024-09389-8 ↗
5. Why has it taken so long for biological psychiatry to develop clinical tests and what to do about it?10.1038/mp.2012.105 ↗
6. Biomarkers in psychiatry10.1038/460202a ↗
7. Neural state machine for character-scene interactions10.1145/3355089.3356505 ↗
8. Machine learning for precision psychiatry: Opportunities and challenges
9. Making individual prognoses in psychiatry using neuroimaging and machine learning
10. Machine learning in mental health: A scoping review of methods and applications10.1017/S0033291719000151 ↗
11. Deep learning in mental health outcome research: A scoping review10.1038/s41398-020-0780-3 ↗
12. Fairness in machine learning with tractable models10.1016/j.knosys.2020.106715 ↗
13. Psychiatric illnesses as disorders of network dynamics
14. Effects of COVID-19 on college students’ mental health in the United States: Interview survey study10.2196/21279 ↗
15. Machine learning in mental health: A systematic review of the HCI literature to support the development of effective and implementable ML systems
16. Overviews in education research: A systematic review and analysis10.3102/0034654316631117 ↗
17. Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement10.7326/0003-4819-151-4-200908180-00135 ↗
18. When beauty is but skin deep: Dealing with problematic studies in systematic reviews
19. Modeling stress with social media around incidents of gun violence on college campuses10.1145/3134727 ↗
20. Bagroy, S., Kumaraguru, P., and De Choudhury, M. (2017, January 6–11). A social media-based index of mental well-being in college campuses. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Denver, CO, USA.10.1145/3025453.3025909 ↗
21. Kumar, S., Varshney, D., Dhawan, G., and Jalutharia, H. (2020, January 13–15). Analyzing the effective psychological state of students using facial features. Proceedings of the 2020 4th International Conference on Intelligent Computing and Control Systems (ICICCS), Madurai, India.10.1109/ICICCS48265.2020.9120909 ↗
22. A depression recognition method for college students using deep integrated support vector algorithm10.1109/ACCESS.2020.2987523 ↗
23. Choudhury, A.A., Khan MR, H., Nahim, N.Z., Tulon, S.R., Islam, S., and Chakrabarty, A. (2019, January 7–9). Predicting Depression in Bangladeshi Undergraduates using Machine Learning. Proceedings of the 2019 IEEE Region 10 Symposium (TENSYMP), Kolkata, India.10.1109/TENSYMP46218.2019.8971369 ↗
24. Zhang, Y., Ma, P., and Gao, Q. (2019, January 25–27). Multiple classification models-based student’s phobia prediction study. Proceedings of the 2019 Third IEEE International Conference on Robotic Computing (IRC), Naples, Italy.10.1109/IRC.2019.00109 ↗
25. Jaques, N., Taylor, S., Azaria, A., Ghandeharioun, A., Sano, A., and Picard, R. (2015, January 21–24). Predicting students’ happiness from physiology, phone, mobility, and behavioral data. Proceedings of the 2015 International Conference on Affective Computing and Intelligent Interaction (ACII), Xi’an, China.10.1109/ACII.2015.7344575 ↗
26. Egilmez, B., Poyraz, E., Zhou, W., Memik, G., Dinda, P., and Alshurafa, N. (2017, January 13–17). UStress: Understanding college student subjective stress using wrist-based passive sensing. Proceedings of the 2017 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops), Kona, HI, USA.10.1109/PERCOMW.2017.7917644 ↗
27. Bian, J., Barnes, L.E., Chen, G., and Xiong, H. (2017, January 16–19). Early detection of diseases using electronic health records data and covariance-regularized linear discriminant analysis. Proceedings of the 2017 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI), Orlando, FL, USA.10.1109/BHI.2017.7897304 ↗
28. Gjoreski, M., Gjoreski, H., Lutrek, M., and Gams, M. (2015, January 15–17). Automatic detection of perceived stress in campus students using smartphones. Proceedings of the 2015 International Conference on Intelligent Environments, Prague, Czech Republic.10.1109/IE.2015.27 ↗
29. Depression prevalence in postgraduate students and its association with gait abnormality10.1109/ACCESS.2019.2957179 ↗
30. CRLEDD: Regularized causalities learning for early detection of diseases using electronic health record (EHR) data10.1109/TETCI.2020.3010017 ↗
31. Using machine learning to model problematic smartphone use severity: The significant role of fear of missing out10.1016/j.addbeh.2019.106261 ↗
32. Mild depression detection of college students: An EEG-based solution with free viewing tasks10.1007/s10916-015-0345-9 ↗
33. Predicting depressive symptoms using smartphone data10.1016/j.smhl.2019.100093 ↗
34. Mental stress detection in university students using machine learning algorithms10.1016/j.procs.2019.05.007 ↗
35. Li, J., Galley, M., Brockett, C., Spithourakis, G.P., Gao, J., and Dolan, B. (2016). A persona-based neural conversation model. arXiv.10.18653/v1/P16-1094 ↗
36. Rodríguez-Arce, J., Lara-Flores, L., Portillo-Rodríguez, O., and Martínez-Méndez, R. (2020). Towards an anxiety and stress recognition system for academic environments based on physiological features. Comput. Methods Programs Biomed., 190.10.1016/j.cmpb.2020.105408 ↗
37. Mir, A.A., Gladson, J.N., and Mohapatra, S.K. (2023, January 16–17). Comparative analysis of mental health disorder in higher education students using predictive algorithms. Proceedings of the 2023 International Conference on Applied Intelligence and Sustainable Computing (ICAISC), Dharwad, India.10.1109/ICAISC58445.2023.10199947 ↗
38. Saraswathi, K., Srinidhi, S., and Devadharshini, B. (2023, January 23–25). Prediction on impact of electronic gadgets in students’ life using machine learning. Proceedings of the 2023 7th International Conference on Computing Methodologies and Communication (ICCMC), Erode, India.
39. Rubaiyat, N., Apsara, A.I., Chaki, D., Arif, H., Israt, L., Kabir, L., and Alam, M.G.R. (2019, January 18–20). Classification of depression, internet addiction and prediction of self-esteem among university students. Proceedings of the 2019 22nd International Conference on Computer and Information Technology (ICCIT), Dhaka, Bangladesh.10.1109/ICCIT48885.2019.9038211 ↗
40. Monisha, S., Meera, R., Swaminath, R.V., and Raj, L.A. (2020, January 22–24). Predictive Analysis of Student Stress Level Using Naïve Bayesian Classification Algorithm. Proceedings of the 2020 International Conference on Computer Communication and Informatics (ICCCI), Coimbatore, India.10.1109/ICCCI48352.2020.9104113 ↗
41. Prediction of stress levels with LSTM and passive mobile sensors10.1016/j.procs.2019.09.221 ↗
42. Geng, H., and Guang-yu, L. (2019, January 9–12). The Connotation and Strategy of College Students’ Behavior Analysis under the Background of Big Data. Proceedings of the 2019 International Conference on Big Data and Education, Los Angeles, CA, USA.10.1145/3322134.3322135 ↗
43. Prediction of adolescent subjective well-being: A machine learning approach10.1136/gpsych-2019-100096 ↗
44. Predicting psychological state among Chinese undergraduate students in the COVID-19 epidemic: A longitudinal study using machine learning10.2147/NDT.S262004 ↗
45. Affective computational model to extract natural affective states of students with Asperger Syndrome (AS) in computer-based learning environment10.1109/ACCESS.2018.2879619 ↗
46. Patel, F., Thakore, R., Nandwani, I., and Bharti, S.K. (2019, January 13–15). Combating depression in students using an intelligent chatbot: A cognitive behavioral therapy. Proceedings of the 2019 IEEE 16th India Council International Conference (INDICON), Rajkot, India.10.1109/INDICON47234.2019.9030346 ↗
47. Seth, A., Babu, B.S., and Iyenger, S.S. (2019, January 20–21). Machine learning model for predicting insomnia levels in Indian college students. Proceedings of the 2019 4th International Conference on Computational Systems and Information Technology for Sustainable Solution (CSITSS), Bengaluru, India.10.1109/CSITSS47250.2019.9031041 ↗
48. Sunthad, K., Niitsu, Y., Inoue, M., and Yokemura, T. (2019, January 11–13). Brain’s stress observation system using 2-channels NIRS based on classroom activity. Proceedings of the 2019 IEEE International Conference on Consumer Electronics (ICCE), Las Vegas, NV, USA.10.1109/ICCE.2019.8662117 ↗
49. Liang, L., Zheng, Y., Ge, Q., and Zhang, F. (2022). Exploration and strategy analysis of mental health education for students in sports majors in the era of artificial intelligence. Front. Psychol., 12.10.3389/fpsyg.2021.762725 ↗
50. Sarsembayeva, T., Mansurova, M., Sarsembayev, M., and Ibrayeva, A. (2024, January 29–31). Research on improving the quality of life of students using machine learning and developing a digital health profile. Proceedings of the 2024 IEEE 12th International Conference on Intelligent Systems (IS), Varna, Bulgaria.10.1109/IS61756.2024.10705244 ↗
51. Patterns of adverse childhood experiences and associations with lower mental well-being among university students10.1016/j.chiabu.2024.106770 ↗
52. Yadav, M., Behzadan, A., and Chaspari, T. (2019, January 25–27). Speak up! Studying the interplay of individual and contextual factors to physiological-based models of public speaking anxiety. Proceedings of the 2019 First International Conference on Transdisciplinary AI (TransAI), Laguna Hills, CA, USA.10.1109/TransAI46475.2019.00017 ↗
53. Mental distress, help seeking, and use of health services among university students. The SHoT-Study 2018, Norway10.3389/fpsyt.2021.727237 ↗
54. Discovery of depression-associated factors among childhood trauma victims from a large sample size: Using machine learning and network analysis10.1016/j.jad.2023.10.101 ↗
55. Machine learning-enabled mental health risk prediction for youths with stressful life events: A modeling study10.1016/j.jad.2024.09.111 ↗
56. Thanasekhar, B., Gomathy, N., Kiruthika, A., and Swarnalaxmi, S. (2019, January 18–20). Machine learning-based academic stress management system. Proceedings of the 2019 11th International Conference on Advanced Computing (ICoAC), Chennai, India.10.1109/ICoAC48765.2019.246831 ↗
57. Rojas, J.A.R., Rosas, J., Shen, Y., Jin, H., and Dey, A.K. (2020, January 23–27). Activity recommendation: Optimizing life in the long term. Proceedings of the 2020 IEEE International Conference on Pervasive Computing and Communications (PerCom), Austin, TX, USA.
58. Mining critical least association rules from students suffering study anxiety datasets10.1007/s11135-014-0125-5 ↗
59. Hao, F., Zhao, L., Xu, T., and Dong, X. (2018, January 28–30). Application of negative and positive association rules in mental health analysis of college students. Proceedings of the 2018 14th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD), Huangshan, China.10.1109/FSKD.2018.8687181 ↗
60. Qiu, J. (2018, January 10–11). Design of psychological data management system for university students based on data mining. Proceedings of the 2018 International Conference on Virtual Reality and Intelligent Systems (ICVRIS), Hunan, China.10.1109/ICVRIS.2018.00126 ↗
61. Immersive artificial intelligence technology based on entertainment game experience in simulation of psychological health testing for university students10.1016/j.entcom.2024.100839 ↗
62. Edirisooriya, Y.L., Rathnayake, N.A., Ariyasena, T.D., Thelijjagoda, S.S., Jayawickrama, N.D., and Chamindi, D.I. (2019, January 18–20). Smartphone-based approach to enhance mindfulness among undergraduates with stress. Proceedings of the 2019 14th Conference on Industrial and Information Systems (ICIIS), Kandy, Sri Lanka.10.1109/ICIIS47346.2019.9063251 ↗
63. Flores, A., Alfaro, L., and Herrera, J. (2019, January 17–20). Proposal model for e-learning based on case-based reasoning and reinforcement learning. Proceedings of the 2019 IEEE World Conference on Engineering Education (EDUNINE), Lima, Peru.10.1109/EDUNINE.2019.8875800 ↗
64. Yu, H., Klerman, E.B., Picard, R.W., and Sano, A. (2019, January 19–22). Personalized wellbeing prediction using behavioral, physiological, and weather data. Proceedings of the 2019 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI), Chicago, IL, USA.10.1109/BHI.2019.8834456 ↗
65. Devi, S., Kumar, S., and Kushwaha, G.S. (2016, January 14–16). An adaptive neuro-fuzzy inference system for prediction of anxiety of students. Proceedings of the 2016 Eighth International Conference on Advanced Computational Intelligence (ICACI), Chiang Mai, Thailand.10.1109/ICACI.2016.7449795 ↗
66. Smart literature review: A practical topic modelling approach to exploratory literature review10.1186/s40537-019-0255-7 ↗
67. Latent Dirichlet allocation
68. Albalawi, R., Yeap, T.H., and Benyoucef, M. (2020). Using topic modeling methods for short-text data: A comparative analysis. Front. Artif. Intell., 3.10.3389/frai.2020.00042 ↗
69. Chuang, J., Manning, C.D., and Heer, J. (2012, January 21–25). Termite: Visualization techniques for assessing textual topic models. Proceedings of the AVI’12: International Working Conference on Advanced Visual Interfaces, Capri Island, Italy.10.1145/2254556.2254572 ↗
70. The global landscape of AI ethics guidelines10.1038/s42256-019-0088-2 ↗
71. SHIFTing artificial intelligence to be responsible in healthcare: A systematic review10.1016/j.socscimed.2022.114782 ↗
72. Improving the process of research ethics review10.1186/s41073-017-0038-7 ↗
73. Ethical dilemmas posed by mobile health and machine learning in psychiatry research10.2471/BLT.19.237107 ↗
74. The mythos of model interpretability: In machine learning, the concept of interpretability is both important and slippery10.1145/3236386.3241340 ↗
75. Cerquitelli, T., Quercia, D., and Pasquale, F. (2017). The tyranny of data? The bright and dark sides of data-driven decision-making for social good. Transparent Data Mining for Big and Small Data, Springer.10.1007/978-3-319-54024-5 ↗
76. Methods for interpreting and understanding deep neural networks10.1016/j.dsp.2017.10.011 ↗
77. Mittelstadt, B., Russell, C., and Wachter, S. (2019, January 29–31). Explaining explanations in AI. Proceedings of the FAT* ’19: Conference on Fairness, Accountability, and Transparency, Atlanta, GA, USA.10.1145/3287560.3287574 ↗
78. Methods in predictive techniques for mental health status on social media: A critical review10.1038/s41746-020-0233-7 ↗
79. Lones, M.A. (2021). How to avoid machine learning pitfalls: A guide for academic researchers. arXiv.
80. Albertoni, R., Colantonio, S., Skrzypczyński, P., and Stefanowski, J. (2023). Reproducibility of machine learning: Terminology, recommendations and open issues. arXiv.
81. Stop explaining black box machine learning models for high-stakes decisions and use interpretable models instead10.1038/s42256-019-0048-x ↗
82. Science and privacy: Data protection laws and their impact on research
83. Under-representation of women in research: A status-quo that is a scandal10.1136/bmj.p2091 ↗
84. An introduction to generative artificial intelligence in mental health care: Considerations and guidance10.1007/s11920-023-01477-x ↗
85. The scored society: Due process for automated predictions
86. A critical review on the use (and misuse) of differential privacy in machine learning
87. Advances and open problems in federated learning. Found10.1561/2200000083 ↗
88. Differentially private synthetic medical data generation using convolutional GANs10.1016/j.ins.2021.12.018 ↗
89. Towards a holistic view of bias in machine learning: Bridging algorithmic fairness and imbalanced learning10.1007/s44248-024-00007-1 ↗
90. Mitchell, M., Wu, S., Zaldivar, A., Barnes, P., Vasserman, L., Hutchinson, B., Spitzer, E., Raji, I.D., and Gebru, T. (2019, January 29–31). Model cards for model reporting. Proceedings of the FAT* ’19: Conference on Fairness, Accountability, and Transparency, Atlanta, GA, USA.10.1145/3287560.3287596 ↗
91. Raji, I.D., and Buolamwini, J. (2019, January 27–28). Actionable auditing: Investigating the impact of publicly naming biased performance results of commercial AI products. Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society, Honolulu, HI, USA.10.1145/3306618.3314244 ↗
92. Richardson, J.G. (1986). The Forms of Capital. Handbook of Theory and Research for the Sociology of Education, Bloomsbury Academic.
93. Policy advice and best practices on bias and fairness in AI10.1007/s10676-024-09746-w ↗
94. Martínez-Martínez, O.A., Ramírez-López, A., Hernández Martínez, E.G., and Mac Kinney Romero, R. (2023). The multidimensionality of social wellbeing: Interactions from the individual to the collective level in large cities. Front. Sociol., 8.10.3389/fsoc.2023.1137797 ↗
95. Flick, U. (2018). An Introduction to Qualitative Research, Sage Publications. [6th ed.].
96. Virani, J., Shukla, M., Daredi, N., and Shah, P. (2023, January 23–24). Mental healthcare analysis using Power BI & machine learning. Proceedings of the 2023 4th International Conference on Signal Processing and Communication (ICSPC), Coimbatore, India.10.1109/ICSPC57692.2023.10125680 ↗
97. Reagan, K., Varde, A.S., and Xie, L. (2022, January 17–20). Evolving Perceptions of Mental Health on Social Media and their Medical Impacts. Proceedings of the 2022 IEEE International Conference on Big Data (Big Data), Osaka, Japan.10.1109/BigData55660.2022.10021013 ↗
98. Lin, F., and Liu, W. (2023, January 11–13). Research on intelligent analysis platform of students’ mental health based on big data computation. Proceedings of the 2023 IEEE 6th International Conference on Knowledge Innovation and Invention (ICKII), Sapporo, Japan.10.1109/ICKII58656.2023.10332736 ↗
99. Liu, Z., and Huang, F. (2021, January 2–4). Research on university mental health education based on computer big data statistical analysis. Proceedings of the 2021 2nd International Conference on Big Data and Informatization Education (ICBDIE), Hangzhou, China.10.1109/ICBDIE52740.2021.00015 ↗
100. Application of image super-resolution recognition and artificial intelligence system in repairing students’ psychological education problems10.1016/j.ypmed.2023.107590 ↗