journal article·2023-08-02Open access

Photoplethysmographic Signal-Diffusive Dynamics as a Mental-Stress Physiological Indicator Using Convolutional Neural Networks

J. de Pedro-Carracedo, J. Clemente, D. Fuentes-Jimenez, M. F. Cabrera-Umpiérrez, A. P. Gonzalez-Marcos

Applied Sciences· Volume 13· Issue 15

Abstract

Stress is one of the primary triggers of serious pathologies (e.g., depression, obesity, heart attack). Prolonged exposure to it can lead to addictive substance consumption and even suicide, without ignoring other adverse side effects in the economic, work and family spheres. Early detection of stress would relax the pressure of medical practice exercised by the population affected and result in a healthier society with a more satisfying quality of life. In this work, a convolutional-neural-network (CNN) model is proposed to detect an individual’s stress state by analyzing the diffusive dynamics of the photoplethysmographic (PPG) signal. The characteristic (p,q)-planes of the 0–1 test serve as a framework to preprocess the PPG signals and feed the CNN with the dynamic information they supply to typify an individual’s stress level. The methodology follows CRISP-DM (Cross Industry Standard Process for Data Mining), which provides the typical steps in developing data-mining models. An adaptation of CRIPS-DM is applied, adding specific transitions between the usual stages of deep-learning models. The result is a CNN model whose performance amounts to 97% accuracy in diagnosing the stress level; it compares with other published results.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Non-Invasive Vital Sign Monitoring · Heart Rate Variability and Autonomic Control · ECG Monitoring and Analysis

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Life Supporting Technologies (LifeSTech), ETSI Telecomunicación, Universidad Politécnica de Madrid (UPM), E-28040 Madrid, Spain

Escuela Politécnica Superior, Departamento de Automática, Universidad de Alcalá (UAH), E-28871 Alcalá de Henares (Madrid), Spain

Escuela Politécnica Superior, Departamento de Electrónica, Universidad de Alcalá (UAH), E-28871 Alcalá de Henares (Madrid), Spain

References (84)

Show source-provided references
1. Competitiveness and stress10.1111/iere.12303 ↗
2. The impact of stress on body function: A review
3. Prevalence, Psychological Responses and Associated Correlates of Depression, Anxiety and Stress in a Global Population, During the Coronavirus Disease (COVID-19) Pandemic10.1007/s10597-020-00728-y ↗
4. World Health Organization (2023, February 14). Mental Health in the Workplace. Available online: https://www.who.int/teams/mental-health-and-substance-use/promotion-prevention/mental-health-in-the-workplace.
5. Chronic Stress, Drug Use and Vulnerability to Addiction10.1196/annals.1441.030 ↗
6. Stress and Health: A Review of Psychobiological Processes10.1146/annurev-psych-062520-122331 ↗
7. The cost of work-related stress to society: A systematic review10.1037/ocp0000069 ↗
8. World Health Organization (2023, February 14). Depression. Available online: https://www.who.int/es/news-room/fact-sheets/detail/depression.
9. The Impact of Acute Stress Physiology on Skilled Motor Performance: Implications for Policing10.3389/fpsyg.2019.02501 ↗
10. Stress and the General Adaptation Syndrome10.1136/bmj.1.4667.1383 ↗
11. From Psychological Stress to the Emotions: A History of Changing Outlooks10.1146/annurev.ps.44.020193.000245 ↗
12. Measuring acute stress response through physiological signals: Towards a quantitative assessment of stress10.1007/s11517-018-1879-z ↗
13. Center for Studies of Stress Human (2023, February 16). Acute vs. Chronic Stress. Available online: https://humanstress.ca/stress/understand-your-stress/acute-vs-chronic-stress/.
14. Stress resilience during the coronavirus pandemic10.1016/j.euroneuro.2020.05.003 ↗
15. The American Institute of Stress (2023, February 15). Digesting the Statistics of Workplace Stress. Available online: https://www.stress.org/workplace-stress.
16. Beyond Heart Rate Variability: Vagal Regulation of Allostatic Systems10.1196/annals.1366.014 ↗
17. The Concepts of Stress and Stress System Disorders10.1001/jama.1992.03480090092034 ↗
18. Project ES3: Attempting to quantify and measure the level of stress
19. Moraes, J., Rocha, M., Vasconcelos, G., Filho, J.V., de Albuquerque, V., and Alexandria, A. (2018). Advances in Photopletysmography Signal Analysis for Biomedical Applications. Sensors, 18.10.3390/s18061894 ↗
20. Photoplethysmography and its application in clinical physiological measurement10.1088/0967-3334/28/3/R01 ↗
21. Sancho, J., Alesanco, Á., and García, J. (2018). Biometric Authentication Using the PPG: A Long-Term Feasibility Study. Sensors, 18.10.3390/s18051525 ↗
22. On the Analysis of Fingertip Photoplethysmogram Signals10.2174/157340312801215782 ↗
23. A review on wearable photoplethysmography sensors and their potential future applications in health care
24. Use of Mobile Applications to Collect Data in Sport, Health and Exercise Science: A Narrative Review10.1519/JSC.0000000000002344 ↗
25. Application of photoplethysmogram for detecting physiological effects of tractor noise10.1016/j.eaef.2015.03.006 ↗
26. An efficient data compression and encryption technique for PPG signal10.1016/j.measurement.2017.11.006 ↗
27. Yadav, U., Abbas, S.N., and Hatzinakos, D. (2018, January 20–23). Evaluation of PPG Biometrics for Authentication in Different States. Proceedings of the 2018 International Conference on Biometrics (ICB), Gold Coast, QLD, Australia.10.1109/ICB2018.2018.00049 ↗
28. A simple method for detecting chaos in nature10.1038/s42003-019-0715-9 ↗
29. Computational Methods for Physiological Signal Processing and Data Analysis10.1155/2022/9861801 ↗
30. Park, J., Seok, H.S., Kim, S.S., and Shin, H. (2022). Photoplethysmogram Analysis and Applications: An Integrative Review. Front. Physiol., 12.10.3389/fphys.2021.808451 ↗
31. Measures of statistical complexity: Why?10.1016/S0375-9601(97)00855-4 ↗
32. Multi-Moment Multiscale Local Sample Entropy and Its Application to Complex Physiological Time Series10.1142/S0218127422501668 ↗
33. Generalized Shannon–Fisher index: An effective method to quantify the instability of multivariate time series10.1016/j.cnsns.2022.106904 ↗
34. A novel method to measure static and dynamic complexity of time series based on visualization curves10.1063/5.0119415 ↗
35. Deep learning for healthcare: Review, opportunities and challenges10.1093/bib/bbx044 ↗
36. Deep learning applications for IoT in health care: A systematic review10.1016/j.imu.2021.100550 ↗
37. Deep learning for healthcare applications based on physiological signals: A review10.1016/j.cmpb.2018.04.005 ↗
38. Secure and Robust Machine Learning for Healthcare: A Survey10.1109/RBME.2020.3013489 ↗
39. A new test for chaos in deterministic systems10.1098/rspa.2003.1183 ↗
40. Testing for chaos in deterministic systems with noise10.1016/j.physd.2005.09.011 ↗
41. An overview of 0–1 test for chaos10.1007/s40430-015-0453-y ↗
42. Chapman, P., Clinton, J., Kerber, R., Khabaza, T., Reinartz, T.P., Shearer, C., and Wirth, R. (2000). The CRISP-DM Consortium, NCR Systems Engineering Copenhagen (USA and Denmark), DaimlerChrysler AG (Germany), OHRA Verzekeringen en Bank Groep B.V.. Available online: https://api.semanticscholar.org/CorpusID:59777418.
43. De Pedro-Carracedo, J., Fuentes-Jimenez, D., Ugena, A.M., and Gonzalez-Marcos, A.P. (2021). Transcending Conventional Biometry Frontiers: Diffusive Dynamics PPG Biometry. Sensors, 21.10.3390/s21165661 ↗
44. Harmon-Jones, E., and Winkielman, P. (2007). Social Neuroscience: Integrating Biological and Psychological Explanations of Social Behavior, Guilford Press. Chapter 4.
45. De Pedro-Carracedo, J., Ugena, A.M., and Gonzalez-Marcos, A.P. (2021). Dynamical Analysis of Biological Signals with the 0–1 Test: A Case Study of the PhotoPlethysmoGraphic (PPG) Signal. Appl. Sci., 11.10.3390/app11146508 ↗
46. Bhagwat, R., Abdolahnejad, M., and Moocarme, M. (2019). Applied Deep Learning with Keras: Solve Complex Real-Life Problems with the Simplicity of Keras, Packt Publishing.
47. Raghu, M., Poole, B., Kleinberg, J.M., Ganguli, S., and Sohl-Dickstein, J. (2016). On the expressive power of deep neural networks. arXiv.
48. Dropout: A Simple Way to Prevent Neural Networks from Overfitting
49. Kingma, D., and Ba, J. (2014). Adam: A Method for Stochastic Optimization. arXiv.
50. Zeiler, M.D. (2012). ADADELTA: An Adaptive Learning Rate Method. arXiv.
51. Mukkamala, M.C., and Hein, M. (2017, January 6–11). Variants of RMSProp and Adagrad with Logarithmic Regret Bounds. Proceedings of the 34th International Conference on Machine Learning, Sydney, Australia.
52. The effect of batch size on the generalizability of the convolutional neural networks on a histopathology dataset10.1016/j.icte.2020.04.010 ↗
53. Géron, A. (2019). Hands-On Machine Learning with Scikit-Learn, Keras and TensorFlow: Concepts, Tools and Techniques to Build Intelligent Systems, O’Reilly Media.
54. Bonaccorso, G. (2017). Machine Learning Algorithms, Packt Publishing.
55. Interrater reliability: The kappa statistic10.11613/BM.2012.031 ↗
56. Delgado, R., and Tibau, X.A. (2019). Why Cohen’s Kappa should be avoided as performance measure in classification. PLoS ONE, 14.10.1371/journal.pone.0222916 ↗
57. Chicco, D., and Jurman, G. (2020). The advantages of the Matthews correlation coefficient (MCC) over F1 score and accuracy in binary classification evaluation. BMC Genom., 21.10.1186/s12864-019-6413-7 ↗
58. A survey of machine learning techniques in physiology based mental stress detection systems10.1016/j.bbe.2019.01.004 ↗
59. A Review on Mental Stress Detection Using Wearable Sensors and Machine Learning Techniques10.1109/ACCESS.2021.3085502 ↗
60. Elzeiny, S., and Qaraqe, M. (November, January 28). Machine Learning Approaches to Automatic Stress Detection: A Review. Proceedings of the 2018 IEEE/ACS 15th International Conference on Computer Systems and Applications (AICCSA), Aqaba, Jordan.10.1109/AICCSA.2018.8612825 ↗
61. Stress detection in daily life scenarios using smart phones and wearable sensors: A survey10.1016/j.jbi.2019.103139 ↗
62. Heart Rate Variability10.1111/j.1542-474X.1996.tb00275.x ↗
63. Linear and nonlinear analyses of heart rate variability signals under mental load10.1016/j.bspc.2022.103758 ↗
64. A Novel Rapid Assessment of Mental Stress by Using PPG Signals Based on Deep Learning10.1109/JSEN.2022.3208427 ↗
65. Review on Psychological Stress Detection Using Biosignals10.1109/TAFFC.2019.2927337 ↗
66. Lovisotto, G., Turner, H., Eberz, S., and Martinovic, I. (2020, January 14–19). Seeing Red: PPG Biometrics Using Smartphone Cameras. Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Seattle, WA, USA.10.1109/CVPRW50498.2020.00417 ↗
67. Stress Detection With Single PPG Sensor by Orchestrating Multiple Denoising and Peak-Detecting Methods10.1109/ACCESS.2021.3060441 ↗
68. Real-time mental stress detection technique using neural networks towards a wearable health monitor10.1088/1361-6501/ac3aae ↗
69. Stress Detection and Management: A Survey of Wearable Smart Health Devices10.1109/MCE.2017.2715578 ↗
70. Qualitative and quantitative evaluation of brain activity in emotional stress
71. McDuff, D., Gontarek, S., and Picard, R. (2014, January 26–30). Remote measurement of cognitive stress via heart rate variability. Proceedings of the 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Chicago, IL, USA.10.1109/EMBC.2014.6944243 ↗
72. Automatic human stress detection based on webcam photoplethysmographic signals10.1142/S0219519416500391 ↗
73. McDuff, D.J., Hernandez, J., Gontarek, S., and Picard, R.W. (2016, January 7–12). COGCAM. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, San Jose, CA, USA.10.1145/2858036.2858247 ↗
74. Stress Detection Using Wearable Physiological and Sociometric Sensors10.1142/S0129065716500416 ↗
75. Stress and anxiety detection using facial cues from videos10.1016/j.bspc.2016.06.020 ↗
76. An application of phonocardiography signals for psychological stress detection using non-linear entropy based features in empirical mode decomposition domain10.1016/j.asoc.2019.01.006 ↗
77. Mental Stress Assessment Using PPG Signal a Deep Neural Network Approach10.1080/03772063.2020.1844068 ↗
78. Bobade, P., and Vani, M. (2020, January 15–17). Stress Detection with Machine Learning and Deep Learning using Multimodal Physiological Data. Proceedings of the 2020 Second International Conference on Inventive Research in Computing Applications (ICIRCA), Coimbatore, India.10.1109/ICIRCA48905.2020.9183244 ↗
79. Stress Detection from Multimodal Wearable Sensor Data10.1088/1757-899X/771/1/012028 ↗
80. Bhanushali, S.P., Sadasivuni, S., Banerjee, I., and Sanyal, A. (2020, January 9–12). Digital Machine Learning Circuit for Real-Time Stress Detection from Wearable ECG Sensor. Proceedings of the 2020 IEEE 63rd International Midwest Symposium on Circuits and Systems (MWSCAS), Springfield, MA, USA.
81. Smart Wristband-Based Stress Detection Framework for Older Adults With Cortisol as Stress Biomarker10.1109/TCE.2021.3057806 ↗
82. Machine Learning Based Real-Time Diagnosis of Mental Stress Using Photoplethysmography
83. Paul, A., Chakraborty, A., Sadhukhan, D., Pal, S., and Mitra, M. (Preprint from Research Square, 2023). Mental stress detection using multimodal characterization of PPG signal for personal healthcare applications, Preprint from Research Square.10.21203/rs.3.rs-2589822/v1 ↗
84. Kyriacou, P., and Allen, J. (2021). Photoplethysmography: Technology, Signal Analysis and Applications, Elsevier.