journal article·2022-05-27Open access

Detection of Walking Features Using Mobile Health and Deep Learning

Sungchul Lee, Hyunhwa Lee

Applied Sciences· Volume 12· Issue 11

Abstract

This study identifies seven human subjects’ walking features by training a deep learning model with sensor data. Using the proposed Mobile Health Application developed for collecting sensor data from an Android device, we collected data from human subjects with a history of mild traumatic brain injury. The sensors measure acceleration in m/s2 with respect to: the X, Y, and Z directions using an accelerometer, the rate of rotation around a spatial axis with a gyroscope, and nine parameters of a rotation vector with rotation vector components along the X, Y, Z axes using a rotation vector software-based sensor. We made a deep learning model using Tensorflow and Keras to identify the walking features of the seven subjects. The data are classified into the following categories: Accelerometer (X, Y, Z); Gyroscope (X, Y, Z); Rotation (X, Y, Z); Rotation vector (nine parameters); and a combination of the preceding categories. Each dataset was then used for training and testing the accuracy of the deep learning model. According to the Keras evaluation function, the deep learning model trained with Rotation vector data shows 99.5% accuracy for classifying walking characteristics of subjects. In addition, the ability of the model to accurately classify the characteristics of subjects’ walking with all datasets combined is 99.9%.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Traumatic Brain Injury Research · Context-Aware Activity Recognition Systems · Gait Recognition and Analysis

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Division of Computer Science and Engineering, Sun Moon University, Asan-si 31460, Korea

School of Nursing, University of Nevada, Las Vegas, NV 89154, USA

Funding

Sun Moon University Research Grant of 2021

References (28)

Show source-provided references
1. Temporal disruption of upper-limb anticipatory postural adjustments in cerebellar ataxic patients10.1007/s00221-014-4103-x ↗
2. Proof-of-Concept Testing of a Real-Time mHealth Measure to Estimate Postural Control During Walking: A Potential Application for Mild Traumatic Brain Injuries
3. Trunk recovery scale: A new tool to measure posture control in patients with severe acquired brain injury. A study of the psychometric properties
4. Vestibular optokinetic and cognitive contribution to the guidance of passive self-rotation toward instructed targets10.1007/s00221-003-1472-y ↗
5. Lee, H., Lee, S., Black, I., Salado, L., Estrada, J., and Isla, K. (2020). Long-Term Impact of Mild Traumatic Brain Injuries on Multiple Functional Outcomes and Epigenetics: A Pilot Study with College Students. Appl. Sci., 10.10.20944/preprints202001.0374.v1 ↗
6. The effects of mild traumatic brain injury on postural control10.1080/02699052.2016.1225982 ↗
7. Evaluation of Nintendo Wii Balance Board as a Tool for Measuring Postural Stability After Sport-Related Concussion10.4085/1062-6050-52.1.13 ↗
8. Tsuruoka, M., Tsuruoka, Y., Shibasaki, R., and Yasuoka, Y. (September, January 30). Spectral Analysis of Walking with Shoes and without Shoes. Proceedings of the 2006 International Conference of the IEEE Engineering in Medicine and Biology Society, New York, NY, USA.10.1109/IEMBS.2006.260349 ↗
9. Venugopalan, J., Cheng, C., Stokes, T.H., and Wang, M.D. (2013, January 3–7). Kinect-based rehabilitation system for patients with traumatic brain injury. Proceedings of the 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Osaka, Japan.10.1109/EMBC.2013.6610578 ↗
10. Heitger, M.H., Jones, R.D., and Anderson, T.J. (2008, January 20–25). A new approach to predicting postconcussion syndrome after mild traumatic brain injury based upon eye movement function. Proceedings of the 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Vancouver, BC, Canada.10.1109/IEMBS.2008.4649977 ↗
11. Petersen, E., Zech, A., and Hamacher, D. (2020). Walking barefoot vs. with minimalist footwear—Influence on gait in younger and older adults. BMC Geriatr., 20.10.1186/s12877-020-1486-3 ↗
12. Health and the mobile phone10.1016/j.amepre.2008.05.001 ↗
13. Health monitors for chronic disease by gait analysis with mobile phones10.1089/tmj.2014.0025 ↗
14. Embracing chaos: The scope and importance of clinical and pathological heterogeneity in mTBI10.1007/s11682-012-9162-7 ↗
15. Wearability assessment of a wearable system for Parkinson’s disease remote monitoring based on a body area network of sensors10.3390/s140917235 ↗
16. Accuracy of wearable physical activity trackers in people with Parkinson’s disease10.1016/j.gaitpost.2018.04.034 ↗
17. TensorFlow (2020, May 01). TensorFlow Core v2.2.0. Available online: https://www.tensorflow.org/api_docs/python/tf/keras/losses/CategoricalCrossentropy.
18. (2020, May 01). Keras. Available online: https://keras.io/.
19. (2020, April 10). Developers. Motion Sensors. Available online: https://developer.android.com/guide/topics/sensors/sensors_motion#sensors-motion-rotate.
20. Lee, S., Hwang, E., Kim, Y., Demir, F., Lee, H., Mosher, J.J., Jang, E., and Lim, K. (2022). Mobile Health App for Adolescents: Motion Sensor Data and Deep Learning Technique to Examine the Relationship between Obesity and Walking Patterns. Appl. Sci., 12.10.3390/app12020850 ↗
21. (2020, April 10). Developers. API reference. Available online: https://developer.android.com/reference.
22. Christopher, M. (2006). Bishop, Pattern Recognition and Machine Learning, Springer.
23. Nair, V., and Hinton, G.E. (2010, January 21–24). Rectified Linear Units Improve Restricted Boltzmann Machines. Proceedings of the 27th International Conference on Machine Learning, Haifa, Israel.
24. Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2016). System and Method for Addressing Overfitting in a Neural Network. (US 9406017B2), USA Patent.
25. Glorot, X., and Bengio, Y. (2010, January 13–15). Understanding the difficulty of training deep feedforward neural networks. Proceedings of the 13th International Conference, Sardinia, Italy.
26. Diederik, P., and Kingma, J.B. (2015, January 7–9). Adam: A Method for Stochastic Optimization. Proceedings of the 3rd International Conference for Learning Representations, San Diego, CA, USA.
27. Assessment of coma and impaired consciousness. A practical scale10.1016/S0140-6736(74)91639-0 ↗
28. The stages of recovery from severe head injury with special reference to late outcome