Human Activity Recognition Method Based on Edge Computing-Assisted and GRU Deep Learning Network
Source abstract
Abstract
Human Activity Recognition (HAR) has been proven to be effective in various healthcare and telemonitoring applications. Current HAR methods, especially deep learning, are extensively employed owing to their exceptional recognition capabilities. However, in pursuit of enhancing feature expression abilities, deep learning often introduces a trade-off by increasing Time complexity. Moreover, the intricate nature of human activity data poses a challenge as it can lead to a notable decrease in recognition accuracy when affected by additional noise. These aspects will significantly impair recognition performance. To advance this field further, we present a HAR method based on an edge-computing-assisted and GRU deep-learning network. We initially proposed a model for edge computing to optimize the energy consumption and processing time of wearable devices. This model transmits HAR data to edge-computable nodes, deploys analytical models on edge servers for remote training, and returns results to wearable devices for processing. Then, we introduced an initial convolution method to preprocess large amounts of training data more effectively. To this end, an attention mechanism was integrated into the network structure to enhance the analysis of confusing data and improve the accuracy of action classification. Our results demonstrated that the proposed approach achieved an average accuracy of 85.4% on the 200 difficult-to-identify HAR data, which outperforms the Recurrent Neural Network (RNN) method’s accuracy of 77.1%. The experimental results showcase the efficacy of the proposed method and offer valuable insights for the future application of HAR.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Context-Aware Activity Recognition Systems · IoT and Edge/Fog Computing · Non-Invasive Vital Sign Monitoring
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Computer Science and Technology, Hangzhou Dianzi University, Hangzhou 310018, China
Key Laboratory of Brain Machine Collaborative Intelligence of Zhejiang Province, Hangzhou 310018, China
School of Media and Design, Hangzhou Dianzi University, Hangzhou 310018, China
Funding
Natural Science Foundation of Zhejiang Province · National Natural Science Foundation of China
References (37)
Show source-provided references
1. A robust human activity recognition system using smartphone sensors and deep learning10.1016/j.future.2017.11.029 ↗
2. Enhancing pedestrian mobility in Smart Cities using Big Data
3. Context-Enriched Regular Human Behavioral Pattern Detection from Body Sensors Data10.1109/ACCESS.2019.2904122 ↗
4. Lytras, M.D., and Sarirete, A. (2020). Innovation in Health Informatics, Academic Press.
5. Zhang, S.B., Li, Y.X., Zhang, S., Shahabi, F., Xia, S., Deng, Y., and Alshurafa, N. (2022). Deep Learning in Human Activity Recognition with Wearable Sensors: A Review on Advances. Sensors, 22.10.3390/s22041476 ↗
6. IoT Wearable Sensor and Deep Learning: An Integrated Approach for Personalized Human Activity Recognition in a Smart Home Environment10.1109/JIOT.2019.2920283 ↗
7. Towards edge computing in intelligent manufacturing: Past, present and future10.1016/j.jmsy.2022.01.010 ↗
8. Recurrent inception convolution neural network for multi short-term load forecasting10.1016/j.enbuild.2019.04.034 ↗
9. Chollet, F. (2017, January 21–26). Xception: Deep Learning with Depthwise Separable Convolutions. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.195 ↗
10. EleAtt-RNN: Adding Attentiveness to Neurons in Recurrent Neural Networks10.1109/TIP.2019.2937724 ↗
11. Insight and perspectives for content delivery networks10.1145/1107458.1107462 ↗
12. The Case for VM-Based Cloudlets in Mobile Computing10.1109/MPRV.2009.82 ↗
13. Mobile device power models for energy efficient dynamic offloading at runtime10.1016/j.jss.2015.11.042 ↗
14. Mobile Edge Computing towards 5G: Vision, Recent Progress, and Open Challenges10.1109/CC.2016.7405725 ↗
15. Edge Computing: Vision and Challenges10.1109/JIOT.2016.2579198 ↗
16. The Emergence of Edge Computing10.1109/MC.2017.9 ↗
17. Wearable sensors for activity monitoring and motion control: A review
18. Human activity recognition based on smartphone and wearable sensors using multiscale DCNN ensemble10.1016/j.neucom.2020.04.151 ↗
19. Duan, L.T., Lawo, M., Wang, Z.G., and Wang, H.Y. (2022). Human Lower Limb Motion Capture and Recognition Based on Smartphones. Sensors, 22.10.3390/s22145273 ↗
20. Pienaar, S.W., and Malekian, R. (2019, January 18–20). Human Activity Recognition using LSTM-RNN Deep. Neural Network Architecture. Proceedings of the 2019 IEEE 2nd Wireless Africa Conference (WAC), Pretoria, South Africa.10.1109/AFRICA.2019.8843403 ↗
21. Münzner, S., Schmidt, P., Reiss, A., Hanselmann, M., Stiefelhagen, R., and Dürichen, R. CNN-based sensor fusion techniques for multimodal human activity recognition. Proceedings of the 2017 ACM International Symposium on Wearable Computers.10.1145/3123021.3123046 ↗
22. Ma, H., Li, W., Zhang, X., Gao, S., and Lu, S. (2019, January 10–16). AttnSense: Multi-level Attention Mechanism For Multimodal Human Activity Recognition. Proceedings of the International Joint Conferences on Artificial Intelligence Organization, Macao, China.10.24963/ijcai.2019/431 ↗
23. LSTM-CNN Architecture for Human Activity Recognition10.1109/ACCESS.2020.2982225 ↗
24. Beyond Frame-level CNN: Saliency-Aware 3-D CNN With LSTM for Video Action Recognition10.1109/LSP.2016.2611485 ↗
25. Fan, Y.C., Tseng, Y.H., and Wen, C.Y. (2022). A Novel Deep Neural Network Method for HAR-Based Team Training Using Body-Worn Inertial Sensors. Sensors, 22.10.3390/s22218507 ↗
26. Zhang, P., Zhang, Z.J., and Chao, H.C. (2020). A Stacked Human Activity Recognition Model Based on Parallel Recurrent Network and Time Series Evidence Theory. Sensors, 20.10.3390/s20144016 ↗
27. Ordonez, F.J., and Roggen, D. (2016). Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition. Sensors, 16.10.3390/s16010115 ↗
28. Hammerla, N.Y., Halloran, S., and Ploetz, T. (2016). Deep, Convolutional, and Recurrent Models for Human Activity Recogniti on Using Wearables. arXiv.
29. Stock Market Prediction Using Optimized Deep-ConvLSTM Model10.1089/big.2018.0143 ↗
30. InnoHAR: A Deep Neural Network for Complex Human Activity Recognition10.1109/ACCESS.2018.2890675 ↗
31. Real-time human activity recognition from accelerometer data using Convolutional Neural Networks10.1016/j.asoc.2017.09.027 ↗
32. TS-LSTM and temporal-inception: Exploiting spatiotemporal dynamics for activity recognition10.1016/j.image.2018.09.003 ↗
33. Interpretation of intelligence in CNN-pooling processes: A methodological survey10.1007/s00521-019-04296-5 ↗
34. A Review of Deep Learning Research
35. Akter, M., Ansary, S., Khan, M.A.-M., and Kim, D. (2023). Human Activity Recognition Using Attention-Mechanism-Based Deep Learning Feature Combination. Sensors, 23.10.3390/s23125715 ↗
36. Multi-input CNN-GRU based human activity recognition using wearable sensors10.1007/s00607-021-00928-8 ↗
37. A multibranch CNN-BiLSTM model for human activity recognition using wearable sensor data10.1007/s00371-021-02283-3 ↗