journal article·2023-08-01Open access

Attention-Based Hybrid Deep Learning Network for Human Activity Recognition Using WiFi Channel State Information

Sakorn Mekruksavanich, Wikanda Phaphan, Narit Hnoohom, Anuchit Jitpattanakul

Applied Sciences· Volume 13· Issue 15

Abstract

The recognition of human movements is a crucial aspect of AI-related research fields. Although methods using vision and sensors provide more valuable data, they come at the expense of inconvenience to users and social limitations including privacy issues. WiFi-based sensing methods are increasingly being used to collect data on human activity due to their ubiquity, versatility, and high performance. Channel state information (CSI), a characteristic of WiFi signals, can be employed to identify various human activities. Traditional machine learning approaches depend on manually designed features, so recent studies propose leveraging deep learning capabilities to automatically extract features from raw CSI data. This research introduces a versatile framework for recognizing human activities by utilizing CSI data and evaluates its effectiveness on different deep learning networks. A hybrid deep learning network called CNN-GRU-AttNet is proposed to automatically extract informative spatial-temporal features from raw CSI data and efficiently classify activities. The effectiveness of a hybrid model is assessed by comparing it with five conventional deep learning models (CNN, LSTM, BiLSTM, GRU, and BiGRU) on two widely recognized benchmark datasets (CSI-HAR and StanWiFi). The experimental results demonstrate that the CNN-GRU-AttNet model surpasses previous state-of-the-art techniques, leading to an average accuracy improvement of up to 4.62%. Therefore, the proposed hybrid model is suitable for identifying human actions using CSI data.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Indoor and Outdoor Localization Technologies · Wireless Networks and Protocols · Energy Efficient Wireless Sensor Networks

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Computer Engineering, School of Information and Communication Technology, University of Phayao, Phayao 56000, Thailand

Department of Applied Statistics, Faculty of Applied Science, King Mongkut’s University of Technology North Bangkok, Bangkok 10800, Thailand

Department of Computer Engineering, Faculty of Engineering, Mahidol University, Nakhon Pathom 73170, Thailand

Department of Mathematics, Faculty of Applied Science, King Mongkut’s University of Technology North Bangkok, Bangkok 10800, Thailand

Intelligent and Nonlinear Dynamic Innovations Research Center, Science and Technology Research Institute, King Mongkut’s University of Technology North Bangkok, Bangkok 10800, Thailand

Funding

Thailand Science Research and Innovation Fund · University of Phayao · National Science, Research and Innovation Fund (NSRF) · King Mongkut’s University of Technology North Bangkok

References (37)

Show source-provided references
1. An Efficient ResNetSE Architecture for Smoking Activity Recognition from Smartwatch10.32604/iasc.2023.028290 ↗
2. Improved wolf swarm optimization with deep-learning-based movement analysis and self-regulated human activity recognition10.3934/math.2023629 ↗
3. RNN-based deep learning for physical activity recognition using smartwatch sensors: A case study of simple and complex activity recognition10.3934/mbe.2022265 ↗
4. Robust human activity recognition from depth video using spatiotemporal multi-fused features10.1016/j.patcog.2016.08.003 ↗
5. A Review of Deep Learning-based Human Activity Recognition on Benchmark Video Datasets10.1080/08839514.2022.2093705 ↗
6. Vrskova, R., Kamencay, P., Hudec, R., and Sykora, P. (2023). A New Deep-Learning Method for Human Activity Recognition. Sensors, 23.10.3390/s23052816 ↗
7. Shoaib, M., Bosch, S., Incel, O.D., Scholten, H., and Havinga, P.J.M. (2016). Complex Human Activity Recognition Using Smartphone and Wrist-Worn Motion Sensors. Sensors, 16.10.3390/s16040426 ↗
8. Transition-Aware Human Activity Recognition Using Smartphones10.1016/j.neucom.2015.07.085 ↗
9. Mekruksavanich, S., Hnoohom, N., and Jitpattanakul, A. (2022). A Hybrid Deep Residual Network for Efficient Transitional Activity Recognition Based on Wearable Sensors. Appl. Sci., 12.10.3390/app12104988 ↗
10. WiAct: A Passive WiFi-Based Human Activity Recognition System10.1109/JSEN.2019.2938245 ↗
11. Integrated Sensing and Communications: Toward Dual-Functional Wireless Networks for 6G and Beyond10.1109/JSAC.2022.3156632 ↗
12. Device-Free Human Activity Recognition Using Commercial WiFi Devices10.1109/JSAC.2017.2679658 ↗
13. RF-Sensing of Activities from Non-Cooperative Subjects in Device-Free Recognition Systems Using Ambient and Local Signals10.1109/TMC.2013.28 ↗
14. Muaaz, M., Chelli, A., and Pätzold, M. (2020, January 25–28). WiHAR: From Wi-Fi Channel State Information to Unobtrusive Human Activity Recognition. Proceedings of the 2020 IEEE 91st Vehicular Technology Conference (VTC2020-Spring), Antwerp, Belgium.10.1109/VTC2020-Spring48590.2020.9128418 ↗
15. CSI-Based Human Continuous Activity Recognition Using GMM–HMM10.1109/JSEN.2022.3198248 ↗
16. Dang, X., Cao, Y., Hao, Z., and Liu, Y. (2020). WiGId: Indoor Group Identification with CSI-Based Random Forest. Sensors, 20.10.3390/s20164607 ↗
17. Alsaify, B.A., Almazari, M.M., Alazrai, R., Alouneh, S., and Daoud, M.I. (2022). A CSI-Based Multi-Environment Human Activity Recognition Framework. Appl. Sci., 12.10.3390/app12020930 ↗
18. Moghaddam, M.G., Shirehjini, A.A.N., and Shirmohammadi, S. (2022, January 16–19). A WiFi-based System for Recognizing Fine-grained Multiple-Subject Human Activities. Proceedings of the 2022 IEEE International Instrumentation and Measurement Technology Conference (I2MTC), Ottawa, ON, Canada.10.1109/I2MTC48687.2022.9806622 ↗
19. A Survey on Behavior Recognition Using WiFi Channel State Information10.1109/MCOM.2017.1700082 ↗
20. WiFi CSI Based Passive Human Activity Recognition Using Attention Based BLSTM10.1109/TMC.2018.2878233 ↗
21. Abdelnasser, H., Youssef, M., and Harras, K.A. (May, January 26). WiGest: A ubiquitous WiFi-based gesture recognition system. Proceedings of the 2015 IEEE Conference on Computer Communications (INFOCOM), Hong Kong, China.10.1109/INFOCOM.2015.7218525 ↗
22. Gu, Y., Quan, L., and Ren, F. (2014, January 28–30). WiFi-assisted human activity recognition. Proceedings of the 2014 IEEE Asia Pacific Conference on Wireless and Mobile, Bali, Indonesia.
23. From RSSI to CSI: Indoor Localization via Channel Response10.1145/2543581.2543592 ↗
24. Toward Centimeter-Scale Human Activity Sensing with Wi-Fi Signals10.1109/MC.2017.7 ↗
25. Wang, Y., Liu, J., Chen, Y., Gruteser, M., Yang, J., and Liu, H. (2014, January 7–11). E-Eyes: Device-Free Location-Oriented Activity Identification Using Fine-Grained WiFi Signatures. Proceedings of the 20th Annual International Conference on Mobile Computing and Networking (MobiCom ’14), New York, NY, USA.10.1145/2639108.2639143 ↗
26. Wang, F., Panev, S., Dai, Z., Han, J., and Huang, D. (2019). Can WiFi Estimate Person Pose?. arXiv.
27. Moshiri, P.F., Shahbazian, R., Nabati, M., and Ghorashi, S.A. (2021). A CSI-Based Human Activity Recognition Using Deep Learning. Sensors, 21.10.3390/s21217225 ↗
28. Chahoushi, M., Nabati, M., Asvadi, R., and Ghorashi, S.A. (2023). CSI-Based Human Activity Recognition Using Multi-Input Multi-Output Autoencoder and Fine-Tuning. Sensors, 23.10.3390/s23073591 ↗
29. Elbayad, M., Besacier, L., and Verbeek, J. (2018). Pervasive Attention: 2D Convolutional Neural Networks for Sequence-to-Sequence Prediction. arXiv.10.18653/v1/K18-1010 ↗
30. Bidirectional recurrent neural networks10.1109/78.650093 ↗
31. Data Augmentation and Dense-LSTM for Human Activity Recognition Using WiFi Signal10.1109/JIOT.2020.3026732 ↗
32. LSTM-CNN network for human activity recognition using WiFi CSI data10.1088/1742-6596/1883/1/012139 ↗
33. CSITime: Privacy-preserving human activity recognition using WiFi channel state information10.1016/j.neunet.2021.11.011 ↗
34. Wang, W., Liu, A.X., Shahzad, M., Ling, K., and Lu, S. (2015, January 7–11). Understanding and Modeling of WiFi Signal Based Human Activity Recognition. Proceedings of the 21st Annual International Conference on Mobile Computing and Networking (MobiCom ’15), New York, NY, USA.10.1145/2789168.2790093 ↗
35. Kingma, D., and Ba, J. (2015, January 7–8). Adam: A Method for Stochastic Optimization. Proceedings of the 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA.
36. Cross-Validatory Choice and Assessment of Statistical Predictions10.1111/j.2517-6161.1974.tb00994.x ↗
37. Luong, T., Pham, H., and Manning, C.D. (2015, January 17–21). Effective Approaches to Attention-based Neural Machine Translation. Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, Lisbon, Portugal.10.18653/v1/D15-1166 ↗