journal article·2022-01-17Open access

A CSI-Based Multi-Environment Human Activity Recognition Framework

Baha A. Alsaify, Mahmoud M. Almazari, Rami Alazrai, Sahel Alouneh, Mohammad I. Daoud

Applied Sciences· Volume 12· Issue 2

Abstract

Passive human activity recognition (HAR) systems, in which no sensors are attached to the subject, provide great potentials compared to conventional systems. One of the recently used techniques showing tremendous potential is channel state information (CSI)-based HAR systems. In this work, we present a multi-environment human activity recognition system based on observing the changes in the CSI values of the exchanged wireless packets carried by OFDM subcarriers. In essence, we introduce a five-stage CSI-based human activity recognition approach. First, the acquired CSI values associated with each recorded activity instance are processed to remove the existing noise from the recorded data. A novel segmentation algorithm is then presented to identify and extract the portion of the signal that contains the activity. Next, the extracted activity segment is processed using the procedure proposed in the first stage. After that, the relevant features are extracted, and the important features are selected. Finally, the selected features are used to train a support vector machine (SVM) classifier to identify the different performed activities. To validate the performance of the proposed approach, we collected data in two different environments. In each of the environments, several activities were performed by multiple subjects. The performed experiments showed that our proposed approach achieved an average activity recognition accuracy of 91.27%.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Indoor and Outdoor Localization Technologies · Context-Aware Activity Recognition Systems · Energy Efficient Wireless Sensor Networks

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Network Engineering and Security Department, Jordan University of Science and Technology, Irbid 22110, Jordan

Computer Engineering Department, German Jordanian University, Amman 11180, Jordan

College of Engineering, Al Ain University, Abu Dhabi Campus, Abu Dhabi 112612, United Arab Emirates

Funding

Jordan University of Science and Technology

References (68)

Show source-provided references
1. Husen, M.N., and Lee, S. (2014, January 9–11). Indoor human localization with orientation using WiFi fingerprinting. Proceedings of the 8th International Conference on Ubiquitous Information Management and Communication, Siem Reap, Cambodia.10.1145/2557977.2557980 ↗
2. Writing in the air with WiFi signals for virtual reality devices10.1109/TMC.2018.2831709 ↗
3. Novel approaches to human activity recognition based on accelerometer data10.1007/s11760-018-1293-x ↗
4. Computational model for the recognition of lower limb movement using wearable gyroscope sensor10.1504/IJSNET.2019.099230 ↗
5. Human activity classification in smartphones using accelerometer and gyroscope sensors10.1109/JSEN.2017.2782492 ↗
6. Depth maps-based human segmentation and action recognition using full-body plus body color cues via recognizer engine10.1007/s42835-018-00012-w ↗
7. Vemulapalli, R., Arrate, F., and Chellappa, R. (2014, January 23–28). Human action recognition by representing 3d skeletons as points in a lie group. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.10.1109/CVPR.2014.82 ↗
8. Why the Accuracy of the Received Signal Strengths as a Positioning Technique was not accurate?10.5121/ijwmn.2011.3306 ↗
9. Wang, X., Yang, C., and Mao, S. (2017, January 4–8). ResBeat: Resilient breathing beats monitoring with realtime bimodal CSI data. Proceedings of the GLOBECOM 2017—2017 IEEE Global Communications Conference, Singapore.10.1109/GLOCOM.2017.8255021 ↗
10. Attention-Based Gait Recognition and Walking Direction Estimation in Wi-Fi Networks10.1109/TMC.2020.3012784 ↗
11. Harke: Human activity recognition from kinetic energy harvesting data in wearable devices10.1109/TMC.2017.2761744 ↗
12. Comparative study on classifying human activities with miniature inertial and magnetic sensors10.1016/j.patcog.2010.04.019 ↗
13. Zubair, M., Song, K., and Yoon, C. (2016, January 26–28). Human activity recognition using wearable accelerometer sensors. Proceedings of the 2016 IEEE International Conference on Consumer Electronics-Asia (ICCE-Asia), Seoul, Korea.10.1109/ICCE-Asia.2016.7804737 ↗
14. Ugulino, W., Cardador, D., Vega, K., Velloso, E., Milidiú, R., and Fuks, H. (2012). Wearable computing: Accelerometers’ data classification of body postures and movements. Brazilian Symposium on Artificial Intelligence, Springer.10.1007/978-3-642-34459-6_6 ↗
15. Badawi, A.A., Al-Kabbany, A., and Shaban, H. (2018, January 3–6). Multimodal human activity recognition from wearable inertial sensors using machine learning. Proceedings of the 2018 IEEE-EMBS Conference on Biomedical Engineering and Sciences (IECBES), Sarawak, Malaysia.10.1109/IECBES.2018.8626737 ↗
16. Towards unsupervised physical activity recognition using smartphone accelerometers10.1007/s11042-015-3188-y ↗
17. Janidarmian, M., Roshan Fekr, A., Radecka, K., and Zilic, Z. (2017). A comprehensive analysis on wearable acceleration sensors in human activity recognition. Sensors, 17.10.3390/s17030529 ↗
18. Deep, S., and Zheng, X. (2019, January 27–29). Leveraging CNN and transfer learning for vision-based human activity recognition. Proceedings of the 2019 29th International Telecommunication Networks and Applications Conference (ITNAC), Auckland, New Zealand.10.1109/ITNAC46935.2019.9078016 ↗
19. Human Activity Recognition: A Survey10.1016/j.procs.2019.08.100 ↗
20. Skeleton embedded motion body partition for human action recognition using depth sequences10.1016/j.sigpro.2017.08.016 ↗
21. Wang, J., Liu, Z., Wu, Y., and Yuan, J. (2012, January 16–21). Mining actionlet ensemble for action recognition with depth cameras. Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA.
22. Oreifej, O., and Liu, Z. (2013, January 23–28). Hon4d: Histogram of oriented 4d normals for activity recognition from depth sequences. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA.10.1109/CVPR.2013.98 ↗
23. Li, W., Zhang, Z., and Liu, Z. (2010, January 13–18). Action recognition based on a bag of 3d points. Proceedings of the 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition-Workshops, San Francisco, CA, USA.10.1109/CVPRW.2010.5543273 ↗
24. Xia, L., Chen, C.C., and Aggarwal, J.K. (2012, January 16–21). View invariant human action recognition using histograms of 3d joints. Proceedings of the 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, Providence, RI, USA.10.1109/CVPRW.2012.6239233 ↗
25. Gu, Y., Liu, T., Li, J., Ren, F., Liu, Z., Wang, X., and Li, P. (2018, January 20–24). Emosense: Data-driven emotion sensing via off-the-shelf wifi devices. Proceedings of the 2018 IEEE International Conference on Communications (ICC), Kansas City, MO, USA.10.1109/ICC.2018.8422330 ↗
26. Wang, X., Yang, C., and Mao, S. (2017, January 5–8). PhaseBeat: Exploiting CSI phase data for vital sign monitoring with commodity WiFi devices. Proceedings of the 2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS), Atlanta, GA, USA.10.1109/ICDCS.2017.206 ↗
27. Gu, Y., Zhang, X., Liu, Z., and Ren, F. (2019). WiFi-based Real-time Breathing and Heart Rate Monitoring during Sleep. arXiv.10.1109/GLOBECOM38437.2019.9014297 ↗
28. An End-to-End Deep Learning Framework for Recognizing Human-to-Human Interactions Using Wi-Fi Signals10.1109/ACCESS.2020.3034849 ↗
29. A dataset for Wi-Fi-based human-to-human interaction recognition10.1016/j.dib.2020.105668 ↗
30. Walls Have No Ears: A Non-Intrusive WiFi-Based User Identification System for Mobile Devices10.1109/TNET.2018.2886411 ↗
31. Jakkala, K., Bhuya, A., Sun, Z., Wang, P., and Cheng, Z. (2019). Deep CSI Learning for Gait Biometric Sensing and Recognition. arXiv.
32. Device-free human activity recognition using commercial WiFi devices10.1109/JSAC.2017.2679658 ↗
33. WiFi CSI-Based Human Activity Recognition Using Deep Recurrent Neural Network10.1109/ACCESS.2019.2956952 ↗
34. WiFi CSI based passive human activity recognition using attention based BLSTM10.1109/TMC.2018.2878233 ↗
35. A survey on behavior recognition using wifi channel state information10.1109/MCOM.2017.1700082 ↗
36. Lagashkin, R. (2020). Human Localization and Activity Classification by Machine Learning on Wi-Fi Channel State Information. [Master’s Thesis, School of Electrical Engineering, Aalto University].
37. Nee, R.V., and Prasad, R. (2000). OFDM for Wireless Multimedia Communications, Artech House, Inc.
38. Fast transfer of channel state information in wireless systems10.1109/TSP.2006.870543 ↗
39. Impact of antenna correlation on the capacity of multiantenna channels10.1109/TIT.2005.850094 ↗
40. The blackford northbridge chipset for the intel 500010.1109/MM.2007.44 ↗
41. A dataset for Wi-Fi-based human activity recognition in line-of-sight and nonline-of-sight indoor environments10.1016/j.dib.2020.106534 ↗
42. Generalized hampel filters10.1186/s13634-016-0383-6 ↗
43. Nason, G.P. (2006). Statistics in Volcanology. Special Publications of IAVCEI, Geological Society of London.
44. Chowdhury, T.Z. (2018). Using Wi-Fi Channel State Information (CSI) for Human Activity Recognition and Fall Detection. [Ph.D. Thesis, University of British Columbia].
45. Levendis, J.D. (2018). Non-stationarity and ARIMA (p, d, q) Processes. Time Series Econometrics, Springer.10.1007/978-3-319-98282-3 ↗
46. Fuller, W.A. (2009). Introduction to Statistical Time Series, John Wiley & Sons.
47. Principal component analysis10.1016/0169-7439(87)80084-9 ↗
48. Deng, G., and Cahill, L. (November, January 31). An adaptive Gaussian filter for noise reduction and edge detection. Proceedings of the 1993 IEEE Conference Record Nuclear Science Symposium and Medical Imaging Conference, San Francisco, CA, USA.
49. Using penalized contrasts for the change-point problem10.1016/j.sigpro.2005.01.012 ↗
50. Optimal detection of changepoints with a linear computational cost10.1080/01621459.2012.737745 ↗
51. Linear predictive coding10.1109/45.1890 ↗
52. Line spectrum representation of linear predictor coefficients of speech signals10.1121/1.1995189 ↗
53. Distribution-free two-sample tests for scale10.1080/01621459.1976.10481517 ↗
54. Rey, D., and Neuhäuser, M. (2011). Wilcoxon-signed-rank test. International Encyclopedia of Statistical Science, Springer.10.1007/978-3-642-04898-2_616 ↗
55. Rank-Sum Tests for Dispersions10.1214/aoms/1177705688 ↗
56. A simple multiple variance ratio test10.1016/0304-4076(93)90051-6 ↗
57. Two sides of the same coin? Employing Granger causality tests in a time series cross-section framework10.1093/pan/mpn002 ↗
58. Engle, R.F. (1982). Autoregressive conditional heteroscedasticity with estimates of the variance of United Kingdom inflation. Econom. J. Econom. Soc., 987–1007.10.2307/1912773 ↗
59. Testing for cointegration: Power versus frequency of observation—Further Monte Carlo results10.1016/S0165-1765(99)00245-1 ↗
60. Estimating and interpreting the instantaneous frequency of a signal. I. Fundamentals10.1109/5.135376 ↗
61. Musical instrument timbres classification with spectral features10.1155/S1110865703210118 ↗
62. Feature selection based on mutual information: Criteria of max-dependency, max-relevance, and min-redundancy10.1109/TPAMI.2005.159 ↗
63. FallDeFi: Ubiquitous fall detection using commodity Wi-Fi devices10.1145/3161183 ↗
64. Wifall: Device-free fall detection by wireless networks10.1109/TMC.2016.2557792 ↗
65. End-to-End Deep Learning-Based Human Activity Recognition Using Channel State Information
66. Nakamura, T., Bouazizi, M., Yamamoto, K., and Ohtsuki, T. (2020, January 7–11). Wi-Fi-CSI-based Fall Detection by Spectrogram Analysis with CNN. Proceedings of the GLOBECOM 2020—2020 IEEE Global Communications Conference, Taipei, Taiwan.10.1109/GLOBECOM42002.2020.9322323 ↗
67. A WiFi-based Smart Home Fall Detection System using Recurrent Neural Network10.1109/TCE.2020.3021398 ↗
68. Multimodal CSI-based Human Activity Recognition using GANs10.1109/JIOT.2021.3080401 ↗