Human Activity Recognition Using CSI Information with Nexmon
Source abstract
Abstract
Using Wi-Fi IEEE 802.11 standard, radio frequency waves are mainly used for communication on various devices such as mobile phones, laptops, and smart televisions. Apart from communication applications, the recent research in wireless technology has turned Wi-Fi into other exploration possibilities such as human activity recognition (HAR). HAR is a field of study that aims to predict motion and movement made by a person or even several people. There are numerous possibilities to use the Wi-Fi-based HAR solution for human-centric applications in intelligent surveillance, such as human fall detection in the health care sector or for elderly people nursing homes, smart homes for temperature control, a light control application, and motion detection applications. This paper’s focal point is to classify human activities such as EMPTY, LYING, SIT, SIT-DOWN, STAND, STAND-UP, WALK, and FALL with deep neural networks, such as long-term short memory (LSTM) and support vector machines (SVM). Special care was taken to address practical issues such as using available commodity hardware. Therefore, the open-source tool Nexmon was used for the channel state information (CSI) extraction on inexpensive hardware (Raspberry Pi 3B+, Pi 4B, and Asus RT-AC86U routers). We conducted three different types of experiments using different algorithms, which all demonstrated a similar accuracy in prediction for HAR with an accuracy between 97% and 99.7% (Raspberry Pi) and 96.2% and 100% (Asus RT-AC86U), for the best models, which is superior to previously published results. We also provide the acquired datasets and disclose details about the experimental setups.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Indoor and Outdoor Localization Technologies · Context-Aware Activity Recognition Systems · Wireless Networks and Protocols
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Faculty 2: Computer Science and Engineering, Frankfurt University of Applied Sciences, 60318 Frankfurt, Germany
References (47)
Show source-provided references
1. Falls in older aged adults in 22 European countries: Incidence, mortality and burden of disease from 1990 to 201710.1136/injuryprev-2019-043347 ↗
2. Incidence of and risk factors for falls and injurious falls among the community-dwelling elderly10.1093/oxfordjournals.aje.a116681 ↗
3. Exploiting WiFi Channel State Information for Residential Healthcare Informatics10.1109/MCOM.2018.1700064 ↗
4. Zou, H., Zhou, Y., Yang, J., Jiang, H., Xie, L., and Spanos, C.J. (2018, January 12–15). WiFi-enabled Device-free Gesture Recognition for Smart Home Automation. Proceedings of the IEEE International Conference on Control and Automation, ICCA, IEEE Computer Society, Anchorage, AK, USA.10.1109/ICCA.2018.8444331 ↗
5. Nee, R.V., and Prasad, R. (2000). OFDM for Wireless Multimedia Communications, Artech House Inc.. [1st ed.].
6. Schulz, M., Wegemer, D., and Hollick, M. (2021, August 05). Nexmon: The C-based Firmware Patching Framework. Available online: https://nexmon.org.
7. Gringoli, F., Schulz, M., Link, J., and Hollick, M. (2019, January 25). Free Your CSI: A Channel State Information Extraction Platform For Modern Wi-Fi Chipsets. Proceedings of the 13th International Workshop on Wireless Network Testbeds, Experimental Evaluation & Characterization, WiNTECH’19, New York, NY, USA.10.1145/3349623.3355477 ↗
8. Schulz, M., Wegemer, D., and Hollick, M. (2015). NexMon: A Cookbook for Firmware Modifications on Smartphones to Enable Monitor Mode. arXiv.10.1145/2939918.2942419 ↗
9. Halperin, D. (2021, August 05). Linux 802.11n CSI Tool. Available online: http://dhalperi.github.io/linux-80211n-csitool/.
10. WiFi sensing with channel state information: A survey10.1145/3310194 ↗
11. Damodaran, N., and Schäfer, J. (2019, January 19–23). Device Free Human Activity Recognition using WiFi Channel State Information. Proceedings of the 2019 IEEE SmartWorld, Ubiquitous Intelligence Computing, Advanced Trusted Computing, Scalable Computing Communications, Cloud Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI), Leicester, UK.10.1109/SmartWorld-UIC-ATC-SCALCOM-IOP-SCI.2019.00205 ↗
12. Device free human activity and fall recognition using WiFi channel state information (CSI)10.1007/s42486-020-00027-1 ↗
13. Barrsiwal, B.R. (2021). Human Activity Recognition Using CSI Information with Raspberry Pi 3B+. [Master’s Thesis, Frankfurt University of Applied Sciences].
14. Kokhkharova, M. (2021). Device-Free Human Activity Recognition Using Channel State Information. [Master’s Thesis, Frankfurt University of Applied Sciences].
15. Adil, H. (2021). Human Activity Recognition Using WiFi Channel State Information (CSI). [Master’s Thesis, Frankfurt University of Applied Sciences].
16. Design and dementia: A case of garments designed to prevent undressing10.1177/1471301211416614 ↗
17. Bergelin, V. (2017). Human Activity Recognition and Behavioral Prediction using Wearable Sensors and Deep Learning, Linköping University. Available online: http://urn.kb.se/resolve?urn=urn:nbn:se:liu:diva-138064.
18. Shotton, J., Fitzgibbon, A., Cook, M., Sharp, T., Finocchio, M., Moore, R., Kipman, A., and Blake, A. (2011, January 20–25). Real-time human pose recognition in parts from single depth images. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Colorado Springs, CO, USA.10.1109/CVPR.2011.5995316 ↗
19. Bloessl, B., Sommer, C., and Dressler, F. (May, January 26). Power matters: Automatic Gain Control for a Software Defined Radio IEEE 802.11a/g/p receiver. Proceedings of the 2015 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS), Hong Kong, China.10.1109/INFCOMW.2015.7179325 ↗
20. (2021, August 05). Raspberry Pi Foundation. Available online: https://www.raspberrypi.org.
21. Tool release: Gathering 802.11n traces with channel state information10.1145/1925861.1925870 ↗
22. WiFall: Device-Free Fall Detection by Wireless Networks10.1109/TMC.2016.2557792 ↗
23. WiFi CSI-Based Human Activity Recognition Using Deep Recurrent Neural Network10.1109/ACCESS.2019.2956952 ↗
24. Deep Spatial–Temporal Model Based Cross-Scene Action Recognition Using Commodity WiFi10.1109/JIOT.2020.2973272 ↗
25. Forbes, G., Massie, S., and Craw, S. (2020, January 9–11). WiFi-based Human Activity Recognition using Raspberry Pi. Proceedings of the 2020 IEEE 32nd International Conference on Tools with Artificial Intelligence (ICTAI), Baltimore, MD, USA.10.1109/ICTAI50040.2020.00115 ↗
26. IEEE 802.11n: Enhancements for higher throughput in wireless LANs10.1109/MWC.2005.1561948 ↗
27. Samantha Albano (2021, August 05). WiFi Frequency Bands: 2.4 GHz and 5 GHz. Available online: https://www.minim.com/blog/wifi-frequency-bands-2.4-ghz-and-5-ghz.
28. Goldsmith, A. (2005). Wireless Communications, Cambridge University Press.10.1017/CBO9780511841224 ↗
29. (2021, August 05). IEEE Standard for Information Technology—Telecommunications and Information Exchange between Systems Local and Metropolitan Area Networks—Specific Requirements—Part 11: Wireless LAN Medium Access Control (MAC) and Physical Layer (PHY) Specifications. Available online: https://ieeexplore.ieee.org/document/5514475.
30. Intel Corporation (2021, August 05). Different Wi-Fi Protocols and Data Rates. Available online: https://www.intel.com/content/www/us/en/support/articles/000005725/network-and-i-o/wireless.html.
31. World Medical Association (2013). World Medical Association Declaration of Helsinki: Ethical principles for medical research involving human subjects. JAMA, 310, 2191–2194.10.1001/jama.2013.281053 ↗
32. Dobkin, D.M. (2013). Friis Equation—An Overview|ScienceDirect Topics, Elsevier.
33. Schäfer, J. (2014, January 6–8). Practical concerns of implementing machine learning algorithms for W-LAN location fingerprinting. Proceedings of the 2014 6th International Congress on Ultra Modern Telecommunications and Control Systems and Workshops (ICUMT), St. Petersburg, Russia.10.1109/ICUMT.2014.7002120 ↗
34. Tsakalaki, E., and Schäfer, J. (2018, January 15–18). On Application of the Correlation Vectors Subspace Method for 2-Dimensional Angle-Delay Estimation in Multipath OFDM Channels. Proceedings of the 2018 14th International Conference on Wireless and Mobile Computing, Networking and Communications (WiMob), Limassol, Cyprus.10.1109/WiMOB.2018.8589183 ↗
35. Tadayon, N., Rahman, M.T., Han, S., Valaee, S., and Yu, W. (2021, August 05). Decimeter Ranging with Channel State Information. Available online: https://arxiv.org/abs/1902.09652v1.
36. π-Splicer: Perceiving Accurate CSI Phases with Commodity WiFi Devices10.1109/TMC.2018.2793222 ↗
37. Gast, M. (2013). 2. The PHY—802.11ac: A Survival Guide. 802.11ac: A Survival Guide, O’Reilly Media. Available online: https://www.oreilly.com/library/view/80211ac-a-survival/9781449357702/ch02.html.
38. The MathWorks, Inc. (2021, August 05). PDF Documentation for MATLAB. Available online: https://de.mathworks.com/help/pdf_doc/matlab/index.html.
39. Luomala, J., and Hakala, I. (2015, January 13–16). Effects of temperature and humidity on radio signal strength in outdoor wireless sensor networks. Proceedings of the 2015 Federated Conference on Computer Science and Information Systems, FedCSIS 2015, Lodz, Poland.10.15439/2015F241 ↗
40. Boano, C.A., Wennerström, H., Zuniga, M., Brown, J., Keppitiyagama, C., Oppermann, F., Roedig, U., Norden, L.Å., Voigt, T., and Öömer, K. (2013). Hot Packets: A Systematic Evaluation of the Effect of Temperature on Low Power Wireless Transceivers, IEEE.
41. Dautov, C.P., and Ozerdem, M.S. (2018, January 2–5). Wavelet transform and signal denoising using Wavelet method. Proceedings of the 26th IEEE Signal Processing and Communications Applications Conference, SIU 2018, Izmir, Turkey.10.1109/SIU.2018.8404418 ↗
42. Nandy, A., Saha, J., Chowdhury, C., and Singh, K.P. (2019, January 18–20). Detailed human activity recognition using wearable sensor and smartphones. Proceedings of the 2019 International Conference on Opto-Electronics and Applied Optics, Kolkata, India.10.1109/OPTRONIX.2019.8862427 ↗
43. Wang, Y., Liu, J., Chen, Y., Gruteser, M., Yang, J., and Liu, H. (2014, January 7–11). E-eyes: Device-free location-oriented activity identification using fine-grained WiFi signatures. Proceedings of the Annual International Conference on Mobile Computing and Networking, MOBICOM, Maui, HI, USA.10.1145/2639108.2639143 ↗
44. Vapnik, V.N. (1995). The Nature of Statistical Learning Theory, Springer.10.1007/978-1-4757-2440-0 ↗
45. Phi, M. (2021, August 05). Illustrated Guide to Recurrent Neural Networks|By Michael Phi|Towards Data Science. Available online: https://towardsdatascience.com/illustrated-guide-to-recurrent-neural-networks-79e5eb8049c9.
46. Long Short-Term Memory10.1162/neco.1997.9.8.1735 ↗
47. Kingma, D.P., and Ba, J.L. (2015, January 7–9). Adam: A method for stochastic optimization. Proceedings of the 3rd International Conference on Learning Representations, ICLR 2015, Diego, CA, USA.