Wi-NN: Human Gesture Recognition System Based on Weighted KNN
Source abstract
Abstract
Gesture recognition, the basis of human–computer interaction (HCI), is a significant component for the development of smart home, VR, and senior care management. Most gesture recognition methods still depend on sensors worn by the user or video-based gestures for recognition, can be used for fine-grained gesture recognition. our paper implements a gesture recognition method that is independent of environment and gesture drawing direction, and it achieves gesture recognition classification by using small sample data. Wi-NN, proposed in this study, does not require the user to wear additional device. In this case, channel state information (CSI) extracted from Wi-Fi signal is used to capture the action information of the human body via CSI. After pre-processing to reduce the interference of environmental noise as much as possible, clear action information is extracted using the feature extraction method based on time domain to obtain the gesture action feature data. The gathered data are integrated with the weighted k-nearest neighbor (KNN) classification recognizer for classification task. The experiment outcomes revealed that the accuracy scores of the same gesture for different users and different gestures for the same user under the same environment were 93.1% and 89.6%, respectively. The experiments in different environments also achieved good recognition results, and by comparing with other experimental methods, the experiments in this paper have better recognition results. Evidently, good classification results were generated after the original data were processed and incorporated into the weighted KNN.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Indoor and Outdoor Localization Technologies · Wireless Networks and Protocols · Underwater Vehicles and Communication Systems
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Software, Xinjiang University, Urumqi 830091, China
Funding
natural science foundation of Xinjiang Uygur Autonomous Region
References (31)
Show source-provided references
1. Human-computer interaction in IoT smart home
2. Soli: Ubiquitous gesture sensing with millimeter wave radar10.1145/2897824.2925953 ↗
3. Nymoen, K., Haugen, M.R., and Jensenius, A.R. (June, January 31). MuMYO-Evaluating and Exploring the MYO Armband for Musical Interaction. Proceedings of the International Conference on New Interfaces for Musical Expression, Baton Rouge, LA, USA.
4. Research on key issues of vision-based gesture interfaces
5. RF-Dial: Rigid Motion Tracking and Touch Gesture Detection for Interaction via RFID Tags10.1109/TMC.2020.3017721 ↗
6. Human Motion Gesture Recognition Based on Computer Vision10.1155/2021/6679746 ↗
7. WiFi sensing with channel state information: A survey10.1145/3310194 ↗
8. Shangguan, L., Zhou, Z., and Jamieson, K. (2017, January 19–23). Enabling gesture-based interactions with objects. Proceedings of the 15th Annual International Conference on Mobile Systems, Applications, and Services, Niagara Falls, NY, USA.10.1145/3081333.3081364 ↗
9. RF-IDraw: Virtual touch screen in the air using RF signals10.1145/2740070.2626330 ↗
10. Zheng, Y., Zhang, Y., Qian, K., Zhang, G., Liu, Y., Wu, C., and Yang, Z. (2019). Proceedings of the 17th Annual International Conference on Mobile Systems, Applications, and Services, Seoul, Republic of Korea, 17–21 June 2019, ACM.
11. WiHF: Gesture and User Recognition with WiFi10.1109/TMC.2020.3009561 ↗
12. (2022, October 10). IEEE Dataport. Available online: https://ieee-dataport.org/open-access/widar30-wifi-based-activity-recognition-dataset.
13. Gkioxari, G., Girshick, R., Dollár, P., and He, K. (2018, January 18–23). Detecting and recognizing human-object interactions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00872 ↗
14. Xu, C., Pathak, P.H., and Mohapatra, P. (2015, January 12–13). Finger-writing with smartwatch: A case for finger and hand gesture recognition using smartwatch. Proceedings of the 16th International Workshop on Mobile Computing Systems and Applications, Santa Fe, NM, USA.10.1145/2699343.2699350 ↗
15. Wen, H., Ramos Rojas, J., and Dey, A.K. (2016, January 7–12). Serendipity: Finger gesture recognition using an off-the-shelf smartwatch. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, San Jose, CA, USA.10.1145/2858036.2858466 ↗
16. Real-time arm gesture recognition in smart home scenarios via millimeter wave sensing10.1145/3432208 ↗
17. Wang, W., Liu, A.X., and Sun, K. (2016, January 3–7). Device-free gesture tracking using acoustic signals. Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking, New York, NY, USA.10.1145/2973750.2973764 ↗
18. A survey on wireless indoor localization from the device perspective10.1145/2933232 ↗
19. Gu, Y., Zhu, Y., Li, J., and Ji, Y. (2021). Proceedings of the 2021 IEEE Global Communications Conference (GLOBECOM), Madrid, Spain, 7–11 December 2021, IEEE.
20. A Novel Approach in WiFi CSI-Based Fall Detection10.1007/s42979-022-01111-2 ↗
21. FallDeFi: Ubiquitous fall detection using commodity Wi-Fi devices10.1145/3161183 ↗
22. Guo, L., Wang, L., Liu, J., and Zhou, W. (2016). Proceedings of the 2016 12th International Conference on Mobile Ad-Hoc and Sensor Networks (MSN), Hefei, China, 16–18 December 2016, IEEE.
23. Rapid: A multimodal and device-free approach using noise estimation for robust person identification
24. Abdelnasser, H., Youssef, M., and Harras, K.A. (2015). Proceedings of the 2015 IEEE Conference on Computer Communications (INFOCOM), Kowloon, Hong Kong, 26 April–1 May 2015, IEEE.
25. Deep transfer learning for gesture recognition with WiFi signals10.1007/s00779-019-01360-8 ↗
26. Wu, W., Yang, B., Yu, H., and Wang, H. (2021). Proceedings of the 2021 IEEE MTT-S International Wireless Symposium (IWS), Nanjing, China, 23–26 May 2021, IEEE.
27. MoSense: An RF-based motion detection system via off-the-shelf WiFi devices10.1109/JIOT.2017.2754578 ↗
28. Cheng, L., and Wang, J. (2016, January 10–14). How can I guard my AP? Non-intrusive user identification for mobile devices using WiFi signals. Proceedings of the 17th ACM International Symposium on Mobile Ad Hoc Networking and Computing, Chennai, India.10.1145/2942358.2942373 ↗
29. Enabling fine-grained finger gesture recognition on commodity WiFi devices10.1109/TMC.2020.3045635 ↗
30. Jiang, W., Miao, C., Ma, F., Yao, S., Wang, Y., Yuan, Y., Xue, H., Song, C., Ma, X., and Koutsonikolas, D. (November, January 29). Towards environment independent device free human activity recognition. Proceedings of the 24th Annual International Conference on Mobile Computing and Networking, New Delhi, India.
31. WiFi cross-scene gesture recognition under multi-view adversarial network