Human Activity Signatures Captured under Different Directions Using SISO and MIMO Radar Systems
Source abstract
Abstract
In this paper, we highlight and resolve the shortcomings of single-input single-output (SISO) millimeter wave (mm-Wave) radar systems for human activity recognition (HAR). A 2×2 distributed multiple-input multiple-output (MIMO) radar framework is presented to capture human activity signatures under realistic conditions in indoor environments. We propose to distribute the two pairs of collocated transmitter–receiver antennas in order to illuminate the indoor environment from different perspectives. For the proposed MIMO system, we measure the time-variant (TV) radial velocity distribution and TV mean radial velocity to observe the signatures of human activities. We deploy the Ancortek SDR-KIT 2400T2R4 mm-Wave radar in a SISO as well as a 2×2 distributed MIMO configuration. We corroborate the limitations of SISO configurations by recording real human activities in different directions. It is shown that, unlike the SISO radar configuration, the proposed MIMO configuration has the ability to obtain superior human activity signatures for all directions. To signify the importance of the proposed 2×2 MIMO radar system, we compared the performance of a SISO radar-based passive step counter with a distributed MIMO radar-based passive step counter. As the proposed 2×2 MIMO radar system is able to detect human activity in all directions, it fills a research gap of radio frequency (RF)-based HAR systems.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced SAR Imaging Techniques · Radar Systems and Signal Processing · Microwave Imaging and Scattering Analysis
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Faculty of Engineering and Science, University of Agder, 4898 Grimstad, Norway
Funding
The Research Council of Norway
References (57)
Show source-provided references
1. Remote health monitoring of elderly through wearable sensors10.1007/s11042-018-7134-7 ↗
2. Vision-based human activity recognition system using depth silhouettes: A smart home system for monitoring the residents10.1007/s42835-019-00278-8 ↗
3. Surveillance video analysis for student action recognition and localization inside computer laboratories of a smart campus10.1007/s11042-020-09741-5 ↗
4. Mapping human–computer interaction research themes and trends from its existence to today: A topic modeling-based review of past 60 years10.1080/10447318.2020.1819668 ↗
5. An automated daily sports activities and gender recognition method based on novel multikernel local diamond pattern using sensor signals10.1109/TIM.2020.3003395 ↗
6. Human activity recognition-based path planning for autonomous vehicles10.1007/s11760-020-01800-6 ↗
7. A context-awareness model for activity recognition in robot-assisted scenarios10.1111/exsy.12481 ↗
8. Muaaz, M., Chelli, A., and Pätzold, M. (2020, January 25–28). WiHAR: From Wi-Fi channel state information to unobtrusive human activity recognition. Proceedings of the 2020 IEEE Vehicular Technology Conference, Antwerp, Belgium.10.1109/VTC2020-Spring48590.2020.9128418 ↗
9. WiWeHAR: Multimodal human activity recognition using Wi-Fi and wearable sensing modalities10.1109/ACCESS.2020.3022287 ↗
10. Device-free human activity recognition using commercial WiFi devices10.1109/JSAC.2017.2679658 ↗
11. Radar data cube processing for human activity recognition using multisubspace learning10.1109/TAES.2019.2910980 ↗
12. Wang, W., Liu, A.X., Shahzad, M., Ling, K., and Lu, S. (2015, January 7–11). Understanding and modeling of WiFi signal based human activity recognition. Proceedings of the 21st Annual International Conference on Mobile Computing and Networking, Paris, France.10.1145/2789168.2790093 ↗
13. Wang, W., Liu, A.X., and Shahzad, M. (2016, January 12–16). Gait recognition using WiFi signals. Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing, Heidelberg, Germany.10.1145/2971648.2971670 ↗
14. Continuous human motion recognition with a dynamic range-Doppler trajectory method based on FMCW radar10.1109/TGRS.2019.2908758 ↗
15. Waqar, S., Yusaf, H., Sana, S., Waqas, M., and Siddiqui, F.A. (2018, January 9–13). Reconfigurable monopulse radar tracking processor. Proceedings of the 2018 15th International Bhurban Conference on Applied Sciences and Technology (IBCAST), Islamabad, Pakistan.10.1109/IBCAST.2018.8312316 ↗
16. Radar signal processing for elderly fall detection: The future for in-home monitoring10.1109/MSP.2015.2502784 ↗
17. Erol, B., Amin, M.G., and Boashash, B. (2017, January 8–12). Range-Doppler radar sensor fusion for fall detection. Proceedings of the 2017 IEEE Radar Conference (RadarConf), Seattle, WA, USA.10.1109/RADAR.2017.7944316 ↗
18. Aspect angle dependence and multistatic data fusion for micro-Doppler classification of armed/unarmed personnel10.1049/iet-rsn.2015.0058 ↗
19. An integrated approach to weather radar calibration and monitoring using ground clutter and satellite comparisons10.1175/JTECH-D-18-0007.1 ↗
20. Watts, S. (2017, January 8–12). The ASV 21 maritime surveillance radar. Proceedings of the 2017 IEEE Radar Conference (RadarConf), Seattle, WA, USA.10.1109/RADAR.2017.7944165 ↗
21. Xiaodong, L., and Koga, T. (2014, January 8–10). DAPS based adaptive tracking system for high-assurance air traffic surveillance. Proceedings of the 2014 Integrated Communications, Navigation and Surveillance Conference (ICNS) Conference Proceedings, Herndon, VA, USA.10.1109/ICNSurv.2014.6820009 ↗
22. Analysis of the optimal frequency band for a ballistic missile defense radar system10.26866/jees.2018.18.4.231 ↗
23. Coherent detection and 3D tracking stages of a DVB-T based passive radar for terrestrial traffic monitoring10.1088/1757-899X/524/1/012002 ↗
24. Unmanned Aerial System (UAS) observations of water surface elevation in a small stream: Comparison of radar altimetry, LIDAR and photogrammetry techniques10.1016/j.rse.2019.111487 ↗
25. The ScanMars subsurface radar sounding experiment on AMADEE-1810.1089/ast.2019.2037 ↗
26. Margot, J.L. (2021). A Data-Taking System for Planetary Radar Applications. J. Astron. Instrum., 10.10.1142/S225117172150001X ↗
27. Automotive Radar—From First Efforts to Future Systems10.1109/JMW.2020.3033616 ↗
28. Liu, Z., Cai, Y., Wang, H., Chen, L., Gao, H., Jia, Y., and Li, Y. (2021). Robust target recognition and tracking of self-driving cars with radar and camera information fusion under severe weather conditions. IEEE Trans. Intell. Transp. Syst., 1–14.
29. Phase-coded FMCW automotive radar: System design and interference mitigation10.1109/TVT.2019.2953305 ↗
30. Microwave breast screening prototype: System miniaturization with IC pulse radio10.1109/JERM.2020.3029214 ↗
31. Segmented convolutional gated recurrent neural networks for human activity recognition in ultra-wideband radar10.1016/j.neucom.2018.11.109 ↗
32. Li, X., He, Y., and Jing, X. (2019). A survey of deep learning-based human activity recognition in radar. Remote Sens., 11.10.3390/rs11091068 ↗
33. Human activity detection and coarse localization outdoors using micro-Doppler signatures10.1109/JSEN.2019.2917375 ↗
34. Fall detection using deep learning in range-Doppler radars10.1109/TAES.2017.2740098 ↗
35. Liu, L., Popescu, M., Skubic, M., Rantz, M., Yardibi, T., and Cuddihy, P. (2011, January 23–26). Automatic fall detection based on Doppler radar motion signature. Proceedings of the 2011 5th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) and Workshops, Dublin, Ireland.
36. Liu, L., Popescu, M., Ho, K.C., Skubic, M., and Rantz, M. (September, January 28). Doppler radar sensor positioning in a fall detection system. Proceedings of the 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, San Diego, CA, USA.
37. Sana, S., Waqar, S., Yusaf, H., Waqas, M., and Siddiqui, F.A. (2016, January 12–16). Software defined digital beam forming processor. Proceedings of the 13th International Bhurban Conference on Applied Sciences and Technology, IBCAST 2016, Islamabad, Pakistan.10.1109/IBCAST.2016.7429952 ↗
38. Molchanov, P., Gupta, S., Kim, K., and Pulli, K. (2015, January 10–15). Short-range FMCW monopulse radar for hand-gesture sensing. Proceedings of the IEEE National Radar Conference-Proceedings, Arlington, VA, USA.10.1109/RADAR.2015.7131232 ↗
39. A hybrid FMCW-interferometry radar for indoor precise positioning and versatile life activity monitoring10.1109/TMTT.2014.2358572 ↗
40. Jian, M., Lu, Z., and Chen, V.C. (2018, January 23–27). Drone detection and tracking based on phase-interferometric Doppler radar. Proceedings of the 2018 IEEE Radar Conference (RadarConf18), Oklahoma City, OK, USA.10.1109/RADAR.2018.8378723 ↗
41. Extrapolation-RELAX estimator based on spectrum partitioning for DOA estimation of FMCW radar10.1109/ACCESS.2019.2930102 ↗
42. Fioranelli, F., Ritchie, M., and Griffiths, H. (2017, January 8–12). Bistatic human micro-Doppler signatures for classification of indoor activities. Proceedings of the 2017 IEEE Radar Conference (RadarConf), Seattle, WA, USA.10.1109/RADAR.2017.7944276 ↗
43. Abuduaini, A., Shiraki, N., Honma, N., Nakayama, T., and Iizuka, S. (2019, January 10–13). Performance evaluation of multiple human-body localization using bistatic MIMO radar. Proceedings of the 2019 IEEE Asia-Pacific Microwave Conference (APMC), Singapore.10.1109/APMC46564.2019.9038192 ↗
44. Berndt, D.J., and Clifford, J. (August, January 31). Using dynamic time warping to find patterns in time series. Proceedings of the 94 Workshop on Knowledge Discovery in Databases, Seattle, WA, USA.
45. Joint MIMO radar and communication system using a PSK-LFM waveform with TDM and CDM approaches10.1109/JSEN.2020.3043085 ↗
46. Chen, V.C. (2019). The Micro-Doppler Effect in Radar, Artech House.
47. Waqar, S., and Pätzold, M. (2021). Interchannel interference and mitigation in distributed MIMO RF sensing. Sensors, 21.10.3390/s21227496 ↗
48. High-resolution range-Doppler maps by coherent extension of narrowband pulses10.1109/TAES.2020.2965754 ↗
49. Muaaz, M., Waqar, S., and Matthias, P. (2021, January 11–13). Radar-based passive step counter and its comparison with a wrist-worn physical activity tracker. Proceedings of the 4th International Conference on Intelligent Technologies and Applications INTAP 2021, Grimstad, Norway.
50. Abdelgawwad, A., Borhani, A., and Pätzold, M. (2020). Modelling, analysis, and simulation of the micro-Doppler effect in wideband indoor channels with confirmation through pendulum experiments. Sensors, 20.10.3390/s20041049 ↗
51. Smoothing and differentiation of data by simplified least squares procedures10.1021/ac60214a047 ↗
52. Ismail, A., Abdlerazek, S., and El-Henawy, I.M. (2020). Development of smart healthcare system based on speech recognition using support vector machine and dynamic time warping. Sustainability, 12.10.3390/su12062403 ↗
53. Fugini, M., Finocchi, J., and Trasa, G. (2020, January 10–13). Gesture recognition using dynamic time warping. Proceedings of the Workshop on Enabling Technologies: Infrastructure for Collaborative Enterprises, Virtual.10.1109/WETICE49692.2020.00061 ↗
54. Smartphone-based gait recognition: From authentication to imitation10.1109/TMC.2017.2686855 ↗
55. Muaaz, M., and Mayrhofer, R. (2014, January 8–10). Orientation independent cell phone based gait authentication. Proceedings of the 12th International Conference on Advances in Mobile Computing and Multimedia, MoMM 2014, Kaohsiung, Taiwan.10.1145/2684103.2684152 ↗
56. Personnel recognition and gait classification based on multistatic micro-Doppler signatures using deep convolutional neural networks10.1109/LGRS.2018.2806940 ↗
57. Muaaz, M., Chelli, A., Gerdes, M.W., and Pätzold, M. (2021). Wi-Sense: A passive human activity recognition system using Wi-Fi and convolutional neural network and its integration in health information systems. Ann. Telecommun., 1–13.10.1007/s12243-021-00865-9 ↗