Long Short-Term Memory-Based Fall Detection by Frequency-Modulated Continuous Wave Millimeter-Wave Radar Sensor for Seniors Living Alone

In this study, four types of fall detection systems for seniors living alone using x-y scatter and Doppler range images measured from frequency-modulated continuous wave (FMCW) millimeter-wave (mmWave) sensors were introduced. Despite advancements in fall detection, existing long short-term memory (LSTM)-based approaches often struggle with effectively distinguishing falls from similar activities of daily living (ADLs) due to their uniform treatment of all time steps, potentially overlooking critical motion cues. To address this limitation, an attention mechanism has been integrated. Data was collected from seven participants, resulting in a dataset of 669 samples, including 285 falls and 384 ADLs with walking, lying, inactivity, and sitting. Four LSTM-based architectures for fall detection were proposed and evaluated: Raw-LSTM, Raw-LSTM-Attention, HOG-LSTM, and HOG-LSTM-Attention. The histogram of oriented gradient (HOG) method was used for feature extraction, while LSTM networks captured temporal dependencies. The attention mechanism further enhanced model performance by focusing on relevant input features. The Raw-LSTM model processed raw mmWave radar images through LSTM layers and dense layers for classification. The Raw-LSTM-Attention model extended Raw-LSTM with an added self-attention mechanism within the traditional attention framework. The HOG-LSTM model included an additional preprocessing step upon the RAW-LSTM model where HOG features were extracted and classified using an SVM. The HOG-LSTM-Attention model built upon the HOG-LSTM model by incorporating a self-attention mechanism to enhance the model’s ability to accurately classify activities. Evaluation metrics such as Sensitivity, Precision, Accuracy, and F1-Score were used to compare four architectural models. The results showed that the HOG-LSTM-Attention model achieved the highest performance, with an Accuracy of 95.3% and an F1-Score of 95.5%. Optimal self-attention configuration was found at a 2:64 ratio of number of attention heads to channels for keys and queries.