Adapted Long Short-Term Memory (LSTM) for Concurrent\\ Human Activity Recognition
Source abstract
Abstract
In this era, deep learning methods offer a broad spectrum of efficient and original algorithms to recognize or predict an output when given a sequence of inputs. In current trends, deep learning methods using recent long short-term memory (LSTM) algorithms try to provide superior performance, but they still have limited effectiveness when detecting sequences of complex human activity. In this work, we adapted the LSTM algorithm into a synchronous algorithm (sync-LSTM), enabling the model to take multiple parallel input sequences to produce multiple parallel synchronized output sequences. The proposed method is implemented for simultaneous human activity recognition (HAR) using heterogeneous sensor data in a smart home. HAR assists artificial intelligence in providing services to users according to their preferences. The sync-LSTM algorithm improves learning performance and sees its potential for real-world applications in complex HAR, such as concurrent activity, with higher accuracy and satisfactory computational complexity. The adapted algorithm for HAR is also applicable in the fields of ambient assistive living, healthcare, robotics, pervasive computing, and astronomy. Extensive experimental evaluation with publicly available datasets demonstrates the competitive recognition capabilities of our approach. The sync-LSTM algorithm improves learning performance and has the potential for real-life applications in complex HAR. For concurrent activity recognition, our proposed method shows an accuracy of more than 97%.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Context-Aware Activity Recognition Systems · Anomaly Detection Techniques and Applications · Human Pose and Action Recognition
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (44)
Show source-provided references
1. Deep learning models for real-time human activity recognition with smartphones10.1007/s11036-019-01445-x ↗
2. Deep convolutional and LSTM recurrent neural networks for multimodal wearable activity recognition10.3390/s16010115 ↗
3. Hybrid speech recognition with deep bidirectional LSTM
4. Deep fragment embeddings for bidirectional image sentence mapping
5. An activity monitoring system for elderly care using generative and discriminative models10.1007/s00779-009-0277-9 ↗
6. Keeping the resident in the loop: Adapting the smart home to the user10.1109/TSMCA.2009.2025137 ↗
7. Human activity recognition with convolutional neural networks10.1007/978-3-030-10997-4_33 ↗
8. Introduction to machine learning & knowledge extraction (MAKE)10.3390/make1010001 ↗
9. Long short-term memory10.1162/neco.1997.9.8.1735 ↗
10. A deep machine learning method for concurrent and interleaved human activity recognition10.3390/s20205770 ↗
11. Generative image modeling using spatial LSTMs
12. Conditional random fields for activity recognition in smart environments
13. Deep learning for RFID-based activity recognition
14. Understanding neural networks through deep visualization
15. Gradient flow in recurrent nets: The difficulty of learning long-term dependencies
16. Long-term recurrent convolutional networks for visual recognition and description10.1109/TPAMI.2016.2599174 ↗
17. Two-layer hidden Markov model for human activity recognition in home environments
18. CIGAR: Concurrent and interleaving goal and activity recognition
19. The mobile sensing platform: An embedded activity recognition system10.1109/MPRV.2008.39 ↗
20. PARE: Profile-applied reasoning engine for context-aware system10.1177/155014775389091 ↗
21. Activity recognition from accelerometer data using symbolic data approach10.1007/978-981-13-2514-4_27 ↗
22. Evaluation of accelerometer based multi-sensor versus single-sensor activity recognition systems10.1016/j.medengphy.2014.02.012 ↗
23. A meta-analysis of neuropsychological outcome after mild traumatic brain injury: Re-analyses and reconsiderations of Binder et al. (1997), Frencham et al. (2005) and Pertab et al. (2009)10.1080/13854046.2011.565076 ↗
24. Deep, convolutional and recurrent models for human activity recognition using wearables
25. Joint recognition of multiple concurrent activities using factorial conditional random fields
26. Talukdar · IEEE Int. Conf. on Communication and Signal Processing 2017 · 2017 · 31710.1109/ICCSP.2017.8286369 ↗
27. Recognizing human actions: A local SVM approach
28. Human activity recognition model based on decision tree
29. State-space based linear modeling for human activity recognition in smart space
30. Log-viterbi algorithm applied on second-order hidden Markov model for human activity recognition10.1177/1550147718772541 ↗
31. Learning to forget: Continual prediction with LSTM10.1162/089976600300015015 ↗
32. Human activity recognition using deep belief networks
33. Favorite video classification based on multimodal bidirectional LSTM10.1109/ACCESS.2018.2876710 ↗
34. 3D Convolutional neural networks for human action recognition10.1109/TPAMI.2012.59 ↗
35. Deep learning-based human activity recognition framework for edge computing10.32604/cmc.2020.011740 ↗
36. LSTM neural network for beat classification in ECG identity recognition
37. Gradient-based learning applied to document recognition10.1109/5.726791 ↗
38. LSTM neural networks for language modeling
39. Bourlard · Connectionist Speech Recognition: A Hybrid Approach · 1994 · 24710.1007/978-1-4615-3210-1 ↗
40. Improving multistream classification by mapping sequence-embedding in a high dimensional space
41. Hybrid LSTM and encoder-decoder architecture for detection of image forgeries10.1109/TIP.2019.2895466 ↗
42. Concurrent activity recognition with multimodal CNN-LSTM structure
43. van Kasteren · Activity Recognition in Pervasive Intelligent Environments · 2011 · 16510.2991/978-94-91216-05-3_8 ↗
44. Collecting and disseminating smart home sensor data in the CASAS project