journal article·2022Open access

Smart Deep Learning Based Human Behaviour Classification for Video Surveillance

Esam A. AlQaralleh, Fahad Aldhaban, Halah Nasseif, Malek Z. Alksasbeh, Bassam A. Y. Alqaralleh

Computers, Materials & Continua· Volume 72· Issue 3

Abstract

Real-time video surveillance system is commonly employed to aid security professionals in preventing crimes. The use of deep learning (DL) technologies has transformed real-time video surveillance into smart video surveillance systems that automate human behavior classification. The recognition of events in the surveillance videos is considered a hot research topic in the field of computer science and it is gaining significant attention. Human action recognition (HAR) is treated as a crucial issue in several applications areas and smart video surveillance to improve the security level. The advancements of the DL models help to accomplish improved recognition performance. In this view, this paper presents a smart deep-based human behavior classification (SDL-HBC) model for real-time video surveillance. The proposed SDL-HBC model majorly aims to employ an adaptive median filtering (AMF) based pre-processing to reduce the noise content. Also, the capsule network (CapsNet) model is utilized for the extraction of feature vectors and the hyperparameter tuning of the CapsNet model takes place utilizing the Adam optimizer. Finally, the differential evolution (DE) with stacked autoencoder (SAE) model is applied for the classification of human activities in the intelligent video surveillance system. The performance validation of the SDL-HBC technique takes place using two benchmark datasets such as the KTH dataset. The experimental outcomes reported the enhanced recognition performance of the SDL-HBC technique over the recent state of art approaches with maximum accuracy of 0.9922.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Video Surveillance and Tracking Methods · Human Pose and Action Recognition · Anomaly Detection Techniques and Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (24)

Show source-provided references
1. A new hybrid deep learning model for human action recognition10.1016/j.jksuci.2019.09.004 ↗
2. Relevant kinematic feature selection to support human action recognition in MoCap data
3. A study of vision-based human motion recognition and analysis10.4018/IJACI.2016070104 ↗
4. DeepPose: Human pose estimation via deep neural networks
5. Action recognition by dense trajectories
6. 3D convolutional neural networks for human action recognition10.1109/TPAMI.2012.59 ↗
7. Human action recognition using support vector machines and 3D convolutional neural networks10.26555/ijain.v3i1.89 ↗
8. Human action recognition based on convolutional neural networks with a convolutional auto-encoder
9. Vision-based human action recognition: An overview and real-world challenges
10. Real-time human detection as an edge service enabled by a lightweight CNN
11. Spatiotemporal anomaly detection using deep learning for real-time video surveillance10.1109/TII.2019.2938527 ↗
12. Intelligent video surveillance for real-time detection of suicide attempts10.1016/j.patrec.2018.03.018 ↗
13. Deep learning models for real-time human activity recognition with smartphones10.1007/s11036-019-01445-x ↗
14. Going deeper with two-stream ConvNets for action recognition in video surveillance10.1016/j.patrec.2017.08.015 ↗
15. Action recognition using optimized deep autoencoder and CNN for surveillance data streams of non-stationary environments10.1016/j.future.2019.01.029 ↗
16. Median filter-based wavelet transforms for multilevel noise10.5120/18818-0225 ↗
17. An adaptive median filtering of salt and pepper noise based on local pixel distribution
18. S. Sabour, F. Nicholas, and G. E. Hinton. “Dynamic routing between capsules,” arXiv preprint arXiv:1710.09829, 2017.
19. Emotion recognition from multiband EEG signals using CapsNet10.3390/s19092212 ↗
20. Gradient descent optimization in deep learning model training based on multistage and method combination strategy
21. Stacked sparse autoencoder (SSAE) for nuclei detection of breast cancer histopathology images10.1109/TMI.2015.2458702 ↗
22. A stacked autoencoder-based deep neural network for achieving gearbox fault diagnosis
23. Differential evolution–A simple and efficient heuristic for global optimization over continuous spaces10.1023/A:1008202821328 ↗
24. A new adjusting technique for PID type fuzzy logic controller using PSOSCALF optimization algorithm10.1016/j.asoc.2019.105822 ↗